WO2017097097A1 - 触摸控制方法、用户设备、输入处理方法、移动终端及智能终端 - Google Patents

触摸控制方法、用户设备、输入处理方法、移动终端及智能终端 Download PDF

Info

Publication number
WO2017097097A1
WO2017097097A1 PCT/CN2016/106171 CN2016106171W WO2017097097A1 WO 2017097097 A1 WO2017097097 A1 WO 2017097097A1 CN 2016106171 W CN2016106171 W CN 2016106171W WO 2017097097 A1 WO2017097097 A1 WO 2017097097A1
Authority
WO
WIPO (PCT)
Prior art keywords
touch
input
event
mobile terminal
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/106171
Other languages
English (en)
French (fr)
Inventor
李鑫
迟建华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nubia Technology Co Ltd
Original Assignee
Nubia Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nubia Technology Co Ltd filed Critical Nubia Technology Co Ltd
Priority to US15/781,955 priority Critical patent/US20180364865A1/en
Publication of WO2017097097A1 publication Critical patent/WO2017097097A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • G06F3/04166Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1626Constructional details or arrangements for portable computers with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1686Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated camera
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1694Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2200/00Indexing scheme relating to G06F1/04 - G06F1/32
    • G06F2200/16Indexing scheme relating to G06F1/16 - G06F1/18
    • G06F2200/161Indexing scheme relating to constructional details of the monitor
    • G06F2200/1614Image rotation following screen orientation, e.g. switching from landscape to portrait mode
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04104Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048Indexing scheme relating to G06F3/048
    • G06F2203/04803Split screen, i.e. subdividing the display area or the window area into separate subareas
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048Indexing scheme relating to G06F3/048
    • G06F2203/04808Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen

Definitions

  • the present invention relates to the field of communications, and in particular, to a touch control method, a user equipment, an input processing method, a mobile terminal, an intelligent terminal, and a computer storage medium.
  • the terminal frame is narrower and narrower.
  • edge input technology for example, edge touch
  • the driver layer determines whether the touch occurs in the edge input region according to the touch point information.
  • the method of obtaining the touch point information by the driver layer is also highly targeted, which leads to the need for each type when judging the event type (whether it is an edge input event).
  • the input chip is modified and ported differently, and the workload is large and error-prone.
  • the driver layer when the driver layer reports an event, it can select either the A protocol or the B protocol.
  • the B protocol distinguishes the finger ID.
  • the implementation of the edge input relies on the finger ID, which is used to compare the data of two clicks before and after the same finger when multi-point input. Therefore, the prior art input scheme can only support the B protocol, while the driver using the A protocol cannot be supported.
  • the edge touch area is fixed.
  • the edge touch area cannot be adaptively changed to control different display areas respectively.
  • the technical problem to be solved by the embodiments of the present invention is that the edge touch mode of the foregoing mobile terminal for the prior art cannot adapt to the defect of the split screen, and provides a touch control method, a user equipment, an input processing method, a mobile terminal, and an intelligent terminal.
  • the first aspect provides a touch control method, which is applied to a mobile terminal, where the mobile terminal includes a first display area and a second display area, including:
  • the corresponding instruction is executed based on the judgment result.
  • the angle of rotation comprises: 0 degrees of rotation, 90 degrees of clockwise rotation, 180 degrees of clockwise rotation, 270 degrees of clockwise rotation, 90 degrees of counterclockwise rotation, 180 degrees of counterclockwise rotation, and 260 counterclockwise rotation. degree.
  • the split screen status includes: upper and lower split screens and left and right split screens.
  • a second aspect provides a user equipment, where the user equipment includes a first display area and a second display area, including: a touch screen, a motion sensor, and a processor;
  • the touch screen includes: a touch panel and a touch controller, wherein:
  • a touch panel configured to detect a touch signal generated on the touch panel
  • a touch controller configured to recognize a touch point according to the touch signal
  • a motion sensor configured to detect a rotation angle of the user equipment
  • the processor includes: a driver module, an application framework module, and an application module, wherein:
  • the driving module is configured to acquire an input event according to the touch signal, and report the event to the application framework module;
  • the application framework module is configured to determine, according to the touched position of the reported input event, the rotation angle of the mobile terminal, and the split screen state, whether the touch point is located in an edge touch area or a normal touch area of the first display area, or is located at the first Displaying an edge touch area or a normal touch area of the area, and identifying the result according to the judgment result and reporting the recognition result to the application module;
  • the application module is configured to execute a corresponding instruction based on the judgment result.
  • the driving module, the application framework module, and the application module may use a central processing unit (CPU), a digital signal processor (DSP), or a programmable logic array when performing processing.
  • CPU central processing unit
  • DSP digital signal processor
  • FPGA Field-Programmable Gate Array
  • a third aspect provides an input processing method, which is applied to a mobile terminal, where the mobile terminal includes a first display area and a second display area, including:
  • the driver layer acquires an input event generated by the user through the input device, and reports it to the application framework layer;
  • the application framework layer determines whether the input event is an edge input event or a normal input event in the first display area or an edge input event in the second display area or is normal according to the end rotation angle of the mobile terminal, the split screen state, and the reported input event. Input an event, and identify the result according to the judgment result and report the recognition result to the application layer;
  • the application layer executes the corresponding instruction according to the reported recognition result.
  • the method further includes:
  • the creating an input device object having a device identifier for each input event includes:
  • the application framework layer sets a second input device object with the second device identifier and the edge input The event corresponds.
  • the driving layer acquiring an input event generated by the user through the input device and reporting to the application framework layer includes:
  • the driving layer assigns a number for distinguishing the finger to each touch point, and reports the input event by using the A protocol protocol.
  • the driving layer acquiring an input event generated by the user through the input device and reporting to the application framework layer includes:
  • the driving layer reports the input event by using the B protocol
  • the method further includes:
  • the application framework layer assigns a number for distinguishing a finger to each of the input events.
  • the current state of the mobile terminal includes: 0 degrees of rotation, 90 degrees of clockwise rotation, 180 degrees of clockwise rotation, 270 degrees of clockwise rotation, 90 degrees of counterclockwise rotation, 180 degrees of counterclockwise rotation, and inverse The hour hand rotates 270 degrees.
  • the split screen status includes: up and down split screens and left and right split screens.
  • a fourth aspect provides a mobile terminal, where the mobile terminal includes a first display area and a second display area, including:
  • a motion sensor configured to detect a current state of the mobile terminal
  • the driver layer is configured to obtain an input event generated by the user through the input device, and report the event to the application framework layer;
  • the application framework layer is configured to determine, according to the end rotation angle of the mobile terminal, the split screen state, and the reported input event, whether the input event is an edge input event or a normal input event in the first display area, or an edge input in the second display area. Event or normal input event, and identify according to the judgment result and report the recognition result to the application layer;
  • the application layer is configured to execute a corresponding instruction according to the reported recognition result.
  • the normal input event corresponds to a first input device object having a first device identification
  • the application framework layer is further configured to set a second input device object having a second device identifier for corresponding to the edge input event.
  • the driving layer reports an input event by using the A protocol or the B protocol. If the input event is reported by the A protocol, the event acquiring module is further configured to assign a number for distinguishing the finger to each touch point. ;
  • the application framework layer is further configured to assign a number for distinguishing the finger to each touch point.
  • the driver layer includes an event acquisition module configured to obtain an input event generated by a user through an input device.
  • the application framework layer includes an input reader
  • the mobile terminal further includes a device node disposed between the driver layer and the input reader, configured to notify the input reader to acquire an input event;
  • the input reader is configured to traverse the device node, obtain an input event, and report the event.
  • the current state of the mobile terminal includes: 0 degrees of rotation, 90 degrees of clockwise rotation, 180 degrees of clockwise rotation, 270 degrees of clockwise rotation, 90 degrees of counterclockwise rotation, 180 degrees of counterclockwise rotation, and inverse The hour hand rotates 270 degrees.
  • the application framework layer further includes: a first event processing module configured to perform coordinate calculation on the input event reported by the input reader and report the result;
  • the first judging module is configured to determine whether the input event is an edge input event according to the current state of the mobile terminal and the coordinate value reported by the first event processing module, and if not, the input event is reported.
  • the application framework layer further includes:
  • a second event processing module configured to perform coordinate calculation on the input event reported by the input reader and report the result
  • the second judging module is configured to determine whether the input event is an edge input event according to the current state of the mobile terminal and the coordinate value reported by the second event processing module, and if yes, report the input event.
  • the split screen status includes: up and down split screens and left and right split screens.
  • the application framework layer further includes:
  • the event dispatching module is configured to report the event reported by the second determining module and the first determining module.
  • the application framework layer further includes:
  • the third judging module is configured to determine whether the event is an edge input event according to the device identifier included in the event reported by the event dispatching module, and if yes, report the event to the first application module, otherwise report to the second application module.
  • the first application module is configured to identify a normal input event according to a relevant parameter of the normal input event, and report the recognition result to the application layer;
  • the second application module is configured to identify an edge input event according to a related parameter of the edge input event and report the recognition result to the application layer.
  • the input device is a touch screen of the mobile terminal
  • the touch screen includes at least one edge input area and at least one normal input area.
  • the input device is a touch screen of the mobile terminal
  • the touch screen includes at least one edge input zone, at least one normal input zone, and at least one transition zone.
  • the event obtaining module, the first event processing module, the first determining module, and the The second event processing module, the second determining module, the event dispatching module, the first application module, the second application module, and the third determining module may adopt a CPU and a DSP when performing processing. Or FPGA implementation.
  • a fifth aspect provides a smart terminal having a communication function, where the smart terminal includes a first display area and a second display area, and further includes: a touch screen, a motion sensor, and a processor;
  • the touch screen includes: a touch panel and a touch controller, wherein:
  • a touch panel configured to detect a touch signal generated on the touch panel
  • a touch controller configured to recognize a touch point according to the touch signal
  • a motion sensor configured to detect a rotation angle of the user equipment
  • the processor includes: a driver module, an application framework module, and an application module, wherein:
  • the driving module is configured to acquire an input event according to the touch signal, and report the event to the application framework module;
  • the application framework module is configured to determine, according to the touched position of the reported input event, the rotation angle of the mobile terminal, and the split screen state, whether the touch point is located in an edge touch area or a normal touch area of the first display area, or is located at the first Displaying an edge touch area or a normal touch area of the area, and identifying the result according to the judgment result and reporting the recognition result to the application module;
  • the application module is configured to execute a corresponding instruction based on the judgment result.
  • the driving module, the application framework module, and the application module may be implemented by using a CPU, a DSP, or an FPGA when performing processing.
  • a computer storage medium stores computer executable instructions configured to execute the touch control method and the input processing method.
  • the touch control method, the user equipment, the input processing method, the mobile terminal and the intelligent terminal of the present invention can realize the corresponding change of the edge touch area according to the rotation and the split screen state of the touch screen, so as to better adapt to the user's operation and improve the user.
  • the shelf layer performs the operations of distinguishing between the A zone and the C zone, and the virtual device is established in the application framework layer, thereby avoiding the dependence of the driver layer on the hardware of the A zone and the C zone; by setting the touch point number, the finger can be distinguished.
  • FIG. 1 is a schematic structural diagram of hardware of a mobile terminal according to an embodiment of the present invention.
  • FIG. 2 is a schematic diagram of a touch screen area division of a mobile terminal according to a first embodiment of the present invention
  • FIG. 3 is a schematic diagram of a top and bottom screen of a mobile terminal according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of coordinates of a touch panel according to an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of left and right split screens of a mobile terminal according to an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of coordinates of a touch panel according to an embodiment of the invention.
  • FIG. 7 is a schematic diagram of coordinates of a touch panel according to an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of coordinates of a touch panel according to an embodiment of the present invention.
  • FIG. 9 is a schematic flow chart of a touch control method according to an embodiment of the present invention.
  • FIG. 10 is a schematic diagram of a software architecture of a mobile terminal according to an embodiment of the present invention.
  • FIG. 11 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention.
  • FIG. 12 is a schematic flowchart of determining an input event according to a device identifier according to an embodiment of the present invention
  • FIG. 13 is a flowchart of an input processing method according to an embodiment of the present invention.
  • FIG. 14 is a schematic diagram showing an effect of opening a camera application of a mobile terminal of a top and bottom split screen when a rotation angle is 0 degrees by using an input processing method according to an embodiment of the present invention
  • FIG. 15 is a schematic diagram of a touch screen area division of a mobile terminal according to a second embodiment of the present invention.
  • FIG. 16 is a schematic diagram showing the hardware structure of a user equipment according to an embodiment of the present invention.
  • a mobile terminal includes an input device, a processor 903, and a display screen 904.
  • the input device is a touch screen 2010.
  • the touch screen 2010 includes a touch panel 901 and a touch controller 902.
  • the input device may also be a non-touch input device (eg, an infrared input device, etc.) or the like.
  • Touch controller 902 can be a single application specific integrated circuit (ASIC), which can include one or more processor subsystems, which can include one or more ARM processors or other processors with similar functions and capabilities.
  • ASIC application specific integrated circuit
  • the touch controller 902 is mainly used for receiving a touch signal generated by the touch panel 901, and processing the same to the processor 903 of the mobile terminal.
  • processing is, for example, analog-to-digital conversion of a physical input signal, processing to obtain touch point coordinates, processing to obtain a touch duration, and the like.
  • the processor 903 receives the output of the touch controller 902, performs processing, and performs an action based on the output.
  • the actions include, but are not limited to, moving an object such as a table or indicator, scrolling or panning, adjusting control settings, opening a file or document, viewing a menu, as a selection, executing an instruction, operating a peripheral device coupled to the host device Answering a phone call, making a call, terminating a phone call, changing volume or audio settings, storing information related to phone communications (eg, address, frequently used number, received call, missed call), logging in to a computer or computer network, allowing authorization An individual accesses a restricted area of a computer or computer network, records a user profile associated with a user preferences configuration of a computer desktop, allows access to network content, launches a particular program, encrypts or decodes a message, and the like.
  • the processor 903 is also coupled to the display screen 904.
  • Display 904 is used to provide a UI to a user of the device.
  • processor 903 can be a separate component from touch controller 902. In other embodiments, the processor 903 can be a composite component with the touch controller 902.
  • the touch panel 901 is provided with a discrete capacitive sensor, a resistive sensor, a force sensor, an optical sensor, or the like.
  • the touch panel 901 includes an electrode array made of a conductive material in a lateral direction and a longitudinal direction.
  • the touch controller 902 uses a self-capacitance scan, and then scans the M rows and the N columns respectively, according to each row and each column.
  • the signal is used to calculate the coordinates of the finger on the touch screen.
  • the number of scans is M+N times.
  • the touch controller 902 uses multi-contact mutual capacitance scanning to intersect the rows and columns. Scanning, whereby the number of scans is M ⁇ N times.
  • the touch panel When the user's finger touches the panel, the touch panel generates a touch signal (which is an electrical signal) to the touch controller 902.
  • the touch controller 902 can obtain the coordinates of the touched point by scanning.
  • the touch panel 901 of the touch screen 2010 is physically a set of independent coordinate positioning systems. After the touch point coordinates of the touch are reported to the processor 903, the processor 903 is converted to the display screen 904. Pixel coordinates to correctly identify the input operation.
  • FIG. 2 is a schematic diagram of area division of a touch panel according to a first embodiment of the present invention.
  • the touch panel of the touch screen is divided into three regions, wherein the C region 101 is an edge input region, and the A region 100 is a normal input region.
  • FIG. 2 is only an embodiment of a specific application scenario.
  • the embodiment of another specific application scenario is also applicable to a borderless mobile terminal.
  • the edge input area of the borderless terminal extends the A area outward to the side edge of the terminal edge, and the edge side is the edge of the terminal housing entity.
  • the edge input area is an area extending from the screen area to the side of the terminal edge.
  • the embodiment of the present invention is applicable to a narrow border or a borderless mobile terminal, fully utilizing the external size of the mobile terminal greatly expands the screen size of the mobile terminal, and satisfies the user's large The demand for the screen, at the same time, the edge input operation is diversified by the gesture calibration operation of the edge input area.
  • the input operation in the A area is processed according to the existing normal processing manner. For example, clicking an application icon in the A area 100 starts the application.
  • the input operation in the C area 101 it can be defined as an edge input processing mode.
  • a bilateral sliding in the C area 101 can be defined, that is, terminal acceleration is performed.
  • the C zone may be divided in a fixed manner or a custom partition.
  • Fixed division that is, a fixed length, fixed broadband area is set as the C area 101.
  • the C area 101 may include a partial area on the left side of the touch panel and a partial area on the right side, the positions of which are fixedly disposed on both side edges of the touch panel, as shown in FIG.
  • the C zone 101 can also be divided only at one side edge.
  • the custom division that is, the number, location, and size of the area of the C area 101
  • the basic graphic design of the C area 101 is a rectangle, and the position and size of the C area can be determined by inputting the coordinates of the two vertices of the diagonal of the graphic.
  • the embodiment of the present invention does not limit the division and setting manner of the C area.
  • the display screen 904 in the embodiment of the present invention is divided into a first display area 9041 and a second display area 9042.
  • the first display area 9041 and the second display area 9042 may be upper and lower split screen display, left and right split screen display, and size screen split screen display.
  • the implementation method of the split screen is prior art, and is not described in detail herein.
  • the upper left corner of the touch panel T0 is set as the coordinate origin, and the coordinate value is (0, 0).
  • the coordinate value of the lower right corner of the touch panel is T7 (W, H), where W is the width of the touch panel and H is the height of the touch panel.
  • the touch screen is divided into an A zone and a C zone as described above, and the A zone and the C zone belong to the same coordinate system.
  • the coordinates are also correspondingly divided. For example, if the width of the touch panel is W and the width of the C area is Wc, the touch points whose coordinates are located in the area defined by T0, T1, T4, and T5, and/or the coordinates are defined by T2, T3, T6, and T7.
  • a touch point within an area is defined as an edge touch point; and a touch point whose coordinates are located in an area defined by T1, T2, T5, and T6 is defined as a normal touch point.
  • the division of the A area and the C area of the corresponding touch panel is also adaptively changed.
  • the first edge touch area defined by T0, T1, P1, and P2 of the touch panel and/or the second edge touch area defined by T2, T3, P3, and P4 are taken as the first An edge touch area of a display area.
  • the fourth edge touch region defined by P1, P2, T4, T5 and/or the fifth edge touch region defined by P3, P4, T6, T7 is used as the edge touch region of the second display region.
  • the manner in which the edge touch regions of FIG. 4 are divided corresponds to the display screen 904 adopting the left and right split screen modes.
  • H1 is the height of the first display area and H2 is the height of the second display area.
  • the embodiment of the present invention does not limit the size of H1 and H2, that is, the first display area and the second display area may be the same size or different sizes.
  • Wc1 is the width of the edge touch area of the first display area
  • Wc2 is the width of the edge touch area of the second display area. In the embodiment of the present invention, Wc1 and Wc2 are equal.
  • the first edge touch region, the second edge touch region, the third edge touch region, and the fourth edge touch region respectively correspond to respective touch gestures and instructions corresponding to the touch gestures. For example, if the sliding operation is performed on the first edge touch area, the corresponding command is to open the application 1 and the third edge touch area to perform the sliding operation, and the corresponding instruction is to open the application 2 or the like.
  • the first edge touch area of the first display area may be The touch gestures and instructions in the third edge touch area of the domain and the second display area are set to be different, and the touch gestures in the second edge touch area of the first display area and the fourth edge touch area of the second display area are The instructions are set to different.
  • the touch gestures and instructions of the first display area and the second display area may also be set to be the same to facilitate the user's memory and operation.
  • the display screen 904 adopts the left and right split screen mode, for the convenience of operation, two edge touch areas on the left and right sides are disposed, corresponding to the first display area and the second display area, respectively.
  • the area defined by T0, T1, T4, and T5 on the touch panel is an edge touch area corresponding to the first display area; and the area defined by T2, T3, T6, and T7 is the second display area.
  • Corresponding edge touch area. Wc3 and Wc4 are the widths of the two edge touch regions, respectively.
  • the touch panel division method shown in FIG. 4 is converted into the division method shown in FIG. Specifically, the area defined by T0, T3, P5, and P6 is an edge touch area corresponding to the first display area (the width of which is Wc1). The area defined by T4, T7, P7, and P8 is an edge touch area (having a width Wc2) corresponding to the second display area.
  • the touch panel division manner shown in FIG. 5 is converted into the division manner shown in FIG. 8, specifically, the area defined by T0, P9, P15, and P16 and/or Or the area defined by T4, P11, P14, and P13 is an edge touch area corresponding to the first display area (having a width of Wc3 and a height of W1).
  • the area defined by T3, P10, P15, P16 and/or the area defined by T7, P12, P14, P13 is an edge touch area corresponding to the second display area (having a width of Wc4 and a height of W2). It should be understood that Wc3 and Wc4 may be equal.
  • W1 and W2 can be freely set to their size.
  • the coordinate system of the touch screen does not change, that is, regardless of the state of the touch screen of the mobile terminal in any of the above-mentioned FIGS. 7-8 or other rotation angles. (These rotation states can be detected by the motion sensor 906.)
  • the touch panel 901 receives the touch signal
  • the coordinates of the touched point reported by the touch controller 902 are all reported in the same coordinate system, and the rotation state of the touch screen is not paid attention to.
  • the display screen 904 also rotates correspondingly, and the processor 903 adaptively converts the coordinates reported by the touch controller 902 to adapt to the pixel coordinates of the display screen 904.
  • the correspondence between the rotation angle and the conversion method is stored in the memory 905, and such conversion will be described later.
  • the touch control method according to the embodiment of the present invention includes the following steps:
  • a touch controller detects the signal, and obtains physical coordinates of the touch point by scanning or the like.
  • a coordinate system as shown in FIG. 4 is employed.
  • the touch screen of the mobile terminal of the embodiment of the present invention is divided into an edge touch area and a normal touch area. Therefore, touch gestures of different areas are separately defined.
  • the touch gestures of the normal touch zone include: click, double tap, slide, and the like.
  • the touch gestures of the edge touch area include: sliding on the left edge, sliding on the left edge, sliding on the right edge, sliding on the right edge, bilateral sliding, bilateral sliding, holding the four corners of the mobile phone, sliding back and forth on one side, holding a grip One-handed grip.
  • the rotation angle of the mobile terminal can be obtained by detecting the rotation angle of the mobile terminal by the motion sensor.
  • the touch screen and display follow it.
  • the user may split the display screen by a manually set manner to divide the touch screen into a first display area and a second display area.
  • the split screen state can be obtained by the processor by detecting relevant setup parameters of the mobile terminal.
  • the processor determines the area to which the touch point belongs according to the physical coordinates reported by the touch controller.
  • the coordinate range of each area is stored in the memory, and specifically, the coordinates of the relevant points shown in FIG. 4, FIG. 6, FIG. 7, and FIG. 8 may be stored, thereby, according to these
  • the stored coordinate area touches the display area to which the touch point belongs, and whether it is in the normal touch area or the edge touch area.
  • the coordinate range of the edge touch area of the first display area is: the coordinates are located in the area defined by T0, T1, P1, P2, and/or the coordinates are located at T2, T3, P3. Within the area defined by P4.
  • the coordinate range of the first display area normal touch area is: the coordinates are located in the area defined by T1, T2, P3, and P2.
  • the coordinate range of the edge touch area of the second display area is: the coordinates are located in the area defined by P1, P2, T4, T5, and/or the coordinates are located in the area defined by P3, P4, T6, T7.
  • the second display area has a coordinate range of the normal touch area: the coordinates are located in the area defined by P2, T5, T6, and P3.
  • the coordinate range of the edge touch area of the first display area is: coordinates are located at T0, T3, P5, and P6.
  • the first display area normal touch area has a coordinate range in which the coordinates are located in the areas defined by P5, P5', P6', and P6.
  • the coordinate range of the edge touch area of the second display area is: the coordinates are located in the area defined by T4, T7, P7, and P8.
  • the second display area has a coordinate range of the normal touch area: the coordinates are located in the area defined by P5', P6', P7, and P8.
  • the coordinate range of the edge touch area of the first display area is: the coordinates are located in the area defined by T0, T1, T4, and T5.
  • the first display area normal touch area has a coordinate range in which the coordinates are located in the area defined by T2', T2, T6, and T6'.
  • the coordinate range of the edge touch area of the second display area is: coordinates are located at T0, T1, T4, and The area defined by T5, and/or the coordinates are located in the area defined by T2, T3, T6 and T7.
  • the second display area has a coordinate range of the normal touch area: the coordinates are located in the area defined by T2', T6', T5, and T1.
  • the coordinate range of the edge touch area of the first display area is: coordinates are located at T0, P9, P15, P16. Within the defined area, and/or the coordinates are located within the area defined by T4, P11, P14, P13.
  • the coordinate range of the normal touch area of the first display area is: the coordinates are located in the area defined by P9, P15, P14, and P11.
  • the coordinate range of the edge touch area of the second display area is: the coordinates are located in the area defined by T3, P10, P15, P16, and/or the coordinates are located in the area defined by T7, P12, P14, P13.
  • the second display area has a coordinate range of the normal touch area: the coordinates are located in the area defined by P16, P10, P12, and P14.
  • the conversion rules are:
  • the rotation angle is 0.
  • the coordinates reported by the touch controller are (xc,, yc), and no conversion is needed, that is, the coordinates of the display screen are also (xc, yc).
  • the coordinate reported by the touch controller is (xc, yc), and the converted coordinates are (yc, W-xc).
  • the coordinates reported by the touch controller are (xc, yc), and the converted coordinates are (W-xc, H-yc).
  • the coordinates reported by the touch controller are (xc, yc), and the converted coordinates are (H-yc, xc).
  • the first display area and the second The display area establishes a coordinate system.
  • the reported coordinates are scaled into coordinates corresponding to the two coordinate systems. For example, if the display screen of the mobile terminal is split up and down, and the first display area and the second display area are equal in size, if the reported coordinate is (xc, yc), the size is reduced by one-half (xc/). 2, yc/2). After zooming out, it can be determined whether the coordinates fall within the first display area or the second display area.
  • the coordinate conversion of the rotation should be performed before the coordinate conversion of the split screen is performed to ensure accuracy.
  • the above conversion rule is based on the same size of the display coordinate system and the size of the touch panel coordinate system (for example, both are 1080 ⁇ 1920 pixels), if the coordinate system of the display screen and the touch panel coordinate system If the size is different, after the above conversion, it is adjusted to adapt to the coordinates of the display screen. Specifically, the coordinates of the touch panel are multiplied by the corresponding conversion coefficients.
  • the conversion factor is the ratio of the size of the display to the touch panel. For example, if the touch panel is 720 ⁇ 1280 and the display screen is 1080 ⁇ 1920, the ratio of the display screen to the touch panel is 1.5, thereby multiplying the abscissa and the ordinate of the physical coordinates of the reported touch panel by 1.5, respectively. When it is (xc, yc), it is changed to (1.5 ⁇ xc, 1.5 ⁇ yc), or (1.5 ⁇ yc, 1.5 ⁇ W - xc), etc. when converted to display coordinates.
  • an accurate display can be realized, and the correct touch gesture can be recognized, thereby executing an instruction corresponding to the touch gesture.
  • the touch gesture is in one-to-one correspondence with the instructions and stored in the memory.
  • the touch control method of the embodiment of the invention can realize the transformation of the edge touch area according to the rotation of the touch screen and the split screen state of the display screen, so as to better adapt to the operation of the user and improve the user experience.
  • FIG. 10 is a schematic diagram of a software architecture of a mobile terminal according to an embodiment of the present invention.
  • the software architecture of the mobile terminal of the embodiment of the present invention includes: an input device 201, a driver layer 202, an application framework layer 203, and an application layer 204.
  • the functions of the driver layer 202, the application framework layer 203, and the application layer 204 are The processor 903 executes.
  • input device 201 is a touch screen that includes a touch panel and a touch controller.
  • the input device 201 receives the input operation of the user, converts the physical input into a touch signal, and transmits the touch signal to the driving layer 202; the driving layer 202 parses the input position to obtain parameters such as specific coordinates and duration of the touch point, and This parameter is uploaded to the application framework layer 203, and communication between the application framework layer 203 and the driver layer 202 can be implemented through a corresponding interface.
  • the application framework layer 203 receives the parameters reported by the driver layer 202, parses, distinguishes the edge input event and the normal input event, and passes the valid input to the specific application of the application layer 204 to meet the application layer 204 according to different Input operations perform different input operation instructions.
  • FIG. 11 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention.
  • the input device includes the touch screen 2010 described above.
  • the driver layer 202 includes an event acquisition module 2020.
  • a device node 2021 is disposed between the drive layer 202 and the application framework layer 203.
  • the application framework layer 203 includes an input reader 2030, a first event processing module 2031, a second event processing module 2032, a first determining module 2033, a second determining module 2034, and an event dispatching module 2035, and a third determining module. 2036.
  • the driving layer 202 includes an event obtaining module 2020 configured to acquire an input event generated by the user through the input device 201, for example, an input operation event through the touch screen.
  • the input events include a normal input event (A zone input event) and an edge input event (C zone input event).
  • Normal input events include input operations such as click, double click, and slide in Area A.
  • Edge input events include sliding on the left edge of Zone C, sliding of the left edge, sliding of the right edge, sliding of the right edge, bilateral sliding, bilateral sliding, holding the four corners of the phone, sliding back and forth, holding one Input operation such as grip, one-handed grip.
  • the event acquisition module 2020 is further configured to acquire related parameters such as coordinates, duration, and the like of the touch point of the input operation. If the input event is reported by the A protocol, the event acquisition module 2020 is further configured. It is set to assign a touch number (ID) to each touch point for distinguishing the finger. Therefore, if the input event is reported by the A protocol, the reported data includes parameters such as coordinates of the touched point, duration, and the number of the touched point.
  • ID touch number
  • a device node 2011 is disposed between the driver layer 202 and the input reader 2030, and is configured to notify the input reader 2030 of the application framework layer 203 to acquire an input event.
  • the input reader 2030 is configured to traverse the device node, obtain an input event, and report it. If the driver layer 202 reports an input event using the B protocol, the input reader 2030 is further configured to assign a number (ID) for distinguishing the finger to each touch point. In an embodiment of the invention, the input reader 2030 is further configured to store all of the element information (coordinates, duration, number, etc.) of the touch point.
  • each input event creates an input device object with a device identification.
  • a first input device object can be created for a normal input event with a first identity.
  • the first input device object corresponds to the actual hardware touch screen.
  • the application framework layer 203 further includes a second input device object (for example, an EDGE device), which is a virtual device, that is, an empty device, which has a second identifier configured to be input with an edge.
  • the event corresponds.
  • the edge input event may also correspond to the first input device object having the first identity and the normal control event corresponding to the second input device object having the second identity.
  • the first event processing module 2031 is configured to process an input event reported by the input reader 2030, for example, coordinate calculation of a touch point.
  • the second event processing module 2032 is configured to process an input event reported by the input reader 2030, for example, coordinate calculation of a touch point.
  • the first determining module 2033 is configured to determine whether the event is an edge input event based on the coordinate value (X value), and if not, upload the event to the event dispatching module 2035.
  • the second determining module 2034 is configured to determine whether the event is an edge input according to the coordinate value (X value) The event, if yes, uploads the event to the event dispatch module 2035.
  • the first judging module 2033 and the second judging module 2034 do not need to pay attention to the split screen and the rotation when judging, and only need to judge whether the coordinates of the touch point fall into the above-mentioned manner.
  • the first display area and/or the edge of the second display area may be within the coordinate range of the edge touch area.
  • the event dispatch module 2035 is configured to report the edge input event and/or the A zone input event to the third determination module 2036.
  • the edge input event is not the same as the channel used for the A zone input event escalation. Edge input events are reported on dedicated channels.
  • the event dispatching module 2035 is further configured to acquire the current state of the mobile terminal, and convert and adjust the reported coordinates according to the current state.
  • the current state includes a rotation angle and a split screen state.
  • the split screen state is obtained according to the detected related setting parameters of the mobile terminal.
  • the rotation angle includes: a rotation angle of 0 degrees, a clockwise 90 degrees, a clockwise 180 degrees, a clockwise 270 degrees, and the like. It should be understood that if it is rotated counterclockwise, the counterclockwise 90 degrees is the same as the clockwise 270 degrees, the counterclockwise 180 degrees is the same as the clockwise 180 degrees, and the counterclockwise 270 degrees is the same as the clockwise 90 degrees.
  • the split screen status includes: left and right split screens and upper and lower split screens.
  • a coordinate system will be established for the first display area and the second display area, respectively.
  • the reported coordinates are scaled into coordinates corresponding to the two coordinate systems. For example, if the display screen of the mobile terminal is split up and down, and the first display area and the second display area are equal in size, if the reported coordinate is (xc, yc), the size is reduced by one-half (xc/). 2, yc/2). After zooming out, it can be determined whether the coordinates fall within the first display area or the second display area.
  • the coordinate conversion of the rotation should be performed before the coordinate conversion of the split screen is performed to ensure accuracy.
  • the event dispatch module 2035 is implemented by inputdispatcher::dispatchmotion().
  • the third judging module 2036 is configured to determine whether the event is an edge input event according to the device identifier (ID). If it belongs, it is reported to the first application module 2037, otherwise it is reported to the second application module 2038.
  • the third determining module 2036 first obtains the device identifier, and determines whether it is a touch screen type device according to the device identifier; if yes, further determines whether the device identifier is the C region device identifier, that is, the second input.
  • the identifier of the device object if yes, is determined to be an edge input event, and if not, it is determined to be a normal input event.
  • the device identifier is an A-zone device identifier, that is, an identifier corresponding to the first input device, and if yes, determining that the device is a normal input event, and if not, determining that the device is an edge. Enter the event.
  • the first application module 2037 is configured to process an input event related to the input of the A zone. Specifically, the process includes: performing processing identification according to the touch point coordinates, duration, number, and the like of the input operation, The recognition result is reported to the application layer.
  • the second application module 2038 is configured to process an input event related to the input of the C zone. Specifically, the process includes: performing process identification according to the touch point coordinates, duration, and number of the processing operation, and reporting the recognition result to the application layer. For example, according to the coordinates, duration and number of the touched point, it can be recognized whether the input operation is a click or slide of the A area, or a single side of the C area.
  • the application layer 204 includes applications such as a camera, a gallery, a lock screen, etc. (Application 1, Application 2, ).
  • the input operations in the embodiments of the present invention include an application level and a system level, and the system level gesture processing also classifies it as an application layer.
  • the application level is the manipulation of the application, for example, on, off, volume control, and the like.
  • the system level is the manipulation of the mobile terminal, for example, power on, acceleration, inter-application switching, global return, and the like.
  • the application layer can obtain the input event of the C area by registering the Listener of the C area event, or can obtain the input event of the A area by registering the Listener of the A area event.
  • the mobile terminal sets and stores fingers corresponding to different input operations.
  • the command includes an instruction corresponding to the edge input operation and an instruction corresponding to the normal input operation.
  • the application layer receives the recognition result of the reported edge input event, that is, invokes a corresponding instruction according to the edge input operation in response to the edge input operation.
  • the application layer receives the recognition result of the reported normal input event, that is, calls the corresponding instruction according to the normal input operation in response to the normal input operation.
  • the input events of the embodiments of the present invention include input operations only in the A zone, input operations only in the C zone, and input operations simultaneously generated in the A zone and the C zone.
  • the instructions also include instructions corresponding to these three types of input events.
  • the embodiment of the present invention can implement the combination of the input operations of the A zone and the C zone to control the mobile terminal. For example, the input operation is to simultaneously click the corresponding positions of the A zone and the C zone, and the corresponding instruction is to close an application, and therefore, At the same time, click the input operation of the corresponding position in the A zone and the C zone to close the application.
  • the mobile terminal of the embodiment of the present invention can implement the transformation of the edge touch area according to the rotation of the touch screen and the state of the split screen, so as to better adapt to the operation of the user and improve the user experience; on the other hand, the difference is made in the application framework layer.
  • the operation of the A area and the C area, and the establishment of the virtual device in the application framework layer avoids the dependence of the driver layer on the hardware of the A area and the C area; by setting the touch point number, the finger can be distinguished, and the A protocol is compatible.
  • the input reader 2030 because of the input reader 2030, the first event processing module 2031, the second event processing module 2032, the first determining module 2033, the second determining module 2034, and the event dispatching module 2035, the third determining module 2036, the first
  • the functions of the application module 2037, the second application module 2038, and the like can be integrated into the operating system of the mobile terminal, and can be applied to different hardware and different types of mobile terminals, and the portability is good; the input reader (Automatic Input Reader) automatically All the elements of the touch point (coordinates, numbers, etc. of the touch points) are saved, which facilitates subsequent judgment of edge input (for example, FIT).
  • FIG. 13 is a flowchart of an input processing method according to an embodiment of the present invention, including the following steps:
  • the S1 and the driver layer acquire an input event generated by the user through the input device, and report it to the application framework layer.
  • the input device receives the input operation of the user (ie, inputs an event), and inputs the physical input. It is converted into an electrical signal and transmitted to the drive layer.
  • the input events include an A zone input event and a C zone input event.
  • Input events in Zone A include input operations such as click, double click, and slide in Zone A.
  • the input events in Zone C include sliding on the left edge of Zone C, sliding on the left edge, slipping on the right edge, sliding on the right edge, bilaterally sliding, bilateral sliding, sliding on one side, holding a grip, one hand Hold and other input operations.
  • the driving layer analyzes the input position according to the received electrical signal to obtain related parameters such as specific coordinates and duration of the touched point.
  • the relevant parameters are reported to the application framework layer.
  • step S1 further includes:
  • a number (ID) for distinguishing the finger is assigned to each touch point.
  • the driver layer reports the input event by using the A protocol
  • the reported data includes the above related parameters and the number of the touched point.
  • the application framework layer determines whether the input event is an edge input event or a normal input event. If it is a normal input event, step S3 is performed, and if the edge input event is performed, step S4 is performed.
  • the step S2 further includes: assigning a number (ID) for distinguishing the finger to each touch point; and performing all the element information (coordinates, duration, number, etc.) of the touch point. storage.
  • the finger by setting the touch point number, the finger can be distinguished, and the A protocol and the B protocol are compatible; and all the elements of the touch point (coordinates, numbers, and the like of the touch point) are stored, and the edge input can be subsequently determined (for example, , FIT) provides convenience.
  • the edge input event is not the same as the channel used for normal input event reporting. Edge input events use dedicated channels.
  • the application framework layer processes and identifies the normal input event, and reports the recognition result to Application layer.
  • the application framework layer processes and recognizes the edge input event, and reports the recognition result to the application layer.
  • the process identification includes: performing process identification according to touch point coordinates, duration, number, and the like of the input operation to determine an input operation. For example, according to the coordinates, duration, and number of the touched point, it is possible to recognize whether the input operation of the A area is clicked or swiped, or the input operation of the single-sided back and forth of the C area.
  • the application layer executes the corresponding instruction according to the reported recognition result.
  • the application layer includes applications such as a camera, a gallery, and a lock screen.
  • the input operations in the embodiments of the present invention include an application level and a system level, and the system level gesture processing also classifies it as an application layer.
  • the application level is the manipulation of the application, for example, on, off, volume control, and the like.
  • the system level is the manipulation of the mobile terminal, for example, power on, acceleration, inter-application switching, global return, and the like.
  • the mobile terminal sets and stores instructions corresponding to different input operations, including instructions corresponding to edge input operations and instructions corresponding to normal input operations.
  • the application layer receives the recognition result of the reported edge input event, that is, the corresponding instruction is invoked according to the edge input operation to respond to the edge input operation; the application layer receives the recognition result of the reported normal input event, that is, the corresponding input is invoked according to the normal input operation.
  • the instruction responds to the normal input operation.
  • the input events of the embodiments of the present invention include input operations only in the A zone, input operations only in the C zone, and input operations simultaneously generated in the A zone and the C zone.
  • the instructions also include instructions corresponding to these three types of input events.
  • the embodiment of the present invention can implement the combination of the input operations of the A zone and the C zone to control the mobile terminal. For example, the input operation is to simultaneously click the corresponding positions of the A zone and the C zone, and the corresponding instruction is to close an application, and therefore, At the same time, click the input operation of the corresponding position in the A zone and the C zone to close the application.
  • the input processing method of the embodiment of the present invention further includes:
  • a first input device object can be created for a normal input event having a first identity.
  • the first input device object corresponds to the input device touch screen.
  • the application framework layer sets a second input device object.
  • the second input device object (for example, a FIT device) is a virtual device, that is, an empty device, and has a second identifier for corresponding to an edge input event. It should be understood that the edge input event may also correspond to the first input device object having the first identity and the normal control event corresponding to the second input device object having the second identity.
  • the input processing method of the embodiment of the present invention further includes:
  • the application framework layer converts and adjusts the reported coordinates according to the rotation angle and the split screen state of the mobile terminal.
  • step S21 can be implemented by inputdispatcher::dispatchmotion().
  • step S22 Determine, according to the device identifier, whether the input event is an edge input event, if yes, execute step S3, and if not, perform step S4.
  • the device identifier determines, according to the device identifier, whether the input event is an edge input event, first obtain the device identifier, and determine whether the device is a touch screen type device according to the device identifier; if yes, further determine whether the device identifier is the C region device identifier. That is, the identifier of the second input device object is determined to be an edge input event, and if not, it is determined to be a normal input event.
  • the device identifier is an A-zone device identifier, that is, an identifier corresponding to the first input device, and if yes, determining that the device is a normal input event, and if not, determining that the device is an edge. Enter the event.
  • the input processing method of the embodiment of the invention can realize the corresponding change of the edge touch area according to the rotation and the split screen state of the touch screen, so as to better adapt to the user operation and improve the user experience; on the other hand, due to the application framework layer Perform the operation of distinguishing between the A area and the C area, and establish the virtual device in the application framework layer, thereby avoiding the dependence of the driver layer on the hardware of the A area and the C area; Set the touch point number to distinguish fingers, compatible with A protocol and B protocol; and can be integrated into the operating system of mobile terminal, can be applied to different hardware, different kinds of mobile terminals, good portability; all elements of touch points ( The coordinates, numbers, etc. of the touched points are stored, and subsequent determination of the edge input (for example, FIT) facilitates.
  • FIG. 14 it is a schematic diagram of an effect of opening a camera application of a mobile terminal of a top and bottom split screen mode by using an input processing method according to an embodiment of the present invention.
  • the figure on the left side of FIG. 13 is a schematic diagram of the main interface of the mobile terminal, wherein the area 1010 is a touch point preset in the edge input area (C area 101) of the first display area to enable an input operation of turning on the camera function. Specifically, clicking on the area 1010 can enable the camera to be turned on. Then, in the mobile terminal, an instruction is stored to: turn on the camera, which corresponds to the input operation of the click area 1010.
  • the user clicks on the area 1010 of the touch screen, and the driver layer acquires the input event and reports it to the application framework layer.
  • the application framework layer can determine that the input event is an edge input event according to the coordinates of the touch point.
  • the application framework layer processes and recognizes the edge input event, and recognizes the input operation as the click region 1010 according to the touch point coordinates, duration, and encoding.
  • the application framework layer reports the recognition result to the application layer, and the application layer executes an instruction to turn on the camera.
  • T region is added at the edge of the touch panel of the mobile terminal.
  • the current sliding is considered to be an edge gesture; if the input event starts from the C area and deviates to the A area, the edge gesture is considered to be ended. Normal input event; if the input event starts from the T area or the A area, it is considered that the current sliding event is a normal input event regardless of sliding to any area of the touch panel.
  • the reporting process of the input event of this embodiment is the same as the interaction control method described in the foregoing embodiment.
  • the application framework layer determines that the input event starts from the C area according to the touch point reported by an input event, and deviates to the A area (ie, the touch point coordinates at the start of the input are located in the C area, and a touch point in the input process)
  • the coordinate is located in the A area
  • the first judgment module and the second judgment module input the event as the edge input event according to the result of the coordinate judgment, and the edge input event ends, the normal input event starts, and the driver layer starts the next input event. Reported.
  • FIG. 16 is a schematic diagram of a hardware structure thereof.
  • the user device 1000 includes a touch screen 2010, a controller 200, a storage device 310, a GPS chip 320, a communicator 330, a video processor 340, an audio processor 350, a button 360, a microphone 370, a camera 380, a speaker 390, and an action.
  • the touch screen 2010 can be divided into an A zone and a C zone, or an A zone, a C zone, and a T zone as described above.
  • the touch screen 2010 can be implemented as various types of displays such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diode) display, and a PDP (Plasma Display Panel).
  • the touch screen 2010 may include a driving circuit that can be implemented, for example, as an a-si TFT, an LTPS (low temperature polysilicon) TFT, and an OTFT (organic TFT), and a backlight unit.
  • the touch screen 2010 may include a touch sensor for sensing a touch gesture of a user.
  • the touch sensor can be implemented as various types of sensors, such as a capacitor type, a resistance type, or a piezoelectric type.
  • the capacitance type calculates a touch coordinate value by sensing a micro current excited by a user's body when a portion of the user's body (eg, a user's finger) is touched on the surface of the touch screen coated with the conductive material.
  • the touch screen includes two electrode plates, and the touch coordinate value is calculated by sensing a current flowing when the upper and lower plates at the touch point are in contact when the user touches the screen.
  • the touch screen 2010 may sense a user gesture for using an input device such as a pen other than the user's finger.
  • an input device such as a pen other than the user's finger.
  • the user device 1000 may include a magnetic sensor (not shown) for sensing a magnetic field that changes according to the proximity of the coil within the stylus to the magnetic sensor.
  • the user device 1000 can also sense a proximity gesture, ie, the stylus hover over the user device 1000.
  • the storage device 310 can store various programs and data required for the operation of the user device 1000.
  • the storage device 310 can store programs and data for constructing various screens to be displayed on the respective areas (for example, the A area, the C area).
  • the controller 200 displays content on each area of the touch screen 2010 by using programs and data stored in the storage device 310.
  • the controller 200 includes a RAM 210, a ROM 220, a CPU (processor) 230, a GPU (Graphics Processing Unit) 240, and a bus 250.
  • the RAM 210, the ROM 220, the CPU 230, and the GPU 240 may be connected to each other through a bus 250.
  • the CPU 230 accesses the storage device 310 and performs booting using an operating system (OS) stored in the storage device 310. Moreover, the CPU 230 performs various operations by using various programs, contents, and data stored in the storage device 310.
  • OS operating system
  • the ROM 220 stores a set of commands for system startup.
  • the CPU 230 copies the OS stored in the storage device 310 to the RAM 210 according to the command set stored in the ROM 220, and starts the system by running the OS.
  • the CPU 230 copies the various programs stored in the storage device 310 to the RAM 210, and performs various operations by running the copy program in the RAM 210.
  • the GPU 240 can generate a screen including various objects such as icons, images, and text by using a calculator (not shown) and a renderer (not shown).
  • the calculator calculates feature values such as coordinate values, format, size, and color, wherein the objects are color-coded according to the layout of the screen, respectively.
  • the GPS chip 320 is a unit that receives GPS signals from a GPS (Global Positioning System) satellite, and calculates the current location of the user equipment 1000. When using the navigation program or when requesting the user's current position At the time, the controller 200 can calculate the position of the user by using the GPS chip 320.
  • GPS Global Positioning System
  • the communicator 330 is a unit that performs communication with various types of external devices in accordance with various types of communication methods.
  • the communicator 330 includes a WiFi chip 331, a Bluetooth chip 332, a wireless communication chip 333, and an NFC chip 334.
  • the controller 200 performs communication with various external devices by using the communicator 330.
  • the WiFi chip 331 and the Bluetooth chip 332 perform communication according to the WiFi method and the Bluetooth method, respectively.
  • various connection information such as a service set identifier (SSID) and a session key may be first transmitted and received, communication may be connected by using connection information, and each of the communication information may be transmitted and received.
  • SSID service set identifier
  • the wireless communication chip 333 is a chip that performs communication in accordance with various communication standards such as IEEE, Zigbee, 3G (third generation), 3GPP (3rd Generation Partnership Project), and LTE (Long Term Evolution).
  • the NFC chip 334 is a chip that operates according to an NFC (Near Field Communication) method using a bandwidth of 13.56 MHz among various RFID bandwidths, such as 135 kHz, 13.56 MHz, 433 MHz, 860 to 960 MHz, and 2.45. Jihe.
  • the video processor 340 is a unit that processes video data included in content received through the communicator 330 or content stored in the storage device 310.
  • Video processor 340 can perform various image processing for video data, such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion.
  • the audio processor 350 is a unit that processes audio data included in content received through the communicator 330 or content stored in the storage device 310.
  • the audio processor 350 can perform various processing for audio data, such as decoding, amplification, and noise filtering.
  • the controller 200 can reproduce the corresponding content by driving the video processor 340 and the audio processor 350 when the reproduction program is run for the multimedia content.
  • the speaker 390 outputs the audio data generated in the audio processor 350.
  • buttons 360 can be various types of buttons, such as mechanical buttons or at like user device 1000 A touch pad or a touch wheel formed on some areas such as the front side, the side surface, or the back side of the main outer body.
  • the microphone 370 is a unit that receives user voice or other sounds and converts them into audio data.
  • the controller 200 can use user voices input through the microphone 370 during the call process, or convert them into audio data and store them in the storage device 310.
  • the camera 380 is a unit that captures a still image or a video image according to a user's control.
  • Camera 380 can be implemented as a plurality of units, such as a front camera and a rear camera. As described below, camera 380 can be used as a means of obtaining a user image in an exemplary embodiment that tracks the user's gaze.
  • the controller 200 can perform a control operation according to a user's voice input through the microphone 370 or a user motion recognized by the camera 380. Therefore, the user equipment 1000 can operate in an action control mode or a voice control mode.
  • the controller 200 photographs the user by activating the camera 380, tracks changes in user actions, and performs corresponding operations.
  • the controller 200 can operate in the voice recognition mode to analyze the voice input through the microphone 370 and perform a control operation according to the analyzed user voice.
  • a voice recognition technology or a motion recognition technology is used in the above various exemplary embodiments. For example, when the user performs an action such as selecting an object marked on the home screen or speaking a voice command corresponding to the object, it may be determined that the corresponding object is selected and a control operation matching the object may be performed.
  • the motion sensor 906 is a unit that senses the movement of the body of the user device 1000.
  • User device 1000 can be rotated or tilted in various directions.
  • the motion sensor 906 can sense moving features such as rotational direction, angle, and slope by using one or more of various sensors such as a geomagnetic sensor, a gyro sensor, and an acceleration sensor. It should be understood that when the user device is rotated, correspondingly, the touch screen is also rotated and is rotated at the same angle as the user device.
  • the user device 1000 may further include a USB port connectable to a USB connector, for connecting like a headphone, a mouse, a LAN, and receiving and processing DMB (Digital Various input ports of various external components such as DMB chips for multimedia broadcast signals, and various other sensors.
  • a USB port connectable to a USB connector, for connecting like a headphone, a mouse, a LAN, and receiving and processing DMB (Digital Various input ports of various external components such as DMB chips for multimedia broadcast signals, and various other sensors.
  • DMB Digital Various input ports of various external components such as DMB chips for multimedia broadcast signals, and various other sensors.
  • the storage device 310 can store various programs.
  • a touch screen is configured to detect a touch signal generated on the touch panel and to recognize a touch point according to the touch signal.
  • a motion sensor configured to detect a rotation angle of the user equipment.
  • the processor includes: a driving module, an application framework module, and an application module;
  • the driving module is configured to acquire an input event according to the touch signal, and report the report to the application framework module;
  • the application framework module is configured to determine, according to the touched point position, the rotation angle, and the split screen state of the reported input event, whether the touch point is an edge touch area or a normal touch area located in the first display area, or an edge touch located in the second display area Area or normal touch area, and identify according to the judgment result and report the recognition result to the application module
  • the application module is configured to execute the corresponding instruction according to the reported recognition result.
  • the touch control method, the user equipment, the input processing method, the mobile terminal, and the intelligent terminal of the embodiment of the present invention can implement the transformation of the edge touch area according to the rotation of the touch screen and the state of the split screen, so as to better adapt to the operation of the user and improve the user.
  • the operation of the A and C areas is performed in the application framework layer, and the virtual device is established in the application framework layer, the dependence of the driver layer on the A and C areas on the hardware is avoided;
  • the terminal of the embodiments of the present invention may be implemented in various forms.
  • the terminal described in the present invention may include, for example, a smart terminal having a communication function, a mobile phone, a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (Personal Digital Assistant), a PAD (Tablet), a PMP (portable) Mobile devices of multimedia players, navigation devices, and the like, as well as stationary devices such as digital TVs, desktop computers, and the like.
  • Any process or method description in the flowcharts or otherwise described in the embodiments of the invention may be understood to represent code that includes one or more executable instructions for implementing the steps of a particular logical function or process. Modules, segments or portions, and the scope of the embodiments of the invention includes additional implementations, in which the functions may be performed in a substantially simultaneous manner or in an inverse order depending on the functions involved, in the order shown or discussed. This should be understood by those skilled in the art of the embodiments of the present invention.
  • the touch control method, the user equipment, the input processing method, the mobile terminal and the intelligent terminal of the present invention can realize the corresponding change of the edge touch area according to the rotation and the split screen state of the touch screen, so as to better adapt to the user's operation and improve the user.
  • the operations of the A and C zones are differentiated in the application framework layer, and the virtual device is established in the application framework layer, the dependence of the driver layer on the hardware of the A zone and the C zone is avoided; by setting the touch point number , can achieve finger differentiation, compatible with A protocol and B protocol; and can be integrated into the operating system of the mobile terminal, can be applied to different hardware, Different kinds of mobile terminals have good portability; all the elements of the touch point (coordinates, numbers, etc. of the touch points) are stored, and the edge input (for example, FIT) can be judged later to facilitate.
  • the edge input for example, FIT

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种触摸控制方法、用户设备、输入处理方法、移动终端及智能终端、计算机存储介质,其中,所述触摸控制方法包括:检测产生于触摸面板上的触摸信号(S100);根据触摸信号识别触摸点(S101);检测移动终端的分屏状态及旋转角度;根据识别出的触摸点、旋转角度及分屏状态,判断触摸点是位于第一显示区域的边缘触摸区域或正常触摸区域,还是位于第二显示区域的边缘触摸区域或正常触摸区域(S102);基于判断结果执行相应的指令(S103)。

Description

触摸控制方法、用户设备、输入处理方法、移动终端及智能终端 技术领域
本发明涉及通讯领域,更具体地说,涉及一种触摸控制方法、用户设备、输入处理方法、移动终端及智能终端、计算机存储介质。
背景技术
随着移动终端技术的发展,终端边框越做越窄。为了改善用户的输入体验,边缘输入技术(例如,边缘触控)应运而生。
现有技术的边缘输入,当检测触摸点信息(touch info)后,在驱动层即根据触摸点信息判断触控是否发生在边缘输入的区域。
然而,在实际中由于输入芯片存在多样性,驱动层获取触摸点信息的方法也都带有极强的针对性,这就导致在判断事件类型(是否为边缘输入事件)时,需要对各款输入芯片做差异化的修改和移植,工作量较大且容易出错。
另一方面,驱动层在上报事件时,可以选择A协议或者B协议两种实现方式,其中B协议会区分手指ID。而边缘输入的实现需要依赖手指ID,在多点输入时用于对比同一手指前后两次点击的数据。因此,现有技术的输入方案仅能支持B协议,而采用A协议的驱动则不能得到支持。
再者,现有技术中,边缘触摸区域是固定的,当移动终端的显示屏发生分屏时,边缘触摸区域不能适应性的变换以便分别对不同的显示区域进行控制。
因此,现有技术存在缺陷,需要改进。
发明内容
本发明实施例要解决的技术问题在于,针对现有技术的上述移动终端的边缘触摸方式不能适应分屏的缺陷,提供一种触摸控制方法、用户设备、输入处理方法、移动终端及智能终端。
本发明实施例解决其技术问题所采用的技术方案是:
第一方面,提供一种触摸控制方法,应用于移动终端,所述移动终端包括第一显示区域和第二显示区域,包括:
检测产生于触摸面板上的触摸信号;
根据触摸信号识别触摸点;
检测所述移动终端的分屏状态及旋转角度;
根据识别出的触摸点、所述旋转角度及分屏状态,判断触摸点是位于第一显示区域的边缘触摸区域或正常触摸区域,还是位于第二显示区域的边缘触摸区域或正常触摸区域;
基于判断结果执行相应的指令。
在一个实施例中,所述旋转角度包括:旋转0度、顺时针旋转90度、顺时针旋转180度、顺时针旋转270度、逆时针旋转90度、逆时针旋转180度和逆时针旋转270度。
在一个实施例中,所述分屏状态包括:上下分屏和左右分屏。
第二方面,提供一种用户设备,所述用户设备包括第一显示区域和第二显示区域,包括:触摸屏、动作传感器和处理器;
触摸屏,包括:触摸面板和触摸控制器,其中:
触摸面板,配置为检测产生于触摸面板上的触摸信号;
触摸控制器,配置为根据触摸信号识别触摸点;
动作传感器,配置为检测所述用户设备的旋转角度;
处理器,包括:驱动模块、应用框架模块和应用模块,其中:
所述驱动模块,配置为根据所述触摸信号获取输入事件,并上报到所述应用框架模块;
所述应用框架模块,配置为根据上报的输入事件的触摸点位置、所述移动终端旋转角度及分屏状态,判断触摸点是位于第一显示区域的边缘触摸区域或正常触摸区域,还是位于第二显示区域的边缘触摸区域或正常触摸区域,并根据判断结果进行识别以及将识别结果上报给应用模块;
应用模块,配置为基于判断结果执行相应的指令。
所述驱动模块、所述应用框架模块和所述应用模块在执行处理时,可以采用中央处理器(CPU,Central Processing Unit)、数字信号处理器(DSP,Digital Singnal Processor)或可编程逻辑阵列(FPGA,Field-Programmable Gate Array)实现。
第三方面,提供一种输入处理方法,应用于移动终端,所述移动终端包括第一显示区域和第二显示区域,包括:
驱动层获取用户通过输入设备产生的输入事件,并上报到应用框架层;
应用框架层根据移动终端的端旋转角度、分屏状态和上报的输入事件,判断输入事件是位于第一显示区域的边缘输入事件或正常输入事件,还是位于第二显示区域的边缘输入事件或正常输入事件,并根据判断结果进行识别以及将识别结果上报给应用层;
应用层根据上报的识别结果执行相应的指令。
在一个实施例中,所述方法还包括:
为每一输入事件创建一具有设备标识的输入设备对象。
在一个实施例中,所述为每一输入事件创建一具有设备标识的输入设备对象包括:
将正常输入事件与具有第一设备标识的触摸屏相对应;
应用框架层设置一具有第二设备标识的第二输入设备对象与边缘输入 事件相对应。
在一个实施例中,所述驱动层获取用户通过输入设备产生的输入事件,并上报到应用框架层包括:
所述驱动层为每一触摸点赋予一用于区分手指的编号,并采用A协议协议上报所述输入事件。
在一个实施例中,所述驱动层获取用户通过输入设备产生的输入事件,并上报到应用框架层包括:
所述驱动层采用B协议上报所述输入事件;
所述方法还包括:
所述应用框架层为所述输入事件中的每一触摸点赋予用于区分手指的编号。
在一个实施例中,所述移动终端的当前状态包括:旋转0度、顺时针旋转90度、顺时针旋转180度、顺时针旋转270度、逆时针旋转90度、逆时针旋转180度和逆时针旋转270度。
在一个实施例中,分屏状态包括:上下分屏和左右分屏。
第四方面,提供一种移动终端,所述移动终端包括第一显示区域和第二显示区域,包括:
输入设备;
动作传感器,配置为检测所述移动终端的当前状态;
驱动层,配置为获取用户通过输入设备产生的输入事件,并上报到应用框架层;
应用框架层,配置为根据移动终端的端旋转角度、分屏状态和上报的输入事件,判断输入事件是位于第一显示区域的边缘输入事件或正常输入事件,还是位于第二显示区域的边缘输入事件或正常输入事件,并根据判断结果进行识别以及将识别结果上报给应用层;
应用层,配置为根据上报的识别结果执行相应的指令。
在一个实施例中,所述正常输入事件与具有第一设备标识的第一输入设备对象相对应;
所述应用框架层还配置为设置一具有第二设备标识的第二输入设备对象,用于与所述边缘输入事件相对应。
在一个实施例中,所述驱动层采用A协议或B协议上报输入事件,若采用A协议上报输入事件,则所述事件获取模块还配置为给每一触摸点赋予一用于区分手指的编号;
若采用B协议上报输入事件,则所述应用框架层还配置为给每一触摸点赋予用于区分手指的编号。
在一个实施例中,所述驱动层包括事件获取模块,配置为获取用户通过输入设备产生的输入事件。
在一个实施例中,所述应用框架层包括输入读取器;
所述移动终端还包括设置于所述驱动层和所述输入读取器间的设备节点,配置为通知所述输入读取器获取输入事件;
所述输入读取器,配置为遍历设备节点,获取输入事件并上报。
在一个实施例中,所述移动终端的当前状态包括:旋转0度、顺时针旋转90度、顺时针旋转180度、顺时针旋转270度、逆时针旋转90度、逆时针旋转180度和逆时针旋转270度。
在一个实施例中,所述应用框架层还包括:第一事件处理模块,配置为对所述输入读取器上报的输入事件进行坐标计算后上报;
第一判断模块,配置为根据所述移动终端的当前状态和所述第一事件处理模块上报的坐标值判断输入事件是否为边缘输入事件,若不是则将输入事件上报。
在一个实施例中,所述应用框架层还包括:
第二事件处理模块,配置为对所述输入读取器上报的输入事件进行坐标计算后上报;
第二判断模块,配置为根据所述移动终端的当前状态和所述第二事件处理模块上报的坐标值判断输入事件是否为边缘输入事件,若是则将输入事件上报。
在一个实施例中,分屏状态包括:上下分屏和左右分屏。
在一个实施例中,所述应用框架层还包括:
事件派发模块,配置为将所述第二判断模块和所述第一判断模块上报的事件进行上报。
在一个实施例中,所述应用框架层还包括:
第一应用模块;
第二应用模块;
第三判断模块,配置为根据所述事件派发模块上报的事件中包含的设备标识判断事件是否为边缘输入事件,若属于,则上报给所述第一应用模块,否则上报给当所述第二应用模块;
所述第一应用模块,配置为根据正常输入事件的相关参数对正常输入事件进行识别并将识别结果上报到应用层;
所述第二应用模块,配置为根据边缘输入事件的相关参数对边缘输入事件进行识别并将识别结果上报的应用层。
在一个实施例中,所述输入设备为移动终端的触摸屏;
所述触摸屏包括至少一个边缘输入区和至少一个正常输入区。
在一个实施例中,所述输入设备为移动终端的触摸屏;
所述触摸屏包括至少一个边缘输入区、至少一个正常输入区和至少一个过渡区。
所述事件获取模块、所述第一事件处理模块、所述第一判断模块、所 述第二事件处理模块、所述第二判断模块、所述事件派发模块、所述第一应用模块、所述第二应用模块、所述第三判断模块在执行处理时,可以采用CPU、DSP或FPGA实现。
第五方面,提供一种具有通讯功能的智能终端,所述智能终端包括第一显示区域和第二显示区域,还包括:触摸屏、动作传感器和处理器;
触摸屏,包括:触摸面板和触摸控制器,其中:
触摸面板,配置为检测产生于触摸面板上的触摸信号;
触摸控制器,配置为根据触摸信号识别触摸点;
动作传感器,配置为检测所述用户设备的旋转角度;
处理器,包括:驱动模块、应用框架模块和应用模块,其中:
所述驱动模块,配置为根据所述触摸信号获取输入事件,并上报到所述应用框架模块;
所述应用框架模块,配置为根据上报的输入事件的触摸点位置、所述移动终端旋转角度及分屏状态,判断触摸点是位于第一显示区域的边缘触摸区域或正常触摸区域,还是位于第二显示区域的边缘触摸区域或正常触摸区域,并根据判断结果进行识别以及将识别结果上报给应用模块;
应用模块,配置为基于判断结果执行相应的指令。
所述驱动模块、所述应用框架模块和所述应用模块在执行处理时,可以采用CPU、DSP或FPGA实现。
第六方面,提供一种计算机存储介质,所述计算机存储介质中存储有计算机可执行指令,该计算机可执行指令配置为执行上述触摸控制方法及输入处理方法。
实施本发明的触摸控制方法、用户设备、输入处理方法、移动终端及智能终端,可实现根据触摸屏的旋转及分屏状态,相应的变换边缘触摸区域,以更好的适应用户的操作,提高用户体验;另一方面,由于在应用框 架层才进行区分A区和C区的操作,且在应用框架层进行虚拟设备的建立,避免了在驱动层区分A区和C区对硬件的依赖;通过设置触摸点编号,可实现区分手指,兼容A协议和B协议;且可集成到移动终端的操作系统中,可适用不同硬件、不同种类的移动终端,可移植性好;触摸点的所有要素(触摸点的坐标、编号等)被存储,可后续判断边缘输入(例如,FIT)提供便利。
附图说明
下面将结合附图及实施例对本发明作进一步说明,附图中:
图1是本发明一实施例的移动终端的硬件结构示意图;
图2是本发明第一实施例的移动终端的触摸屏区域划分示意图;
图3是本发明一实施例的移动终端的上下分屏示意图;
图4是本发明一实施例的触摸面板坐标示意图;
图5是本发明一实施例的移动终端的左右分屏示意图;
图6是本发明一实施例的触摸面板坐标示意图;
图7是本发明一实施例的触摸面板坐标示意图;
图8是本发明一实施例的触摸面板坐标示意图;
图9是本发明实施例的触摸控制方法的流程示意图;
图10是本发明一实施例的移动终端的软件架构示意图;
图11是本发明一实施例的移动终端的结构示意图;
图12是本发明实施例根据设备标识判断输入事件的流程示意图;
图13是本发明实施例的输入处理方法的流程图;
图14是利用本发明实施例的输入处理方法对旋转角度为0度时的上下分屏的移动终端的相机应用进行开启的效果示意图;
图15是本发明第二实施例的移动终端的触摸屏区域划分示意图;
图16是本发明一实施例的用户设备的硬件结构示意图。
具体实施方式
为了对本发明的技术特征、目的和效果有更加清楚的理解,现对照附图详细说明本发明的具体实施方式。
参见图1,本发明一实施例的移动终端包括:输入设备、处理器903和显示屏904。在一个实施例中,输入设备为触摸屏2010。触摸屏2010包括触摸面板901和触摸控制器902。此外,输入设备还可为非触摸式输入设备(例如,红外输入设备等)等。
触摸控制器902可以是单个专用集成电路(ASIC),其可以包括一个或多个处理器子系统,处理器子系统可以包括一个或多个ARM处理器或者其它具有类似功能和性能的处理器。
触摸控制器902主要用于接收产生于触摸面板901的触摸信号,并进行处理后传输给移动终端的处理器903。这种处理例如,为将物理输入信号进行模数转换、处理得到触摸点坐标、处理得到触摸持续时间等。
处理器903接收触摸控制器902的输出,进行处理后基于该输出执行动作。所述动作包括但不限于,移动诸如由表或指示符的对象、滚动或摇摄、调整控制设置、打开文件或文档、查看菜单、作为选择、执行指令、操作耦接到主机设备的外围设备、应答电话呼叫、拨打电话、终止电话呼叫、改变音量或音频设置、存储于电话通信相关的信息(例如,地址、常用号码、已接呼叫、未接呼叫)、登录计算机或计算机网络、允许授权个体访问计算机或计算机网络的受限区域、记载与计算机桌面的用户喜好配置相关联的用户简档、允许访问网络内容、启动特定程序、加密或解码消息,等等。
处理器903还与显示屏904连接。显示屏904用于向设备的用户提供UI。
在一些实施例中,处理器903可以是与触摸控制器902分开的部件。在其它实施例中,处理器903可以与触摸控制器902为一合成的部件。
在一个实施例中,触摸面板901设置有分立的电容性传感器、电阻性传感器、力传感器、光学传感器或类似传感器等。
触摸面板901内包括有由导电材料制成横向和纵向的电极阵列。对于一个M行和N列电极阵列的单点触摸屏(仅能确定单点触摸的坐标),触摸控制器902采用自电容扫描,则分别扫描M行和N列后就可以根据每一行和每一列信号来进行计算,定位手指在触摸屏上的坐标。扫描次数为M+N次。
对于一个M行和N列电极阵列的多触点触摸屏(能检测并解析多点的坐标,即多点触控),触摸控制器902采用多触点互电容扫描,对行和列的交叉点扫描,由此,扫描次数为M×N次。
当用户的手指触摸面板,触摸面板产生触摸信号(为电信号)发送给触摸控制器902。触摸控制器902通过扫描可以得到触摸点的坐标。在一个实施例中,触摸屏2010的触摸面板901在物理上是一套独立的坐标定位系统,每次触摸的触摸点坐标上报到处理器903后,由处理器903转换为适应于显示屏904的像素坐标,以正确识别输入操作。
参见图2为本发明第一实施例的触摸面板的区域划分示意图。在该实施例中,为了实现边缘防误触、且提供新的交互方式,将触摸屏的触摸面板划分为三个区域,其中,C区101为边缘输入区,A区100为正常输入区。
需要指出的是:图2仅为一个具体应用场景的实施例,在实际应用中,另一个具体应用场景的实施例为本发明实施例公开的上述方案也同样适用于无边框的移动终端中,在无边框的移动终端中,由于无边框,相较于上述窄边框,无边框的终端的边缘输入区是将A区向外延伸至终端边缘侧边,边缘侧边为终端外壳实体的包边。可见:本发明实施例适用的具体应用场景非常广泛,所述边缘输入区为:从屏幕区域向外延伸到终端边缘侧边的区域。由于本发明实施例适用于窄边框或无边框的移动终端,充分利用移动终端的外形尺寸,极大的扩展了移动终端的屏幕尺寸,满足了用户对大 屏幕的需求,同时,通过边缘输入区的手势校准操作使得边缘输入操作多样化。
在本发明的实施例中,A区内的输入操作,按照现有的正常处理方式进行处理,例如,A区100内单击某应用图标即开启该应用等。对于C区101内的输入操作,可定义为边缘输入处理方式,例如,可定义C区101内双边滑动即进行终端加速等。
在本发明的实施例中,C区可采用固定方式划分或自定义划分。固定划分,即设置固定长度、固定宽带的区域作为C区101。C区101可包括位于触摸面板左侧的部分区域和右侧的部分区域,其位置固定设于触摸面板的两侧边缘,如图1所示。当然,也可仅在一侧边缘处划分C区101。
自定义划分,即C区101的区域的个数、位置及大小,可自定义的设置,例如,可由用户进行设定,也可由移动终端根据自身需求,调整C区101的区域的数量、位置及大小。通常,C区101的基本图形设计为矩形,只要输入图形对角的两个顶点坐标即可确定C区的位置和大小。
为满足不同用户对不同应用的使用习惯,还可设置应用于不同应用场景下的多套C区设置方案。例如,在系统桌面下,因为图标占位较多,两侧的C区宽度设置得相对较窄;而当点击相机图标进入相机应用后,可设置此场景下的C区数量、位置、大小,在不影响对焦的情况下,C区宽度可设置的相对较宽。
本发明实施例对C区的划分、设置方式不作限制。
参见图3,本发明实施例中的显示屏904被划分为第一显示区域9041和第二显示区域9042。第一显示区域9041和第二显示区域9042可为上下分屏显示、左右分屏显示和大小屏分屏显示。
具体的,分屏的实现方法为现有技术,在此不对其进行详细描述。
参见图4,触摸面板左上角T0被设置为坐标原点,坐标值为(0,0)。而 触摸面板的右下角的坐标值为T7(W,H),其中,W为触摸面板的宽度,H为触摸面板的高度。
在本发明的一个实施例中,如上所述将触摸屏划分为A区和C区,A区和C区属于同一坐标系。当移动终端的触摸面板被划分为多个区域后,将坐标也对应进行划分。例如,若触摸面板的宽度为W,C区宽度为Wc,则将坐标位于T0、T1、T4和T5所限定的区域内的触摸点,和/或坐标位于T2、T3、T6和T7所限定的区域内的触摸点,定义为边缘触摸点;而将坐标位于T1、T2、T5和T6所限定的区域内的触摸点定义为正常触摸点。
当显示屏904被划分为第一显示区域和第二显示区域后,相应的触摸面板的A区和C区的划分也进行适应性的变换。具体的,参见图4,分屏后,将触摸面板的T0、T1、P1、P2所限定的第一边缘触摸区域和/或T2、T3、P3、P4所限定的第二边缘触摸区域作为第一显示区域的边缘触摸区。将P1、P2、T4、T5所限定的第四边缘触摸区域和/或P3、P4、T6、T7所限定的第五边缘触摸区域作为第二显示区域的边缘触摸区。
图4的边缘触摸区域的划分方式与显示屏904采用左右分屏方式相对应。其中,H1为第一显示区域的高度,H2为第二显示区域的高度。本发明实施例对H1和H2不进行大小限制,即第一显示区域和第二显示区域可为相同大小或不同大小。Wc1为第一显示区域的边缘触摸区域的宽度,Wc2为第二显示区域的边缘触摸区域的宽度。本发明实施例中Wc1和Wc2相等。
在本发明的实施例中,第一边缘触摸区域、第二边缘触摸区域、第三边缘触摸区域和第四边缘触摸区域分别对应有相应的触摸手势,以及与触摸手势对应的指令。例如,可设置在第一边缘触摸区域进行下滑操作,则对应的指令为开启应用1,在第三边缘触摸区域进行下滑操作,则对应的指令为开启应用2等。应理解,由于分屏后,第一显示区域和第二显示区域为两个独立的显示和控制区域,因此,可将第一显示区域的第一边缘触摸区 域和第二显示区域的第三边缘触摸区域中的触摸手势和指令设置为不同,将将第一显示区域的第二边缘触摸区域和第二显示区域的第四边缘触摸区域中的触摸手势和指令设置为不同。此外,也可将第一显示区域和第二显示区域的触摸手势和指令设置为相同,以便于用户的记忆和操作。
参见图5,若显示屏904采用左右分屏的方式,则为了操作的方便,设置左右两侧的两个边缘触摸区域,分别与第一显示区域和第二显示区域相对应。具体的,参见图6,触摸面板上T0、T1、T4和T5所限定的区域为与第一显示区域对应的边缘触摸区域;T2、T3、T6和T7所限定的区域为与第二显示区域对应的边缘触摸区域。Wc3和Wc4分别为这两个边缘触摸区域的宽度。
若图3所示的移动终端顺时针旋转90度,则图4所示的触摸面板划分方式变换为图7所示的划分方式。具体的,T0、T3、P5和P6所限定的区域为与第一显示区域对应的边缘触摸区域(其宽度为Wc1)。T4、T7、P7和P8所限定的区域为与第二显示区域对应的边缘触摸区域(其宽度为Wc2)。
如图5所示的移动终端顺时针旋转90度,则图5所示的触摸面板划分方式变换为图8所示的划分方式,具体的,T0、P9、P15、P16所限定的区域和/或T4、P11、P14、P13所限定的区域为与第一显示区域对应的边缘触摸区域(其宽度为Wc3,高度为W1)。T3、P10、P15、P16所限定的区域和/或T7、P12、P14、P13所限定的区域为与第二显示区域对应的边缘触摸区域(其宽度为Wc4,高度为W2)。应理解,Wc3和Wc4可相等。W1和W2可自由设定其大小。
应理解,本发明实施例的各种分屏方式下的边缘触摸区域的划分可根据需求进行设置,不限于上述所述的划分方式。
如图7-图8所示的触摸屏状态,其触摸屏的坐标系均未发生改变,即无论移动终端的触摸屏处于上述图7-图8的任一状态或其它旋转角度的状态 (这些旋转状态可由动作传感器906检测得到),触摸面板901接收到触摸信号时,触摸控制器902上报的触摸点的坐标都是按照同样的坐标系进行上报的,不会关注触摸屏的旋转状态。而由于触摸屏2010发生旋转后,显示屏904也相应的发生了旋转,处理器903将把触摸控制器902上报的坐标进行适应性的转换以适应显示屏904的像素坐标。存储器905中存储有旋转角度与转换方法之间的对应关系,这样的转换将在后续进行介绍。
参见图9,基于上述移动终端,本发明实施例的触摸控制方法包括以下步骤:
S100、检测产生于触摸面板上的触摸信号。
S101、根据触摸信号识别触摸点。
具体的,当手指或其它物体触摸面板产生触摸手势时,生成触摸信号,触摸控制器检测该信号,并通过扫描等方式获得触摸点的物理坐标。在本发明实施例中,采用如图4中所示的坐标系。
由上所述,本发明实施例的移动终端的触摸屏被划分为边缘触摸区和正常触摸区,因此,对不同区的触摸手势分别进行定义。在一个实施例中,正常触摸区的触摸手势包括:单击、双击、滑动等。边缘触摸区的触摸手势包括:左侧边缘上滑、左侧边缘下滑、右侧边缘上滑、右侧边缘下滑、双边上滑、双边下滑、握持手机四角、单边来回滑、握一握、单手握持等。
应理解,这里的“左侧”和“右侧”是相对而言的。
S102、检测移动终端的旋转角度及分屏状态,根据识别出的触摸点、所述旋转角度及分屏状态,判断触摸点是位于第一显示区域的边缘触摸区域或正常触摸区域,还是位于第二显示区域的边缘触摸区域或正常触摸区域。
具体的,移动终端的旋转角度可由动作传感器检测移动终端的旋转角度从而得出。移动终端发生旋转时,触摸屏和显示屏跟随其旋转。
在本发明的实施例中,用户可通过手动设置的方式对显示屏进行分屏,以将触摸屏划分为第一显示区域和第二显示区域。由此,分屏状态可由处理器通过检测到移动终端的相关设置参数获得。
处理器根据触摸控制器上报的物理坐标判断触摸点所属的区域。在本发明的实施例中,存储器中存储有各区域的坐标范围,具体的,可将图4、图6、图7和图8所示的相关点的坐标进行存储,由此,可根据这些存储的坐标区域触摸点所属的显示区域,和是处于正常触摸区域还是边缘触摸区域。
参见图4,“上下分屏方式时”:第一显示区域的边缘触摸区域的坐标范围为:坐标位于T0、T1、P1、P2所限定的区域内,和/或坐标位于T2、T3、P3、P4所限定的区域内。第一显示区域正常触摸区域的坐标范围为:坐标位于T1、T2、P3和P2所限定的区域内。
第二显示区域的边缘触摸区域的坐标范围为:坐标位于P1、P2、T4、T5所限定的区域内,和/或坐标位于P3、P4、T6、T7所限定的区域内。第二显示区域正常触摸区域的坐标范围为:坐标位于P2、T5、T6和P3所限定的区域内。参见图7,“上下分屏方式时”:当触摸屏发生顺时针90度旋转或顺时针270度旋转时,第一显示区域的边缘触摸区域的坐标范围为:坐标位于T0、T3、P5和P6所限定的区域内。第一显示区域正常触摸区域的坐标范围为:坐标位于P5、P5’、P6’和P6所限定的区域内。
第二显示区域的边缘触摸区域的坐标范围为:坐标位于T4、T7、P7和P8所限定的区域内。第二显示区域正常触摸区域的坐标范围为:坐标位于P5’、P6’、P7和P8所限定的区域内。
参见图6,“左右分屏方式时”:第一显示区域的边缘触摸区域的坐标范围为:坐标位于T0、T1、T4和T5所限定的区域内。第一显示区域正常触摸区域的坐标范围为:坐标位于T2’、T2、T6和T6’所限定的区域内。
第二显示区域的边缘触摸区域的坐标范围为:坐标位于T0、T1、T4和 T5所限定的区域内,和/或坐标位于T2、T3、T6和T7所限定的区域内。第二显示区域正常触摸区域的坐标范围为:坐标位于T2’、T6’、T5和T1所限定的区域内。
参见图8,“左右分屏方式时”:当触摸屏发生顺时针90度旋转或顺时针270度旋转时,第一显示区域的边缘触摸区域的坐标范围为:坐标位于T0、P9、P15、P16所限定的区域内,和/或坐标位于T4、P11、P14、P13所限定的区域内。第一显示区域正常触摸区域的坐标范围为:坐标位于P9、P15、P14和P11所限定的区域内。
第二显示区域的边缘触摸区域的坐标范围为:坐标位于T3、P10、P15、P16所限定的区域内,和/或坐标位于T7、P12、P14、P13所限定的区域内。第二显示区域正常触摸区域的坐标范围为:坐标位于P16、P10、P12和P14所限定的区域内。
S103、基于判断结果执行相应的指令。
具体的,由于触摸面板的坐标和显示屏的坐标为两个独立的坐标系,因此,需要将触摸面板的物理坐标映射为显示屏的像素点坐标,以实现正确显示触点效果、识别触摸手势。具体的,转换规则为:
旋转角度为0,对于触摸点M,触摸控制器上报的坐标为(xc,,yc),则无需进行转换,即显示屏的坐标同样为(xc,,yc)。
旋转角度为顺时针90度时,对于触摸点M,触摸控制器上报的坐标为(xc,,yc),则转换后的坐标为(yc,W-xc)。
旋转角度为顺时针180度时,对于触摸点M,触摸控制器上报的坐标为(xc,,yc),则转换后的坐标为(W-xc,H-yc)。
旋转角度为顺时针270度时,对于触摸点M,触摸控制器上报的坐标为(xc,,yc),则转换后的坐标为(H-yc,xc)。
在本发明的实施例中,若处于分屏状态,则将为第一显示区域和第二 显示区域分别建立一个坐标系。并将上报的坐标按比例转换为与该两个坐标系对应的坐标。例如,将移动终端的显示屏进行上下分屏,且第一显示区域和第二显示区域为相等大小,则上报的坐标若为(xc,yc)则将其缩小二分之一为(xc/2,yc/2)。缩小后即可判断其坐标是落入第一显示区域还是第二显示区域。
应理解,在本发明实施例中,应先进行旋转的坐标转换后,再进行分屏的坐标的转换,以确保准确。
应理解,上述转换规则是建立在显示屏坐标系的大小和触摸面板坐标系的大小相同的基础上的(例如,均为1080×1920像素),若显示屏的坐标系与触摸面板坐标系的大小不相同,则在经过上述转换后,还要调整为适应于显示屏的坐标,具体的,将触摸面板的坐标乘以相应的转换系数。转换系数即显示屏和触摸面板的大小的比值。例如,若触摸面板为720×1280,而显示屏为1080×1920,则显示屏和触摸面板的比值为1.5,由此,将上报的触摸面板的物理坐标的横坐标和纵坐标分别乘以1.5,原来为(xc,yc),则转换为显示屏坐标时则变为(1.5×xc,1.5×yc),或(1.5×yc,1.5×W-xc)等等。
坐标转换和调整后,即可实现准确的显示,识别出正确的触控手势,由此执行与触控手势对应的指令。在本发明的实施例中,触控手势与指令一一对应并存储于存储器中。
本发明实施例的触摸控制方法可实现根据触摸屏的旋转和显示屏的分屏状态相应的变换边缘触摸区域,以更好的适应用户的操作,提高用户体验。
参见图10,本发明一实施例的移动终端的软件架构示意图。本发明实施例的移动终端的软件架构包括:输入设备201、驱动层202、应用框架层203和应用层204。其中,驱动层202、应用框架层203和应用层204的功能由 处理器903执行。在一个实施例中,输入设备201为包括触摸面板和触摸控制器的触摸屏。
输入设备201接收到用户的输入操作,将物理输入转变为触摸信号,将触摸信号传递至驱动层202;驱动层202对输入的位置进行解析,得到触摸点的具体坐标、持续时间等参数,将该参数上传至应用框架层203,应用框架层203与驱动层202的通信可通过相应的接口来实现。应用框架层203接收到驱动层202上报的参数,进行解析,区分边缘输入事件和正常输入事件,并将有效的输入向上传递给应用层204的具体哪一个应用,以满足应用层204根据不同的输入操作执行不同的输入操作指令。
参见图11,为本发明一实施例的移动终端的结构示意图。在本发明的一个实施例中,输入设备包括上述所述的触摸屏2010。驱动层202包括事件获取模块2020。在驱动层202和应用框架层203之间设置有设备节点2021。应用框架层203包括输入读取器(input reader)2030、第一事件处理模块2031、第二事件处理模块2032、第一判断模块2033、第二判断模块2034和事件派发模块2035、第三判断模块2036、第一应用模块2037、第二应用模块2038等。
其中,驱动层202包括事件获取模块2020,配置为获取用户通过输入设备201产生的输入事件,例如,通过触摸屏进行的输入操作事件。在本发明的实施例中,输入事件包括:正常输入事件(A区输入事件)和边缘输入事件(C区输入事件)。正常输入事件包括在A区进行的单击、双击、滑动等输入操作。边缘输入事件包括在C区进行的左侧边缘上滑、左侧边缘下滑、右侧边缘上滑、右侧边缘下滑、双边上滑、双边下滑、握持手机四角、单边来回滑、握一握、单手握持等输入操作。
此外,事件获取模块2020还配置为获取输入操作的触摸点的坐标、持续时间等相关参数。若采用A协议上报输入事件,则事件获取模块2020还配 置为给每一触摸点赋予一用于区分手指的编号(ID)。由此,若采用A协议上报输入事件,则上报的数据包括触摸点的坐标、持续时间等参数,以及触摸点的编号。
驱动层202和输入读取器2030间设置有设备节点2011,配置为通知应用框架层203的输入读取器2030获取输入事件。
输入读取器2030,配置为遍历设备节点,获取输入事件并上报。若驱动层202采用B协议上报输入事件,则输入读取器2030还配置为给每一触摸点赋予用于区分手指的编号(ID)。在本发明的实施例中,输入读取器2030还配置为将触摸点的所有要素信息(坐标、持续时间、编号等)进行存储。
在本发明的实施例中,为了便于应用层204区分不同的输入事件以进行响应,每一输入事件创建一具有设备标识的输入设备对象。在一个实施例中,可为正常输入事件创建第一输入设备对象,其具有第一标识。第一输入设备对象与实际硬件触摸屏相对应。
此外,应用框架层203还包括第二输入设备对象,该第二输入设备对象(例如,边缘输入设备,FIT device)为虚拟设备,即为一空设备,其有一第二标识,配置为与边缘输入事件相对应。应理解,也可将边缘输入事件与具有第一标识的第一输入设备对象相对应,而将正常控事件与具有第二标识的第二输入设备对象相对应。
第一事件处理模块2031,配置为对输入读取器2030上报的输入事件进行处理,例如,触摸点的坐标计算。
第二事件处理模块2032,配置为对输入读取器2030上报的输入事件进行处理,例如,触摸点的坐标计算。
第一判断模块2033配置为根据坐标值(X值)判断事件是否为边缘输入事件,若不是则将事件上传到事件派发模块2035。
第二判断模块2034配置为根据坐标值(X值)判断事件是否为边缘输入 事件,若是则将事件上传到事件派发模块2035。
应理解,在本发明的实施例中,第一判断模块2033和第二判断模块2034在判断时,并不需要关注分屏和旋转的情况,只需判断触摸点的坐标是否落入上述所述的第一显示区域和/或第二显示区域的边缘触摸区域的坐标范围内即可。
事件派发模块2035配置为将边缘输入事件和/或A区输入事件上报到第三判断模块2036。在一个实施例中,边缘输入事件和A区输入事件上报所采用的通道不相同。边缘输入事件采用专用通道上报。
此外,事件派发模块2035还配置为获取移动终端的当前状态,根据当前状态对上报的坐标进行转换和调整后上报。
本发明实施例中,当前状态包括旋转角度和分屏状态。根据动作传感器的检测结果获取移动终端的当前状态。根据检测到的移动终端的相关设置参数获取分屏状态。旋转角度包括:旋转角度为0度、顺时针90度、顺时针180度、顺时针270度等。应理解,若为逆时针旋转,则逆时针90度与顺时针270度相同,逆时针180度与顺时针180度相同,逆时针270度与顺时针90度相同。分屏状态包括:左右分屏和上下分屏。
在本发明的实施例中,若处于分屏状态,则将为第一显示区域和第二显示区域分别建立一个坐标系。并将上报的坐标按比例转换为与该两个坐标系对应的坐标。例如,将移动终端的显示屏进行上下分屏,且第一显示区域和第二显示区域为相等大小,则上报的坐标若为(xc,yc)则将其缩小二分之一为(xc/2,yc/2)。缩小后即可判断其坐标是落入第一显示区域还是第二显示区域。
而对于旋转一定角度的坐标转换方式参见上述描述。
应理解,在本发明实施例中,应先进行旋转的坐标转换后,再进行分屏的坐标的转换,以确保准确。
在一个实施例中,事件派发模块2035由inputdispatcher::dispatchmotion()实现。
第三判断模块2036配置为根据设备标识(ID)判断事件是否为边缘输入事件,若属于,则上报给第一应用模块2037,否则上报给当第二应用模块2038。
具体的,参见图12,第三判断模块2036在判断时,首先获取设备标识,根据设备标识判断是否为触屏类型设备;若是,则进一步判断设备标识是否为C区设备标识即上述第二输入设备对象的标识,若是,则判断为边缘输入事件,若否,则判断为正常输入事件。应理解,也可在判断为触屏类设备后,进一步判断设备标识是否为A区设备标识即上述第一输入设备对应的标识,若是,则判断为正常输入事件,若否,则判断为边缘输入事件。
在本发明的实施例中,第一应用模块2037配置为处理与A区输入相关的输入事件,具体的,这种处理包括:根据输入操作的触摸点坐标、持续时间、编号等进行处理识别,并将识别结果上报到应用层。第二应用模块2038配置为处理与C区输入相关的输入事件,具体的,这种处理包括:根据处理操作的触摸点坐标、持续时间、编号进行处理识别,并将识别结果上报到应用层。例如,根据触摸点的坐标、持续时间和编号即可识别出输入操作是A区的单击、滑动,还是C区的单边来回滑等。
应用层204包括相机、图库、锁屏等应用(应用1、应用2……)。本发明实施例中的输入操作包括应用级和系统级,系统级的手势处理也将其归类为应用层。其中,应用级为对应用程序的操控,例如,开启、关闭、音量控制等。系统级为对移动终端的操控,例如,开机、加速、应用间切换、全局返回等。应用层可以通过注册C区事件的Listener获得C区的输入事件进行处理,也可以通过注册A区事件的Listener获得A区的输入事件进行处理。
在一个实施例中,移动终端设置并存储有与不同的输入操作对应的指 令,其中包括与边缘输入操作对应的指令和与正常输入操作对应的指令。应用层接收到上报的边缘输入事件的识别结果,即根据边缘输入操作调用相应的指令以响应该边缘输入操作。应用层接收到上报的正常输入事件的识别结果,即根据正常输入操作调用相应的指令以响应该正常输入操作。
应理解,本发明实施例的输入事件包括仅在A区的输入操作、仅在C区的输入操作以及同时产生于A区和C区的输入操作。由此,指令也包括与这三类输入事件对应的指令。本发明实施例可实现A区和C区输入操作的组合对移动终端进行控制,例如,输入操作为同时单击A区和C区的相应位置,对应的指令为关闭某一应用,因此,通过同时单击A区和C区相应位置的输入操作,可实现对应用的关闭。
本发明实施例的移动终端,可实现根据触摸屏的旋转及分屏状态相应的变换边缘触摸区域,以更好的适应用户的操作,提高用户体验;另一方面,由于在应用框架层才进行区分A区和C区的操作,且在应用框架层进行虚拟设备的建立,避免了在驱动层区分A区和C区对硬件的依赖;通过设置触摸点编号,可实现区分手指,兼容A协议和B协议;且由于输入读取器2030、第一事件处理模块2031、第二事件处理模块2032、第一判断模块2033、第二判断模块2034和事件派发模块2035、第三判断模块2036、第一应用模块2037、第二应用模块2038等的功能可集成到移动终端的操作系统中,可适用不同硬件、不同种类的移动终端,可移植性好;输入读取器(Input Reader)会自动将一个触摸点的所有要素(触摸点的坐标、编号等)保存起来,为后续判断边缘输入(例如,FIT)提供便利。
参见图13为本发明实施例的输入处理方法的流程图,包括以下步骤:
S1、驱动层获取用户通过输入设备产生的输入事件,并上报到应用框架层。
具体的,输入设备接收到用户的输入操作(即输入事件),将物理输入 转变为电信号,并将电信号传递至驱动层。在本发明实施例中,输入事件包括A区输入事件和C区输入事件。A区输入事件包括在A区进行的单击、双击、滑动等输入操作。C区输入事件包括在C区进行的左侧边缘上滑、左侧边缘下滑、右侧边缘上滑、右侧边缘下滑、双边上滑、双边下滑、单边来回滑、握一握、单手握持等输入操作。
驱动层根据接收到的电信号对输入位置进行解析,得到触摸点的具体坐标、持续时间等相关参数。该相关参数被上报到应用框架层。
此外,若驱动层采用A协议上报输入事件,则该步骤S1还包括:
为每一触摸点赋予一用于区分手指的编号(ID)。
由此,若驱动层采用A协议上报输入事件,则上报的数据包括上述相关参数,以及触摸点的编号。
S2、应用框架层判断输入事件是边缘输入事件,还是正常输入事件,若为正常输入事件则执行步骤S3,若为边缘输入事件则执行步骤S4。
若驱动层采用B协议上报输入事件,则步骤S2还具体包括:为每一触摸点赋予用于区分手指的编号(ID);将触摸点的所有要素信息(坐标、持续时间、编号等)进行存储。
应理解,在判断时,并不需要关注分屏和旋转的情况,只需判断触摸点的坐标是否落入上述所述的第一显示区域和/或第二显示区域的边缘触摸区域的坐标范围内即可。
由此,本发明实施例通过设置触摸点编号,可实现区分手指,兼容A协议和B协议;且触摸点的所有要素(触摸点的坐标、编号等)被存储,可后续判断边缘输入(例如,FIT)提供便利。
在一个实施例中,边缘输入事件和正常输入事件上报所采用的通道不相同。边缘输入事件采用专用通道。
S3、应用框架层对正常输入事件进行处理识别,并将识别结果上报给 应用层。
S4、应用框架层对边缘输入事件进行处理识别,并将识别结果上报给应用层。
具体的,处理识别包括:根据输入操作的触摸点坐标、持续时间、编号等进行处理识别,以确定输入操作。例如,根据触摸点的坐标、持续时间和编号即可识别出是A区的单击、滑动等输入操作,还是C区的单边来回滑等输入操作。
S5、应用层根据上报的识别结果执行相应的指令。
具体的,应用层包括相机、图库、锁屏等应用。本发明实施例中的输入操作包括应用级和系统级,系统级的手势处理也将其归类为应用层。其中,应用级为对应用程序的操控,例如,开启、关闭、音量控制等。系统级为对移动终端的操控,例如,开机、加速、应用间切换、全局返回等。
在一个实施例中,移动终端设置并存储有与不同的输入操作对应的指令,其中包括与边缘输入操作对应的指令和与正常输入操作对应的指令。应用层接收到上报的边缘输入事件的识别结果,即根据边缘输入操作调用相应的指令以响应该边缘输入操作;应用层接收到上报的正常输入事件的识别结果,即根据正常输入操作调用相应的指令以响应该正常输入操作。
应理解,本发明实施例的输入事件包括仅在A区的输入操作、仅在C区的输入操作以及同时产生于A区和C区的输入操作。由此,指令也包括与这三类输入事件对应的指令。本发明实施例可实现A区和C区输入操作的组合对移动终端进行控制,例如,输入操作为同时单击A区和C区的相应位置,对应的指令为关闭某一应用,因此,通过同时单击A区和C区相应位置的输入操作,可实现对应用的关闭。
在一个实施例中,本发明实施例的输入处理方法还包括:
S11、为每一输入事件创建一具有设备标识的输入设备对象。
具体的,在一个实施例中,可为正常输入事件创建第一输入设备对象,其具有第一标识。第一输入设备对象与输入设备触摸屏相对应。应用框架层设置一第二输入设备对象。该第二输入设备对象(例如,为FIT device)为虚拟设备,即为一空设备,其具有一第二标识,用于与边缘输入事件相对应。应理解,也可将边缘输入事件与具有第一标识的第一输入设备对象相对应,而将正常控事件与具有第二标识的第二输入设备对象相对应。
在一个实施例中,本发明实施例的输入处理方法还包括:
S21、应用框架层根据移动终端的旋转角度和分屏状态,对上报的坐标进行转换和调整后上报。
对坐标进行转换和调整的具体实现参见上述描述,在此不再赘述。
在一个实施例中,步骤S21可由inputdispatcher::dispatchmotion()实现。
S22、根据设备标识判断输入事件是否为边缘输入事件,若属于,则上执行步骤S3,若不属于则执行步骤S4。
具体的,参见上述图11,根据设备标识判断输入事件是否为边缘输入事件时,首先获取设备标识,根据设备标识判断是否为触屏类型设备;若是,则进一步判断设备标识是否为C区设备标识即上述第二输入设备对象的标识,若是,则判断为边缘输入事件,若否,则判断为正常输入事件。应理解,也可在判断为触屏类设备后,进一步判断设备标识是否为A区设备标识即上述第一输入设备对应的标识,若是,则判断为正常输入事件,若否,则判断为边缘输入事件。
本发明实施例的输入处理方法,可实现根据触摸屏的旋转及分屏状态,相应的变换边缘触摸区域,以更好的适应用户的操作,提高用户体验;另一方面,由于在应用框架层才进行区分A区和C区的操作,且在应用框架层进行虚拟设备的建立,避免了在驱动层区分A区和C区对硬件的依赖;通过 设置触摸点编号,可实现区分手指,兼容A协议和B协议;且可集成到移动终端的操作系统中,可适用不同硬件、不同种类的移动终端,可移植性好;触摸点的所有要素(触摸点的坐标、编号等)被存储,可后续判断边缘输入(例如,FIT)提供便利。
参见图14,是利用本发明实施例的输入处理方法对上下分屏方式的移动终端的相机应用进行开启的效果示意图。其中,图13左边的图为移动终端的主界面示意图,其中,区域1010为在第一显示区域的边缘输入区域(C区域101)预先设置的可实现开启相机功能的输入操作的触摸点。具体的,单击区域1010可实现开启相机。则在移动终端中,存储有指令为:开启相机,其与单击区域1010的输入操作相对应。
当需要使用相机时,用户单击触摸屏的区域1010,驱动层获取该输入事件,并上报到应用框架层。应用框架层根据触摸点的坐标可判断出该输入事件为边缘输入事件。应用框架层对该边缘输入事件进行处理识别,根据触摸点坐标、持续时间和编码,识别出该输入操作为单击区域1010。应用框架层将识别结果上报到应用层,应用层即执行开启相机的指令。
应理解,图14中,开启相机功能后,未示出C区,但其仍存在,或根据本发明实施例的上述对C区划分的描述,开启相机后,C区宽度可设置的相对较宽等,这可被本领域技术人员所理解。
参见图15为本发明第二实施例的移动终端的触摸屏划分示意图。在该实施例中,为了防止用户输入过程中偏离输入开始的区域导致准确率下降,在移动终端的触摸面板边缘增加过渡区103(T区)。
在该实施例中,若输入事件从C区开始,偏离到T区则依旧认为本次滑动是边缘手势;若输入事件从C区开始,偏离到A区,则认为本次边缘手势结束,开始正常输入事件;若输入事件从T区或者A区开始,无论之后滑动到触摸面板任何区域,都认为本次滑动是正常输入事件。
该实施例的输入事件的上报流程和上述实施例所述的交互控制方法相同,区别仅在于:应用框架层对边缘输入事件进行处理识别时,需要按照上述三种情况进行判断,以确定准确的输入事件。例如,应用框架层根据某一次输入事件上报的触摸点判断得到输入事件从C区开始,并偏离到A区(即输入开始时的触摸点坐标位于C区,而输入过程中某一触摸点的坐标位于A区),则第一判断模块和第二判断模块根据坐标判断的结果为输入事件为边缘输入事件,且本次边缘输入事件结束,开始正常输入事件,驱动层即开始下一次输入事件的上报。
相应的,本发明实施例还提供一种用户设备,参见图16为其硬件结构示意图。参见图16,用户设备1000包括触摸屏2010、控制器200、存储装置310、GPS芯片320、通信器330、视频处理器340、音频处理器350、按钮360、麦克风370、相机380、扬声器390和动作传感器906。
触摸屏2010可以如上所述划分为A区和C区,或A区、C区和T区。触摸屏2010可以实现为各种类型的显示器,诸如LCD(液晶显示器)、OLED(有机发光二极管)显示器和PDP(等离子体显示板)。触摸屏2010可以包括驱动电路,其能够实现为,例如a-si TFT、LTPS(低温多晶硅)TFT和OTFT(有机TFT),和背光单元。
同时,触摸屏2010可以包括用于感测用户的触摸手势的触摸传感器。触摸传感器可以实现为各种类型的传感器,诸如电容类型、电阻类型或者压电类型。电容类型通过当用户身体的一部分(例如,用户的手指)触摸表面上涂敷有导电材料的触摸屏的表面时感测由用户的身体激励的微电流计算触摸坐标值。根据电阻类型,触摸屏包括两个电极板,并且当用户触摸屏幕时通过感测当触摸点处的上板和下板接触时流动的电流,来计算触摸坐标值。此外,当用户设备1000支持笔输入功能时,触摸屏2010可以感测用于使用除了用户手指之外诸如笔之类的输入装置的用户手势。当输入装置 是包括线圈的手写笔(stylus pen)时,用户设备1000可以包括用于感测磁场的磁性传感器(未示出),所述磁场根据手写笔内线圈对磁性传感器的接近度而改变。由此,除了感测触摸手势之外,用户设备1000还可以感测接近的手势,即手写笔悬停在用户设备1000上方。
存储装置310可以存储用户设备1000的操作所需的各种程序和数据。例如,存储装置310可以存储用于构成将在各区(例如,A区、C区)上显示的各种屏幕的程序和数据。
控制器200通过使用存储在存储装置310中的程序和数据在触摸屏2010的各区上显示内容。
控制器200包括RAM 210、ROM 220、CPU(处理器)230、GPU(图形处理单元)240和总线250。RAM 210、ROM 220、CPU 230和GPU 240可以通过总线250彼此连接。
CPU230访问存储装置310并且使用存储在存储装置310中的操作系统(OS)执行启动。而且,CPU 230通过使用存储在存储装置310中的各种程序、内容和数据执行各种操作。
ROM 220存储用于系统启动的命令集。当开启命令被输入并且电力被提供时,CPU 230根据存储在ROM 220中命令集将存储在存储装置310中的OS复制到RAM 210,并且通过运行OS启动系统。当启动完成时,CPU 230将存储在存储装置310中的各种程序复制到RAM 210,并且通过运行RAM 210中的复制程序执行各种操作。具体地说,GPU 240可以通过使用计算器(未示出)和渲染器(未示出)生成包括诸如图标、图像和文本这样的各种对象的屏幕。计算器计算诸如坐标值、格式、大小和颜色这样的特征值,其中分别根据屏幕的布局用颜色标记对象。
GPS芯片320是从GPS(全球定位系统)卫星接收GPS信号的单元,并且计算用户设备1000的当前位置。当使用导航程序时或者当请求用户的当前位 置时,控制器200可以通过使用GPS芯片320计算用户的位置。
通信器330是根据各种类型的通信方法与各种类型的外部设备执行通信的单元。通信器330包括WiFi芯片331、蓝牙芯片332、无线通信芯片333和NFC芯片334。控制器200通过使用通信器330执行与各种外部设备的通信。
WiFi芯片331和蓝牙芯片332分别根据WiFi方法和蓝牙方法执行通信。当使用WiFi芯片331或者蓝牙芯片332时,诸如服务集标识符(service set identifier,SSID)和会话密钥这样的各种连接信息可以首先被收发,可以通过使用连接信息连接通信,并且可以收发各种信息。无线通信芯片333是根据诸如IEEE、Zigbee、3G(第三代)、3GPP(第三代合作项目)和LTE(长期演进)这样的各种通信标准执行通信的芯片。NFC芯片334是根据使用各种RFID频带宽度当中13.56兆赫带宽的NFC(近场通信)方法进行操作的芯片,各种RFID频带宽度诸如135千赫兹、13.56兆赫、433兆赫、860~960兆赫和2.45吉赫。
视频处理器340是处理包括在通过通信器330接收到的内容或者存储在存储装置310中的内容中的视频数据的单元。视频处理器340可以执行对于视频数据的各种图像处理,诸如解码、缩放、噪声过滤、帧速率变换和分辩率变换。
音频处理器350是处理包括在通过通信器330接收到的内容或者存储在存储装置310中的内容中的音频数据的单元。音频处理器350可以执行对于音频数据的各种处理,诸如解码、放大和噪声过滤。
当对于多媒体内容运行再现程序时控制器200可以通过驱动视频处理器340和音频处理器350再现相应内容。
扬声器390输出在音频处理器350中生成的音频数据。
按钮360可以是各种类型的按钮,诸如机械按钮或者在像用户设备1000 的主要外体的正面、侧面或者背面这样的一些区域上形成的触摸垫或者触摸轮。
麦克风370是接收用户语音或者其它声音并且将它们变换为音频数据的单元。控制器200可以使用在呼叫过程期间通过麦克风370输入的用户语音,或者将它们变换为音频数据并且存储在存储装置310中。
相机380是根据用户的控制捕获静止图像或者视频图像的单元。相机380可以实现为多个单元,诸如正面相机和背面相机。如下面所述,相机380可以用作在追踪用户的目光的示范性实施例中获得用户图像的装置。
当提供相机380和麦克风370时,控制器200可以根据通过麦克风370输入的用户的声音或者由相机380识别的用户动作执行控制操作。因此,用户设备1000可以在动作控制模式或者语音控制模式下操作。当在动作控制模式下操作时,控制器200通过激活相机380拍摄用户,跟踪用户动作的改变,以及执行相应的操作。当在语音控制模式下操作时,控制器200可以在语音识别模式下操作以分析通过麦克风370输入的语音并且根据分析的用户语音执行控制操作。
在支持动作控制模式或者语音控制模式的用户设备1000中,在上述各种示范性实施例中使用语音识别技术或者动作识别技术。例如,当用户执行像选择在主页屏幕上标记的对象这样的动作或者说出相应于对象的语音命令时,可以确定选择了相应对象并且可以执行与该对象匹配的控制操作。
动作传感器906是感测用户设备1000的主体的移动的单元。用户设备1000可以旋转或者沿各种方向倾斜。动作传感器906可以通过使用诸如地磁传感器、陀螺仪传感器和加速度传感器这样的各种传感器中的一个或多个来感测诸如旋转方向、角度和斜率这样的移动特征。应理解,当用户设备旋转时,相应的,触摸屏也进行了旋转,且与用户设备的旋转角度是相同的。
而且,虽然在图16中未示出,但是根据示范性实施例,用户设备1000还可以包括能够与USB连接器连接的USB端口、用于连接像耳机、鼠标、LAN和接收并处理DMB(数字多媒体广播)信号的DMB芯片这样的各种外部元件的各种输入端口、以及各种其他传感器。
如上所述,存储装置310可以存储各种程序。
基于图16所示的用户设备,在本发明的实施例中,触摸屏,配置为检测产生于触摸面板上的触摸信号,以及根据触摸信号识别触摸点。
动作传感器,配置为检测用户设备的旋转角度。
处理器,包括:驱动模块、应用框架模块和应用模块;
其中,驱动模块,配置为根据触摸信号获取输入事件,并上报到应用框架模块;
应用框架模块,配置为根据上报的输入事件的触摸点位置、旋转角度及分屏状态,判断触摸点是位于第一显示区域的边缘触摸区域或正常触摸区域,还是位于第二显示区域的边缘触摸区域或正常触摸区域,并根据判断结果进行识别以及将识别结果上报给应用模块
应用模块,配置为根据上报的识别结果执行相应的指令。
应理解,该实施例的用户设备的各模块的工作原理和细节和上述实施例描述的相同,在此不再赘述。
本发明实施例的触摸控制方法、用户设备、输入处理方法、移动终端及智能终端,可实现根据触摸屏的旋转及分屏状态相应的变换边缘触摸区域,以更好的适应用户的操作,提高用户体验;另一方面,由于在应用框架层才进行区分A区和C区的操作,且在应用框架层进行虚拟设备的建立,避免了在驱动层区分A区和C区对硬件的依赖;通过设置触摸点编号,可实现区分手指,兼容A协议和B协议;且可集成到移动终端的操作系统中,可适用不同硬件、不同种类的移动终端,可移植性好;触摸点的所有要素(触 摸点的坐标、编号等)被存储,可后续判断边缘输入(例如,FIT)提供便利。
应理解,本发明实施例的终端可以以各种形式来实施。例如,本发明中描述的终端可以包括诸如具有通讯功能的智能终端、手机、移动电话、智能电话、笔记本电脑、数字广播接收器、PDA(个人数字助理)、PAD(平板电脑)、PMP(便携式多媒体播放器)、导航装置等等的移动设备以及诸如数字TV、台式计算机等等的固定设备。
流程图中或在本发明的实施例中以其他方式描述的任何过程或方法描述可以被理解为,表示包括一个或更多个用于实现特定逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分,并且本发明实施方式的范围包括另外的实现,其中可以不按所示出或讨论的顺序,包括根据所涉及的功能按基本同时的方式或按相反的顺序,来执行功能,这应被本发明的实施例所述技术领域的技术人员所理解。
上面结合附图对本发明的实施例进行了描述,但是本发明并不局限于上述的具体实施方式,上述的具体实施方式仅仅是示意性的,而不是限制性的,本领域的普通技术人员在本发明的启示下,在不脱离本发明宗旨和权利要求所保护的范围情况下,还可做出很多形式,这些均属于本发明的保护之内。
工业实用性
实施本发明的触摸控制方法、用户设备、输入处理方法、移动终端及智能终端,可实现根据触摸屏的旋转及分屏状态,相应的变换边缘触摸区域,以更好的适应用户的操作,提高用户体验;由于在应用框架层才进行区分A区和C区的操作,且在应用框架层进行虚拟设备的建立,避免了在驱动层区分A区和C区对硬件的依赖;通过设置触摸点编号,可实现区分手指,兼容A协议和B协议;且可集成到移动终端的操作系统中,可适用不同硬件、 不同种类的移动终端,可移植性好;触摸点的所有要素(触摸点的坐标、编号等)被存储,可后续判断边缘输入(例如,FIT)提供便利。

Claims (26)

  1. 一种触摸控制方法,应用于移动终端,所述移动终端包括第一显示区域和第二显示区域,包括:
    检测产生于触摸面板上的触摸信号;
    根据触摸信号识别触摸点;
    检测所述移动终端的分屏状态及旋转角度;
    根据识别出的触摸点、所述旋转角度及分屏状态,判断触摸点是位于第一显示区域的边缘触摸区域或正常触摸区域,还是位于第二显示区域的边缘触摸区域或正常触摸区域;
    基于判断结果执行相应的指令。
  2. 根据权利要求1所述的触摸控制方法,其中,所述旋转角度包括:旋转0度、顺时针旋转90度、顺时针旋转180度、顺时针旋转270度、逆时针旋转90度、逆时针旋转180度和逆时针旋转270度。
  3. 根据权利要求2所述的触摸控制方法,其中,所述分屏状态包括:上下分屏和左右分屏。
  4. 一种用户设备,所述用户设备包括第一显示区域和第二显示区域,包括:触摸屏、动作传感器和处理器;
    触摸屏,包括:触摸面板和触摸控制器,其中:
    触摸面板,配置为检测产生于触摸面板上的触摸信号;
    触摸控制器,配置为根据触摸信号识别触摸点;
    动作传感器,配置为检测所述用户设备的旋转角度;
    处理器,包括:驱动模块、应用框架模块和应用模块,其中:
    所述驱动模块,配置为根据所述触摸信号获取输入事件,并上报到所述应用框架模块;
    所述应用框架模块,配置为根据上报的输入事件的触摸点位置、所述 移动终端旋转角度及分屏状态,判断触摸点是位于第一显示区域的边缘触摸区域或正常触摸区域,还是位于第二显示区域的边缘触摸区域或正常触摸区域,并根据判断结果进行识别以及将识别结果上报给应用模块;
    应用模块,配置为基于判断结果执行相应的指令。
  5. 一种输入处理方法,应用于移动终端,所述移动终端包括第一显示区域和第二显示区域,包括:
    驱动层获取用户通过输入设备产生的输入事件,并上报到应用框架层;
    应用框架层根据移动终端的端旋转角度、分屏状态和上报的输入事件,判断输入事件是位于第一显示区域的边缘输入事件或正常输入事件,还是位于第二显示区域的边缘输入事件或正常输入事件,并根据判断结果进行识别以及将识别结果上报给应用层;
    应用层根据上报的识别结果执行相应的指令。
  6. 根据权利要求5所述的输入处理方法,其中,所述方法还包括:
    为每一输入事件创建一具有设备标识的输入设备对象。
  7. 根据权利要求6所述的输入处理方法,其中,所述为每一输入事件创建一具有设备标识的输入设备对象包括:
    将正常输入事件与具有第一设备标识的触摸屏相对应;
    应用框架层设置一具有第二设备标识的第二输入设备对象与边缘输入事件相对应。
  8. 根据权利要求5所述的输入处理方法,其中,所述驱动层获取用户通过输入设备产生的输入事件,并上报到应用框架层包括:
    所述驱动层为每一触摸点赋予一用于区分手指的编号,并采用A协议协议上报所述输入事件。
  9. 根据权利要求5所述的输入处理方法,其中,所述驱动层获取用户通过输入设备产生的输入事件,并上报到应用框架层包括:
    所述驱动层采用B协议上报所述输入事件;
    所述方法还包括:
    所述应用框架层为所述输入事件中的每一触摸点赋予用于区分手指的编号。
  10. 根据权利要求5-9任一项所述的输入处理方法,其中,所述移动终端的当前状态包括:旋转0度、顺时针旋转90度、顺时针旋转180度、顺时针旋转270度、逆时针旋转90度、逆时针旋转180度和逆时针旋转270度。
  11. 根据权利要求10所述的输入处理方法,其中,分屏状态包括:上下分屏和左右分屏。
  12. 一种移动终端,所述移动终端包括第一显示区域和第二显示区域,包括:
    输入设备;
    动作传感器,配置为检测所述移动终端的当前状态;
    驱动层,配置为获取用户通过输入设备产生的输入事件,并上报到应用框架层;
    应用框架层,配置为根据移动终端的端旋转角度、分屏状态和上报的输入事件,判断输入事件是位于第一显示区域的边缘输入事件或正常输入事件,还是位于第二显示区域的边缘输入事件或正常输入事件,并根据判断结果进行识别以及将识别结果上报给应用层;
    应用层,配置为根据上报的识别结果执行相应的指令。
  13. 根据权利要求12所述的移动终端,其中,所述正常输入事件与具有第一设备标识的第一输入设备对象相对应;
    所述应用框架层还配置为设置一具有第二设备标识的第二输入设备对象,用于与所述边缘输入事件相对应。
  14. 根据权利要求12所述的移动终端,其中,所述驱动层采用A协议或 B协议上报输入事件,若采用A协议上报输入事件,则所述事件获取模块还配置为给每一触摸点赋予一用于区分手指的编号;
    若采用B协议上报输入事件,则所述应用框架层还配置为给每一触摸点赋予用于区分手指的编号。
  15. 根据权利要求12所述的移动终端,其中,所述驱动层包括事件获取模块,配置为获取用户通过输入设备产生的输入事件。
  16. 根据权利要求12所述的移动终端,其中,所述应用框架层包括输入读取器;
    所述移动终端还包括设置于所述驱动层和所述输入读取器间的设备节点,配置为通知所述输入读取器获取输入事件;
    所述输入读取器,配置为遍历设备节点,获取输入事件并上报。
  17. 根据权利要求12所述的移动终端,其中,所述移动终端的当前状态包括:旋转0度、顺时针旋转90度、顺时针旋转180度、顺时针旋转270度、逆时针旋转90度、逆时针旋转180度和逆时针旋转270度。
  18. 根据权利要求17所述的移动终端,其中,所述应用框架层还包括:第一事件处理模块,配置为对所述输入读取器上报的输入事件进行坐标计算后上报;
    第一判断模块,配置为根据所述移动终端的当前状态和所述第一事件处理模块上报的坐标值判断输入事件是否为边缘输入事件,若不是则将输入事件上报。
  19. 根据权利要求18所述的移动终端,其中,所述应用框架层还包括:
    第二事件处理模块,配置为对所述输入读取器上报的输入事件进行坐标计算后上报;
    第二判断模块,配置为根据所述移动终端的当前状态和所述第二事件处理模块上报的坐标值判断输入事件是否为边缘输入事件,若是则将输入 事件上报。
  20. 根据权利要求18或19所述的移动终端,其中,分屏状态包括:上下分屏和左右分屏。
  21. 根据权利要求20所述的移动终端,其中,所述应用框架层还包括:
    事件派发模块,配置为将所述第二判断模块和所述第一判断模块上报的事件进行上报。
  22. 根据权利要求21所述的移动终端,其中,所述应用框架层还包括:
    第一应用模块;
    第二应用模块;
    第三判断模块,配置为根据所述事件派发模块上报的事件中包含的设备标识判断事件是否为边缘输入事件,若属于,则上报给所述第一应用模块,否则上报给当所述第二应用模块;
    所述第一应用模块,配置为根据正常输入事件的相关参数对正常输入事件进行识别并将识别结果上报到应用层;
    所述第二应用模块,配置为根据边缘输入事件的相关参数对边缘输入事件进行识别并将识别结果上报的应用层。
  23. 根据权利要求12所述的移动终端,其中,所述输入设备为移动终端的触摸屏;
    所述触摸屏包括至少一个边缘输入区和至少一个正常输入区。
  24. 根据权利要求12所述的移动终端,其中,所述输入设备为移动终端的触摸屏;
    所述触摸屏包括至少一个边缘输入区、至少一个正常输入区和至少一个过渡区。
  25. 一种具有通讯功能的智能终端,所述智能终端包括第一显示区域和第二显示区域,还包括:触摸屏、动作传感器和处理器;
    触摸屏,包括:触摸面板和触摸控制器,其中:
    触摸面板,配置为检测产生于触摸面板上的触摸信号;
    触摸控制器,配置为根据触摸信号识别触摸点;
    动作传感器,配置为检测所述用户设备的旋转角度;
    处理器,包括:驱动模块、应用框架模块和应用模块,其中:
    所述驱动模块,配置为根据所述触摸信号获取输入事件,并上报到所述应用框架模块;
    所述应用框架模块,配置为根据上报的输入事件的触摸点位置、所述移动终端旋转角度及分屏状态,判断触摸点是位于第一显示区域的边缘触摸区域或正常触摸区域,还是位于第二显示区域的边缘触摸区域或正常触摸区域,并根据判断结果进行识别以及将识别结果上报给应用模块;
    应用模块,配置为基于判断结果执行相应的指令。
  26. 一种计算机存储介质,所述计算机存储介质中存储有计算机可执行指令,该计算机可执行指令配置为执行上述权利要求1-3任一项所述的方法及权利要求5-11任一项所述的方法。
PCT/CN2016/106171 2015-11-20 2016-11-16 触摸控制方法、用户设备、输入处理方法、移动终端及智能终端 Ceased WO2017097097A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/781,955 US20180364865A1 (en) 2015-11-20 2016-11-16 Touch control method, user equipment, input processing method, mobile terminal and intelligent terminal

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201510811872 2015-11-20
CN201510896531.8A CN105511675B (zh) 2015-11-20 2015-12-07 触摸控制方法、用户设备、输入处理方法、移动终端及智能终端
CN201510896531.8 2015-12-07

Publications (1)

Publication Number Publication Date
WO2017097097A1 true WO2017097097A1 (zh) 2017-06-15

Family

ID=55719715

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/106171 Ceased WO2017097097A1 (zh) 2015-11-20 2016-11-16 触摸控制方法、用户设备、输入处理方法、移动终端及智能终端

Country Status (3)

Country Link
US (1) US20180364865A1 (zh)
CN (1) CN105511675B (zh)
WO (1) WO2017097097A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113253858A (zh) * 2020-02-13 2021-08-13 北京小米移动软件有限公司 触控屏的控制方法及装置、移动终端和存储介质
CN114356133A (zh) * 2021-12-23 2022-04-15 深圳市创易联合科技有限公司 触控物体的尺寸分析方法、装置、终端设备以及存储介质

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105335007B (zh) * 2015-11-20 2019-10-08 努比亚技术有限公司 触摸控制方法、用户设备、输入处理方法和移动终端
CN105511675B (zh) * 2015-11-20 2020-07-24 重庆桔子科技发展有限公司 触摸控制方法、用户设备、输入处理方法、移动终端及智能终端
CN106095163B (zh) * 2016-05-30 2019-01-22 京东方科技集团股份有限公司 触控屏的驱动装置、显示装置
CN106101423B (zh) * 2016-06-28 2019-11-05 努比亚技术有限公司 分屏区域大小调整装置及方法
US10739927B2 (en) 2016-10-11 2020-08-11 Huawei Technologies Co., Ltd. Operation detection method and apparatus, and mobile terminal
CN106681635B (zh) * 2016-12-16 2020-09-29 Oppo广东移动通信有限公司 一种分屏防误触方法、装置及移动终端
CN106802764B (zh) * 2017-01-19 2020-03-31 努比亚技术有限公司 一种基于边缘输入的试穿戴装置及方法
CN107479745B (zh) * 2017-07-31 2020-07-21 北京雷石天地电子技术有限公司 一种配置触摸屏的方法、模块及操作系统
CN108089805A (zh) * 2017-12-28 2018-05-29 努比亚技术有限公司 一种图片操作方法、移动终端和计算机可读存储介质
CN110049177A (zh) * 2018-01-16 2019-07-23 中兴通讯股份有限公司 一种新消息处理方法、装置及存储介质
CN109710169B (zh) * 2018-12-29 2023-09-08 深圳市瑞比德传感技术有限公司 一种基于温度传感器的控制方法、移动终端及存储介质
CN110045819B (zh) * 2019-03-01 2021-07-09 华为技术有限公司 一种手势处理方法及设备
JP7400205B2 (ja) * 2019-04-02 2023-12-19 船井電機株式会社 入力装置
CN110262705B (zh) * 2019-06-24 2022-05-27 北京集创北方科技股份有限公司 定位方法、定位装置及电子设备
KR102732966B1 (ko) 2019-08-02 2024-11-22 삼성전자주식회사 휠 입력을 처리하는 전자 장치 및 이의 동작 방법
CN110716660B (zh) * 2019-09-02 2023-05-09 Oppo(重庆)智能科技有限公司 一种触摸屏启动方法及终端、存储介质
CN110955568B (zh) * 2019-11-06 2023-09-01 Oppo(重庆)智能科技有限公司 触摸屏问题的定位方法及装置、设备、存储介质
CN111104012B (zh) * 2019-12-12 2021-06-15 惠州Tcl移动通信有限公司 测距方法及其装置、存储介质及终端设备
CN111158819B (zh) * 2019-12-25 2024-02-20 广州华多网络科技有限公司 界面状态的确定方法、装置、设备及存储介质
CN111258455B (zh) * 2020-01-17 2023-08-18 Oppo广东移动通信有限公司 一种事件流处理方法、事件流处理装置及移动终端
CN111338506B (zh) * 2020-02-19 2022-01-07 Oppo广东移动通信有限公司 触摸响应方法、装置、电子设备及存储介质
CN113395389B (zh) * 2020-03-13 2022-12-02 北京小米移动软件有限公司 一种防止屏幕误触的方法、装置及存储介质
CN119248132B (zh) * 2024-04-25 2025-10-24 荣耀终端股份有限公司 触摸检测方法和终端

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101676843A (zh) * 2008-09-18 2010-03-24 联想(北京)有限公司 触摸输入方法及触摸输入装置
CN102236468A (zh) * 2010-04-26 2011-11-09 宏达国际电子股份有限公司 感测方法、计算机程序产品与便携式装置
CN104735256A (zh) * 2015-03-27 2015-06-24 努比亚技术有限公司 移动终端的握持方式判断方法及装置
CN104735255A (zh) * 2015-03-27 2015-06-24 努比亚技术有限公司 分屏显示方法和系统
US20150309668A1 (en) * 2014-04-24 2015-10-29 Hisense Mobile Communications Technology Co., Ltd. Methods for operating multiple windows on a handheld mobile terminal and the handheld mobile terminal conducting the same
CN105511675A (zh) * 2015-11-20 2016-04-20 努比亚技术有限公司 触摸控制方法、用户设备、输入处理方法、移动终端及智能终端

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110089032A (ko) * 2010-01-29 2011-08-04 주식회사 팬택 이동 단말기 및 이동 단말기를 이용한 정보 표시 방법
JP5423894B2 (ja) * 2010-07-05 2014-02-19 富士通株式会社 電子機器、制御プログラムおよび制御方法
US20120289290A1 (en) * 2011-05-12 2012-11-15 KT Corporation, KT TECH INC. Transferring objects between application windows displayed on mobile terminal
JP5978660B2 (ja) * 2012-03-06 2016-08-24 ソニー株式会社 情報処理装置及び情報処理方法
KR20160088603A (ko) * 2015-01-16 2016-07-26 삼성전자주식회사 화면 제어 장치 및 방법

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101676843A (zh) * 2008-09-18 2010-03-24 联想(北京)有限公司 触摸输入方法及触摸输入装置
CN102236468A (zh) * 2010-04-26 2011-11-09 宏达国际电子股份有限公司 感测方法、计算机程序产品与便携式装置
US20150309668A1 (en) * 2014-04-24 2015-10-29 Hisense Mobile Communications Technology Co., Ltd. Methods for operating multiple windows on a handheld mobile terminal and the handheld mobile terminal conducting the same
CN104735256A (zh) * 2015-03-27 2015-06-24 努比亚技术有限公司 移动终端的握持方式判断方法及装置
CN104735255A (zh) * 2015-03-27 2015-06-24 努比亚技术有限公司 分屏显示方法和系统
CN105511675A (zh) * 2015-11-20 2016-04-20 努比亚技术有限公司 触摸控制方法、用户设备、输入处理方法、移动终端及智能终端

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113253858A (zh) * 2020-02-13 2021-08-13 北京小米移动软件有限公司 触控屏的控制方法及装置、移动终端和存储介质
CN114356133A (zh) * 2021-12-23 2022-04-15 深圳市创易联合科技有限公司 触控物体的尺寸分析方法、装置、终端设备以及存储介质
CN114356133B (zh) * 2021-12-23 2023-12-01 深圳市创易联合科技有限公司 触控物体的尺寸分析方法、装置、终端设备以及存储介质

Also Published As

Publication number Publication date
US20180364865A1 (en) 2018-12-20
CN105511675A (zh) 2016-04-20
CN105511675B (zh) 2020-07-24

Similar Documents

Publication Publication Date Title
CN105511675B (zh) 触摸控制方法、用户设备、输入处理方法、移动终端及智能终端
US11042185B2 (en) User terminal device and displaying method thereof
KR102895498B1 (ko) 사용자 단말 장치 및 이의 디스플레이 방법
US10168797B2 (en) Terminal apparatus, audio system, and method for controlling sound volume of external speaker thereof
KR102119843B1 (ko) 사용자 단말 장치 및 이의 디스플레이 방법
EP3091426B1 (en) User terminal device providing user interaction and method therefor
US10712918B2 (en) User terminal device and displaying method thereof
US20170322713A1 (en) Display apparatus and method for controlling the same and computer-readable recording medium
WO2017084470A1 (zh) 移动终端、输入处理方法及用户设备、计算机存储介质
US20180181217A1 (en) User terminal device and method for controlling the user terminal device thereof
US20200371685A1 (en) Graphical User Interface Display Method And Electronic Device
US10067666B2 (en) User terminal device and method for controlling the same
US20170185373A1 (en) User terminal device, and mode conversion method and sound system for controlling volume of speaker thereof
US20130135228A1 (en) Device and method for displaying object in terminal
US20150227166A1 (en) User terminal device and displaying method thereof
KR102132390B1 (ko) 사용자 단말 장치 및 이의 디스플레이 방법
US11157127B2 (en) User terminal apparatus and controlling method thereof
US20160139797A1 (en) Display apparatus and contol method thereof
KR102168648B1 (ko) 사용자 단말 장치 및 그 제어 방법
KR20150094479A (ko) 사용자 단말 장치 및 이의 디스플레이 방법
WO2017084469A1 (zh) 触摸控制方法、用户设备、输入处理方法和移动终端
KR20150134674A (ko) 사용자 단말 및 이의 제어 방법, 그리고 멀티미디어 시스템
CN103324394A (zh) 用于移动终端的输入控制方法和移动终端
US10474335B2 (en) Image selection for setting avatars in communication applications
WO2017088694A1 (zh) 手势校准方法、装置及手势输入处理方法、计算机存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16872289

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16872289

Country of ref document: EP

Kind code of ref document: A1