CN104820551A - Method and device for touch operation in terminal - Google Patents
Method and device for touch operation in terminal Download PDFInfo
- Publication number
- CN104820551A CN104820551A CN201510203099.XA CN201510203099A CN104820551A CN 104820551 A CN104820551 A CN 104820551A CN 201510203099 A CN201510203099 A CN 201510203099A CN 104820551 A CN104820551 A CN 104820551A
- Authority
- CN
- China
- Prior art keywords
- window
- data
- coordinate position
- touch event
- adjustment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- User Interface Of Digital Computer (AREA)
- Digital Computer Display Output (AREA)
Abstract
Embodiments of the invention provide a method and a device for a touch operation in a terminal. The method comprises the following steps of adjusting a window in a display screen according to adjusting data in an adjusting command when the adjusting command of the window is received; mapping a first coordinate position where a touch event occurs to a second coordinate position according to the adjusting data when the touch event on the touch screen is received; and transmitting the touch event to the window with the original position in the display screen as the second coordinate position so as to drive an application to which the window belongs to execute the corresponding operation. According to the embodiments, the logical relationship between the window and the position thereof cannot be changed, and the touch event is mapped and reported, so that secondary forwarding is avoided and stability is greatly improved.
Description
Technical field
The present invention relates to technical field of touch control, particularly relate to a kind of touch operation method in the terminal and a kind of touch control operation device in the terminal.
Background technology
Along with the development of science and technology, various terminal, especially such as the mobile device such as mobile phone, panel computer is also more and more higher in the utilization rate of each side such as work, study, daily interchange of people.
Conveniently user reading and the factor such as to check, the screen of terminal is increasing.
When the screen of terminal is larger, user's one-handed performance becomes more and more inconvenient.Therefore, singlehanded manipulation technology is just arisen at the historic moment, and wherein, window being moved to the region that one hand can manipulate is one of scheme of singlehanded manipulation technology.
After window moves, screen is not mobile, and therefore touch event needs synchronously to map.Current window moves scheme
Generally to forward the secondary of system event, therefore, there is the synchronism problem that secondary forwards afterwards and control manipulates, and touch screen event be to the adaptability of otherness control and compatibility issue.
For solving problem above, greatly can increase the complexity of system and application, reducing the stability of product, reduce response speed.
Summary of the invention
In view of the above problems, the embodiment of the present invention is proposed to provide a kind of overcoming the problems referred to above or a kind of touch operation method in the terminal solved the problem at least in part and a kind of touch control operation device in the terminal accordingly.
In order to solve the problem, the embodiment of the invention discloses a kind of touch operation method in the terminal, comprising:
When receiving the adjustment instruction of window, according to the window of adjustment data point reuse in display screen in described adjustment instruction;
When receive touch-screen there is touch event time, be the second coordinate position by the first coordinate position that described touch event occurs according to described adjustment data-mapping;
Be sent to by described touch event, in display screen, original position is the window of described second coordinate position, performs corresponding operation to drive the application belonging to described window.
Preferably, the described step according to the window of adjustment data point reuse in display screen in described adjustment instruction comprises:
Adjustment data in described adjustment instruction are sent to Window state class by window management service;
Refresh display window time, window management service transfer window corresponding, the window data be stored in Window state class; Described window data is included in the raw data in display screen and adjusts data;
Window management service carries out adjustment process according to adjustment data to raw data, shows to obtain display data.
Preferably, described when detect touch-screen there is touch event time, the first coordinate position that described touch event occurs is comprised according to the step that described adjustment data-mapping is the second coordinate position:
Input audiomonitor obtains the window data be stored in Window state class;
The first coordinate position that described touch event occurs, according to the adjustment data in described window data, is mapped as the second coordinate position by input audiomonitor.
Preferably, to be describedly sent to by described touch event, in display screen, original position is the window of described second coordinate position, comprises with the step driving the application belonging to described window to perform corresponding operation:
Described touch event is sent to by input audiomonitor, and in window data, original position is the window of described second coordinate position, performs corresponding operation to drive the application belonging to described window.
Preferably, described adjustment data comprise side-play amount and/or scaling;
Described window management service carries out adjustment process according to adjustment data to raw data, and the step of carrying out showing to obtain display data comprises:
Window management service, to raw data superposition side-play amount, shows to obtain display data;
Or,
Window management service is multiplied by scaling to raw data, shows to obtain display data;
Or,
Window management service is multiplied by scaling to raw data, to obtain variable data;
Window management service, to variable data superposition side-play amount, shows to obtain display data;
The step that the first coordinate position that described touch event occurs is mapped as the second coordinate position, according to the adjustment data in described window data, comprises by described input audiomonitor:
Input audiomonitor deducts side-play amount, to obtain the second coordinate position to the first coordinate position that described touch event occurs;
Or,
Input audiomonitor to there is the first coordinate position of described touch event divided by scaling, to obtain the second coordinate position;
Or,
Input audiomonitor deducts side-play amount, to obtain variable position to the first coordinate position that described touch event occurs;
Input audiomonitor to described variable position divided by scaling, to obtain the second coordinate position.
The embodiment of the invention also discloses a kind of touch control operation device in the terminal, comprising:
Window adjustment module, for when the adjustment instruction receiving window, according to the window of adjustment data point reuse in display screen in described adjustment instruction;
Position mapping block, for receive touch-screen there is touch event time, be the second coordinate position by the first coordinate position that described touch event occurs according to described adjustment data-mapping;
Case distribution module, for being sent to by described touch event, in display screen, original position is the window of described second coordinate position, performs corresponding operation to drive the application belonging to described window.
Preferably, described window adjustment module comprises window management Attendant sub-module, and described window management Attendant sub-module comprises:
Adjustment data send submodule, for the adjustment data in described adjustment instruction are sent to Window state class;
Window data calls submodule, for refresh display window time, transfer window corresponding, the window data be stored in Window state class; Described window data is included in the raw data in display screen and adjusts data;
Adjustment process submodule, for carrying out adjustment process according to adjustment data to raw data, shows to obtain display data.
Preferably, described position mapping block comprises input audiomonitor first submodule, and described input audiomonitor first submodule comprises:
Window data obtains submodule, for obtaining the window data be stored in Window state class;
Touch event mapping submodule, for according to the adjustment data in described window data, is mapped as the second coordinate position by the first coordinate position that described touch event occurs.
Preferably, described case distribution module comprises input audiomonitor second submodule, and described input audiomonitor second submodule comprises:
Event data distribution submodule, for being sent to by described touch event, in window data, original position is the window of described second coordinate position, performs corresponding operation to drive the application belonging to described window.
Preferably, described adjustment data comprise side-play amount and/or scaling;
Described adjustment process submodule comprises:
First mover module, for raw data superposition side-play amount, shows to obtain display data;
Or,
First convergent-divergent submodule, for being multiplied by scaling to raw data, shows to obtain display data;
Or,
Second convergent-divergent submodule, for being multiplied by scaling to raw data, to obtain variable data;
Second mover module, for variable data superposition side-play amount, shows to obtain display data;
Described touch event mapping submodule comprises:
3rd mover module, for deducting side-play amount, to obtain the second coordinate position to the first coordinate position that described touch event occurs;
Or,
3rd convergent-divergent submodule, for there is the first coordinate position of described touch event divided by scaling, to obtain the second coordinate position;
Or,
4th mover module, for deducting side-play amount, to obtain variable position to the first coordinate position that described touch event occurs;
4th convergent-divergent submodule, for described variable position divided by scaling, to obtain the second coordinate position.
The embodiment of the present invention comprises following advantage:
The embodiment of the present invention is according to after the window of adjustment data point reuse in display screen, by the touch event of generation by the first coordinate position occurred according to adjustment data-mapping be the second coordinate position, and this touch event is sent to, in display screen, original position is the window of the second coordinate position, to perform corresponding operation, the thought changed by display screen virtual origin carries out touch control operation, the logical relation of window and position thereof does not change, touch event is carried out mapping report, avoid secondary to forward, the stability substantially increased.
Accompanying drawing explanation
Fig. 1 is the structured flowchart of a kind of terminal of the present invention;
Fig. 2 is the flow chart of steps of a kind of touch operation method embodiment in the terminal of the present invention;
Fig. 3 A-Fig. 3 D is the adjustment exemplary plot of a kind of window of the present invention;
Fig. 4 is the structural drawing of a kind of window management system of the present invention;
Fig. 5 is the structured flowchart of a kind of touch control operation device embodiment in the terminal of the present invention.
Embodiment
For enabling above-mentioned purpose of the present invention, feature and advantage become apparent more, and below in conjunction with the drawings and specific embodiments, the present invention is further detailed explanation.
Can carry out in the terminal of touch control operation, generally can comprise display screen and touch-screen (touchscreen).
Wherein, display screen can by user interface (User Interface, UI) element, as window (comprising control) is shown on screen, specifically can comprise LCD (Liquid Crystal Display, liquid crystal display) display screen, LED (Light-Emitting Diode, light emitting diode) display screen etc.
Touch-screen can be called again " touch screen ", " contact panel ", it is an induction type liquid crystal indicator that can receive the input signals such as contact, specifically can comprise vector pressure sensing technology touch-screen, resistive technologies touch-screen, capacitance technology touch-screen, infrared technology touch-screen, surface acoustic wave technique touch-screen etc., the embodiment of the present invention is not limited this.
In most cases, touch-screen is attached on display screen, if can measure touch point coordinate position on the touchscreen, then can know the intention of toucher according to the user interface element of respective coordinates position on display screen, operate accordingly, as closed, confirming, return etc.
As shown in Figure 1, for mobile phone 100, mobile phone 100 can comprise fuselage 100, display screen 102, panel 103, and wherein, panel 103 comprises touch-screen 1031, and touch-screen 1031 adheres on the display screen 102.
The screen of terminal is increasing, as mobile phone screen develops into 5.2 inches, 5.5 inches from 4.7 inches, 5 inches, even larger, and user's one-handed performance becomes more and more inconvenient.
Such as, the thumb length of the male sex, generally at about 175px, can touch each corner of 4 inches of touch-screens substantially, but only can cover the region of 1/3rd in 6.4 inches of touch-screens, and the region of residue 2/3rds cannot be touched.
Conveniently user's one-handed performance, currently provides window and moves scheme, and it is roughly divided into two kinds:
Scheme is an application process, and great majority application is all made up of several or tens even more controls, wherein also has the nested situation of child control.
After control is moved with window, touch event is sent to the dominant control of the window being positioned at its coordinate position, dominant control needs to recalculate coordinate position according to side-play amount, then touch event is transmitted to corresponding child control, realizes its function by child control.
Another kind of scheme is window treatments, great majority application is all made up of several or tens even more controls, except main window, also have the subwindow of input method window, various pop-up window and self-defined pattern, the position of each window needs independent calculating.
After window moves, touch event is sent to main window, main window needs to recalculate coordinate position according to side-play amount, then touch event is transmitted to corresponding subwindow, realizes its function by subwindow.
All there is secondary and forward in two kinds of modes, namely touch event is transmitted to dominant control, is transmitted to child control by dominant control again, and touch event is transmitted to main window, is transmitted to subwindow by main window again, there is synchronism problem, adaptability and compatibility issue.
So-called synchronism, the display position data referring to control must be mated with the data of touch event.
When first time display window (comprising control), relation between the position of display screen and window (comprising control) is determined, namely each control is fixed for the relative position of the screen initial point (point in the upper left corner) of display screen, and it is determined with touch screen mapping events relation.If after changing the position of control, each child control in this control will adjust its relative position relative to the screen initial point of display screen, and it also will remap with touch screen mapping events relation.
Adaptability and compatibility issue are mainly reflected in the layout of control, such as certain control, be presented at time full frame in the middle of display screen, if offset, it should be presented at the centre of the window after skew, but it may be in left side, also may be in right side in display screen, and the processing mode of middle position display live together a left side, occupy right display etc. processing mode all otherwise with.
In application process, under many circumstances, the logic state changing touch screen event is needed.Wherein, the logic state of touch event comprises the data such as time, position, type, touch duration, being directed to for original state drives layer to report, but some special event is through its partial status when window management part is distributed and there occurs change, therefore the event that receives of upper strata and touch-screen real event different, if carry out secondary distribution again, the logic state of this event changes.
Such as, there is a pop-up window, finger touch point slides into after window and lifts in window, the event type that touch screen drives layer finally to report should be Action_UP (lifting), and window management module finds that when distributing this point is not in window, its event type may will be converted to cancel (cancellation), and then notice application.
As mentioned above, for the control after ensureing skew normally uses, need all situations mating control in theory, comprise specified location in user, the control of specifying size etc., will go wrong if inconsiderate, considerably increase the complexity of system and application like this, reduce the stability of product, reduce response speed.
Therefore, one of core idea proposing the embodiment of the present invention, to the touch event that touch-screen reports, the adjustment data according to window map, then report corresponding window, realize the synchronous of touchscreen data and display interface.
With reference to Fig. 2, show the flow chart of steps of a kind of touch operation method embodiment in the terminal of the present invention, specifically can comprise the steps:
Step 201, when receiving the adjustment instruction of window, according to the window of adjustment data point reuse in display screen in described adjustment instruction;
In embodiments of the present invention, can according to the window of adjustment data point reuse in display screen in application layer;
In actual applications, can by the adjustment instruction of operation toggle window of specifying, this adjustment instruction comprises adjustment data, namely indicates the information how adjusting window, according to this adjustment data point reuse window, makes terminal adapt to one-handed performance.
Wherein, user can pass through to click certain physical button, or, click certain control, or, trigger certain operating gesture, or the operations such as inclination mobile phone, trigger adjustment instruction, the embodiment of the present invention is not limited to this.
In specific implementation, this adjustment data can default setting, if displacement, moving direction are default settings, also can generate according to the operation of specifying in real time, as the direction of operating gesture is set to moving direction, the distance of operating gesture is directly proportional etc. to the distance of movement, and the embodiment of the present invention is not limited this.
Such as, as shown in Figure 3A, main window 302 (both are overlapping) is shown in display screen 301, the virtual origin 305 of display screen 301 is positioned at the upper left corner, and coordinate is (0,0), the original size of main window 306 is (W, H), wherein, W is wide, H is high, main window 302 comprises subwindow 303 and subwindow 304, can comprise control in subwindow 303 and subwindow 304, and the position of subwindow 303 is A (x
1, y
1), the position of subwindow 304 is B (x
2, y
2).
Wherein, position A and position B can be a value, as (300,200), also can be a scope, as the upper left corner be (300,200), the lower right corner is the rectangle of (350,250).
Subwindow 303 is positioned at the position A of display screen 301, sees in the angle of user, and subwindow 303 also should be position A in the position of touch-screen, if the control in user view triggers window 303, should point touching screen position A.
In like manner, subwindow 304 is positioned at the position B of display screen 301, sees in the angle of user, and subwindow 304 also should be position B in the position of touch-screen, if the control in user view triggers window 304, should point touching screen position B.
If user uses the possibly control that cannot touch in subwindow 303 of right hand one-handed performance, then by the operation such as moving window, resize-window, subwindow 303 can be adjusted toward lower right.
If user uses the possibly control that cannot touch in subwindow 304 of left hand one-handed performance, then by the operation such as moving window, resize-window, subwindow 304 can be adjusted toward upper left side.
It should be noted that the terminal in the embodiment of the present invention can comprise mobile device, such as, mobile phone, panel computer etc., also can comprise fixed equipment, and such as, PC etc., the embodiment of the present invention is not limited this.
These terminals can be supported to comprise the operating system such as Windows, Android (Android), IOS, WindowsPhone, the embodiment of the present invention is understood better for making those skilled in the art, in embodiments of the present invention, Android (Android) is described as a kind of example of terminal system.
In one preferred embodiment of the invention, step 201 can comprise following sub-step:
Sub-step S11, the adjustment data in described adjustment instruction are sent to Window state class by window management service;
Sub-step S12, refresh display window time, window management service transfer window corresponding, the window data be stored in Window state class;
Wherein, described window data can be included in the raw data in display screen and adjust data;
Sub-step S13, window management service carries out adjustment process according to adjustment data to raw data, shows to obtain display data.
As shown in Figure 4, in android system, from the angle of design, window management system is based on C/S (Server/Client, service end/client) pattern.
Whole window management system can be divided into service end (Server) and client (Client) two large divisions, and client is responsible for request and is created window and use window, and service end completes the maintenance of window, window display etc.
At client (Client), be not directly with WindowManagerService (window management service) alternately, but directly and native object WindowManager (window manager) alternately, then complete with WindowManagerService by WindowManager mutual.
For the application in android system, this is transparent alternately, and application generally can not perceive the existence of WindowManagerService.
In the application framework of android system, window is mainly divided into two kinds:
The first is the window of application: an Activity assembly (interactive interface being covered with whole window or being suspended on other windows, usually in one application, to be made up of multiple Activity) there is a main window, the dialog box ejected also has a window, Menu (menu) is also a window, etc.In same Activity, associated by this Activity between the window of main window, dialog box, Menu.
The second is the window of public interface: as nearest run dialog, shutdown dialog box, the drop-down hurdle of status bar, locking screen interface etc.These windows are all the windows of system level, are not subordinated to any application, and Activity it doesn't matter.
The window management of android system based on C/S model, and uses the mode of detached process to realize.
It is inner that the service end WindowManagerService of window management operates in independently process system_server (system service), when application needs to create window, window is created, by WindowManagerService to the application passes interaction message relevant with window by the mode request WindowManagerService of process communication.The window of all application is all in service end management, and display and the control of window all process in WindowManagerService.
WindowManagerService mainly completes following a few partial function:
1, the interpolation of window and deletion;
2, window display and hide control;
3, Z-order sequence management;
4, the management of focus window and focus application;
5, input method window management and wallpaper window management;
6, transition animation;
7, system message is collected and distribution.
Several classes of the core of service end (Server) are:
WindowManagerService.java
WindowState.java
WindowToken.java
AppWindowToken.java
Session.java
InputManager.java
InputMonitor.java
Wherein, WindowManagerService has been responsible for the management work of window;
WindowState (Window state class) and client window are one to one, namely each window has a WindowState, when application call WindowManager.addView () creates window, WindowState one_to_one corresponding with it can be added at WindowManagerService.
InputMonitor (input audiomonitor) is responsible for the message distribution function on upper strata.
In actual applications, WindowState saves nearly all attribute and the status data of the window of its correspondence, can say that WindowState just represents window.
WindowManagerService can carry out the state of management window by the attribute of WindowState and status data, comprise level, and focus is distributed, location layout etc.
Most of data of WindowState generate when window creation, and partial status data and adjustment data are controlled to use by WindowManagerService.
WindowManagerService, when receiving adjustment instruction, extracts adjustment instruction from adjustment instruction, according to the original strategy of window layout, as the dependence etc. between the level of window, window, gives adjustment Data dissemination the window needing adjustment.
WindowManageService carries out refreshing display at control window, recall the window data in WindowState corresponding to window, comprising raw data (as original size, original position etc.) and adjustment data, based on raw data and the display data adjusting data calculation window, as target location and target sizes etc., show according to these display data to drive display screen.
In a kind of preferred exemplary of the embodiment of the present invention, described adjustment data can comprise side-play amount and/or scaling;
Wherein, side-play amount can be the moving direction of window movement and displacement, may be used for moving window;
Scaling can the window ratio that reduces or amplify, may be used for reducing or method window.
In this example, this sub-step S13 can comprise following sub-step:
Sub-step S131, window management service superposes side-play amount to raw data, shows to obtain display data;
In this example, for mobile operation, can on the basis in the original position of raw data, superposition side-play amount, obtains the target location for showing, and the target sizes of its display can continue to use the original size of raw data.
Such as, as shown in Figure 3 B, side-play amount is (Δ x, Δ y), then can by the distance of main window 302 (comprising subwindow 303) mobile (Δ x, Δ y), shown in dotted line, the coordinate of the virtual origin 305 ' of the display screen after movement is (Δ x, Δ y), and the position A ' of the subwindow 303 after mobile is (x
1+ Δ x, y
1+ Δ y).
Or,
Sub-step S132, window management service is multiplied by scaling to raw data, shows to obtain display data;
In this example, for zoom operations, can carrying out convergent-divergent, obtaining the target sizes for showing on the basis of the original size of raw data according to scaling, the virtual origin that its target location shown can rely on display screen carries out layout.
Such as, as shown in Figure 3 C, scaling is n% (n is positive number), then the original size of main window 302 (comprising subwindow 304) can be scaled n%, the target sizes of main window 302 is (W*n%, H*n%), shown in dotted line, the coordinate of the virtual origin 305 ' of the display screen after convergent-divergent is (0,0), namely overlapping with the virtual origin 305 before convergent-divergent, the position B ' of the subwindow 304 after convergent-divergent is (x
2* n%, y
2* n%).
Or,
Sub-step S133, window management service is multiplied by scaling to raw data, to obtain variable data;
Sub-step S134, window management service superposes side-play amount to variable data, shows to obtain display data;
In this example, for mobile operation and zoom operations, first can carry out zoom operations, carry out again moving operation, namely on the basis of the original size of raw data, convergent-divergent can being carried out according to scaling, obtaining the target sizes for showing, variable position (variable data) can carry out layout along the virtual origin of display screen, on the basis of variable position, superposition side-play amount, obtains the target location for showing.
Such as, as shown in Figure 3 D, side-play amount is (Δ x, Δ y), scaling is n% (n is positive number), then the original size of main window 302 (comprising subwindow 303, subwindow 304) can be scaled n%, the target sizes as main window 302 is (W*n%, H*n%), the variable position of subwindow 303 is (x
1* n%, y
1* n%), the variable position of subwindow 304 is (x
2* n%, y
2* n%), again by mobile for main window 302 (comprising subwindow 303, subwindow 304) (Δ x, Δ y) distance, shown in dotted line, the coordinate of the virtual origin 305 ' after adjustment is (Δ x, Δ y), the position A ' of the subwindow 303 after adjustment is (x
1* n%+ Δ x, y
1* n%+ Δ y), the position B ' of subwindow 304 is (x2*n%+ Δ x, y2*n%+ Δ y).
Certainly, just exemplarily, when implementing the embodiment of the present invention, can arrange other adjustment modes according to actual conditions, the embodiment of the present invention is not limited this above-mentioned adjustment mode.In addition, except above-mentioned adjustment mode, those skilled in the art can also adopt other adjustment mode according to actual needs, and the embodiment of the present invention is not also limited this.
Step 202, when receive touch-screen there is touch event time, be the second coordinate position by the first coordinate position that described touch event occurs according to described adjustment data-mapping;
In embodiments of the present invention, drive layer when the touch event that touch-screen occurs being detected, touch event can be reported application layer, can be the second coordinate position by there is the first coordinate position of described touch event according to described adjustment data-mapping in application layer.
If window adjusts, display screen display be adjustment after window (comprising control), see in the angle of user, window (comprising control) adjusts, and should click the window (comprising control) after adjustment and trigger corresponding function.
Suppose, the virtual origin (upper left corner) of display screen is (0,0), and the virtual origin (upper left corner, current value is the point of 0) of touch-screen is also (0,0), the displaying contents skew (x after adjustment window
0, y
0), the virtual origin of the display screen namely after adjustment is (x
0, y
0).
Because the relation between the position of display screen and window (comprising control) is determined, namely the relation between the original position of display screen and window (comprising control) is determined, and, the position relationship of touch-screen and display screen is one to one, system upper strata still thinks that the virtual origin of the display screen that window relies on is (0,0), the virtual origin of the touch-screen corresponding to it is (0,0).
Due to through adjustment, the position that user clicks is the physical location of touch-screen, and not it needs the position in display screen of the control triggered, the virtual origin (x of the display screen that what the touch event namely now reported relied on is after adjustment
0, y
0), but the touch event that system upper strata needs remains the virtual origin (0,0) depending on the display screen before moving in fact.
Therefore, in embodiments of the present invention, the first corresponding for touch event coordinate position can be converted to the second coordinate position according to adjustment data, the virtual origin relying on display screen by touch screen event institute is from (the x after adjusting
0, y
0) be mapped as (0,0) before adjustment, to obtain the actual position that user needs the display screen triggered.
Such as, as shown in Fig. 3 A-Fig. 3 D, the original position of subwindow 303 (comprising control) is A, the original position of subwindow 304 (comprising control) is B, after adjustment window, the target location of subwindow 303 (comprising control) is A ', the target location of subwindow 304 (comprising control) is B '.
See in the angle of user, subwindow 303 (comprising control) be presented at that target location is that A ' is upper, subwindow 304 (comprising control) is that to be presented at target location be on B ', therefore, user generally can click target location A ' on the touchscreen, control in intention triggers window 303, or, click target location B ' on the touchscreen, the control in intention triggers window 304.
In specific implementation, the operations such as user can carry out clicking by the mode such as hand, writing pencil on the touchscreen, slip, touch-screen can detect the touch signal of user, this touch signal is converted to touch event and coordinate position (the first coordinate position, namely in touch-screen, there is the position of touch event), as rectangular coordinate (i.e. X-coordinate and Y-coordinate).
Wherein, touch event specifically can comprise the event of pressing (Action_Down), moving event (Action_Move) and lift event (Action_Up) etc.
Wherein, press event (Action_Down) can represent that user presses at touch-screen and do not move, do not lift, moving event (Action_Move) can represent that user starts mobile (or sliding) after touch-screen is pressed, and lifts event (Action_Up) and can represent that user lifts at touch-screen.
Different touch events can combine definition touch control gesture, and application can trigger corresponding operation according to this touch control gesture, completes touch control operation.
In embodiments of the present invention, as shown in Fig. 3 A-Fig. 3 D, can will there is the touch event that target location is on the touchscreen A ' (the first coordinate position), target location is B ' (the first coordinate position), be mapped as and occur in the touch event that target location is A (the second coordinate position), target location is B (the second coordinate position), make it possible to the control in the control in triggered as normal subwindow 303, subwindow 304.
In one preferred embodiment of the invention, step 201 can comprise following sub-step:
Sub-step S21, input audiomonitor obtains the window data be stored in Window state class;
Sub-step S22, the first coordinate position that described touch event occurs, according to the adjustment data in described window data, is mapped as the second coordinate position by input audiomonitor.
In embodiments of the present invention, the data of the touch event of touch-screen can report InputMonitor, reset the event handling strategy of window binding in InputMonitor, i.e. the position of window and touch event distribution policy.
Specifically, WindowManagerService sends a notice to InputMonitor, after InputMonitor receives this notice, can obtain window data from WindowState.
This distribution policy can be preserved by InputWindowHandle (event handling interface) by InputMonitor, comprising the window ID of correspondence, event receiving area, the scaling of event and the mobile status of current window, its Data Source is all through window data that WindowState passes over to carry out conversion and obtains.
The binding of indication in the embodiment of the present invention, can refer to that the window data (WindowState) of each window correspond to an InputWindowHandle and processes.
In a kind of preferred exemplary of the embodiment of the present invention, described adjustment data can comprise side-play amount and/or scaling; Then in this example, sub-step S22 can comprise following sub-step:
Sub-step S221, input audiomonitor deducts side-play amount, to obtain the second coordinate position to the first coordinate position that described touch event occurs;
In this example, for mobile operation, on the basis of the first coordinate position (identical with the target location that window shows), side-play amount can be deducted, obtains the second coordinate position.
Such as, as shown in Figure 3 B, user is (x at touch-screen click location A ' (i.e. the first coordinate position)
1+ Δ x, y
1+ Δ y), if side-play amount is (Δ x, Δ y), then can at position A ' (x
1+ Δ x, y
1+ Δ y) on deduct side-play amount for (Δ x, Δ y), obtain the second coordinate position (x
1, y
1), i.e. the position A of subwindow 303.
Or,
Sub-step S222, inputs audiomonitor to there is the first coordinate position of described touch event divided by scaling, to obtain the second coordinate position;
In this example, for zoom operations, on the basis of the first coordinate position (identical with the target location that window shows), convergent-divergent can be carried out according to scaling, obtain the second coordinate position.
Such as, as shown in Figure 3 C, user is at touch-screen click location B ' (i.e. the first coordinate position) (x
2* n%, y
2* n%), if scaling is n% (n is positive number), then can at position B ' (x
2* n%, y
2* n%) on divided by scaling n%, obtain the second coordinate position (x
2, y
2), i.e. the position B of subwindow 304.
Or,
Sub-step S223, input audiomonitor deducts side-play amount, to obtain variable position to the first coordinate position that described touch event occurs;
Sub-step S224, inputs audiomonitor to described variable position divided by scaling, to obtain the second coordinate position.
In this example, for mobile operation and zoom operations, first can map mobile operation, map zoom operations again, namely side-play amount can be deducted on the basis of the first coordinate position (identical with the target location that window shows), carry out convergent-divergent according to scaling again, obtain the second coordinate position.
Such as, as shown in Figure 3 D, user is at touch-screen click location A ' (i.e. the first coordinate position) (x
1* n%+ Δ x, y
1* n%+ Δ y), position B ' (i.e. the first coordinate position) (x2*n%+ Δ x, y2*n%+ Δ y), if side-play amount is (Δ x, Δ y), scaling is n% (n is positive number), then can first at position A ' (x
1* n%+ Δ x, y
1* n%+ Δ y), B ' (x2*n%+ Δ x, y2*n%+ Δ y) deducts side-play amount for (Δ x, Δ y), obtain variable position (x
1* n%, y
1* n%), (x2*n%, y2*n%), then at variable position (x
1* n%, y
1* n%), on (x2*n%, y2*n%) divided by scaling n%, obtain the second coordinate position (x
1, y
1), (x
2, y
2), i.e. the position A of subwindow 303, the position B of subwindow 304.
Certainly, just exemplarily, when implementing the embodiment of the present invention, can arrange other mapping modes according to actual conditions, the embodiment of the present invention is not limited this above-mentioned mapping mode.In addition, except above-mentioned mapping mode, those skilled in the art can also adopt other mapping mode according to actual needs, and the embodiment of the present invention is not also limited this.
Step 203, is sent to described touch event, and in display screen, original position is the window of described second coordinate position, performs corresponding operation to drive the application belonging to described window.
In embodiments of the present invention, described touch event can be sent to, in display screen, original position is the window of described second coordinate position.
In specific implementation, the second coordinate position obtained after touch event maps, reflection be the original position of window, directly can be sent to corresponding window and process.
It should be noted that, in the embodiment of the present invention, touch event is sent to window by indication, this touch event can be referred to be sent to process corresponding to window or thread, belong to certain application by this process or thread, this process or thread perform corresponding operation according to the rule pre-set.
Such as, the control in certain window is the space bar of input method application, if touch event characterizes single-click operation, then inputs space, if touch event characterizes long by operation, then switches phonetic entry etc.
In one preferred embodiment of the invention, step 301 can comprise following sub-step:
Sub-step S31, described touch event is sent to by input audiomonitor, and in window data, original position is the window of described second coordinate position, performs corresponding operation to drive the application belonging to described window.
In embodiments of the present invention, window, when creating, to system bottom registered events call back function, can monitor touch event by InputMonitor.
When touchscreen events occurs, InputManager, by InputManager.Callbacks class response readjustment, calls WindowManagerService.InputMonitor again to receive touch event in readjustment.
InputMonitor finds the event handling interface (InputWindowHandle) that current window (WindowState) is corresponding, processes, and result is reported current window with the parameter after movement.
The embodiment of the present invention is according to after the window of adjustment data point reuse in display screen, by the touch event of generation by the first coordinate position occurred according to adjustment data-mapping be the second coordinate position, and this touch event is sent to, in display screen, original position is the window of the second coordinate position, to perform corresponding operation, the thought changed by display screen virtual origin carries out touch control operation:
One, system upper strata provides adjustment data, and does not need to carry out large change, portable strong;
Its two, the logical relation of window and position thereof does not change, and touch event is carried out mapping and reports, avoid secondary forward, the stability substantially increased;
Its three, do not carry out logic and state to touch event and change, do not affect original application, greatly reduce compatibility issue, complexity is little.
It should be noted that, for embodiment of the method, in order to simple description, therefore it is all expressed as a series of combination of actions, but those skilled in the art should know, the embodiment of the present invention is not by the restriction of described sequence of movement, because according to the embodiment of the present invention, some step can adopt other orders or carry out simultaneously.Secondly, those skilled in the art also should know, the embodiment described in instructions all belongs to preferred embodiment, and involved action might not be that the embodiment of the present invention is necessary.
With reference to Fig. 5, show the structured flowchart of a kind of touch control operation device embodiment in the terminal of the present invention, described terminal can comprise display screen and touch-screen, and repacking is put and specifically can be comprised as lower module:
Window adjustment module 501, for when receiving the adjustment instruction of window, according to the window of adjustment data point reuse in display screen in described adjustment instruction;
Position mapping block 502, for detect touch-screen there is touch event time, be the second coordinate position by the first coordinate position that described touch event occurs according to described adjustment data-mapping;
Case distribution module 503, for being sent to by described touch event, in display screen, original position is the window of described second coordinate position, performs corresponding operation to drive the application belonging to described window.
In one preferred embodiment of the invention, described window adjustment module can comprise window management Attendant sub-module, and described window management Attendant sub-module can comprise following submodule:
Adjustment data send submodule, for the adjustment data in described adjustment instruction are sent to Window state class;
Window data calls submodule, for refresh display window time, transfer window corresponding, the window data be stored in Window state class; Described window data is included in the raw data in display screen and adjusts data;
Adjustment process submodule, for carrying out adjustment process according to adjustment data to raw data, shows to obtain display data.
In one preferred embodiment of the invention, described position mapping block can comprise input audiomonitor first submodule, and described input audiomonitor first submodule can comprise following submodule:
Window data obtains submodule, for obtaining the window data be stored in Window state class;
Touch event mapping submodule, for according to the adjustment data in described window data, is mapped as the second coordinate position by the first coordinate position that described touch event occurs.
In one preferred embodiment of the invention, described case distribution module can comprise input audiomonitor second submodule, and described input audiomonitor second submodule can comprise following submodule:
Event data distribution submodule, for being sent to by described touch event, in window data, original position is the window of described second coordinate position, performs corresponding operation to drive the application belonging to described window.
In a kind of preferred exemplary of the embodiment of the present invention, described adjustment data can comprise side-play amount and/or scaling;
Described adjustment process submodule can comprise following submodule:
First mover module, for raw data superposition side-play amount, shows to obtain display data;
Or,
First convergent-divergent submodule, for being multiplied by scaling to raw data, shows to obtain display data;
Or,
Second convergent-divergent submodule, for being multiplied by scaling to raw data, to obtain variable data;
Second mover module, for variable data superposition side-play amount, shows to obtain display data;
Described touch event mapping submodule can comprise following submodule:
3rd mover module, for deducting side-play amount, to obtain the second coordinate position to the first coordinate position that described touch event occurs;
Or,
3rd convergent-divergent submodule, for there is the first coordinate position of described touch event divided by scaling, to obtain the second coordinate position;
Or,
4th mover module, for deducting side-play amount, to obtain variable position to the first coordinate position that described touch event occurs;
4th convergent-divergent submodule, for described variable position divided by scaling, to obtain the second coordinate position.
For device embodiment, due to itself and embodiment of the method basic simlarity, so description is fairly simple, relevant part illustrates see the part of embodiment of the method.
Each embodiment in this instructions all adopts the mode of going forward one by one to describe, and what each embodiment stressed is the difference with other embodiments, between each embodiment identical similar part mutually see.
Those skilled in the art should understand, the embodiment of the embodiment of the present invention can be provided as method, device or computer program.Therefore, the embodiment of the present invention can adopt the form of complete hardware embodiment, completely software implementation or the embodiment in conjunction with software and hardware aspect.And the embodiment of the present invention can adopt in one or more form wherein including the upper computer program implemented of computer-usable storage medium (including but not limited to magnetic disk memory, CD-ROM, optical memory etc.) of computer usable program code.
The embodiment of the present invention describes with reference to according to the process flow diagram of the method for the embodiment of the present invention, terminal device (system) and computer program and/or block scheme.Should understand can by the combination of the flow process in each flow process in computer program instructions realization flow figure and/or block scheme and/or square frame and process flow diagram and/or block scheme and/or square frame.These computer program instructions can being provided to the processor of multi-purpose computer, special purpose computer, Embedded Processor or other programmable data processing terminal equipment to produce a machine, making the instruction performed by the processor of computing machine or other programmable data processing terminal equipment produce device for realizing the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.
These computer program instructions also can be stored in can in the computer-readable memory that works in a specific way of vectoring computer or other programmable data processing terminal equipment, the instruction making to be stored in this computer-readable memory produces the manufacture comprising command device, and this command device realizes the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.
These computer program instructions also can be loaded on computing machine or other programmable data processing terminal equipment, make to perform sequence of operations step to produce computer implemented process on computing machine or other programmable terminal equipment, thus the instruction performed on computing machine or other programmable terminal equipment is provided for the step realizing the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.
Although described the preferred embodiment of the embodiment of the present invention, those skilled in the art once obtain the basic creative concept of cicada, then can make other change and amendment to these embodiments.So claims are intended to be interpreted as comprising preferred embodiment and falling into all changes and the amendment of embodiment of the present invention scope.
Finally, also it should be noted that, in this article, the such as relational terms of first and second grades and so on is only used for an entity or operation to separate with another entity or operational zone, and not necessarily requires or imply the relation that there is any this reality between these entities or operation or sequentially.And, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, article or terminal device and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, article or terminal device.When not more restrictions, the key element limited by statement " comprising ... ", and be not precluded within process, method, article or the terminal device comprising described key element and also there is other identical element.
Above to a kind of touch operation method in the terminal provided by the present invention and a kind of touch control operation device in the terminal, be described in detail, apply specific case herein to set forth principle of the present invention and embodiment, the explanation of above embodiment just understands method of the present invention and core concept thereof for helping; Meanwhile, for one of ordinary skill in the art, according to thought of the present invention, all will change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.
Claims (10)
1. a touch operation method in the terminal, is characterized in that, comprising:
When receiving the adjustment instruction of window, according to the window of adjustment data point reuse in display screen in described adjustment instruction;
When receive touch-screen there is touch event time, be the second coordinate position by the first coordinate position that described touch event occurs according to described adjustment data-mapping;
Be sent to by described touch event, in display screen, original position is the window of described second coordinate position, performs corresponding operation to drive the application belonging to described window.
2. method according to claim 1, is characterized in that, the described step according to the window of adjustment data point reuse in display screen in described adjustment instruction comprises:
Adjustment data in described adjustment instruction are sent to Window state class by window management service;
Refresh display window time, window management service transfer window corresponding, the window data be stored in Window state class; Described window data is included in the raw data in display screen and adjusts data;
Window management service carries out adjustment process according to adjustment data to raw data, shows to obtain display data.
3. method according to claim 1 and 2, is characterized in that, described when detect touch-screen there is touch event time, the first coordinate position that described touch event occurs is comprised according to the step that described adjustment data-mapping is the second coordinate position:
Input audiomonitor obtains the window data be stored in Window state class;
The first coordinate position that described touch event occurs, according to the adjustment data in described window data, is mapped as the second coordinate position by input audiomonitor.
4. method according to claim 3, is characterized in that, is describedly sent to by described touch event, and in display screen, original position is the window of described second coordinate position, comprises with the step driving the application belonging to described window to perform corresponding operation:
Described touch event is sent to by input audiomonitor, and in window data, original position is the window of described second coordinate position, performs corresponding operation to drive the application belonging to described window.
5. the method according to claim 1 or 2 or 4, is characterized in that, described adjustment data comprise side-play amount and/or scaling;
Described window management service carries out adjustment process according to adjustment data to raw data, and the step of carrying out showing to obtain display data comprises:
Window management service, to raw data superposition side-play amount, shows to obtain display data;
Or,
Window management service is multiplied by scaling to raw data, shows to obtain display data;
Or,
Window management service is multiplied by scaling to raw data, to obtain variable data;
Window management service, to variable data superposition side-play amount, shows to obtain display data;
The step that the first coordinate position that described touch event occurs is mapped as the second coordinate position, according to the adjustment data in described window data, comprises by described input audiomonitor:
Input audiomonitor deducts side-play amount, to obtain the second coordinate position to the first coordinate position that described touch event occurs;
Or,
Input audiomonitor to there is the first coordinate position of described touch event divided by scaling, to obtain the second coordinate position;
Or,
Input audiomonitor deducts side-play amount, to obtain variable position to the first coordinate position that described touch event occurs;
Input audiomonitor to described variable position divided by scaling, to obtain the second coordinate position.
6. a touch control operation device in the terminal, is characterized in that, comprising:
Window adjustment module, for when the adjustment instruction receiving window, according to the window of adjustment data point reuse in display screen in described adjustment instruction;
Position mapping block, for receive touch-screen there is touch event time, be the second coordinate position by the first coordinate position that described touch event occurs according to described adjustment data-mapping;
Case distribution module, for being sent to by described touch event, in display screen, original position is the window of described second coordinate position, performs corresponding operation to drive the application belonging to described window.
7. device according to claim 6, is characterized in that, described window adjustment module comprises window management Attendant sub-module, and described window management Attendant sub-module comprises:
Adjustment data send submodule, for the adjustment data in described adjustment instruction are sent to Window state class;
Window data calls submodule, for refresh display window time, transfer window corresponding, the window data be stored in Window state class; Described window data is included in the raw data in display screen and adjusts data;
Adjustment process submodule, for carrying out adjustment process according to adjustment data to raw data, shows to obtain display data.
8. the device according to claim 6 or 7, is characterized in that, described position mapping block comprises input audiomonitor first submodule, and described input audiomonitor first submodule comprises:
Window data obtains submodule, for obtaining the window data be stored in Window state class;
Touch event mapping submodule, for according to the adjustment data in described window data, is mapped as the second coordinate position by the first coordinate position that described touch event occurs.
9. device according to claim 8, is characterized in that, described case distribution module comprises input audiomonitor second submodule, and described input audiomonitor second submodule comprises:
Event data distribution submodule, for being sent to by described touch event, in window data, original position is the window of described second coordinate position, performs corresponding operation to drive the application belonging to described window.
10. the device according to claim 6 or 7 or 9, is characterized in that, described adjustment data comprise side-play amount and/or scaling;
Described adjustment process submodule comprises:
First mover module, for raw data superposition side-play amount, shows to obtain display data;
Or,
First convergent-divergent submodule, for being multiplied by scaling to raw data, shows to obtain display data;
Or,
Second convergent-divergent submodule, for being multiplied by scaling to raw data, to obtain variable data;
Second mover module, for variable data superposition side-play amount, shows to obtain display data;
Described touch event mapping submodule comprises:
3rd mover module, for deducting side-play amount, to obtain the second coordinate position to the first coordinate position that described touch event occurs;
Or,
3rd convergent-divergent submodule, for there is the first coordinate position of described touch event divided by scaling, to obtain the second coordinate position;
Or,
4th mover module, for deducting side-play amount, to obtain variable position to the first coordinate position that described touch event occurs;
4th convergent-divergent submodule, for described variable position divided by scaling, to obtain the second coordinate position.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510203099.XA CN104820551A (en) | 2015-04-24 | 2015-04-24 | Method and device for touch operation in terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510203099.XA CN104820551A (en) | 2015-04-24 | 2015-04-24 | Method and device for touch operation in terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104820551A true CN104820551A (en) | 2015-08-05 |
Family
ID=53730859
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510203099.XA Pending CN104820551A (en) | 2015-04-24 | 2015-04-24 | Method and device for touch operation in terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104820551A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017063324A1 (en) * | 2015-10-16 | 2017-04-20 | 青岛海信移动通信技术股份有限公司 | Window displaying method and mobile terminal |
| CN113220136A (en) * | 2021-04-27 | 2021-08-06 | 北京麟卓信息科技有限公司 | Method and device for automatically switching keyboard mapping schemes based on window layout perception |
| CN113220135A (en) * | 2021-04-27 | 2021-08-06 | 北京麟卓信息科技有限公司 | Touch event-based adaptive keyboard mapping method and device |
| CN113238663A (en) * | 2021-04-27 | 2021-08-10 | 北京麟卓信息科技有限公司 | Adaptive keyboard mapping method and device based on view matching |
| CN115079887A (en) * | 2022-08-18 | 2022-09-20 | 北京麟卓信息科技有限公司 | Method for displaying auxiliary prompt for mapping android application keyboard on desktop system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030020709A1 (en) * | 2000-01-11 | 2003-01-30 | Sun Microsystems, Inc. | Graphics system having a super-sampled sample buffer and having single sample per pixel support |
| US20030156603A1 (en) * | 1995-08-25 | 2003-08-21 | Rakib Selim Shlomo | Apparatus and method for trellis encoding data for transmission in digital data transmission systems |
| US20040248146A2 (en) * | 1990-11-29 | 2004-12-09 | Applera Corporation | Thermal cycler for automatic performance of the polymerase chain reaction with close temperature control |
| CN102681779A (en) * | 2012-04-25 | 2012-09-19 | 中兴通讯股份有限公司南京分公司 | Method and device for operating touch screen |
| CN102722280A (en) * | 2012-05-21 | 2012-10-10 | 华为技术有限公司 | Method and device for controlling screen movement, and terminal |
| CN103425431A (en) * | 2013-08-07 | 2013-12-04 | 福州瑞芯微电子有限公司 | Mobile terminal and method for achieving multi-window operation |
-
2015
- 2015-04-24 CN CN201510203099.XA patent/CN104820551A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040248146A2 (en) * | 1990-11-29 | 2004-12-09 | Applera Corporation | Thermal cycler for automatic performance of the polymerase chain reaction with close temperature control |
| US20030156603A1 (en) * | 1995-08-25 | 2003-08-21 | Rakib Selim Shlomo | Apparatus and method for trellis encoding data for transmission in digital data transmission systems |
| US20030020709A1 (en) * | 2000-01-11 | 2003-01-30 | Sun Microsystems, Inc. | Graphics system having a super-sampled sample buffer and having single sample per pixel support |
| CN102681779A (en) * | 2012-04-25 | 2012-09-19 | 中兴通讯股份有限公司南京分公司 | Method and device for operating touch screen |
| CN102722280A (en) * | 2012-05-21 | 2012-10-10 | 华为技术有限公司 | Method and device for controlling screen movement, and terminal |
| CN103425431A (en) * | 2013-08-07 | 2013-12-04 | 福州瑞芯微电子有限公司 | Mobile terminal and method for achieving multi-window operation |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017063324A1 (en) * | 2015-10-16 | 2017-04-20 | 青岛海信移动通信技术股份有限公司 | Window displaying method and mobile terminal |
| CN106598404A (en) * | 2015-10-16 | 2017-04-26 | 青岛海信移动通信技术股份有限公司 | Window display method and mobile terminal |
| CN113220136A (en) * | 2021-04-27 | 2021-08-06 | 北京麟卓信息科技有限公司 | Method and device for automatically switching keyboard mapping schemes based on window layout perception |
| CN113220135A (en) * | 2021-04-27 | 2021-08-06 | 北京麟卓信息科技有限公司 | Touch event-based adaptive keyboard mapping method and device |
| CN113238663A (en) * | 2021-04-27 | 2021-08-10 | 北京麟卓信息科技有限公司 | Adaptive keyboard mapping method and device based on view matching |
| CN113220135B (en) * | 2021-04-27 | 2021-11-23 | 北京麟卓信息科技有限公司 | Touch event-based adaptive keyboard mapping method and device |
| CN115079887A (en) * | 2022-08-18 | 2022-09-20 | 北京麟卓信息科技有限公司 | Method for displaying auxiliary prompt for mapping android application keyboard on desktop system |
| CN115079887B (en) * | 2022-08-18 | 2022-10-25 | 北京麟卓信息科技有限公司 | Display method of auxiliary prompt for mapping android application keyboard on desktop system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11562544B2 (en) | Transferring graphic objects between non-augmented reality and augmented reality media domains | |
| JP5922598B2 (en) | Multi-touch usage, gestures and implementation | |
| CN102436343B (en) | Input based on touching the user interface element that aligns | |
| CN103955339A (en) | Terminal operation method and terminal equipment | |
| CN104820551A (en) | Method and device for touch operation in terminal | |
| CN104881203A (en) | Touch operation method and device in terminal | |
| US20090278812A1 (en) | Method and apparatus for control of multiple degrees of freedom of a display | |
| JP6313395B1 (en) | Drawing processing method, drawing processing program, and drawing processing apparatus | |
| CN103984494A (en) | System and method for intuitive user interaction among multiple pieces of equipment | |
| CN110347317B (en) | Window switching method and device, storage medium and interactive intelligent panel | |
| KR20100041006A (en) | A user interface controlling method using three dimension multi-touch | |
| KR20090107152A (en) | Multi-touch system and driving method thereof | |
| CN102568253A (en) | Method and device used for displaying geometrical characteristic of graph in electronic whiteboard | |
| CN105117056A (en) | Method and equipment for operating touch screen | |
| US20140285507A1 (en) | Display control device, display control method, and computer-readable storage medium | |
| CN103064646B (en) | A kind of combination display packing and device | |
| CN102508568A (en) | Switching method of relative coordinate and absolute coordinate | |
| CN104834468A (en) | Touch operation method and touch operation device in terminal | |
| AU2018251560B2 (en) | Live ink presence for real-time collaboration | |
| CN103631551A (en) | Local display method for remote desktop in medical consultation system | |
| US10402085B2 (en) | Display of content based on handwritten input | |
| WO2014207288A1 (en) | User interfaces and associated methods for controlling user interface elements | |
| CN104820489A (en) | System and method in managing low-latency direct control feedback | |
| US20100265107A1 (en) | Self-description of an adaptive input device | |
| JP2018092681A (en) | Control program, control method, and information processing apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150805 |
|
| RJ01 | Rejection of invention patent application after publication |