CN102622182A - Off-screen touch interactive system with nearly-joint sensing projection point coordinate indication - Google Patents
Off-screen touch interactive system with nearly-joint sensing projection point coordinate indication Download PDFInfo
- Publication number
- CN102622182A CN102622182A CN2012101113489A CN201210111348A CN102622182A CN 102622182 A CN102622182 A CN 102622182A CN 2012101113489 A CN2012101113489 A CN 2012101113489A CN 201210111348 A CN201210111348 A CN 201210111348A CN 102622182 A CN102622182 A CN 102622182A
- Authority
- CN
- China
- Prior art keywords
- touch
- subpoint
- data
- graphical interfaces
- coordinate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03547—Touch pads, in which fingers can move on a surface
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Position Input By Displaying (AREA)
Abstract
The invention provides a touch device which is separated from a graphical interface display screen and provided with a man-machine interactive system with nearly-joint sensing projection point coordinate indication. The touch device can sense a coordinate of projection points when an object approaches a touch panel of the touch device, can also sense a coordinate of touch points when the object is contacted with the touch panel, and transmits two coordinate data to a graphical interface control module through a wired or wireless mode. The graphical interface control module is used for drawing a graphical interface and drawing indication points at corresponding positions on the graphical interface according to received coordinate data of the projection point, therefore positions of the projection points of the object close to the touch panel can be indicated and tracked continuously through a visual mode. When the object contacts with the touch panel, the graphical interface control module performs corresponding touch type graphical interface interactive operation according to the coordinate and movement of the touch points, and simultaneously indication points of the touch points can be drawn on the graphical interface.
Description
Technical field
The invention relates to a kind of touch graphical interfaces man-machine interactive system, particularly separate with display device about contactor control device, contactor control device possesses closely to connect and can show the touch graphical interfaces man-machine interactive system that closely connects project objects point position indication point on project objects point coordinate sensing, the graphical interfaces.
Background technology
The graphical interfaces man-machine interactive system mainly contains following two big types at present.
One type is the graphical interfaces based on mouse input for many years of widespread use, serves as typical case's representative with the Window operating system figure interface of MS.The principal feature of this graphical interfaces interactive mode is to show an indication point on the interface all the time, for example mouse pointer or literal input cursor.The user operates a two dimensional surface coordinate input equipment; For example mouse, trace ball, Trackpad (TouchPad), TrackPoint (TrackPoint) etc.; This equipment produces two-dimensional coordinate data, and graphical interfaces is according to this coordinate data location mouse or cursor, rolling mouse or cursor according to the variation of this coordinate data and on graphical interfaces; Thereby the various elements on the positioning pattern interface; Like button, menu, icon, literal etc., utilize then the click action of mechanical key or Trackpad is clicked (click) operation to oriented interface element, or after click and discharge key prior and pull (drag) operation.
Another kind of is in recent years popular gradually touch graphical interfaces, serves as typical case's representative with the graphical interfaces that mobile phone and panel computer were adopted of U.S. Apple.The principal feature of this graphical interfaces interactive mode is; Its display screen also is a contact panel simultaneously; No matter reality realizes that last contact panel and display screen are to be integrated into single equipment; Still contact panel is covered on the display screen as optional equipment, does not have perceptible difference for the user, and both combine together.This touch-control interface need not show indication point, because objects itself such as finger or pointer have just indicated the position of touching.Therefore the user can click (click), towing operations such as (drag) with objects such as finger or pointer to the element in the graphical interfaces according to intuition; And can support a plurality of touch points, and carry out more complicated operations based on gesture (Gesture).This interactive mode has been brought very outstanding user experience, and the application on portable set has obtained development at full speed in recent years.
The major defect of above-mentioned first kind interactive system is; 1; The intuitive and the ease for use of operation graphical interfaces are relatively poor relatively; For example choose an interface element and need two actions: at first move indication point to the interface element top, carry out a selection operation through clicking mechanical key or Trackpad then through the two-dimensional coordinate input equipment.2; This kind system only supports an indication point usually simultaneously, even a plurality of input equipment connecting systems are arranged, also can only move this indication point; For example notebook computer possesses Trackpad and mouse simultaneously, but mouse or cursor always have only one on the graphical interfaces.Also therefore can't realize more gesture operation, separate enlarged image, close up downscaled images like two fingers that on the touch graphical interfaces, are easy to realize.3, the input equipment of this kind interactive system needs the cooperation of mechanical key or keyboard could intactly realize all interactive operations usually.
The intuitive and the ease for use of above-mentioned second type of interactive system are superior to the first kind, but its maximum defective is limited in other words, and contact panel must be integrated with display screen, intuitive in the time of so just reaching interactive operation and ease for use.This just requires or contact panel is fully integrated in (in-cell) within the display screen, perhaps is covered on the display screen with transparent form.The problem of bringing like this is, 1, and the technical requirement and the production cost of contact panel are higher, and the yields in the production run is relatively low.2, for non-portable set, for example flat panel TV, projector etc.; Its display screen general size is bigger, so keeps certain distance between user's needs and the display screen, could obtain more comfortable field range and sharpness; The user can't directly touch display screen thus, carries out touch control operation if must the user get rid of near demonstration, retreats into original position after the complete operation again; Use very inconvenience undoubtedly, user experience even more even worse than the mode that adopts mouse.This is the maximum limitation of this type of interactive system.
Some touch telepilots have appearred at present; It disposes contact panel; Can touch information be sent to receiving end, and then the graphical interaction interface of control far-end, but existing this series products all fails to solve well a principal contradiction: because contact panel separates with display screen; The user can't be through the contact panel element on the positioning pattern interface intuitively, thereby can't realize interactive operation intuitively, quickly.Known solution comprises: 1; Come down to the two-dimensional coordinate input equipment of above-mentioned first kind interactive system is adapted as wireless transmission; Or longer-distance wire transmission, the user moves on the interface element of appointment through mouse or cursor on the contact panel control display screen on the telepilot; And then realize clicking through click action, this scheme has been inherited all defect of above-mentioned first kind interactive system.2; Telepilot possesses display screen and contact panel; Telepilot is set up bi-directional data with controlled end and is connected; Controlled end can partly or entirely be sent to the graphical interfaces that is presented on the distal displayed screen on this telepilot, on the remote controller displays screen, shows synchronously, and the user can carry out the touch-control interactive operation intuitively on telepilot.The defective of this kind scheme does, user's sight line must conversion between distal displayed screen and remote controller displays screen, and the user can't watch the content on the distal displayed screen simultaneously when carrying out interactive operation, and its ease for use is had a greatly reduced quality; And based on the transfer rate restriction, the distal displayed screen is gone up content displayed and can not intactly on the remote controller displays screen, be appeared in real time sometimes; In addition, the cost of this kind scheme telepilot and receiving end is all higher.
Summary of the invention
The present invention proposes a kind of touch graphical interfaces man-machine interactive system; Comprise: the contactor control device that separates with the graphical interfaces display device; Its contact panel possesses and closely connects sensing function; The coordinate data of the touch points when both but object sensing touches contact panel, but also sensing and is sent to the Graphic Interface Control module with these two kinds of coordinate datas near the coordinate data of the subpoint of object on contact panel of contact panel; Show by Graphic Interface Control module form with indication point on display device.This Graphic Interface Control module can be integrated in the same equipment with display device, such as flat panel TV, or as an independent equipment and to display device output picture, such as STB.The user is when this contactor control device of operation, and sight line needn't be left display screen, when objects such as finger or pointer are also sensed near contact panel, on display screen, can see the position and its track that moves of corresponding indication point intuitively.Therefore, the user can realize intuitive touch control operation as operating portable equipment touch-control interface on the distal displayed screen.
Contactor control device according to the present invention comprises: contact panel, control module, data transmission module.But the wherein position and the output coordinate data of contact panel object sensing when contact touch points, and can object sensing near the time with respect to the position and the output coordinate data of the subpoint of contact panel.This contact panel can be supported the sensing of one or more touch points and subpoint simultaneously.Wherein control module reads the touch points of contact panel output and the coordinate data of subpoint, converts thereof into the form that can supply data transmission module to send.Wherein data transmitting module receives data and is sent to receiving end from control module.
Graphic Interface Control module according to the present invention comprises: data transmission module, data processing module, touch Graphic Interface Control module, indication point control module, picture merge display module.Wherein data transmission module is responsible for being connected through wireless or wired data with above-mentioned contactor control device, receives the data of being sent by contactor control device, and is transmitted to data processing module.Wherein data processing module is resolved the data that receive, and obtains the touch points coordinate and the subpoint coordinate of contact panel output, and is distributed to indication point control module and touch Graphic Interface Control module.Wherein touch Graphic Interface Control module is responsible for the graphing interface, and carries out corresponding touch-control interface alternation operation according to one or more touch points coordinate data that receives, and promptly realizes the function like aforementioned second type of interactive system.Wherein the indication point control module is drawn obviously one or more visible indication point according to one or more touch points coordinate data that receives and subpoint coordinate data corresponding position on graphical interfaces, and the variation of this touch points coordinate data and subpoint coordinate data directly translates into this indication point moving on graphical interfaces.Wherein picture merges display module graphical interfaces and all indication points is merged into a picture, on display device, showing, and guarantees that all indication points are being positioned on the graphical interfaces on the Z-direction, and can not hidden by any interface element.
According to indication point of the present invention, comprising:, on display screen, have the indication point of equal number according to the number that closely connects project objects point of sensing; According to the number of the object touch points that has contacted, on display screen, has the indication point of equal number.The optional position of this indication point on the arbitrary graphic interface is all high-visible.It is touch points or subpoint that this indication point can be distinguished it indicated with different display modes; Different display modes can be distinguished through shape, size, texture, color or other modes of indication point; Whether need distinguish two kinds of indication points and depend on user's demand and decide, can be configured by the user.But when connect closely that object moves in sensing range but when not touching contact panel as yet, this indication point is followed this and is closely connect moving of project objects point and on graphical interfaces, do corresponding mobile.When closely connect object continue near so that when touching contact panel, this indication point indicates the position with touch points.When object keep with contact panel contact and when mobile, this indication point is done corresponding mobile with moving of touch points.When object leaves contact panel but still when closely connecing within the induction range, this indication point then the position of indication subpoint.When object continues to leave contact panel and exceeds can closely connect the scope of sensing the time, this indication point disappears.
According to the contact panel of contactor control device of the present invention and and the graphical interfaces drawn of Graphic Interface Control module between have the corresponding relation of shape, size and coordinate; Comprise: but the effective sensing region of this contact panel is similar with the shape of the touch area of this graphical interfaces, and needn't be identical; Its both sizes needn't be identical; Its both resolution needn't be identical; When both shapes or size or resolution when being not identical, but the coordinate data of contact panel output is with the touch area at cover graphics interface fully after the fixing rate conversion.
Through touch man-machine interactive system provided by the invention; When operating, the user realizes to rest on the display screen of display device always; Observe graphical interfaces; When finger or object such as pointer being placed within the contact panel top certain distance of contactor control device, can see intuitively on the display screen and the pairing indication point of this object subpoint on contact panel.But but object sensing such as user's moveable finger or pointer but when not leaving sensing range, can see intuitively that on the distal displayed screen this indication point correspondingly moves.But the user will point or object sensing such as pointer continue near and and then when touching contact panel, this indication point promptly reflects the position that the user touches on graphical interfaces.As shown in Figure 1.Therefore the user can operate the touch graphical interfaces on the distal displayed screen intuitively, and can not feel any obstacle.
The invention has the advantages that, in intuitive that keeps aforementioned second type of interactive system fully and ease for use, overcome its defective and restriction, the user can still obtain intuitively when display screen distance is far away, outstanding touch interactive experience.The present invention can be applied to flat panel TV, STB, video conferencing system, and other need the occasion of the touch man-machine interaction that contactor control device separates with display device.
Description of drawings
Fig. 1 for contactor control device sense finger contact and near, demonstrate the synoptic diagram of corresponding indication point on the display screen of display device synchronously.
Sight when Fig. 2 does not come close to or in contact with contact panel with finger for user in the embodiment of the invention.
Fig. 3 is the sight the when user will point near contact panel in the embodiment of the invention.
The sight of Fig. 4 mobile surface chart timestamp of wanting with the location to touch for user in the embodiment of the invention will point on contact panel in can sensing range.
Fig. 5 continues near the sight when touching contact panel for user in the embodiment of the invention will point.
Fig. 6 is that the user will point the sight when on contact panel, sliding in the embodiment of the invention.
Fig. 7 lifts the sight when leaving contact panel for user in the embodiment of the invention with finger.
The sight when but Fig. 8 shifts out finger outside the contact panel sensing range for user in the embodiment of the invention.
Fig. 9 is the system construction drawing of the embodiment of the invention.
Figure 10 is for calculating the synoptic diagram of the conversion proportion between contact panel coordinate data and the graphical interfaces touch area coordinate data.
Figure 11 is for doing indication point picture and touch graphical interfaces the synoptic diagram of merging.
Embodiment
Here provide a kind of specific embodiment of the present invention, be used at length explaining and explaining the present invention, but can not be used to limit the present invention.
In the present embodiment, adopt a kind of flat panel TV as an example, it has the telepilot of band contact panel, on TV screen, shows the touch graphic user interface.When the user operated this telepilot, sight line can stay on the TV screen always, and needn't be transformed on this telepilot.Here with the user icon on the graphical interfaces is moved to the example that is operating as in the screen lower left corner from the screen upper right corner, its operation steps explanation as follows.
Step 1, when the user does not directly contact any finger the contact panel of telepilot, and not with any finger near the contact panel of telepilot and get into can closely connect sensing range the time, do not show any indication point on the TV screen.As shown in Figure 2.
Step 2, when user finger near the contact panel of telepilot and when being sensed, the indication point of this finger position of indication appears on TV screen,, as shown in Figure 3 in the present embodiment with the indication point of empty circles as subpoint.
Step 3, user's moveable finger but when not touching this contact panel as yet, the indication point on the TV screen can correspondingly move above contact panel.Therefore the user is moveable finger on one side, according to indication point TV screen on find the position of the icon of wanting touch-control on one side, as shown in Figure 4.
Step 4; After user's moveable finger makes indication point arrival preposition; To point and continue to contact panel near until touching contact panel, this indication point becomes solid round dot and representes touch points in the present embodiment, and the interface element by this indication point location obtains a touching operational order simultaneously; For example, an icon of this position is selected.As shown in Figure 5.
Step 5; When the user kept finger to contact with contact panel and on it, move, this indication point was also followed the finger touches point and is done corresponding moving, and the touch-control interface can be moved according to this and carried out corresponding touch control operation simultaneously; For example, the icon of having chosen is followed the position of indication point and is moved.As shown in Figure 6.
Step 6; After the user moves to preposition with icon; Finger is lifted when leaving contact panel but still being within the scope that can closely connect sensing; Its corresponding indication point is still visible on TV screen, and to represent indicated be subpoint and no longer be touch points but become hollow circle again, as shown in Figure 7.
Step 7, when the user will point continue to lift and exceed this contact panel closely connect sensing range the time, its corresponding indication point disappears on TV screen.As shown in Figure 8.
Should be appreciated that the aforesaid operations step is merely the interactive operation that illustrates a typical mobile icon, only can not carry out aforesaid operations for the restriction embodiment of the invention.
Fig. 9 is the system construction drawing of present embodiment.What specify is, only drawn among the figure assembly relevant and module with the present invention, and the TV signal receiving processing module that generally has for flat panel TV, video reception processing module or the like are not drawn.
Telepilot 1 and flat panel TV 2 are when the data transmission module through both sides connects for the first time; The control module 11 of telepilot 1 sends to the resolution of contact panel 10 through data transmission channel the data processing module 24 of flat panel TV 2; Data processing module 24 is according to the resolution of effective touch area of the resolution of contact panel 10 and touch Graphic Interface Control module 22; Calculate the ratio RatioX and the RatioY of X axle and Y axial coordinate data linear transformation between the two, shown in figure 10.Data processing module 24 possesses the floating-point operation ability to improve the precision of coordinate conversion.What specify is; The resolution of the effective touch area of graphical interfaces equals the resolution of display screen 20 in the present embodiment; But be the zone that the All Ranges that shows on the display screen 20 is touch control operation, and in other certain applications occasions, both needn't be equal fully; Effectively the touch area possibly also be that the graphical interfaces that shows on the display screen has only the subregion can carry out touch control operation less than the resolution of display screen.Effectively the touch area also maybe be greater than the resolution of display screen, and the present invention does not limit this, but because the part that exceeds can not show on display screen, do not have too big meaning in the practical application.
The data transmission module 25 of flat panel TV 2 is handed to data processing module 24 with the data that receive; 24 pairs of data of this data processing module are unpacked; Obtain each touch points coordinate data 110 and subpoint coordinate data 120; And, calculate touch points coordinate data 210 and subpoint coordinate data 220 after the conversion, and be sent to indication point control module 23 according to aforementioned coordinate data linear transformation ratio RatioX and the RatioY that has calculated; Simultaneously, the touch position coordinate data 210 after the conversion is sent to touch Graphic Interface Control module 22.
Indication point control module 23 outputs one picture; This screen resolution equates with the resolution of the effective touch area of graphical interfaces; Also promptly equate with the resolution of display screen 20; This picture background is transparent, and on this picture, draws indication point with subpoint coordinate data 220 according to the touch points coordinate data 210 that is sended over by data processing module 24 after conversion, and distinguishes the indication point of expression touch points and the indication point of expression subpoint with different display format.In the present embodiment, represent the indication point of subpoint, represent the indication point of touch points with solid round dot with empty circles.
The picture that graphical interfaces is arranged is drawn in 22 outputs of touch Graphic Interface Control module; And according to the touch points coordinate data 210 after conversion that sends over by data processing module 24; Carry out corresponding touch-control interactive operation, and correspondingly upgrade the graphing interface.For example, when touch points is on certain button, carry out action by this button definition; When detecting a series of continuous touch points changes in coordinates, promptly point when on contact panel, sliding, carry out the corresponding operation of this slip gesture, or the like.This touch Graphic Interface Control module 22 both can have been developed voluntarily, also can take the mode of free or payment authorization directly to adopt existing technology, the Android panel computer touch-control interface of for example mainly being developed by U.S. Google company.
Picture merges display module 21 the indication point picture of indication point control module 23 outputs and the graphical interfaces of touch Graphic Interface Control module 22 outputs is merged, and the rule of its merging is: the indication point picture is being positioned on the Z-direction on the graphical interfaces; The indication point picture merges on the graphical interfaces with the mode that α mixes.Thereby guarantee that all indication points and graphical interfaces are still high-visible after merging, and the content on the graphical interfaces can not cover fully yet by indication point, shown in figure 11.This picture merges display module 21 to be accomplished by special graph processing chips (GPU) usually, neither can take the processing time of main control chip (CPU) in a large number, can guarantee smooth display effect again.In present consumer electronics field, particularly at the middle and high end equipment that is used for possessing the touch graphical interfaces, the integrated mostly GPU of the embedded single chip of the main flow that is adopted.
As stated; The technical scheme that provides through the embodiment of the invention; When the user carried out interaction through telepilot 1 with the touch graphical interaction interface on the flat panel TV 2, whether indication point capable of using perceived finger or the residing position of pointer intuitively, and touch with Trackpad.Its user experience is than the mode that directly on display screen, touches with finger or pointer; Both had concurrently its intuitively, advantage easily; More because need hand not placed on the screen; And avoid when operation hand can the shield portions screen-picture shortcoming, we can say the further user experience that promoted.On flat panel TV based on this technical scheme, the operation graphical interfaces that the user can be smooth, browsing page, picture, and the abundant application program of operation, and recreation.
The above is merely the preferred embodiment of the present invention on the flat panel TV product, is not limited to the present invention.For the personnel that grasp correlation technique, the present invention can have various changes and variation.All within spirit of the present invention and principle, any modification of being made, replacement, improvement etc. all should be included within protection scope of the present invention.
Claims (14)
1. touch graphical interfaces man-machine interactive system; Comprise contactor control device, Graphic Interface Control module, display device, it is characterized in that: contactor control device separates with display device, but when the contact panel object sensing on the contactor control device touches contact panel the coordinate of touch points and object near the time the coordinate of subpoint on contact panel; Setting up data between contactor control device and the Graphic Interface Control module is connected; The coordinate of touch points and subpoint is sent to the Graphic Interface Control module, and the Graphic Interface Control module is according to the touch points that receives and the coordinate of subpoint, and corresponding indication point draws on graphical interfaces; All indication points that draw can not hidden by other interface elements; When touch points and subpoint moved, corresponding indication point moved on graphical interfaces thereupon, if touch points and subpoint disappearance; Corresponding indication point disappears on graphical interfaces thereupon, and the Graphic Interface Control module outputs to display device with graphical interfaces that is drawn and indication point.
2. touch graphical interfaces man-machine interactive system according to claim 1 is characterized in that: contactor control device, Graphic Interface Control module, display device are respectively independent equipment.
3. touch graphical interfaces man-machine interactive system according to claim 1 is characterized in that: contactor control device is an independent equipment, and Graphic Interface Control module and display device are integrated in another independent equipment.
4. touch graphical interfaces man-machine interactive system according to claim 1 is characterized in that: contactor control device and Graphic Interface Control module are integrated in an equipment, and display device is another independent equipment.
5. according to claim 2 or the described touch graphical interfaces of claim 3 man-machine interactive system, it is characterized in that: set up data through wireless communication module between contactor control device and the Graphic Interface Control module and be connected and transmit data.
6. according to claim 2 or the described touch graphical interfaces of claim 3 man-machine interactive system, it is characterized in that: set up data through the wire communication module between contactor control device and the Graphic Interface Control module and be connected and transmit data.
7. contactor control device; Comprise contact panel; Data transmission module is characterized in that: this contact panel possesses and closely connects sensing function, the coordinate of touch points when both can object sensing touching contact panel; Also can object sensing the coordinate of the subpoint on contact panel during near contact panel, and the coordinate data of sending touch points and subpoint through data transmission module.
8. contactor control device according to claim 7 is characterized in that: contact panel is the coordinate of the one or more touch points of sensing and subpoint simultaneously, and the coordinate data through data transmission module all touch points of transmission and subpoint.
9. contactor control device according to claim 7 is characterized in that: data transmission module adopts wireless communication mode.
10. contactor control device according to claim 7 is characterized in that: data transmission module adopts wire communication mode.
11. Graphic Interface Control module; The picture at output pattern interface receives data from contactor control device, carries out corresponding touch control operation and upgrades the picture of graphical interfaces; It is characterized in that: according to the touch points that receives from contactor control device and the coordinate data of subpoint; Navigate to position corresponding on the graphical interfaces, the indication point that draws in this position, drawn indication point can not hidden by any interface element on the graphical interfaces; When the coordinate data of touch points and subpoint changes, wipe in situ drawn indication point, the indication point that draws of the position after variation makes indication point mobile on graphical interfaces reflect the mobile of touch points and subpoint; When touch points or subpoint disappearance, wipe the indication point corresponding with this touch points or subpoint.
12. Graphic Interface Control module according to claim 11 is characterized in that: distinguishing the coordinate data that receives from contactor control device is expression touch points or subpoint, for touch points and the subpoint multi-form indication point that draws.
13. Graphic Interface Control module according to claim 11 is characterized in that: have configurable option, can specify whether need the draw indication point of touch points, the indication point of the subpoint that whether need draw through config option.
14. Graphic Interface Control module according to claim 11 is characterized in that, comprising:
Data transmission module is used for setting up data with contactor control device according to claim 7 and is connected, and receives data from said contactor control device, and is transmitted to data processing module;
Said data processing module parses described touch points coordinate data and subpoint coordinate data from the data that data transmission module is transmitted, and is transmitted to indication point control module and touch Graphic Interface Control module;
Said indication point control module, according to the said touch points coordinate data and the subpoint coordinate data that receive, all indication points that draws, and export to picture merging display module;
Said touch Graphic Interface Control module; The picture at graphing interface; Said touch points position data and subpoint position data according to receiving are carried out corresponding touch control operation, upgrade the picture of graphical interfaces simultaneously, and the picture of graphical interfaces is outputed to picture merging display module;
Said picture merges display module, and the picture and the indication point picture of the said graphical interfaces that receives are merged into a picture, outputs to display device then.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012101113489A CN102622182A (en) | 2012-04-16 | 2012-04-16 | Off-screen touch interactive system with nearly-joint sensing projection point coordinate indication |
| PCT/CN2012/074957 WO2013155735A1 (en) | 2012-04-16 | 2012-05-01 | Off-screen touch control interaction system having projection point coordinate indication of detected proximity |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012101113489A CN102622182A (en) | 2012-04-16 | 2012-04-16 | Off-screen touch interactive system with nearly-joint sensing projection point coordinate indication |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102622182A true CN102622182A (en) | 2012-08-01 |
Family
ID=46562119
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012101113489A Pending CN102622182A (en) | 2012-04-16 | 2012-04-16 | Off-screen touch interactive system with nearly-joint sensing projection point coordinate indication |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN102622182A (en) |
| WO (1) | WO2013155735A1 (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102968222A (en) * | 2012-11-07 | 2013-03-13 | 电子科技大学 | Multi-point touch equipment based on depth camera |
| CN104238828A (en) * | 2013-06-13 | 2014-12-24 | 仁宝电脑工业股份有限公司 | Display device operation method and system |
| CN105204764A (en) * | 2015-09-06 | 2015-12-30 | 惠州Tcl移动通信有限公司 | Hand-held terminal provided with suspension screen, display equipment and remote control method |
| CN106445211A (en) * | 2015-08-05 | 2017-02-22 | 宸盛光电有限公司 | Touch module |
| WO2017059567A1 (en) * | 2015-10-08 | 2017-04-13 | 神画科技（深圳）有限公司 | Interactive display system and touch-sensitive interactive remote control and interactive touch method thereof |
| CN106681537A (en) * | 2016-10-24 | 2017-05-17 | 深圳市芯智科技有限公司 | Capacitance type trackpoint mouse and touch coordinate acquisition method thereof |
| CN108153464A (en) * | 2018-01-26 | 2018-06-12 | 北京硬壳科技有限公司 | A kind of control method and device |
| TWI628560B (en) * | 2014-05-27 | 2018-07-01 | 禾瑞亞科技股份有限公司 | Touch processor |
| CN108446074A (en) * | 2018-03-20 | 2018-08-24 | 北京硬壳科技有限公司 | Position of touch reminding method and device |
| CN108491153A (en) * | 2018-03-08 | 2018-09-04 | 北京硬壳科技有限公司 | Touch control method and device |
| TWI635434B (en) * | 2017-07-25 | 2018-09-11 | 英業達股份有限公司 | Cursor control method |
| CN110147180A (en) * | 2019-05-24 | 2019-08-20 | 深圳秋田微电子股份有限公司 | Touch control display apparatus, touch control display method, display and terminal |
| CN112905136A (en) * | 2021-03-11 | 2021-06-04 | 北京小米移动软件有限公司 | Screen projection control method and device and storage medium |
| CN114079760A (en) * | 2020-08-18 | 2022-02-22 | 青岛海信电子产业控股股份有限公司 | Household appliance and projection method thereof |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106527923B (en) | 2016-10-19 | 2020-03-10 | 华为机器有限公司 | Graph display method and device |
| CN111951598B (en) * | 2019-05-17 | 2022-04-26 | 杭州海康威视数字技术股份有限公司 | Vehicle tracking monitoring method, device and system |
| CN116091899B (en) * | 2023-04-12 | 2023-06-23 | 中国铁塔股份有限公司 | Vehicle tracking method, system, device, electronic equipment and readable storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101010661A (en) * | 2004-09-03 | 2007-08-01 | 松下电器产业株式会社 | Input device |
| US20080036743A1 (en) * | 1998-01-26 | 2008-02-14 | Apple Computer, Inc. | Gesturing with a multipoint sensing device |
| CN101539834A (en) * | 2008-03-20 | 2009-09-23 | Lg电子株式会社 | Portable terminal capable of sensing proximity touch and method for controlling screen in the same |
| CN101739165A (en) * | 2008-11-05 | 2010-06-16 | 英业达股份有限公司 | Electronic device and control method thereof |
| CN102075709A (en) * | 2010-05-20 | 2011-05-25 | 曾瑋 | Touchpad television remote controller and touch control method thereof |
| CN102129313A (en) * | 2010-01-19 | 2011-07-20 | 索尼公司 | Information processing apparatus, input operation determination method, and input operation determination program |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100437451C (en) * | 2004-06-29 | 2008-11-26 | 皇家飞利浦电子股份有限公司 | Method and device for preventing staining of a display device |
-
2012
- 2012-04-16 CN CN2012101113489A patent/CN102622182A/en active Pending
- 2012-05-01 WO PCT/CN2012/074957 patent/WO2013155735A1/en active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080036743A1 (en) * | 1998-01-26 | 2008-02-14 | Apple Computer, Inc. | Gesturing with a multipoint sensing device |
| CN101010661A (en) * | 2004-09-03 | 2007-08-01 | 松下电器产业株式会社 | Input device |
| CN101539834A (en) * | 2008-03-20 | 2009-09-23 | Lg电子株式会社 | Portable terminal capable of sensing proximity touch and method for controlling screen in the same |
| CN101739165A (en) * | 2008-11-05 | 2010-06-16 | 英业达股份有限公司 | Electronic device and control method thereof |
| CN102129313A (en) * | 2010-01-19 | 2011-07-20 | 索尼公司 | Information processing apparatus, input operation determination method, and input operation determination program |
| CN102075709A (en) * | 2010-05-20 | 2011-05-25 | 曾瑋 | Touchpad television remote controller and touch control method thereof |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102968222A (en) * | 2012-11-07 | 2013-03-13 | 电子科技大学 | Multi-point touch equipment based on depth camera |
| CN104238828A (en) * | 2013-06-13 | 2014-12-24 | 仁宝电脑工业股份有限公司 | Display device operation method and system |
| TWI628560B (en) * | 2014-05-27 | 2018-07-01 | 禾瑞亞科技股份有限公司 | Touch processor |
| CN106445211A (en) * | 2015-08-05 | 2017-02-22 | 宸盛光电有限公司 | Touch module |
| CN106445211B (en) * | 2015-08-05 | 2019-10-15 | 宸盛光电有限公司 | Touch-control module |
| CN105204764A (en) * | 2015-09-06 | 2015-12-30 | 惠州Tcl移动通信有限公司 | Hand-held terminal provided with suspension screen, display equipment and remote control method |
| WO2017059567A1 (en) * | 2015-10-08 | 2017-04-13 | 神画科技（深圳）有限公司 | Interactive display system and touch-sensitive interactive remote control and interactive touch method thereof |
| CN106681537A (en) * | 2016-10-24 | 2017-05-17 | 深圳市芯智科技有限公司 | Capacitance type trackpoint mouse and touch coordinate acquisition method thereof |
| TWI635434B (en) * | 2017-07-25 | 2018-09-11 | 英業達股份有限公司 | Cursor control method |
| CN108153464A (en) * | 2018-01-26 | 2018-06-12 | 北京硬壳科技有限公司 | A kind of control method and device |
| CN108491153A (en) * | 2018-03-08 | 2018-09-04 | 北京硬壳科技有限公司 | Touch control method and device |
| CN108446074A (en) * | 2018-03-20 | 2018-08-24 | 北京硬壳科技有限公司 | Position of touch reminding method and device |
| CN110147180A (en) * | 2019-05-24 | 2019-08-20 | 深圳秋田微电子股份有限公司 | Touch control display apparatus, touch control display method, display and terminal |
| CN114079760A (en) * | 2020-08-18 | 2022-02-22 | 青岛海信电子产业控股股份有限公司 | Household appliance and projection method thereof |
| CN112905136A (en) * | 2021-03-11 | 2021-06-04 | 北京小米移动软件有限公司 | Screen projection control method and device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2013155735A1 (en) | 2013-10-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102622182A (en) | Off-screen touch interactive system with nearly-joint sensing projection point coordinate indication | |
| CN102934049B (en) | Touch sensitivity control surface and desktop is used to carry out indirect user mutual | |
| KR101810884B1 (en) | Apparatus and method for providing web browser interface using gesture in device | |
| US9880697B2 (en) | Remote multi-touch control | |
| US9721365B2 (en) | Low latency modification of display frames | |
| CN103838505A (en) | Method for displaying images of touch control device on external display device | |
| US10890982B2 (en) | System and method for multipurpose input device for two-dimensional and three-dimensional environments | |
| CN104202643A (en) | Intelligent television touch remote-control terminal screen mapping method and control method and control system of touch remote-control terminal | |
| CN103914206A (en) | Method and associated system for displaying graphic content on extension screen | |
| CN104679324A (en) | Touch Display And Control Module Of Same | |
| CN102109924A (en) | Method of generating multi-touch signal, data transmission connecting apparatus, and control system | |
| US20140015783A1 (en) | Method and apparatus for detecting an attachable/detachable pen | |
| US20110216014A1 (en) | Multimedia wireless touch control device | |
| CN103037253B (en) | Remote control system and method for remotely controlling | |
| KR200477008Y1 (en) | Smart phone with mouse module | |
| CN103677272A (en) | Finger equipment, electronic equipment operated through the finger equipment and control method thereof | |
| CN101498984A (en) | Computer cursor control system and method for controlling cursor movement | |
| CN102650925A (en) | Electronic device with touch type screen and display control method of touch type screen | |
| US20150009136A1 (en) | Operation input device and input operation processing method | |
| CN103885707A (en) | Multi-touch technology based human-computer interaction method and remote controller | |
| KR20120061169A (en) | Object control system using the mobile with touch screen | |
| US9060153B2 (en) | Remote control device, remote control system and remote control method thereof | |
| KR101363661B1 (en) | Smart Remote Controller Using Edge Sliding UI | |
| US20210019010A1 (en) | Dynamically adaptive sensing for remote hover touch | |
| US20130241844A1 (en) | Method of Touch Command Integration and Touch System Using the Same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20120801 |
|
| WD01 | Invention patent application deemed withdrawn after publication |