CN104216644A - System and method for mapping blocked area - Google Patents

System and method for mapping blocked area Download PDF

Info

Publication number
CN104216644A
CN104216644A CN201310206365.5A CN201310206365A CN104216644A CN 104216644 A CN104216644 A CN 104216644A CN 201310206365 A CN201310206365 A CN 201310206365A CN 104216644 A CN104216644 A CN 104216644A
Authority
CN
China
Prior art keywords
touch
mapping
screen
push button
button
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201310206365.5A
Other languages
Chinese (zh)
Inventor
顾红波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201310206365.5A priority Critical patent/CN104216644A/en
Priority to PCT/CN2014/079423 priority patent/WO2014190951A1/en
Publication of CN104216644A publication Critical patent/CN104216644A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G06F3/0418—Control or interface arrangements specially adapted for digitisers for error correction or compensation, e.g. based on parallax, calibration or alignment
    • G06F3/04186—Touch location disambiguation

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

The invention describes a system and method for mapping a blocked area. The system and method for mapping the blocked area are used for solving the problem that when equipment such as a touchpad and a touch screen is operated by an operator, display contents on the touch screen or depiction contents on the touchpad and a contact point between a finger and the touch screen are blocked by the finger and meanwhile solving the problem that contents of windows below virtual buttons of some system levels can be blocked by the virtual buttons of the system levels. According to the system and method for mapping the blocked area, the mode of establishing a mapping area, a mapping point of a finger contact point and the like is mainly used, and contents of the area covered by the finger or the virtual buttons are displayed through dynamic mapping of the mapping area, and therefore the problem of blocking in the prior art is solved.

Description

A kind of mapping is blocked the system and method in district
Technical field
The invention belongs to control system and the method for man-machine interaction, be mainly used in manipulating Hand Personal Computer, the such as portable tester etc. of smart mobile phone, panel computer, intelligence, in the middle of the telepilot that also may be used for the equipment such as general desktop computer, Set Top Box, intelligent television.
background technology:
The equipment such as existing desktop computer, notebook, Hand Personal Computer are all graphical interfaces displays, and all support the display mode of multiwindow and the executive mode of multitask, will there is the display conflict of multiple window in this manner; And the conflict coordination of operator when performing multitask.The present invention designs to solve this kind of conflict.
So a kind of control mode is had in the control method of manipulation handheld PC, the rotation posture of operator to handheld PC is monitored with the gyro in handheld PC, thus the mouse pointer in control screen moves, simultaneity factor divides a region in screen, is used for display one group of virtual mouse button to play the function of conventional mouse button.This control mode is very promising in the such handheld PC equipment of the intelligent tester of mobile phone, PAD, hand-held, about this control mode, be described later in detail in the middle of a kind of control system for handheld PC equipment of patented claim and method of my submission in 2012.But this mode exists some defects, that is exactly,
1. virtual push button lacks tactile feedback, we are when pressing mouse or remote controller buttons, can not only feel the vibrations that button is pressed, can also feel a lot of feedback information of the relative position etc. of button and finger, and the position of finger on mouse, telepilot can be adjusted by feedback information accordingly, and control finger and switch between multiple button, the acquisition of these feedback informations has all been come by sense of touch completely not through visual information.But when manipulating virtual push button on the touchscreen, but the acquisition of these feedback informations cannot be completed by sense of touch, like this, if operator infrequently observes the position of finger on virtual push button, be just difficult to guarantee that finger operates on correct position.It should be noted that, in this, virtual mouse system based on dynamically induction has obvious inferior position compared with traditional touch-screen control mode, because the pointer of traditional touch-screen, finger, button are Trinitarian, and in the virtual mouse system based on dynamically induction, pointer is separated with button, and this just needs the observation point of the eyes of operator constantly to move between pointer and virtual push button, and this can cause operator significantly uncomfortable.
2. finger obscures virtual mouse button, as described above, operator needs constantly to observe the relative position pointed with virtual mouse button when operation virtual mouse button, the proper operation of such ability, but finger itself has sheltered from again button, when system only has a virtual mouse button time, operator still roughly can infer the position of button by object of reference around button, but when system has multiple virtual mouse button and is mutually closely aligned together time, operation just becomes and difficult for very much, also similar difficulty is there is in the operation of its really traditional touch-screen, its settling mode has two kinds, each screen object that can be triggered distributes sparse by the first as far as possible, triggered target is as far as possible larger, its two be to finger touch point do one extend cross curve along with finger movement and move, remain that the point of crossing of cross curve overlaps with the touch point of finger, such operator just can come by the part of extending finger obscures region of cross curve the position that speculative arbitration goes out the contact point of finger.But these two kinds of modes of prior art are all undesirable for the precise manipulation aspect solving multiple compact arranged virtual mouse button, because multiple button may all be pointed block, particularly the adjacent borderline region of its button be almost certain to be pointed block, which button the contact point that operator is still difficult to differentiate finger is on earth on.
3. virtual push button window itself has blocked a part for displaying contents, a virtual mouse button area is opened up in the screen of the equipment such as mobile phone, panel computer, certain screen space will inevitably be taken, this just needs other programs to coordinate with it, avoid this region and show its content, but wanting numerous application developer all to follow its program of certain rule reforming is obviously unlikely thing.Consider that panel computer also often changes and grip direction, sometimes horizontally to hold, sometimes perpendicularly to hold, the position of virtual mouse button then needs and then change, and the solution of this problem just becomes more complicated.
  
Summary of the invention
Summary of the invention:
In the prior art, the application of touch pad and touch-screen is a lot, but their application is subject to the restriction of itself technical characterstic, also there are some defects, mainly comprises the following aspects,
1. finger manipulation touch pad and touch-screen time, finger itself can hinder the sight line of operator, if use touch display screen, finger can stop the sight line of operator, make operator cannot see finger clearly with the particular location of the contact of touch-screen, and and display screen on relative position between shown object.If use touch pad, I was once contemplated such product, on a remote control completely can with touch pad drawing regularly several virtual button, carry out alternative general button, but application not such in prior art, the problem of its basic reason or finger obscures operator sight line.
2. in some applications, such as with the cell phone system of dynamically induction manipulation, system level needs to set up a virtual push button on the touchscreen, and this virtual push button needs the superiors remaining on displaying contents, such virtual push button can stop the display of other guide original in screen and manipulation.
The present invention, mainly for the problems referred to above, innovates, and adopts to create within display screen to map window or the mapping area of other types, solves the problems referred to above.The mode mapped and type are mainly divided into following two types, but are not limited only to this two kinds of modes.
1. set up a map section, to pointed the virtual push button that blocks or the object be triggered of other types carry out mapping and show,
2., in above-mentioned map section, show a contact point mapped, in order to map display finger with the contact point between the virtual push button on touch-screen,
3. set up a map section, for the object be triggered that blocks by virtual push button or other guide carries out mapping display,
In the concrete form of product and the placement of virtual push button, be mainly divided into following two kinds of modes, but be not limited only to this two kinds of modes,
1. virtual push button is in the touch display screen curtain of computer, and this mode is mainly used in mobile phone, panel computer or other adopt on the equipment of touch-screen.This product form may need to use three kinds of mapping modes above simultaneously.
2. the non-display area of virtual push button on the touch-screen of mobile phone, present smart mobile phone with this region as function keys such as home keys, after adopting method of the present invention, can as virtual push button.
3. virtual push button is on the touch pad of smart mobile phone, namely lays a fritter touch pad in the front of smart mobile phone or side, specially lays virtual push button.The mobile phone of certain prior art does not still have this design, but after adopting the present invention, completely likely adopts in this way.
4. virtual push button is on the touch pad of telepilot, on the touch pad of mouse or above the external unit such as the touch pad that carries of notebook.This product form may only need to use first and second kinds of above-mentioned mapping modes, certainly, if on the equipment such as telepilot to adopt be not simple touch pad, but the touch display screen curtain of band Presentation Function, then may need to use above-mentioned three kinds of mapping modes simultaneously.
System and the implementation step of specific implementation of the present invention are described below
Mapping is blocked the system and method in district, comprises touch pad or touch-screen, dynamic sensing system, control system, virtual push button module, virtual push button mapping block,
1. the state sensor-based system monitoring mobile phone described in, telepilot, etc. equipment dynamic, and dynamic data is submitted to control system, control system moves on the display screen according to dynamic data mouse beacon pointer.Dynamic sensing system mentioned here can be the sensors such as gyro in general sense, Gravity accelerometer, electronic compass, the laser coherence optical sensor in existing mouse, LED incoherent light sensor, can as the dynamic sensor of monitoring.
2. the virtual push button module described in for opening up at least one virtual button regions on touch pad or touch-screen, and at least one virtual push button is set up in this region, touch manipulation for accepting operator and the manipulation of operator instruction is sent to control system.In the application that smart mobile phone is such, may only need to open up a virtual push button district, and lay 1 to 3 virtual push button in this region just much of that, but in the application that panel computer has like this compared with giant-screen, multiple virtual button regions can be had, and allow these virtual button regions can movement flexibly.Touch pad described here or touch-screen and virtual button regions opened up thereon, and can be one between the primary display screen of computer, also can be independently two assemblies, mainly be divided into following several situation, but be not limited only to following several situation,
1) in the such portable equipment of smart mobile phone, panel computer, described touch pad or touch-screen are exactly the primary display screen of computer, virtual push button module is opened up in primary display screen, take a small area of ground side as virtual button regions, shows one or more virtual push button in this region; In certain application such at panel computer, display screen is comparatively large, also can open up multiple virtual button regions in different places.
2) in the smart mobile phone of prior art, its touch pad is larger than display screen, large out part simple touch pad part we be commonly referred to as the non-display area of touch-screen, general using as the function key such as Home key, return key, similar region can be utilized in the present invention as the virtual push button in the present invention, just need the top placing it in screen, instead of below, person's operation easy to use like this.
3) region beyond the front screen of mobile phone or panel computer or side a fritter touch pad can be laid, as virtual push button.Certainly, also in conjunction with above-mentioned 2 points, and multiple adjacent virtual push button can be laid at the intersection of dissimilar touch toggle area, and for they distribute different functions, as multiple function key come with the use of.
4) in the such equipment of desktop computer, intelligent television, IPTV, described touch pad is positioned on telepilot, this merely do not have on the touch pad of Presentation Function, multiple button can be drawn by modes such as etching, printings, and coordinate with software and make the function of multiple virtual push button;
5) in the such equipment of desktop computer, intelligent television, described touch-screen can be positioned on telepilot, on this telepilot with the touch-screen of Presentation Function, multiple button can be demonstrated according to different application, and the function making multiple virtual push button is coordinated with software, this mode is equivalent to the combination of first two mode, also has application mode smart mobile phone is used as telepilot and come in practice;
3. the virtual push button mapping block described in maps viewing area for opening up at least one on touch display screen curtain, maps the form of the above-mentioned virtual push button on touch pad or touch-screen of display, position.This map viewing area can be fixing, also can move according to actual conditions, even can together with mouse pointer dynamic mobile, from programming angle, even map section and mouse pointer can be made the form be combined as a whole.Corresponding with above-mentioned 2nd step, mapping viewing area described here, and can be one between the primary display screen of computer, also can be independently two assemblies, mainly be divided into following several situation, but be not limited only to following several situation,
1) in the such portable equipment of smart mobile phone, panel computer, viewing area and virtual button regions is mapped all in primary display screen,
2) in the such equipment of desktop computer, intelligent television, map viewing area in the primary display screen of computer or television, and virtual push button on a remote control;
3) in the such equipment of desktop computer, intelligent television, the remote control appliance of its equipment is for touch screen function, map viewing area on the touch-screen of telepilot, in conjunction with aforesaid way, can certainly set up in the primary display screen of computer or television simultaneously and map viewing area;
4. the virtual push button mapping block described in also for adopt in above-mentioned mapping viewing area the mode of mapping express touch pad or touch-screen contact point detected in virtual button regions position and and each virtual push button between position relationship.In the form of wherein said expression, the simplest expression way is in above-mentioned mapping viewing area, show a contact point mapped, and this contact point mapped maps the position being presented at touch pad or the contact point detected by touch-screen in virtual button regions.Certainly, if control system support carries out multipoint operation to virtual push button, map the contact point that also should be able to show multiple mapping in viewing area.
5. the district's mapping block that is blocked described in maps viewing area for opening up one on touch display screen curtain, for map display by above-mentioned virtual button regions or the operation tool of operator, limbs the content of blocking; This step and the 6th step are below just when virtual push button is based upon on the touch display screen curtain with Presentation Function time, just useful, if virtual push button be based upon do not possess Presentation Function simple touch pad on time, because it does not exist the problem of blocking original displaying contents, therefore do not need these steps and function;
6. when operator moves the pointer to the region be blocked, namely by virtual push button district or the finger of operator, palm or artificial limb or other operation tools block region time, described is blocked district's mapping block also for showing a mouse pointer mapped in above-mentioned mapping viewing area.Position relationship between other guide shown in this mouse pointer mapped and map section, embody actual mouse pointer and by virtual push button district or operator point the position relationship between the content that is blocked in the region of blocking; This step is just when virtual push button is based upon on the touch display screen curtain with Presentation Function time, just useful;
7. operator carries out touching after manipulation triggers the virtual push button that above-mentioned virtual push button module sets up with finger, control system trigger mouse pointer indication manipulation object or the manipulation object be blocked or triggered the manipulation object of virtual mouse pointer indication in by the map section of virtual push button occlusion area by control system.Certainly, in actual product, multiple button can be laid in virtual push button district, wherein can not be used to trigger pointer referent by some button, but no matter where mouse pointer points to, it is all directly trigger certain specific function that button is pressed, the such as function of Home key, return key.
  
in the present invention, the implication of relevant technologies term and content are explained as follows further:
1. virtual push button,
In the present invention, need the function coming the parts such as analog mouse button, roller with the region of on touch pad or touch-screen, this functional area is called virtual mouse button, but based on the characteristic of touch pad or touch-screen, the unexistent function of some conventional mouse buttons can also be made, so can referred to as virtual push button.
2. virtual button regions
In the present invention, need in touch pad or touch-screen, set up a region, in this region, concentrate and place several virtual push button, certainly can also have subregion be idle, not as the region of any function button, as in Fig. 2, whole region 10 is virtual button regions, the position of placing time this region, region 100 is wherein idle as finger, just need not be always unsettled time finger is idle like this.
3. map
In the present invention, need with a viewing area map another by the finger of operator or virtual push button the position of each element, state in the region of blocking, map the relation referring to that element is mutually corresponding between the two, so that operator can see, understand the situation be blocked in region, its mapping mode can be a mapping copying original pattern completely, such as map lines with lines, map the position of the point of another movement with the position of the point of a movement; It is pointed out that the key element such as the stripe shape in map section in the present invention, color, block, large small scale is not necessarily completely the same with mapped district, is not hinting obliquely in general sense, or projection; The thinking of mapping that even can depart from image completely, that show shape, express the position relationship between finger contact point and each virtual push button with mapping mode that is abstract, that express the meaning, such as, map, express the position of a point by the color of lines or color lump, shape.
4. virtual push button map section
In the present invention, operator, when operating touchpad or touch-screen, needs finger to be placed on top-operation, and the contact point pointed between same touch-screen or touch pad is very little, finger inherently blocks the sight line of operator, makes operator be difficult to see the particular location of contact point.So need to open up within display screen the position that a window or region map this contact point of display in the present invention, also to map one or several virtual push button of display simultaneously, such operator displaying contents just by observing map section determine to be pointed the position of contact point of blocking and the relative position relation between contact point and button.
5. by region that virtual push button blocks
In the present invention, sometimes need in touch screen, open up one piece of virtual button regions or window, in this region, the content that screen showed originally may be blocked, and we claim this block region to be the region of being blocked by virtual push button.
6. by the region of finger obscures
In the present invention, when operator operates touch pad or touch-screen time, finger, palm or the artificial limb of operator or other operation tools can block the contents such as the button portrayed on a touchpad, or block the content such as button touching screen display, even if the virtual push button touching screen display can be made transparent attribute in program, but the finger of people cannot be become transparent, finger or can block content shown on the window of its more lower or desktop, this region is called by the region of finger obscures by we.
7. be blocked the map section in region
In the present invention, in order to allow operator can to by the finger of virtual push button or operator, palm or artificial limb or other operation tools etc. the object in the region of blocking carry out clicking etc. operation, need to open up content and the object that one piece of region maps display originally in this block region of display in other positions, so that operate these objects.This map section is just called the map section in the region that is blocked.
8. the region of blocking, mapped district
In above-mentioned concept, in order to show by the region of finger obscures, establish a virtual push button map section; In order to show the region of being blocked by virtual push button, establish one by the map section of virtual push button occlusion area.But these two map sections can occupy in each comfortable screen again, block a region and the content shown by middle script thereof, and such region is referred to as the region that mapped district blocks.
9. the contact point mapped
In the present invention, general operator is in operating touchpad or the process of touch-screen, finger, or the limbs of other operations, instrument can block touch point, and button, the naked eyes of such operator cannot see the position of concrete touch point exactly, and and other buttons between position relationship, in order to address this problem, the present invention adopts and opens up the mode that maps viewing area, as shown in Figure 4, wherein 212 in 20 regions are the contact point mapped, it maps actual contact point 112, such can allow operator can pointed see outside the region of blocking contact point motion state and and button between position relationship.
10. the mouse pointer mapped
In the present invention, the operations such as click can be carried out to the object in the region of being blocked by virtual push button to allow operator, establish by the map section of virtual push button occlusion area, in this map section, not only to show the content be blocked in region, also will map display mouse pointer, as shown in 313 in 30 regions in Fig. 5, like this, operator just can be clear that the relative position relation between pointer and object, so that accurate triggered target.Such pointer is called the mouse pointer of mapping.
11. touch pads
In the present invention, the function and application scope of the touch pad be usually used in notebook computer expanded and innovated, not only may be used in general notebook computer, for telepilot, can also even be positioned at button mouse substituting mouse.Due to the touch-screen on mobile phone, the product technology that a transparent touch pad is combined with a LCDs technically, certainly have in production technology and manufacture respectively, then the mode combined, also the mode of once property manufacture synthesis, but its essence or the combination of two kinds of technology; Also the technical approach of such combination is had in the rear-projection display screen of computer, even electronic whiteboard.Special needs to be pointed out is, in the smart mobile phone of prior art, its touch pad is larger than display screen, large out the part of those simple touch pads be used as Home key, return key, similar region can be utilized in the present invention as the virtual push button in the present invention, just need the top placing it in screen, instead of below, person's operation easy to use like this.In the present invention, the mode realized with touch pad mentioned, can realize with touch-screen, so the touch pad mentioned in the present invention, both can be traditional opaque touch pad, and also comprise the transparent touch pad on touch-screen.
12. touch-screens
In present technology, touch screen technology development is very fast, ultrasonic touch screen, touch screens, capacitance plate etc., constantly weed out the old and bring forth the new, the present invention not only can be applied in the touch-screen of prior art, also can be applied in the external functionally similar technology of following emerging and existing touch-screen, such as when operating virtual screen, although there is not the touch on essential meaning, such as, but also can be realized the function of touch-screen by the virtual touch in action, the virtual screen technology based on glasses that Google releases also can realize the function of similar touch-screen.And the present invention also can be applied in the middle of these technology.So also comprise virtual screen at touch-screen of the present invention.
13. computer touch controllers,
In the present invention, can with the Trigger Function in touch pad or touch-screen, carry out Alternative digital TV remote controller, be used in the dynamic induction telepilot on intelligent television and IPTV, conventional mouse, swagger mouse, on-air radio mouse, Deng the push button function on equipment, and these are independent of computer main display, the controller unified address that still neither one is upper in Chinese of manipulation instruction is sent to computer, and this quasi-controller is all constantly being weeded out the old and bring forth the new nominally or functionally, people is such as had again to load software recently on mobile phone, utilize the touch-screen of mobile phone to complete the function of IPTV telepilot, this application not yet has fixing address.I thinks this kind of equipment for controlling computer is called that computer controller is proper.And all need to use touch control in the present invention, so be called by this new equipment: computer touch controller.
  
Accompanying drawing explanation
Fig. 1 represent virtual push button in a smart mobile phone screen 10, virtual push button map section 20 and the map section 30 by virtual push button occlusion area, certainly in systems in practice, their size, shape, residing position can also adjust flexibly, and map section 20 and 30 may be incorporated in a region display.In order to more clearly represent, figure below no longer shows the screen of whole mobile phone or Hand Personal Computer, and directly shows virtual button regions and each mapping area.
Shown in Fig. 2 is the division of virtual button regions, and 10 regions are whole virtual button regions, wherein, 100 be thumb idle time the region of placing, be placed in this region when action when finger, do not do any trigger action; 101,102 is two virtual push buttons, when pointing in this region when action, and that object that control system will trigger pointed by mouse pointer.Certainly multiple virtual mouse button that can trigger can be had in actual applications.
Shown in Fig. 3 is that it has blocked subregion when the thumb of operation is placed on virtual push button district time, consistent with described in Fig. 2 of other parts, and this occlusion area is 111, and the contact area of thumb and touch-screen is 112,112 to be in all the time under 111 block.Prior art is in order to solve this difficult problem, do the cross curve that is point of crossing with contact point 112 to stretch out, and the and then movement of contact point and dynamic mobile, convenient operation person can infer contact position, the present invention does not use this technology, draws in the drawings just in order to the shortcoming of prior art is described.It is pointed out that in the drawings, point the region of blocking and be included within virtual button regions, but in practical operation, but may exceed outside its scope.
Shown in Fig. 4 is in the present invention, a map section is established on the side in virtual push button district 10, two virtual push buttons in 10th district are shown in the mode of this map section 20 employing mapping display, and the contact point of finger and touch-screen, wherein, 201 map 101,202 maps 102,200 mappings 100, more specifically contact point 112 points dynamic mobile with operator, so 212 also will to move, dynamically map 112 thereupon, such convenient operation person observes, infer relative position between each virtual push button and contact point.
Shown in Fig. 5 be, in the present invention, establish a map section 30 in the below in virtual push button district 10, be called by the map section of virtual push button occlusion area, for map display by virtual push button district or finger be arranged in the content that window under it or desktop show in the region of blocking.When mouse pointer 113 enters 10th district or 111 region time, also show a mouse pointer mapped in the corresponding position of map section.
Shown in Fig. 6, in the present invention, after the content of virtual push button map section and lines are simplified, the technical scheme of movement together with binding with mouse pointer.Certainly, also move together with can being bound with mouse pointer by the map section of virtual push button occlusion area, and need just to need display when pointer enters the region of being blocked by virtual push button due to it, also can consider to share the same area with virtual push button map section, staggered display, just content is wherein uncertain, so cannot show in the drawings.
specific implementation case
embodiment 1
We are first set in the such applied environment of big screen intelligent mobile phone, the rotation posture of operator to handheld PC monitored by gyro in the control system mobile phone of smart mobile phone, thus the movement of mouse pointer in control screen, namely operator's left-right rotation mobile phone then mouse pointer move left and right; Operator rotates mobile phone up and down, then mouse pointer moves up and down; In addition, as shown in 10 regions in Fig. 1, system divides a region in mobile phone screen, be used for display one group of virtual mouse button, play the function of conventional mouse button, when mouse pointer points to certain icon time, by pressing or stir virtual mouse button, thus trigger the object of mouse pointer indication.As shown in Figure 2, its 10 region is whole virtual mouse region, wherein, 100 be thumb idle time the region of placing, be placed in this region when action when finger, do not do any trigger action; 101,102 is two virtual mouse buttons, when pointing in this region when action, and that object that control system will trigger pointed by mouse pointer.
Consider the technical characteristic of touch display screen curtain, in virtual mouse button area, it can not only be the function that the pressing realizing conventional mouse is clicked, other function a lot of can also be realized, such as can realize simulated dual with sliding to dial type button, even with similarly being gesture complicated like this of drawing a circle, generate special trigger event, so call it for virtual mouse button to seem not too suitable, can virtual push button be referred to as.
Certainly, multiple virtual push button that can trigger can be had in actual applications.When the system that practical operation is such; we find; finger obscures virtual push button; as shown in Figure 3; thumb occlusion area 111 is very large; and thumb is in fact very little with the region 112 of screen contact; and under the covering in finger obscures region; and this very little contact area is only really for manipulating virtual push button; operator due to sight line block by thumb; be difficult to judge that this contact area is which the concrete position in finger obscures region on earth, thus accurately trigger 101 or 102 these two virtual push buttons, so often can maloperation be produced.If adopt the mode that the cross curve of prior art extends, as shown in Figure 3, namely control system with finger contact point for point of crossing, show a cross curve, although operator can infer the particular location of contact point according to the part of extending finger obscures region of cross curve like this, but the shape of two virtual push buttons, border also block by thumb, so operator can only rely on, the memory of virtual push button and imagination are operated, so still very inaccurate.
Settling mode of the present invention is such, as shown in Figure 4, on the side of virtual button regions, or other are not divided the mapping area in a virtual push button district again by the place of finger obscures, display virtual button regions is not only mapped at this map section, also map the contact area of display finger, as shown in Figure 4, 10 regions of whole 20 area maps virtual push buttons, wherein, 200 mapping area 100, 201 mapping area 101, 202 mapping area 102, it is crucial that region 212 dynamically maps the region 112 of thumb and screen contact, such operator just can learn the accurate position relationship between contact point and virtual push button pointed on screen by the state of observing mapping area, thus can operate exactly.
Certainly, screen has more such mapping area, be certain to conflict to some extent with the object of original display, from software process, the angle of Graphics Processing can solve these conflicts, first, it is the problem of display conflict, in order to reduce mapping area to the impact of the display in the region that it blocks as far as possible, as far as possible succinct lines formation can be designed to by mapping viewing area, transparent attribute is arranged in region except the mapping area of lines and contact point without exception, and lines and contact point itself also can be arranged to translucent attribute, such operator just can see its lower other objects blocked through mapping area.Secondly, it is the problem triggering conflict, in the operating system of traditional multiwindow, multitask, although also there is translucent window application, but operating system always triggers the object in the window of the superiors pointed by mouse pointer, but need operating system to ignore the mapping window of the superiors in the present invention, trigger the object shown by window being positioned at its lower floor.In existing system architecture, this point be realized, although some is difficult, but can realize.
In order to solve by virtual push button map section the display in region of blocking and the problem of clicking operation, this map section can also to be made dynamic mobile, such as, map section originally in the left side of virtual push button, as shown in Figure 4, but, we can make such effect in a program, and that is exactly that this map section jumps to below it from the left side of virtual push button automatically when mouse pointer enters map section 20 time, when mouse pointer leaves that position time, rebound is next automatically again for map section.Improve further and be, map section can be made completely dynamic, and follows mouse pointer and move together, and such map section would not hinder operating the operand of mouse pointer indication, and embodiment is see the detailed description in embodiment 3.
Derivative technical advantage
After adopting the present invention, the finger of operator can operate more accurately to adjacent multiple virtual push buttons, just because of operating more accurately, its mode of operation just can break through existing mode of operation, thus derive a series of new mode of operation, such as, in prior art, the operation of touch-screen is mainly clicked and slide, in its operating process, operator must press continually, lift finger, because operator needs the icon often looking to point below, the position of the objects such as virtual push button, after adopting method of the present invention, the finger of operator can be placed on above touch-screen always not leave, triggered by the position entered occupied by virtual push button, any triggering is not done when 111 regions as shown in Figure 3 when pointing the contact point 112 with touch-screen, time contact point moves into 101 region from 111 regions, trigger the function being equivalent to left mouse button and being pressed, when contact point 112 to move from 101 regions return to 111 region time, trigger and be equivalent to the released function of left mouse button.Also be same principle to the operation of the right mouse button representated by 102 regions.So just eliminate operator and constantly press the operation steps lifting finger, only need between the multiple regions on screen, to move back and forth finger slightly and just can produce multiple different trigger action.
Aforesaid way can also further expand to the operation of finger to the general icon on mobile phone or panel computer screen, button, the mode and the existing function that swipes that are this slide trigger likely clash, namely in existing system, pressing finger, slip finger, lifting this implication swiped representated by action of finger is again screen page turning, and needing to shield the function that swipes could be used for the above-mentioned functions in the present invention triggering general screen object.Due to not yet find this mode trigger the screen objects such as general icon click triggering mode with tradition compared with have an enormous advantage, therefore not as being that embodiment describes separately.
  
Specific implementation step
Mapping is blocked the system and method in district, comprises dynamic sensing system, control system, virtual push button module, virtual push button mapping block, and realizes in accordance with the following steps,
1. the dynamic sensing system monitoring mobile phone described in or panel computer dynamic, and dynamic data is submitted to control system, control system moves on the display screen according to dynamic data mouse beacon pointer.
2. the virtual push button module described in for opening up at least one region in touch screen, and in this region, set up the form of at least one virtual push button, the Show Button, touch manipulation for accepting operator and the manipulation of manipulator instruction is sent to control system.Certainly, this virtual push button also partly or entirely can be placed on the non-display area of touch-screen by cloth, and in current mobile phone, this non-display area carrys out use as laying the function key such as Home key, return key.Touch manipulation mentioned here can have various ways, can imitate real mouse button and carry out clicking, growing by operation; Also can be that roller, the two-way button stirring trigger-type are imitated in the operations such as slip; Can be even draw a circle, manipulation posture that ticking etc. is more complicated, and when doing these postures, finger even can lift continually and puts down as traditional operation, but on screen, do various different sliding action always.Above-mentioned operation on virtual push button can be combined with the action of pointer, derivative greater functionality, and such as, traditional drag operation, is realized with pointer movement by combination button operation.Virtual push button can possess more function than the button of reality, so also can make the combination of more function future.
3. the virtual push button mapping block described in maps viewing area for opening up at least one on touch display screen curtain, maps the form of the virtual push button that the above-mentioned virtual push button module of display is set up.Map section mentioned here, can be the size identical with virtual button regions, also can zoom in or out; The display form of map section can be completely consistent with virtual push button, also can simplify, or even represent the form of virtual push button abstractively; The position form of map section can adopt fixing position, also can adopt dynamic position, even can adopt the mode of dynamic mobile together with mouse pointer.
4. the virtual push button mapping block described in is also for when touching the virtual push button shown by above-mentioned virtual push button module operator, in the mapping area shown by above-mentioned virtual push button mapping block, map the touch point of display operator in real time, this touch point mapped map be presented in virtual button regions pointed the finger that blocks with touch-screen contact point and and each virtual push button between position relationship.The formalness of the touch point of above-mentioned mapping can be the original irregular oval form of touch point, also can be abstract initial point, annulus or even the various form of little cross magnitude.
5., after operator triggers the button shown by above-mentioned virtual push button module with finger, control system triggers mouse pointer manipulation object pointed within display screen.Certainly, in actual product, multiple button can be laid in virtual push button district, wherein can not be used to trigger pointer referent by some button, but no matter where mouse pointer points to, it is all directly trigger certain specific function that button is pressed, the such as function of Home key, return key.
  
embodiment 2
Have so a kind of control mode in the control method of manipulation handheld PC, with the gyro in handheld PC monitor operator to the rotation of handheld PC, the operation posture such as to rock, thus the mouse pointer controlled in screen moves.As shown in Figure 2, system divides a region in screen, be used for display one group of virtual push button, play the function of conventional mouse button, certainly in order at any time can control system, this virtual button regions needs to be presented at the superiors, but at mobile phone, a virtual button regions is opened up in the screen of the equipment such as panel computer, certain screen space will inevitably be taken, a part of screen space can be blocked, like this when mouse pointer needs the object that points to below this region and triggers it time, obstacle will be there is, certainly virtual push button can be set to translucent, or even the pattern of all-transparent substantially, so just can see mouse pointer below and object through it, but when practical operation, finger will be placed on top-operation by operator, or can obstruct the view, as shown in Figure 5, the occlusion area 111 of thumb has blocked pointer 113.In order to solve this obstacle, the present invention designs a kind of contingent window of Real time dynamic display, when mouse pointer moves in the region 100 that virtual push button blocks time, near virtual button regions, one can be jumped out temporarily map window, as shown in the region 30 in Fig. 5, map in this window display the screen content that blocks by virtual button regions; Map in window at this simultaneously and also show a mouse pointer 313 mapped, dynamically map actual mouse pointer and the object below blocked area, and the relative position embodied between them, certainly, after starting to map the mouse pointer of this reality, the mouse pointer of this reality can show, and also can not show, but the coordinate position of its reality and the content of reality that is blocked still exist in the inside of Hand Personal Computer.The mouse pointer mapping mapping content shown in window and mapping is all to operator can be seen, inferring the content and blocked by virtual button regions, and can see, infer the relative position mouse pointer and occlusion area object wherein, and virtual push button can be pressed trigger the object wanting to operate in appropriate.
Certainly realize the present invention, also need consider and solve following Railway Project,
1. the display problem of mapping area, mapping area mentioned here is by the map section of virtual push button occlusion area, if it is certainly passable that the viewing area of opening up a for a long time display shows the region of being blocked by virtual button regions, but another problem can be caused like this, be exactly that another one region has been blocked again in this mapping viewing area, this just becomes the problem of a circulation.Solve in several ways so can adopt, but be not limited only to this several mode,
1) timesharing conversion display, can temporally be divided into multiple time slice, the display screen content of window and the content of map section originally in turn, such as, each fragment 0.5 second will be divided into the time, with two time slices i.e. time of 1 second, mapping area is become transparent state, namely in display screen, being blocked of the second layer is mapping the content under window, then a time slice is used, namely the time showing of 0.5 second maps the content of window, and then with the time of 1 second, mapping area is become pellucidity, like this, operator just can switch in the process shown the content seeing both, the benefit of this mode is exactly that operator any additional operation can just see the content in the region that is blocked, inferior position is so reciprocal flickering display, seem harder.
2) pointer is jumped out new window display temporarily and to be blocked the content in region after entering the region of being blocked by virtual push button, the benefit of this mode is exactly less on the display impact in other regions, but shortcoming is when operator wants to see by content in the region that virtual push button blocks time, just need mouse pointer to move to blocked area, such system just can be jumped out a contingent window and show the content be blocked in region.
3) can also be further improved a upper mode, exactly the window of virtual push button and button wherein are only represented with simple lines, other most of regions of non-lines are all set to transparent, like this, 111 subregions of merely hitting in whole 10 regions also have blocking of thumb, in the region of other parts, operator still can see the content and mouse pointer that are positioned at the screen display under being blocked by virtual push button, only have when pointer enters the occlusion area of finger time, just can trigger and jump out map pane port area 30.Due to the finger movement that this 111 region is along with people, so need control system to calculate according to the position of finger with the contact point of screen, as for how speculative operations person points the size of head and the size of blocked area, that just can be provided with by artificial.
4) show the same area is overlapping with virtual push button map section, can see in embodiment 1, system inherently will open up a virtual push button map section 20, and the preferred forms in this region adopts the translucent mode only showing simple lines, so, the mode that this region can adopt superposition to map, both the shape of virtual push button and the position of finger touch point was shown as virtual push button map section, show again the content in the region of being blocked by virtual push button, the content that translucent should show to show this region third layer can also be become simultaneously.This Method compare is complicated, and indigestion, explains explanation below further.First supposing the system does not have virtual push button, virtual push button map section is not had yet, then screen shows the content of its display originally, this content text that may to be the icon object on general desktop also may be shown by a text editor, also can be the content of general application program, the content that this one deck shows be called the content of C layer by us.After adding virtual button regions, because this region because operation needs and block by the finger of operator, so need to set up a virtual push button map section on its side, such operator just can see the relative position between the contact point of its finger and screen and each virtual push button, this one deck is called A layer by us, because A layer needs the content of display can represent with simple lines, so, A layer can make translucent form, only show at line portion, other regions are pellucidity, we just can see A layer and the information shown by C layer simultaneously like this.Also need now the content mapping the region that display is blocked by virtual push button in the superposition of this region, with regard to more complicated, need between A layer and C layer, insert one deck B layer again, the content in the region of being blocked by virtual push button is shown with this one deck, the display mode of this one deck can with reference to above-mentioned two kinds of modes, such as can not show the content of B layer at ordinary times, just when mouse pointer enters the region of being blocked by virtual push button, just show the content of B layer.Or often at regular intervals, the content of the B layer of display a period of time, then B layer becomes transparent again, makes content screen demonstrating C layer.Like this, operator just in this window or region, can see the different content of three layers.
5) above-mentioned virtual push button map section and the window area of the map section in region that blocked by virtual push button being made can the window form of dynamic mobile, such as, map section is originally in the left side of virtual push button, as shown in Figure 5, but, we can make such effect in a program, that is exactly when mouse pointer enters map section 30 time, this map section jumps on the left of it from the below of virtual push button automatically, when mouse pointer leaves that position time, rebound is next automatically again for map section.Improve further and be, map section can make completely dynamic window, and this window is followed mouse pointer and is moved together, such map section would not hinder operating the operand of mouse pointer indication, and the sight line of general operation person all moves along with pointer, this mode of following movement can make the operation of operator more comfortable, and embodiment is see the detailed description in embodiment 3.
2. the display problem of the mouse pointer mapped, in the present invention, likely occur screen occurring simultaneously two mouse pointers, add the mapping point of a finger contact point, the such complicated situation of object of three dynamic mobiles, the situation more easily allowing people confuse is that mouse pointer just disappears from the position on virtual push button side, a mouse pointer mapped is jumped out again from another place, this can allow the operator of new left-hand seat compare fascination, so need to allow the mapping point of finger contact point, the mouse pointer mapped and real mouse pointer are in color, form, or flicker etc. has larger difference in form, so that operator identifies.
3. the problem of the mouse pointer triggered target of mouse pointer and mapping, in the present invention, unlike the prior art, in prior art, mouse pointer only can trigger the object of the window being arranged in the screen the superiors, even if the superiors' window is transparent or semitransparent, also can not trigger be arranged in its block under the object of window, and in the present invention, the virtual button regions being arranged in the superiors does not have the object that can be triggered by mouse pointer, only has the object that can be triggered by finger, so by the transformation to existing operating system, or the object on the window or desktop that can realize allowing mouse pointer trigger being positioned at lower floor.Certainly, also can trigger with the content mapped in window and the mouse pointer of hinting obliquely at, after jumping out mapping window, in mapping window, the mouse pointer of those contents and mapping of being positioned at lower windows is located in the superiors, just can achieve with the algorithm of traditional operating system.
  
Specific implementation step
Mapping is blocked the system and method in district, comprises dynamic sensing system, control system, virtual push button module, blocked area mapping block, and realizes in accordance with the following steps,
1. the Hand Personal Computer such as dynamic sensing system monitoring mobile phone, panel computer described in dynamic, and dynamic data is submitted to control system, control system moves on the display screen according to dynamic data mouse beacon pointer;
2. the virtual push button module described in for opening up at least one virtual button regions on touch display screen curtain, and at least one virtual push button is set up in this region, the form of the Show Button, accept operator and touch manipulation and the manipulation of manipulator instruction is sent to control system; Touch manipulation mentioned here can have various ways, can imitate real mouse button and carry out clicking, growing by operation; Also can be that roller, the two-way button stirring trigger-type are imitated in the operations such as slip; Can be even draw a circle, manipulation posture that ticking etc. is more complicated, and when doing these postures, finger even can lift continually and puts down as traditional operation, but on screen, do various different sliding action always.Above-mentioned operation on virtual push button can be combined with the action of pointer, derivative greater functionality, and such as, traditional drag operation, is realized with pointer movement by combination button operation.Virtual push button can possess more function than the button of reality, so also can make the combination of more function future.
3. the blocked area mapping block described in maps viewing area for opening up at least one on touch display screen curtain, for map display by above-mentioned virtual button regions or the operation tool of operator, limbs the content of blocking; Map section mentioned here can be identical with the region that virtual button regions is blocked size, also can zoom in or out; Content in the region that the display form of map section can be blocked with virtual push button is completely consistent, also can simplify; The position form of map section can adopt fixing position, also can adopt dynamic position, even can adopt the mode of dynamic mobile together with mouse pointer.
4., when operator moves the pointer to the region be blocked, described is blocked district's mapping block also for showing a mouse pointer mapped in above-mentioned mapping viewing area.Position relationship between other guide shown in this mouse pointer mapped and map section, embody actual mouse pointer and by above-mentioned virtual button regions or the operation tool of operator, limbs position relationship between the content of blocking; The mouse pointer of mapping mentioned here, can be just the same with the mouse pointer of reality, also can adopt different forms and color, even can also with display modes such as flickers to highlight the difference with the mouse pointer of reality.
5. after operator carries out touching with finger the button that manipulation triggers shown by above-mentioned virtual push button module, control system triggers the manipulation object be blocked of mouse pointer indication, or triggers the manipulation object of virtual mouse pointer indication in mapping area by control system.
  
embodiment 3
According to the mapping principle in embodiment 1, the present invention can not only be used in mobile phone and panel computer, intelligent television can also be applied in, IPTV, in the middle of the telepilot of digital TV set-top box, I was just considering a long time ago, why not by the touch pad in similar notebook computer or the principle of touch-screen, substitute traditional rubber button with the virtual button laid on a touchpad on a remote control and manipulate TV or IPTV? my thinking conclusion is at that time exactly traditional button can provide feedback based on sense of touch to operator, such operator is when stare at TV screen does not see telepilot just can with the sense of touch of finger, know the posture oneself pointed, position, which button current touched is, and touch pad can not provide such feedback.Estimate that also having many technician has similar idea, but the telepilot never seen based on touch pad or touch-screen, certainly, fan is had to develop a kind of software on mobile phone recently, TV, IPTV etc. is controlled with virtual push button shown on the mobile phone of touch-screen, but never formal manufacturer adopts the product of this technology, estimate it is the reason lacking tactile feedback based on its technology equally.And utilize principle of the present invention to address this problem easily.
Present telepilot has two kinds of fundamental types, a kind of is traditional completely by telepilot that button controls, one is also had to be dynamic remote control device, built-in dynamic sensor-based system in telepilot, monitor the action of operator and be converted into the movement of pointer on screen, then confirming operation with the button on telepilot.And the present invention can simultaneously in the middle of above-mentioned two kinds of telepilots.
What the present embodiment described is a kind of telepilot adopting touch pad or touch-screen, from technical standpoint, touch-screen is actually and is covered on display screen by the touch pad of layer of transparent, if certainly telepilot adopt as mobile phone there is Presentation Function touch-screen, even possess CPU and intelligent processing capacity, just can provide more function, comprise embodiment 1 above and the function described in embodiment 2, but these additional functions are not within the scope of the innovation of the embodiment of the present invention.So describing below will no longer repeat, directly with both touch pad representatives.
What first describe is the mode substituting the button on remote control mouse, dynamic remote control device with touch pad, and this mode is mainly used on the telepilot of intelligent television, IPTV or computer, is called computer and dynamic remote control device without exception below for convenience.The dynamic sensing system such as built-in gyroscope in present dynamic remote control device, for the manipulation attitude of monitoring user, in telepilot or its supporting firmware, the signal that gyro is reported is converted into the movement of mouse pointer on computer screen, this conversion work also can realize by computer software systems certainly.Button on the dynamic remote control device of prior art is all also traditional button, and it is all similar to mouse, keyboard button with functional method in form, for operands such as the icons pointed by clicking trigger mouse pointer, or directly triggers certain function.In the present invention, alternative multiple function button can be carried out with one or a few touch pad, divide several region on a touchpad and represent several button respectively, if directly used like this, the experience of its operator is even not as good as traditional button, first shortcoming is the feedback that operator lacks sense of touch, if user not look at telepilot almost cannot know which button the finger of oneself is pressed on, if will move to another button from a button, also only just movement cannot be completed according to sense of touch, the viewpoint of the eyes of such operator frequently must move back and forth at computer screen, experience is very poor, next is as said in embodiment 1 above, and when button is smaller, when arranging than comparatively dense, finger itself can block the border of button, causes maloperation.According to the thinking described in above-described embodiment 1, a button map section can be opened up on the display screen of computer, TV, the shape of the Show Button and finger touch point on a touchpad in this map section.Such operator, when operating computer, just by sight line frequently movement between screen and telepilot, but can stare at screen to operate always.Certainly the size of this map section can be equally large with the touch pad area on dynamic remote control device, also can zoom in or out, and even only can map the subregion on touch pad, and those do not have mapped touch pad area separately can be used as him.
If do further improvement, this mapping area or window can be made can the pattern of dynamic mobile, and allow it follow mouse pointer to move together, even itself and mouse pointer can be made of one, the benefit done like this is that the sight line of operator can follow mouse pointer to walk always, and often sight line need not be moved on to that fixing map section.This mode has obvious advantage when user operation big screen intelligent TV, because when operating handset or panel computer, screen area is less, the sight line of operator moves not quite, even just map section can be seen by the remaining light of eyes, and when user operation big screen intelligent TV time, just obviously sensation is hard if adopt fixing map section operator, the dynamic mapping district following mouse pointer movement is adopted then obviously to save labour.
On above-mentioned basis, further improvement can also be done, if mapping area or window are moved together with mouse pointer, and adopt general mapping mode, such operator may think that this very large map section dangles on screen, hinder operator's viewing, simple directly mapping mode is the mode of direct employing table shape, by button layout originally, shape maps and shows, such as shown in Fig. 2 is a map section be similar to normally, but the lines of the map section shown in Fig. 2 can simplify by we, omit the frame of its surrounding, and the element such as the color of button entity, except lines, other parts of map section are all transparent, and the mouse pointer of only surplus lines and system is combined as a whole, and follow it and move, become shape as shown in Figure 6, wherein 601 is pointers of system, thereafter the curve as two tails, be actually the curve on the border representing two buttons in map section, such operator can map the relative position of contact point 212 and two curves 501 and 502 shown equally by institute in map section, infer the position that finger is residing on a touchpad, determine how moveable finger goes to trigger some buttons.As for the size of this map section, can be consistent with the mapped region on touch pad, also can change by arranging of user the size that it maps display, even the displaying ratio relation of its transverse and longitudinal also can change by arranging.
On the basis of the above, can also do and improve further, depart from the thinking of the mapping of the table shape of image completely, with abstract, the mapping mode of expressing the meaning is to express the position relationship between finger contact point and each virtual push button, such as, color can be utilized map the position represented between contact point and each button, in figure 6, the mapping point 212 of contact point can not had, but represent the distance relation between contact point and two buttons by the color of lines 501 and 502, the display of distance nearly then lines is red, comparatively far then show orange successively, green, blue, such operator is just by observing the color of these two lines to infer the position relationship between the contact point of finger and each virtual push button, if the two dimensional surface of a virtual push button not square on the touchscreen, but cloth is placed on a strip touch pad of mobile phone side, an i.e. one dimension line segment, be so two points on line segment by Button Abstraction, so just for ease with the position relationship that abstract mode is expressed between finger and each button.Certainly, if only have a virtual push button, just simpler, just can represent its position relationship with the color change of a color lump, even can represent its position relationship by a numeral; Even it is also conceivable to cartoon character and on screen shown by limbs posture out map and represent touch point and the direct position relationship of each button.Certainly, if adopt this mapping mode of expressing the meaning to express, just can derive a lot of very cruel pattern, just repeat no longer one by one here.
In simulation test, we find, the mode that this map section follows mouse pointer movement also creates a beyond thought excellent results, the mapping viewing area mode in fixed area described in embodiment 1, there is a shortcoming, that is exactly the content that map section itself can block a part of screen display, even if adopt translucent display mode to carry out maps virtual button, also there is a problem, namely by being invoked at the bottom layer driving module of prior art, pointer can only trigger the object in the superiors' window, and cannot trigger be positioned at map pane mouth block under object, existing responsible display have to be transformed, mouse-driven, many bottom layer driving such as objects trigger just can address this problem.But after implementing the mode in present case, mapping area dynamically follows pointer movement, mapping area just can block pointer indication never, operator wants the object triggered.Also there is a minor issue in the mode that certain this mapping area as shown in Figure 6 dynamically follows pointer movement, when pointer movement is to screen leftmost time, certainly no problem, but when pointer movement to screen rightmost time, mapping area is just outside on-screen display (osd) area, cannot see completely, this problem ratio is easier to solve, that is exactly by sequential monitoring mouse pointer, or the lateral coordinates at mapping area edge, when pointer movement to close on the right of screen time, namely viewing area is mapped when having arrived screen rightmost, the left side switching and move to pointer will be mapped by programmed control, like this, problem just solves.Certainly, if viewing area is just in the left side of pointer at ordinary times, then its process is just in time contrary, and namely pointer movement carries out switching movement to mapping viewing area when left side close to screen.Certainly, when pointer movement to the coboundary of screen or lower boundary time, the switching mode of same principle can be adopted.
The usable range of the method and system described in the present embodiment can also expand to above traditional mouse further, substitutes mouse button with touch pad, and binding one piece of touch pad map section on mouse pointer in computer screen.It is exactly its button that traditional mouse holds flimsy parts most, after using this method, can come two buttons, rollers of alternative conventional mouse with one piece of touch pad.And its advantage be the quantity of mouse button, function, shape, position distribution can be arranged by software, the pattern more fixing than the hardware button of existing mouse is much flexible.Its form even can change according to the difference of current application window, and such as, if current operation is CAD system, its virtual push button quantity can become 3 from traditional 2; Read-only text window if current, then its second and the 3rd the function of button can become page-turning function key up and down; And the operation that the finger of operator not only can press, unclamp, the various gestures such as can also do paddling, draw a circle.Further, the touch pad of mouse can be transparent and can also have one deck display screen under it, and namely its button area is a miniature touch-screen, and this touch-screen can also make curved surface; As can be seen from foregoing description, after the technology described by the present embodiment of the present invention is applied to conventional mouse, traditional mouse can be made no matter from pattern or be functionally obtained for huge lifting.
specific implementation step
Mapping is blocked the system and method in district, comprises computer touch controller, dynamic sensing system, control system, virtual push button module, virtual push button mapping block,
1. the dynamic sensing system described in monitors the dynamic of telepilot, and dynamic data is submitted to control system, and control system moves on the display screen according to dynamic data mouse beacon pointer.Dynamic sensing system mentioned here can be the sensors such as gyro in general sense, Gravity accelerometer, electronic compass, the laser coherence optical sensor in existing mouse, LED incoherent light sensor, can as the dynamic sensor of monitoring.
2. the virtual push button module described in for opening up at least one region on the touch pad or touch-screen of computer touch controller, and at least one virtual push button is set up in this region, touch manipulation for accepting operator and the manipulation of manipulator instruction is sent to control system.Virtual push button module mentioned here can be arranged in main frame as intelligent processing module, also can be positioned at band intelligent processing capacity telepilot in the middle of; Touch manipulation mentioned here can have various ways, can imitate real mouse button and carry out clicking, growing by operation; Also can be that roller, the two-way button stirring trigger-type are imitated in the operations such as slip; Can be even draw a circle, manipulation posture that ticking etc. is more complicated, and when doing these postures, finger even can lift continually and puts down as traditional operation, but does various different sliding action on a touchpad always.Above-mentioned operation on virtual push button can be combined with the action of pointer, derivative greater functionality, and such as, traditional drag operation, mouse gestures operation etc., realized with pointer movement by combination button operation.Virtual push button can possess more function than the button of reality, so also can make the combination of more function future.
3. the virtual push button mapping block described in is used for opening up at least one on the display screen and maps viewing area, maps the form of the virtual push button on the above-mentioned touch pad at telepilot of display or touch-screen, position.Map section mentioned here, can be the size identical with virtual push button, also can zoom in or out; The display form of map section can be completely consistent with virtual push button, also can simplify, or even represent the form of virtual push button abstractively; The position form of map section can adopt fixing position, also dynamic position can be adopted, even can adopt the mode with mouse pointer together dynamic mobile, from the angle of programming, even map section and mouse pointer can be made the form be combined as a whole.
4. the position of the virtual push button mapping block described in also for adopting the mode of mapping to express touch pad or touch-screen contact point detected in virtual button regions in above-mentioned mapping viewing area, and the position relationship between contact point and virtual push button.
5. after operator carries out touching with finger the button that manipulation triggers shown by above-mentioned virtual push button module, control system triggers the manipulation object be blocked of mouse pointer indication, or triggers the manipulation object of virtual mouse pointer indication in mapping area by control system.In actual product, multiple button can be laid in virtual push button district, wherein can not be used to trigger pointer referent by some button, but no matter where mouse pointer points to, button is all the specific function directly triggering certain program setting, the such as function of Home key, return key after being pressed.
  
embodiment 4
Existing big screen intelligent mobile phone screen is typewrited, it is a more difficult thing, a lot of button has been laid due to English Typing keyboard very dense, touch-screen can not provide the feedback based on sense of touch by concave-convex sense as the hardware keyboards of BlackBerry, also numerous buttons can not sparsely be arranged as the icon in general touch screen, so the thing of the wrong button of finger point often occurs.
After adopting this technology, can address this problem easily, first on screen, divide a keyboard area and set up many keyboards wherein, and will in the function that swipes of the soft keyboard regions shield touch-screen of touch-screen, in other words, slide finger in soft keyboard region on screen, and screen picture can not be caused to slide.Then a map section is set up, map the touch point of finger presses, key area around it, and the character on button, this map section can not only map touch point put in button, the button of its periphery next-door neighbour can also be mapped, this map section can be arranged in the fixing position of of touch-screen, also it can be allowed to followed by the touch point of finger and move, the touch point of finger adopts rear along triggering to the triggering of button, do not trigger when namely pressing finger, the button of contact point indication at that time is just triggered when unclamping finger, such user is when click keys, even if put mistake position, also can be seen by map section, then continuous contact screen also slight moveable finger, see that contact point has moved to after on correct button by map section and unclamp finger again, so just can realize at smart mobile phone, the object that the touch-screen of panel computer is typewrited glibly.Certainly above-mentioned map section not necessarily have to map display by the mode of image, the mode of dynamics change character can also map display, such as this map section can be a text box, when this key of finger contact K time, text box is a display K character just, the J adjacent with K key can also be shown in other colors of the layout of its periphery simulating keyboard, L, I, the characters such as M, convenient operation person determines the direction of moveable finger, in order to be different from the character of its periphery, it is on the position of K character keys that this K character can be expressed the touch point of finger current by obvious color or overstriking, if certainly only show a K character at map section, its character has inherently given full expression to the position of contact point.In above-mentioned description, based on common people's custom with understand for the ease of those skilled in the art, button is all called button, in fact both same thing.
Can further expand said apparatus, at computer, TV, IPTV, or the telepilot of intelligent television lays one piece of touch pad, many keyboards are marked off on a touchpad by software, certain touch pad does not have Presentation Function, cannot show, but display map section can be mapped on the display screen of computer or television, this map section can be different with above-mentioned map section, a region can be opened up over the display, map the whole keyboard of display wherein, and the touch point that display one maps, for expressing the position of touch pad contact point detected in virtual button regions, and using this region as a large map section, and a little map section need not be opened up specially again, this is because the region that finger blocks on a remote control, display screen and upper shown keyboard thereof can't be blocked, whole keyboard can not certainly be shown on screen, but the map section that only display one is little, in this little map section, that only show the button of contact and adjacent button, help operator and locate its finger position on a touchpad, the visual effect just made like this seems can be stranger.
specific implementation step
Mapping is blocked the system and method in district, comprises computer touch controller, control system, virtual push button module, virtual push button mapping block,
1. the virtual push button module described in for opening up at least one virtual button regions on touch pad or touch-screen, and at least one virtual push button is set up in this region, touch manipulation for accepting operator and the manipulation of operator instruction is sent to control system;
2. the virtual push button mapping block described in is used for opening up at least one on the display screen and maps viewing area, maps the form of the above-mentioned virtual push button on touch pad or touch-screen of display;
3. the position of the virtual push button mapping block described in also for adopting the mode of mapping to express touch pad or touch-screen contact point detected in virtual button regions in above-mentioned mapping viewing area.

Claims (10)

1. mapping is blocked the control system in district, comprises touch pad, touch-screen, it is characterized in that: comprise virtual push button module, virtual push button mapping block,
Described virtual push button module for opening up at least one virtual button regions on touch pad or touch-screen, and at least one virtual push button is set up in this region, touch manipulation for accepting operator and the manipulation of operator instruction is sent to control system;
Described virtual push button mapping block is used for opening up at least one on the display screen and maps viewing area, maps the form of the above-mentioned virtual push button on touch pad or touch-screen of display;
The position of described virtual push button mapping block also for adopting the mode of mapping to express touch pad or touch-screen contact point detected in virtual button regions in above-mentioned mapping viewing area.
2. mapping is blocked the method in district, it is characterized in that system adopts following steps,
Virtual push button module opens up a virtual button regions on touch pad or touch-screen, and sets up at least one virtual push button in this region, touches manipulation for accepting operator and the manipulation of operator instruction is sent to control system;
Virtual push button mapping block is opened up one on the display screen and is mapped viewing area, maps the form of the above-mentioned virtual push button on touch pad or touch-screen of display;
The position of virtual push button mapping block also for adopting the mode of mapping to express touch pad or touch-screen contact point detected in virtual button regions in above-mentioned mapping viewing area.
3. mapping is blocked the control system in district, comprises touch pad, touch-screen, dynamic sensing system, it is characterized in that: comprise virtual push button module, be blocked district's mapping block,
Described virtual push button module for opening up a region on touch display screen curtain, show and set up at least one virtual push button, accept operator touch manipulation and by the manipulation of manipulator instruction send to control system;
The described district's mapping block that is blocked maps viewing area for opening up at least one on touch display screen curtain, for map display by above-mentioned virtual button regions or the operation tool of operator, limbs the content of blocking;
When operator moves the pointer to the region be blocked, described is blocked district's mapping block also for showing a mouse pointer mapped in above-mentioned mapping viewing area.
4. mapping is blocked the method in district, it is characterized in that system adopts following steps,
Virtual push button module opens up a region on the display screen, the form of the Show Button, accepts operator and touches manipulation and the manipulation of manipulator instruction is sent to control system;
The district's mapping block that is blocked is opened up one and is mapped viewing area on touch display screen curtain, map display by above-mentioned virtual button regions or the operation tool of operator, limbs the content of blocking;
When operator moves the pointer to the region be blocked, the described district's mapping block that is blocked shows a mouse pointer mapped in above-mentioned mapping viewing area.
5. control system according to claim 1, described touch pad or touch-screen is positioned on the telepilot of computer system.
6. control system according to claim 1, described mapping viewing area is mobile with mouse pointer, or is combined as a whole with mouse pointer.
7. virtual push button mapping block according to claim 1 adopts the mode mapped to express touch pad or touch-screen in the position of contact point detected in virtual button regions, the form of wherein said expression is the contact point showing mapping in above-mentioned mapping viewing area, and this contact point mapped maps the position being presented at touch pad or the contact point detected by touch-screen in virtual button regions.
8. mapping according to claim 2 is blocked the method in district, and described mapping viewing area is the touch-screen that is arranged on the telepilot of computer system or mouse.
9. control system according to claim 3, described touch-screen is positioned on the telepilot of computer system.
10. mapping according to claim 4 is blocked the method in district, and described touch-screen is positioned on the telepilot of computer system.
CN201310206365.5A 2013-05-29 2013-05-29 System and method for mapping blocked area Pending CN104216644A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201310206365.5A CN104216644A (en) 2013-05-29 2013-05-29 System and method for mapping blocked area
PCT/CN2014/079423 WO2014190951A1 (en) 2013-05-29 2014-06-07 System and method for mapping occluded area

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310206365.5A CN104216644A (en) 2013-05-29 2013-05-29 System and method for mapping blocked area

Publications (1)

Publication Number Publication Date
CN104216644A true CN104216644A (en) 2014-12-17

Family

ID=51988039

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310206365.5A Pending CN104216644A (en) 2013-05-29 2013-05-29 System and method for mapping blocked area

Country Status (2)

Country Link
CN (1) CN104216644A (en)
WO (1) WO2014190951A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104866228A (en) * 2015-02-17 2015-08-26 顾红波 System and method for holding portable intelligent equipment for operation
CN106959799A (en) * 2017-03-28 2017-07-18 联想(北京)有限公司 A kind of window operation method and electronic equipment
CN107783747A (en) * 2017-10-19 2018-03-09 维沃移动通信有限公司 A kind of interface display processing method and mobile terminal
CN108595082A (en) * 2018-03-15 2018-09-28 维沃移动通信有限公司 A kind of information cuing method and terminal device
CN109765994A (en) * 2017-11-09 2019-05-17 托比股份公司 Improvement to the protection and the access that calculate the data in equipment
CN111782111A (en) * 2019-04-04 2020-10-16 广州高新兴机器人有限公司 Method for drawing polygon on touch screen

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108132706A (en) * 2017-11-27 2018-06-08 北京用友政务软件有限公司 A kind of method of controlling operation thereof of terminal device, system and terminal device
US11354016B2 (en) 2020-01-09 2022-06-07 International Business Machines Corporation Dynamic user interface pagination operation

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2000075766A1 (en) * 1999-06-02 2000-12-14 Ncr International, Inc. Self-service terminal
EP1567927B1 (en) * 2002-11-29 2013-07-10 Koninklijke Philips Electronics N.V. System and method for user interface with displaced representation of touch area
CN101354618A (en) * 2007-07-24 2009-01-28 英华达(上海)电子有限公司 Method and apparatus for positioning touch screen

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104866228A (en) * 2015-02-17 2015-08-26 顾红波 System and method for holding portable intelligent equipment for operation
CN104866228B (en) * 2015-02-17 2022-02-01 顾红波 System and method for holding portable intelligent device for operation
CN106959799A (en) * 2017-03-28 2017-07-18 联想(北京)有限公司 A kind of window operation method and electronic equipment
CN106959799B (en) * 2017-03-28 2020-02-21 联想(北京)有限公司 Window operation method and electronic equipment
CN107783747A (en) * 2017-10-19 2018-03-09 维沃移动通信有限公司 A kind of interface display processing method and mobile terminal
CN109765994A (en) * 2017-11-09 2019-05-17 托比股份公司 Improvement to the protection and the access that calculate the data in equipment
CN109765994B (en) * 2017-11-09 2022-09-09 托比股份公司 Improvements in protection and access to data on computing devices
CN108595082A (en) * 2018-03-15 2018-09-28 维沃移动通信有限公司 A kind of information cuing method and terminal device
CN108595082B (en) * 2018-03-15 2020-05-26 维沃移动通信有限公司 Information prompting method and terminal equipment
CN111782111A (en) * 2019-04-04 2020-10-16 广州高新兴机器人有限公司 Method for drawing polygon on touch screen

Also Published As

Publication number Publication date
WO2014190951A1 (en) 2014-12-04

Similar Documents

Publication Publication Date Title
CN104216644A (en) System and method for mapping blocked area
KR102219912B1 (en) Remote hover touch system and method
CN106292859B (en) Electronic device and operation method thereof
US8638315B2 (en) Virtual touch screen system
US20130307796A1 (en) Touchscreen Device Integrated Computing System And Method
JP5580694B2 (en) Information processing apparatus, control method therefor, program, and storage medium
CN101595445B (en) Human-computer interaction device, electronic installation and man-machine interaction method
Hinckley et al. Input/Output Devices and Interaction Techniques.
US20140015785A1 (en) Electronic device
Moscovich Contact area interaction with sliding widgets
US20130082922A1 (en) Tactile glove for human-computer interaction
JP2008276776A (en) Touch-type tab navigation method and related device
CN103097997A (en) Digital whiteboard system
CN104423836B (en) Information processing unit
JP5780438B2 (en) Electronic device, position designation method and program
CN103218044B (en) A kind of touching device of physically based deformation feedback and processing method of touch thereof
JP2009276819A (en) Method for controlling pointing device, pointing device and computer program
CN104317485B (en) electronic blackboard display control method and device
US20220197502A1 (en) Multi-Perspective Input For Computing Devices
CN106325726A (en) A touch control interaction method
Benko et al. Imprecision, inaccuracy, and frustration: The tale of touch input
JP5414134B1 (en) Touch-type input system and input control method
US20210089161A1 (en) Virtual input devices for pressure sensitive surfaces
Uddin Improving Multi-Touch Interactions Using Hands as Landmarks
JP2012155434A (en) Electronic device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20141217