CN102414653B - control circuit and method - Google Patents
control circuit and method Download PDFInfo
- Publication number
- CN102414653B CN102414653B CN201080019231.7A CN201080019231A CN102414653B CN 102414653 B CN102414653 B CN 102414653B CN 201080019231 A CN201080019231 A CN 201080019231A CN 102414653 B CN102414653 B CN 102414653B
- Authority
- CN
- China
- Prior art keywords
- image
- processing system
- host processing
- user
- display screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 97
- 238000012545 processing Methods 0.000 claims abstract description 172
- 230000015654 memory Effects 0.000 claims abstract description 79
- 230000004044 response Effects 0.000 claims abstract description 47
- 238000002156 mixing Methods 0.000 claims description 54
- 230000006870 function Effects 0.000 claims description 41
- 238000009434 installation Methods 0.000 claims description 36
- 230000008569 process Effects 0.000 claims description 34
- 230000000007 visual effect Effects 0.000 claims description 16
- 230000005611 electricity Effects 0.000 claims description 9
- 238000004321 preservation Methods 0.000 claims description 6
- 230000000977 initiatory effect Effects 0.000 claims description 5
- 230000005039 memory span Effects 0.000 claims description 5
- 230000001960 triggered effect Effects 0.000 claims description 4
- 238000007689 inspection Methods 0.000 claims description 3
- 230000005055 memory storage Effects 0.000 claims 1
- 230000008859 change Effects 0.000 description 14
- 239000000203 mixture Substances 0.000 description 11
- 238000005516 engineering process Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 7
- 230000009471 action Effects 0.000 description 5
- 238000013519 translation Methods 0.000 description 5
- 238000001514 detection method Methods 0.000 description 4
- 230000002452 interceptive effect Effects 0.000 description 4
- 102000004127 Cytokines Human genes 0.000 description 3
- 108090000695 Cytokines Proteins 0.000 description 3
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000005684 electric field Effects 0.000 description 3
- 230000003466 anti-cipated effect Effects 0.000 description 2
- 238000000429 assembly Methods 0.000 description 2
- 230000000712 assembly Effects 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 238000009933 burial Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000008602 contraction Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 210000003127 knee Anatomy 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000010587 phase diagram Methods 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000002829 reductive effect Effects 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 230000029058 respiratory gaseous exchange Effects 0.000 description 1
- 230000004043 responsiveness Effects 0.000 description 1
- 239000012536 storage buffer Substances 0.000 description 1
- 238000000547 structure data Methods 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 239000000725 suspension Substances 0.000 description 1
Abstract
A kind of system includes being configured to the display screen of display image, having the touch sensor of sensing region, host processing system and touch screen control system.Touch screen control system includes being configured to operate the touch sensor control circuit of touch sensor and be configured to the display control circuit of operating display curtain.Display circuit includes that being configured to the first memory preserving preimage, the second memory being configured to preserve secondary picture and display refreshes circuit.Display refreshes circuit and is configured to update display screen, and response user inputs and generates without the intervention of host processing system and comprises preimage and the mixed image of secondary picture, and uses mixed image to update display screen.
Description
Cross-Reference to Related Applications
This application claims the U.S. Provisional Patent Application submitted on April 30th, 2009
The senior interest of 61/174403, is intactly incorporated herein in it by quoting.
Background technology
Electronic installation generally exists at society.Along with the technology of electronic installation is entered
Step, the quantity of the integrated functionality realized on this kind of device also increases.As an example, permitted
The most current electronic installation includes the information that displays to the user that and receives from user based on touch
The ability of input.In order to receive and process based on the input touched, many current electronic installations
Utilize the capacitance sensing apparatus being combined with display device.Generally, this kind of capacitance sensing apparatus processes
From the sensing region of the most one or more fingers, pointer or capacitive sensor means
User's input that other object is received.
But, along with on electronic installation, the quantity of integrated functionality increases, to its main place
The processing load that reason device is applied also increases.(as an example, when electronic installation includes showing
When showing device and capacitive sensor means, the primary processor of electronic installation handles the place of two kinds of assemblies
Reason.) therefore, electronic installation can suffer from performance and lacks because of the burden that is placed on its primary processor
Point.Such as, user inputs and can lead the delay between the visual feedback of user because of primary processor
Cause waiting time and occur.
Due to this kind of shortcoming, user may become disappointed and/or puzzled.User loses
Hope or puzzlement may cause user discontented or makes user perform to repeat and/or unnecessary user
Input action, this increases the weight of the burden of primary processor further.It addition, along with being integrated into electronics dress
The quantity of the function put increases, and power consumption also increases.
With mobile device as a specific example, the use of mobile device often requires that and adds
Carry, show and control to include a large amount of of picture, webpage, map, text and non-text documents etc.
Data.In some mobile devices, user's input (such as click, double-click, scrolling order
Deng) and the visual feedback to user between often there is delay.
Summary of the invention
In broad terms, this technology relates to the wait between user's input and visual feedback
The reduction of time.
Accompanying drawing explanation
Fig. 1 illustrates the example of the electronic installation according to one embodiment of the present of invention.
Fig. 2 illustrates the touch screen control system according to one embodiment of the present of invention
Example.
Fig. 3 illustrates according to one embodiment of the present of invention, for operating touch screen control
System processed is to show the exemplary method of image on the display screen.
Fig. 4 A-6B illustrates and carries according to embodiments of the invention, response user's input
The example of the visual feedback of confession.
In this description, the accompanying drawing of institute's reference is appreciated that and is not drawn to scale,
Unless specifically.
Detailed description of the invention
Reference will now be made in detail to now embodiments of the invention, shown in the drawings its shows
Example.Although the present invention will be described in conjunction with each embodiment, it will be understood that describe not
It is intended to limit the invention to these embodiments.On the contrary, present invention contemplates that to contain and can be included in institute
The purpose of attached each embodiment as defined in the claims and within the scope of alternative, amendment and
Equivalents.
Additionally, in the following description of embodiment, propose a large amount of detail, with
Thorough understanding of the present invention is just provided.But, having subset or these can not had concrete
The present invention is implemented in the case of details.In other cases, do not describe in detail well-known
Method, process, assembly and circuit, in order to avoid unnecessarily making the aspect of present example hard to understand.
Expect that any element or the obvious of step are revised or replaced.Preferably comprise (but not requiring to comprise)
Each element and step.
Assembly describes
Fig. 1 illustrates the electronic installation 100 according to one embodiment of the present of invention.Electricity
Sub-device 100 includes that (it includes that touch sensor controls electricity to touch screen control system (TSCS) 110
Road (TSCC) 120 and display control circuit (DCC) 130), display screen 140, touch sensing
Device 150 and host processing system 160, all of which will describe in detail after a while.Connect arrow
170,180 and 190 host processing system 160 in certain embodiments is indicated to have and TSCS 110
Two-way interactive, TSCC 120 has and the two-way interactive of touch sensor 150, and DCC
130 have and the two-way interactive of display screen 140.In other embodiments, these are mutual
Can be partly or entirely unidirectional.
In various embodiments, electronic installation 100 is to include said modules and function
Any electronic installation of (such as receive user's input and provide a user with visual feedback).Example
As, electronic installation 100 comprises the steps that personal computer (such as desk computer, meter on knee
Calculation machine, pocket computer, work station, personal digital assistant and video game machine), communicate dress
Put (such as radio telephone, pager and other messaging device), record and/or play various
Media apparatus (such as television set, cable television box, music player, the number of the media of form
Word photo frame, video player, digital camera and video camera), the peripheral hardware of bigger system (such as
Printer, keyboard and remote control), white goods (such as household electrical appliances), automotive fittings, industry dress
Put, electronic toy and may benefit from the burden with the host processing system that will not substantially increase the weight of it
Other electric device any of complex user interface.
In certain embodiments, the element of electronic installation 100 is unified physically
, and TSCS 110, display screen 140, touch sensor 150 and host processing system
160 are provided entirely in common shell.Such as, electronic installation 100 can be that hand-held calculating is
System.
Display screen 140 is configured to show image.Display screen 140 can be
Cathode ray tube (CRT), liquid crystal display (LCD), Organic Light Emitting Diode (OLED) show
Device, electroluminescent display or be suitable for integrated in an electronic any other type of
Display screen.It addition, in certain embodiments, electronic installation 100 includes backlight (not shown),
So as the observability of the image strengthened on display screen 140.
Touch sensor 150 is shown as the dotted line of overlapping display screen 140 in FIG
Frame.But, in various embodiments, the actual physics sensor cluster of touch sensor 150
Can be located at dotted line frame interiorly or exteriorly.
Although be referred to as " touch " sensor, but the enforcement of touch sensor 150
Example can respond the contact in its corresponding sense region or contactless user input.Sensing region
Overlapping with the active area of display screen 140.Active area is wherein can be shown by display screen 140
Show the region of electronic image.It is appreciated that, some embodiments of display screen 140 can include
Wherein can not show the region of electronic image, such as borderline region.
The embodiment of touch sensor 150 can use surface to distinguish its sensing area
Territory.During operation, operation touch sensor 150 is with or many in detection sensing region
Individual input object, is used for sensing user's input." sensing region " used herein is anticipated wide
Free burial ground for the destitute comprises wherein touch sensor 150 can reliably detect any space of input object.
In some embodiments of touch sensor 150, sensing region along one or more directions from touch
The surface touching sensor 150 extends in space, until the signal to noise ratio reduced stops thing accurately
Health check-up is surveyed.This distance can be approximately be less than one millimeter, several millimeters, centimetre or more than,
And greatly can change with the type of the detection technology used and intended precision.Therefore,
Embodiment may call for contacting with surface with or without pressure applied, and other embodiments
Then not requirement.Correspondingly, in certain embodiments, the flatness of specific sensing region, size,
Shape and accurate location are extremely different to embodiment one by one.
Touch sensor 150 may utilize any of sensor cluster and detection technology
Combination.As some non-limiting examples, touch sensor 150 can use electric capacity, dielectric of falling
(elastive), resistance, inductance, surface acoustic wave, light or other technology.Touch sensor 150
The data gathered can be used for determining one or more finger, pointer and/or other object
Existence, position and/or motion.
In some resistance of touch sensor 150 realizes, flexible and conduction first
Layer is separated with conductive second layer by one or more isolation elements.During operation, on layer
Create one or more voltage gradient.The flexible ground floor of pressing can make it fully bend so that at layer
Between create electrical contact, thus produce reflection layer between contact point voltage output.These electricity
Pressure output can be used for determining positional information.
In some inductance of touch sensor 150 realize, one or more sensings
Device component pick-up (pick up) resonance coil or the coil loop current to being sensed.The width of electric current
Value, some combinations of phase and frequency can be used for determining positional information.
In some electric capacity of touch sensor 150 realizes, apply voltage or electric current
To create electric field.Near input object cause the change of electric field, and produce can as voltage,
The capacity coupled detectable change that the change of electric current etc. detects.These changes capacity coupled
Can be used for determining positional information.
Some electric capacity realizes utilizing array or other pattern of capacitance sensor electrodes
Create electric field.It can be the uniform resistor disc of resistance that some electric capacity realize utilization.
Some electric capacity realizes utilizing based between sensor electrode and free space
Capacity coupled " self-capacitance " (also referred to as " absolute capacitance ") method for sensing.A realization
In, absolute capacitance method for sensing carrys out modulation sensor by relative reference voltage (the most systematically)
Electrode and by detection sensor electrode and input object between Capacitance Coupled operate.
It is capacity coupled that some electric capacity realizes utilizing based between sensor electrode
" mutual capacitance " (also referred to as " across electric capacity ") method for sensing.In one implementation, across electric capacity sense
Survey method is by detecting between one or more emission electrodes and one or more reception electrode
Capacitance Coupled operates.Substantially can carry out modulate emission relative to reference voltage (the most systematically)
Sensor electrode is so that transmitting, and receives sensor electrode and can relatively reference voltage essence keep
For constant so that receiving.Sensor electrode can be dedicated transmitter and receptor, or can
Can also receive to transmit.
Host processing system 160 can be used for processing image for aobvious on display screen 140
Show.Such as, in certain embodiments, in order to show video, main place on display screen 140
Reason system 160 provides the view data of frame of video so that display screen 140 can use different frame
It is updated, and presents video to user.
In certain embodiments, host processing system 160 is configured at display screen
The main process of the image of display on curtain 140.It is to say, host processing system 160 configuration is used
In performing for the major part of the process of the image of display on display screen 140.In other words, exist
In some embodiments, electronic installation 100 is designed to show on display screen 140
View data great majority will through host processing system 160 and by its process.But,
In some embodiments, host processing system 160 is configured without for for aobvious on display screen 140
The main process of the image shown, and host processing system 160 is for for aobvious on display screen 140
The image shown seldom processes or does not process.
" preimage " is handled by host processing system 160 and is saved in TSCS
For at display screen 140 in the memorizer (first memory 131 being such as discussed below) of 110
On the image of main display.Preimage can be static, or can become in a period of time
Change.In certain embodiments, preimage by host processing system 160, by TSCS 110 or by
Both is revised or replaces completely.
When representing the data division of image or all changing, in memory " more
Newly " image.In certain embodiments, host processing system 160 or TSCS 110 change with
The position of changing section association, or write new image data is to replace the number of storage in memorizer
According to.
When the image section shown by display screen 140 or all changing, aobvious
Image " is updated " on display screen curtain 140.In certain embodiments, TSCS 110 changes display
One or more parts of the image of display on screen 140, or replace display screen completely
The image of display on 140.
When repainting displayed content, " refreshing " display screen 140, i.e.
Making institute's drawing image is identical with the image having shown that.The phase diagram used and have shown that
Shown as refreshing display screen 140 can help to reduce to flash or otherwise assist in keeping
Diagram picture.Therefore, display screen 140 can refresh when not being updated.
" display image update speed " used herein typicallys represent renewal display
The speed of the image on screen 140.Such as, associated with the animation of suitable quality or video
A little typical display image renewal rates include 15,24 and 30 frames per second.As another example,
The typical display image renewal rate associated with quality user interface experience is 60 frames per second.
" view data renewal rate " used herein is generally represented in TSCS
The speed of more new image data in the memorizer (first memory 131 being such as discussed below) of 110
Rate.The renewal of the view data in the memorizer of TSCS 110 can by host processing system 160,
TSCS 110 or additionally certain element are carried out.
" display refresher rate " for represent pixel on multiple scanning display with
The speed of the quality image on holding display.Such as, some typical case's brushes of convention display curtain
New speed includes the 60Hz for LCD, the 60-85Hz for CRT etc..
Different embodiments of the invention can have than its maximum image data renewal speed
Rate is more slowly, faster or maximum display refresher rate equal thereto.Similarly, the present invention
Different embodiments can have than its maximum display image update speed more slowly, faster or with its phase
Deng maximum display refresher rate.
In various embodiments, it is proposed, according to the invention, TSCC 120 and DCC 130
And optionally the other parts of TSCS 110 are provided commonly for operating touch sensor 150 with inspection
Survey the user's input in sensing region, and operating display curtain 140 is with response user's input
Display image, and without the intervention of primary processor 160.In other words, TSCC 120 and DCC
130 and other parts optionally with TSCS 110 independently operate touch sensor 150
With display screen 140, and not do not input directly in response to the user in sensing region and perform in real time
Master image processes or provides and instructs.TSCC 120 and DCC 130 (and optionally with
The other parts of TSCS 110) can be first according to hardwired rule or employing host processing system 160
Front provided rule performs these functions.
In certain embodiments, host processing system 160 is sometimes in low power state
(including disconnecting), and TSCS 110 independently operates.In certain embodiments, main place
Reason system 160 is not to perform to process or carry sometimes with renewal display screen 140 directly relatedly
For instructing or not being to perform to process or provide instruction directly in response to user's input.
In the embodiment of electronic installation 100, this autonomous operation reduces or eliminates
Disadvantages mentioned above.Such as, this autonomous operation can reduce the waiting time, reduce response time variable
Property and increase to user input responsiveness.These improve can increase user relaxation,
The credibility of the operation of comfort level or electronic installation 100.
In the embodiment of electronic installation 100, needed for this autonomous operation reduces
The process of host processing system 160, and thus reduce the power consumption of electronic installation 100.Example
As, host processing system 160 can the renewal of image on display screen 140 by TSCS 110
This locality enters low power state while carrying out.The example of low power state include off-state,
Sleep state and host processing system 160 consume the state of less process power.
It addition, in the embodiment of electronic installation 100, this autonomous operation reduces
Host processing system 160 needs the maximum image data update rate supported, the most still provides flat
Sliding and response is fed back.Such as, TSCS 110 may be arranged so that it can produce image and
Can update memorizer (the depositing of such as the following stated of TSCS 110 than host processing system 160
Reservoir 131) in preserve the higher speed of preimage update display screen 140.Implement at some
In example, TSCS 110 can respond user's input and produce with 60Hz or above and update
Display.This alleviates the load of host processing system 160 so that host processing system 160 can use low
Maximum renewal rate (such as 30Hz) in 60Hz configures, and the brightest to Consumer's Experience
Aobvious adverse effect.This also allows for electronic installation 100, and for communication bandwidth, (such as serial link is wanted
Ask), other Performance Characteristics etc. there is loose requirement.Loose requirement can provide bigger design
Select and cost savings.
Some embodiments of electronic installation 100 can than host processing system 160
Update preimage and update display screen 140 quickly.It is to say, some of electronic installation 100
Embodiment support is more higher than the view data renewal rate associated with host processing system 160 aobvious
Diagram is as renewal rate.Such as, in certain embodiments, TSCS 110 is configured to raw
Become the most more new images, and faster speed during to perform image procossing than host processing system 160
Update display screen.Higher display in this TSCS 110 those systems of functional support
Image update speed.
Unrelated with maximum renewal rate, in operation, the view data used is more
New speed is substantially low than the display screen renewal rate used.Such as, TSCS 110
Can during the function of such as drag function etc mixed image to provide visual feedback.Preimage can
Being towed item " background " that move thereon, and memorizer preserves for preimage
View data seldom or completely will not be able to change during drag function.Therefore, more
Low view data renewal rate is used (with the display image update used by some embodiments
Speed is compared).
The image of towed item can remain during drag function in memory
Static.But, the hybrid coordinate associated with the image of towed item can be sent out during drag function
Changing.TSCS 110 uses the figure mixing towed item in the position specified by hybrid coordinate
The image being autonomously generated of picture is to update display screen 140, thus preimage or display screen relatively
140 or both effectively move towed item.Therefore, (with the picture number used
Compare according to renewal rate) use higher display image update speed.
In various embodiments, TSCC 230 is (alternatively with other of TSCS 110
Part is together) it is used for operating touch sensor 150, in order to the accomplished number such as inputting object
The measurement of the determination of user's input characteristics of amount and motion etc.In certain embodiments, this
(this kind of) measures and is used for determining for user's input relative to touch sensor by TSCS 110
The positional information of the sensing region of 150.
Term as used herein " positional information " is wherein wrapped anticipated broadly comprising
Include the absolute and relative location type information moved along one or more directions, and also comprise
The other type of spatial-domain information of such as speed, acceleration etc..Various forms of positional informationes
May also include time history composition, as in the case of gesture identification etc..From TSCS
The positional information of 110 can be used for promoting the interface action of complete series, including proximity transducer device
Indicator device as cursor control, scrolling and other function.
The element (such as TSCC 120 and DCC 130) of TSCS 110 can be embodied as
The one or more integrated circuits physically separated with host processing system 160 and/or discrete assembly
Part or all of.It is to say, TSCS 110 can include separating with host processing system 160
An IC part or all of.Similarly, TSCS 110 can include and host processing system 160
The multiple IC's separated is part or all of.
In certain embodiments, TSCC 120 and DCC 130 does not share circuit.
It is to say, for operating the circuit of touch sensor not used for operating display curtain, anti-mistake
Also as being.In certain embodiments, TSCC 120 and DCC 130 shares circuit really,
Making the circuit of TSCC 120 is also the circuit of DCC 130.Such as, touch sensor 150
The specific circuit of operation operating specific circuit and display screen 140 can be physically
It is coupled to perform the same processing unit of the calculating of touch sensor and display operation.As separately
One example, TSCC 120 and DCC 130 can save the data in same memorizer.
There is provided as follows by the structure of Fig. 2 and the detailed description of assembly now.
Fig. 2 illustrates the touch screen control system according to one embodiment of the present of invention
(TSCS)110.TSCS 110 includes that touch screen control circuit (TSCC) 120, display control electricity
Road (DCC) 130, first memory 131 and second memory 132.In certain embodiments,
DCC 130 includes that display refreshes circuit 134 alternatively, and display refreshes circuit 134 and wraps alternatively
Include display screen renovator 136 and mixed image maker 138.It addition, in some embodiments
In, TSCS 110 includes device control module 125 alternatively.
As it has been described above, TSCS 110 and associated component thereof are embodied as one or more
Integrated circuit and/or discrete assembly part or all of.Reality according to the TSCS 110 of the present invention
Execute example and be especially suitable for that there is discrete assembly, the most each individually include TSCC 120 or DCC 130
IC etc..It is also highly suitable for being integrated in single according to the embodiment of the TSCS 110 of the present invention
In IC, such as, form an all or part of IC of TSCC 120 and DCC 130.
Also as discussed above, in various embodiments, the element of TSCS 110 is shared
Omnibus circuit element.Such as, TSCC 120 and DCC 130 can use of same circuit
Divide and operate.
In certain embodiments, first memory 131 and second memory 132 set
It is set to physically separated memory construction, as shown in Figure 2.But, according to the reality of the present invention
Execute the first memory 131 that example is also highly suitable for having the subregion as same memory construction
With second memory 132.In various embodiments, first memory 131 and second memory
132 or adjoin or non-contiguous.In various embodiments, first memory 131
With second memory 132 by volatile memory (the most various types of random access memorys
) or nonvolatile memory (the most various types of flash or read only memory (ROM)) (RAM)
Or combinations thereof forms.
Additionally, in certain embodiments, the memory span of second memory 132
Less than first memory 131.In certain embodiments, first memory 131 is frame buffering
Device.
Referring still to Fig. 2, in certain embodiments, display refreshing circuit 134 wraps
Include display screen renovator 136 and mixed image maker 138.To retouch in operation as following
Described in stating, display screen renovator 136 and mixed image maker 138 (alternatively with
The other parts of TSCS 110 are together) it is provided commonly for updating display screen 140, and without main place
The intervention of reason device 160.
In various embodiments, the same electricity that display screen renovator 136 is used
Route mixed image maker 138 uses.On the contrary, in certain embodiments, display screen
Renovator 136 has the special circuit only used by display screen renovator 136.Similarly,
Mixed image maker 138 has the special circuit only used by mixed image maker 138.
Assembly in operation describes
Fig. 3 illustrates according to one embodiment of the present of invention, for operating electronic installation
100 and TSCS 110 so that the method showing image on display screen 140.Will be in conjunction with figure
4A-6B describes the method shown in Fig. 3.In one embodiment, method 300 is by processor
Perform under the control of computer-readable and computer-executable code with electric component.Computer
Readable and computer-executable code such as resides in such as computer and can use volatibility and Fei Yi
In the data storage medium of the property lost memorizer etc.But, computer-readable and computer can be held
Line code can reside in any kind of computer-readable recording medium.In some embodiments
In, method 300 is at least performed by the system described in Fig. 1, Fig. 2 and Fig. 4 A-6B.Tool
For body, Fig. 4 A-6B is shown on display screen 140 each embodiment showing image.
In the 310 of method 300, use handled by host processing system 160 and
Some images from the image that host processing system 160 is received to update display screen 140,
Wherein host processing system 160 is configured on display screen 140 image main of display
Process.Such as, in one embodiment, with reference to Fig. 4 A, use by host processing system 160
Handled and the image that received from host processing system 160 is to update display screen 140.By
Host processing system 160 image that is handled and that received from host processing system 160 can include
Frame of video, picture, webpage, map, text and non-text documents etc..
In the 320 of method 300, received from the host processing system 160 of Fig. 1
Preimage is saved in the first memory 131 of Fig. 2.First memory 131 is configured to preserve confession
The preimage of display on display screen 140.In one embodiment, first memory 131 is also
It is configured to preserve multiple preimage.In one embodiment, pre-loaded preimage.
For example, referring to Fig. 1 and Fig. 2, for showing on display screen 140, come
Can first be processed by host processing system 160 from the image of video flowing, and consequently as one
Series preimage is saved in first memory 131.It is to say, first memory can be in difference
Time point preserves the different images in one group of image as preimage, and these different images can shape
The part of the video that one-tenth user can check.In another example, preimage is adjusted to produce user
The Dynamic Announce that can check.
As another example, preimage can be still image, such as user interface,
Background, such as default page of the application of text input picture etc etc..As other example,
Preimage can also include the single frames (such as from document or the frame of webpage) of image information, use figure
Menu page (the such as top level menu page) of the application of shape user interface etc..
At the 330 of method 300, the secondary second memory 132 as being saved in Fig. 2
In.In one embodiment, multiple images are saved in second memory 132, one of them
It it is secondary picture.In certain embodiments, pre-loaded (alternatively be saved in second memory 132
In other image together) secondary picture.
In certain embodiments, the 3rd image or multiple 3rd image are with secondary picture simultaneously
It is saved in second memory 132.In certain embodiments, second memory 132 is configured to
Preserve secondary picture, the 3rd image, multiple 3rd image or combinations thereof.
Secondary picture (or other image any being saved in second memory, such as
3rd image) can be the image of multiple different images.Such as, secondary as pop-up window can be included
For showing on preimage.As other example, secondary picture (or be saved in second memory
Other image) can be control (the most one or more pointers, button, media control etc.),
Status indicator (being such as used for providing battery information, help information etc.), by motion video (passive
Image) (such as mark) and a type of user input (such as suspend, touch, tap,
Press, thump, stroke, hand-written, drafting, other gesture etc.) image that associates etc..
According to some embodiments of the present invention, secondary as less than preimage.Such as, respectively
In individual embodiment, secondary as being less than preimage at aspects such as physical size, position sizes.
In a part for the secondary picture typically smaller than embodiment of preimage, second memory
Capacity less than first memory.
Preserve memory size needed for image with the color depth of image and size
(measuring with pixel) and increase.Can reduce by relatively low color depth is used for those images
Preserve image for mixing (the pair picture that is such as saved in second memory 132 or any its
Its image) needed for memorizer.
In one embodiment, secondary as being provided by host processing system 160.One
In a little embodiments, secondary as being provided by TSCS 110.Secondary as can by host processing system 160,
TSCS 110 or both revise.The offer of secondary picture or adaptation can respond user's input
(such as using user's input that touch sensor 150 is detected) and is carried out.
In one embodiment, secondary as changing.As some examples, change
The secondary size of picture, shape, color, transparency etc. can be affected.Such as, secondary picture can be by main process
System 160 or TSCS 110 is revised or is replaced completely.As detailed below in conjunction with Fig. 5
Thin description, in certain embodiments, secondary picture changes to highlight display user and can interact
Control or instruction button start.And for example describe in detail below in conjunction with Fig. 6, real at some
Execute in example, the secondary inking merit carried out because of response user's input as (pair of such as Fig. 6 A is as 620A)
Can and change.Additionally, in various embodiments, TSCS 110 is configured to perform image
Process, strengthen such as but not limited to decompression, windowing or contrast.
At the 340 of method 300, response sensing and the active area of display screen 140
User's input in overlapping sensing region: (1) is autonomously generated and comprises preimage and the mixing of secondary picture
Image；And (2) use mixed image independently to update display screen 140.
As it has been described above, perform method 300, embodiments of the invention can be to user
Thering is provided low latency visual feedback, this improves the Consumer's Experience to electronic installation 100.Part
Independently generated mixed image to supply to show on display screen 140 by TSCS 110, and
Use mixed image independently to update display screen 140, the low latency to user is provided
Visual feedback.It addition, reduce the power consumption of electronic installation 100, and/or relax electronics
The performance requirement of the various assemblies of device 100.
According in each embodiment of the present invention, hybrid technology is used for generating mixing
Image.Such as, embodiment can use α hybrid technology.α mixing is for by one or more
The process that overlay image and primary picture are combined, and for mixing from independent source
Pictorial element with create single composograph be useful.Cover and primary picture size,
Resolution, color depth, aspect ratio etc. can be different.
In certain embodiments, transparency or the hybrid cytokine of overlay image can control
For being defined on the merging of the primary picture in any overlapping region of two images and overlay image
Percentage ratio.Outside overlapping region, show that primary picture does not carry out any amendment.Mixed
Close function to realize according to following relationship:
Composograph=overlay image (α)+primary picture (1-α) (equation 1)
In many cases, primary picture and overlay image be shaped as rectangle.?
In this kind of embodiment, use chroma key technology to cover non-rectangular shape image and remain possibility
's.Chroma key allows will be for " transparent " particular color in system identification overlay image.When covering
When pixel in lid image comprises colourity key assignments, show without change by these pixels overlap
The part of primary picture.Therefore, each embodiment can preserve the pair picture as overlay image,
Preserve the primary picture as preimage, and use α mixing by pair as covering on preimage.
The embodiment utilizing α mixing or other hybrid technology can be from various mixing choosings
Choose in Xiang.Such as, TSCS 110 can mix identical minor picture at diverse location, in order to generates
Multiple different mixed image.Diverse location can be relative to preimage, the having of display screen 140
Source region or both.This can be carried out in time so that produces the moving sets when illustrating successively
One group of mixed image of picture.As another example, TSCS 110 can be at diverse location by pair
Multiple examples of picture are mixed into a mixed image.As another example, TSCS 110 can
At diverse location, multiple examples of secondary picture are mixed into multiple mixed image so that produce and effectively move
One group of mixed image of the example of dynamic secondary picture.
In addition to secondary picture, embodiment also can mix other image one or more.
Such as, some embodiments also can mix the 3rd image or the example of the 3rd image, in order to is formed
Mixed image.
In certain embodiments, mixing is secondary as (or the 3rd image or other image)
Position based on user input.Such as, respond packet user's input containing input object, can be at base
The secondary picture of position mixing in the position of input object.Specifically, selectable position, in order to will
Secondary as being positioned so that it is transfused to overlapped object or deviation input object.Deviation can be based on all
Input the factor such as the user of speed, power, duration etc. and either statically or dynamically determine.As another
Example, responds user's input that multiple input object is provided, can be in position based on input object
Multiple examples of the secondary picture of position mixing put (or secondary as, the 3rd image and alternatively other
Image).
In certain embodiments, selected as secondary as (or the 3rd image or other
Image) and pass through the image of mixing based on user's input.Such as, specific image can be with one
The user input sequence of type associates, and that specific image can be in response to that type
User input sequence and the pair picture that mixes.As another example, specific image can be with a kind
The input object of type associates, and that specific image can be in response to comprise the defeated of that type
Enter the pair picture of user's input of object.
Some embodiments by the most newly specified wherein mixing secondary as
The coordinate of the position of example, realizes mixing.This mode allows TSCS 110 to generate difference
Mixed image, allows secondary as keeping constant in second memory 132 simultaneously.
Embodiment also can with space, in time or both change mixing because of
Son.Such as, some embodiments can be increased or decreased hybrid cytokine, in order to makes image fade in or light
Go out.As another example, some embodiment definable preimages or display screen active area
The different hybrid cytokines of zones of different.In those regions mixing secondary as time, use association mixing
The factor.
In certain embodiments, this autonomous mixing and renewal are with display refresher rate
Or to carry out close to display refresher rate；Therefore, these embodiments are supported to refresh close to display
The image update speed (and thus supporting perception movement rate) of speed.
It is described below the concrete example of the operation of the present invention.Concrete example reference
Fig. 4 A-6B, Fig. 4 A-6B illustrates according to regarding that embodiments of the invention, response user input
Feel and feed back.Fig. 4 A-6B.Specifically, in each example, the operation of the present invention includes
TSCS 110 independently generates mixed image and uses mixed image independently to update display screen
Curtain 140.
Referring now to Fig. 4 A, it is shown that according to the towing of one embodiment of the present of invention
Operation.In general, response user's input, update secondary as 420A continuously, in order to show as
Input path 430A (in this path or deviateing) with it along user to put in place from position 410A towing
Put 414A.
Specifically, it is provided that user's input (such as includes initiating the one of drag operation
Individual or multiple user's fingers).User's input is touched overlapping with the active area of display screen 140
The position 410A touched in the sensing region of sensor 150 starts.Response user's input, including
Preimage 405A (such as background image) and the secondary mixed image as 420A (such as circular icon) by
TSCS 110 independently generates.Additionally, display screen 140 is used combination chart by TSCS 110
As independently updating.To be positioned at position 410A (or inclined with it as 420 by pair for mixed image
From).
When user input path 430A inputted by user create time, multiple mixing
Image is independently generated by TSCS 110.These mixed image input path 430A along user
Diverse location illustrate secondary as 420A.Display screen 140 is used mixed image by TSCS 110
Independently update.Such as, defeated along user when the one or more input objects providing user's input
Entering path 430A when being positioned at position 412A, mixed image is independently generated by TSCS 110.
Pair is determined by this mixed image as 420A is positioned to be inputted by the user of position 412A
Position in and before preimage 405A.Display screen 140 is used this by TSCS 110
Individual mixed image independently updates.
Similarly, it is positioned at when the one or more input objects providing user's input
During the 414A of position, mixed image is responded user's input by TSCS 110 and independently generates,
And use mixed image independently to update display screen 140.This mixed image is by pair picture
420A is positioned in position determined by the user of position 414A inputs.Response user
The movement of input, TSCS 110 (or suitably joins relative to another relative to preimage 405A
Examine, such as the active area of display screen 140) repeat to update wherein mixing pair as the position of 420A.
The mixed image that also uses TSCS 110 repeats to update display screen 140.This is relative to preimage
405A, display screen 140 or both carry out moving sets as 420A.
In certain embodiments, user's input and being produced between corresponding visual feedback
The raw waiting time is the time of process user's input, determines time and the employing being updated mixing
Mixed image updates the function of the time of display screen 140.In certain embodiments, immediately
Generate mixed image, and combination image is written directly to display screen 140.In this kind of embodiment
In, determine updated time of mixing can the most only comprise determine secondary as (and/or other image)
Time needed for the coordinate mixed with preimage.
Fig. 4 A illustrates that the identical minor picture of the different piece of drag function is former with identical
Picture.Other embodiments can mix not in different time points, space or user input capability sequence
Same image.Such as, the image that instruction towing is initiated can be used as the pair picture of position 410A, instruction
The image of towing continuity can be used as the pair picture of position 412A, or the image that instruction towing terminates
Can be used as the pair picture of position 414A.
In certain embodiments, the termination of response drag operation, host processing system
160 update the preimage preserved in first memory 131, in order to be included in drag operation and determined
New position towing item.Such as, in the drag operation shown in Fig. 4 A at position 414A eventually
After Zhi, some embodiments update preimage 405A, in order to be included in position 414A towing
The image (as pair as the circular icon of 420A) of item.In certain embodiments, main process is
This renewal of system 160 execution preimage.
In this way, preimage 405A in first memory 131 not by
Destroying or change, mixed image illustrates secondary towed as 420A response user's input simultaneously.
Shown pair is as item that 420A is that user is just pulling.But, real at some
Executing in example, different images is considered as secondary picture, and mixes different operating.Such as, when
Drag operation can provide blue star when occurring.By contrast, response another kind operates, as double-clicked behaviour
Make and two superposition fingers can be provided.
Referring still to Fig. 4 A, in another example, touch sensor 150 is used
In following the tracks of user's input, (such as, finger is suspended on display screen 140 or contacts display screen
140 and streak display screen 140).Then, TSCS 110 can independently perform mixing,
To provide the visual feedback of the form of the historical trace taking cursor or user's finger, and nothing
The intervention of host processing system 160 need to be associated.In certain embodiments, host processing system 160 exists
User gets involved when interacting with icon or other interactive element of display on display screen 140.
See figures.1.and.2, discuss and describe each according to the present invention in detail by continuing
The structure of individual embodiment and the operation of assembly.Specifically, it is TSCS 110, TSCC 120
Operation with DCC 130.
The embodiment of TSCS 110 can include enabling it to distinguish or determine user
The computing capability of the correct response of input.Such as, TSCS 110 can carry out judging, being voluntarily
System represents that (formulate) responds or cause action.It addition, TSCS 110 can respond and one
Or user's input that multiple electronic application is relevant, and without with host processing system 160 continue or
Periodic communication.Example response includes the adjustment to shown image.
In various embodiments, TSCC 120 and DCC 130 be integrated or with
Alternate manner directly communicates so that reduces and performs the main place that some touches or display task associates
The responsibility of reason system 160.Can sent such as to host processing system 160 by TSCC 120
Before the information of touch coordinate or gesture command etc or be parallel with sending them to
DCC 130, realizes leading between TSCC 120, host processing system 160 and DCC 130
Letter.
In various embodiments, TSCS 110 includes logic circuit.Logic circuit
Be configured to control following one or more between information flow: (1) TSCC 120 and DCC
130, (2) DCC 130 and host processing system 160, and (3) TSCC 120 processes system with main
System 160.Logic circuit can control the communication between TSCS 110 and host processing system 160
Link.In certain embodiments, logic circuit controls DCC 130 and host processing system 160
Between, between TSCC 120 and host processing system 160 or both communication link.
In certain embodiments, logic circuit control host processing system 160 with
Communication flowing between TSCC 110, and distinguishing or interpretability in communication is provided.Logical
Crossing this configuration, logic circuit can reduce and the frequency of interaction of host processing system 160.
Logic circuit can include that being specifically designed to realization calculates the circuit of logic, is programmed for
Perform to calculate general processor circuit or the combinations thereof of the function of logic.Such as, one
In a little embodiments, logic circuit carries out hardwired according to rule.As another example, one
In a little embodiments, logic circuit includes and the calculating electricity that suitably rule couples preserved in memorizer
Road.Rule can include computer-executable code, by action and storage in table or other structure
Data of conditions relevant etc..
The logic realized can be special.In certain embodiments, this passes through
The Different Logic circuit being combined with different application is used to realize.In certain embodiments, this leads to
Cross and use the Different Rule collection simultaneously preserved in memorizer to realize.In some other embodiment
In, this is realized by the rule set preserved in alterable storage.
Referring now to Fig. 2, display refreshes circuit 134 and includes mixed image maker
138 and display screen renovator 136.Mixed image maker 138 is by mixing the first storage
The pair picture preserved in the preimage preserved in device 131 and additional storage 132 is (alternatively with TSCS
Other image preserved in 110 and/or one or more copies of secondary picture), independently generate
Mixed image.Such as, for the response shown in Fig. 4, mixed image include preimage 405A and
Secondary as 420A.Display screen renovator 136 uses mixed image maker 138 to be generated
Mixed image independently updates display screen 140.
Mixed image can be additionally used in offer device for ejecting (pop-ups), and this strengthens user
Experience.Such as, during audio frequency, picture or video playback, media control (such as play,
Time-out, F.F., rewinding, volume, retreat, advance etc.) can on shown reflection bullet
Go out.With reference to Fig. 1, this ejects response and can be responded TSCS 110 by TSCS 110 and detect and connect
The contact of nearly display screen 140 (such as click, the touch of specific duration) or noncontact are (the most quiet
Only or dynamic suspension) user's input and provide, and without relating to host processing system 160.Therefore,
Some embodiments use popup menu or control to respond selection noncontact user input.Response is not
There is this " floating " or " based on suspending " of the user's input touching touch sensor 150
Trace feedback is used as hybrid plan and realizes.
In certain embodiments, host processing system 160 can be shown with impact user
Show that one of control shown in the mixed image of media is involved when interacting.This ejection merit
Property can be used for other control, such as, draw when drawing program is activity and control, when document volume
Collect edit commands etc. when device is activity.
In various embodiments, mixed image be can be additionally used in and inputted by response user
And the various icons produced or other similar image are to provide visual feedback.Such as, if performed
Relate to the gesture rotating image, then " rotate " icon and can act as secondary picture, and come with preimage
Display, and without the intervention of host processing system.Meanwhile, host processing system 160 can perform rotation
Image procossing needed for image, it is provided that perform the preimage of renewal needed for rotating.
In one embodiment, with reference to Fig. 4 B, method 300 also includes the 3rd
Image 425B is saved in TSCS 110 as 420B with pair simultaneously.The mixed image generated
Including preimage 405B, pair as 420B and the 3rd image 425B.In one embodiment,
Three image 425B are saved in second memory 132.In another embodiment, the 3rd figure
As 425B is saved in other position of TSCS 110, such as in the 3rd memorizer (not shown).
Such as, referring still to Fig. 4 B, it is shown that according to one embodiment of the present of invention,
By the translation (pan) operation (such as both hands refer to translation) performed by two input objects.?
In some embodiments, the preimage 405B shown in display screen 140 be bigger image (such as
Figure, picture, text document, webpage) a part.Translation shown in Fig. 4 B changes aobvious
Content shown in display screen curtain 140, in order to be shown on bigger image and move " viewport "
(viewport).In certain embodiments, host processing system 160 updates preimage, in order to provide
Motion.In some other embodiments, first memory preserves bigger image, and TSCS
110 determine which part showing bigger image.For the sake of clarity, Fig. 4 B does not shows
Go out modified-image.
As it has been described above, some embodiments of TSCS 110 can independently realize viewport.
In some realizations of viewport, first memory is configured through bigger, via figure
As the compression of data or combinations thereof preserve than once can shown in more picture number
According to.Compress technique is probably efficiently (such as based on run length encoding (RLE) compression),
Or it is probably (such as individually pixel is replaced) damaged.In certain embodiments, in the operation phase
Between, " viewport " can be same size or the physics chi of the active area than display screen 140
Very little less." viewport " can such as respond in sensing region user input and reality at image
On move, and on definition display screen 140, show what view data.
As shown in Figure 4 B, in order to indicate translation functions, secondary as 420B and the 3rd
Image 425B mixes with preimage 405B in the position associated with the first and second input objects.
As it can be seen, pair is closed as 420B and the first input object inputting path 430B along user
Connection, and the 3rd image 425B and the second input object inputting path 435B along user close
Connection.Correspondingly, the mixed image being autonomously generated includes that preimage 405B, pair are as 420B and the 3rd
Image 425B.When inputting object and moving, TSCS 110 associates in the position with input object
Position repeatedly generate have secondary as 420B and the mixed image of the 3rd image 425B, and
Mixed image is used to repeat to update display screen 140.Therefore, secondary as 420B and the 3rd image
425B according to make them completely or with certain skew along user input path 430B and
435B follows the mode of input object and moves.
For example, referring to Fig. 4 C, it is shown that another according to one embodiment of the present of invention
One dual input object translation operation.Operation shown in Fig. 4 C and the operation phase shown in Fig. 4 B
Seemingly, as mentioned above.But, in order to indicate this function, at the not coordination relative to two of preimage
Put and mix secondary picture.For convenience's sake, they referred to herein as pairs are as 420C and secondary picture
Copy 425C.Pair is closed as 420C and the first input object inputting path 430C along user
Connection.Similarly, the copy 425C of secondary picture and the second input inputting path 435C along user
Object associates.Correspondingly, the mixed image being autonomously generated includes that preimage 405C, pair are as 420C
And the copy 425C of pair picture.When inputting object and moving, TSCS 110 is relative to display
The diverse location weight of screen 140 (or another suitable reference, such as relative to preimage 405C)
Repetitive generation has pair as 420C and the mixed image of the copy 425C of secondary picture, and uses
Mixed image repeats to update display screen 140.Therefore, pair is as 420C and the copy of secondary picture
425C shows as moving relative to preimage 405C and/or display screen 140, and continues to use respectively
Input path, family 430C and 435C follows input object.
In another embodiment of method 300, according to an enforcement of the present invention
Example, determines the beginning of the sequence of user's input operation.Respond the sequence of user's input operation and give birth to
Become additional mixed image.Respond the sequence of user's input operation and use additional mixed image to come more
The display screen 140 of new Fig. 4 C, and the intervention of the host processing system 160 without Fig. 1.Really
Determine the end of the sequence of user's input operation.There is provided to host processing system 160 and input about user
The instruction of the sequence of operation.
In various embodiments, it is provided that can include to the instruction of host processing system 160
The only signal of the termination of the sequence of instruction user's input operation.In certain embodiments, it is provided that give
The instruction about user's input of host processing system 160 can include inputting relevant with user
Information (gesture such as identified, the character inputted, the input object of composition user's input
Mass motion, function (the functions selected text of selected text that inputted
Entered), the quantity of input object, the type of input object, location information, force information etc.
Deng).This instruction can make host processing system 160 from low power state be switched to full power state,
Initiate or close application etc..
For example, referring to Fig. 4 C, in one embodiment, instruction user inputs behaviour
The user of the beginning of the sequence made enters through the input object of position 410C and 415C and carries
Supply.In response to determining that the beginning of the sequence of user's input operation, TSCS 110 generates and comprises preimage
405C and pair are as the mixed image of 420C.Mixed image is used for updating display screen 140.
In the sequence of user's input operation, the first input object inputs road along user
Footpath 430C moves into place 140, and the second input object inputs path 435C along user and moves
To position 445C.Response relates to inputting object and inputs the shifting of path 430C and 435C along user
The sequence of dynamic user's input operation, generates additional mixed image.Additional mixed image is with defeated
Enter the secondary picture of diverse location mixing inputting path 430C and 435C along user of object association
420C and the copy 425C of secondary picture.TSCS 110 uses additional mixed image to update
Display screen 140.TSCS 110 realizes these actions and without the intervention of host processing system 160.
Fig. 4 A-4C illustrates secondary as carrying out the several examples mixed with preimage, they
Visual feedback to user's input is provided.Exist and consider many changes.Such as, secondary picture can
Including any amount of shape, color and size.As another example, such as can be in difference
Time, different orientation or diverse location mix the copy of any amount of image and image.
As a concrete example, secondary as angular shape can be included.Respond respectively wherein
" compression " or " expansion " user input that input object is gathered or scattered, angular shape can be directed to
Be positioned to follow input object of which movement.In certain embodiments, this can imitate picture box
Two or more angles and the expansion of that picture " frame " or contraction.
In certain embodiments, the secondary picture of mixing, in order to highlight the part of display preimage.
In certain embodiments, at the position mixing secondary picture corresponding with the position that user inputs.
Such as when user input include upward out touch sensor surface or
When leaving one or more input object of sensing region, determine the sequence of user's input operation
Terminate.Some embodiments are determined by no longer sensing in the sensing region of touch sensor 150
Input to user, determine end.In certain embodiments, to respond user defeated for TSCS 110
Enter the termination of the sequence of operation and the sequence of user's input operation is provided to host processing system 160
Instruction.
In each embodiment of method 300, respond the first signal and initiate individually
Mixed function, and respond secondary signal and terminate independent mixed function.In independent mixed function
Period, TSCS 110 independently generates mixed image, and uses mixed image aobvious to update
Display screen curtain 140, and without the intervention of host processing system 160.Such as, independent mixed function is
α mixed function, as discussed in detail above.
In certain embodiments and with reference to Fig. 1, it is right that host processing system 160 determines
The response of user's input need not the intervention of host processing system 160.Correspondingly, host processing system
160 provide the first signal to initiate independent mixed function.In certain embodiments, main process is
System 160 also provides for secondary signal to terminate independent mixed function.In certain embodiments, TSCS
110 terminate independent mixed function, and provide independent mixed function to host processing system 160
The instruction terminated.
Referring again to Fig. 1, in certain embodiments, TSCS 110 determines user defeated
The response entered need not the intervention of host processing system 160.Correspondingly, in various embodiments,
TSCS 110 independently initiates mixed function.In certain embodiments, TSCS 110 is then to master
Processing system 160 provides the instruction having begun to about independent mixed function.In some embodiments
In, TSCS 110 independently performs independent mixed function, and function terminate rear to master
There is independent mixed function in processing system 160 instruction.
In another embodiment of method 300, with reference to Fig. 5 A-B, preimage 505A
Image including dummy keyboard.Second memory 132 comprise associate with dummy keyboard multiple by
Key image (the playing motion video, such as button image 520A of such as space bar).Determine based on user
The user of the button (such as space bar) of the dummy keyboard of input starts.In multiple button image
Button image is selected as the pair picture that will carry out mixing with preimage so that mixed image illustrates wherein
Start the dummy keyboard of selected button.Such as, response is for starting the use of button image 520A
Family inputs, and selects the pair having started Fig. 5 B of space bar as 520B, in order to illustrate dummy keyboard
The space bar of upper starting.In certain embodiments, in second memory 132, the multiple of preservation press
Key image is the subset (rather than complete or collected works) that can start button.Response does not has and second memory
The starting of the button of the button image association preserved in 132, host processing system 160 can provide
The image starting button mixes for TSCS 110, or provides wherein suitably button to be shown as
The image of the dummy keyboard started.
In another embodiment of method 300, TSCS 110 stores second
The multiple images preserved in device 132 mix with preimage.Such as, preimage can include virtual key
The image of dish, and second memory 132 can preserve general button image together with specific keys
Multiple additional image (image of such as character or radical) of association.Response starts dummy keyboard
User's input of button (such as " # "), TSCS 110 mixing is key associated with " # " suitable
Image, general button image and preimage so that mixed image illustrates and wherein starts selected button
Dummy keyboard.
In another embodiment of method 300, TSCS 110 is entering with preimage
To secondary as modifying before row mixing.Instance modification includes size, shape, color, transparent
Degree etc..Such as, preimage can include the image of dummy keyboard, and secondary as including general button figure
Picture.Response starts user's input of the button (such as " W ") of dummy keyboard, and TSCS 110 repaiies
Change secondary picture, in order to " W " is placed on the suitable part of secondary picture so that mixed image illustrates it
The dummy keyboard of button selected by middle starting.
Designator in addition to starting the image of button can be used for provide from
The visual feedback that button starts.For example, referring to Fig. 5 A-B, including the outline-color of coloured rectangle
(highlighter) can be that the pair mixed with preimage 520A is as 520B, in order to starting is provided
Visual feedback.In certain embodiments, second memory 132 preserves single outline-color, and
By same outline-color (pass through or do not revise through TSCS 110) for multiple buttons.?
In some embodiments, second memory 132 preserves multiple outline-colors of different sizes and shapes,
And TSCS 110 (passes through to starting button mixing suitable profile color or does not pass through
TSCS 110 revises).
Which (which) button the display that highlights of button may be used to indicate in offer choosing
To be started when selecting input, as the replacement that instruction button is started or supplementary.Such as, with
On the region that " Q " is key associated suspend exceed the reference time amount noncontact user input can
" Q " button is caused to highlight display.Contact user's input then can cause the starting of " Q " button
And " Q " is input in storage buffer.
In an embodiment of method 300, with reference to Fig. 6 A-B, respond user
Input and revise secondary as 620A, and the intervention of the host processing system 160 without Fig. 1.Specifically
For, the inking of the secondary mobile association included as 620A with user's input.
Such as, it is provided that user's input of hand-written letter " T ".As hand-written letter " T "
When creating by inputting user's input in path 621 and 622 along user, TSCS 110 repaiies
Change secondary as to mate.Therefore, it is autonomously generated and for updating the mixing of display screen 140
Image is along hand-written letter " T " inking.It is to say, preimage 605A and applicable pair are as 620A
Repetition mixed display inking.Additionally, in certain embodiments, when hand-written letter " T "
When user's input is identified as letter " T ", hand-written letter " T " is on display screen 140
Replaced by keying in letter " T ".
In various embodiments, the host processing system 160 of Fig. 1 is by character recognition code
Download in TSCS 110.TSCS 110 realizes most of or whole character identification function.
This can include the drafting of low latency stroke, sense of touch feedback and dictionary correction etc..Standard hands
Write or keypad input interface can be used in communicating with host processing system 160.Main process is
System 160 can configure character know by downloading different code, different language, character set etc.
The most functional.
In some embodiments of method 300, TSCS 110 is to host processing system
160 provide in generation mixed image and use mixed image to update display screen 140 extremely
During small part, host processing system 160 is triggered into the instruction being in low power state.At each
In embodiment, this instruction includes user's input information, according to user's input information, and main process system
System 160 determines that it can enter low power state.In certain embodiments, this instruction includes specially
Indicate it can enter the signal of low power state to host processing system 160.
Such as perform drag operation as shown in Figure 4 A.Once it is determined that drag operation
Initiate, then the host processing system 160 of Fig. 1 having been triggered into being in low power state.Accordingly
Ground, reduces power consumption.
In certain embodiments, host processing system 160 provides real to TSCS 110
The now software of complete nested menu GUI.User can browse through nested menu structure, and without
Any intervention from host processing system 160.TSCS 110 presents menu, and main process
System 160 can enter lower power state.When user carries out menu setecting, processing system
160 are waken up when necessary, and process responsibility and suitably return to processing system 160.
In the embodiment of method 300, according to running on host processing system 160
Should be used for customizing preimage, secondary picture and/or the 3rd image.In certain embodiments, based on operation
In Fig. 1 host processing system 160 should be used for secondary picture is provided.Similarly, in some embodiments
In, should be for providing preimage based on run on host processing system 160.This application can be shown
Show there is focus or have and be better than running on other application preferential of host processing system 160
Level.In another embodiment, secondary as based on inputting relevant application to user.
Such as, word processing application and web browser all run on host processing system
160.When user uses web browser energetically, web browser has focus or tool
There is the priority being better than word processing application.Similarly, word processing system is used energetically as user
Rather than during web browser, word processing application has focus or has and be better than web browser
Priority.When word processing is applied and is had priority on display screen 140, it is provided that secondary picture,
Such as comprise the translucent pop-up box of word processing functions list.Correspondingly, response senses and at word
User's input of reason association, independently generates and comprises preimage and the mixing of translucent pop-up box
Image, and use mixed image independently to update display screen 140.Word processing and webpage are clear
Device of looking at is example application, and the application of any quantity and type can run on host processing system
160。
Additionally, the TSCS 110 of Fig. 1 and Fig. 2 can provide user the explanation inputted,
A part as its communication with primary processor.The explanation function that can make TSCS 110 is
Reconfigurable or application is specific.TSCS 110 can need not process system to main
Each example of system 160 report user's input, but to giving timing during only report user inputs
Between handled application is meaningful or relative those examples.
In various embodiments of the present invention, each in addition to display screen 140
Plant device and provide a user with feedback.In one embodiment, tactile actuator (not shown) via
The device control module 125 of Fig. 2 controls, and provides a user with sense of touch feedback.Owing to touching
Feeling and feed back, user's comfort and the confidence of the electronic installation 100 of Fig. 1 are strengthened.At one
In example, tactile actuator provides stereognosis (tactile) feedback, such as the physics electricity to user's input
Resistance or non linear mechanical response.In another example, tactile actuator provides and inputs user
Buzzing or vibratory response.Available via thump (click), sound of heavy breathing, bang bang or other sound
Other device of auditory feedback is provided.
Additionally, available alternative or additional assembly, such as other interface or feedback dress
Put.These alternative or additional devices include microphone, loudspeaker and other audio devices, force transducer,
Motion sensor, accelerometer, gyroscope, photodetector, imaging device, mechanical button, bullet
Key, lever, slide block etc..
In each embodiment of the present invention, electronic installation 100 includes security function,
And without the intervention of host processing system 160.In one embodiment, response sensing is aobvious with described
User's input in the sensing region that the active area of display screen curtain 140 is overlapping and to electronic installation 100
Unlock.TSCS 110 may not allow host processing system 160 to power up or not allow electronics to fill
Put 100 and accept other input, until electronic installation 100 is unlocked.
In certain embodiments, the failure that electronic installation 100 is unlocked by response is tasted
Examination, on display screen 140, display is configured to respond the failure unlocking electronic installation 100
The pair picture attempted.
In various embodiments, security password and encryption key are protected by TSCS 110
Exist in the protected field that cannot be read by host processing system 160 of its memorizer.TSCS
Virtual keypad on 110 display screens, it allows user to input password.Then, TSCS 110
Compare inputting via the user of keypad with one or more passwords of preservation in memorizer
Relatively.If password is correct, then TSCS 110 discharges encryption key to host processing system 160.
Owing to host processing system 160 is without reference to the storage of password or input, so running on main process
The Malware of system 160 cannot spy upon storage and/or the input of password.
In short, the most at least disclose following generalized concept.
Concept 1.A kind of electronic installation, including:
It is configured to show the display screen of image；
There is the touch sensor of sensing region, wherein said sensing region and described display screen
Active area overlapping；
Host processing system, is configured on described display screen the master of the described image of display
Process；And
Touch screen control system, including:
Touch sensor control circuit, is configured to operate described touch sensor, in order to inspection
Survey the user's input in described sensing region；And
Display control circuit, is configured to operate described display screen, described display circuit bag
Include:
First memory, is configured to preserve that described host processing system provided is former
Picture；
Second memory, is configured to preserve secondary picture；And
Display refreshes circuit, is configured to:
Use some in the described image handled by described host processing system
Image updates described display screen, and
Respond described user input and Jie without described host processing system
Enter: generate and comprise described preimage and the mixed image of described secondary picture, and use described combination chart
As updating described display screen.
Concept 2.Device as described in concept 1, wherein, described display refreshes circuit and is configured to
Generate through the following steps and comprise described preimage and the described mixed image of described secondary picture:
Mixing described secondary picture relative to the position of described preimage, wherein said position is based on institute
State position and at least one in motion of user's input.
Concept 3.Device as described in concept 1, wherein, described host processing system is configured to
Should be for providing one of multiple image as described pair based on run on described host processing system
Picture.
Concept 4.Device as described in concept 1, wherein, described host processing system is configured to
Based on run on described host processing system have priority should for provide multiple image it
One as described secondary picture.
Concept 5.Device as described in concept 1, wherein, described host processing system is configured to:
The initiation of response drag operation, providing as described secondary picture will be in described drag operation
The image of towing so that it is former relative to described that described mixed image comprises described image to be pulled
The movement of picture；And
Respond the termination of described drag operation, update described preimage, in order to include to drag described
Drag the copy of the described image of operation defined position towing.
Concept 6.Device as described in concept 1, wherein, described host processing system is configured to
Refresh mixed image described in circuit evolving in described display and use described mixed image to come more
At least some of period of the time of new described display screen is in low power state.
Concept 7.Device as described in concept 1, wherein, described host processing system is configured to
Described preimage or described secondary picture, wherein said display is updated with maximum image data update rate
Control circuit is configured to generate with maximum mixed image renewal rate and update, and described
Maximum image data update rate is less than described maximum mixed image renewal rate.
Concept 8.A kind of touch screen control system, is configured to communicate with host processing system,
Wherein said host processing system is configured for the main place of the image shown on the display screen
Reason, described touch screen control system includes:
Touch sensor control circuit, is configured to control for detecting described touch sensor element
Sensing region in user input touch sensor element, wherein said sensing region and institute
The active area stating display screen is overlapping；And
Display control circuit, is configured to control described display screen, described display control circuit bag
Include:
First memory, is configured to preserve the preimage that described host processing system is provided；
Second memory, is configured to preserve secondary picture；And
Display refreshes circuit, is configured to:
Use some images in the described image handled by described host processing system
Update described display screen, and
Respond described user input and without the intervention of described host processing system:
Generate and comprise described preimage and at least part of mixing of described secondary picture
Image, and
Use described mixed image to update described display screen.
Concept 9.Touch screen control system as described in concept 8, wherein, described touch screen control
System processed is configured to respond described user input and revise described secondary picture, and without described main place
The intervention of reason system.
Concept 10.Touch screen control system as described in concept 8, wherein, described second deposits
The memory span of reservoir is less than described first memory.
Concept 11.Touch screen control system as described in concept 8, wherein, described second deposits
Reservoir is configured to secondary as preserving the 3rd image simultaneously with described.
Concept 12.Touch screen control system as described in concept 8, wherein, described display brush
Novel circuit is configured through the following step to generate described mixed image:
At secondary picture described relative to the mixing of the primary importance of described preimage, and
Relative to the of the second position of described preimage mixing the 3rd image or described secondary picture
Two copies.
Concept 13.Touch screen control system as described in concept 8, wherein, described display brush
Novel circuit is configured through the following step to generate described mixed image:
Mixing described secondary picture relative to the position of described preimage, wherein said position is based on institute
State position and at least one in motion of user's input.
Concept 14.A kind of display control circuit, including:
First memory, is configured to preserve the preimage for showing on the display screen；
Second memory, is configured to preserve for the pair picture of display on described display screen；And
Display refreshes circuit, is configured to:
Use described in being received handled by host processing system and from host processing system
Some images in image update described display screen；And
The user detected in the sensing region of response touch sensor inputs and without institute
State the intervention of host processing system: generate and comprise described preimage and the mixed image of described secondary picture, and
And use described mixed image to update described display screen, the institute of wherein said touch sensor
State sensing region overlapping with the described active area of described display screen.
Concept 15.Display control circuit as described in concept 14, wherein, described second storage
The memory span of device is less than described first memory.
Concept 16.Display control circuit as described in concept 14, wherein, described display refreshes
Circuit is configured through the following step to generate described mixed image:
Mixing described secondary picture relative to the position of described preimage, wherein said position is based on institute
State position and at least one in motion of user's input.
Concept 17.Display control circuit as described in concept 14, wherein, described user inputs
Including the input of multiple input objects, and described display refreshes circuit and is configured through following step
Suddenly described mixed image is generated:
Mixing described secondary picture relative to the primary importance of described preimage, described primary importance with
The position association of the first input object of the plurality of input object, and
Relative to the second position of described preimage mix the 3rd image or described secondary as
Triplicate, the described second position inputs the position of object with the second of the plurality of input object
Association.
Concept 18.One is used for operating touch screen control system to show on the display screen
The processor implementation method of image, described method includes:
Use described in being received handled by host processing system and from described host processing system
Some images in image update described display screen, and the configuration of wherein said host processing system is used
In for the main process of the described image of display on described display screen；
The preimage received from described host processing system is preserved in the first memory；
By pair as being saved in second memory；
User in the sensing region that response sensing is overlapping with the active area of described display screen is defeated
Enter:
Independently generate and comprise described preimage and the mixed image of described secondary picture；And
Described mixed image is used independently to update described display screen.
Concept 19.Processor implementation method as described in concept 18, also includes:
Described secondary picture is received from described host processing system.
Concept 20.Processor implementation method as described in concept 18, also includes and described preservation
Described secondary as simultaneously the 3rd image being saved in described additional storage, wherein said generation
Described mixed image includes:
Mix described preimage, described secondary picture and described 3rd image.
Concept 21.Processor implementation method as described in concept 18, also includes:
Described with described preservation secondary as simultaneously the 3rd image being saved in described additional storage
In, the described mixed image of wherein said generation includes:
Respond described sensing described user input and select described secondary picture.
Concept 22.Processor implementation method as described in concept 18, also includes:
Determine that described user input includes the sequence of user's input operation；
Respond the sequence of described user's input operation, generate additional mixed image, and use institute
State additional mixed image to update described display screen, and without Jie of described host processing system
Enter；
Determine the end of the sequence of described user's input operation；And
Respond described end and provide about described user's input operation to described host processing system
The instruction of sequence.
Concept 23.Processor implementation method as described in concept 18, also includes:
Response initiates independent mixed function from the first signal of described host processing system, wherein
Described touch screen control system generates mixed image, and without described host processing system to described list
The solely intervention of mixed function；And
Response terminates described independent mixed function from the secondary signal of described host processing system.
Concept 24.Processor implementation method as described in concept 18, wherein, described preimage bag
Include the image of dummy keyboard, and described second memory comprises and associates with described dummy keyboard
Multiple button image, described method also includes:
Determine that based on described user input the user of the button of described dummy keyboard starts, and
Based on described determine come in the plurality of button image selected as described secondary picture by
Key image so that described mixed image shows the described virtual key wherein having started described button
Dish.
Concept 25.Processor implementation method as described in concept 18, also includes:
The initiation of drag operation is processed based on described user input；And
As described secondary as receiving the image of towing in described drag operation so that described
Mixed image comprises described image the to be pulled movement relative to described preimage.
Concept 26.Processor implementation method as described in concept 25, also includes:
The termination of described drag operation is processed based on described user input；And
Receive another preimage preserved in described first memory, another preimage wherein said
Including by the described image towed in the position reflecting described drag operation.
Concept 27.Processor implementation method as described in concept 18, also includes:
Respond described user input and revise described secondary picture, and without Jie of described host processing system
Enter.
Concept 28.Processor implementation method as described in concept 27, wherein, described amendment institute
State secondary as including:
Adjust described secondary picture so that described mixed image includes the mobile pass inputted with described user
The inking of connection.
Concept 29.Processor implementation method as described in concept 18, wherein, described user is defeated
Enter the input of the multiple input objects included in described sensing region, and described generation is described mixed
Conjunction image includes:
Relative to the described secondary picture of the first position of described preimage mixing, wherein said first
Put the primary importance of the first input object based on the plurality of input object, and
Relative to the second position of described preimage mixing the 3rd image or described secondary as
Triplicate, the wherein said second position the second input object based on the plurality of input object
The second position.
Concept 30.Processor implementation method as described in concept 18, also includes:
There is provided in described generation and at least some of phase of described renewal to described host processing system
Between described host processing system triggered into the information being in low power state.
Concept 31.Processor implementation method as described in concept 18, wherein, described second deposits
Reservoir is configured to preserve multiple image, and each image of the plurality of image and multiple users input hands
At least one gesture association of gesture, described method also includes:
Described user input is identified as comprising the plurality of user and inputs the first gesture of gesture；
And
Image in the plurality of image that will associate with described first gesture is selected as described
Secondary picture so that described mixed image provides the visual feedback of described identification.
Concept 32.Processor implementation method as described in concept 18, wherein, described independently
Generate and independently update and perform with speed more faster than maximum image data update rate, its
Described in maximum image data update rate be described processing system can update described preimage or
The rapid rate of described secondary picture.
Have thus described each embodiment of the present invention.Although in a particular embodiment
Describe the present invention, but it is to be understood that the present invention is understood not to by this kind of enforcement
Example limits, but should understand according to following claims.
Claims (32)
1. an electronic installation, including:
It is configured to show the display screen of image；
There is the touch sensor of sensing region, wherein said sensing region and described display screen
Active area overlapping；
Host processing system, is configured on described display screen the master of the described image of display
Process；And
Touch screen control system, including:
Touch sensor control circuit, is configured to operate described touch sensor, in order to inspection
Survey the user's input in described sensing region；And
Display control circuit, is configured to operate described display screen, and described display controls electricity
Road includes:
First memory, is configured to preserve that described host processing system provided is former
Picture；
Second memory, is configured to preserve secondary picture；And
Display refreshes circuit, is configured to:
Use some in the described image handled by described host processing system
Image updates described display screen, and
Respond described user input and Jie without described host processing system
Enter: generate and comprise described preimage and the mixed image of described secondary picture, and use described combination chart
As updating described display screen.
2. device as claimed in claim 1, wherein, described display refreshes circuit and is configured to lead to
Cross the following step to generate and comprise described preimage and the described mixed image of described secondary picture:
At a described secondary picture of position mixing, the position that described position inputs based on described user and
At least one in motion.
3. device as claimed in claim 1, wherein, described host processing system is configured to base
In run in described host processing system should be for providing one of multiple image as described pair
Picture.
4. device as claimed in claim 1, wherein, described host processing system is configured to base
In run on described host processing system there is priority should be for providing one of multiple image
As described secondary picture.
5. device as claimed in claim 1, wherein, described host processing system is configured to:
The initiation of response drag operation, providing as described secondary picture will be in described drag operation
The image of towing so that it is former relative to described that described mixed image comprises described image to be pulled
The movement of picture；And
Respond the termination of described drag operation, update described preimage, in order to include to drag described
Drag the copy of the described image of operation defined position towing.
6. device as claimed in claim 1, wherein, described host processing system is configured to
Described display refreshes mixed image described in circuit evolving and uses described mixed image to update
At least some of period of the time of described display screen is in low power state.
7. device as claimed in claim 1, wherein, described host processing system be configured to
Maximum image data update rate updates described preimage or described secondary picture, wherein said display control
Circuit processed is configured to generate with maximum mixed image renewal rate and update, and described
Big view data renewal rate is less than described maximum mixed image renewal rate.
8. a touch screen control system, is configured to communicate with host processing system, Qi Zhongsuo
State the main process of the image that host processing system is configured for showing on the display screen, described
Touch screen control system includes:
Touch sensor control circuit, is configured to control touch sensor element to detect described touching
Touching the user's input in the sensing region of sensor element, wherein said sensing region is aobvious with described
The active area of display screen curtain is overlapping；And
Display control circuit, is configured to control described display screen, described display control circuit bag
Include:
First memory, is configured to preserve the preimage that described host processing system is provided；
Second memory, is configured to preserve secondary picture；And
Display refreshes circuit, is configured to:
Use some images in the described image handled by described host processing system
Update described display screen, and
Respond described user input and without the intervention of described host processing system:
Generate and comprise described preimage and at least part of mixing of described secondary picture
Image, and
Use described mixed image to update described display screen.
9. touch screen control system as claimed in claim 8, wherein, described touch screen controls
System is configured to respond described user input and revises described secondary picture, and without described main process
The intervention of system.
10. touch screen control system as claimed in claim 8, wherein, described second storage
The memory span of device is less than described first memory.
11. touch screen control systems as claimed in claim 8, wherein, described second storage
Device is configured to while preserving described secondary picture preserve the 3rd image.
12. touch screen control systems as claimed in claim 8, wherein, described display refreshes
Circuit is configured through the following step to generate described mixed image:
At the described secondary picture of primary importance mixing, and
At second position mixing the 3rd image or the triplicate of described secondary picture.
13. touch screen control systems as claimed in claim 8, wherein, described display refreshes
Circuit is configured through the following step to generate described mixed image:
At a described secondary picture of position mixing, the position that described position inputs based on described user and
At least one in motion.
14. 1 kinds of display control circuits, including:
First memory, is configured to preserve the preimage for showing on the display screen；
Second memory, is configured to preserve for the pair picture of display on described display screen；And
Display refreshes circuit, is configured to:
Use and come by some images handled by host processing system and received from which
Update described display screen；And
The user detected in the sensing region of response touch sensor inputs and without institute
State the intervention of host processing system: generate and comprise described preimage and the mixed image of described secondary picture, and
And use described mixed image to update described display screen, the institute of wherein said touch sensor
State sensing region overlapping with the active area of described display screen.
15. show control circuit, wherein, described second memory as claimed in claim 14
Memory span less than described first memory.
16. show control circuit as claimed in claim 14, and wherein, described display refreshes electricity
Road is configured through the following step to generate described mixed image:
At a described secondary picture of position mixing, the position that described position inputs based on described user and
At least one in motion.
17. show control circuit as claimed in claim 14, and wherein, described user inputs bag
Include the input of multiple input object, and described display refreshes circuit and is configured through the following step
Generate described mixed image:
At the described secondary picture of first position mixing, described primary importance and the plurality of input object
First input object position association, and
At second position mixing the 3rd image or the triplicate of described secondary picture, described second
Position associates with the position of the second input object of the plurality of input object.
18. 1 kinds for operating touch screen control system to show image on the display screen
Processor implementation method, described method includes:
Use described in being received handled by host processing system and from described host processing system
Some images in image update described display screen, and the configuration of wherein said host processing system is used
In for the main process of the described image of display on described display screen；
The preimage received from described host processing system is preserved in the first memory；
By pair as being saved in second memory；
User in the sensing region that response sensing is overlapping with the active area of described display screen is defeated
Enter:
Independently generate and comprise described preimage and the mixed image of described secondary picture；And
Described mixed image is used independently to update described display screen.
19. processor implementation methods as claimed in claim 18, also include:
Described secondary picture is received from described host processing system.
20. processor implementation methods as claimed in claim 18, also include and described preservation institute
State secondary as simultaneously the 3rd image being saved in described second memory, wherein said generation institute
State mixed image to include:
Mix described preimage, described secondary picture and described 3rd image.
21. processor implementation methods as claimed in claim 18, also include and described preservation institute
State secondary as simultaneously the 3rd image being saved in described second memory, wherein said generation institute
State mixed image to include:
Respond described sensing described user input and select described secondary picture.
22. processor implementation methods as claimed in claim 18, also include:
Determine that described user input includes the sequence of user's input operation；
Respond the sequence of described user's input operation, generate additional mixed image, and use institute
State additional mixed image to update described display screen, and without Jie of described host processing system
Enter；
Determine the end of the sequence of described user's input operation；And
Respond described end and provide about described user's input operation to described host processing system
The instruction of sequence.
23. processor implementation methods as claimed in claim 18, also include:
Response initiates independent mixed function from the first signal of described host processing system, wherein
Described touch screen control system generates mixed image, and without described host processing system to described list
The solely intervention of mixed function；And
Response terminates described independent mixed function from the secondary signal of described host processing system.
24. processor implementation methods as claimed in claim 18, wherein, described preimage includes
The image of dummy keyboard, and described second memory storage has and associates with described dummy keyboard
Multiple button image, described method also includes:
Determine that based on described user input the user of the button of described dummy keyboard starts, and
Based on the described button determining the next the plurality of button image selected as described secondary picture
Image so that described mixed image shows the described dummy keyboard wherein having started described button.
25. processor implementation methods as claimed in claim 18, also include:
The initiation of drag operation is processed based on described user input；And
As described secondary as receiving the image of towing in described drag operation so that described
Mixed image comprises described image the to be pulled movement relative to described preimage.
26. processor implementation methods as claimed in claim 25, also include:
The termination of described drag operation is processed based on described user input；And
Receive another preimage preserved in described first memory, another preimage wherein said
Including by the described image towed in the position reflecting described drag operation.
27. processor implementation methods as claimed in claim 18, also include:
Respond described user input and revise described secondary picture, and without Jie of described host processing system
Enter.
28. processor implementation methods as claimed in claim 27, wherein, described in described amendment
Secondary as including:
Adjust described secondary picture so that described mixed image includes the mobile pass inputted with described user
The inking of connection.
29. processor implementation methods as claimed in claim 18, wherein, described user inputs
Including the input of the multiple input objects in described sensing region, and the described mixing of described generation
Image includes:
At the described secondary picture of first position mixing, described primary importance is based on the plurality of input thing
The primary importance of the first input object of body, and
At second position mixing the 3rd image or the triplicate of described secondary picture, described second
The second position of position the second input object based on the plurality of input object.
30. processor implementation methods as claimed in claim 18, also include:
There is provided in described generation and at least some of phase of described renewal to described host processing system
Between described host processing system triggered into the information being in low power state.
31. processor implementation methods as claimed in claim 18, wherein, described second storage
Device is configured to preserve multiple image, and each image in the plurality of image and multiple users input hands
At least one gesture association of gesture, described method also includes:
Described user input is identified as comprising the plurality of user and inputs the first gesture of gesture；
And
Image in the plurality of image that will associate with described first gesture is selected as described
Secondary picture so that described mixed image provides the visual feedback of described identification.
32. processor implementation methods as claimed in claim 18, wherein, described independently give birth to
Become and independently update to perform with speed more faster than maximum image data update rate, wherein
Described maximum image data update rate is that described processing system can update described preimage or institute
State the rapid rate of secondary picture.
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US17440309P | 2009-04-30 | 2009-04-30 | |
| US61/174403 | 2009-04-30 | ||
| US12/770,415 US9703411B2 (en) | 2009-04-30 | 2010-04-29 | Reduction in latency between user input and visual feedback |
| US12/770415 | 2010-04-29 | ||
| PCT/US2010/033051 WO2010127175A2 (en) | 2009-04-30 | 2010-04-29 | Control circuitry and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102414653A CN102414653A (en) | 2012-04-11 |
| CN102414653B true CN102414653B (en) | 2016-11-30 |
Family
ID=
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1614545A (en) * | 2003-11-06 | 2005-05-11 | 三星电子株式会社 | Apparatus and method for providing virtual graffiti and recording medium for the same |
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1614545A (en) * | 2003-11-06 | 2005-05-11 | 三星电子株式会社 | Apparatus and method for providing virtual graffiti and recording medium for the same |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10254878B2 (en) | Operating a touch screen control system according to a plurality of rule sets | |
| KR102063952B1 (en) | Multi display apparatus and multi display method | |
| CN104641322B (en) | For providing the user terminal apparatus of LOCAL FEEDBACK and its method | |
| US10613678B1 (en) | Input device with haptic feedback | |
| CN104185831B (en) | For the system and method using input unit dynamic regulation user-interface parameters | |
| US20100241957A1 (en) | System with ddi providing touch icon image summing | |
| US9721365B2 (en) | Low latency modification of display frames | |
| KR102028717B1 (en) | Flexible apparatus and control method thereof | |
| CN107102806A (en) | A kind of split screen input method and mobile terminal | |
| US20140015785A1 (en) | Electronic device | |
| CN103729158A (en) | Multi-display apparatus and method of controlling display thereof | |
| KR101528412B1 (en) | Display device, user interface method, and program | |
| CN105556428A (en) | Portable terminal having display and method for operating same | |
| US20110134071A1 (en) | Display apparatus and touch sensing method | |
| CN107943381A (en) | Hot-zone method of adjustment and device, client | |
| CN114721539A (en) | Touch controller, touch sensing apparatus including the same, and method of operating the same | |
| CN105320413A (en) | Method of providing screen and image forming apparatus performing the method | |
| EP2520076A1 (en) | An apparatus, method, computer program and user interface | |
| CN108027682A (en) | Coordinate measuring set and its control method | |
| CN102414653B (en) | control circuit and method | |
| CN106843615B (en) | A kind of display screen and display system | |
| US20140123069A1 (en) | Electronic apparatus, display method, and program | |
| CN102385449A (en) | Portable electronic device and touch control method | |
| US20170031589A1 (en) | Invisible touch target for a user interface button | |
| KR102008692B1 (en) | A electronic device and a method of pointing object on the display thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20191011 Address after: Saitama Prefecture, Japan Patentee after: Corporate clubs and crowns Address before: California, USA Patentee before: Synaptics Inc |