CN106896969A - A kind of mobile terminal and its method and apparatus for realizing man-machine interaction - Google Patents
A kind of mobile terminal and its method and apparatus for realizing man-machine interaction Download PDFInfo
- Publication number
- CN106896969A CN106896969A CN201710113877.5A CN201710113877A CN106896969A CN 106896969 A CN106896969 A CN 106896969A CN 201710113877 A CN201710113877 A CN 201710113877A CN 106896969 A CN106896969 A CN 106896969A
- Authority
- CN
- China
- Prior art keywords
- mobile terminal
- touch
- control device
- contactor control
- top layer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03547—Touch pads, in which fingers can move on a surface
Abstract
The invention discloses a kind of mobile terminal and its method and apparatus for realizing man-machine interaction, belong to mobile communication technology field.Wherein, realize that the method for man-machine interaction is comprised the following steps：Mobile terminal obtains user's finger and is slidably reciprocated on its top layer the operating position information of generation by contactor control device, and is sent to the touch-control single-chip microcomputer of contactor control device in real time and synchronizes treatment, to draw out the track of mouse movement；The track of the mouse movement that mobile terminal is drawn out according to touch-control single-chip microcomputer carries out active user interface UI draftings, until UI display mouses reach specified location；After UI display mouses reach specified location, the trigger action that mobile terminal passes through contactor control device acquisition user's finger to respond and performs corresponding action command.The present invention adds contactor control device to realize contact control mouse man-machine interactive operation by the back of mobile terminal, effectively coordinates 3D glass edges touch-control, touch-screen, button to carry out friendly interaction.
Description
Technical field
The present invention relates to field of terminal technology, more particularly to a kind of mobile terminal and its realize the method and dress of man-machine interaction
Put.
Background technology
With the gradually development of intelligent artifact, man-machine interaction also occurs in that diversified form.Man-machine interaction refers to people
With interacting for machine, be substantially people interacts with mobile terminal, or understands from wider angle：Man-machine interaction refers to people
Interacting between the machine containing processor, specifically, man-machine interaction refers to use certain right between people and computer
Conversational language, with certain interactive mode, such as keystroke, mobile mouse, the symbol/figure on display screen etc., to complete to determine to appoint
Information exchanging process between the people of business and computer, at present for computer, its man-machine interaction focuses primarily upon mouse
Interaction, Trackpad interaction, button interaction, fingerprint interaction, touch-screen click on interaction etc., it is seen then that the man-machine interaction of computer has become
It is convenient, fast, accurate to obtain.
Society now, mobile terminal at an unprecedented rate develops, and the main customer-centric of various brands manufacturer sets substantially
Meter principle carries out the Human-computer Interactive Design of product, and the man-machine interaction mode of current mobile terminal mainly has button, fingerprint, touches
Screen interaction etc. is touched, intelligent mobile terminal largely can complete some functions with replacement computer at this stage, but computer
Mouse hands over mode not to be added to always in mobile mobile terminal but.
The content of the invention
It is a primary object of the present invention to proposing a kind of mobile terminal and its realizing the method and apparatus of man-machine interaction, it is intended to
It is largely user-friendly, make user that one-handed performance more can be easily carried out during mobile terminal is used,
To solve existing product the drawbacks of the subregion during thumb during singlehanded use cannot get at touch-screen, meanwhile, also
So that product is in the case of touch screen from being damaged, user can also continue to manipulate product by contact control mouse operation.
To achieve the above object, a kind of mobile terminal that the present invention is provided, the mobile terminal includes touch display screen, place
Reason device and contactor control device, the contactor control device are independently layed in side table of the mobile terminal away from the touch display screen
On face, and the touch display screen, the contactor control device are electrically connected with the processor respectively.
Preferably, the bottom of the contactor control device is provided with touch-control single-chip microcomputer, the top layer of the contactor control device be provided with to
A few capacitance type sensor for matrix arrangement, the touch-control single-chip microcomputer respectively with the capacitance type sensor and the processor
It is electrically connected with.
Preferably, the mobile terminal also includes fingerprint module, and the fingerprint module is electrically connected with the processor, institute
Fingerprint module is stated located at the mobile terminal on a side surface of the touch display screen, the contactor control device superposition is laid
In on the fingerprint module.
Additionally, to achieve the above object, the present invention also proposes a kind of method for realizing man-machine interaction, is applied to above-mentioned shifting
Dynamic terminal, the described method comprises the following steps：Mobile terminal obtains user's finger and is slidably reciprocated on its top layer by contactor control device
The operating position information of generation, and be sent to the touch-control single-chip microcomputer of the contactor control device in real time and synchronize treatment, to draw out
The track of mouse movement；Used in real time the track of the mouse movement that the mobile terminal is drawn out according to the touch-control single-chip microcomputer
Family interface UI draws, until UI display mouses reach specified location；After UI display mouses reach specified location, institute
The trigger action that mobile terminal obtains user's finger by the contactor control device is stated, to respond and corresponding action command is performed.
Preferably, the mobile terminal obtains user's finger and is slidably reciprocated on its top layer the action of generation by contactor control device
Before the step of positional information, methods described is further comprising the steps of：After the mobile terminal bright screen, the touch-control single-chip microcomputer meeting
Top layer to contactor control device carries out low-power consumption real-time monitoring, to find that user starts contact control mouse operation.
Preferably, the step of touch-control single-chip microcomputer carries out low-power consumption real-time monitoring to the top layer of contactor control device is specifically wrapped
Include：When the touch-control single-chip microcomputer carries out low-power consumption real-time monitoring to the top layer of contactor control device, if detecting touching for user's finger
The time is touched more than 3S, the touch-control single-chip microcomputer is then judged to that user starts contact control mouse operation, and sends dependent instruction to described
Mobile terminal, to start contact control mouse operating function.
Preferably, the mobile terminal obtains the trigger action of user's finger by the contactor control device, to respond and hold
After the step of row corresponding action command, methods described is further comprising the steps of：After the mobile terminal breath screen, the touch-control
Device is stopped, into resting state.
Preferably, the trigger action includes that double-click action, click action and long pressing act.
A kind of device for realizing man-machine interaction is also provided, above-mentioned mobile terminal is applied to, described device includes：Top layer list
Unit, the touch action for receiving finger, and the operating position information that the touch action is produced is sent to device in real time
Bottom floor units；Middle layer elements, figure and word for providing man-machine interaction；Bottom floor units, for the table of monitoring device
Whether layer unit is touched, and draws out mouse after processing the operating position information that the top layer unit is sended in real time
The track of motion is marked, while processor of the Real-time Feedback to the mobile terminal.
Preferably, the bottom floor units include：Touch judge module, for mobile terminal bright screen after, to the top layer list
Unit carries out low-power consumption real-time monitoring, to find whether user starts contact control mouse operation；Message processing module, for touch-control mouse
After mark operation starts, mouse movement is drawn out after processing the operating position information that the top layer unit is sended in real time
Track, while Real-time Feedback to the mobile terminal processor.
A kind of mobile terminal proposed by the present invention and its method and apparatus for realizing man-machine interaction, it is proposed in movement first
The back of terminal adds contactor control device, to realize contact control mouse man-machine interactive operation on mobile terminals, effectively coordinates 3D glass
Glass edge touch-control, touch-screen, button carry out friendly interaction.So, current large-size screen monitors mobile terminal user is on the one hand solved
Thumb cannot get at the problem of screen Zone Full during singlehanded use, and the forefinger for effectively utilizing user is conveniently used
Family carries out singlehanded friendliness；On the other hand, in the case of the touch screen from being damaged of mobile terminal, user still can be from the
Two kinds of interactive modes come continue manipulate mobile terminal.
Brief description of the drawings
Fig. 1 is the hardware architecture diagram of the mobile terminal for realizing each embodiment of the invention；
Fig. 2 is the hardware architecture diagram of the mobile terminal that first embodiment of the invention is proposed；
Fig. 3 is the fundamental diagram of capacitive touch control plate.
Fig. 4 is the FB(flow block) of the method for realizing man-machine interaction that second embodiment of the invention is proposed；
Fig. 5 is the schematic diagram that mobile terminal selects application by contactor control device；
Fig. 6 is that mobile terminal triggers the schematic diagram for clicking on application by contactor control device；
Fig. 7 is the connection block diagram of the device for realizing man-machine interaction that third embodiment of the invention is proposed；
The realization of the object of the invention, functional characteristics and advantage will be described further referring to the drawings in conjunction with the embodiments.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
The mobile terminal of each embodiment of the invention is realized referring now to Description of Drawings.In follow-up description, use
For represent element such as " module ", " part " or " unit " suffix only for being conducive to explanation of the invention, itself
Not specific meaning.Therefore, " module " can be used mixedly with " part ".
Mobile terminal can be implemented in a variety of manners.For example, the terminal described in the present invention can include such as moving
Phone, smart phone, notebook computer, digit broadcasting receiver, PDA (personal digital assistant), PAD (panel computer), PMP
The mobile terminal of (portable media player), guider etc. and such as numeral TV, desktop computer etc. are consolidated
Determine terminal.Hereinafter it is assumed that terminal is mobile terminal.However, it will be understood by those skilled in the art that, except being used in particular for movement
Outside the element of purpose, construction according to the embodiment of the present invention can also apply to the terminal of fixed type.
Fig. 1 is that the hardware configuration of the mobile terminal for realizing each embodiment of the invention is illustrated.
Mobile terminal 1 00 can include wireless communication unit 110, A/V (audio/video) input block 120, user input
Unit 130, sensing unit 140, output unit 150, memory 160, interface unit 170, controller 180 and power subsystem 190
Etc..Fig. 1 shows the mobile terminal with various assemblies, it should be understood that being not required for implementing all groups for showing
Part.More or less component can alternatively be implemented.The element of mobile terminal will be discussed in more detail below.
Wireless communication unit 110 generally includes one or more assemblies, and it allows mobile terminal 1 00 and wireless communication system
Or the radio communication between network.For example, wireless communication unit can include broadcasting reception module 111, mobile communication module
112nd, at least one of wireless Internet module 113, short range communication module 114 and location information module 115.
Broadcasting reception module 111 receives broadcast singal and/or broadcast via broadcast channel from external broadcast management server
Relevant information.Broadcast channel can include satellite channel and/or terrestrial channel.Broadcast management server can be generated and sent
The broadcast singal and/or broadcast related information generated before the server or reception of broadcast singal and/or broadcast related information
And send it to the server of terminal.Broadcast singal can include TV broadcast singals, radio signals, data broadcasting
Signal etc..And, broadcast singal may further include the broadcast singal combined with TV or radio signals.Broadcast phase
Pass information can also be provided via mobile communications network, and in this case, broadcast related information can be by mobile communication mould
Block 112 is received.Broadcast singal can exist in a variety of manners, for example, it can be with the electronics of DMB (DMB)
The form of program guide (EPG), the electronic service guidebooks (ESG) of digital video broadcast-handheld (DVB-H) etc. and exist.Broadcast
Receiver module 111 can receive signal and broadcast by using various types of broadcast systems.Especially, broadcasting reception module 111
Can be wide by using such as multimedia broadcasting-ground (DMB-T), DMB-satellite (DMB-S), digital video
Broadcast-hand-held (DVB-H), forward link media (MediaFLO@) Radio Data System, received terrestrial digital broadcasting integrated service
Etc. (ISDB-T) digit broadcasting system receives digital broadcasting.Broadcasting reception module 111 may be constructed such that and be adapted to provide for extensively
Broadcast the various broadcast systems and above-mentioned digit broadcasting system of signal.Via broadcasting reception module 111 receive broadcast singal and/
Or broadcast related information can be stored in memory 160 (or other types of storage medium).
Mobile communication module 112 sends radio signals to base station (for example, access point, node B etc.), exterior terminal
And at least one of server and/or receive from it radio signal.Such radio signal can be logical including voice
Words signal, video calling signal or the various types of data for sending and/or receiving according to text and/or Multimedia Message.
Wireless Internet module 113 supports the Wi-Fi (Wireless Internet Access) of mobile terminal.The module can be internally or externally
It is couple to terminal.Wi-Fi (Wireless Internet Access) technology involved by the module can include WLAN (WLAN) (Wi-Fi), Wibro
(WiMAX), Wimax (worldwide interoperability for microwave accesses), HSDPA (high-speed downlink packet access) etc..
Short range communication module 114 is the module for supporting junction service.Some examples of short-range communication technology include indigo plant
ToothTM, radio frequency identification (RFID), Infrared Data Association (IrDA), ultra wide band (UWB), purple honeybeeTMEtc..
Location information module 115 is the module for checking or obtaining the positional information of mobile terminal.Location information module
Typical case be GPS (global positioning system).According to current technology, GPS module 115 is calculated and comes from three or more satellites
Range information and correct time information and the Information application triangulation for calculating, so as to according to longitude, latitude
Highly accurately calculate three-dimensional current location information.Currently, defended using three for calculating the method for position and temporal information
Star and the position that is calculated by using other satellite correction and the error of temporal information.Additionally, GPS module 115
Can be by Continuous plus current location information in real time come calculating speed information.
A/V input blocks 120 are used to receive audio or video signal.A/V input blocks 120 can include the He of camera 121
Microphone 1220, the static map that 121 pairs, camera is obtained in Video Capture pattern or image capture mode by image capture apparatus
The view data of piece or video is processed.Picture frame after treatment may be displayed on display unit 151.At camera 121
Picture frame after reason can be stored in memory 160 (or other storage mediums) or carried out via wireless communication unit 110
Send, two or more cameras 1210 can be provided according to the construction of mobile terminal.Microphone 122 can be in telephone relation mould
Sound (voice data) is received via microphone in formula, logging mode, speech recognition mode etc. operational mode, and can be by
Such acoustic processing is voice data.Audio (voice) data after treatment can be changed in the case of telephone calling model
For the form that can be sent to mobile communication base station via mobile communication module 112 is exported.Microphone 122 can implement all kinds
Noise eliminate (or suppress) algorithm eliminating (or suppression) in the noise for receiving and producing during sending audio signal or
Person disturbs.
User input unit 130 can generate key input data to control each of mobile terminal according to the order of user input
Plant operation.User input unit 130 allows the various types of information of user input, and can include keyboard, metal dome, touch-control
Plate (for example, detection due to being touched caused by resistance, pressure, electric capacity etc. change sensitive component), roller, rocking bar etc.
Deng.Especially, when Trackpad is superimposed upon on display unit 151 in the form of layer, touch-screen can be formed.
Sensing unit 140 detects the current state of mobile terminal 1 00, (for example, mobile terminal 1 00 opens or closes shape
State), the presence or absence of the contact (that is, touch input) of the position of mobile terminal 1 00, user for mobile terminal 1 00, mobile terminal
The acceleration or deceleration movement of 100 orientation, mobile terminal 1 00 and direction etc., and generate for controlling mobile terminal 1 00
The order of operation or signal.For example, when mobile terminal 1 00 is embodied as sliding-type mobile phone, sensing unit 140 can be sensed
The sliding-type phone is opened or closed.In addition, sensing unit 140 can detect power subsystem 190 whether provide electric power or
Whether person's interface unit 170 couples with external device (ED).Sensing unit 140 can will be combined below including proximity transducer 1410
Touch-screen is described to this.
Interface unit 170 is connected the interface that can pass through with mobile terminal 1 00 as at least one external device (ED).For example,
External device (ED) can include wired or wireless head-band earphone port, external power source (or battery charger) port, wired or nothing
Line FPDP, memory card port, the port for connecting the device with identification module, audio input/output (I/O) end
Mouth, video i/o port, ear port etc..Identification module can be that storage uses each of mobile terminal 1 00 for verifying user
Kind of information and subscriber identification module (UIM), client identification module (SIM), Universal Subscriber identification module (USIM) can be included
Etc..In addition, the device (hereinafter referred to as " identifying device ") with identification module can take the form of smart card, therefore, know
Other device can be connected via port or other attachment means with mobile terminal 1 00.Interface unit 170 can be used for reception and come from
The input (for example, data message, electric power etc.) of the external device (ED) and input that will be received is transferred in mobile terminal 1 00
One or more elements can be used for transmitting data between mobile terminal and external device (ED).
In addition, when mobile terminal 1 00 is connected with external base, interface unit 170 can serve as allowing by it by electricity
Power provides to the path of mobile terminal 1 00 from base or can serve as allowing the various command signals being input into from base to pass through it
It is transferred to the path of mobile terminal.Be can serve as recognizing that mobile terminal is from the various command signals or electric power of base input
The no signal being accurately fitted within base.Output unit 150 is configured to provide defeated with vision, audio and/or tactile manner
Go out signal (for example, audio signal, vision signal, alarm signal, vibration signal etc.).Output unit 150 can include display
Unit 151, dio Output Modules 152, alarm unit 153 etc..
Display unit 151 may be displayed on the information processed in mobile terminal 1 00.For example, when mobile terminal 1 00 is in electricity
During words call mode, display unit 151 can show and converse or other communicate (for example, text messaging, multimedia file
Download etc.) related user interface (UI) or graphic user interface (GUI).When mobile terminal 1 00 is in video calling pattern
Or during image capture mode, display unit 151 can show the image of capture and/or the image of reception, show video or figure
UI or GUI of picture and correlation function etc..
Meanwhile, when display unit 151 and Trackpad in the form of layer it is superposed on one another to form touch-screen when, display unit
151 can serve as input unit and output device.Display unit 151 can include liquid crystal display (LCD), thin film transistor (TFT)
In LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexible display, three-dimensional (3D) display etc. at least
It is a kind of.Some in these displays may be constructed such that transparence to allow user to be watched from outside, and this is properly termed as transparent
Display, typical transparent display can be, for example, TOLED (transparent organic light emitting diode) display etc..According to specific
Desired implementation method, mobile terminal 1 00 can include two or more display units (or other display devices), for example, moving
Dynamic terminal can include outernal display unit (not shown) and inner display unit (not shown).Touch-screen can be used to detect touch
Input pressure and touch input position and touch input area.
Dio Output Modules 152 can mobile terminal be in call signal reception pattern, call mode, logging mode,
It is that wireless communication unit 110 is received or in memory 160 when under the isotypes such as speech recognition mode, broadcast reception mode
The voice data transducing audio signal of middle storage and it is output as sound.And, dio Output Modules 152 can be provided and movement
The audio output (for example, call signal receives sound, message sink sound etc.) of the specific function correlation that terminal 100 is performed.
Dio Output Modules 152 can include loudspeaker, buzzer etc..
Alarm unit 153 can provide output and be notified to mobile terminal 1 00 with by event.Typical event can be with
Including calling reception, message sink, key signals input, touch input etc..In addition to audio or video is exported, alarm unit
153 can in a different manner provide output with the generation of notification event.For example, alarm unit 153 can be in the form of vibrating
Output is provided, when calling, message or some other entrance communication (incomingcommunication) are received, alarm list
Unit 153 can provide tactile output (that is, vibrating) to notify to user.Exported by providing such tactile, even if
When in pocket of the mobile phone of user in user, user also can recognize that the generation of various events.Alarm unit 153
The output of the generation of notification event can be provided via display unit 151 or dio Output Modules 152.
Memory 160 can store software program for the treatment and control operation performed by controller 180 etc., Huo Zheke
Temporarily to store oneself data (for example, telephone directory, message, still image, video etc.) through exporting or will export.And
And, memory 160 can store the vibration of various modes on being exported when touching and being applied to touch-screen and audio signal
Data.
Memory 160 can include the storage medium of at least one type, and the storage medium includes flash memory, hard disk, many
Media card, card-type memory (for example, SD or DX memories etc.), random access storage device (RAM), static random-access storage
Device (SRAM), read-only storage (ROM), Electrically Erasable Read Only Memory (EEPROM), programmable read only memory
(PROM), magnetic storage, disk, CD etc..And, mobile terminal 1 00 can perform memory with by network connection
The network storage device cooperation of 160 store function.
The overall operation of the generally control mobile terminal of controller 180.For example, controller 180 is performed and voice call, data
Communication, video calling etc. related control and treatment.In addition, controller 180 can be included for reproducing (or playback) many matchmakers
The multi-media module 1810 of volume data, multi-media module 1810 can be constructed in controller 180, or can be structured as and control
Device processed 180 is separated.Controller 180 can be with execution pattern identifying processing, the handwriting input that will be performed on the touchscreen or figure
Piece draws input and is identified as character or image.
Power subsystem 190 receives external power or internal power under the control of controller 180 and provides operation each unit
Appropriate electric power needed for part and component.
Various implementation methods described herein can be with use such as computer software, hardware or its any combination of calculating
Machine computer-readable recording medium is implemented.Implement for hardware, implementation method described herein can be by using application-specific IC
(ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), scene can
Programming gate array (FPGA), processor, controller, microcontroller, microprocessor, it is designed to perform function described herein
At least one in electronic unit is implemented, and in some cases, such implementation method can be implemented in controller 180.
For software implementation, the implementation method of such as process or function can with allow to perform the single of at least one function or operation
Software module is implemented.Software code can be come by the software application (or program) write with any appropriate programming language
Implement, software code can be stored in memory 160 and performed by controller 180.
So far, oneself according to its function through describing mobile terminal.Below, for the sake of brevity, will description such as folded form,
Slide type mobile terminal in various types of mobile terminals of board-type, oscillating-type, slide type mobile terminal etc. is used as showing
Example.Therefore, the present invention can be applied to any kind of mobile terminal, and be not limited to slide type mobile terminal.
Based on above-mentioned mobile terminal hardware configuration, each embodiment of the invention is proposed.
As shown in Fig. 2 first embodiment of the invention proposes a kind of mobile terminal 200, mobile terminal 200 includes touching display
Screen 2100, processor 280, contactor control device 2110 and fingerprint module 2120, touch display screen 2100, contactor control device 2110 and
Fingerprint module 2120 is electrically connected with processor 280 respectively, and fingerprint module 2120 deviates from touch display screen located at mobile terminal 200
On 2100 side surface, the superposition of contactor control device 2110 is layed on fingerprint module 2120.
The bottom of the contactor control device 2110 in the present embodiment is provided with touch-control single-chip microcomputer 2113, the top layer of contactor control device 2110
Be provided with the capacitance type sensor 2111 of at least one matrix arrangement, touch-control single-chip microcomputer 2113 respectively with capacitance type sensor 2111
And processor 280 is electrically connected with, i.e., this contactor control device 2110 is capacitive touch control plate.It is known that the work of capacitive touch control plate
It is that the position of finger is perceived by the electric capacity of human body as principle, i.e., when the finger of user touches the wink of capacitive touch control plate
Between, just produce an electric capacity on the surface of capacitive touch control plate.As shown in figure 3, dotted line represents touch touchpad surface in figure
User's finger, a kind of sensor matrices are attached with touchpad surface, and this sensor matrices connect together with chip, continuously not
The disconnected finger electric capacity track for tracking user, by internal a series for the treatment of such that it is able to be accurately positioned use all the time
The finger position (X, Y-coordinate) at family, while forming electricity due to the finger and distance between plates (pressure size) of user by measuring
The size of capacitance determines Z coordinate, is finally completed the measurement of X, Y, Z coordinate.Further, since the signal collected by Trackpad
Tri- groups of analog signal datas of X, Y, Z are relatively faint, it would be desirable to carry out signal amplification to it using amplifier；After amplification
Analog signal, for the ease of touch-control single-chip microcomputer A/D samplings, it is necessary to design one step gain circuit, by the analog signal of circuit all
Adjust zero point top；The analog signal of gain circuitry output carries out A/D conversions by touch-control single-chip microcomputer, to realize analog signal
To the conversion of data signal.
In addition, in the present embodiment, being set by the way that contactor control device 2110 is superimposed into the structure being layed on fingerprint module 2120
Meter, can be while build stack space be greatlyd save, and the switching for also completing two kinds of functions is used.And for art technology
For personnel, contactor control device 2110 can also independently be layed in mobile terminal 200 away from a side surface of touch display screen 2100
In any position, meanwhile, the size of contactor control device 2110 also can go definition by user's request, be touched with deviating from mobile terminal 200
Touch the contactor control device 2110 for being formed on a side surface of display screen 2100 and being dimensioned for, be easy to user to manipulate.
As shown in figure 4, second embodiment of the invention proposes a kind of method for realizing man-machine interaction, above-mentioned movement is applied to
Terminal, comprises the following steps：
Step S1：After mobile terminal bright screen, the touch-control single-chip microcomputer of contactor control device can carry out low work(to the top layer of contactor control device
Consumption real-time monitoring, to find that user starts contact control mouse operation.
Specifically, because the contactor control device of mobile terminal is the second sets of plan that it realizes man-machine interaction, it makes daily
Used time, user typically carries out man-machine interaction using the first sets of plan (i.e. touch display screen), thus, in order to reduce its operation work(
Consumption, contactor control device in most cases can in a dormant state, even if after mobile terminal bright screen, will not also be started at once,
Only when user needs, contact control mouse operation can be just started under the triggering of user.And in order to improve the processor of mobile terminal
Processing speed so that the processor of mobile terminal can find in time user start contact control mouse operation.Contactor control device is carried
Touch-control single-chip microcomputer can be after mobile terminal bright screen, the algorithm process for carrying out early stage internal first, i.e., using low frequency to touch-control
The top layer of device is scanned, to monitor whether user has the operation for starting contact control mouse, when touch-control single-chip microcomputer is to contactor control device
Top layer when carrying out low-power consumption real-time monitoring, if detecting the touch time of user's finger more than 3S, touch-control single-chip microcomputer then judges
For user starts contact control mouse operation, and dependent instruction is sent to processor, to start contact control mouse operating function.Such one
Come, by setting the restriction scheme of 3S, can be prevented effectively from occur user hold mobile terminal during false touch touch touch-control dress
The top layer put and cause that mobile terminal takes for user and to start the problem of contact control mouse operation.
Step S2：Mobile terminal obtains user's finger and is slidably reciprocated on its top layer the operating position of generation by contactor control device
Information, and be sent to the touch-control single-chip microcomputer of contactor control device in real time and synchronize treatment, to draw out the track of mouse movement.
Specifically, after processor starts contact control mouse operating function, if user's finger is come on the top layer of contactor control device
Return slip, the meshed capacitance on its top layer can be caused to change, with produce include upper cunning, downslide, left cunning, right cunning, upper left cunning,
Upper right cunning, lower-left cunning, bottom right cunning etc. are in interior operating position information, and Real-time Feedback gives touch-control single-chip microcomputer, touch-control single-chip microcomputer pair
Synchronize treatment, to draw out the track of mouse movement.
Step S3：The track of the mouse movement that mobile terminal is drawn out according to touch-control single-chip microcomputer carries out active user interface UI
Draw, until UI display mouses reach specified location.
Specifically, when touch-control single-chip microcomputer carries out the drafting of the track of mouse movement, the processor of mobile terminal can be synchronous
Active user interface UI draftings are carried out, to refresh the position of mouse in real time on UI.Citing：When touch-control single-chip microcomputer detects user
When finger from left to right slides into the top layer edge of contactor control device, and the mouse shown on UI does not reach specified location, this
When, the position coordinates (X, Y) of mouse is recorded, and UI pauses refresh.When user's finger leaves the top layer of contactor control device,
Continue to be slided since the left side of the top layer of contactor control device, now, the positional information of mouse is from (the X, Y) coordinate position for recording just now
Start to update, repeat operation, until showing that mouse reaches specified location on UI.
Step S4：After UI display mouses reach specified location, mobile terminal obtains user's finger by contactor control device
Trigger action, to respond and performs corresponding action command.
Specifically, trigger action includes that double-click action, click action and long pressing act.When the processor of mobile terminal is opened
After opening the communication connection with the touch-control single-chip microcomputer of contactor control device, according to the mouse coordinates value (X, Y value) that touch-control singlechip feedbsck is returned
Carry out active user interface UI draftings, as user's finger is constantly moved on the top layer of contactor control device, coordinate value (X, Y of mouse
Value) real-time change is carried out, UI displays are constantly updated.After UI display mouses are reached needs open position (i.e. specified location),
User's finger carries out double-click action or click action or long by action on the top layer of contactor control device, feeds back to Z values, mobile terminal
Processor get the trigger action of user's finger after, to respond and corresponding action command is performed, so as to be shown on UI
Corresponding mode of operation.Citing：Such as Fig. 5 and Fig. 6 performances is after a touch-control selects an application, to click the table of contactor control device
The effect that layer is produced.
Step S5：After mobile terminal breath screen, contactor control device is stopped, into resting state.
Specifically, when mobile terminal is in breath screen state, in order to reduce power consumption, contactor control device carries out dormancy shape
State, is not operated, and when it lights screen again, the touch-control single-chip microcomputer that contactor control device is carried can be first using low
Frequency is scanned to the top layer of contactor control device, to monitor whether user has the operation for starting contact control mouse.When monitoring user
When starting contact control mouse operation, touch-control single-chip microcomputer starts high frequency sweep, and constantly the data to contactor control device feedback are carried out
Real-time processing, and will it is treated after data feedback carry out active user interface UI to the processor of mobile terminal and draw.
As shown in fig. 7, third embodiment of the invention proposes a kind of device 300 for realizing man-machine interaction, it is applied to above-mentioned
Mobile terminal, device 300 includes top layer unit 301, middle layer elements 302 and bottom floor units 303.
Wherein, top layer unit 301, the touch action for receiving finger, and the positional information reality that touch action is produced
When be sent to the bottom floor units of contactor control device.Specifically, when user's finger carries out sliding, downslide, a left side on top layer unit 301
During the touch actions such as sliding, right cunning, upper left are slided, upper right is slided, lower-left is slided, bottom right cunning, can cause its meshed capacitance that corresponding change occurs
Change, top layer unit 301 judges corresponding operating position information, and Real-time Feedback to the bottom floor units of device according to these changes
303。
Middle layer elements 302, figure and word for providing man-machine interaction, i.e. what is shown on mobile terminal UI is interior
Hold so that user can carry out corresponding touch and manipulate according to these contents in top layer unit 301.
Whether bottom floor units 303, the top layer unit for monitoring contactor control device is touched, and top layer unit is sent in real time
The operating position information for coming over draws out the track of mouse movement after being processed, while treatment of the Real-time Feedback to mobile terminal
Device.Specifically, bottom floor units 303 include touching judge module 3031 and message processing module 3032, touch judge module 3031
After for mobile terminal bright screen, low-power consumption real-time monitoring is carried out to top layer unit 301, to find whether user starts touch-control mouse
Mark operation, in order to reduce power consumption, when mobile terminal is in breath screen state, device 300 can not carried out in a dormant state
Work, thus, after mobile terminal bright screen, whether contact control mouse operation need to be started to user to be monitored, so as to when needed
Start contact control mouse operating function in time, so, after mobile terminal bright screen, touching judge module 3031 can be using low frequency to table
Layer unit 301 is scanned, to monitor whether user has the operation for starting contact control mouse, if detect the touch of user's finger
Between more than 3S when, touch judge module 3031 and be then judged to that user starts contact control mouse operation, and send dependent instruction to treatment
Device, to start contact control mouse operating function.After message processing module 3031 is used for contact control mouse operation startup, to top layer unit
The 301 operating position information for sending in real time draw out the track of mouse movement after being processed, while Real-time Feedback is to shifting
The processor of dynamic terminal, after contact control mouse is operated to be started, if slip of the user's finger on top layer unit 301 back and forth, can lead
Cause the meshed capacitance on its top layer to change, upper cunning, downslide, left cunning, right cunning, upper left cunning, upper right cunning, lower-left are included to produce
Sliding, bottom right cunning is in interior operating position information, and Real-time Feedback, to message processing module 3031, message processing module 3031 can be right
Synchronize treatment, to draw out the track of mouse movement, while processor of the Real-time Feedback to mobile terminal, to carry out reality
When user interface UI draw.
A kind of mobile terminal proposed by the present invention and its method and apparatus for realizing man-machine interaction, it is proposed in movement first
The back of terminal adds contactor control device, to realize contact control mouse man-machine interactive operation on mobile terminals, effectively coordinates 3D glass
Glass edge touch-control, touch-screen, button carry out friendly interaction.So, current large-size screen monitors mobile terminal user is on the one hand solved
Thumb cannot get at the problem of screen Zone Full during singlehanded use, and the forefinger for effectively utilizing user is conveniently used
Family carries out singlehanded friendliness；On the other hand, in the case of the touch screen from being damaged of mobile terminal, user still can be from the
Two kinds of interactive modes come continue manipulate mobile terminal.
It should be noted that herein, term " including ", "comprising" or its any other variant be intended to non-row
His property is included, so that process, method, article or device including a series of key elements not only include those key elements, and
And also include other key elements being not expressly set out, or also include for this process, method, article or device institute are intrinsic
Key element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that including this
Also there is other identical element in the process of key element, method, article or device.
The embodiments of the present invention are for illustration only, and the quality of embodiment is not represented.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases
The former is more preferably implementation method.Based on such understanding, technical scheme is substantially done to prior art in other words
The part for going out contribution can be embodied in the form of software product, and the computer software product is stored in a storage medium
In (such as ROM/RAM, magnetic disc, CD), including some instructions are used to so that a station terminal equipment (can be mobile phone, computer, clothes
Business device, air-conditioner, or network equipment etc.) perform method described in each embodiment of the invention.
The preferred embodiments of the present invention are these are only, the scope of the claims of the invention is not thereby limited, it is every to utilize this hair
Equivalent structure or equivalent flow conversion that bright specification and accompanying drawing content are made, or directly or indirectly it is used in other related skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of mobile terminal, it is characterised in that the mobile terminal includes touch display screen, processor and contactor control device,
The contactor control device is independently layed in the mobile terminal on a side surface of the touch display screen, and described touch shows
Display screen, the contactor control device are electrically connected with the processor respectively.
2. mobile terminal according to claim 1, it is characterised in that the bottom of the contactor control device is provided with touch-control monolithic
Machine, the top layer of the contactor control device is provided with the capacitance type sensor of at least one matrix arrangement, the touch-control single-chip microcomputer difference
It is electrically connected with the capacitance type sensor and the processor.
3. mobile terminal according to claim 1, the mobile terminal also includes fingerprint module, the fingerprint module and institute
Processor electric connection is stated, the fingerprint module is located at the mobile terminal to deviate from a side surface of the touch display screen,
The contactor control device superposition is layed on the fingerprint module.
4. a kind of method for realizing man-machine interaction, it is characterised in that be applied to the mobile end as described in claim 1-3 is any
End, the described method comprises the following steps：
The mobile terminal obtains user's finger and is slidably reciprocated on its top layer the act bit confidence of generation by the contactor control device
Cease, and be sent to the touch-control single-chip microcomputer of the contactor control device in real time and synchronize treatment, to draw out the track of mouse movement；
The track of the mouse movement that the mobile terminal is drawn out according to the touch-control single-chip microcomputer carries out active user interface UI and paints
System, until UI display mouses reach specified location；
After UI display mouses reach specified location, the mobile terminal obtains user's finger by the contactor control device
Trigger action, to respond and performs corresponding action command.
5. method according to claim 4, it is characterised in that the mobile terminal obtains user's finger by contactor control device
Its top layer slidably reciprocate generation operating position information the step of before, methods described is further comprising the steps of：The movement
After terminal bright screen, the touch-control single-chip microcomputer can carry out low-power consumption real-time monitoring to the top layer of contactor control device, to find that user opens
Dynamic contact control mouse operation.
6. method according to claim 5, it is characterised in that the touch-control single-chip microcomputer carries out low to the top layer of contactor control device
The step of power consumption real-time monitoring, specifically includes：When the touch-control single-chip microcomputer carries out low-power consumption real-time monitoring to the top layer of contactor control device
When, if detecting the touch time of user's finger more than 3S, the touch-control single-chip microcomputer is then judged to that user starts contact control mouse behaviour
Make, and send dependent instruction to the mobile terminal, to start contact control mouse operating function.
7. method according to claim 4, it is characterised in that the mobile terminal obtains user by the contactor control device
The trigger action of finger, to respond and the step of perform corresponding action command after, methods described is further comprising the steps of：Institute
After stating mobile terminal breath screen, the contactor control device is stopped, into resting state.
8. method according to claim 4, it is characterised in that the trigger action include double-click action, click action with
And it is long by action.
9. a kind of device for realizing man-machine interaction, it is characterised in that be applied to the mobile end as described in claim 1-3 is any
End, described device includes：
Top layer unit, the touch action for receiving finger, and the operating position information that the touch action is produced is sent out in real time
The bottom floor units of feed apparatus；
Middle layer elements, figure and word for providing man-machine interaction；
Whether bottom floor units, the top layer unit for monitoring device is touched, and the top layer unit is sended in real time
Operating position information draws out the track of mouse movement after being processed, while treatment of the Real-time Feedback to the mobile terminal
Device.
10. device according to claim 9, it is characterised in that the bottom floor units include：
Touch judge module, for mobile terminal bright screen after, low-power consumption real-time monitoring is carried out to the top layer unit, to find
Whether user starts contact control mouse operation；
Message processing module, after starting for contact control mouse operation, the operating position sended in real time to the top layer unit
Information draws out the track of mouse movement after being processed, while processor of the Real-time Feedback to the mobile terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710113877.5A CN106896969A (en) | 2017-02-28 | 2017-02-28 | A kind of mobile terminal and its method and apparatus for realizing man-machine interaction |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710113877.5A CN106896969A (en) | 2017-02-28 | 2017-02-28 | A kind of mobile terminal and its method and apparatus for realizing man-machine interaction |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106896969A true CN106896969A (en) | 2017-06-27 |
Family
ID=59185107
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710113877.5A Pending CN106896969A (en) | 2017-02-28 | 2017-02-28 | A kind of mobile terminal and its method and apparatus for realizing man-machine interaction |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106896969A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107831924A (en) * | 2017-11-28 | 2018-03-23 | 信利光电股份有限公司 | A kind of mouse device |
| CN110811282A (en) * | 2018-08-07 | 2020-02-21 | 韩小龙 | Control circuit and control method for rice and soup function |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101355354A (en) * | 2007-07-27 | 2009-01-28 | 乐聱钟表电子有限公司 | Equipment, touch sensor for the equipment and method for manufacturing the sensor |
| CN201274466Y (en) * | 2008-08-15 | 2009-07-15 | 厦门灿坤实业股份有限公司 | Touching control panel for regulating apparatus |
| CN101498976A (en) * | 2008-12-26 | 2009-08-05 | 深圳华为通信技术有限公司 | Touch display unit and its fabrication method and electronic equipment |
| CN102362250A (en) * | 2009-03-25 | 2012-02-22 | 阿尔申蒂斯有限责任公司 | Apparatus and method for determining a touch input |
| CN103257826A (en) * | 2013-05-17 | 2013-08-21 | 广东欧珀移动通信有限公司 | Method and system for mobile terminal to achieve navigation key function based on fingerprint identification |
| CN203338321U (en) * | 2013-07-10 | 2013-12-11 | 京东方科技集团股份有限公司 | Mobile terminal |
| CN204887078U (en) * | 2015-08-03 | 2015-12-16 | 毕育枝 | Intelligent dull and stereotyped cell -phone of supplementary touch screen in area |
| CN106371688A (en) * | 2015-07-22 | 2017-02-01 | 小米科技有限责任公司 | Full-screen single-hand operation method and apparatus |
-
2017
- 2017-02-28 CN CN201710113877.5A patent/CN106896969A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101355354A (en) * | 2007-07-27 | 2009-01-28 | 乐聱钟表电子有限公司 | Equipment, touch sensor for the equipment and method for manufacturing the sensor |
| CN201274466Y (en) * | 2008-08-15 | 2009-07-15 | 厦门灿坤实业股份有限公司 | Touching control panel for regulating apparatus |
| CN101498976A (en) * | 2008-12-26 | 2009-08-05 | 深圳华为通信技术有限公司 | Touch display unit and its fabrication method and electronic equipment |
| CN102362250A (en) * | 2009-03-25 | 2012-02-22 | 阿尔申蒂斯有限责任公司 | Apparatus and method for determining a touch input |
| CN103257826A (en) * | 2013-05-17 | 2013-08-21 | 广东欧珀移动通信有限公司 | Method and system for mobile terminal to achieve navigation key function based on fingerprint identification |
| CN203338321U (en) * | 2013-07-10 | 2013-12-11 | 京东方科技集团股份有限公司 | Mobile terminal |
| CN106371688A (en) * | 2015-07-22 | 2017-02-01 | 小米科技有限责任公司 | Full-screen single-hand operation method and apparatus |
| CN204887078U (en) * | 2015-08-03 | 2015-12-16 | 毕育枝 | Intelligent dull and stereotyped cell -phone of supplementary touch screen in area |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107831924A (en) * | 2017-11-28 | 2018-03-23 | 信利光电股份有限公司 | A kind of mouse device |
| CN110811282A (en) * | 2018-08-07 | 2020-02-21 | 韩小龙 | Control circuit and control method for rice and soup function |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102423826B1 (en) | User termincal device and methods for controlling the user termincal device thereof | |
| WO2020199934A1 (en) | Information processing method and terminal device | |
| CN106657667A (en) | Apparatus and method for lighting display screen | |
| CN105511667A (en) | Back touch control mobile terminal and method based on back pressure transducer | |
| CN107896279A (en) | Screenshotss processing method, device and the mobile terminal of a kind of mobile terminal | |
| CN104423581A (en) | Mobile terminal and controlling method thereof | |
| CN107943390B (en) | Character copying method and mobile terminal | |
| US11886894B2 (en) | Display control method and terminal device for determining a display layout manner of an application | |
| WO2020238408A1 (en) | Application icon display method and terminal | |
| CN111610904B (en) | Icon arrangement method, electronic device and storage medium | |
| US20210200432A1 (en) | Display method and mobile terminal | |
| CN109165033B (en) | Application updating method and mobile terminal | |
| JP2022545202A (en) | Target position adjustment method and electronic device | |
| CN107450872A (en) | A kind of split screen adjusting method, terminal and computer-readable recording medium | |
| US20220321120A1 (en) | Touch button, control method, and electronic device | |
| CN106843642A (en) | The exchange method and mobile terminal of a kind of mobile terminal | |
| WO2020168882A1 (en) | Interface display method and terminal device | |
| KR102511456B1 (en) | Character input method and terminal | |
| CN108696642B (en) | Method for arranging icons and mobile terminal | |
| CN107239184A (en) | A kind of touch screen contactor control device, method and mobile terminal | |
| CN106527685A (en) | Control method and device for terminal application | |
| CN106843716A (en) | A kind of terminal desktop switching control and method | |
| CN106896969A (en) | A kind of mobile terminal and its method and apparatus for realizing man-machine interaction | |
| CN106775375A (en) | A kind of end message editing and processing devices and methods therefor | |
| CN110502169B (en) | Display control method and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170627 |
|
| RJ01 | Rejection of invention patent application after publication |