CN105791558A - Mobile terminal and method thereof for controlling terminal device - Google Patents
Mobile terminal and method thereof for controlling terminal device Download PDFInfo
- Publication number
- CN105791558A CN105791558A CN201610107920.2A CN201610107920A CN105791558A CN 105791558 A CN105791558 A CN 105791558A CN 201610107920 A CN201610107920 A CN 201610107920A CN 105791558 A CN105791558 A CN 105791558A
- Authority
- CN
- China
- Prior art keywords
- information
- finger
- mobile terminal
- unit
- preview image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
- H04M1/72415—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories for remote control of appliances
Abstract
The invention discloses a mobile terminal, comprising: a collection module, used by the mobile terminal for operating a camera and collecting preview image information by the camera; a conversion module, used for converting the preview image information into an operation instruction; and a sending module, used for sending the operation instruction to a terminal device to control the terminal device. The invention further discloses a method for controlling the terminal device. According to the invention, any hardware cost of the mobile terminal does not need to be increased, and based on the existing mobile phone having an automatic focusing camera function, for example, a mobile phone, the operations of a 3D control terminal device can be realized.
Description
Technical field
The present invention relates to communication technical field, particularly relate to a kind of mobile terminal and the method controlling terminal unit thereof.
Background technology
Existing terminal unit is all controlled by remote controller such as television set and air-conditioning, when remote controller is not by the side of, in addition it is also necessary to user first searches out remote controller and is controlled；And for example computer is usually controlled by mouse, but when user uses that computer is full frame sees video, now user distance computer has certain distance, controls operation to adjust volume or other, in addition it is also necessary to first take mouse and be controlled.So, operate cumbersome, especially when terminal unit is more, add burden for users, thus reducing Consumer's Experience.
Foregoing is only used for assisting understanding technical scheme, does not represent and admits that foregoing is prior art.
Summary of the invention
Present invention is primarily targeted at a kind of method mobile terminal being provided and controlling terminal unit, it is intended to gather preview image information by mobile terminal, and be acted upon sending to terminal unit, thus realizing the control to terminal unit.
For achieving the above object, a kind of mobile terminal provided by the invention, mobile terminal includes:
Acquisition module, opens photographic head for mobile terminal, and by described camera collection preview image information；
Conversion module, for being converted into operational order by described preview image information；
Sending module, for sending described operational order to terminal unit, to control described terminal unit.
Preferably, described conversion module includes:
Judging unit, is used for judging whether have finger information in described preview image information；
Indexing unit, if for having, then obtaining the position of finger tips, and finger tips described in labelling be target from described finger information；
Focusing unit, for by target following technology, carrying out target focusing with finger place plane for focal plane, and record relative displacement and the focus data of described target；
Computing unit, for according to described relative displacement and focus data, calculating and obtain object run information；
Conversion unit, for being converted into operational order by described object run information.
Preferably, described conversion module also includes:
Comparing unit, if for having, then with the frequency of predetermined frame number, compares described finger information and default calibration information；
Acquiring unit, for when described finger information is consistent with described default calibration information, obtaining the position of finger tips from described finger information.
Preferably, described conversion module also includes:
Monitoring unit, if for nothing, then continues to monitor in described preview image information whether have finger information, until having finger information in described preview image information.
Preferably, described operational order includes: click, long by, slide or rotate in any one.
Additionally, for achieving the above object, the present invention also provides for a kind of method controlling terminal unit, and the method for described control terminal unit comprises the following steps:
Mobile terminal opens photographic head, and by described camera collection preview image information；
Described preview image information is converted into operational order；
Described operational order is sent to terminal unit, to control described terminal unit.
Preferably, described the step that described preview image information is converted into operational order is included:
Judge whether described preview image information has finger information；
If having, then from described finger information, obtain the position of finger tips, and finger tips described in labelling is target；
By target following technology, carry out target focusing with finger place plane for focal plane, and record relative displacement and the focus data of described target；
According to described relative displacement and focus data, calculate and obtain object run information；
Described object run information is converted into operational order.
Preferably, also include after the described step judging whether to have in described preview image information finger information:
If having, then with the frequency of predetermined frame number, described finger information and default calibration information are compared；
When described finger information is consistent with described default calibration information, from described finger information, obtain the position of finger tips.
Preferably, also include after the described step judging whether to have in described preview image information finger information:
If nothing, then continue to monitor in described preview image information whether have finger information, until described preview image information has finger information.
Preferably, described operational order includes: click, long by, slide or rotate in any one.
Mobile terminal provided by the invention and the method controlling terminal unit thereof, utilize the camera collection preview image information of mobile terminal, and described preview image information is converted into operational order, then described operational order is sent to terminal unit, to control described terminal unit.So, it is not necessary to increase any hardware cost of mobile terminal, based on the mobile terminal such as mobile phone of the camera function currently with auto-focusing, 3D can be realized and control the operation of terminal unit.
Accompanying drawing explanation
Fig. 1 is the hardware architecture diagram of the mobile terminal realizing each embodiment of the present invention；
Fig. 2 is the radio communication device schematic diagram of mobile terminal as shown in Figure 1；
Fig. 3 is the mutual schematic diagram between mobile terminal of the present invention and terminal unit；
Fig. 4 is the high-level schematic functional block diagram of mobile terminal one embodiment of the present invention；
Fig. 5 is the refinement high-level schematic functional block diagram of conversion module first embodiment in Fig. 4；
Fig. 6 is the refinement high-level schematic functional block diagram of conversion module the second embodiment in Fig. 4；
Fig. 7 is the refinement high-level schematic functional block diagram of conversion module the 3rd embodiment in Fig. 4；
Fig. 8 is the schematic flow sheet that the present invention controls method one embodiment of terminal unit；
Fig. 9 is the refinement schematic flow sheet that in Fig. 8, described preview image information is converted into operational order first embodiment by step；
Figure 10 is the refinement schematic flow sheet that in Fig. 8, described preview image information is converted into operational order the second embodiment by step；
Figure 11 is the refinement schematic flow sheet that in Fig. 8, described preview image information is converted into operational order the 3rd embodiment by step.
The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, are described further with reference to accompanying drawing.
Detailed description of the invention
Should be appreciated that specific embodiment described herein is only in order to explain the present invention, is not intended to limit the present invention.
The mobile terminal realizing each embodiment of the present invention is described referring now to accompanying drawing.In follow-up description, use the suffix being used for representing such as " module ", " parts " or " unit " of element only for being conducive to the explanation of the present invention, itself do not have specific meaning.Therefore, " module " and " parts " can mixedly use.
Mobile terminal can be implemented in a variety of manners.Such as, the terminal described in the present invention can include the mobile terminal of such as mobile phone, smart phone, notebook computer, digit broadcasting receiver, PDA (personal digital assistant), PAD (panel computer), PMP (portable media player), guider etc. and the fixed terminal of such as numeral TV, desk computer etc..Hereinafter it is assumed that terminal is mobile terminal.However, it will be understood by those skilled in the art that, except being used in particular for the element of mobile purpose, structure according to the embodiment of the present invention can also apply to the terminal of fixed type.
Fig. 1 is the hardware configuration signal of the mobile terminal realizing each embodiment of the present invention.
Mobile terminal 100 can include wireless communication unit 110, A/V (audio/video) input block 120, user input unit 130, sensing unit 140, output unit 150, memorizer 160, interface unit 170, controller 180 etc..Fig. 1 illustrates the mobile terminal with various assembly, it should be understood that be not required for implementing all assemblies illustrated.Can alternatively implement more or less of assembly.Will be discussed in more detail below the element of mobile terminal.
Wireless communication unit 110 generally includes one or more assembly, and it allows the radio communication between mobile terminal 100 and radio communication device or network.Such as, wireless communication unit can include at least one in mobile communication module 111, wireless Internet module 112, short range communication module 113 and positional information module 114.
Mobile communication module 111 sends radio signals at least one in base station (such as, access point, node B etc.), exterior terminal and server and/or receives from it radio signal.Such radio signal can include voice call signal, video calling signal or the various types of data sending according to text and/or Multimedia Message and/or receiving.
Wireless Internet module 112 supports the Wi-Fi (Wireless Internet Access) of mobile terminal.This module can internally or externally be couple to terminal.Wi-Fi (Wireless Internet Access) technology involved by this module can include WLAN (WLAN) (Wi-Fi), Wibro (WiMAX), Wimax (worldwide interoperability for microwave access), HSDPA (high-speed downlink packet access) etc..
Short range communication module 113 is the module for supporting junction service.Some examples of short-range communication technology include bluetoothTM, RF identification (RFID), Infrared Data Association (IrDA), ultra broadband (UWB), purple honeybeeTMEtc..
Positional information module 114 is the module of positional information for checking or obtain mobile terminal.The typical case of positional information module is GPS (global pick device).According to current technology, GPS module 114 calculates from the range information of three or more satellites and correct time information and the Information application triangulation for calculating, thus according to longitude, latitude with highly accurately calculate three-dimensional current location information.Currently, the method for calculating position and temporal information uses three satellites and the error by the position using an other satellite correction to calculate and temporal information.Additionally, GPS module 114 can calculate velocity information by Continuous plus current location information in real time.
A/V input block 120 is used for receiving audio or video signal.A/V input block 120 can include camera 121 and mike 122, and the view data of the camera 121 static images to being obtained by image capture apparatus in Video Capture pattern or image capture mode or video processes.Picture frame after process may be displayed on display unit 151.Picture frame after camera 121 processes can be stored in memorizer 160 (or other storage medium) or be transmitted via wireless communication unit 110, it is possible to provide two or more cameras 121 according to the structure of mobile terminal.Such acoustic processing can via microphones sound (voice data) in telephone calling model, logging mode, speech recognition mode etc. operational mode, and can be voice data by mike 122.Audio frequency (voice) data after process can be converted to the form output that can be sent to mobile communication base station via mobile communication module 111 when telephone calling model.Mike 122 can implement various types of noise elimination (or suppression) algorithm to eliminate (or suppression) in the noise received and produce in the process of transmission audio signal or interference.
User input unit 130 can generate key input data to control the various operations of mobile terminal according to the order of user's input.User input unit 130 allows user to input various types of information, and can include keyboard, metal dome, touch pad (such as, detection due to touched and cause resistance, pressure, electric capacity etc. the sensitive component of change), roller, rocking bar etc..Especially, when touch pad is superimposed upon on display unit 151 as a layer, it is possible to form touch screen.
Sensing unit 140 detects the current state of mobile terminal 100, (such as, mobile terminal 100 open or close state), the position of mobile terminal 100, user for mobile terminal 100 contact (namely, touch input) presence or absence, the orientation of mobile terminal 100, the acceleration of mobile terminal 100 or speed is moved and direction etc., and generate order or the signal of operation for controlling mobile terminal 100.Such as, when mobile terminal 100 is embodied as sliding-type mobile phone, sensing unit 140 can sense this sliding-type phone and open or close.It addition, sensing unit 140 can detect power subsystem 190 and whether provide whether electric power or interface unit 170 couple with external device (ED).Sensing unit 140 can include proximity transducer 1410 and below in conjunction with touch screen, this will be described.
Interface unit 170 is used as at least one external device (ED) and is connected, with mobile terminal 100, the interface that can pass through.Such as, external device (ED) can include wired or wireless head-band earphone port, external power source (or battery charger) port, wired or wireless FPDP, memory card port, for connecting the port of the device with identification module, audio frequency input/output (I/O) port, video i/o port, ear port etc..Identification module can be that storage is for verifying that user uses the various information of mobile terminal 100 and can include subscriber identification module (UIM), client identification module (SIM), Universal Subscriber identification module (USIM) etc..It addition, the device (hereinafter referred to " identification device ") with identification module can take the form of smart card, therefore, identify that device can be connected with mobile terminal 100 via port or other connecting device.Interface unit 170 may be used for receiving from the input (such as, data message, electric power etc.) of external device (ED) and the one or more elements being transferred in mobile terminal 100 by the input received or may be used for transmission data between mobile terminal and external device (ED).
Additionally, when mobile terminal 100 is connected with external base, interface unit 170 can serve as and allows to provide the path of mobile terminal 100 or can serve as to allow to be transferred to the path of mobile terminal from the various command signals of base input by it from base electric power by it.May serve as whether identification mobile terminal is accurately fitted within the signal base from the various command signals of base input or electric power.Output unit 150 is configured to provide output signal (such as, audio signal, video signal, alarm signal, vibration signal etc.) with vision, audio frequency and/or tactile manner.Output unit 150 can include display unit 151, dio Output Modules 152, alarm unit 153 etc..
Display unit 151 may be displayed on the information processed in mobile terminal 100.Such as, when mobile terminal 100 is in telephone calling model, display unit 151 can show the user interface (UI) relevant with call or other communicate (such as, text messaging, multimedia file download etc.) or graphic user interface (GUI).When being in video calling pattern or image capture mode when mobile terminal 100, display unit 151 can show the image of image and/or the reception caught, UI or GUI illustrating video or image and correlation function etc..
Meanwhile, when display unit 151 and touch pad as a layer superposed on one another to form touch screen time, display unit 151 can serve as input equipment and output device.Display unit 151 can include at least one in liquid crystal display (LCD), thin film transistor (TFT) LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexible display, three-dimensional (3D) display etc..Some in these display may be constructed such that transparence is to allow user to watch from outside, and this is properly termed as transparent display, and typical transparent display can be such as TOLED (transparent organic light emitting diode) display etc..According to the specific embodiment wanted, mobile terminal 100 can include two or more display units (or other display device), such as, mobile terminal can include outernal display unit (not shown) and inner display unit (not shown).Touch screen can be used for detecting touch input pressure and touch input position and touch input area.
Dio Output Modules 152 can mobile terminal be in call signal receive under the isotype such as pattern, call mode, logging mode, speech recognition mode, broadcast reception mode time, that wireless communication unit 110 is received or storage in memorizer 160 voice data transducing audio signal and be output as sound.And, dio Output Modules 152 can provide the audio frequency output (such as, call signal receive sound, message sink sound etc.) relevant to the specific function of mobile terminal 100 execution.Dio Output Modules 152 can include pick up, buzzer etc..
Alarm unit 153 can provide output so that event to inform mobile terminal 100.Typical event can include calling reception, message sink, key signals input, touch input etc..Except audio or video exports, alarm unit 153 can provide in a different manner and export the generation with notification event.Such as, alarm unit 153 can provide output with the form of vibration, when receiving calling, message or some other entrance communication (incomingcommunication), alarm unit 153 can provide sense of touch output (that is, vibration) to notify to user.By providing such sense of touch to export, even if when the mobile phone of user is in the pocket of user, user also is able to identify the generation of various event.Alarm unit 153 can also provide the output of the generation of notification event via display unit 151 or dio Output Modules 152.
Memorizer 160 can store the process performed by controller 180 and the software program controlling operation etc., or can temporarily store the data (such as, telephone directory, message, still image, video etc.) that oneself maybe will export through output.And, memorizer 160 can store the vibration about the various modes exported when touching and being applied to touch screen and the data of audio signal.
Memorizer 160 can include the storage medium of at least one type, described storage medium includes flash memory, hard disk, multimedia card, card-type memorizer (such as, SD or DX memorizer etc.), random access storage device (RAM), static random-access memory (SRAM), read only memory (ROM), Electrically Erasable Read Only Memory (EEPROM), programmable read only memory (PROM), magnetic storage, disk, CD etc..And, mobile terminal 100 can be connected the network storage device cooperation of the storage function performing memorizer 160 with by network.
Controller 180 generally controls the overall operation of mobile terminal.Such as, controller 180 performs the control relevant to voice call, data communication, video calling etc. and process.It addition, controller 180 can include the multi-media module 181 for reproducing (or playback) multi-medium data, multi-media module 181 can construct in controller 180, or it is so structured that separates with controller 180.Controller 180 can perform pattern recognition process, so that the handwriting input performed on the touchscreen or picture drafting input are identified as character or image.
Various embodiment described herein can to use such as computer software, hardware or its any combination of computer-readable medium to implement.Hardware is implemented, embodiment described herein can pass through to use application-specific IC (ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), processor, controller, microcontroller, microprocessor, at least one that is designed to perform in the electronic unit of function described herein to implement, in some cases, such embodiment can be implemented in controller 180.Implementing for software, the embodiment of such as process or function can be implemented with allowing the independent software module performing at least one function or operation.Software code can be implemented by the software application (or program) write with any suitable programming language, and software code can be stored in memorizer 160 and be performed by controller 180.
So far, mobile terminal is described according to its function.Below, for the sake of brevity, by the slide type mobile terminal in the various types of mobile terminals describing such as folded form, board-type, oscillating-type, slide type mobile terminal etc. exemplarily.Therefore, the present invention can be applied to any kind of mobile terminal, and is not limited to slide type mobile terminal.
With reference to the electrical structure block diagram that Fig. 2, Fig. 2 are camera in Fig. 1.
Photographic lens 1211 is made up of the multiple optical lens being used for being formed shot object image, for single-focus lens or zoom lens.Photographic lens 1211 can move in the direction of the optical axis under the control of lens driver 1221, lens driver 1221 is according to the control signal from lens driving control circuit 1222, control the focal position of photographic lens 1211, when zoom lens, it is possible to control focal length.The driving that lens driving control circuit 1222 carries out lens driver 1221 according to the control command from microcomputer 1217 controls.
Imaging apparatus 1212 it is configured with near the position of the shot object image formed on the optical axis of photographic lens 1211, by photographic lens 1211.Imaging apparatus 1212 is for imaging shot object image and obtaining image data.On imaging apparatus 1212 two dimension and be arranged in a matrix the photodiode constituting each pixel.Each photodiode produces the opto-electronic conversion electric current corresponding with light income, and this opto-electronic conversion electric current is carried out charge accumulation by the capacitor being connected with each photodiode.The front surface of each pixel is configured with the RGB color filter of Bayer arrangement.
Imaging apparatus 1212 is connected with imaging circuit 1213, this imaging circuit 1213 carries out charge accumulation in imaging apparatus 1212 and controls and picture signal reading control, the picture signal (analog picture signal) of this reading is reduced and resets the laggard row waveform shaping of noise, and then carry out gain raising etc. to become suitable signal level.
Imaging circuit 1213 is connected with A/D converter 1214, and analog picture signal is carried out analog digital conversion by this A/D converter 1214, to bus 1227 output digital image signal (hereinafter referred to as view data).
Bus 1227 is the transmission path for being transmitted in the various data that the inside of camera reads or generates.It is connected to above-mentioned A/D converter 1214 in bus 1227, additionally it is connected to image processor 1215, jpeg processor 1216, microcomputer 1217, SDRAM (SynchronousDynamicrandomaccessmemory, SDRAM (Synchronous dynamic random access memory)) 1218, memory interface (hereinafter referred to as memory I/F) 1219, LCD (LiquidCrystalDisplay, liquid crystal display) driver 1220.
The view data of the output based on imaging apparatus 1212 is carried out OB and subtracts each other the various image procossing such as process, blank level adjustment, color matrix computing, gamma conversion, colour difference signal process, noise removal process, change process simultaneously, edge treated by image processor 1215.Jpeg processor 1216, when by Imagery Data Recording in record medium 1225, compresses from the SDRAM1218 view data read according to JPEG compression mode.Additionally, jpeg processor 1216 carries out the decompression of jpeg image data to carry out image reproducing to show.When decompressing, read record file in record medium 1225, after implementing decompression in jpeg processor 1216, the view data of decompression is temporarily stored in SDRAM1218 and displays on LCD1226.H.264 it addition, in the present embodiment, what decompress that mode adopts as compression of images is JPEG mode, but compressed and decompressed mode is not limited to this, it is of course possible to adopt MPEG, TIFF, other the compressed and decompressed mode such as.
Microcomputer 1217 plays the function in the control portion overall as this camera, is uniformly controlled the various process sequences of camera.Microcomputer 1217 is connected to operating unit 1223 and flash memory 1224.
Operating unit 1223 includes but not limited to physical button or virtual key, this entity or virtual key can be the operational controls such as various load buttons and various input keys such as power knob, key of taking pictures, edit key, dynamic image button, reproduction button, menu button, cross key, OK button, deletion button, large buttons, detect the mode of operation of these operational controls.
Testing result is exported to microcomputer 1217.Additionally, the front surface at the LCD1226 as display is provided with touch panel, the touch location of detection user, this touch location is exported to microcomputer 1217.The microcomputer 1217 testing result according to the operating position from operating unit 1223, performs the various process sequences corresponding with the operation of user.
Flash memory 1224 storage is for performing the program of the various process sequences of microcomputer 1217.Microcomputer 1217 carries out, according to this program, the control that camera is overall.Additionally, flash memory 1224 stores the various adjusted values of camera, microcomputer 1217 reads adjusted value, carries out the control of camera according to this adjusted value.
SDRAM1218 is can the volatile memory rewritten of electricity for what view data etc. carried out temporarily storage.This SDRAM1218 temporarily stores the view data from A/D converter 1214 output and has carried out the view data after processing image processor 1215, jpeg processor 1216 etc..
Memory interface 1219 is connected with record medium 1225, carries out view data and the first-class data write of file being attached in view data are recorded medium 1225 and the control read from record medium 1225.Record medium 1225 be such as the memory card of disassembled and assembled freely etc. can record medium on camera main-body, but is not limited to this, it is also possible to be the hard disk etc. being built in camera main-body.
Lcd driver 1210 is connected with LCD1226, view data after being processed by image processor 1215 is stored in SDRAM1218, when needing to show, read the view data of SDRAM1218 storage and show on LCD1226, or, the compressed view data of jpeg processor 1216 is stored in SDRAM1218, when needs show, jpeg processor 1216 reads the compressed view data of SDRAM1218, then decompresses, and the view data after decompressing is displayed by LCD1226.
LCD1226 is arranged in the back side of camera main-body to carry out image and shows.This LCD1226LCD), but it is not limited to this, it would however also be possible to employ the various display floater such as organic EL (LCD1226), but it is not limited to this, it would however also be possible to employ the various display floater such as organic EL.
Based on above-mentioned mobile terminal hardware configuration and communication system, it is proposed to each embodiment of the present invention.
The present invention provides a kind of mobile terminal 1, and with reference to Fig. 3 and Fig. 4, in the present embodiment, described mobile terminal 1 includes:
Acquisition module 10, opens photographic head for mobile terminal, and by described camera collection preview image information；
In the present embodiment, described mobile terminal can be the radio transmission apparatus with camera function, is chosen as mobile phone, panel computer, notebook computer etc..Certainly, in other embodiments, it is also possible to for having the fixed terminal equipment of camera function.
In the present embodiment, for mobile phone, using mobile phone as collection terminal, by opening camera collection preview image information, and be acted upon being converted into operational order, then described operational order is sent to terminal unit with wifi, focus, bluetooth, the radio connection such as infrared, and then controls described terminal unit, thus realizing controlling terminal unit every empty 3D operation.
In the present embodiment, described photographic head can be built in described mobile terminal, it is also possible to external with described mobile terminal.Described preview image information is photographic head Real-time Collection or the user's finger-image information gathered with preset frequency, it is possible to display on the screen of the mobile terminal.Certainly, in other embodiments, it is possible in conjunction with information such as user's head portrait and/or voices.
When mobile terminal opens photographic head, user can adjust the position of described photographic head so that the finger of user can complete presenting in the display screen of mobile terminal.For obtaining preview image information satisfactory for result, it is possible to the finger of user is positioned on the object of horizontal table top or other planes, it is of course also possible to finger is placed in space without by other objects.
Conversion module 20, for being converted into operational order by described preview image information；
In the first embodiment, with finger tips for target, by target following technology, identify gesture and be converted to operational order.Described operational order includes: click, long by, slide or rotate in any one or more combination.Click includes clicking and the mode such as double-click；When finger pin time of a certain position exceed Preset Time such as more than 2S then for long by, when the position of finger exists relative displacement, then for sliding；Pin a certain position when finger and exceed Preset Time, and when there is angle change, then for rotating.
In a second embodiment, with palm for target, by target following technology, identify gesture and be converted to operational order.Described operational order includes: click, long by, slide or any one or more combination in rotation etc..Click includes clicking and the mode such as double-click, when palm bends rapidly to side and reduces, then for clicking, when palm double rapid bending reducing to side, then for double-clicking, or, both hands are clapped the hands once for clicking, and both hands clap the hands twice for double-click；When palm be parked in time of a certain position exceed Preset Time such as more than 2S then for long by, when the position of palm exists relative displacement, then for sliding；Preset Time is exceeded when palm is parked in a certain position, and when there is angle change, then for rotating.It is understood that described operational order can rationally be arranged according to actual needs, it is possible to arranged by User Defined.
Sending module 30, for sending described operational order to terminal unit, to control described terminal unit.
In the present embodiment, described terminal unit can be the equipment such as computer, TV, air-conditioning, described operational order is sent to terminal unit by mobile terminal by radio connection, the operational order received is converted by described terminal unit, Corresponding matching is to current mouse or cursor position, or match the operation (for computer) of full page, or match the operation (for TV or air-conditioning) of direction key, thus complete 3D to control operation.
Mobile terminal provided by the invention, utilizes camera collection preview image information, and described preview image information is converted into operational order, then sends described operational order to terminal unit, to control described terminal unit.So, it is not necessary to increase any hardware cost of mobile terminal, based on the mobile terminal such as mobile phone of the camera function currently with auto-focusing, 3D can be realized and control the operation of terminal unit.
In one embodiment, as it is shown in figure 5, on the basis of above-mentioned Fig. 4 embodiment, described conversion module 20 includes:
Judging unit 201, is used for judging whether have finger information in described preview image information；
Indexing unit 202, if for having, then obtaining the position of finger tips, and finger tips described in labelling be target from described finger information；
In the present embodiment, mobile terminal, with finger information for reference, by judging whether have finger information in preview image information, obtains operational order further.Certainly, in other embodiments, it is possible to for palm, headwork, action nictation and voice etc..When preview image information has finger information, from described finger information, obtain the position of finger tips, and finger tips described in labelling is target.Wherein, described finger information includes the parameter such as finger position and shape.
By target following technology, the position of real-time tracking finger tips when finger tips has shift in position, specifically can be divided into following two situation:
1, when finger quantity is 1, by distinguishing the actions such as relative position and focusing information differentiating click, slip, the rotation of finger tips, and the action that will identify that is converted into operational order and is sent to terminal unit；
2, when finger quantity is more than 1, then requiring over the relative position judging between finger, the overall displacements direction in conjunction with all fingers end judges action, and the action that will identify that is converted into operational order and is sent to terminal unit.This kind of situation, action includes referring to reduce, refer to amplify, refer to slip etc. more more more.
Focusing unit 203, for by target following technology, carrying out target focusing with finger place plane for focal plane, and record relative displacement and the focus data of described target；
Computing unit 204, for according to described relative displacement and focus data, calculating and obtain object run information；
Conversion unit 205, for being converted into operational order by described object run information.
In the present embodiment, when mobile terminal recognizes finger information, and labelling finger tips is when being target, by target following technology, persistent goal focusing is carried out for focal plane with finger place plane, and record relative displacement and the focus data of described target, and then calculate according to described relative displacement and focus data and obtain object run information, finally described object run information being converted into can by the operational order of terminal unit identification.
In one embodiment, as shown in Figure 6, on the basis of above-mentioned Fig. 5 embodiment, described conversion module 20 also includes:
Comparing unit 206, if for having, then with the frequency of predetermined frame number, compares described finger information and default calibration information；
In the present embodiment, it is possible to each frame image information and default calibration information are compared, it is also possible to every frame numbers such as two frames or three frames, preview image information and default calibration information are compared.Wherein, default calibration information can be the user's finger information that shoot in advance and preserve, the information such as including the relative position between single finger-type shape or many finger-types shape, many fingers.
Acquiring unit 207, for when described finger information is consistent with described default calibration information, obtaining the position of finger tips from described finger information.
In the present embodiment, when described finger information is consistent with described default calibration information, it was shown that now operator is user or the operator of user's permission, now can obtain the position of finger tips from described finger information.As such, it is possible to prevent other people from the unlicensed of terminal unit is controlled operation.
In one embodiment, as it is shown in fig. 7, on the basis of above-mentioned Fig. 5 embodiment, described conversion module 20 also includes:
Monitoring unit 208, if for nothing, then continues to monitor in described preview image information whether have finger information, until having finger information in described preview image information.
In the present embodiment, mobile terminal, with finger information for reference, by judging whether have finger information in preview image information, obtains operational order further.When mobile terminal judges do not have described preview image information in described preview image information, then can continue whether monitoring preview image information has finger information, until described preview image information has finger information.Now, in monitoring process, mobile terminal does not send any instruction to terminal unit.
It is understood that described terminal unit can receive real-time control instruction by connecting mobile terminal in real time, and the different operating instruction sent from mobile terminal is converted to concrete operation, to control such as mouse, cursor, and other controllable pair as etc..
As shown in Figure 8, the present invention also proposes a kind of method controlling terminal unit, and in one embodiment, the method for described control terminal unit comprises the following steps:
Step S10, mobile terminal opens photographic head, and by described camera collection preview image information；
In the present embodiment, described mobile terminal can be the radio transmission apparatus with camera function, is chosen as mobile phone, panel computer, notebook computer etc..Certainly, in other embodiments, it is also possible to for having the fixed terminal equipment of camera function.
In the present embodiment, for mobile phone, using mobile phone as collection terminal, by opening camera collection preview image information, and be acted upon being converted into operational order, then described operational order is sent to terminal unit with wifi, focus, bluetooth, the radio connection such as infrared, and then controls described terminal unit, thus realizing controlling terminal unit every empty 3D operation.
In the present embodiment, described photographic head can be built in described mobile terminal, it is also possible to external with described mobile terminal.Described preview image information is photographic head Real-time Collection or the user's finger-image information gathered with preset frequency, it is possible to display on the screen of the mobile terminal.Certainly, in other embodiments, it is possible in conjunction with information such as user's head portrait and/or voices.
When mobile terminal opens photographic head, user can adjust the position of described photographic head so that the finger of user can complete presenting in the display screen of mobile terminal.For obtaining preview image information satisfactory for result, it is possible to the finger of user is positioned on the object of horizontal table top or other planes, it is of course also possible to finger is placed in space without by other objects.
Step S20, is converted into operational order by described preview image information；
In the first embodiment, with finger tips for target, by target following technology, identify gesture and be converted to operational order.Described operational order includes: click, long by, slide or rotate in any one or more combination.Click includes clicking and the mode such as double-click；When finger pin time of a certain position exceed Preset Time such as more than 2S then for long by, when the position of finger exists relative displacement, then for sliding；Pin a certain position when finger and exceed Preset Time, and when there is angle change, then for rotating.
In a second embodiment, with palm for target, by target following technology, identify gesture and be converted to operational order.Described operational order includes: click, long by, slide or any one or more combination in rotation etc..Click includes clicking and the mode such as double-click, when palm bends rapidly to side and reduces, then for clicking, when palm double rapid bending reducing to side, then for double-clicking, or, both hands are clapped the hands once for clicking, and both hands clap the hands twice for double-click；When palm be parked in time of a certain position exceed Preset Time such as more than 2S then for long by, when the position of palm exists relative displacement, then for sliding；Preset Time is exceeded when palm is parked in a certain position, and when there is angle change, then for rotating.It is understood that described operational order can rationally be arranged according to actual needs, it is possible to arranged by User Defined.
Step S30, sends described operational order to terminal unit, to control described terminal unit.
In the present embodiment, described terminal unit can be the equipment such as computer, TV, air-conditioning, described operational order is sent to terminal unit by mobile terminal by radio connection, the operational order received is converted by described terminal unit, Corresponding matching is to current mouse or cursor position, or match the operation (for computer) of full page, or match the operation (for TV or air-conditioning) of direction key, thus complete 3D to control operation.
The method of control terminal unit provided by the invention, utilizes the camera collection preview image information of mobile terminal, and described preview image information is converted into operational order, then sends described operational order to terminal unit, to control described terminal unit.So, it is not necessary to increase any hardware cost of mobile terminal, based on the mobile terminal such as mobile phone of the camera function currently with auto-focusing, 3D can be realized and control the operation of terminal unit.
In one embodiment, as it is shown in figure 9, on the basis of above-mentioned Fig. 8 embodiment, described step S20 includes:
Step S201, it is judged that whether have finger information in described preview image information；
Step S202, if having, then obtains the position of finger tips from described finger information, and finger tips described in labelling is target；
In the present embodiment, mobile terminal, with finger information for reference, by judging whether have finger information in preview image information, obtains operational order further.Certainly, in other embodiments, it is possible to for palm, headwork, action nictation and voice etc..When preview image information has finger information, from described finger information, obtain the position of finger tips, and finger tips described in labelling is target.Wherein, described finger information includes the parameter such as finger position and shape.
By target following technology, the position of real-time tracking finger tips when finger tips has shift in position, specifically can be divided into following two situation:
1, when finger quantity is 1, by distinguishing the actions such as relative position and focusing information differentiating click, slip, the rotation of finger tips, and the action that will identify that is converted into operational order and is sent to terminal unit；
2, when finger quantity is more than 1, then requiring over the relative position judging between finger, the overall displacements direction in conjunction with all fingers end judges action, and the action that will identify that is converted into operational order and is sent to terminal unit.This kind of situation, action includes referring to reduce, refer to amplify, refer to slip etc. more more more.
Step S203, by target following technology, carries out target focusing with finger place plane for focal plane, and records relative displacement and the focus data of described target；
Step S204, according to described relative displacement and focus data, calculates and obtains object run information；
Step S205, is converted into operational order by described object run information.
In the present embodiment, when mobile terminal recognizes finger information, and labelling finger tips is when being target, by target following technology, persistent goal focusing is carried out for focal plane with finger place plane, and record relative displacement and the focus data of described target, and then calculate according to described relative displacement and focus data and obtain object run information, finally described object run information being converted into can by the operational order of terminal unit identification.
In one embodiment, as shown in Figure 10, on the basis of above-mentioned Fig. 9 embodiment, also include after described step S201:
Step S206, if having, then with the frequency of predetermined frame number, compares described finger information and default calibration information；
In the present embodiment, it is possible to each frame image information and default calibration information are compared, it is also possible to every frame numbers such as two frames or three frames, preview image information and default calibration information are compared.Wherein, default calibration information can be the user's finger information that shoot in advance and preserve, the information such as including the relative position between single finger-type shape or many finger-types shape, many fingers.
Step S207, when described finger information is consistent with described default calibration information, obtains the position of finger tips from described finger information.
In the present embodiment, when described finger information is consistent with described default calibration information, it was shown that now operator is user or the operator of user's permission, now can obtain the position of finger tips from described finger information.As such, it is possible to prevent other people from the unlicensed of terminal unit is controlled operation.
In one embodiment, as shown in figure 11, on the basis of above-mentioned Fig. 9 embodiment, also include after described step S201:
Step S208, if nothing, then continues to monitor in described preview image information whether have finger information, until having finger information in described preview image information.
In the present embodiment, mobile terminal, with finger information for reference, by judging whether have finger information in preview image information, obtains operational order further.When mobile terminal judges do not have described preview image information in described preview image information, then can continue whether monitoring preview image information has finger information, until described preview image information has finger information.Now, in monitoring process, mobile terminal does not send any instruction to terminal unit.
It is understood that described terminal unit can receive real-time control instruction by connecting mobile terminal in real time, and the different operating instruction sent from mobile terminal is converted to concrete operation, to control such as mouse, cursor, and other controllable pair as etc..
It should be noted that, in this article, term " includes ", " comprising " or its any other variant are intended to comprising of nonexcludability, so that include the process of a series of key element, method, article or device not only include those key elements, but also include other key elements being not expressly set out, or also include the key element intrinsic for this process, method, article or device.When there is no more restriction, statement " including ... " key element limited, it is not excluded that there is also other identical element in including the process of this key element, method, article or device.
The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.
Through the above description of the embodiments, those skilled in the art is it can be understood that can add the mode of required general hardware platform by software to above-described embodiment method and realize, hardware can certainly be passed through, but in a lot of situation, the former is embodiment more preferably.Based on such understanding, the part that prior art is contributed by technical scheme substantially in other words can embody with the form of software product, this computer software product is stored in a storage medium (such as ROM/RAM, magnetic disc, CD), including some instructions with so that a station terminal equipment (can be mobile phone, computer, server, air-conditioner, or the network equipment etc.) perform the method described in each embodiment of the present invention.
These are only the preferred embodiments of the present invention; not thereby the scope of the claims of the present invention is limited; every equivalent structure utilizing description of the present invention and accompanying drawing content to make or equivalence flow process conversion; or directly or indirectly it is used in other relevant technical fields, all in like manner include in the scope of patent protection of the present invention.
Claims (10)
1. a mobile terminal, it is characterised in that described mobile terminal includes:
Acquisition module, opens photographic head for mobile terminal, and by described camera collection preview image information；
Conversion module, for being converted into operational order by described preview image information；
Sending module, for sending described operational order to terminal unit, to control described terminal unit.
2. mobile terminal as claimed in claim 1, it is characterised in that described conversion module includes:
Judging unit, is used for judging whether have finger information in described preview image information；
Indexing unit, if for having, then obtaining the position of finger tips, and finger tips described in labelling be target from described finger information；
Focusing unit, for by target following technology, carrying out target focusing with finger place plane for focal plane, and record relative displacement and the focus data of described target；
Computing unit, for according to described relative displacement and focus data, calculating and obtain object run information；
Conversion unit, for being converted into operational order by described object run information.
3. mobile terminal as claimed in claim 2, it is characterised in that described conversion module also includes:
Comparing unit, if for having, then with the frequency of predetermined frame number, compares described finger information and default calibration information；
Acquiring unit, for when described finger information is consistent with described default calibration information, obtaining the position of finger tips from described finger information.
4. mobile terminal as claimed in claim 2, it is characterised in that described conversion module also includes:
Monitoring unit, if for nothing, then continues to monitor in described preview image information whether have finger information, until having finger information in described preview image information.
5. mobile terminal as claimed in claim 1, it is characterised in that described operational order includes: click, long by, slide or rotate in any one.
6. the method controlling terminal unit, it is characterised in that the method for described control terminal unit comprises the following steps:
Mobile terminal opens photographic head, and by described camera collection preview image information；
Described preview image information is converted into operational order；
Described operational order is sent to terminal unit, to control described terminal unit.
7. the as claimed in claim 6 method controlling terminal unit, it is characterised in that described the step that described preview image information is converted into operational order is included:
Judge whether described preview image information has finger information；
If having, then from described finger information, obtain the position of finger tips, and finger tips described in labelling is target；
By target following technology, carry out target focusing with finger place plane for focal plane, and record relative displacement and the focus data of described target；
According to described relative displacement and focus data, calculate and obtain object run information；
Described object run information is converted into operational order.
8. the as claimed in claim 7 method controlling terminal unit, it is characterised in that also include after the described step judging whether to have in described preview image information finger information:
If having, then with the frequency of predetermined frame number, described finger information and default calibration information are compared；
When described finger information is consistent with described default calibration information, from described finger information, obtain the position of finger tips.
9. the as claimed in claim 7 method controlling terminal unit, it is characterised in that also include after the described step judging whether to have in described preview image information finger information:
If nothing, then continue to monitor in described preview image information whether have finger information, until described preview image information has finger information.
10. the as claimed in claim 6 method controlling terminal unit, it is characterised in that described operational order includes: click, long by, slide or rotate in any one.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610107920.2A CN105791558A (en) | 2016-02-26 | 2016-02-26 | Mobile terminal and method thereof for controlling terminal device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610107920.2A CN105791558A (en) | 2016-02-26 | 2016-02-26 | Mobile terminal and method thereof for controlling terminal device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105791558A true CN105791558A (en) | 2016-07-20 |
Family
ID=56403844
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610107920.2A Pending CN105791558A (en) | 2016-02-26 | 2016-02-26 | Mobile terminal and method thereof for controlling terminal device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105791558A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106453872A (en) * | 2016-09-28 | 2017-02-22 | 北京小米移动软件有限公司 | Display control method and device |
| CN109507895A (en) * | 2018-08-28 | 2019-03-22 | 中国银联股份有限公司 | Based on interactive control equipment and interaction control method |
| CN111383345A (en) * | 2018-12-29 | 2020-07-07 | 广东虚拟现实科技有限公司 | Virtual content display method and device, terminal equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101930282A (en) * | 2009-06-27 | 2010-12-29 | 英华达(上海)电子有限公司 | Mobile terminal and mobile terminal-based input method |
| CN103309439A (en) * | 2012-03-15 | 2013-09-18 | 欧姆龙株式会社 | Gesture recognition apparatus, electronic device, and gesture recognition method |
| CN103780761A (en) * | 2014-01-23 | 2014-05-07 | 深圳市欧珀通信软件有限公司 | Infrared equipment control method and device |
-
2016
- 2016-02-26 CN CN201610107920.2A patent/CN105791558A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101930282A (en) * | 2009-06-27 | 2010-12-29 | 英华达(上海)电子有限公司 | Mobile terminal and mobile terminal-based input method |
| CN103309439A (en) * | 2012-03-15 | 2013-09-18 | 欧姆龙株式会社 | Gesture recognition apparatus, electronic device, and gesture recognition method |
| CN103780761A (en) * | 2014-01-23 | 2014-05-07 | 深圳市欧珀通信软件有限公司 | Infrared equipment control method and device |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106453872A (en) * | 2016-09-28 | 2017-02-22 | 北京小米移动软件有限公司 | Display control method and device |
| CN109507895A (en) * | 2018-08-28 | 2019-03-22 | 中国银联股份有限公司 | Based on interactive control equipment and interaction control method |
| CN111383345A (en) * | 2018-12-29 | 2020-07-07 | 广东虚拟现实科技有限公司 | Virtual content display method and device, terminal equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11516381B2 (en) | Display device and operating method thereof with adjustments related to an image display according to bending motion of the display device | |
| CN105100609A (en) | Mobile terminal and shooting parameter adjusting method | |
| CN105578056A (en) | Photographing terminal and method | |
| CN105100481A (en) | Shooting method and apparatus, and mobile terminal | |
| CN104902185B (en) | Image pickup method and device | |
| CN105262951A (en) | Mobile terminal having binocular camera and photographing method | |
| US20150296317A1 (en) | Electronic device and recording method thereof | |
| CN105704369B (en) | A kind of information processing method and device, electronic equipment | |
| CN105120164B (en) | The processing means of continuous photo and method | |
| CN105681894A (en) | Device and method for displaying video file | |
| CN104639837A (en) | Method and device for setting shooting parameters | |
| CN105335458A (en) | Picture previewing method and apparatus | |
| CN105357444B (en) | focusing method and device | |
| CN105763811A (en) | Shooting control device and method | |
| CN105163035A (en) | Mobile terminal shooting system and mobile terminal shooting method | |
| CN108156374A (en) | A kind of image processing method, terminal and readable storage medium storing program for executing | |
| CN104822099A (en) | Video packaging method and mobile terminal | |
| CN104991731A (en) | Photographic method, apparatus and mobile terminal | |
| CN105407275B (en) | Photo synthesizer and method | |
| CN104751488A (en) | Photographing method for moving track of moving object and terminal equipment | |
| CN105791558A (en) | Mobile terminal and method thereof for controlling terminal device | |
| CN105430259A (en) | Pressure control focusing shooting device, pressure control focusing shooting method and mobile terminal | |
| CN104967772B (en) | Photographic method and device | |
| CN105262952A (en) | Mobile terminal and image processing method thereof | |
| CN104639836A (en) | Method and system for updating shooting mode |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160720 |