CN106445132A - Manipulation device and method based on screen projection - Google Patents
Manipulation device and method based on screen projection Download PDFInfo
- Publication number
- CN106445132A CN106445132A CN201610831447.2A CN201610831447A CN106445132A CN 106445132 A CN106445132 A CN 106445132A CN 201610831447 A CN201610831447 A CN 201610831447A CN 106445132 A CN106445132 A CN 106445132A
- Authority
- CN
- China
- Prior art keywords
- transmitting terminal
- gesture
- screen
- application
- screen prjection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
Abstract
The invention discloses a manipulation device and a method based on screen projection. The device comprises an application information acquisition module, a manipulation scheme acquisition module and a control instruction conversion module, wherein the application information acquisition module is used to acquire information of an application being operated by a sending end; the manipulation scheme acquisition module is used to acquire a gesture manipulation scheme according to the application; and the control instruction conversion module is used to receive a gesture instruction, convert the gesture instruction into a control instruction according to the gesture manipulation scheme and send the control instruction to the sending end, so that the sending end can control the application according to the control instruction. In this way, a user's gesture instruction is received by a receiving end side, and the gesture instruction is converted into the control instruction and sent to the sending end, so that the sending end can control the application being operated according to the control instruction, and the user can remotely manipulate the sending end on the receiving end side by an gesture action and needs not to manipulate the sending end directly. Hence, screen projection manipulation becomes more convenient; manipulation modes of the screen projection are enriched; and the user's experience is improved.
Description
Technical field
The present invention relates to communication technical field, more particularly, to a kind of actuation means based on screen prjection and method.
Background technology
Wireless Fidelity shows that (WiFi Display, WFD) technology is that one kind enables the transmitting terminals such as smart mobile phone, notebook
Enough technology being wirelessly connected with receiving terminals such as TV, display.During carrying out screen prjection by WFD, transmitting terminal incite somebody to action this
The screen picture of machine as the receiving terminal that is sent to of data for projection persistence, the reception data for projection of receiving terminal also persistence, and
The screen picture of transmitting terminal is reproduced on the screen of the machine.
Existing screen prjection technology, when initiating screen prjection connection, needs user to arrange receiving terminal and transmission manually
End, initiates mode not convenient.During screen prjection, user needs to manipulate the transmitting terminal such as screen touching transmitting terminal to control
The current application running of system, and then control screen projection process.However, during screen prjection, user generally watches and connecing
The screen of receiving end or close receiving terminal side, therefore manipulate not convenient and swift, thus affecting Consumer's Experience during transmitting terminal.
Content of the invention
Present invention is primarily targeted at proposing a kind of actuation means based on screen prjection and method it is intended to solve existing
The inadequate conveniently technical problem of screen prjection manipulation in technology.
For achieving the above object, the present invention proposes a kind of actuation means based on screen prjection, and described device includes：
Application message acquisition module, for obtaining the information of the current application running of transmitting terminal；
Manipulation scheme acquisition module, for obtaining gesture manipulation scheme according to described application；
Control instruction modular converter, for receiving gesture instruction, manipulates scheme by described gesture instruction according to described gesture
Be converted to control instruction and be sent to described transmitting terminal, so that described transmitting terminal controls described application according to described control instruction.
Further, described application message acquisition module is used for：Before setting up screen prjection connection, obtain transmitting terminal and work as
The information of the application of front operation；
Described device also includes screen prjection link block, and described screen prjection link block is used for：In described manipulation side
While case acquisition module obtains described gesture manipulation scheme, before or after, sent out to described transmitting terminal with the identity of receiving terminal
Play screen prjection connection request, set up screen prjection with described transmitting terminal and be connected.
Further, described application message acquisition module is used for：
Scan the screen picture of transmitting terminal by photographic head, identify that described transmitting terminal is currently transported according to described screen picture
The application of row；Or,
Read the screen picture of described transmitting terminal by near-field communication NFC, send out according to described screen picture identifies
The current application running of sending end.
Further, described application message acquisition module is used for：
After setting up screen prjection and connecting, obtain the projected image on screen；Institute is identified according to described projected image
State the application of transmitting terminal operation.
Further, described manipulation scheme acquisition module is used for：One and institute is selected from preset gesture manipulation scheme
State the corresponding gesture manipulation scheme of application；Or, generate a gesture behaviour corresponding with described application according to preset rules
Prosecutor case.
The present invention proposes a kind of control method based on screen prjection simultaneously, and methods described includes step：
Obtain the information of the current application running of transmitting terminal；
Gesture manipulation scheme is obtained according to described application；
Receive gesture instruction, scheme is manipulated according to described gesture and described gesture instruction is converted to control instruction and is sent to
Described transmitting terminal, so that described transmitting terminal controls described application according to described control instruction.
Further, the described information obtaining the current application running of transmitting terminal includes：
Before setting up screen prjection connection, obtain the information of the current application running of transmitting terminal；
Described according to described application obtain control described application gesture manipulate scheme step while, before or after
Also include：Initiate screen prjection connection request to described transmitting terminal, screen is set up with the identity of receiving terminal and described transmitting terminal and throws
Shadow connects.
Further, the described information obtaining the current application running of transmitting terminal includes：
Scan the screen picture of transmitting terminal by photographic head, identify that described transmitting terminal is currently transported according to described screen picture
The application of row；Or,
Read the screen picture of described transmitting terminal by near-field communication NFC, send out according to described screen picture identifies
The current application running of sending end.
Further, the described information obtaining the current application running of transmitting terminal includes：
After setting up screen prjection and connecting, obtain the projected image on screen；
The current application running of described transmitting terminal is identified according to described projected image.
Further, described according to described application obtain gesture manipulation scheme include：
A gesture manipulation scheme corresponding with described application is selected from preset gesture manipulation scheme；Or, root
Generate a gesture manipulation scheme corresponding with described application according to preset rules.
A kind of actuation means based on screen prjection proposed by the invention, by the gesture of receiving terminal side receive user
Instruct, and gesture instruction is converted to control instruction and be sent to transmitting terminal, so that transmitting terminal controls current fortune according to control instruction
The application of row.So that user can pass through gesture motion remote control transmitting terminal receiving side, need not be directly to transmission
End is manipulated, and improves the convenience of screen prjection manipulation, solves screen prjection manipulation in prior art not convenient fast
Prompt technical problem, and enrich the control mode of screen prjection, improve Consumer's Experience.
Brief description
Fig. 1 is the hardware architecture diagram realizing the optional mobile terminal of each embodiment of the present invention one；
Fig. 2 is the wireless communication system schematic diagram of mobile terminal as shown in Figure 1；
Fig. 3 is the flow chart based on the control method of screen prjection for the first embodiment of the invention；
Fig. 4 is the flow chart based on the control method of screen prjection for the second embodiment of the invention；
Fig. 5 is the flow chart based on the control method of screen prjection for the third embodiment of the invention；
Fig. 6 is the module diagram based on the actuation means of screen prjection for the fourth embodiment of the invention；
Fig. 7 is the module diagram based on the actuation means of screen prjection for the fifth embodiment of the invention.
The realization of the object of the invention, functional characteristics and advantage will be described further in conjunction with the embodiments referring to the drawings.
Specific embodiment
It should be appreciated that specific embodiment described herein, only in order to explain the present invention, is not intended to limit the present invention.
Realize the mobile terminal of each embodiment of the present invention referring now to Description of Drawings.In follow-up description, use
For represent element such as " module ", " part " or " unit " suffix only for being conducive to the explanation of the present invention, itself
Not specific meaning.Therefore, " module " and " part " can mixedly use.
Mobile terminal can be implemented in a variety of manners.For example, the terminal described in the present invention can include such as moving
Phone, smart phone, notebook computer, digit broadcasting receiver, PDA (personal digital assistant), PAD (panel computer), PMP
The mobile terminal of (portable media player), guider etc. and such as numeral TV, desk computer etc. consolidate
Determine terminal.Hereinafter it is assumed that terminal is mobile terminal.However, it will be understood by those skilled in the art that, except being used in particular for moving
Outside the element of purpose, construction according to the embodiment of the present invention can also apply to the terminal of fixed type.
Fig. 1 is that the hardware configuration of an optional mobile terminal realizing each embodiment of the present invention is illustrated.
Mobile terminal 1 00 can include wireless communication unit 110, A/V (audio/video) input block 120, user input
Unit 130, sensing unit 140, output unit 150, memorizer 160, interface unit 170, controller 180 and power subsystem 190
Etc..Fig. 1 shows the mobile terminal with various assemblies, it should be understood that being not required for implementing all groups illustrating
Part.More or less of assembly can alternatively be implemented.Will be discussed in more detail below the element of mobile terminal.
Wireless communication unit 110 generally includes one or more assemblies, and it allows mobile terminal 1 00 and wireless communication system
Or the radio communication between network.For example, wireless communication unit can include broadcasting reception module 111, mobile communication module
112nd, at least one of wireless Internet module 113, short range communication module 114 and location information module 115.
Broadcasting reception module 111 receives broadcast singal and/or broadcast via broadcast channel from external broadcast management server
Relevant information.Broadcast channel can include satellite channel and/or terrestrial channel.Broadcast management server can be generated and sent
The broadcast singal generating before the server of broadcast singal and/or broadcast related information or reception and/or broadcast related information
And send it to the server of terminal.Broadcast singal can include TV broadcast singal, radio signals, data broadcasting
Signal etc..And, broadcast singal may further include the broadcast singal combining with TV or radio signals.Broadcast phase
Pass information can also provide via mobile communications network, and in this case, broadcast related information can be by mobile communication mould
Block 112 is receiving.Broadcast singal can exist in a variety of manners, and for example, it can be with the electronics of DMB (DMB)
The form of program guide (EPG), the electronic service guidebooks (ESG) of digital video broadcast-handheld (DVB-H) etc. and exist.Broadcast
Receiver module 111 can be broadcasted by using various types of broadcast system receipt signals.Especially, broadcasting reception module 111
Can be wide by using such as multimedia broadcasting-ground (DMB-T), DMB-satellite (DMB-S), digital video
Broadcast-hand-held (DVB-H), forward link media (MediaFLO@) Radio Data System, received terrestrial digital broadcasting integrated service
Etc. (ISDB-T) digit broadcasting system receives digital broadcasting.Broadcasting reception module 111 may be constructed such that and is adapted to provide for extensively
Broadcast the various broadcast systems of signal and above-mentioned digit broadcasting system.Via broadcasting reception module 111 receive broadcast singal and/
Or broadcast related information can be stored in memorizer 160 (or other types of storage medium).
Mobile communication module 112 sends radio signals to base station (for example, access point, node B etc.), exterior terminal
And at least one of server and/or receive from it radio signal.Such radio signal can include voice and lead to
Words signal, video calling signal or the various types of data sending and/or receiving according to text and/or Multimedia Message.
Wireless Internet module 113 supports the Wi-Fi (Wireless Internet Access) of mobile terminal.This module can be internally or externally
It is couple to terminal.Wi-Fi (Wireless Internet Access) technology involved by this module can include WLAN (WLAN) (Wi-Fi), Wibro
(WiMAX), Wimax (worldwide interoperability for microwave accesses), HSDPA (high-speed downlink packet access) etc..
Short range communication module 114 is the module for supporting junction service.Some examples of short-range communication technology include indigo plant
ToothTM, RF identification (RFID), Infrared Data Association (IrDA), ultra broadband (UWB), purple honeybeeTMEtc..
Location information module 115 be for check or obtain mobile terminal positional information module.Location information module
Typical case be GPS (global positioning system).According to current technology, GPS module 115 calculates and is derived from three or more satellites
Range information and correct time information and for the Information application triangulation calculating, thus according to longitude, latitude
Highly accurately calculate three-dimensional current location information.Currently, the method for calculating position and temporal information is defended using three
Star and the error of the position that calculates by using other satellite correction and temporal information.Additionally, GPS module 115
Can be by Continuous plus current location information in real time come calculating speed information.
A/V input block 120 is used for receiving audio or video signal.A/V input block 120 can include camera 121 He
Mike 122, camera 121 is to the static images being obtained by image capture apparatus in Video Capture pattern or image capture mode
Or the view data of video is processed.Picture frame after process may be displayed on display module 151.Process through camera 121
Picture frame afterwards can be stored in memorizer 160 (or other storage medium) or carry out sending out via wireless communication unit 110
Send, two or more cameras 121 can be provided according to the construction of mobile terminal.Mike 122 can be in telephone calling model, note
Sound (voice data) is received via mike in record pattern, speech recognition mode etc. operational mode, and can be by so
Acoustic processing be voice data.Audio frequency (voice) data after process can be converted in the case of telephone calling model can
It is sent to the form output of mobile communication base station via mobile communication module 112.Mike 122 can implement various types of making an uproar
Sound eliminates (or suppression) algorithm to eliminate the noise that (or suppression) produces in reception with during sending audio signal or to do
Disturb.
User input unit 130 can generate key input data to control each of mobile terminal according to the order of user input
Plant operation.User input unit 130 allows the various types of information of user input, and can include keyboard, metal dome, touch
Plate (for example, detection due to touched and lead to resistance, pressure, the change of electric capacity etc. sensitive component), roller, rocking bar etc.
Deng.Especially, when touch pad is superimposed upon on display module 151 as a layer, touch screen can be formed.
Sensing unit 140 detect mobile terminal 1 00 current state, (for example, mobile terminal 1 00 open or close shape
State), the position of mobile terminal 1 00, user is for the presence or absence of the contact (that is, touch input) of mobile terminal 1 00, mobile terminal
100 orientation, the acceleration or deceleration movement of mobile terminal 1 00 and direction etc., and generate for controlling mobile terminal 1 00
The order of operation or signal.For example, when mobile terminal 1 00 is embodied as sliding-type mobile phone, sensing unit 140 can sense
This sliding-type phone opens or cuts out.In addition, sensing unit 140 can detect power subsystem 190 whether provide electric power or
Whether person's interface unit 170 is coupled with external device (ED).Interface unit 170 is used as at least one external device (ED) and mobile terminal 1 00
The interface that connection can be passed through.For example, external device (ED) can include wired or wireless head-band earphone port, external power source (or
Battery charger) port, wired or wireless FPDP, memory card port, for connect have identification module device end
Mouth, audio input/output (I/O) port, video i/o port, ear port etc..Identification module can be that storage is used for verifying
User using mobile terminal 1 00 various information and can include subscriber identification module (UIM), client identification module (SIM),
Universal Subscriber identification module (USIM) etc..In addition, the device (hereinafter referred to as " identifying device ") with identification module can be adopted
Take the form of smart card, therefore, identifying device can be connected with mobile terminal 1 00 via port or other attachment means.Interface
Unit 170 can be used for receiving from the input (for example, data message, electric power etc.) of external device (ED) and defeated by receive
Enter to be transferred to the one or more elements in mobile terminal 1 00 or can be used for transmission between mobile terminal and external device (ED)
Data.
In addition, when mobile terminal 1 00 is connected with external base, interface unit 170 can serve as allowing by it by electricity
Power provides the path of mobile terminal 1 00 from base or can serve as allowing the various command signals from base input to pass through it
It is transferred to the path of mobile terminal.May serve as identifying that mobile terminal is from the various command signals of base input or electric power
The no signal being accurately fitted within base.Output unit 150 is configured to defeated with the offer of vision, audio frequency and/or tactile manner
Go out signal (for example, audio signal, video signal, alarm signal, vibration signal etc.).Output unit 150 can include showing
Module 151, dio Output Modules 152, alarm modules 153 etc..
Display module 151 may be displayed on the information processing in mobile terminal 1 00.For example, when mobile terminal 1 00 is in electricity
During words call mode, display module 151 can show (for example, text messaging, the multimedia file that communicate with call or other
Download etc.) related user interface (UI) or graphic user interface (GUI).When mobile terminal 1 00 is in video calling pattern
Or during image capture mode, display module 151 can show the image of capture and/or the image of reception, illustrate video or figure
UI or GUI of picture and correlation function etc..
Meanwhile, when display module 151 and the touch pad touch screen with formation superposed on one another as a layer, display module
151 can serve as input equipment and output device.Display module 151 can include liquid crystal display (LCD), thin film transistor (TFT)
In LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexible display, three-dimensional (3D) display etc. at least
A kind of.Some in these display may be constructed such that transparence to allow user from outside viewing, and this is properly termed as transparent
Display, typical transparent display can be, for example, TOLED (transparent organic light emitting diode) display etc..According to specific
The embodiment wanted, mobile terminal 1 00 can include two or more display modules (or other display device), for example, moves
Dynamic terminal can include outside display module (not shown) and internal display module (not shown).Touch screen can be used for detection and touches
Input pressure and touch input position and touch input area.
Dio Output Modules 152 can mobile terminal be in call signal reception pattern, call mode, logging mode,
When under the isotypes such as speech recognition mode, broadcast reception mode, that wireless communication unit 110 is received or in memorizer 160
The voice data transducing audio signal of middle storage and be output as sound.And, dio Output Modules 152 can provide and move
The audio output (for example, call signal receives sound, message sink sound etc.) of the specific function correlation of terminal 100 execution.
Dio Output Modules 152 can include speaker, buzzer etc..
Alarm modules 153 can provide output to notify event to mobile terminal 1 00.Typical event is permissible
Including calling reception, message sink, key signals input, touch input etc..In addition to audio or video output, alarm modules
153 can provide output in a different manner with the generation of notification event.For example, alarm modules 153 can be in the form of vibrating
Output is provided, enters when communicating (incomingcommunication) when receiving calling, message or some other, alarm mould
Block 153 can provide tactile output (that is, vibrating) to notify to user.By providing such tactile output, even if
When the mobile phone of user is in the pocket of user, user also can recognize that the generation of various events.Alarm modules 153
The output of the generation of notification event can be provided via display module 151 or dio Output Modules 152.
Memorizer 160 can store software program of the process being executed by controller 180 and control operation etc., or can
Temporarily to store oneself data (for example, telephone directory, message, still image, video etc.) through exporting or will export.And
And, memorizer 160 can be to store the vibration of various modes with regard to exporting and audio signal when touching and being applied to touch screen
Data.
Memorizer 160 can include the storage medium of at least one type, and described storage medium includes flash memory, hard disk, many
Media card, card-type memorizer (for example, SD or DX memorizer etc.), random access storage device (RAM), static random-access storage
Device (SRAM), read only memory (ROM), Electrically Erasable Read Only Memory (EEPROM), programmable read only memory
(PROM), magnetic storage, disk, CD etc..And, mobile terminal 1 00 can execute memorizer with by network connection
The network storage device cooperation of 160 store function.
Controller 180 generally controls the overall operation of mobile terminal.For example, controller 180 execution and voice call, data
The related control of communication, video calling etc. and process.In addition, controller 180 can be included for reproducing (or playback) many matchmakers
The multi-media module 181 of volume data, multi-media module 181 can construct in controller 180, or it is so structured that and controls
Device 180 separates.Controller 180 can be with execution pattern identifying processing, by the handwriting input executing on the touchscreen or picture
Draw input and be identified as character or image.
Power subsystem 190 receives external power or internal power under the control of controller 180 and provides operation each unit
Suitable electric power needed for part and assembly.
Various embodiment described herein can be with using such as computer software, hardware or its any combination of calculating
Machine computer-readable recording medium is implementing.Hardware is implemented, embodiment described herein can be by using application-specific IC
(ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), scene can
Program gate array (FPGA), processor, controller, microcontroller, microprocessor, be designed to execute function described herein
At least one in electronic unit implementing, in some cases, can be implemented in controller 180 by such embodiment.
Software is implemented, the embodiment of such as process or function can with allow to execute the single of at least one function or operation
Software module is implementing.Software code can be come by the software application (or program) write with any suitable programming language
Implement, software code can be stored in memorizer 160 and be executed by controller 180.
So far, oneself is through describing mobile terminal according to its function.The present invention can be applied to such as folded form, board-type,
Various types of mobile terminal such as oscillating-type, sliding-type.
As shown in Figure 1 mobile terminal 1 00 may be constructed such that using via frame or packet transmission data all if any
Line and wireless communication system and satellite-based communication system are operating.
The communication system being wherein operable to according to the mobile terminal of the present invention referring now to Fig. 2 description.
Such communication system can use different air interfaces and/or physical layer.For example, used by communication system
Air interface includes such as frequency division multiple access (FDMA), time division multiple acess (TDMA), CDMA (CDMA) and universal mobile communications system
System (UMTS) (especially, Long Term Evolution (LTE)), global system for mobile communications (GSM) etc..As non-limiting example, under
The description in face is related to cdma communication system, but such teaching is equally applicable to other types of system.
With reference to Fig. 2, cdma wireless communication system can include multiple mobile terminal 1s 00, multiple base station (BS) 270, base station
Controller (BSC) 275 and mobile switching centre (MSC) 280.MSC280 is configured to and Public Switched Telephony Network (PSTN)
290 formation interfaces.MSC280 is also structured to and can form interface via the BSC275 that back haul link is couple to base station 270.
If back haul link can construct according to any one in the interface that Ganji knows, described interface includes such as E1/T1, ATM, IP,
PPP, frame relay, HDSL, ADSL or xDSL.It will be appreciated that system as shown in Figure 2 can include multiple BSC275.
Each BS270 can service one or more subregions (or region), by the sky of multidirectional antenna or sensing specific direction
Each subregion that line covers is radially away from BS270.Or, each subregion can by for diversity reception two or more
Antenna covers.Each BS270 may be constructed such that support multiple frequency distribution, and the distribution of each frequency has specific frequency spectrum
(for example, 1.25MHz, 5MHz etc.).
Intersecting that subregion and frequency are distributed can be referred to as CDMA Channel.BS270 can also be referred to as base station transceiver
System (BTS) or other equivalent terms.In this case, term " base station " can be used for broadly representing single
BSC275 and at least one BS270.Base station can also be referred to as " cellular station ".Or, each subregion of specific BS270 can be claimed
For multiple cellular stations.
As shown in Figure 2, broadcast singal is sent to the mobile terminal of operation in system by broadcsting transmitter (BT) 295
100.Broadcasting reception module 111 is arranged at mobile terminal 1 00 to receive the broadcast being sent by BT295 as shown in Figure 1
Signal.In fig. 2 it is shown that several global positioning system (GPS) satellites 300.Satellite 300 helps position multiple mobile terminals
At least one of 100.
In fig. 2, multiple satellites 300 are depicted, but it is to be understood that, it is possible to use any number of satellite obtains to be had
Location information.GPS module 115 is generally configured to coordinate with satellite 300 to obtain the positioning wanted as shown in Figure 1
Information.Substitute GPS tracking technique or outside GPS tracking technique, it is possible to use can follow the tracks of the position of mobile terminal its
Its technology.In addition, at least one gps satellite 300 can optionally or additionally process satellite dmb transmission.
As a typical operation of wireless communication system, BS270 receives the reverse link from various mobile terminal 1s 00
Signal.Mobile terminal 1 00 generally participates in call, information receiving and transmitting and other types of communication.Each of certain base station 270 reception is anti-
Processed in specific BS270 to link signal.The data obtaining is forwarded to the BSC275 of correlation.BSC provides call
Resource allocation and the mobile management function of including the coordination of soft switching process between BS270.BSC275 is also by the number receiving
According to being routed to MSC280, it provides the extra route service for forming interface with PSTN290.Similarly, PSTN290 with
MSC280 forms interface, and MSC and BSC275 form interface, and BSC275 correspondingly controls BS270 with by forward link signals
It is sent to mobile terminal 1 00.
Based on above-mentioned mobile terminal hardware configuration and communication system, the control method based on screen prjection for the present invention is proposed
With each embodiment of device, methods and apparatus of the present invention is mainly used in above-mentioned mobile terminal, particularly mobile phone.Additionally, also
Can apply to the fixed terminals such as projection screen, display screen, intelligent television.
Screen prjection described in the embodiment of the present invention, refers mainly to the screen prjection based on WFD naturally it is also possible to be based on it
The screen prjection of its screen prjection technology, the present invention is not construed as limiting to this, mainly taking WFD technology as a example carries out specifically below
Bright.
In the embodiment of the present invention, when two terminals carry out screen prjection, one of terminal is transmitting terminal (Source),
For being sent out data for projection, another terminal is receiving terminal (Sink), for receiving data for projection and exporting.
Embodiment one
As shown in figure 3, proposing the control method based on screen prjection of first embodiment of the invention, methods described is applied to
The receiving terminal of screen prjection, comprises the following steps：
S11, the information of the current application running of acquisition transmitting terminal.
In this step S11, receiving terminal can obtain the transmission of screen prjection setting up screen prjection before or after connecting
The information of the current application running in end, that is, which application learn the current operation of transmitting terminal is.
Alternatively, receiving terminal, before setting up screen prjection connection, obtains the information of the current application running of transmitting terminal；So
Afterwards, while next step S12, before or after, with the identity of receiving terminal to transmitting terminal initiate screen prjection connection request,
Set up screen prjection with transmitting terminal to be connected.
Specifically, receiving terminal can scan the screen picture of transmitting terminal by photographic head, or passes through near-field communication (Near
Field Communication, NFC) read transmitting terminal screen picture, then utilize image recognition technology, according to screen map
As identifying the current application running of transmitting terminal.Image recognition technology is the prior art of comparative maturity, will not be described here.
For example, after transmitting terminal starts the application (as video playback application, demonstration application etc.) intending carrying out screen prjection, receive
End starts photographic head, the photographic head of receiving terminal is aligned with the screen of transmitting terminal, receiving terminal then scans transmitting terminal by photographic head
Screen picture, this screen picture shows the user interface of the current application running of transmitting terminal, and receiving terminal passes through image recognition
Technology identifies that this user interface belongs to the user interface which (kind) is applied, so identify transmitting terminal current run be
Which application.
And for example, after transmitting terminal starts the application (as video playback application, demonstration application etc.) intending carrying out screen prjection, open
Receiving terminal and the NFC function of transmitting terminal, then will be close to receiving terminal and transmitting terminal, and receiving terminal then reads transmitting terminal by NFC
Screen picture, this screen picture shows the user interface of the current application running of transmitting terminal, and receiving terminal passes through image recognition skill
Art identifies that this user interface belongs to the user interface which (kind) is applied, and then identifies that current run is which to transmitting terminal
One application.
Alternatively, after setting up screen prjection and connecting, receiving terminal obtains the projected image on the machine screen, using image
Technology of identification, identifies the current application running of transmitting terminal according to projected image.
Specifically, receiving terminal and transmitting terminal are set up after screen prjection is connected, and transmitting terminal then sends projection number to receiving terminal
According to receiving terminal receives data for projection, and generates projected image on screen according to data for projection.Then receiving terminal obtains the machine screen
Projected image on curtain, this projected image is the current screen picture of transmitting terminal, and this screen picture shows that transmitting terminal is currently transported
The user interface of the application of row, by image recognition technology, receiving terminal identifies that this user interface belongs to what which (kind) was applied
User interface, and then identify current which application run be to transmitting terminal.
S12, the application acquisition gesture manipulation scheme according to the current operation of transmitting terminal.
Alternatively, receiving terminal selects an application with the current operation of transmitting terminal relative from preset gesture manipulation scheme
The gesture manipulation scheme answered.
Specifically, corresponding gesture manipulation scheme can be pre-set for various applications, and it is local to be stored in receiving terminal
Or cloud server, such as pre-sets gesture manipulation scheme, gesture manipulation scheme of demonstration application of video playback application etc.,
Described demonstration application such as PowerPoint application (as PPT), picture playing application etc..When the application learning the current operation of transmitting terminal
Afterwards, receiving terminal then can choose the corresponding handss of the application that run current with transmitting terminal from locally stored or high in the clouds store
Gesture manipulates scheme.
For example, when the current application running of transmitting terminal is applied for video playback, then selecting video plays the gesture of application
Manipulation scheme；When the current application running of transmitting terminal is applied for PowerPoint, then choose the gesture manipulation of PowerPoint application
Scheme；When the current application running of transmitting terminal is applied, then choose the gesture manipulation scheme of picture playing application for picture playing.
Alternatively, receiving terminal generates the corresponding gesture behaviour of the application that run current with transmitting terminal according to preset rules
Prosecutor case.
Specifically, the create-rule that the gesture for different applications manipulates scheme can be preset, when learning transmission
During the application that end is current to be run, then the create-rule according to this application manipulates scheme generating a corresponding gesture.
For example, when the current application running of transmitting terminal is applied for video playback, then the generation according to video playback application
Rule is generating corresponding gesture manipulation scheme；When the current application running of transmitting terminal is applied for PowerPoint, then basis is drilled
Show the create-rule of manuscript application to generate corresponding gesture manipulation scheme；The application running when transmitting terminal is current is picture playing
During application, then corresponding gesture manipulation scheme is generated according to the create-rule of picture playing application.
S13, reception gesture instruction, manipulate scheme according to gesture and gesture instruction are converted to control instruction and are sent to transmission
End, so that transmitting terminal controls the current application running according to control instruction.
In the embodiment of the present invention, described gesture manipulates the corresponding relation that scheme contains gesture instruction and control instruction, connects
Receiving end can manipulate scheme according to gesture and gesture instruction is converted to corresponding control instruction, current in order to remotely control transmitting terminal
The application running.Described gesture instruction is specific gesture motion.
Alternatively, described gesture motion can be gesture motion high up in the air, and such as staff soars aloft to the left, to the right, downward or upward
Brandish, or the action clicked on high up in the air etc., receiving terminal can catch gesture motion high up in the air by photographic head, high up in the air when capture
When gesture motion is specific gesture motion, then receive gesture instruction.
For example, so that the current application running of receiving terminal is for video playback application as a example.Soar aloft to wave to the left when capturing
During dynamic gesture instruction, this gesture instruction is converted to the control instruction of playing progress rate retrogressing；Soar aloft to brandish to the right when capturing
Gesture instruction when, by this gesture instruction be converted to playing progress rate advance control instruction；When the gesture capturing click high up in the air
During instruction, this gesture instruction is converted to the control instruction of time-out/broadcasting；When capturing the high up in the air gesture instruction brandished upwards
When, this gesture instruction is converted to the control instruction being switched to a upper video file；When capturing the high up in the air handss brandished downwards
During gesture instruction, this gesture instruction is converted to the control instruction being switched to next video file.
Alternatively, described gesture motion can also be the mobile gesture motion of staff mobile receiving end, and such as staff grips and connects
Receiving end to the left, to the right, move downward or upward, or double swerve, is rocked in front and back, and receiving terminal can pass through sensor sensing
Mobile gesture motion, when the mobile gesture motion sensing is specific gesture motion, then receives gesture instruction.
For example, so that the current application running of receiving terminal is for video playback application as a example.It is moved to the left when sensing
During gesture instruction, this gesture instruction is converted to the control instruction of playing progress rate retrogressing；When sensing that the gesture moving right refers to
When making, this gesture instruction is converted to the control instruction of playing progress rate advance；When sensing the gesture instruction rocked in front and back, will
This gesture instruction is converted to the control instruction of time-out/broadcasting；When sensing the gesture instruction moving up, by this gesture instruction
Be converted to the control instruction being switched to a video file；When sensing the gesture instruction moving down, this gesture is referred to
Order is converted to the control instruction being switched to next video file.
After transmitting terminal receives the control instruction of receiving terminal transmission, immediately answering of current operation is controlled according to control instruction
With such as controlling video playback application retreat, advance, suspending/play, being switched to a video file, being switched to the next one and regard
Frequency file etc..
The control method based on screen prjection of the embodiment of the present invention, by the gesture instruction of receiving terminal receive user, and
Gesture instruction is converted to control instruction and is sent to transmitting terminal, so that transmitting terminal controls answering of current operation according to control instruction
With.So that user can pass through gesture motion remote control transmitting terminal receiving side, need not directly transmitting terminal be carried out
Manipulation, improves the convenience of screen prjection manipulation, solves the inadequate conveniently skill of screen prjection manipulation in prior art
Art problem, and enrich the control mode of screen prjection, improve Consumer's Experience.
Embodiment two
As shown in figure 4, proposing the control method based on screen prjection for the second embodiment of the invention, methods described is applied to shield
The receiving terminal of curtain projection, comprises the following steps：
S21, scan the screen picture of transmitting terminal by photographic head, identify that transmitting terminal is current according to screen picture and run
Application.
In the present embodiment, receiving terminal, before setting up screen prjection connection, obtains the letter of the current application running of transmitting terminal
Breath.Specifically, receiving terminal scans the screen picture of transmitting terminal by photographic head, then utilizes image recognition technology, according to screen
Image recognition goes out the current application running of transmitting terminal.In certain embodiments, receiving terminal can also read transmitting terminal by NFC
Screen picture,
For example, after transmitting terminal starts the application (as video playback application, demonstration application etc.) intending carrying out screen prjection, receive
End starts photographic head, the photographic head of receiving terminal is aligned with the screen of transmitting terminal, receiving terminal then scans transmitting terminal by photographic head
Screen picture, this screen picture shows the user interface of the current application running of transmitting terminal, and receiving terminal passes through image recognition
Technology identifies that this user interface belongs to the user interface which (kind) is applied, so identify transmitting terminal current run be
Which application.
S22, the application acquisition gesture manipulation scheme according to the current operation of transmitting terminal.
This step S22 is identical with step S12 in first embodiment, will not be described here.
S23, screen prjection connection request is initiated to transmitting terminal with the identity of receiving terminal, set up screen prjection even with transmitting terminal
Connect.
Specifically, terminal unit initiates screen prjection connection request with the identity of receiving terminal to transmitting terminal, and transmitting terminal receives
To after request, when selecting to accept this request, the two then begins setting up screen prjection and connects, the concrete foundation that screen prjection connects
Flow process is same as the prior art, will not be described here.
In certain embodiments, step S22 and the order of S23 can also overturn, or two steps S22 and S23 are simultaneously
Carry out.
S24, reception gesture instruction, manipulate scheme according to gesture and gesture instruction are converted to control instruction and are sent to transmission
End, so that transmitting terminal controls the current application running according to control instruction.
This step S24 is identical with step S13 in first embodiment, will not be described here.
Using the control method based on screen prjection for the present embodiment, when a terminal unit gets another terminal unit
After the current information of application run, then automatically screen connection request is initiated to another terminal unit with the identity of receiving terminal,
So that another terminal unit sets up screen with the identity of transmitting terminal and receiving terminal being automatically connected, reception is set manually without user
End and transmitting terminal, enrich the initiation mode of screen prjection, have both improve the convenience of screen prjection initiation, and have improve screen again
The convenience of projection manipulation, is greatly improved Consumer's Experience.
As shown in figure 5, proposing method of the present invention 3rd embodiment, methods described is applied to the receiving terminal of screen prjection,
Comprise the following steps：
S31 sets up screen prjection with receiving terminal and is connected.
In this step S31, screen prjection connection request can be initiated by receiving terminal and throw it is also possible to screen is initiated by transmitting terminal
Shadow connection request.
S32, the projected image obtaining on screen, identify the current application running of transmitting terminal according to projected image.
In this step S32, after setting up screen prjection and connecting, receiving terminal obtains the projected image on the machine screen, profit
With image recognition technology, the current application running of transmitting terminal is identified according to projected image.
Specifically, receiving terminal and transmitting terminal are set up after screen prjection is connected, and transmitting terminal then sends projection number to receiving terminal
According to receiving terminal receives data for projection, and generates projected image on screen according to data for projection.Then receiving terminal obtains the machine screen
Projected image on curtain, this projected image is the current screen picture of transmitting terminal, and this screen picture shows that transmitting terminal is currently transported
The user interface of the application of row, by image recognition technology, receiving terminal identifies that this user interface belongs to what which (kind) was applied
User interface, and then identify current which application run be to transmitting terminal.
S33, the application acquisition gesture manipulation scheme according to the current operation of transmitting terminal.
This step S33 is identical with step S12 in first embodiment, will not be described here.
S34, reception gesture instruction, manipulate scheme according to gesture and gesture instruction are converted to control instruction and are sent to transmission
End, so that transmitting terminal controls the current application running according to control instruction.
This step S34 is identical with step S13 in first embodiment, will not be described here.
Using the actuation means based on screen prjection for the present embodiment, after setting up screen prjection connection, automatically by projection
The information of the current application running of Image Acquisition transmitting terminal, and then acquisition gesture manipulation scheme carries out remote control to transmitting terminal,
To obtain the application message of transmitting terminal without user's manual operation, to further increase the convenience of screen prjection manipulation, lifting
Consumer's Experience.
Example IV
As shown in fig. 6, proposing the actuation means based on screen prjection for the fourth embodiment of the invention, described device is applied to shield
The receiving terminal of curtain projection, including application message acquisition module, manipulates scheme acquisition module and control instruction modular converter, wherein：
Application message acquisition module：For obtaining the information of the current application running of transmitting terminal.
In the present embodiment, after setting up screen prjection and connecting, application message acquisition module obtains the throwing on the machine screen
Shadow image, using image recognition technology, identifies the current application running of transmitting terminal according to projected image.
Specifically, receiving terminal and transmitting terminal are set up after screen prjection is connected, and transmitting terminal then sends projection number to receiving terminal
According to receiving terminal receives data for projection, and generates projected image on screen according to data for projection.Then application message acquisition module
Obtain the projected image on the machine (receiving terminal) screen, this projected image is the current screen picture of transmitting terminal, this screen picture
Show the user interface of the current application running of transmitting terminal, application message acquisition module identifies this by image recognition technology
User interface belongs to the user interface which (kind) is applied, and then identifies current which application run be to transmitting terminal.
Manipulation scheme acquisition module：For gesture manipulation scheme is obtained according to the current application running of transmitting terminal.
Alternatively, manipulation scheme acquisition module is selected one from preset gesture manipulation scheme and is currently run with transmitting terminal
Application corresponding gesture manipulation scheme.
Specifically, corresponding gesture manipulation scheme can be pre-set for various applications, and it is local to be stored in receiving terminal
Or cloud server, such as pre-sets gesture manipulation scheme, gesture manipulation scheme of demonstration application of video playback application etc.,
Described demonstration application such as PowerPoint application (as PPT), picture playing application etc..When the application learning the current operation of transmitting terminal
Afterwards, manipulation scheme acquisition module then can choose a current application running with transmitting terminal from locally stored or high in the clouds store
Corresponding gesture manipulation scheme.
For example, when the current application running of transmitting terminal is applied for video playback, manipulation scheme acquisition module is then chosen and is regarded
Frequency plays the gesture manipulation scheme of application；When the current application running of transmitting terminal is applied for PowerPoint, manipulation scheme obtains
Module then chooses the gesture manipulation scheme of PowerPoint application；When the current application running of transmitting terminal is applied for picture playing,
Manipulation scheme acquisition module then chooses the gesture manipulation scheme of picture playing application.
Alternatively, manipulation scheme acquisition module is relative with the current application running of transmitting terminal according to preset rules generation one
The gesture manipulation scheme answered.
Specifically, the create-rule that the gesture for different applications manipulates scheme can be preset, when learning transmission
During the application that end is current to be run, then the create-rule according to this application manipulates scheme generating a corresponding gesture.
For example, when the current application running of transmitting terminal is applied for video playback, then the generation according to video playback application
Rule is generating corresponding gesture manipulation scheme；When the current application running of transmitting terminal is applied for PowerPoint, then basis is drilled
Show the create-rule of manuscript application to generate corresponding gesture manipulation scheme；The application running when transmitting terminal is current is picture playing
During application, then corresponding gesture manipulation scheme is generated according to the create-rule of picture playing application.
Control instruction modular converter：For receiving gesture instruction, scheme is manipulated according to gesture gesture instruction is converted to control
System instructs and is sent to transmitting terminal, so that transmitting terminal controls the current application running according to control instruction.
In the embodiment of the present invention, described gesture manipulates the corresponding relation that scheme contains gesture instruction and control instruction, control
System instruction modular converter can manipulate scheme according to gesture and gesture instruction is converted to corresponding control instruction, in order to remotely control
The current application running of transmitting terminal.Described gesture instruction is specific gesture motion.
Alternatively, described gesture motion can be gesture motion high up in the air, and such as staff soars aloft to the left, to the right, downward or upward
Brandish, or the high up in the air action clicked on etc., control instruction modular converter can catch, by photographic head, gesture motion of soaring aloft, when catching
When the gesture motion high up in the air grasped is specific gesture motion, then receive gesture instruction.
For example, so that the current application running of receiving terminal is for video playback application as a example.Soar aloft to wave to the left when capturing
During dynamic gesture instruction, this gesture instruction is converted to the control instruction of playing progress rate retrogressing by control instruction modular converter；When catching
When grasping the gesture instruction brandished to the right high up in the air, this gesture instruction is converted to playing progress rate advance by control instruction modular converter
Control instruction；When capturing the gesture instruction of click high up in the air, control instruction modular converter by this gesture instruction be converted to time-out/
The control instruction play；When capturing the high up in the air gesture instruction brandished upwards, control instruction modular converter is by this gesture instruction
Be converted to the control instruction being switched to a video file；When capturing the gesture instruction brandished downwards high up in the air, control refers to
Make modular converter that this gesture instruction is converted to the control instruction being switched to next video file.
Alternatively, described gesture motion can also be the mobile gesture motion of staff mobile receiving end, and such as staff grips and connects
Receiving end to the left, to the right, move downward or upward, or double swerve, is rocked in front and back, and control instruction modular converter can pass through
Sensor sensing moves gesture motion, when the mobile gesture motion sensing is specific gesture motion, then receives gesture
Instruction.
For example, so that the current application running of receiving terminal is for video playback application as a example.It is moved to the left when sensing
During gesture instruction, this gesture instruction is converted to the control instruction of playing progress rate retrogressing by control instruction modular converter；When sensing
During the gesture instruction moving right, the control that this gesture instruction is converted to playing progress rate advance is referred to by control instruction modular converter
Order；When sensing the gesture instruction rocked in front and back, this gesture instruction is converted to time-out/broadcasting by control instruction modular converter
Control instruction；When sensing the gesture instruction moving up, this gesture instruction is converted to switching by control instruction modular converter
Control instruction to a upper video file；When sensing the gesture instruction moving down, control instruction modular converter should
Gesture instruction is converted to the control instruction being switched to next video file.
After transmitting terminal receives the control instruction of control instruction modular converter transmission of receiving terminal, immediately according to control instruction
Control the current application running, such as control video playback application retreat, advance, suspending/play, being switched to a video literary composition
Part, it is switched to next video file etc..
The actuation means that the embodiment of the present invention is connected based on screen prjection, are referred to by the gesture in receiving terminal side receive user
Make, and gesture instruction is converted to control instruction and be sent to transmitting terminal, so that transmitting terminal controls current operation according to control instruction
Application.So that user can pass through gesture motion remote control transmitting terminal receiving side, need not be directly to transmitting terminal
Manipulated, improve the convenience of screen prjection manipulation, solved screen prjection manipulation in prior art not convenient and swift
Technical problem, and enrich the control mode of screen prjection, improve Consumer's Experience.
Embodiment five
As shown in fig. 7, proposing the actuation means based on screen prjection for the fifth embodiment of the invention, described device is applied to shield
The receiving terminal of curtain projection, the present embodiment increased a screen prjection link block on the basis of first embodiment.
In the present embodiment, before setting up screen prjection connection, application message acquisition module then obtains transmitting terminal and currently transports
The information of the application of row；Then, screen prjection link block manipulate scheme acquisition module obtain gesture manipulation scheme while,
Before or after, automatically screen prjection is set up with the identity of receiving terminal and transmitting terminal and be connected.
Specifically, application message acquisition module can scan the screen picture of transmitting terminal by photographic head, or passes through NFC
Read the screen picture of transmitting terminal, then utilize image recognition technology, the current operation of transmitting terminal is identified according to screen picture
Application.Image recognition technology is the prior art of comparative maturity, will not be described here.
For example, after transmitting terminal starts the application (as video playback application, demonstration application etc.) intending carrying out screen prjection, application
Data obtaining module starts photographic head, the photographic head of receiving terminal is aligned with the screen of transmitting terminal, application message acquisition module is then
Scan the screen picture of transmitting terminal by photographic head, this screen picture shows user circle of the current application running of transmitting terminal
Face, by image recognition technology, application message acquisition module identifies that this user interface belongs to user circle which (kind) is applied
Face, and then identify current which application run be to transmitting terminal.
And for example, after transmitting terminal starts the application (as video playback application, demonstration application etc.) intending carrying out screen prjection, open
Receiving terminal and the NFC function of transmitting terminal, then will be close to receiving terminal and transmitting terminal, and application message acquisition module is then read by NFC
Take the screen picture of transmitting terminal, this screen picture shows the user interface of the current application running of transmitting terminal, application message obtains
By image recognition technology, delivery block identifies that this user interface belongs to the user interface which (kind) is applied, and then identify
Which application the current operation of transmitting terminal is.
Using the actuation means based on screen prjection for the present embodiment, when get another terminal unit current run should
After information, then automatically screen connection request is initiated to another terminal unit with the identity of receiving terminal, so that another is eventually
End equipment is automatically set up screen with the identity of transmitting terminal and receiving terminal and is connected, and arranges receiving terminal and transmitting terminal manually without user,
Enrich the initiation mode of screen prjection, both improve the convenience of screen prjection initiation, improve screen prjection manipulation again
Convenience, is greatly improved Consumer's Experience.
The manipulation side being connected with based on screen prjection based on the actuation means that screen prjection connects that above-described embodiment provides
Method embodiment belongs to same design, and it implements the technical characteristic that process refers in embodiment of the method, and embodiment of the method and exists
All corresponding applicable in device embodiment, repeat no more here.
It should be noted that herein, term " inclusion ", "comprising" or its any other variant are intended to non-row
The comprising of his property, so that including a series of process of key elements, method, article or device not only include those key elements, and
And also include other key elements of being not expressly set out, or also include intrinsic for this process, method, article or device institute
Key element.In the absence of more restrictions, the key element being limited by sentence "including a ..." is it is not excluded that including being somebody's turn to do
Also there is other identical element in the process of key element, method, article or device.
The embodiments of the present invention are for illustration only, do not represent the quality of embodiment.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can be realized by the mode of software plus necessary general hardware platform naturally it is also possible to pass through hardware, but in many cases
The former is more preferably embodiment.Based on such understanding, technical scheme is substantially done to prior art in other words
Go out partly can embodying in the form of software product of contribution, this computer software product is stored in a storage medium
In (as ROM/RAM, magnetic disc, CD), including some instructions with so that a station terminal equipment (can be mobile phone, computer, clothes
Business device, or the network equipment etc.) method described in execution each embodiment of the present invention.
These are only the preferred embodiments of the present invention, not thereby limit the present invention the scope of the claims, every using this
Equivalent structure or equivalent flow conversion that bright description and accompanying drawing content are made, or directly or indirectly it is used in other related skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of actuation means based on screen prjection are it is characterised in that include：
Application message acquisition module, for obtaining the information of the current application running of transmitting terminal；
Manipulation scheme acquisition module, for obtaining gesture manipulation scheme according to described application；
Control instruction modular converter, for receiving gesture instruction, manipulates scheme according to described gesture and changes described gesture instruction
For control instruction and be sent to described transmitting terminal, so that described transmitting terminal controls described application according to described control instruction.
2. the actuation means based on screen prjection according to claim 1 are it is characterised in that described application message obtains mould
Block is used for：Before setting up screen prjection connection, obtain the information of the current application running of transmitting terminal；
Described device also includes screen prjection link block, and described screen prjection link block is used for：Obtain in described manipulation scheme
While delivery block obtains described gesture manipulation scheme, before or after, screen is initiated to described transmitting terminal with the identity of receiving terminal
Curtain projection connection request, sets up screen prjection with described transmitting terminal and is connected.
3. the actuation means based on screen prjection according to claim 2 are it is characterised in that described application message obtains mould
Block is used for：
Scan the screen picture of transmitting terminal by photographic head, the current operation of described transmitting terminal is identified according to described screen picture
Application；Or,
Read the screen picture of described transmitting terminal by near-field communication NFC, described transmitting terminal is identified according to described screen picture
The current application running.
4. the actuation means based on screen prjection according to claim 1 are it is characterised in that described application message obtains mould
Block is used for：
After setting up screen prjection and connecting, obtain the projected image on screen；Send out according to described projected image identifies
The application that sending end is run.
5. the actuation means based on screen prjection according to any one of claim 1-4 are it is characterised in that described manipulation side
Case acquisition module is used for：A gesture manipulation scheme corresponding with described application is selected from preset gesture manipulation scheme；
Or, generate a gesture manipulation scheme corresponding with described application according to preset rules.
6. a kind of control method based on screen prjection is it is characterised in that include step：
Obtain the information of the current application running of transmitting terminal；
Gesture manipulation scheme is obtained according to described application；
Receive gesture instruction, scheme is manipulated according to described gesture and described gesture instruction is converted to control instruction and described in being sent to
Transmitting terminal, so that described transmitting terminal controls described application according to described control instruction.
7. the control method based on screen prjection according to claim 6 is it is characterised in that described acquisition transmitting terminal is current
The information of the application running includes：
Before setting up screen prjection connection, obtain the information of the current application running of transmitting terminal；
Described according to described application obtain control described application gesture manipulate scheme step while, before or after also wrap
Include：Initiate screen prjection connection request to described transmitting terminal, screen prjection is set up even with the identity of receiving terminal and described transmitting terminal
Connect.
8. the control method based on screen prjection according to claim 7 is it is characterised in that described acquisition transmitting terminal is current
The information of the application running includes：
Scan the screen picture of transmitting terminal by photographic head, the current operation of described transmitting terminal is identified according to described screen picture
Application；Or,
Read the screen picture of described transmitting terminal by near-field communication NFC, described transmitting terminal is identified according to described screen picture
The current application running.
9. the control method based on screen prjection according to claim 6 is it is characterised in that described acquisition transmitting terminal is current
The information of the application running includes：
After setting up screen prjection and connecting, obtain the projected image on screen；
The current application running of described transmitting terminal is identified according to described projected image.
10. the control method based on screen prjection according to any one of claim 6-9 is it is characterised in that described basis
Described application obtains gesture manipulation scheme and includes：
A gesture manipulation scheme corresponding with described application is selected from preset gesture manipulation scheme；Or, according to pre-
If rule generates a gesture manipulation scheme corresponding with described application.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610831447.2A CN106445132A (en) | 2016-09-19 | 2016-09-19 | Manipulation device and method based on screen projection |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610831447.2A CN106445132A (en) | 2016-09-19 | 2016-09-19 | Manipulation device and method based on screen projection |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106445132A true CN106445132A (en) | 2017-02-22 |
Family
ID=58165691
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610831447.2A Pending CN106445132A (en) | 2016-09-19 | 2016-09-19 | Manipulation device and method based on screen projection |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106445132A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111176431A (en) * | 2019-09-23 | 2020-05-19 | 广东小天才科技有限公司 | Screen projection control method of sound box and sound box |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104076914A (en) * | 2013-03-28 | 2014-10-01 | 联想(北京)有限公司 | Electronic equipment and projection display method |
| CN104808800A (en) * | 2015-05-21 | 2015-07-29 | 上海斐讯数据通信技术有限公司 | Smart glasses device, mobile terminal and operation method of mobile terminal |
| US20160266722A1 (en) * | 2013-03-11 | 2016-09-15 | Hitachi Maxell, Ltd. | Operation detection device, operation detection method and projector |
-
2016
- 2016-09-19 CN CN201610831447.2A patent/CN106445132A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160266722A1 (en) * | 2013-03-11 | 2016-09-15 | Hitachi Maxell, Ltd. | Operation detection device, operation detection method and projector |
| CN104076914A (en) * | 2013-03-28 | 2014-10-01 | 联想(北京)有限公司 | Electronic equipment and projection display method |
| CN104808800A (en) * | 2015-05-21 | 2015-07-29 | 上海斐讯数据通信技术有限公司 | Smart glasses device, mobile terminal and operation method of mobile terminal |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111176431A (en) * | 2019-09-23 | 2020-05-19 | 广东小天才科技有限公司 | Screen projection control method of sound box and sound box |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106453538A (en) | Screen sharing apparatus and method | |
| CN106453382A (en) | Message pushing method and device | |
| CN106911850A (en) | Mobile terminal and its screenshotss method | |
| CN106371788A (en) | Screen projection connection device and method | |
| CN106897005A (en) | A kind of method for controlling projection, apparatus and system | |
| CN106375840A (en) | Screen projection device, mobile terminal and screen projection connection method | |
| CN106157970A (en) | A kind of audio identification methods and terminal | |
| CN106534914A (en) | Split screen display device, mobile terminal and method | |
| CN106909681A (en) | A kind of information processing method and its device | |
| CN106406737A (en) | A screen operating method and device and a mobile terminal | |
| CN106411700A (en) | Method for extracting instant communication information and terminal | |
| CN106873887A (en) | It is a kind of that the system and method for application function is controlled based on gesture | |
| CN104731508B (en) | Audio frequency playing method and device | |
| CN106793159A (en) | A kind of screen prjection method and mobile terminal | |
| CN106775336A (en) | A kind of content duplication method, device and terminal | |
| CN106453542A (en) | Screen sharing apparatus and method | |
| CN106888317A (en) | A kind of interaction processing method, device and terminal | |
| CN106357929A (en) | Previewing method based on audio file and mobile terminal | |
| CN106385514A (en) | Music processing method, device and terminal | |
| CN106534498A (en) | Control device and method of application folder and mobile terminal | |
| CN106488207A (en) | A kind of multi-screen projecting method based on DLNA agreement and terminal | |
| CN106648505A (en) | Mobile terminal control method and mobile terminal | |
| CN106375842A (en) | Image sharing device and method | |
| CN106941568A (en) | A kind of Toast pop-ups optimization display methods, device and Toast pop-ups dispatching method and device | |
| CN106454771A (en) | Information sending method and device and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170222 |
|
| RJ01 | Rejection of invention patent application after publication |