Specific embodiment
The application is described in further detail below in conjunction with the accompanying drawings.
In a typical configuration of this application, terminal, the equipment of service network and computing device include one or more
Processor (CPU), input/output interface, network interface and memory.
Memory may include computer-readable medium in volatile memory, random access memory (RAM) and/or
The forms such as Nonvolatile memory, such as read-only memory (ROM) or flash memory (flash RAM).Memory is computer-readable medium
Example.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method
Or technology come realize information store.Information can be computer-readable instruction, data structure, the module of program or other data.
The example of the storage medium of computer includes, but are not limited to phase transition internal memory (PRAM), static RAM (SRAM), moves
State random access memory (DRAM), other kinds of random access memory (RAM), read-only memory (ROM), electric erasable
Programmable read only memory (EEPROM), fast flash memory bank or other memory techniques, CD-ROM read-only memory (CD-ROM),
Digital versatile disc (DVD) or other optical storages, magnetic tape cassette, magnetic tape disk storage or other magnetic storage apparatus or
Any other non-transmission medium, available for storing the information that can be accessed by a computing device.It is defined according to herein, computer
Readable medium does not include the data-signal and carrier wave of non-temporary computer readable media (transitory media), such as modulation.
This application provides a kind of method that smart machine is remotely controlled by Trackpad, the method can be set in the intelligence
Standby middle realization.Fig. 1 shows a kind of method schematic diagram that smart machine 1 is remotely controlled by Trackpad according to the application one side.
Wherein, the method includes the steps S101, step S102 and step S103.Wherein, in step S101, smart machine 1 can be with
Touch operation of the user in Trackpad is obtained, wherein, the Trackpad matches with smart machine 1;Then, in step S102
In, smart machine 1 can based on first position information of the touch operation in the Trackpad and the Trackpad with
The coordinate mapping relations of the display device of the smart machine 1 determine second of the touch operation in the display device
Location information;Then, in step s 103, smart machine 1 can be according to the touch operation and the second position information control
Make the smart machine 1.
In one implementation, the smart machine 1 can include various intelligent appliances, such as intelligent playback equipment,
Such as smart television, intelligent sound;For another example intelligent washing machine etc..In one implementation, the intelligent appliance includes intelligence electricity
Depending on here, the smart television can be included based on wireless network application technology, having open operating system and chip, possessing
Open application platform integrates the equipment of the multiple functions such as audio-visual, amusement, data, it can be achieved that two-way human-computer interaction function.
In one implementation, the smart television can include the combination of common TV and intelligent assembly, and the intelligent assembly can
To include but not limited to set-top box or disparate networks box etc.;The smart television can also include being directly integrated smart group
The smart television of part.In one implementation, the intelligent appliance can pass through wired communication mode or infrared, bluetooth
Communications is waited to establish with the Trackpad in corresponding other equipment, such as the application to communicate to connect.
In this application, the Trackpad can be an independent touch device;The Trackpad can also be integrated in
In existing remote control, such as it is embedded in existing button remote control.In one implementation, the Trackpad can be with
Trackpad including supporting single-point touch can also include supporting the Trackpad of multi-point touch.I.e. in the application, user can be single
Trackpad described in point touch-control or multi-point touch.
In this application, the display device can include display screen, such as can be one or more display screen;May be used also
To include the perspective plane projected by the projection arrangement that smart machine 1 or smart machine 1 include;It can also include display unit
Combination, such as the combination of the corresponding multiple display lamps of smart machine 1;The display device can also include above-mentioned all types of group
It closes.It, can be by Trackpad to display if display device includes display screen or perspective plane in a kind of realization method of the application
Show that information is controlled in screen or perspective plane.In a kind of realization method of the application, if display device includes display unit
Combination, it may for example comprise the combination of multiple display lamps then can control wherein one or more display lamps are corresponding to open by Trackpad
It closes.It is existing or occur from now on here, those skilled in the art are it should be understood that above-mentioned various display devices are only for example
If other kinds of display device can be suitable for the application, should also be included in the protection domain of the application, and to draw
Form is incorporated herein.
Specifically, in step S101, smart machine 1 can obtain touch operation of the user in Trackpad, wherein, institute
Trackpad is stated with smart machine 1 to match.In one implementation, the mode of the touch operation can include but is not limited to
It clicks, such as click or repeatedly clicks;Pressing, such as the pressing of different pressures degree, the pressing of different durations;It is mobile;Lift finger
Release;And the combination of above-mentioned various modes.Here, those skilled in the art are it should be understood that the side of above-mentioned touch operation
Formula is only for example, if the mode of other touch operations that is existing or occurring from now on can be suitable for the application, should also be included
In the protection domain of the application, and it is incorporated herein in the form of reference.Here, the touch operation that user submits can be
User realizes the touch of Trackpad by finger, user is can also be by other touch-control components, if stylus is to touch-control
What the touch-control of plate was realized.
In one implementation, the touch operation can be used to implement the friendship to interactive information in the display device
Interoperability, the mode of the touch operation and the implementing result of the follow-up touch operation match.For example, perform touch operation
It can be used to implement the arbitrary customized interaction behaviour such as selection, confirmation, deletion to interactive information corresponding in the display device
Make.
Here, the Trackpad matches with smart machine 1.It determines that the intelligence can be controlled by the Trackpad
Equipment 1.In one implementation, the matching method of the Trackpad and smart machine 1 can be acquiescence, such as described tactile
Control plate is one-to-one matching relationship with the smart machine 1, and pairing relationship is stablized.In another implementation, it is described
The pairing relationship of Trackpad and smart machine 1 is can in any combination, i.e., in practical applications, and the Trackpad can control not
Same smart machine, smart machine can also be controlled by different Trackpads.In this application, when the Trackpad and smart machine
1 pairing relationship determines that the operation of smart machine is remotely controlled by Trackpad to be realized.
Then, in step s 102, first position letter of the smart machine 1 based on the touch operation in the Trackpad
Breath and the Trackpad and the coordinate mapping relations of the display device of the smart machine, determine the touch operation in institute
State the second position information in display device.
In one implementation, the coordinate mapping relations of the display device of the Trackpad and the smart machine can be with
Coordinate mapping relations including the Trackpad Yu display device entirety, at this point, due to the display device with it is described touch
Control plate be it is fixed, therefore, after the coordinate mapping relations for having pre-established the Trackpad and the display device, the seat
Mark mapping relations will also be relatively fixed existing.In another implementation, the Trackpad and the smart machine is aobvious
The coordinate mapping relations of showing device can also include the coordinate mapping relations of remote control interface and the Trackpad in display device.
This, can include remote control interface in the display device, i.e. interactive information in display device is remote control interface.In a kind of realization
In mode, the remote control interface can include function selection interface, such as various control selection interfaces, taking a smart TV as an example,
It can include treating the various application controls of selection in the remote control interface;The remote control interface can also include interface of input method,
The interface of input method can include letter key, number key, symbolic key, other function keys etc., by user to interface of input method
Operation can realize the input of corresponding informance.In addition, the remote control interface other can also interact boundaries including search interface etc.
Face;The remote control interface can also include the combination of above-mentioned various interactive interfaces.Here, those skilled in the art should can manage
Solution, above-mentioned various remote control interfaces are only for example, if other kinds of remote control interface that is existing or occurring from now on can be suitable for
The application should be also included in the protection domain of the application, and be incorporated herein in the form of reference.At this point, since display fills
Remote control interface in putting can be based on practical application difference and change, so remote control interface and the Trackpad in display device
Coordinate mapping relations can also flexibly change.
Here, the coordinate mapping relations can include the location information in the display device, on the Trackpad
Have that corresponding location information is matching, for example, as first position information (x0, y0) on user's touch operation Trackpad,
Based on pre-existing coordinate mapping relations, the execution of the touch operation acts on and the first position information match
In the display device in second position information (x, y).
For example, being arranged in order multiple functionality controls for treating user's selection in the display device, user needs to find control
Part " setting ", it is only necessary to second position information match on touch operation Trackpad with control " setting " in a display device
First position information can be realized.
For another example, the display device includes a row in input method:1234567890, user wants to find key " 0 ", only needs
Want the first position information of the second position information match on touch operation Trackpad with key " 0 " in a display device can be real
It is existing.
For another example, it is still the display device and includes a row in input method:1234567890, user is intended to from current key
" 0 " goes to key " 1 ";Or the predeterminated target key of user be key " 8 ", but before there are deviation and touch operation to " 0 " correspondence
First position information.Then under above application scene, user can be by the touch operation of slip from the second position of key " 0 "
The corresponding first position information of information is moved to the corresponding first position information of second position information of key " 1 " or key " 8 ", from
And realize the selection to key " 1 " or key " 8 ".Here, company can be passed through based on the touch operation that the coordinate mapping relations perform
The continuous finger that slides is realized, without carrying out in the prior art by repeatedly pressing the operation of remote controller buttons, effectively reduces friendship
Mutually take.
Then, in step s 103, smart machine 1 is according to the touch operation and second position information control
Smart machine.
In one implementation, the control smart machine can include smart machine 1 based on the second
Confidence breath performs the touch operation.Here, the execution touch operation is in the first position information to user
On touch operation response.In one implementation, the touch operation is performed to can be used to implement to the display dress
The arbitrary customized interactive operation such as selection, confirmation, deletion of corresponding interactive information in putting.For example, it can set, the touch
Operation includes selection operation, and the mode of the touch operation includes slide, currently slides past first position on Trackpad and believes
Breath, the then touch operation performed are the interaction in the second position information selected in the corresponding display device of first position information
Information, when the remote control interface in the display device is function selection interface, when user's finger streaks current control " setting ",
Then perform the selection operation to control " setting ".For another example, it can also set, the touch operation includes confirmation operation, in one kind
In realization method, the mode of the touch operation includes pressing operation, continues the example above, for selection control " setting " into
Row confirms, that is, determines to enter the corresponding new remote control interface of selected control " setting ".In another implementation, may be used also
Include release operation in a manner that the confirmation operation is set, that is, continue the example above, when user is selected by slide
After control " setting ", completed in the first position information, by lifting the release operation of finger to control " setting " really
Recognize operation;In another implementation, the mode of the confirmation operation can also be set to further include, long when touching is more than pre-
Timing is long, performs confirmation operation automatically, that is, continues the example above, when user is first corresponding by sliding into control " setting "
After confidence breath, the residence time is more than scheduled duration in the position, then performs confirmation operation automatically.
For another example, when the remote control interface in the display device is interface of input method, user's finger currently streaks number key
" 1 " then performs the selection operation to number key " 1 ".For another example, it can also set, the touch operation includes confirmation operation, one
In kind realization method, the mode of the touch operation includes pressing operation, continues the example above, for the number key " 1 " of selection
Confirmed, that is, determine the selected number key " 1 " of input, then when user is in the matched second position information pair of number key " 1 "
After carrying out pressing operation in the first position information answered, the confirmation operation to number key " 1 " is performed;In another realization method
In, the mode of the confirmation operation can also be set to include release and operated, that is, continue the example above, when user passes through slide
After having selected number key " 1 ", completion is operated to number key " 1 " in the first position information, by lifting the release of finger
Confirmation operation;In another implementation, the mode of the confirmation operation can also be set to further include, it is long super when touching
Scheduled duration is crossed, confirmation operation is performed automatically, that is, continues the example above, when user is by sliding into number key " 1 " corresponding
After one location information, the residence time is more than scheduled duration in the position, then performs confirmation operation automatically.
In another implementation, the control smart machine 1 can also include according to the second confidence
Breath show the touch operation on said display means, if for example, the touch operation include slide, slide past
On Trackpad during each first position information, to the interactive information in display device accordingly each second position information successively into
Row distinctly displays, such as the control for being chosen to pass through in function selection interface is highlighted or changed currently quilt successively
Shape, size, color of control etc. for passing through are selected, thus, it is possible to which user is facilitated to know the process of touch operation so that man-machine
Interaction is more friendly.
In another implementation, the control smart machine can also include showing on said display means
The execution result information of the touch operation.For example, the confirmation that the touch operation includes to key corresponding in interface of input method is grasped
Make, it is alphabetical " a " based on touch operation confirmation input such as under English input state, then be in accordingly on said display means
Existing region such as inputs the letter " a " that display is selected at text cursor;For another example, under Pinyin Input state, based on touch operation
Confirmation input letter " a ", then will include in the corresponding region of interface of input method may corresponding Chinese character after the letter " a " is confirmed
Character option.For another example, the touch operation includes confirming the control " setting " of selection, that is, shows the touch operation
Execution result information is to be switched to the corresponding new remote control interface of control " setting " from current interface.
Here, those skilled in the art are it should be understood that above-mentioned according to the touch operation and the second confidence
Breath controls the mode of the smart machine to be only for example, it is existing or occur from now on other according to the touch operation and described the
If two location informations control the mode of the smart machine that can be suitable for the application, it should also be included in the protection of the application
In the range of, and be incorporated herein in the form of reference.
In one implementation, the Trackpad can support multi-point touch operation, can obtain user simultaneously at this time
Multiple touch operations in Trackpad, such as obtain the touch operation of the multiple fingers of user.For example, multiple fingers difference of user
When being moved to corresponding first position information, that is, the corresponding second confidence of each first position information is determined
Key display high-brightness in breath, such as corresponding interface of input method of each second position information, and then can be with it is anticipated that the elder generation confirmed
Sequence afterwards performs the touch operation, such as user discharges each second position successively according to each second position information
Finger in the corresponding first position information of information, to realize corresponding confirmation operation successively.
After smart machine 1 obtains touch operation of the user in the touch tablet to match with it in the application, institute will be based on
The first position information in Trackpad, and the coordinate mapping relations between combination of touch control plate and the display device of smart machine are stated,
The second position information of the touch operation in a display device is determined, so as to be based on the touch operation and described second
Location information controls the smart machine.Here, since there are the mappings of preset coordinate between display device and the Trackpad
Location information in relationship, i.e. display device, there is that corresponding location information is matching on the Trackpad, when user touches
When operating the first position information on Trackpad, based on pre-existing coordinate mapping relations, the execution of the touch operation is made
With in the display device of the first position information match in the information of the second position, if for example, described second
The interactive information for treating selection is presented on location information, user can be thus achieved in the touch operation of the first position information to this
The selection of interactive information.Therefore, based on the application, user can pass through described second in the quick locating and displaying device of Trackpad
Location information, and then realize the interactive operation to the display information in the second position information, remove from by using remote controler
On the passes intelligent appliance of button up and down operation, the application can be based on Trackpad realize to intelligent appliance into
During row control, time-consuming man-machine interaction mode is effectively avoided, improves the flexibility of human-computer interaction.
Further, compared to the existing mode based on button remote control control intelligent appliance or some be based on intelligence
Mobile phone control intelligent appliance mode, the application matched by the Trackpad with smart machine can accurately be remotely controlled it is a variety of
Smart machine simplifies user's operation, improves manipulation efficiency, improves user experience, it is thus also avoided that user's study is a variety of distant
Control the learning cost of distant control function in device or smart mobile phone.In addition, the because existing mode using mobile phone control intelligent appliance
When mobile phone screen is occupied, such as:Receiving calls, video, voice when, user can not control intelligent appliance simultaneously, and
Only when mobile phone screen does not have occupied, manipulation intelligent appliance could be carried out by the touch function of mobile phone screen, therefore, this
Kind of mode cannot be guaranteed to keep effective control to intelligent appliance at any time, and the application then can continually and steadily to intelligent appliance into
Row control so that man-machine interactive operation is more friendly.
In the application one embodiment, the method further includes step S104 (not shown), in step S104, intelligence
Equipment 1 can establish the pairing relationship of Trackpad and smart machine 1 and the display of the Trackpad and the smart machine 1
The coordinate mapping relations of device;Then, in step s 102, smart machine 1 can be based on the touch operation in the touch-control
First position information and the coordinate mapping relations in plate determine of the touch operation in the display device
Two location informations.
In one implementation, the smart machine 1 and the Trackpad can be configured with corresponding infrared function or
Thus Bluetooth function establishes the communication connection of the smart machine 1 and the Trackpad, so as to fulfill Trackpad and smart machine
The foundation of 1 pairing relationship.In one implementation, the Trackpad opens bluetooth with smart machine 1, can be by touch-control
Plate initiating equipment is searched, and finds the facility information of the smart machine 1, and then initiate pairing request to the smart machine 1,
Here, the acquiescence of smart machine 1 can be set to receive pairing, the smart machine 1 can also be set to be connect by confirmation operation
Receive pairing.In another implementation, it can also be searched by 1 initiating equipment of smart machine, find setting for the Trackpad
Standby information, and then pairing request is initiated to the Trackpad, here, the Trackpad acquiescence can be set to receive pairing, may be used also
It is matched so that the Trackpad is set to be received by confirmation operation.In one implementation, during pairing, the intelligence is set
Standby 1 gets the facility information of the Trackpad, such as identification information.
In this application, the button for the remote controler for passing through smart machine in order to avoid user is grasped to carry out cumbersome button
Make, meanwhile, in order to by interactive information in the quick locating and displaying device of touch tablet, as the positioning of control in function selection interface,
Positioning of key in interface of input method etc. reduces time overhead, can be by display device and the touch tablet according to relative scale
Scaling forms coordinate mapping relations.It in one implementation, can be by the region of touch tablet and the region of the display device
Establish one-to-one coordinate mapping relations.In a further mode of operation, can also specifically, based on remote control circle in display device
Face, by the putting in order of interactive interface unit in the region of touch tablet and the remote control interface, position relationship is established and is corresponded
Coordinate mapping relations.
A kind of citing for establishing the display device and the coordinate mapping relations of the touch tablet is as shown in Figure 6.Assuming that institute
The resolution ratio for stating touch tablet is x1*y1, and display device resolution ratio is x2*y2.Assuming that user's finger touches on touch tablet
One location information (x0, y0) then falls on the second position information (x, y) in display device.Its calculation formula:
It can obtain
It can obtain
Thus, it is possible to the coordinate mapping relations of the display device and the touch tablet are obtained.In a kind of realization method
In, based on the coordinate mapping relations, each location information in display device can be looked in the touch tablet
To the location information of maps mutually.In another implementation, based on the coordinate mapping relations, display device can also be set
In pieces of position information the location information of maps mutually can be found in the touch tablet, for example, based in display device
The corresponding location information of remote control interface establishes the coordinate mapping relations.
Here, those skilled in the art are it should be understood that the above-mentioned seat for establishing the display device and the touch tablet
The mode of mark mapping relations is only for example, it is existing or occur from now on other establish the seat of the display device and the touch tablet
It can be suitable for the application if marking the mode of mapping relations, should also be included in the protection domain of the application, and with reference
Form be incorporated herein.
In one implementation, the coordinate mapping relations in the display device between remote control interface and the touch tablet
Establish the method for building up that can also refer to the whole coordinate mapping relations with the touch tablet of the display device.
In one embodiment, in step S104, the pairing relationship of Trackpad and smart machine 1 can first be established;It connects
It, works as successful matching, establish the Trackpad and the coordinate mapping relations of the display device of the smart machine 1.Actually should
In, since the foundation of coordinate mapping relations needs the specification of equipment in view of the Trackpad with the smart machine 1, because
This, can establish pairing relationship and then establish the Trackpad and the coordinate mapping of the display device of the smart machine 1
Relationship.Further, in one embodiment, it is described to establish the Trackpad and the coordinate of the display device of the smart machine reflects
The relationship of penetrating includes:Obtain the touch area information of the Trackpad;According to the touch area information and the smart machine 1
The display region information of display device establishes the coordinate mapping relations of the Trackpad and the display device.
In one implementation, the touch area information can include but is not limited to the touch area of the Trackpad
Size information, shape information, directional information etc..In one implementation, the smart machine 1 can with the touch-control
Plate establish pairing relationship during, get the touch area information that the Trackpad is sent;Alternatively, the smart machine 1 can
After pairing relationship is established with the Trackpad, the touch-control is actively submitted to Trackpad request or Trackpad
Area information.In another implementation, the touch area information for obtaining the Trackpad can also be based on pairing
History, the information for being retained in smart machine 1, being directly read when pairing again.In another implementation, the acquisition
The touch area information of the Trackpad can also include sending to the 1 corresponding network equipment of smart machine to be touched about described
The touch area inquiry request of plate is controlled, wherein, the touch area inquiry request includes the identification information of the Trackpad;Into
And receive the touch area information of Trackpad that the network equipment is returned based on the touch area inquiry request, described.
In a kind of realization method, the network equipment can include the 1 corresponding cloud database of smart machine, here, the cloud
Client database can manage numerous smart machines including smart machine 1, further, can in the cloud database
Uploaded in store history or based on connect with the smart machine 1 or other smart machine history and described in preserving
The touch area information of Trackpad, therefore, the identification information including the Trackpad based on the initiation of current smart machine 1 are touched
Site polling request is controlled, the network equipment can return to the touch area information of the Trackpad.
In one implementation, the display region information of the display device of the smart machine 1 can include but unlimited
Correlation in the display screen of the display device, perspective plane or display lamp region or the display area of above-mentioned all kinds of combinations
Information.If for example, the display device includes display screen, the display region information can include but is not limited to the display
Size information, shape information, directional information of screen etc..For another example, if the display device includes perspective plane, the display area
Information can include but is not limited to the size information, shape information, directional information on the perspective plane etc., in a kind of realization method
In, the size information on the perspective plane can be by 1 corresponding projection arrangement of smart machine, such as external projector or internal projection
The settings such as component as the resolution ratio of projection is provided in projection arrangement, and after projector distance is determined, calculate corresponding perspective plane
Size information.In addition, in one implementation, the display region information of the display device of the smart machine 1 can be from
It is directly read in the configuration information of the smart machine 1;The display region information of the display device of the smart machine 1 can be from this
It is read in 1 corresponding other equipment of smart machine, such as the corresponding display area letter in perspective plane is read from extraneous projection device
Breath.
In the application one embodiment, the method further includes step S105 (not shown), in step S105, intelligence
Equipment 1 establishes the coordinate mapping relations of remote control interface and the Trackpad in the display device;Wherein, in the S102, intelligence
Can equipment 1 based on first position information of the touch operation in the Trackpad and the Trackpad and the remote control
The coordinate mapping relations at interface determine second position information of the touch operation in the display device.
Here, can include remote control interface in the display device, i.e., the interactive information in display device is remote control interface.
In one implementation, the remote control interface can include function selection interface, such as various control selection interfaces, with intelligence
It can include treating the various application controls of selection for TV, in the remote control interface;The remote control interface can also include defeated
Enter method interface, the interface of input method can include letter key, number key, symbolic key, other function keys etc., by user to defeated
The input of corresponding informance can be realized by entering the operation at method interface.In addition, the remote control interface can also including search interface etc. its
His interactive interface;The remote control interface can also include the combination of above-mentioned various interactive interfaces.
In this application, the button for the remote controler for passing through smart machine in order to avoid user is grasped to carry out cumbersome button
Make, meanwhile, in order to by interactive information in the quick locating and displaying device of touch tablet, as the positioning of control in function selection interface,
Positioning of key in interface of input method etc. reduces time overhead, can be by display device and the touch tablet according to relative scale
Scaling forms coordinate mapping relations.In one implementation, the region of touch tablet can be interacted with the remote control interface
The putting in order of boundary element, position relationship establishes one-to-one coordinate mapping relations, described by taking function selection interface as an example
Interactive interface unit can include various application controls;By taking interface of input method as an example, the interactive interface unit can include defeated
Enter each letter key in method interface, number key, symbolic key, other function keys etc..
Fig. 8 shows a kind of exemplary plot that smart machine 1 is remotely controlled by Trackpad according to the application one embodiment,
In, the smart machine 1 can be smart television, the display device of the smart television, on the remote control interface in display screen
Multiple functionality controls for treating user's selection, such as locally applied, video, e-book, picture ... control in figure have been arranged in order,
The coordinate mapping relations of remote control interface and the Trackpad in the display device are established, i.e., so that each control is based on it
Corresponding position information matches on location information in the remote control interface, with the Trackpad.For example, " locally applied "
The corresponding first position information match on Trackpad that second position information where control is directed toward with dotted line in figure.Into
And if user needs to select the control " locally applied " in display device, it is only necessary to " local with control on touch operation Trackpad
Using " the first position information of second position information match in a display device can be realized.
A kind of citing for establishing remote control interface and the coordinate mapping relations of the touch tablet in the display device can also
With reference to shown in figure 7.Assuming that the resolution ratio of the touch tablet is x1*y1, display device resolution ratio is x2*y2.Assuming that user's finger
Touch the first position information (x0, y0) on touch tablet, then fall on remote control interface in display device second position information (x,
y).Its calculation formula:
It can obtain
It can obtain
Thus, it is possible to the remote control interface of the display device and the coordinate mapping relations of the touch tablet are obtained.Here,
The remote control interface can take up the part or all of band of position of the display screen.
Here, those skilled in the art it should be understood that the above-mentioned remote control interface for establishing the display device with it is described
The mode of the coordinate mapping relations of touch tablet is only for example, it is existing or occur from now on other establish the remote control of the display device
If interface and the mode of the coordinate mapping relations of the touch tablet can be suitable for the application, it should also be included in the application's
In protection domain, and it is incorporated herein in the form of reference.
Further, in one embodiment, in step S105, smart machine 1 can work as to be remotely controlled in the display device
Interface is updated, and establishes the coordinate mapping relations of remote control interface and Trackpad in the display device.It in practical applications, can be with
When being arranged on the switching of remote control interface, the coordinate mapping relations are re-established.For example, the selection variation input method based on user
After the pattern at interface, the coordinate mapping relations re-establish, for another example, if having selected one in function selection interface to apply
Control, hence into the interface of the application, then current remote control interface is switched, is changed, and can also be re-established described
Coordinate mapping relations.Thus, it is possible to ensure matching degree and the accuracy of man-machine interactive operation, friendly user experience is brought.
In one embodiment, in step S105, smart machine 1 establish in the display device remote control interface with it is described
The coordinate mapping relations of effective touch area in Trackpad.In practical applications, it can be based in Trackpad partly or entirely
The coordinate mapping relations with remote control interface in the display device are established in touch area.If effective touch area is partial touch area
Domain, the then touch operation that user implements in the region are just effective;If effective touch area includes whole touch areas, user exists
The touch operation that whole touch areas of the Trackpad are implemented is all effective.
Further, in one embodiment, the method further includes step S106 (not shown), in step s 106, intelligence
Energy equipment 1 works as first position information of the touch operation in the Trackpad except effective touch area, provides
Corresponding operation prompt information.In one implementation, what the operation prompt information can be used for prompting user current touches
It touches zone void or guiding user enters effective touch area to perform effective touch operation etc..For example, it can prompt
" effective interaction area please be click " or prompting " please moving touch operation to xx directions " etc..In one implementation, the behaviour
The modes such as picture and text prompting in voice prompt, display device are can include but is not limited to as prompt message.
In one embodiment, the shape of effective touch area and the shape of the remote control interface match.
In practical applications, in display device remote control interface shape, as function selection interface, interface of input method be laid out
Shape can be different, and then, the shape of effective touch area to match can be set based on the shape of the remote control interface.And
And the remote control interface can be presented on any position in the display device.Fig. 5 is shown according to one implementation of the application
Several groups of examples that the shape of effective touch area of the Trackpad of example and the shape of the remote control interface of display device match.Its
In, the remote control interface can take up a part of region of whole display device or presentation in a display device.In a kind of reality
In existing mode, can middle remote control interface according to the display device shape, adjust in Trackpad the effectively layout of touch area, example
Such as:The shape of the remote control interface is rectangular, and the shape of effective touch area of Trackpad can be preferably rectangular, builds as a result,
Vertical mapping relations are more accurate, and it is higher to touch precision;For another example, the shape of the remote control interface is oval, Trackpad
Effective coverage can also be rectangle.In one implementation, even if the shape of effective touch area and the remote control interface
Shape it is not exactly the same, the mapping relations that both can also be established.
In one embodiment, the second position information includes one or more interactions on remote control interface in display device
The location information of boundary element.In one implementation, the interactive interface unit is to be supplied to use in the remote control interface
Family performs the effective object of interactive operation.For example, in function selection interface, the control each applied can be an interaction
Boundary element;For another example, in interface of input method, each key, such as letter key, number key, symbolic key, other function keys all may be used
To correspond to an interactive interface unit.Here, the second position information can correspond only to include being remotely controlled in display device
The location information of an interactive interface unit on interface can also correspond to the location information of multiple interactive interface units simultaneously.
Further, in one embodiment, in the step S103, smart machine 1 can be according to the second position
Information, one or more of interactive interface units corresponding to the second position information perform the touch operation.
Specifically, in one implementation, if there are one the corresponding interactive interface units of the second position information,
The touch operation is then performed to be used directly for realizing that the selection to the interactive interface unit, confirmation, deletion etc. are arbitrarily made by oneself
The interactive operation of justice.For example, can set, the touch operation includes selection operation, and the mode of the touch operation includes sliding
Operation, currently slides past first position information on touch tablet, then the touch operation performed is selects the first position information pair
The interactive information in the information of the second position in the display device answered, for example, when the remote control interface in the display device is defeated
Enter method interface, user's finger currently streaks number key " 1 ", then performs the selection operation to number key " 1 ".
In another implementation, if the second position information includes multiple interactions on remote control interface in display device
The location information of boundary element;Wherein, in step s 103, smart machine 1 can be according to the second position information, to described
Information corresponding the multiple interactive interface unit in the second position performs the touch operation;User is obtained in the Trackpad
Selection operation;The selection operation is performed to realize the multiple interactive interface unit corresponding to the second position information
The selection of middle target interactive interface unit.
In one implementation, if user is expected to choose the corresponding multiple interactive interface units of the second position information
In some or several target interactive interface units, then smart machine 1 is according to the second position information, to the second position
The result that the corresponding the multiple interactive interface unit of information performs the touch operation has been locked out the second position information.
And then can on the basis of the touch operation, by user in the Trackpad further touch control operation, that is, select
Operation, to realize the selection to target interactive interface unit.
For example, when the second position information corresponds in interface of input method the position of two keys, while highlight the two
Key, then touched again by upper and lower or left and right, select the key of one of them;Similarly, when the second position information correspond to it is defeated
When entering in method interface the adjacent position of four keys, while this four keys are highlighted, then by touching again up and down, selection is wherein
One of key.Those skilled in the art it should be understood that above-mentioned selection operation is only for example, it is existing or occur from now on other
If selection operation can be suitable for the application, should also be included in the protection domain of the application, and the packet in the form of reference
Contained in this.
For another example, if there is multiple target interaction circles in the corresponding multiple interactive interface units of the second position information
Face unit, such as second position information correspond to multiple keys in interface of input method, and wherein have part key needs continuously to wait to choose,
Then at this point it is possible to be expected selected order based on each target interactive interface unit, the continuous multiple selections behaviour for obtaining user
Make.Such as, when the second position information corresponds in interface of input method the position of two keys, and two keys are that user is expected to connect
When continuing two keys chosen, while the two keys are highlighted, at this point, the touch operation is actually to the second position information
The locking of corresponding two keys, then touched again by upper and lower or left and right, the preceding object key of order of preference, the selection operation
Weight operation or release operation are can include but is not limited to, after completing primary selection, that is, confirmed an object key, and then can be with
Further carry out the selection operation of next object key, if for example, the selection operation include weight operation, can not release
Let go finger in the case of, continue through up and down or left and right touch again, the posterior object key of order of preference, again perform weight behaviour
Make, complete the selection operation of the posterior object key of the order;For another example, if the selection operation includes release and operates, then may be used
It is touched again in preset operational use time, continuing through upper and lower or left and right, the posterior object key of order of preference, again
Release operation is performed, completes the selection operation of the posterior object key of the order.Those skilled in the art it should be understood that on
It states selection operation to be only for example, if other selection operations existing or occur from now on can be suitable for the application, should also wrap
It is contained in the protection domain of the application, and is incorporated herein in the form of reference.
Present invention also provides a kind of methods for being remotely controlled smart machine on the touch pad.The method can be in the touch-control
It is realized in plate.Fig. 2 shows a kind of method schematic diagrams that smart machine is remotely controlled by Trackpad according to the application one embodiment.
The method includes the steps S201 ', step S202 ', step S101 ', step S102 ' and step S103 '.
Wherein, in step S201 ', Trackpad 2 can receive touch operation of the user in Trackpad 2;Then, in step
In rapid S202 ', the touch operation can be sent to corresponding smart machine 1 by Trackpad 2, wherein, the Trackpad and institute
Stating the display device of smart machine, there are coordinate mapping relations;Then, in step S101 ', smart machine 1 can obtain user
Touch operation in Trackpad 2, wherein, the Trackpad 2 matches with smart machine 1;Then, in step S102 ', intelligence
Energy equipment 1 can be based on first position information of the touch operation in the Trackpad 2 and the Trackpad 2 and institute
The coordinate mapping relations of the display device of smart machine 1 are stated, determine second of the touch operation in the display device
Confidence ceases;Then, in step S103 ', smart machine 1 can be controlled according to the touch operation and the second position information
The smart machine 1.Here, the Trackpad 2 can correspond to Trackpad described in Fig. 1 embodiments.Here, the step
Step S101 ', step S102 ', step S103 ' and step S101 ' in Fig. 1, step S102, step S103 content is identical or phase
Seemingly, details are not described herein, and is incorporated herein in the form of reference.
Here, compared to the existing mode based on button remote control control intelligent appliance or some be based on intelligent hand
Machine control intelligent appliance mode, the application matched by the Trackpad 2 with smart machine 1 can accurately be remotely controlled it is a variety of
Smart machine simplifies user's operation, improves manipulation efficiency, improves user experience, it is thus also avoided that user's study is a variety of distant
Control the learning cost of distant control function in device or smart mobile phone.In addition, the because existing mode using mobile phone control intelligent appliance
When mobile phone screen is occupied, such as:Receiving calls, video, voice when, user can not control intelligent appliance simultaneously, and
Only when mobile phone screen does not have occupied, manipulation intelligent appliance could be carried out by the touch function of mobile phone screen, therefore, this
Kind of mode cannot be guaranteed to keep effective control to intelligent appliance at any time, and the application then can continually and steadily to intelligent appliance into
Row control so that man-machine interactive operation is more friendly.
Further, in one embodiment, the method further includes step S203 ' (not shown), in step S203 ',
The pairing relationship of Trackpad and smart machine can be established;Then, in step S202 ', Trackpad 2 can grasp described touch
The smart machine that pairing relationship is established with the Trackpad is sent to, wherein, the Trackpad and the smart machine
There are coordinate mapping relations for display device.Here, the Trackpad matches with smart machine 1.Determining can be by described
Trackpad controls the smart machine 1.In one implementation, the matching method of the Trackpad and smart machine 1 can be with
It is acquiescence, such as the Trackpad and the smart machine 1 are one-to-one matching relationships, pairing relationship is stablized.Another
In a kind of realization method, the pairing relationship of the Trackpad and smart machine 1 be can in any combination, i.e., in practical applications,
The Trackpad can control different smart machines, and smart machine can also be controlled by different Trackpads.In this application, when
The Trackpad determines that the operation of smart machine is remotely controlled by Trackpad to be realized with 1 pairing relationship of smart machine.
In one implementation, the smart machine 1 and the Trackpad 2 can be configured with corresponding infrared function or
Thus Bluetooth function establishes the communication connection of the smart machine 1 and the Trackpad 2, set so as to fulfill Trackpad 2 and intelligence
The foundation of standby 1 pairing relationship.In one implementation, the Trackpad 2 opens bluetooth, Ke Yiyou with smart machine 1
2 initiating equipment of Trackpad is searched, and finds the facility information of the smart machine 1, and then initiate to match to the smart machine 1
Request here, the acquiescence of smart machine 1 can be set to receive pairing, can also set the smart machine 1 to be grasped by confirming
Make to receive pairing.In another implementation, it can also be searched by 1 initiating equipment of smart machine, find the Trackpad 2
Facility information, and then initiate pairing request to the Trackpad 2, match here, the Trackpad 2 acquiescence can be set to receive
It is right, the Trackpad 2 can also be set to be received by confirmation operation and matched.In one implementation, during pairing, institute
The smart machine 1 can be sent to by its facility information, such as identification information by stating Trackpad 2.
This application provides a kind of smart machines 1 being remotely controlled by Trackpad.Fig. 3 is shown according to the application one side
A kind of equipment schematic diagram for the smart machine 1 being remotely controlled by Trackpad.Wherein, smart machine 1 includes acquisition device 301, determines
Device 302 and control device 303.Wherein, acquisition device 301 can obtain touch operation of the user in Trackpad, wherein, institute
Trackpad is stated with smart machine 1 to match;Determining device 302 can be based on the touch operation first in the Trackpad
Location information and the Trackpad and the coordinate mapping relations of the display device of the smart machine 1 determine that described touch is grasped
Make the second position information in the display device;Control device 303 can be according to the touch operation and the second
Confidence breath controls the smart machine 1.
In one implementation, the smart machine 1 can include various intelligent appliances, such as intelligent playback equipment,
Such as smart television, intelligent sound;For another example intelligent washing machine etc..In one implementation, the intelligent appliance includes intelligence electricity
Depending on here, the smart television can be included based on wireless network application technology, having open operating system and chip, possessing
Open application platform integrates the equipment of the multiple functions such as audio-visual, amusement, data, it can be achieved that two-way human-computer interaction function.
In one implementation, the smart television can include the combination of common TV and intelligent assembly, and the intelligent assembly can
To include but not limited to set-top box or disparate networks box etc.;The smart television can also include being directly integrated smart group
The smart television of part.In one implementation, the intelligent appliance can pass through wired communication mode or infrared, bluetooth
Communications is waited to establish with the Trackpad in corresponding other equipment, such as the application to communicate to connect.
In this application, the Trackpad can be an independent touch device;The Trackpad can also be integrated in
In existing remote control, such as it is embedded in existing button remote control.In one implementation, the Trackpad can be with
Trackpad including supporting single-point touch can also include supporting the Trackpad of multi-point touch.I.e. in the application, user can be single
Trackpad described in point touch-control or multi-point touch.
In this application, the display device can include display screen, such as can be one or more display screen;May be used also
To include the perspective plane projected by the projection arrangement that smart machine 1 or smart machine 1 include;It can also include display unit
Combination, such as the combination of the corresponding multiple display lamps of smart machine 1;The display device can also include above-mentioned all types of group
It closes.It, can be by Trackpad to display if display device includes display screen or perspective plane in a kind of realization method of the application
Show that information is controlled in screen or perspective plane.In a kind of realization method of the application, if display device includes display unit
Combination, it may for example comprise the combination of multiple display lamps then can control wherein one or more display lamps are corresponding to open by Trackpad
It closes.It is existing or occur from now on here, those skilled in the art are it should be understood that above-mentioned various display devices are only for example
If other kinds of display device can be suitable for the application, should also be included in the protection domain of the application, and to draw
Form is incorporated herein.
Specifically, touch operation of the user in Trackpad can be obtained in acquisition device 301, wherein, the Trackpad
Match with smart machine 1.In one implementation, the mode of the touch operation can include but is not limited to click, such as
It clicks or repeatedly clicks;Pressing, such as the pressing of different pressures degree, the pressing of different durations;It is mobile;Lift finger release;With
And the combination of above-mentioned various modes.Here, those skilled in the art are it should be understood that the mode of above-mentioned touch operation is only to lift
Example if the mode of other touch operations that is existing or occurring from now on can be suitable for the application, should also be included in the application
Protection domain in, and be incorporated herein in the form of reference.Here, the touch operation that user submits can be that user passes through
Finger realizes the touch of Trackpad, user is can also be by other touch-control components, if stylus is to the touch-control of Trackpad
It realizes.
In one implementation, the touch operation can be used to implement the friendship to interactive information in the display device
Interoperability, the mode of the touch operation and the implementing result of the follow-up touch operation match.For example, perform touch operation
It can be used to implement the arbitrary customized interaction behaviour such as selection, confirmation, deletion to interactive information corresponding in the display device
Make.
Here, the Trackpad matches with smart machine 1.It determines that the intelligence can be controlled by the Trackpad
Equipment 1.In one implementation, the matching method of the Trackpad and smart machine 1 can be acquiescence, such as described tactile
Control plate is one-to-one matching relationship with the smart machine 1, and pairing relationship is stablized.In another implementation, it is described
The pairing relationship of Trackpad and smart machine 1 is can in any combination, i.e., in practical applications, and the Trackpad can control not
Same smart machine, smart machine can also be controlled by different Trackpads.In this application, when the Trackpad and smart machine
1 pairing relationship determines that the operation of smart machine is remotely controlled by Trackpad to be realized.
Where it determines that device 302 can based on first position information of the touch operation in the Trackpad and
The Trackpad and the coordinate mapping relations of the display device of the smart machine determine the touch operation in the display dress
Second position information in putting.
In one implementation, the coordinate mapping relations of the display device of the Trackpad and the smart machine can be with
Coordinate mapping relations including the Trackpad Yu display device entirety, at this point, due to the display device with it is described touch
Control plate be it is fixed, therefore, after the coordinate mapping relations for having pre-established the Trackpad and the display device, the seat
Mark mapping relations will also be relatively fixed existing.In another implementation, the Trackpad and the smart machine is aobvious
The coordinate mapping relations of showing device can also include the coordinate mapping relations of remote control interface and the Trackpad in display device.
This, can include remote control interface in the display device, i.e. interactive information in display device is remote control interface.In a kind of realization
In mode, the remote control interface can include function selection interface, such as various control selection interfaces, taking a smart TV as an example,
It can include treating the various application controls of selection in the remote control interface;The remote control interface can also include interface of input method,
The interface of input method can include letter key, number key, symbolic key, other function keys etc., by user to interface of input method
Operation can realize the input of corresponding informance.In addition, the remote control interface other can also interact boundaries including search interface etc.
Face;The remote control interface can also include the combination of above-mentioned various interactive interfaces.Here, those skilled in the art should can manage
Solution, above-mentioned various remote control interfaces are only for example, if other kinds of remote control interface that is existing or occurring from now on can be suitable for
The application should be also included in the protection domain of the application, and be incorporated herein in the form of reference.At this point, since display fills
Remote control interface in putting can be based on practical application difference and change, so remote control interface and the Trackpad in display device
Coordinate mapping relations can also flexibly change.
Here, the coordinate mapping relations can include the location information in the display device, on the Trackpad
Have that corresponding location information is matching, for example, as first position information (x0, y0) on user's touch operation Trackpad,
Based on pre-existing coordinate mapping relations, the execution of the touch operation acts on and the first position information match
In the display device in second position information (x, y).
For example, being arranged in order multiple functionality controls for treating user's selection in the display device, user needs to find control
Part " setting ", it is only necessary to second position information match on touch operation Trackpad with control " setting " in a display device
First position information can be realized.
For another example, the display device includes a row in input method:1234567890, user wants to find key " 0 ", only needs
Want the first position information of the second position information match on touch operation Trackpad with key " 0 " in a display device can be real
It is existing.
For another example, it is still the display device and includes a row in input method:1234567890, user is intended to from current key
" 0 " goes to key " 1 ";Or the predeterminated target key of user be key " 8 ", but before there are deviation and touch operation to " 0 " correspondence
First position information.Then under above application scene, user can be by the touch operation of slip from the second position of key " 0 "
The corresponding first position information of information is moved to the corresponding first position information of second position information of key " 1 " or key " 8 ", from
And realize the selection to key " 1 " or key " 8 ".Here, company can be passed through based on the touch operation that the coordinate mapping relations perform
The continuous finger that slides is realized, without carrying out in the prior art by repeatedly pressing the operation of remote controller buttons, effectively reduces friendship
Mutually take.
Here, control device 303 controls the smart machine according to the touch operation and the second position information.
In one implementation, the control smart machine can include smart machine 1 based on the second
Confidence breath performs the touch operation.Here, the execution touch operation is in the first position information to user
On touch operation response.In one implementation, the touch operation is performed to can be used to implement to the display dress
The arbitrary customized interactive operation such as selection, confirmation, deletion of corresponding interactive information in putting.For example, it can set, the touch
Operation includes selection operation, and the mode of the touch operation includes slide, currently slides past first position on Trackpad and believes
Breath, the then touch operation performed are the interaction in the second position information selected in the corresponding display device of first position information
Information, when the remote control interface in the display device is function selection interface, when user's finger streaks current control " setting ",
Then perform the selection operation to control " setting ".For another example, it can also set, the touch operation includes confirmation operation, in one kind
In realization method, the mode of the touch operation includes pressing operation, continues the example above, for selection control " setting " into
Row confirms, that is, determines to enter the corresponding new remote control interface of selected control " setting ".In another implementation, may be used also
Include release operation in a manner that the confirmation operation is set, that is, continue the example above, when user is selected by slide
After control " setting ", completed in the first position information, by lifting the release operation of finger to control " setting " really
Recognize operation;In another implementation, the mode of the confirmation operation can also be set to further include, long when touching is more than pre-
Timing is long, performs confirmation operation automatically, that is, continues the example above, when user is first corresponding by sliding into control " setting "
After confidence breath, the residence time is more than scheduled duration in the position, then performs confirmation operation automatically.
For another example, when the remote control interface in the display device is interface of input method, user's finger currently streaks number key
" 1 " then performs the selection operation to number key " 1 ".For another example, it can also set, the touch operation includes confirmation operation, one
In kind realization method, the mode of the touch operation includes pressing operation, continues the example above, for the number key " 1 " of selection
Confirmed, that is, determine the selected number key " 1 " of input, then when user is in the matched second position information pair of number key " 1 "
After carrying out pressing operation in the first position information answered, the confirmation operation to number key " 1 " is performed;In another realization method
In, the mode of the confirmation operation can also be set to include release and operated, that is, continue the example above, when user passes through slide
After having selected number key " 1 ", completion is operated to number key " 1 " in the first position information, by lifting the release of finger
Confirmation operation;In another implementation, the mode of the confirmation operation can also be set to further include, it is long super when touching
Scheduled duration is crossed, confirmation operation is performed automatically, that is, continues the example above, when user is by sliding into number key " 1 " corresponding
After one location information, the residence time is more than scheduled duration in the position, then performs confirmation operation automatically.
In another implementation, the control smart machine 1 can also include according to the second confidence
Breath show the touch operation on said display means, if for example, the touch operation include slide, slide past
On Trackpad during each first position information, to the interactive information in display device accordingly each second position information successively into
Row distinctly displays, such as the control for being chosen to pass through in function selection interface is highlighted or changed currently quilt successively
Shape, size, color of control etc. for passing through are selected, thus, it is possible to which user is facilitated to know the process of touch operation so that man-machine
Interaction is more friendly.
In another implementation, the control smart machine can also include showing on said display means
The execution result information of the touch operation.For example, the confirmation that the touch operation includes to key corresponding in interface of input method is grasped
Make, it is alphabetical " a " based on touch operation confirmation input such as under English input state, then be in accordingly on said display means
Existing region such as inputs the letter " a " that display is selected at text cursor;For another example, under Pinyin Input state, based on touch operation
Confirmation input letter " a ", then will include in the corresponding region of interface of input method may corresponding Chinese character after the letter " a " is confirmed
Character option.For another example, the touch operation includes confirming the control " setting " of selection, that is, shows the touch operation
Execution result information is to be switched to the corresponding new remote control interface of control " setting " from current interface.
Here, those skilled in the art are it should be understood that above-mentioned according to the touch operation and the second confidence
Breath controls the mode of the smart machine to be only for example, it is existing or occur from now on other according to the touch operation and described the
If two location informations control the mode of the smart machine that can be suitable for the application, it should also be included in the protection of the application
In the range of, and be incorporated herein in the form of reference.
In one implementation, the Trackpad can support multi-point touch operation, can obtain user simultaneously at this time
Multiple touch operations in Trackpad, such as obtain the touch operation of the multiple fingers of user.For example, multiple fingers difference of user
When being moved to corresponding first position information, that is, the corresponding second confidence of each first position information is determined
Key display high-brightness in breath, such as corresponding interface of input method of each second position information, and then can be with it is anticipated that the elder generation confirmed
Sequence afterwards performs the touch operation, such as user discharges each second position successively according to each second position information
Finger in the corresponding first position information of information, to realize corresponding confirmation operation successively.
After smart machine 1 obtains touch operation of the user in the touch tablet to match with it in the application, institute will be based on
The first position information in Trackpad, and the coordinate mapping relations between combination of touch control plate and the display device of smart machine are stated,
The second position information of the touch operation in a display device is determined, so as to be based on the touch operation and described second
Location information controls the smart machine.Here, since there are the mappings of preset coordinate between display device and the Trackpad
Location information in relationship, i.e. display device, there is that corresponding location information is matching on the Trackpad, when user touches
When operating the first position information on Trackpad, based on pre-existing coordinate mapping relations, the execution of the touch operation is made
With in the display device of the first position information match in the information of the second position, if for example, described second
The interactive information for treating selection is presented on location information, user can be thus achieved in the touch operation of the first position information to this
The selection of interactive information.Therefore, based on the application, user can pass through described second in the quick locating and displaying device of Trackpad
Location information, and then realize the interactive operation to the display information in the second position information, remove from by using remote controler
On the passes intelligent appliance of button up and down operation, the application can be based on Trackpad realize to intelligent appliance into
During row control, time-consuming man-machine interaction mode is effectively avoided, improves the flexibility of human-computer interaction.
Further, compared to the existing mode based on button remote control control intelligent appliance or some be based on intelligence
Mobile phone control intelligent appliance mode, the application matched by the Trackpad with smart machine can accurately be remotely controlled it is a variety of
Smart machine simplifies user's operation, improves manipulation efficiency, improves user experience, it is thus also avoided that user's study is a variety of distant
Control the learning cost of distant control function in device or smart mobile phone.In addition, the because existing mode using mobile phone control intelligent appliance
When mobile phone screen is occupied, such as:Receiving calls, video, voice when, user can not control intelligent appliance simultaneously, and
Only when mobile phone screen does not have occupied, manipulation intelligent appliance could be carried out by the touch function of mobile phone screen, therefore, this
Kind of mode cannot be guaranteed to keep effective control to intelligent appliance at any time, and the application then can continually and steadily to intelligent appliance into
Row control so that man-machine interactive operation is more friendly.
In the application one embodiment, the smart machine 1 further includes first and establishes device (not shown), and described first
Establish device can establish Trackpad and smart machine 1 pairing relationship and the Trackpad and the smart machine 1 it is aobvious
The coordinate mapping relations of showing device;Where it determines that device 302 can be based on the touch operation first in the Trackpad
Location information and the coordinate mapping relations determine second position information of the touch operation in the display device.
In one implementation, the smart machine 1 and the Trackpad can be configured with corresponding infrared function or
Thus Bluetooth function establishes the communication connection of the smart machine 1 and the Trackpad, so as to fulfill Trackpad and smart machine
The foundation of 1 pairing relationship.In one implementation, the Trackpad opens bluetooth with smart machine 1, can be by touch-control
Plate initiating equipment is searched, and finds the facility information of the smart machine 1, and then initiate pairing request to the smart machine 1,
Here, the acquiescence of smart machine 1 can be set to receive pairing, the smart machine 1 can also be set to be connect by confirmation operation
Receive pairing.In another implementation, it can also be searched by 1 initiating equipment of smart machine, find setting for the Trackpad
Standby information, and then pairing request is initiated to the Trackpad, here, the Trackpad acquiescence can be set to receive pairing, may be used also
It is matched so that the Trackpad is set to be received by confirmation operation.In one implementation, during pairing, the intelligence is set
Standby 1 gets the facility information of the Trackpad, such as identification information.
In this application, the button for the remote controler for passing through smart machine in order to avoid user is grasped to carry out cumbersome button
Make, meanwhile, in order to by interactive information in the quick locating and displaying device of touch tablet, as the positioning of control in function selection interface,
Positioning of key in interface of input method etc. reduces time overhead, can be by display device and the touch tablet according to relative scale
Scaling forms coordinate mapping relations.It in one implementation, can be by the region of touch tablet and the region of the display device
Establish one-to-one coordinate mapping relations.In a further mode of operation, can also specifically, based on remote control circle in display device
Face, by the putting in order of interactive interface unit in the region of touch tablet and the remote control interface, position relationship is established and is corresponded
Coordinate mapping relations.
A kind of citing for establishing the display device and the coordinate mapping relations of the touch tablet is as shown in Figure 6.Assuming that institute
The resolution ratio for stating touch tablet is x1*y1, and display device resolution ratio is x2*y2.Assuming that user's finger touches on touch tablet
One location information (x0, y0) then falls on the second position information (x, y) in display device.Its calculation formula:
It can obtain
It can obtain
Thus, it is possible to the coordinate mapping relations of the display device and the touch tablet are obtained.In a kind of realization method
In, based on the coordinate mapping relations, each location information in display device can be looked in the touch tablet
To the location information of maps mutually.In another implementation, based on the coordinate mapping relations, display device can also be set
In pieces of position information the location information of maps mutually can be found in the touch tablet, for example, based in display device
The corresponding location information of remote control interface establishes the coordinate mapping relations.
Here, those skilled in the art are it should be understood that the above-mentioned seat for establishing the display device and the touch tablet
The mode of mark mapping relations is only for example, it is existing or occur from now on other establish the seat of the display device and the touch tablet
It can be suitable for the application if marking the mode of mapping relations, should also be included in the protection domain of the application, and with reference
Form be incorporated herein.
In one implementation, the coordinate mapping relations in the display device between remote control interface and the touch tablet
Establish the method for building up that can also refer to the whole coordinate mapping relations with the touch tablet of the display device.
In one embodiment, it described first establishes device and can first establish the pairing relationship of Trackpad and smart machine 1;
Then, work as successful matching, establish the Trackpad and the coordinate mapping relations of the display device of the smart machine 1.In reality
In, since the foundation of coordinate mapping relations needs the specification of equipment in view of the Trackpad with the smart machine 1, because
This, can establish pairing relationship and then establish the Trackpad and the coordinate mapping of the display device of the smart machine 1
Relationship.Further, in one embodiment, it is described to establish the Trackpad and the coordinate of the display device of the smart machine reflects
The relationship of penetrating includes:Obtain the touch area information of the Trackpad;According to the touch area information and the smart machine
The display region information of display device establishes the coordinate mapping relations of the Trackpad and the display device.
In one implementation, the touch area information can include but is not limited to the touch area of the Trackpad
Size information, shape information, directional information etc..In one implementation, the smart machine 1 can with the touch-control
Plate establish pairing relationship during, get the touch area information that the Trackpad is sent;Alternatively, the smart machine 1 can
After pairing relationship is established with the Trackpad, the touch-control is actively submitted to Trackpad request or Trackpad
Area information.In another implementation, the touch area information for obtaining the Trackpad can also be based on pairing
History, the information for being retained in smart machine 1, being directly read when pairing again.In another implementation, the acquisition
The touch area information of the Trackpad can also include sending to the 1 corresponding network equipment of smart machine to be touched about described
The touch area inquiry request of plate is controlled, wherein, the touch area inquiry request includes the identification information of the Trackpad;Into
And receive the touch area information of Trackpad that the network equipment is returned based on the touch area inquiry request, described.
In a kind of realization method, the network equipment can include the 1 corresponding cloud database of smart machine, here, the cloud
Client database can manage numerous smart machines including smart machine 1, further, can in the cloud database
Uploaded in store history or based on connect with the smart machine 1 or other smart machine history and described in preserving
The touch area information of Trackpad, therefore, the identification information including the Trackpad based on the initiation of current smart machine 1 are touched
Site polling request is controlled, the network equipment can return to the touch area information of the Trackpad.
In one implementation, the display region information of the display device of the smart machine 1 can include but unlimited
Correlation in the display screen of the display device, perspective plane or display lamp region or the display area of above-mentioned all kinds of combinations
Information.If for example, the display device includes display screen, the display region information can include but is not limited to the display
Size information, shape information, directional information of screen etc..For another example, if the display device includes perspective plane, the display area
Information can include but is not limited to the size information, shape information, directional information on the perspective plane etc., in a kind of realization method
In, the size information on the perspective plane can be by 1 corresponding projection arrangement of smart machine, such as external projector or internal projection
The settings such as component as the resolution ratio of projection is provided in projection arrangement, and after projector distance is determined, calculate corresponding perspective plane
Size information.In addition, in one implementation, the display region information of the display device of the smart machine 1 can be from
It is directly read in the configuration information of the smart machine 1;The display region information of the display device of the smart machine 1 can be from this
It is read in 1 corresponding other equipment of smart machine, such as the corresponding display area letter in perspective plane is read from extraneous projection device
Breath.
In the application one embodiment, the smart machine 1 further includes second and establishes device (not shown), and described second
The coordinate mapping relations of remote control interface and the Trackpad in the display device can be established by establishing device;Wherein it is determined that dress
Putting can be based on first position information of the touch operation in the Trackpad and the Trackpad and remote control circle
The coordinate mapping relations in face determine second position information of the touch operation in the display device.
Here, can include remote control interface in the display device, i.e., the interactive information in display device is remote control interface.
In one implementation, the remote control interface can include function selection interface, such as various control selection interfaces, with intelligence
It can include treating the various application controls of selection for TV, in the remote control interface;The remote control interface can also include defeated
Enter method interface, the interface of input method can include letter key, number key, symbolic key, other function keys etc., by user to defeated
The input of corresponding informance can be realized by entering the operation at method interface.In addition, the remote control interface can also including search interface etc. its
His interactive interface;The remote control interface can also include the combination of above-mentioned various interactive interfaces.
In this application, the button for the remote controler for passing through smart machine in order to avoid user is grasped to carry out cumbersome button
Make, meanwhile, in order to by interactive information in the quick locating and displaying device of touch tablet, as the positioning of control in function selection interface,
Positioning of key in interface of input method etc. reduces time overhead, can be by display device and the touch tablet according to relative scale
Scaling forms coordinate mapping relations.In one implementation, the region of touch tablet can be interacted with the remote control interface
The putting in order of boundary element, position relationship establishes one-to-one coordinate mapping relations, described by taking function selection interface as an example
Interactive interface unit can include various application controls;By taking interface of input method as an example, the interactive interface unit can include defeated
Enter each letter key in method interface, number key, symbolic key, other function keys etc..
Fig. 8 shows a kind of exemplary plot that smart machine 1 is remotely controlled by Trackpad according to the application one embodiment,
In, the smart machine 1 can be smart television, the display device of the smart television, on the remote control interface in display screen
Multiple functionality controls for treating user's selection, such as locally applied, video, e-book, picture ... control in figure have been arranged in order,
The coordinate mapping relations of remote control interface and the Trackpad in the display device are established, i.e., so that each control is based on it
Corresponding position information matches on location information in the remote control interface, with the Trackpad.For example, " locally applied "
The corresponding first position information match on Trackpad that second position information where control is directed toward with dotted line in figure.Into
And if user needs to select the control " locally applied " in display device, it is only necessary to " local with control on touch operation Trackpad
Using " the first position information of second position information match in a display device can be realized.
A kind of citing for establishing remote control interface and the coordinate mapping relations of the touch tablet in the display device can also
With reference to shown in figure 7.Assuming that the resolution ratio of the touch tablet is x1*y1, display device resolution ratio is x2*y2.Assuming that user's finger
Touch the first position information (x0, y0) on touch tablet, then fall on remote control interface in display device second position information (x,
y).Its calculation formula:
It can obtain
It can obtain
Thus, it is possible to the remote control interface of the display device and the coordinate mapping relations of the touch tablet are obtained.Here,
The remote control interface can take up the part or all of band of position of the display screen.
Here, those skilled in the art it should be understood that the above-mentioned remote control interface for establishing the display device with it is described
The mode of the coordinate mapping relations of touch tablet is only for example, it is existing or occur from now on other establish the remote control of the display device
If interface and the mode of the coordinate mapping relations of the touch tablet can be suitable for the application, it should also be included in the application's
In protection domain, and it is incorporated herein in the form of reference.
Further, in one embodiment, described second establish device can work as the display device in remote control interface quilt
Update, establishes the coordinate mapping relations of remote control interface and Trackpad in the display device.In practical applications, it can be arranged on
During the switching of remote control interface, the coordinate mapping relations are re-established.For example, the selection variation interface of input method based on user
After pattern, the coordinate mapping relations re-establish, for another example, if having selected an application controls in function selection interface,
Hence into the interface of the application, then current remote control interface is switched, is changed, and can also be re-established the coordinate and be reflected
Penetrate relationship.Thus, it is possible to ensure matching degree and the accuracy of man-machine interactive operation, friendly user experience is brought.
In one embodiment, it described second establishes device and can establish in the display device remote control interface and touched with described
Control the coordinate mapping relations of effective touch area in plate.In practical applications, it can be based on partly or entirely touching in Trackpad
Touch region foundation and the coordinate mapping relations of remote control interface in the display device.If effective touch area is partial touch
Region, the then touch operation that user implements in the region are just effective;If effective touch area includes whole touch areas, user
It is all effective in the touch operation that whole touch areas of the Trackpad are implemented.
Further, in one embodiment, the smart machine 1 can include suggestion device (not shown), be touched when described
First position information of the operation in the Trackpad is touched except effective touch area, the suggestion device can provide
Corresponding operation prompt information.In one implementation, what the operation prompt information can be used for prompting user current touches
It touches zone void or guiding user enters effective touch area to perform effective touch operation etc..For example, it can prompt
" effective interaction area please be click " or prompting " please moving touch operation to xx directions " etc..In one implementation, the behaviour
The modes such as picture and text prompting in voice prompt, display device are can include but is not limited to as prompt message.
In one embodiment, the shape of effective touch area and the shape of the remote control interface match.
In practical applications, in display device remote control interface shape, as function selection interface, interface of input method be laid out
Shape can be different, and then, the shape of effective touch area to match can be set based on the shape of the remote control interface.And
And the remote control interface can be presented on any position in the display device.Fig. 5 is shown according to one implementation of the application
Several groups of examples that the shape of effective touch area of the Trackpad of example and the shape of the remote control interface of display device match.Its
In, the remote control interface can take up a part of region of whole display device or presentation in a display device.In a kind of reality
In existing mode, can middle remote control interface according to the display device shape, adjust in Trackpad the effectively layout of touch area, example
Such as:The shape of the remote control interface is rectangular, and the shape of effective touch area of Trackpad can be preferably rectangular, builds as a result,
Vertical mapping relations are more accurate, and it is higher to touch precision;For another example, the shape of the remote control interface is oval, Trackpad
Effective coverage can also be rectangle.In one implementation, even if the shape of effective touch area and the remote control interface
Shape it is not exactly the same, the mapping relations that both can also be established.
In one embodiment, the second position information includes one or more interactions on remote control interface in display device
The location information of boundary element.In one implementation, the interactive interface unit is to be supplied to use in the remote control interface
Family performs the effective object of interactive operation.For example, in function selection interface, the control each applied can be an interaction
Boundary element;For another example, in interface of input method, each key, such as letter key, number key, symbolic key, other function keys all may be used
To correspond to an interactive interface unit.Here, the second position information can correspond only to include being remotely controlled in display device
The location information of an interactive interface unit on interface can also correspond to the location information of multiple interactive interface units simultaneously.
Further, in one embodiment, the control device 303 can be according to the second position information, to described
Information corresponding one or more of interactive interface units in the second position perform the touch operation.
Specifically, in one implementation, if there are one the corresponding interactive interface units of the second position information,
The touch operation is then performed to be used directly for realizing that the selection to the interactive interface unit, confirmation, deletion etc. are arbitrarily made by oneself
The interactive operation of justice.For example, can set, the touch operation includes selection operation, and the mode of the touch operation includes sliding
Operation, currently slides past first position information on touch tablet, then the touch operation performed is selects the first position information pair
The interactive information in the information of the second position in the display device answered, for example, when the remote control interface in the display device is defeated
Enter method interface, user's finger currently streaks number key " 1 ", then performs the selection operation to number key " 1 ".
In another implementation, if the second position information includes multiple interactions on remote control interface in display device
The location information of boundary element;Wherein, the control device 303 can be according to the second position information, to the second
The corresponding the multiple interactive interface unit of confidence breath performs the touch operation;Obtain selection of the user in the Trackpad
Operation;The selection operation is performed to realize target in the multiple interactive interface unit corresponding to the second position information
The selection of interactive interface unit.
In one implementation, if user is expected to choose the corresponding multiple interactive interface units of the second position information
In some or several target interactive interface units, then smart machine 1 is according to the second position information, to the second position
The result that the corresponding the multiple interactive interface unit of information performs the touch operation has been locked out the second position information.
And then can on the basis of the touch operation, by user in the Trackpad further touch control operation, that is, select
Operation, to realize the selection to target interactive interface unit.
For example, when the second position information corresponds in interface of input method the position of two keys, while highlight the two
Key, then touched again by upper and lower or left and right, select the key of one of them;Similarly, when the second position information correspond to it is defeated
When entering in method interface the adjacent position of four keys, while this four keys are highlighted, then by touching again up and down, selection is wherein
One of key.Those skilled in the art it should be understood that above-mentioned selection operation is only for example, it is existing or occur from now on other
If selection operation can be suitable for the application, should also be included in the protection domain of the application, and the packet in the form of reference
Contained in this.
For another example, if there is multiple target interaction circles in the corresponding multiple interactive interface units of the second position information
Face unit, such as second position information correspond to multiple keys in interface of input method, and wherein have part key needs continuously to wait to choose,
Then at this point it is possible to be expected selected order based on each target interactive interface unit, the continuous multiple selections behaviour for obtaining user
Make.Such as, when the second position information corresponds in interface of input method the position of two keys, and two keys are that user is expected to connect
When continuing two keys chosen, while the two keys are highlighted, at this point, the touch operation is actually to the second position information
The locking of corresponding two keys, then touched again by upper and lower or left and right, the preceding object key of order of preference, the selection operation
Weight operation or release operation are can include but is not limited to, after completing primary selection, that is, confirmed an object key, and then can be with
Further carry out the selection operation of next object key, if for example, the selection operation include weight operation, can not release
Let go finger in the case of, continue through up and down or left and right touch again, the posterior object key of order of preference, again perform weight behaviour
Make, complete the selection operation of the posterior object key of the order;For another example, if the selection operation includes release and operates, then may be used
It is touched again in preset operational use time, continuing through upper and lower or left and right, the posterior object key of order of preference, again
Release operation is performed, completes the selection operation of the posterior object key of the order.Those skilled in the art it should be understood that on
It states selection operation to be only for example, if other selection operations existing or occur from now on can be suitable for the application, should also wrap
It is contained in the protection domain of the application, and is incorporated herein in the form of reference.
Present invention also provides a kind of Trackpads for being remotely controlled smart machine.Fig. 4 shows one according to the application one side
The system schematic of kind remote control smart machine 1.The system comprises smart machine 1 and Trackpad 2, the smart machine 1 includes
Acquisition device 301 ', determining device 302 ' and control device 303 ', the Trackpad include reception device 401 ' and sending device
402’。
Wherein, the reception device 401 ' of Trackpad 2 can receive touch operation of the user in Trackpad 2;Then, touch-control
The touch operation can be sent to corresponding smart machine 1 by the sending device 402 ' of plate 2, wherein, the Trackpad and institute
Stating the display device of smart machine, there are coordinate mapping relations;Then, acquisition device 301 ' can obtain user in Trackpad 2
Touch operation, wherein, the Trackpad 2 matches with smart machine 1;It is then determined device 302 ' can be based on described touch
Touch the display device of first position information and the Trackpad 2 and the smart machine 1 of the operation in the Trackpad 2
Coordinate mapping relations, determine second position information of the touch operation in the display device;Then, control device
303 ' can control the smart machine 1 according to the touch operation and the second position information.Here, the Trackpad 2
It can correspond to Trackpad described in Fig. 3 embodiments.Here, the acquisition device 301 ', determining device 302 ' and control fill
Put it is 303 ' same or similar with the content of acquisition device in Fig. 3 301, determining device 302 and control device 303, it is no longer superfluous herein
It states, and is incorporated herein in the form of reference.
Here, compared to the existing mode based on button remote control control intelligent appliance or some be based on intelligent hand
Machine control intelligent appliance mode, the application matched by the Trackpad 2 with smart machine 1 can accurately be remotely controlled it is a variety of
Smart machine simplifies user's operation, improves manipulation efficiency, improves user experience, it is thus also avoided that user's study is a variety of distant
Control the learning cost of distant control function in device or smart mobile phone.In addition, the because existing mode using mobile phone control intelligent appliance
When mobile phone screen is occupied, such as:Receiving calls, video, voice when, user can not control intelligent appliance simultaneously, and
Only when mobile phone screen does not have occupied, manipulation intelligent appliance could be carried out by the touch function of mobile phone screen, therefore, this
Kind of mode cannot be guaranteed to keep effective control to intelligent appliance at any time, and the application then can continually and steadily to intelligent appliance into
Row control so that man-machine interactive operation is more friendly.
Further, in one embodiment, the Trackpad 2 further includes third and establishes device (not shown), the third
The pairing relationship of Trackpad and smart machine can be established by establishing device;Then, sending device 402 ' can grasp described touch
The smart machine that pairing relationship is established with the Trackpad is sent to, wherein, the Trackpad and the smart machine
There are coordinate mapping relations for display device.Here, the Trackpad matches with smart machine 1.Determining can be by described
Trackpad controls the smart machine 1.In one implementation, the matching method of the Trackpad and smart machine 1 can be with
It is acquiescence, such as the Trackpad and the smart machine 1 are one-to-one matching relationships, pairing relationship is stablized.Another
In a kind of realization method, the pairing relationship of the Trackpad and smart machine 1 be can in any combination, i.e., in practical applications,
The Trackpad can control different smart machines, and smart machine can also be controlled by different Trackpads.In this application, when
The Trackpad determines that the operation of smart machine is remotely controlled by Trackpad to be realized with 1 pairing relationship of smart machine.
In one implementation, the smart machine 1 and the Trackpad 2 can be configured with corresponding infrared function or
Thus Bluetooth function establishes the communication connection of the smart machine 1 and the Trackpad 2, set so as to fulfill Trackpad 2 and intelligence
The foundation of standby 1 pairing relationship.In one implementation, the Trackpad 2 opens bluetooth, Ke Yiyou with smart machine 1
2 initiating equipment of Trackpad is searched, and finds the facility information of the smart machine 1, and then initiate to match to the smart machine 1
Request here, the acquiescence of smart machine 1 can be set to receive pairing, can also set the smart machine 1 to be grasped by confirming
Make to receive pairing.In another implementation, it can also be searched by 1 initiating equipment of smart machine, find the Trackpad 2
Facility information, and then initiate pairing request to the Trackpad 2, match here, the Trackpad 2 acquiescence can be set to receive
It is right, the Trackpad 2 can also be set to be received by confirmation operation and matched.In one implementation, during pairing, institute
The smart machine 1 can be sent to by its facility information, such as identification information by stating Trackpad 2.
Present invention also provides it is a kind of by Trackpad be remotely controlled smart machine, including:
One or more processors;
Memory;And
One or more programs wherein one or more of programs are stored in the memory, and are configured
It is performed by one or more of processors, described program is included for performing the following operations:
Touch operation of the user in Trackpad is obtained, wherein, the Trackpad matches with smart machine;
Based on first position information of the touch operation in the Trackpad and the Trackpad and the intelligence
The coordinate mapping relations of the display device of equipment determine second position information of the touch operation in the display device;
The smart machine is controlled according to the touch operation and the second position information.
Further, the described program of the equipment can be also used for performing in other related embodiments based on aforesaid operations
Respective operations.
Present invention also provides a kind of computer readable storage mediums, are stored thereon with computer program, the computer
Program can be executed by processor following operation:
Touch operation of the user in Trackpad is obtained, wherein, the Trackpad matches with smart machine;
Based on first position information of the touch operation in the Trackpad and the Trackpad and the intelligence
The coordinate mapping relations of the display device of equipment determine second position information of the touch operation in the display device;
The smart machine is controlled according to the touch operation and the second position information.
Further, the computer program can be also executed by processor in other related embodiments based on aforesaid operations
Respective operations.
Present invention also provides it is a kind of be remotely controlled smart machine Trackpad, including:
One or more processors;
Memory;And
One or more programs wherein one or more of programs are stored in the memory, and are configured
It is performed by one or more of processors, described program is included for performing the following operations:
Receive touch operation of the user in Trackpad;
The touch operation is sent to corresponding smart machine, wherein, the Trackpad is aobvious with the smart machine
There are coordinate mapping relations for showing device.
Further, the described program of the equipment can be also used for performing in other related embodiments based on aforesaid operations
Respective operations.
Present invention also provides a kind of computer readable storage mediums, are stored thereon with computer program, the computer
Program can be executed by processor following operation:
Receive touch operation of the user in Trackpad;
The touch operation is sent to corresponding smart machine, wherein, the Trackpad is aobvious with the smart machine
There are coordinate mapping relations for showing device.
Further, the computer program can be also executed by processor in other related embodiments based on aforesaid operations
Respective operations.
Obviously, those skilled in the art can carry out the application essence of the various modification and variations without departing from the application
God and range.In this way, if these modifications and variations of the application belong to the range of the application claim and its equivalent technologies
Within, then the application is also intended to include these modifications and variations.
It should be noted that the present invention can be carried out in the assembly of software and/or software and hardware, for example, can adopt
With application-specific integrated circuit (ASIC), general purpose computer or any other realized similar to hardware device.In one embodiment
In, software program of the invention can perform to realize steps described above or function by processor.Similarly, it is of the invention
Software program can be stored in computer readable recording medium storing program for performing (including relevant data structure), for example, RAM memory,
Magnetic or optical driver or floppy disc and similar devices.In addition, hardware can be used to realize in some steps or function of the present invention, example
Such as, as coordinating with processor so as to perform the circuit of each step or function.
In addition, the part of the present invention can be applied to computer program product, such as computer program instructions, when its quilt
When computer performs, by the operation of the computer, it can call or provide according to the method for the present invention and/or technical solution.
And the program instruction of the method for the present invention is called, it is possibly stored in fixed or moveable recording medium and/or passes through
Broadcast or the data flow in other signal loaded mediums and be transmitted and/or be stored according to described program instruction operation
In the working storage of computer equipment.Here, including a device according to one embodiment of present invention, which includes using
Memory in storage computer program instructions and processor for executing program instructions, wherein, when the computer program refers to
When order is performed by the processor, method and/or skill of the device operation based on aforementioned multiple embodiments according to the present invention are triggered
Art scheme.
It is obvious to a person skilled in the art that the present invention is not limited to the details of above-mentioned exemplary embodiment, Er Qie
In the case of without departing substantially from spirit or essential attributes of the invention, the present invention can be realized in other specific forms.Therefore, no matter
From the point of view of which point, the present embodiments are to be considered as illustrative and not restrictive, and the scope of the present invention is by appended power
Profit requirement rather than above description limit, it is intended that all by what is fallen within the meaning and scope of the equivalent requirements of the claims
Variation includes within the present invention.Any reference numeral in claim should not be considered as to the involved claim of limitation.This
Outside, it is clear that one word of " comprising " is not excluded for other units or step, and odd number is not excluded for plural number.That is stated in device claim is multiple
Unit or device can also be realized by a unit or device by software or hardware.The first, the second grade words are used for table
Show title, and do not represent any particular order.