CN106331806B - A kind of implementation method and equipment of virtual remote controller - Google Patents
A kind of implementation method and equipment of virtual remote controller Download PDFInfo
- Publication number
- CN106331806B CN106331806B CN201610709710.0A CN201610709710A CN106331806B CN 106331806 B CN106331806 B CN 106331806B CN 201610709710 A CN201610709710 A CN 201610709710A CN 106331806 B CN106331806 B CN 106331806B
- Authority
- CN
- China
- Prior art keywords
- controlling terminal
- server
- user
- remote controller
- control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Abstract
The invention discloses a kind of implementation methods of virtual remote controller, this method identifies some familiar objects by controlling terminal, the image information of object is uploaded to server, it receives the controller picture to match with object that server returns and generates virtual remote controller image to user's displaying, obtain operation information of the user in virtual remote controller, it determines the control function that user wishes to carry out and generates corresponding control signal, operate controlling terminal by the control that the control signal generated is completed for electronic product.Pass through the technical solution proposed using the embodiment of the present application, control operation can be carried out to electronic product using common object as virtual remote controller, entity controller problem easy to be lost in use is effectively reduced, user is improved and is carrying out experience sense and feeling of freshness in remote control process.
Description
Technical field
The present invention relates to wireless control field more particularly to a kind of implementation methods of virtual remote controller.The present invention is also simultaneously
It is related to a kind of controlling terminal and a kind of server.
Background technique
AR (Augmented Reality, augmented reality) technology be a kind of position for calculating video camera image in real time and
Angle and the technology for adding respective image, the target of this technology is that virtual world is covered in real world and carried out on the screen
Interaction.In recent years, with the development of wearable electronic product, more and more wearable devices start integrated AR technology, pass through
It links with the control server on backstage, have the function of realizing augmented reality: such as familiar intelligent glasses completely may be used
To be directed to common objects, accomplish identification, operation, load backstage image, to virtual image is perfectly embedded into actual
On object, and then get movement by glasses by manipulating actual object, feed back the control server to backstage, finally by
Background server issues a series of specific control instructions, achievees the purpose that control real world.
The important way that TV remote controller is interacted as the mankind with television set is all that the mankind manipulate television set all the time
Major way.But there is also many drawbacks, such as key are more and complicated for operation for TV remote controller.Although in recent years, with
The emergence of intelligent TV set, each smart television manufacturer have all done huge in the appearance summary and function ease for use of remote controler
Big improvement, the remote controler of smart television is increasingly simpler, key is also fewer and fewer, but not everyone can receive;And
The intelligent or non intelligent TV of many storages is remained in the market, their remote controler construction is extremely complex.In addition, TV
Remote controler appearance after tv product is bought in can not be just altered again, in addition it is easy to happen and is difficult to as small-sized control peripheral hardware
The case where finding.
Applicant has found that existing TV remote controller is still to be with entity remote controler in the implementation of the present invention
It is main, still can there are problems that causing since small volume is easy to be lost television set can not normal use distant control function, and due to showing
The appearance fixture construction of some entity remote controlers is complicated, can not be replaced according to the hobby of user, this uses body to user's
It tests and brings limitation.
Therefore, entity remote controler how is substituted by a kind of virtual remote controller, improves entity remote controler in use process
The problem of middle objective reality, and then user experience is promoted, become those skilled in the art's problem to be solved.
Summary of the invention
The embodiment of the present application provides a kind of implementation method of virtual remote controller, can be using some common objects as remote control
Device simultaneously realizes the corresponding function of remote controler, avoid as entity remote controler lose and caused by can not normal use the case where,
The appearance that remote controler can be optimized according to user preferences simultaneously, greatly improves the usage experience of user.
In order to reach above-mentioned technical purpose, this application provides a kind of implementation method of virtual remote controller, the method is answered
For the controlling terminal in control system, the control system further includes server, this method comprises:
The image data of the object to be identified is uploaded to described by the object to be identified that controlling terminal is selected according to user
Server;
Controlling terminal receives the candidate picture that the server returns, and candidate's picture is the server according to
What the image data for the object to be identified that controlling terminal uploads determined after being matched in graphic data base;
The controlling terminal generates virtual remote controller image according to the candidate picture on the object to be identified, and will
The virtual remote controller image is shown to user;
Operation information of the user on the virtual remote controller image is uploaded to the server by the controlling terminal, with
The server is set to generate control signal according to the operation information.
Another aspect of the present invention additionally provides a kind of implementation method of virtual controlling, and the method is applied in control system
Server, the control system further includes controlling terminal, this method comprises:
The server receives the image data for the object to be identified that controlling terminal uploads, and described image data are by described
Controlling terminal is uploaded according to the object to be identified that user selectes;
The image data for the object to be identified that the server is uploaded according to the controlling terminal is true in graphic data base
The candidate picture that fixed and described image data match, and the candidate picture is returned into the controlling terminal, so that the control
Terminal processed generates virtual remote controller image according to the candidate picture on the object to be identified, and shows institute to the user
State virtual remote controller image;
The server receives the operation information that the controlling terminal uploads, and generates control corresponding with the operation information
Signal, the operation information are that the controlling terminal is generated according to user in the operation of the virtual remote controller image.
Correspondingly, the application also proposed a kind of controlling terminal, which is characterized in that the controlling terminal is applied to control system
In system, the control system further includes server, and the terminal includes:
First uploading module: the object to be identified selected according to user uploads the image data of the object to be identified
To the server;
First receiving module: the candidate picture that the server returns is received, candidate's picture is the server root
What the image data of the object to be identified uploaded according to the controlling terminal determined after being matched in graphic data base;
Generate display module: the controlling terminal generates on the object to be identified virtual distant according to the candidate picture
Device image is controlled, and the virtual remote controller image is shown to user;
Second uploading module: operation information of the user on the virtual remote controller image is uploaded to by the controlling terminal
The server, so that the server generates control signal according to the operation information.
Further, the present invention also provides a kind of server, the server application is in control system, the control
System further includes controlling terminal, and the server includes:
Receiving module: the server receives the image data for the object to be identified that controlling terminal uploads, described image number
According to being to be uploaded by the controlling terminal according to the object to be identified that user selectes;
Determining module: the image data for the object to be identified that the server is uploaded according to the controlling terminal is in figure number
The controlling terminal is returned according to the candidate picture to match with described image data determining in library, and by the candidate picture, with
The controlling terminal is set to generate virtual remote controller image on the object to be identified according to the candidate picture, and to the use
Family shows the virtual remote controller image;
Generation module: the server receives the operation information that the controlling terminal uploads, and generates and the operation information
Corresponding control signal, the operation information are that the controlling terminal is raw in the operation of the virtual remote controller image according to user
At.
Compared with prior art, the advantageous effects for the technical solution that the embodiment of the present application is proposed include:
The embodiment of the present application discloses a kind of implementation method of virtual remote controller, and this method is identified by controlling terminal
The image information of the object is uploaded to server by familiar object, and receive that server returns matches with the object
Controller picture generates virtual remote controller image and shows to user, obtains operation information of the user in virtual remote controller, determines
The corresponding control signal of control function and generation that user wishes to carry out makes control signal completion pair of the controlling terminal by generation
It is operated in the control of electronic product.By the technical solution proposed using the embodiment of the present application, common object can be made
Control operation is carried out to electronic product for virtual remote controller, effectively reduces that entity controller is easy to be lost in use asks
Topic improves user and is carrying out experience sense and feeling of freshness in remote control process.
Detailed description of the invention
Fig. 1 is a kind of implementation method flow diagram for virtual remote controller that the embodiment of the present application proposes;
Fig. 2 is a kind of implementation method flow diagram for virtual remote controller that the embodiment of the present application proposes;
Fig. 3 is a kind of virtual remote control method realized by intelligent glasses for television set proposed in the embodiment of the present application
Schematic diagram;
Fig. 4 is in the embodiment of the present application in the application preferred embodiment in application scenarios, and a kind of realization Television Virtual is distant
The system architecture diagram of control;
Fig. 5 is a kind of structural schematic diagram of the controlling terminal proposed in the embodiment of the present application;
Fig. 6 is a kind of structural schematic diagram of the server proposed in the embodiment of the present application.
Specific embodiment
In view of the problems of the prior art, this application provides a kind of implementation methods of virtual remote controller, by spy
Virtual remote controller image is launched on fixed object, is obtained operation information of the user in virtual remote controller, is generated and correspond to operation
The control signal of information effectively subtracts to achieve the purpose that control electronic product to greatly improve the usage experience of user
Lacked entity controller it is easy to be lost in use, can not the dull experience sense of general and use process it is poor the problems such as.
As shown in Figure 1, a kind of implementation method flow diagram of the virtual remote controller proposed for the embodiment of the present application, described
Method is applied to the controlling terminal in control system, and the control system further includes server, this method comprises:
Step 101: the object to be identified that controlling terminal is selected according to user, it will be in the image data of the object to be identified
Reach the server.
The remote controler of entity exists due to some objective factors and is easily lost and can not arbitrarily change in the prior art
The problem of remote controler appearance, thus need it is adjustable with a kind of appearance, and will not can not be normal distant because remote control carrier is lacked
The virtual remote controller of control replaces existing entity remote controler.Therefore need to select the object of the carrier as virtual remote controller first
Body, and the image data of the object is uploaded to server and is analyzed.
In the application preferred embodiment, controlling terminal determines the selected object to be identified of user first;It controls later
Terminal obtains the image data of the object to be identified, and acquisition modes can be through but not limited to the built-in miniature in controlling terminal
Video camera is realized;Then, the image data that controlling terminal will acquire is uploaded to the server end in system, trigger the server
According to the image data matching candidate image of object to be identified.
Step 102: controlling terminal receives the candidate picture that the server returns.
In the application preferred embodiment, the image data of object to be identified is being uploaded to the server by controlling terminal
Later, matching instruction can be sent to server, carries out server in graphic data base according to the image data received
Match, finds out and be used as candidate picture to be back to controlling terminal with controller picture similar in described image data shape.
Step 103: the controlling terminal generates virtual remote controller on the object to be identified according to the candidate picture
Image, and the virtual remote controller image is shown to user.
In the application preferred embodiment, controlling terminal, can be by institute after the candidate picture for receiving server return
The candidate picture presentation having different candidate pictures can be compared with object to be identified to user, user, select one
Picture is as controller picture ready for use, and result is nested by controller picture ready for use according to the user's choice for controlling terminal
On object to be identified, generates the image of virtual remote controller and the image of the virtual remote controller of generation is showed into user.
Step 104: operation information of the user on the virtual remote controller image is uploaded to described by the controlling terminal
Server, so that the server generates control signal according to the operation information.
In the application preferred embodiment, when user starts operation, controlling terminal obtains user in virtual remote control utensil
Gymnastics is made, and generates corresponding control information according to the concrete operations of user, the control information includes at least: user is in the void
The phase that actuation time, action frequency, sequence of movement and user on quasi- remote controler act on the virtual remote controller image
To position.The control information is being uploaded to server by controlling terminal, and issues analysis instruction to server, is referred to by analysis
It enables instruction server to analyze operation information, and then generates the control signal for corresponding to operation information.
Compared with prior art, the advantageous effects for the technical solution that the embodiment of the present application is proposed include:
The embodiment of the present application discloses a kind of implementation method of virtual remote controller, and this method is identified by controlling terminal
The image information of the object is uploaded to server by familiar object, and receive that server returns matches with the object
Controller picture generates virtual remote controller image and shows to user, by obtaining operation information of the user in virtual remote controller,
It determines the control function that user wishes to carry out and generates corresponding control signal, keep controlling terminal complete by the control signal generated
It is operated in pairs in the control of electronic product.It, can be by common object by the technical solution proposed using the embodiment of the present application
Body carries out control operation to electronic product as virtual remote controller, effectively reduces entity controller and easily loses in use
Lose, can not the dull experience sense of general and use process it is poor the problems such as, improve user carry out remote control process in experience
Sense and feeling of freshness.
It should be noted that the above-mentioned embodiment in the application preferred embodiment only represent it is a kind of preferably real in the application
Implement scene in example is applied, the solution of the present invention can not be represented and be only restricted in this, anyone skilled in the art are without wound
In the case that the property made is worked it is conceivable that prioritization scheme should all fall into the protection scope of the present embodiment.
The present invention also provides a kind of implementation method of virtual controlling, the method is applied to the service in control system
Device, the control system further include controlling terminal, are illustrated in figure 2 the flow diagram of the method, this method comprises:
Step 201: the server receives the image data for the object to be identified that controlling terminal uploads, described image data
It is to be uploaded by the controlling terminal according to the object to be identified that user selectes;
Step 202: the image data for the object to be identified that the server is uploaded according to the controlling terminal is in figure number
The controlling terminal is returned according to the candidate picture to match with described image data determining in library, and by the candidate picture.
In the application preferred embodiment, image data of the server in the object to be identified for receiving controlling terminal upload
Later, graphic data base is traversed, wherein the graphic data base is stored with the controller picture of various shapes;
Server by the graphic data base controller picture and the object to be identified image data carry out
Match, finds out with controller picture similar in the body form to be identified as candidate picture, it should be noted that candidate picture
Quantity there is no specific limitation, can need be arranged according to the specific of user;
After selected candidate picture, the candidate picture selected is returned to the controlling terminal by server, so that the control
Terminal processed generates virtual remote controller image according to the candidate picture on the object to be identified, and by the virtual remote controller
Image shows that the method that virtual remote controller image is generated in the application preferred embodiment is identical with preceding method, In to user
This is repeated no more.
Step 203: the server receives the operation information that the controlling terminal uploads, and generates and the operation information phase
The control signal answered.
In the application preferred embodiment, server analyzes institute after the operation information for receiving controlling terminal upload
The corresponding relationship for stating key on operation information and the virtual remote controller image, determines the user function to be executed.Such as:
User has carried out single-click operation corresponding to the key of " volume+" on the image of the virtual remote controller, and server passes through user
The click on object of number of clicks and user relative position, to judge the function that user wishes to carry out at this time " to increase
Add volume a unit ", so server can correspond to the control signal for generating and realizing " increasing by one unit of volume " function.Equally
, when user presses bookish other parts, cloud server also can be according to the corresponding position of user's operation and click
Number, click time determine the function that user wishes to carry out, and then the control for corresponding to the function is generated according to the function
Signal.
Compared with prior art, the advantageous effects for the technical solution that the embodiment of the present application is proposed include:
The embodiment of the present application discloses a kind of implementation method of virtual remote controller, and this method is identified by controlling terminal
The image information of the object is uploaded to server by familiar object, and receive that server returns matches with the object
Controller picture generates virtual remote controller image and shows to user, by obtaining operation information of the user in virtual remote controller,
It determines the control function that user wishes to carry out and generates corresponding control signal, keep controlling terminal complete by the control signal generated
It is operated in pairs in the control of electronic product.It, can be by common object by the technical solution proposed using the embodiment of the present application
Body carries out control operation to electronic product as virtual remote controller, effectively reduces entity controller and easily loses in use
Lose, can not the dull experience sense of general and use process it is poor the problems such as, improve user carry out remote control process in experience
Sense and feeling of freshness.
It should be noted that the above-mentioned embodiment in the application preferred embodiment only represent it is a kind of preferably real in the application
Implement scene in example is applied, the solution of the present invention can not be represented and be only restricted in this, anyone skilled in the art are without wound
In the case that the property made is worked it is conceivable that prioritization scheme should all fall into the protection scope of the present embodiment.
It is right now in conjunction with the application scenarios in the application preferred embodiment for the technical idea that the present invention is further explained
Technical solution of the present invention is illustrated.
As shown in figure 3, a kind of being realized by intelligent glasses for the virtual of television set for what is proposed in the embodiment of the present application
Remote control method schematic diagram, the technical solution in the present embodiment are main including the following three aspects: are that intelligent glasses identification is special first
Fixed domestic articles cover the virtual picture stored in server on article, and user is made to feel that the article is one " true
" TV remote controller;Secondly, user's operation " remote controler ", glasses capture acts and issues corresponding manipulation instruction, control electricity
Depending on;Finally, intelligent glasses incude and disconnect this application when user's no longer wearing spectacles, special article can continue to play its original
There is purposes.The framework of whole system is as shown in Fig. 4, and the method specifically includes:
Step 301: image data acquiring.
In the application preferred embodiment, in user's wearing after intelligent glasses, open " virtual distant in intelligent glasses
Control device " app application, it is automatic search the smart television being located in same local area network and establish connection (if it is non intelligent TV, can
It to input television model by way of craft, is matched);Intelligent glasses are by built-in miniature webcam, first to wanting
The object of identification is imaged, and shoots 5 photos (such as books of one 120mm*60mm*10mm of identification), acquisition will identify
The image data of object.
Step 302: image data uploads.
In the application preferred embodiment, by built-in camera complete to the image data acquiring of object to be identified it
Afterwards, acquired image data are uploaded to cloud server.
Step 303: issuing comparison instruction.
In the application preferred embodiment, after described image data are uploaded to cloud server, intelligent glasses are issued
Instruction indicates that cloud server according to the image data received carries out shape comparison in picture library, filter out with it is described to
Virtual remote controller picture similar in body form is identified as candidate picture, the quantity of candidate picture is 10 in the present embodiment
.It should be understood that the quantity of candidate picture can not exist according to specific using being manually set
It is limited in the application preferred embodiment, details are not described herein.
Step 304: issuing candidate picture.
In the application preferred embodiment, server is complete in picture library according to the image data of object to be identified beyond the clouds
In contrast with after, the candidate picture determined is returned into the intelligent glasses end that user uses, user can be in candidate picture
Carry out selection and effect preview.
Step 305: candidate picture selection.
In the application preferred embodiment, selects and imitate in user's 10 candidate pictures that server returns beyond the clouds
Fruit preview selectes the comparison picture of oneself satisfaction, the picture chosen is nested on the notebook as object to be identified.
Step 306: display virtual remote controller.
In the application preferred embodiment, after the selection of user, selected remote controler picture is nested in wait know
On other object, at this point, notebook visually becomes one completely when user sees notebook by intelligent glasses again
Completely " TV remote controller "
Step 307: movement obtains.
In the application preferred embodiment, intelligent glasses in user's wearing, after the processing Jing Guo abovementioned steps, at this time
Books visually have become a complete TV remote controller user's, and have the various buttons of remote controler, such as
Power on button, volume add and subtract button, channel selection button etc.;User can as using true remote controler on books point
It hits or long-pressing, intelligent glasses obtains the movement and opposite position that user is carried out on books by built-in miniature webcam
It sets, records user in bookish operation information.
Step 308: upload information.
In the application preferred embodiment, the user that intelligent glasses will acquire is in books (i.e. visual virtual remote control
Device) on operation information upload to cloud server.
Step 309: issuing analysis instruction.
In the application preferred embodiment, user is uploaded into cloud service in bookish operation information in intelligent glasses
After device, Xiang Suoshu cloud server issues analysis instruction, indicates that the cloud server believes user in bookish operation
Breath is analyzed, and determines function and the purpose for manipulating TV that user wishes to carry out, such as: user clicks one on books
Under, the position that user clicks corresponds to the position of volume "+" in virtual remote controller, and cloud server can determine that user thinks at this time
Increase the operation of volume, when user presses bookish other parts, cloud server also can be according to corresponding position
It sets and number of clicks, click event determines function that user wishes to carry out, determine method in the application preferred embodiment
Identical as preceding method, details are not described herein.
Step 310: issuing control signal.
In the application preferred embodiment, the cloud server is after having determined the function that user wishes to carry out, root
Corresponding control signal is generated according to the function and the control signal is returned to the intelligent glasses end of user, in the application reality
It applies in example, after the completion of cloud server analysis, by the Keycode (to smart television) of generation or infrared code value (to non intelligent
TV) notice intelligent glasses.
Step 311: carrying out control operation by controlling signal.
In the application preferred embodiment, intelligent glasses receive the Keycode or infrared code value that cloud server returns,
Infrared key assignments (to non intelligent TV) is sent to by Keycode (to smart television) or by IR interface by udp protocol
TV achievees the purpose that control TV.
Preferably, in application the embodiment of the present application, when user took off one's spectacles more than 5 minutes, or actively, selection is exited
When, glasses end disconnects, and books continue to play the function of itself and act in the application preferred embodiment and can pass through
As under type is realized:
(1) user removes intelligent glasses, and intelligent glasses sense this movement of user, start timing;
(2) full 5 minutes of timing, glasses end will close identification application, and virtual remote controler picture disappears, and user is from glasses end
The books seen restore normal;
(3) user can also the slave glasses end selection of active exit application, effect is identical as (2).
The technical solution that the embodiment of the present application is proposed, by the place that specific object to be identified is passed through to AR intelligent glasses
After reason, virtual controller is visually formed;When user operates, by analysis user described virtual distant
Operation information on control device determines user's function to be performed, the control signal of corresponding function is generated and sent, to reach
Control the purpose of television set.By technical solution provided by the embodiment of the present application, being effectively reduced entity controller makes
With in the process it is easy to be lost, can not the dull experience sense of general and use process it is poor the problems such as, improve user and remotely controlled
Experience sense and feeling of freshness in the process.
It should be noted that described embodiment is a part of the embodiment of the application, rather than whole realities
Apply example.Above in the application preferred embodiment the content of application scenarios be only the application preferred embodiment propose example, In
It can also include more application fields on the basis of this, so that the technical program has widely application, these improvement
Belong to protection scope of the present invention.
To reach the above technical purpose, accordingly, present applicant proposes a kind of controlling terminals, as shown in figure 5, being the application
A kind of structural schematic diagram of the controlling terminal proposed in embodiment, the terminal applies are in control system, the control system
Further include server, the terminal specifically includes:
First uploading module 510: the object to be identified selected according to user, it will be in the image data of the object to be identified
Reach the server;
First receiving module 520: the candidate picture that the server returns is received, candidate's picture is the server
What the image data of the object to be identified uploaded according to the controlling terminal determined after being matched in graphic data base;
Generate display module 530: the controlling terminal generates void according to the candidate picture on the object to be identified
Quasi- remote controler image, and the virtual remote controller image is shown to user;
Second uploading module 540: the controlling terminal is by user in the operation information on the virtual remote controller image
The server is reached, so that the server generates control signal according to the operation information.
In the application preferred embodiment in application scenarios, the controlling terminal further include:
Second receiving module 550: the controlling terminal receives the control signal that the server returns;
Sending module 560: being sent to signal emission module for the control signal, the signal emission module for want by
It controls object emission and controls signal;
Execution module 570: the controlling terminal emits the control signal by the signal emission module and executes to quilt
Control the control operation of object;
Wherein, the control signal is to be generated by the server according to the operation information that the controlling terminal uploads.
In application scenarios, the operation information is included at least in the application preferred embodiment:
Actuation time, action frequency, sequence of movement and user of the user in the virtual remote controller are described virtual
The relative position acted on remote controler image.
Compared with prior art, the advantageous effects for the technical solution that the embodiment of the present application is proposed include:
The embodiment of the present application discloses a kind of implementation method of virtual remote controller, and this method is identified by controlling terminal
The image information of the object is uploaded to server by familiar object, and receive that server returns matches with the object
Controller picture generates virtual remote controller image and shows to user, by obtaining operation information of the user in virtual remote controller,
It determines the control function that user wishes to carry out and generates corresponding control signal, keep controlling terminal complete by the control signal generated
It is operated in pairs in the control of electronic product.It, can be by common object by the technical solution proposed using the embodiment of the present application
Body carries out control operation to electronic product as virtual remote controller, effectively reduces entity controller and easily loses in use
Lose, can not the dull experience sense of general and use process it is poor the problems such as, improve user carry out remote control process in experience
Sense and feeling of freshness.
It should be noted that the above-mentioned embodiment in the application preferred embodiment only represent it is a kind of preferably real in the application
Implement scene in example is applied, the solution of the present invention can not be represented and be only restricted in this, anyone skilled in the art are without wound
In the case that the property made is worked it is conceivable that prioritization scheme should all fall into the protection scope of the present embodiment.
The present invention still further provides a kind of server, and the server application is in control system, the control system
It further include controlling terminal, as shown in fig. 6, for a kind of structural schematic diagram of the server proposed in the embodiment of the present application, the clothes
Business device include:
Receiving module 610: the server receives the image data for the object to be identified that controlling terminal uploads, described image
Data are to be uploaded by the controlling terminal according to the object to be identified that user selectes;
Determining module 620: the image data for the object to be identified that the server is uploaded according to the controlling terminal is being schemed
The determining candidate picture to match with described image data in graphic data library, and the candidate picture is returned into the control eventually
End, so that the controlling terminal generates virtual remote controller image according to the candidate picture on the object to be identified, and to
The user shows the virtual remote controller image;
Generation module 630: the server receives the operation information that the controlling terminal uploads, and generates and believes with the operation
The corresponding control signal of breath, the operation information be the controlling terminal according to user the virtual remote controller image operation
It generates.
In application scenarios, the determining module 620 is specifically used in the application preferred embodiment:
Traverse the graphic data base;
Controller picture in the graphic data base is matched with the image data of the object to be identified, is found out
With controller picture similar in the body form to be identified as candidate picture;
The candidate picture is returned into the controlling terminal, so that the controlling terminal is according to the candidate picture described
Virtual remote controller image is generated on object to be identified, and the virtual remote controller image is shown to user.
In application scenarios, the generation module 630 is specifically used in the application preferred embodiment:
Receive the operation information;
The corresponding relationship for analyzing key on the operation information and the virtual remote controller image, determines that the user will hold
Capable function;
The control signal for corresponding to the function is generated according to the function.
Compared with prior art, the advantageous effects for the technical solution that the embodiment of the present application is proposed include:
The embodiment of the present application discloses a kind of implementation method of virtual remote controller, and this method is identified by controlling terminal
The image information of the object is uploaded to server by familiar object, and receive that server returns matches with the object
Controller picture generates virtual remote controller image and shows to user, by obtaining operation information of the user in virtual remote controller,
It determines the control function that user wishes to carry out and generates corresponding control signal, keep controlling terminal complete by the control signal generated
It is operated in pairs in the control of electronic product.It, can be by common object by the technical solution proposed using the embodiment of the present application
Body carries out control operation to electronic product as virtual remote controller, effectively reduces entity controller and easily loses in use
Lose, can not the dull experience sense of general and use process it is poor the problems such as, improve user carry out remote control process in experience
Sense and feeling of freshness.
It should be noted that the above-mentioned embodiment in the application preferred embodiment only represent it is a kind of preferably real in the application
Implement scene in example is applied, the solution of the present invention can not be represented and be only restricted in this, anyone skilled in the art are without wound
In the case that the property made is worked it is conceivable that prioritization scheme should all fall into the protection scope of the present embodiment.
Through the above description of the embodiments, those skilled in the art can be understood that the present invention can lead to
Hardware realization is crossed, the mode of necessary general hardware platform can also be added to realize by software.Based on this understanding, this hair
Bright technical solution can be embodied in the form of software products, which can store in a non-volatile memories
In medium (can be CD-ROM, USB flash disk, mobile hard disk etc.), including some instructions are used so that a computer equipment (can be
Personal computer, server or network equipment etc.) execute method described in each implement scene of the present invention.
It will be appreciated by those skilled in the art that the accompanying drawings are only schematic diagrams of a preferred implementation scenario, module in attached drawing or
Process is not necessarily implemented necessary to the present invention.
It will be appreciated by those skilled in the art that the module in device in implement scene can be described according to implement scene into
Row is distributed in the device of implement scene, can also be carried out corresponding change and is located at the one or more dresses for being different from this implement scene
In setting.The module of above-mentioned implement scene can be merged into a module, can also be further split into multiple submodule.
Aforementioned present invention serial number is for illustration only, does not represent the superiority and inferiority of implement scene.
Disclosed above is only several specific implementation scenes of the invention, and still, the present invention is not limited to this, Ren Heben
What the technical staff in field can think variation should all fall into protection scope of the present invention.
Claims (8)
1. a kind of implementation method of virtual remote controller, which is characterized in that the method is applied to the controlling terminal in control system,
The control system further includes server, this method comprises:
Controlling terminal acquires the image data of the object to be identified and by the object to be identified according to determining object to be identified
The image data of body is uploaded to the server;
Controlling terminal receives the candidate picture that the server returns, and candidate's picture is the server according to the control
What the image data for the object to be identified that terminal uploads determined after being matched in graphic data base;
The controlling terminal generates virtual remote controller image according to the candidate picture on the object to be identified, and will be described
Virtual remote controller image is shown to user;
Operation information of the user on the virtual remote controller image is uploaded to the server by the controlling terminal, so that institute
It states server and control signal is generated according to the operation information;
The controlling terminal by user after the operation information on the virtual remote controller image is uploaded to the server,
Further include:
The controlling terminal receives the control signal that the server returns;
The control signal is sent to signal emission module, the signal emission module to by control object emission for controlling
Signal;
The controlling terminal emits the control signal by the signal emission module and executes to by the control behaviour of control object
Make;
Wherein, the control signal is to be generated by the server according to the operation information that the controlling terminal uploads.
2. the method as described in claim 1, which is characterized in that the operation information includes at least:
Actuation time, action frequency, sequence of movement and user of the user in the virtual remote controller are in the virtual remote control
The relative position acted on device image.
3. a kind of implementation method of virtual remote controller, which is characterized in that the method is applied to the server in control system, institute
Stating control system further includes controlling terminal, this method comprises:
The server receives the image data for the object to be identified that controlling terminal uploads, and described image data are by the control
Terminal is uploaded according to the object to be identified that user selectes;
The image data for the object to be identified that the server is uploaded according to the controlling terminal in graphic data base determine with
The candidate picture that described image data match, and the candidate picture is returned into the controlling terminal, so that the control is eventually
End generates virtual remote controller image according to the candidate picture on the object to be identified, and shows the void to the user
Quasi- remote controler image;
The server receives the operation information that the controlling terminal uploads, and generation is corresponding with the operation information to control letter
Number, the operation information is that the controlling terminal is generated according to user in the operation of the virtual remote controller image;
Wherein, the control signal is used to that the controlling terminal to be made to execute to by the control operation of control object.
4. method as claimed in claim 3, which is characterized in that the server uploads to be identified according to the controlling terminal
The image data of object determining candidate picture to match with described image data in graphic data base, specifically:
Traverse the graphic data base;
Controller picture in the graphic data base is matched with the image data of the object to be identified, is found out and institute
Controller picture similar in body form to be identified is stated as candidate picture;
The candidate picture is returned into the controlling terminal so that the controlling terminal according to the candidate picture described wait know
Virtual remote controller image is generated on other object, and the virtual remote controller image is shown to user.
5. method as claimed in claim 3, which is characterized in that the server generates control corresponding with the operation information
Signal, specifically:
Receive the operation information;
The corresponding relationship for analyzing key on the operation information and the virtual remote controller image, determines what the user to be executed
Function;
The control signal for corresponding to the function is generated according to the function.
6. a kind of controlling terminal, which is characterized in that the controlling terminal is applied in control system, and the control system further includes
Server, the terminal include:
First uploading module: the image data of the object to be identified is uploaded to institute by the object to be identified selected according to user
State server;
First receiving module: the candidate picture that the server returns is received, candidate's picture is the server according to institute
State controlling terminal upload object to be identified image data matched in graphic data base after determine;
Generate display module: the controlling terminal generates virtual remote controller on the object to be identified according to the candidate picture
Image, and the virtual remote controller image is shown to user;
Second uploading module: operation information of the user on the virtual remote controller image is uploaded to described by the controlling terminal
Server, so that the server generates control signal according to the operation information;
The controlling terminal further include:
Second receiving module: the controlling terminal receives the control signal that the server returns;
Sending module: the control signal is sent to signal emission module, the signal emission module is used for by control object
Body emissioning controling signal;
Execution module: the controlling terminal emits the control signal by the signal emission module and executes to by control object
Control operation;
Wherein, the control signal is to be generated by the server according to the operation information that the controlling terminal uploads.
7. controlling terminal as claimed in claim 6, which is characterized in that the operation information includes at least:
Actuation time, action frequency, sequence of movement and user of the user in the virtual remote controller are in the virtual remote control
The relative position acted on device image.
8. a kind of server, which is characterized in that for the server application in control system, the control system further includes control
Terminal, the server include:
Receiving module: the server receives the image data for the object to be identified that controlling terminal uploads, and described image data are
It is uploaded by the controlling terminal according to the object to be identified that user selectes;
Determining module: the image data for the object to be identified that the server is uploaded according to the controlling terminal is in graphic data base
The candidate picture that middle determination and described image data match, and the candidate picture is returned into the controlling terminal, so that institute
It states controlling terminal and virtual remote controller image is generated on the object to be identified according to the candidate picture, and to user's exhibition
Show the virtual remote controller image;
Generation module: the server receives the operation information that the controlling terminal uploads, and generates corresponding to the operation information
Control signal, the operation information, which is the controlling terminal, to be generated according to user in the operation of the virtual remote controller image
's;
Wherein, the control signal is used to that the controlling terminal to be made to execute to by the control operation of control object.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610709710.0A CN106331806B (en) | 2016-08-23 | 2016-08-23 | A kind of implementation method and equipment of virtual remote controller |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610709710.0A CN106331806B (en) | 2016-08-23 | 2016-08-23 | A kind of implementation method and equipment of virtual remote controller |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106331806A CN106331806A (en) | 2017-01-11 |
CN106331806B true CN106331806B (en) | 2019-11-19 |
Family
ID=57742245
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610709710.0A Active CN106331806B (en) | 2016-08-23 | 2016-08-23 | A kind of implementation method and equipment of virtual remote controller |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106331806B (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108021917A (en) * | 2017-10-27 | 2018-05-11 | 浙江兀兀科技有限公司 | A kind of remote controler recognition methods, system and portable electric appts based on image |
CN110968716B (en) * | 2019-12-03 | 2023-06-06 | 上海头豹智能技术有限公司 | Method for quickly code matching |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103389978A (en) * | 2012-05-07 | 2013-11-13 | 联想(北京)有限公司 | Method and system for acquiring information through augmented reality technologies |
CN104063039A (en) * | 2013-03-18 | 2014-09-24 | 朱慧灵 | Human-computer interaction method of wearable computer intelligent terminal |
CN105843054A (en) * | 2016-03-22 | 2016-08-10 | 美的集团股份有限公司 | Method for controlling household devices, intelligent household system and mobile device |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20150110257A (en) * | 2014-03-21 | 2015-10-02 | 삼성전자주식회사 | Method and wearable device for providing a virtual input interface |
US9900541B2 (en) * | 2014-12-03 | 2018-02-20 | Vizio Inc | Augmented reality remote control |
CN105468142A (en) * | 2015-11-16 | 2016-04-06 | 上海璟世数字科技有限公司 | Interaction method and system based on augmented reality technique, and terminal |
-
2016
- 2016-08-23 CN CN201610709710.0A patent/CN106331806B/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103389978A (en) * | 2012-05-07 | 2013-11-13 | 联想(北京)有限公司 | Method and system for acquiring information through augmented reality technologies |
CN104063039A (en) * | 2013-03-18 | 2014-09-24 | 朱慧灵 | Human-computer interaction method of wearable computer intelligent terminal |
CN105843054A (en) * | 2016-03-22 | 2016-08-10 | 美的集团股份有限公司 | Method for controlling household devices, intelligent household system and mobile device |
Also Published As
Publication number | Publication date |
---|---|
CN106331806A (en) | 2017-01-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10360715B2 (en) | Storage medium, information-processing device, information-processing system, and avatar generating method | |
US9098873B2 (en) | Motion-based interactive shopping environment | |
US20160180593A1 (en) | Wearable device-based augmented reality method and system | |
CN112396679B (en) | Virtual object display method and device, electronic equipment and medium | |
US10373348B2 (en) | Image processing apparatus, image processing system, and program | |
CN112148189A (en) | Interaction method and device in AR scene, electronic equipment and storage medium | |
CN111935489B (en) | Network live broadcast method, information display method and device, live broadcast server and terminal equipment | |
CN110176077A (en) | The method, apparatus and computer storage medium that augmented reality is taken pictures | |
CN113240782A (en) | Streaming media generation method and device based on virtual role | |
JPWO2018008138A1 (en) | Cosmetic information providing system, cosmetic information providing apparatus, cosmetic information providing method, and program | |
CN113115061B (en) | Live broadcast interaction method and device, electronic equipment and storage medium | |
CN112791417B (en) | Game picture shooting method, device, equipment and storage medium | |
EP3819752A1 (en) | Personalized scene image processing method and apparatus, and storage medium | |
CN106406111A (en) | Intelligent household electrical appliance operation method based on AR technology and image recognition technology | |
CN109242940A (en) | The generation method and device of three-dimensional dynamic images | |
CN106686463A (en) | Video role replacing method and apparatus | |
CN109978658A (en) | Product introduction method and device | |
CN106331806B (en) | A kind of implementation method and equipment of virtual remote controller | |
CN110543230A (en) | Stage lighting element design method and system based on virtual reality | |
CN114363689A (en) | Live broadcast control method and device, storage medium and electronic equipment | |
CN112148125A (en) | AR interaction state control method, device, equipment and storage medium | |
CN115379195A (en) | Video generation method and device, electronic equipment and readable storage medium | |
CN115624740A (en) | Virtual reality equipment, control method, device and system thereof, and interaction system | |
CN109509162B (en) | Image acquisition method, terminal, storage medium and processor | |
CN114173142A (en) | Object live broadcast display method and device, storage medium and electronic equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CP03 | Change of name, title or address | ||
CP03 | Change of name, title or address |
Address after: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218 Patentee after: Hisense Video Technology Co., Ltd Address before: 266555, No. 218, Bay Road, Qingdao economic and Technological Development Zone, Qingdao, Shandong Patentee before: HISENSE ELECTRIC Co.,Ltd. |