CN106331806B - A kind of implementation method and equipment of virtual remote controller - Google Patents

A kind of implementation method and equipment of virtual remote controller Download PDF

Info

Publication number
CN106331806B
CN106331806B CN201610709710.0A CN201610709710A CN106331806B CN 106331806 B CN106331806 B CN 106331806B CN 201610709710 A CN201610709710 A CN 201610709710A CN 106331806 B CN106331806 B CN 106331806B
Authority
CN
China
Prior art keywords
controlling terminal
server
user
remote controller
control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610709710.0A
Other languages
Chinese (zh)
Other versions
CN106331806A (en
Inventor
申成
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hisense Visual Technology Co Ltd
Original Assignee
Qingdao Hisense Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Hisense Electronics Co Ltd filed Critical Qingdao Hisense Electronics Co Ltd
Priority to CN201610709710.0A priority Critical patent/CN106331806B/en
Publication of CN106331806A publication Critical patent/CN106331806A/en
Application granted granted Critical
Publication of CN106331806B publication Critical patent/CN106331806B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality

Abstract

The invention discloses a kind of implementation methods of virtual remote controller, this method identifies some familiar objects by controlling terminal, the image information of object is uploaded to server, it receives the controller picture to match with object that server returns and generates virtual remote controller image to user's displaying, obtain operation information of the user in virtual remote controller, it determines the control function that user wishes to carry out and generates corresponding control signal, operate controlling terminal by the control that the control signal generated is completed for electronic product.Pass through the technical solution proposed using the embodiment of the present application, control operation can be carried out to electronic product using common object as virtual remote controller, entity controller problem easy to be lost in use is effectively reduced, user is improved and is carrying out experience sense and feeling of freshness in remote control process.

Description

A kind of implementation method and equipment of virtual remote controller
Technical field
The present invention relates to wireless control field more particularly to a kind of implementation methods of virtual remote controller.The present invention is also simultaneously It is related to a kind of controlling terminal and a kind of server.
Background technique
AR (Augmented Reality, augmented reality) technology be a kind of position for calculating video camera image in real time and Angle and the technology for adding respective image, the target of this technology is that virtual world is covered in real world and carried out on the screen Interaction.In recent years, with the development of wearable electronic product, more and more wearable devices start integrated AR technology, pass through It links with the control server on backstage, have the function of realizing augmented reality: such as familiar intelligent glasses completely may be used To be directed to common objects, accomplish identification, operation, load backstage image, to virtual image is perfectly embedded into actual On object, and then get movement by glasses by manipulating actual object, feed back the control server to backstage, finally by Background server issues a series of specific control instructions, achievees the purpose that control real world.
The important way that TV remote controller is interacted as the mankind with television set is all that the mankind manipulate television set all the time Major way.But there is also many drawbacks, such as key are more and complicated for operation for TV remote controller.Although in recent years, with The emergence of intelligent TV set, each smart television manufacturer have all done huge in the appearance summary and function ease for use of remote controler Big improvement, the remote controler of smart television is increasingly simpler, key is also fewer and fewer, but not everyone can receive;And The intelligent or non intelligent TV of many storages is remained in the market, their remote controler construction is extremely complex.In addition, TV Remote controler appearance after tv product is bought in can not be just altered again, in addition it is easy to happen and is difficult to as small-sized control peripheral hardware The case where finding.
Applicant has found that existing TV remote controller is still to be with entity remote controler in the implementation of the present invention It is main, still can there are problems that causing since small volume is easy to be lost television set can not normal use distant control function, and due to showing The appearance fixture construction of some entity remote controlers is complicated, can not be replaced according to the hobby of user, this uses body to user's It tests and brings limitation.
Therefore, entity remote controler how is substituted by a kind of virtual remote controller, improves entity remote controler in use process The problem of middle objective reality, and then user experience is promoted, become those skilled in the art's problem to be solved.
Summary of the invention
The embodiment of the present application provides a kind of implementation method of virtual remote controller, can be using some common objects as remote control Device simultaneously realizes the corresponding function of remote controler, avoid as entity remote controler lose and caused by can not normal use the case where, The appearance that remote controler can be optimized according to user preferences simultaneously, greatly improves the usage experience of user.
In order to reach above-mentioned technical purpose, this application provides a kind of implementation method of virtual remote controller, the method is answered For the controlling terminal in control system, the control system further includes server, this method comprises:
The image data of the object to be identified is uploaded to described by the object to be identified that controlling terminal is selected according to user Server;
Controlling terminal receives the candidate picture that the server returns, and candidate's picture is the server according to What the image data for the object to be identified that controlling terminal uploads determined after being matched in graphic data base;
The controlling terminal generates virtual remote controller image according to the candidate picture on the object to be identified, and will The virtual remote controller image is shown to user;
Operation information of the user on the virtual remote controller image is uploaded to the server by the controlling terminal, with The server is set to generate control signal according to the operation information.
Another aspect of the present invention additionally provides a kind of implementation method of virtual controlling, and the method is applied in control system Server, the control system further includes controlling terminal, this method comprises:
The server receives the image data for the object to be identified that controlling terminal uploads, and described image data are by described Controlling terminal is uploaded according to the object to be identified that user selectes;
The image data for the object to be identified that the server is uploaded according to the controlling terminal is true in graphic data base The candidate picture that fixed and described image data match, and the candidate picture is returned into the controlling terminal, so that the control Terminal processed generates virtual remote controller image according to the candidate picture on the object to be identified, and shows institute to the user State virtual remote controller image;
The server receives the operation information that the controlling terminal uploads, and generates control corresponding with the operation information Signal, the operation information are that the controlling terminal is generated according to user in the operation of the virtual remote controller image.
Correspondingly, the application also proposed a kind of controlling terminal, which is characterized in that the controlling terminal is applied to control system In system, the control system further includes server, and the terminal includes:
First uploading module: the object to be identified selected according to user uploads the image data of the object to be identified To the server;
First receiving module: the candidate picture that the server returns is received, candidate's picture is the server root What the image data of the object to be identified uploaded according to the controlling terminal determined after being matched in graphic data base;
Generate display module: the controlling terminal generates on the object to be identified virtual distant according to the candidate picture Device image is controlled, and the virtual remote controller image is shown to user;
Second uploading module: operation information of the user on the virtual remote controller image is uploaded to by the controlling terminal The server, so that the server generates control signal according to the operation information.
Further, the present invention also provides a kind of server, the server application is in control system, the control System further includes controlling terminal, and the server includes:
Receiving module: the server receives the image data for the object to be identified that controlling terminal uploads, described image number According to being to be uploaded by the controlling terminal according to the object to be identified that user selectes;
Determining module: the image data for the object to be identified that the server is uploaded according to the controlling terminal is in figure number The controlling terminal is returned according to the candidate picture to match with described image data determining in library, and by the candidate picture, with The controlling terminal is set to generate virtual remote controller image on the object to be identified according to the candidate picture, and to the use Family shows the virtual remote controller image;
Generation module: the server receives the operation information that the controlling terminal uploads, and generates and the operation information Corresponding control signal, the operation information are that the controlling terminal is raw in the operation of the virtual remote controller image according to user At.
Compared with prior art, the advantageous effects for the technical solution that the embodiment of the present application is proposed include:
The embodiment of the present application discloses a kind of implementation method of virtual remote controller, and this method is identified by controlling terminal The image information of the object is uploaded to server by familiar object, and receive that server returns matches with the object Controller picture generates virtual remote controller image and shows to user, obtains operation information of the user in virtual remote controller, determines The corresponding control signal of control function and generation that user wishes to carry out makes control signal completion pair of the controlling terminal by generation It is operated in the control of electronic product.By the technical solution proposed using the embodiment of the present application, common object can be made Control operation is carried out to electronic product for virtual remote controller, effectively reduces that entity controller is easy to be lost in use asks Topic improves user and is carrying out experience sense and feeling of freshness in remote control process.
Detailed description of the invention
Fig. 1 is a kind of implementation method flow diagram for virtual remote controller that the embodiment of the present application proposes;
Fig. 2 is a kind of implementation method flow diagram for virtual remote controller that the embodiment of the present application proposes;
Fig. 3 is a kind of virtual remote control method realized by intelligent glasses for television set proposed in the embodiment of the present application Schematic diagram;
Fig. 4 is in the embodiment of the present application in the application preferred embodiment in application scenarios, and a kind of realization Television Virtual is distant The system architecture diagram of control;
Fig. 5 is a kind of structural schematic diagram of the controlling terminal proposed in the embodiment of the present application;
Fig. 6 is a kind of structural schematic diagram of the server proposed in the embodiment of the present application.
Specific embodiment
In view of the problems of the prior art, this application provides a kind of implementation methods of virtual remote controller, by spy Virtual remote controller image is launched on fixed object, is obtained operation information of the user in virtual remote controller, is generated and correspond to operation The control signal of information effectively subtracts to achieve the purpose that control electronic product to greatly improve the usage experience of user Lacked entity controller it is easy to be lost in use, can not the dull experience sense of general and use process it is poor the problems such as.
As shown in Figure 1, a kind of implementation method flow diagram of the virtual remote controller proposed for the embodiment of the present application, described Method is applied to the controlling terminal in control system, and the control system further includes server, this method comprises:
Step 101: the object to be identified that controlling terminal is selected according to user, it will be in the image data of the object to be identified Reach the server.
The remote controler of entity exists due to some objective factors and is easily lost and can not arbitrarily change in the prior art The problem of remote controler appearance, thus need it is adjustable with a kind of appearance, and will not can not be normal distant because remote control carrier is lacked The virtual remote controller of control replaces existing entity remote controler.Therefore need to select the object of the carrier as virtual remote controller first Body, and the image data of the object is uploaded to server and is analyzed.
In the application preferred embodiment, controlling terminal determines the selected object to be identified of user first;It controls later Terminal obtains the image data of the object to be identified, and acquisition modes can be through but not limited to the built-in miniature in controlling terminal Video camera is realized;Then, the image data that controlling terminal will acquire is uploaded to the server end in system, trigger the server According to the image data matching candidate image of object to be identified.
Step 102: controlling terminal receives the candidate picture that the server returns.
In the application preferred embodiment, the image data of object to be identified is being uploaded to the server by controlling terminal Later, matching instruction can be sent to server, carries out server in graphic data base according to the image data received Match, finds out and be used as candidate picture to be back to controlling terminal with controller picture similar in described image data shape.
Step 103: the controlling terminal generates virtual remote controller on the object to be identified according to the candidate picture Image, and the virtual remote controller image is shown to user.
In the application preferred embodiment, controlling terminal, can be by institute after the candidate picture for receiving server return The candidate picture presentation having different candidate pictures can be compared with object to be identified to user, user, select one Picture is as controller picture ready for use, and result is nested by controller picture ready for use according to the user's choice for controlling terminal On object to be identified, generates the image of virtual remote controller and the image of the virtual remote controller of generation is showed into user.
Step 104: operation information of the user on the virtual remote controller image is uploaded to described by the controlling terminal Server, so that the server generates control signal according to the operation information.
In the application preferred embodiment, when user starts operation, controlling terminal obtains user in virtual remote control utensil Gymnastics is made, and generates corresponding control information according to the concrete operations of user, the control information includes at least: user is in the void The phase that actuation time, action frequency, sequence of movement and user on quasi- remote controler act on the virtual remote controller image To position.The control information is being uploaded to server by controlling terminal, and issues analysis instruction to server, is referred to by analysis It enables instruction server to analyze operation information, and then generates the control signal for corresponding to operation information.
Compared with prior art, the advantageous effects for the technical solution that the embodiment of the present application is proposed include:
The embodiment of the present application discloses a kind of implementation method of virtual remote controller, and this method is identified by controlling terminal The image information of the object is uploaded to server by familiar object, and receive that server returns matches with the object Controller picture generates virtual remote controller image and shows to user, by obtaining operation information of the user in virtual remote controller, It determines the control function that user wishes to carry out and generates corresponding control signal, keep controlling terminal complete by the control signal generated It is operated in pairs in the control of electronic product.It, can be by common object by the technical solution proposed using the embodiment of the present application Body carries out control operation to electronic product as virtual remote controller, effectively reduces entity controller and easily loses in use Lose, can not the dull experience sense of general and use process it is poor the problems such as, improve user carry out remote control process in experience Sense and feeling of freshness.
It should be noted that the above-mentioned embodiment in the application preferred embodiment only represent it is a kind of preferably real in the application Implement scene in example is applied, the solution of the present invention can not be represented and be only restricted in this, anyone skilled in the art are without wound In the case that the property made is worked it is conceivable that prioritization scheme should all fall into the protection scope of the present embodiment.
The present invention also provides a kind of implementation method of virtual controlling, the method is applied to the service in control system Device, the control system further include controlling terminal, are illustrated in figure 2 the flow diagram of the method, this method comprises:
Step 201: the server receives the image data for the object to be identified that controlling terminal uploads, described image data It is to be uploaded by the controlling terminal according to the object to be identified that user selectes;
Step 202: the image data for the object to be identified that the server is uploaded according to the controlling terminal is in figure number The controlling terminal is returned according to the candidate picture to match with described image data determining in library, and by the candidate picture.
In the application preferred embodiment, image data of the server in the object to be identified for receiving controlling terminal upload Later, graphic data base is traversed, wherein the graphic data base is stored with the controller picture of various shapes;
Server by the graphic data base controller picture and the object to be identified image data carry out Match, finds out with controller picture similar in the body form to be identified as candidate picture, it should be noted that candidate picture Quantity there is no specific limitation, can need be arranged according to the specific of user;
After selected candidate picture, the candidate picture selected is returned to the controlling terminal by server, so that the control Terminal processed generates virtual remote controller image according to the candidate picture on the object to be identified, and by the virtual remote controller Image shows that the method that virtual remote controller image is generated in the application preferred embodiment is identical with preceding method, In to user This is repeated no more.
Step 203: the server receives the operation information that the controlling terminal uploads, and generates and the operation information phase The control signal answered.
In the application preferred embodiment, server analyzes institute after the operation information for receiving controlling terminal upload The corresponding relationship for stating key on operation information and the virtual remote controller image, determines the user function to be executed.Such as: User has carried out single-click operation corresponding to the key of " volume+" on the image of the virtual remote controller, and server passes through user The click on object of number of clicks and user relative position, to judge the function that user wishes to carry out at this time " to increase Add volume a unit ", so server can correspond to the control signal for generating and realizing " increasing by one unit of volume " function.Equally , when user presses bookish other parts, cloud server also can be according to the corresponding position of user's operation and click Number, click time determine the function that user wishes to carry out, and then the control for corresponding to the function is generated according to the function Signal.
Compared with prior art, the advantageous effects for the technical solution that the embodiment of the present application is proposed include:
The embodiment of the present application discloses a kind of implementation method of virtual remote controller, and this method is identified by controlling terminal The image information of the object is uploaded to server by familiar object, and receive that server returns matches with the object Controller picture generates virtual remote controller image and shows to user, by obtaining operation information of the user in virtual remote controller, It determines the control function that user wishes to carry out and generates corresponding control signal, keep controlling terminal complete by the control signal generated It is operated in pairs in the control of electronic product.It, can be by common object by the technical solution proposed using the embodiment of the present application Body carries out control operation to electronic product as virtual remote controller, effectively reduces entity controller and easily loses in use Lose, can not the dull experience sense of general and use process it is poor the problems such as, improve user carry out remote control process in experience Sense and feeling of freshness.
It should be noted that the above-mentioned embodiment in the application preferred embodiment only represent it is a kind of preferably real in the application Implement scene in example is applied, the solution of the present invention can not be represented and be only restricted in this, anyone skilled in the art are without wound In the case that the property made is worked it is conceivable that prioritization scheme should all fall into the protection scope of the present embodiment.
It is right now in conjunction with the application scenarios in the application preferred embodiment for the technical idea that the present invention is further explained Technical solution of the present invention is illustrated.
As shown in figure 3, a kind of being realized by intelligent glasses for the virtual of television set for what is proposed in the embodiment of the present application Remote control method schematic diagram, the technical solution in the present embodiment are main including the following three aspects: are that intelligent glasses identification is special first Fixed domestic articles cover the virtual picture stored in server on article, and user is made to feel that the article is one " true " TV remote controller;Secondly, user's operation " remote controler ", glasses capture acts and issues corresponding manipulation instruction, control electricity Depending on;Finally, intelligent glasses incude and disconnect this application when user's no longer wearing spectacles, special article can continue to play its original There is purposes.The framework of whole system is as shown in Fig. 4, and the method specifically includes:
Step 301: image data acquiring.
In the application preferred embodiment, in user's wearing after intelligent glasses, open " virtual distant in intelligent glasses Control device " app application, it is automatic search the smart television being located in same local area network and establish connection (if it is non intelligent TV, can It to input television model by way of craft, is matched);Intelligent glasses are by built-in miniature webcam, first to wanting The object of identification is imaged, and shoots 5 photos (such as books of one 120mm*60mm*10mm of identification), acquisition will identify The image data of object.
Step 302: image data uploads.
In the application preferred embodiment, by built-in camera complete to the image data acquiring of object to be identified it Afterwards, acquired image data are uploaded to cloud server.
Step 303: issuing comparison instruction.
In the application preferred embodiment, after described image data are uploaded to cloud server, intelligent glasses are issued Instruction indicates that cloud server according to the image data received carries out shape comparison in picture library, filter out with it is described to Virtual remote controller picture similar in body form is identified as candidate picture, the quantity of candidate picture is 10 in the present embodiment .It should be understood that the quantity of candidate picture can not exist according to specific using being manually set It is limited in the application preferred embodiment, details are not described herein.
Step 304: issuing candidate picture.
In the application preferred embodiment, server is complete in picture library according to the image data of object to be identified beyond the clouds In contrast with after, the candidate picture determined is returned into the intelligent glasses end that user uses, user can be in candidate picture Carry out selection and effect preview.
Step 305: candidate picture selection.
In the application preferred embodiment, selects and imitate in user's 10 candidate pictures that server returns beyond the clouds Fruit preview selectes the comparison picture of oneself satisfaction, the picture chosen is nested on the notebook as object to be identified.
Step 306: display virtual remote controller.
In the application preferred embodiment, after the selection of user, selected remote controler picture is nested in wait know On other object, at this point, notebook visually becomes one completely when user sees notebook by intelligent glasses again Completely " TV remote controller "
Step 307: movement obtains.
In the application preferred embodiment, intelligent glasses in user's wearing, after the processing Jing Guo abovementioned steps, at this time Books visually have become a complete TV remote controller user's, and have the various buttons of remote controler, such as Power on button, volume add and subtract button, channel selection button etc.;User can as using true remote controler on books point It hits or long-pressing, intelligent glasses obtains the movement and opposite position that user is carried out on books by built-in miniature webcam It sets, records user in bookish operation information.
Step 308: upload information.
In the application preferred embodiment, the user that intelligent glasses will acquire is in books (i.e. visual virtual remote control Device) on operation information upload to cloud server.
Step 309: issuing analysis instruction.
In the application preferred embodiment, user is uploaded into cloud service in bookish operation information in intelligent glasses After device, Xiang Suoshu cloud server issues analysis instruction, indicates that the cloud server believes user in bookish operation Breath is analyzed, and determines function and the purpose for manipulating TV that user wishes to carry out, such as: user clicks one on books Under, the position that user clicks corresponds to the position of volume "+" in virtual remote controller, and cloud server can determine that user thinks at this time Increase the operation of volume, when user presses bookish other parts, cloud server also can be according to corresponding position It sets and number of clicks, click event determines function that user wishes to carry out, determine method in the application preferred embodiment Identical as preceding method, details are not described herein.
Step 310: issuing control signal.
In the application preferred embodiment, the cloud server is after having determined the function that user wishes to carry out, root Corresponding control signal is generated according to the function and the control signal is returned to the intelligent glasses end of user, in the application reality It applies in example, after the completion of cloud server analysis, by the Keycode (to smart television) of generation or infrared code value (to non intelligent TV) notice intelligent glasses.
Step 311: carrying out control operation by controlling signal.
In the application preferred embodiment, intelligent glasses receive the Keycode or infrared code value that cloud server returns, Infrared key assignments (to non intelligent TV) is sent to by Keycode (to smart television) or by IR interface by udp protocol TV achievees the purpose that control TV.
Preferably, in application the embodiment of the present application, when user took off one's spectacles more than 5 minutes, or actively, selection is exited When, glasses end disconnects, and books continue to play the function of itself and act in the application preferred embodiment and can pass through As under type is realized:
(1) user removes intelligent glasses, and intelligent glasses sense this movement of user, start timing;
(2) full 5 minutes of timing, glasses end will close identification application, and virtual remote controler picture disappears, and user is from glasses end The books seen restore normal;
(3) user can also the slave glasses end selection of active exit application, effect is identical as (2).
The technical solution that the embodiment of the present application is proposed, by the place that specific object to be identified is passed through to AR intelligent glasses After reason, virtual controller is visually formed;When user operates, by analysis user described virtual distant Operation information on control device determines user's function to be performed, the control signal of corresponding function is generated and sent, to reach Control the purpose of television set.By technical solution provided by the embodiment of the present application, being effectively reduced entity controller makes With in the process it is easy to be lost, can not the dull experience sense of general and use process it is poor the problems such as, improve user and remotely controlled Experience sense and feeling of freshness in the process.
It should be noted that described embodiment is a part of the embodiment of the application, rather than whole realities Apply example.Above in the application preferred embodiment the content of application scenarios be only the application preferred embodiment propose example, In It can also include more application fields on the basis of this, so that the technical program has widely application, these improvement Belong to protection scope of the present invention.
To reach the above technical purpose, accordingly, present applicant proposes a kind of controlling terminals, as shown in figure 5, being the application A kind of structural schematic diagram of the controlling terminal proposed in embodiment, the terminal applies are in control system, the control system Further include server, the terminal specifically includes:
First uploading module 510: the object to be identified selected according to user, it will be in the image data of the object to be identified Reach the server;
First receiving module 520: the candidate picture that the server returns is received, candidate's picture is the server What the image data of the object to be identified uploaded according to the controlling terminal determined after being matched in graphic data base;
Generate display module 530: the controlling terminal generates void according to the candidate picture on the object to be identified Quasi- remote controler image, and the virtual remote controller image is shown to user;
Second uploading module 540: the controlling terminal is by user in the operation information on the virtual remote controller image The server is reached, so that the server generates control signal according to the operation information.
In the application preferred embodiment in application scenarios, the controlling terminal further include:
Second receiving module 550: the controlling terminal receives the control signal that the server returns;
Sending module 560: being sent to signal emission module for the control signal, the signal emission module for want by It controls object emission and controls signal;
Execution module 570: the controlling terminal emits the control signal by the signal emission module and executes to quilt Control the control operation of object;
Wherein, the control signal is to be generated by the server according to the operation information that the controlling terminal uploads.
In application scenarios, the operation information is included at least in the application preferred embodiment:
Actuation time, action frequency, sequence of movement and user of the user in the virtual remote controller are described virtual The relative position acted on remote controler image.
Compared with prior art, the advantageous effects for the technical solution that the embodiment of the present application is proposed include:
The embodiment of the present application discloses a kind of implementation method of virtual remote controller, and this method is identified by controlling terminal The image information of the object is uploaded to server by familiar object, and receive that server returns matches with the object Controller picture generates virtual remote controller image and shows to user, by obtaining operation information of the user in virtual remote controller, It determines the control function that user wishes to carry out and generates corresponding control signal, keep controlling terminal complete by the control signal generated It is operated in pairs in the control of electronic product.It, can be by common object by the technical solution proposed using the embodiment of the present application Body carries out control operation to electronic product as virtual remote controller, effectively reduces entity controller and easily loses in use Lose, can not the dull experience sense of general and use process it is poor the problems such as, improve user carry out remote control process in experience Sense and feeling of freshness.
It should be noted that the above-mentioned embodiment in the application preferred embodiment only represent it is a kind of preferably real in the application Implement scene in example is applied, the solution of the present invention can not be represented and be only restricted in this, anyone skilled in the art are without wound In the case that the property made is worked it is conceivable that prioritization scheme should all fall into the protection scope of the present embodiment.
The present invention still further provides a kind of server, and the server application is in control system, the control system It further include controlling terminal, as shown in fig. 6, for a kind of structural schematic diagram of the server proposed in the embodiment of the present application, the clothes Business device include:
Receiving module 610: the server receives the image data for the object to be identified that controlling terminal uploads, described image Data are to be uploaded by the controlling terminal according to the object to be identified that user selectes;
Determining module 620: the image data for the object to be identified that the server is uploaded according to the controlling terminal is being schemed The determining candidate picture to match with described image data in graphic data library, and the candidate picture is returned into the control eventually End, so that the controlling terminal generates virtual remote controller image according to the candidate picture on the object to be identified, and to The user shows the virtual remote controller image;
Generation module 630: the server receives the operation information that the controlling terminal uploads, and generates and believes with the operation The corresponding control signal of breath, the operation information be the controlling terminal according to user the virtual remote controller image operation It generates.
In application scenarios, the determining module 620 is specifically used in the application preferred embodiment:
Traverse the graphic data base;
Controller picture in the graphic data base is matched with the image data of the object to be identified, is found out With controller picture similar in the body form to be identified as candidate picture;
The candidate picture is returned into the controlling terminal, so that the controlling terminal is according to the candidate picture described Virtual remote controller image is generated on object to be identified, and the virtual remote controller image is shown to user.
In application scenarios, the generation module 630 is specifically used in the application preferred embodiment:
Receive the operation information;
The corresponding relationship for analyzing key on the operation information and the virtual remote controller image, determines that the user will hold Capable function;
The control signal for corresponding to the function is generated according to the function.
Compared with prior art, the advantageous effects for the technical solution that the embodiment of the present application is proposed include:
The embodiment of the present application discloses a kind of implementation method of virtual remote controller, and this method is identified by controlling terminal The image information of the object is uploaded to server by familiar object, and receive that server returns matches with the object Controller picture generates virtual remote controller image and shows to user, by obtaining operation information of the user in virtual remote controller, It determines the control function that user wishes to carry out and generates corresponding control signal, keep controlling terminal complete by the control signal generated It is operated in pairs in the control of electronic product.It, can be by common object by the technical solution proposed using the embodiment of the present application Body carries out control operation to electronic product as virtual remote controller, effectively reduces entity controller and easily loses in use Lose, can not the dull experience sense of general and use process it is poor the problems such as, improve user carry out remote control process in experience Sense and feeling of freshness.
It should be noted that the above-mentioned embodiment in the application preferred embodiment only represent it is a kind of preferably real in the application Implement scene in example is applied, the solution of the present invention can not be represented and be only restricted in this, anyone skilled in the art are without wound In the case that the property made is worked it is conceivable that prioritization scheme should all fall into the protection scope of the present embodiment.
Through the above description of the embodiments, those skilled in the art can be understood that the present invention can lead to Hardware realization is crossed, the mode of necessary general hardware platform can also be added to realize by software.Based on this understanding, this hair Bright technical solution can be embodied in the form of software products, which can store in a non-volatile memories In medium (can be CD-ROM, USB flash disk, mobile hard disk etc.), including some instructions are used so that a computer equipment (can be Personal computer, server or network equipment etc.) execute method described in each implement scene of the present invention.
It will be appreciated by those skilled in the art that the accompanying drawings are only schematic diagrams of a preferred implementation scenario, module in attached drawing or Process is not necessarily implemented necessary to the present invention.
It will be appreciated by those skilled in the art that the module in device in implement scene can be described according to implement scene into Row is distributed in the device of implement scene, can also be carried out corresponding change and is located at the one or more dresses for being different from this implement scene In setting.The module of above-mentioned implement scene can be merged into a module, can also be further split into multiple submodule.
Aforementioned present invention serial number is for illustration only, does not represent the superiority and inferiority of implement scene.
Disclosed above is only several specific implementation scenes of the invention, and still, the present invention is not limited to this, Ren Heben What the technical staff in field can think variation should all fall into protection scope of the present invention.

Claims (8)

1. a kind of implementation method of virtual remote controller, which is characterized in that the method is applied to the controlling terminal in control system, The control system further includes server, this method comprises:
Controlling terminal acquires the image data of the object to be identified and by the object to be identified according to determining object to be identified The image data of body is uploaded to the server;
Controlling terminal receives the candidate picture that the server returns, and candidate's picture is the server according to the control What the image data for the object to be identified that terminal uploads determined after being matched in graphic data base;
The controlling terminal generates virtual remote controller image according to the candidate picture on the object to be identified, and will be described Virtual remote controller image is shown to user;
Operation information of the user on the virtual remote controller image is uploaded to the server by the controlling terminal, so that institute It states server and control signal is generated according to the operation information;
The controlling terminal by user after the operation information on the virtual remote controller image is uploaded to the server, Further include:
The controlling terminal receives the control signal that the server returns;
The control signal is sent to signal emission module, the signal emission module to by control object emission for controlling Signal;
The controlling terminal emits the control signal by the signal emission module and executes to by the control behaviour of control object Make;
Wherein, the control signal is to be generated by the server according to the operation information that the controlling terminal uploads.
2. the method as described in claim 1, which is characterized in that the operation information includes at least:
Actuation time, action frequency, sequence of movement and user of the user in the virtual remote controller are in the virtual remote control The relative position acted on device image.
3. a kind of implementation method of virtual remote controller, which is characterized in that the method is applied to the server in control system, institute Stating control system further includes controlling terminal, this method comprises:
The server receives the image data for the object to be identified that controlling terminal uploads, and described image data are by the control Terminal is uploaded according to the object to be identified that user selectes;
The image data for the object to be identified that the server is uploaded according to the controlling terminal in graphic data base determine with The candidate picture that described image data match, and the candidate picture is returned into the controlling terminal, so that the control is eventually End generates virtual remote controller image according to the candidate picture on the object to be identified, and shows the void to the user Quasi- remote controler image;
The server receives the operation information that the controlling terminal uploads, and generation is corresponding with the operation information to control letter Number, the operation information is that the controlling terminal is generated according to user in the operation of the virtual remote controller image;
Wherein, the control signal is used to that the controlling terminal to be made to execute to by the control operation of control object.
4. method as claimed in claim 3, which is characterized in that the server uploads to be identified according to the controlling terminal The image data of object determining candidate picture to match with described image data in graphic data base, specifically:
Traverse the graphic data base;
Controller picture in the graphic data base is matched with the image data of the object to be identified, is found out and institute Controller picture similar in body form to be identified is stated as candidate picture;
The candidate picture is returned into the controlling terminal so that the controlling terminal according to the candidate picture described wait know Virtual remote controller image is generated on other object, and the virtual remote controller image is shown to user.
5. method as claimed in claim 3, which is characterized in that the server generates control corresponding with the operation information Signal, specifically:
Receive the operation information;
The corresponding relationship for analyzing key on the operation information and the virtual remote controller image, determines what the user to be executed Function;
The control signal for corresponding to the function is generated according to the function.
6. a kind of controlling terminal, which is characterized in that the controlling terminal is applied in control system, and the control system further includes Server, the terminal include:
First uploading module: the image data of the object to be identified is uploaded to institute by the object to be identified selected according to user State server;
First receiving module: the candidate picture that the server returns is received, candidate's picture is the server according to institute State controlling terminal upload object to be identified image data matched in graphic data base after determine;
Generate display module: the controlling terminal generates virtual remote controller on the object to be identified according to the candidate picture Image, and the virtual remote controller image is shown to user;
Second uploading module: operation information of the user on the virtual remote controller image is uploaded to described by the controlling terminal Server, so that the server generates control signal according to the operation information;
The controlling terminal further include:
Second receiving module: the controlling terminal receives the control signal that the server returns;
Sending module: the control signal is sent to signal emission module, the signal emission module is used for by control object Body emissioning controling signal;
Execution module: the controlling terminal emits the control signal by the signal emission module and executes to by control object Control operation;
Wherein, the control signal is to be generated by the server according to the operation information that the controlling terminal uploads.
7. controlling terminal as claimed in claim 6, which is characterized in that the operation information includes at least:
Actuation time, action frequency, sequence of movement and user of the user in the virtual remote controller are in the virtual remote control The relative position acted on device image.
8. a kind of server, which is characterized in that for the server application in control system, the control system further includes control Terminal, the server include:
Receiving module: the server receives the image data for the object to be identified that controlling terminal uploads, and described image data are It is uploaded by the controlling terminal according to the object to be identified that user selectes;
Determining module: the image data for the object to be identified that the server is uploaded according to the controlling terminal is in graphic data base The candidate picture that middle determination and described image data match, and the candidate picture is returned into the controlling terminal, so that institute It states controlling terminal and virtual remote controller image is generated on the object to be identified according to the candidate picture, and to user's exhibition Show the virtual remote controller image;
Generation module: the server receives the operation information that the controlling terminal uploads, and generates corresponding to the operation information Control signal, the operation information, which is the controlling terminal, to be generated according to user in the operation of the virtual remote controller image 's;
Wherein, the control signal is used to that the controlling terminal to be made to execute to by the control operation of control object.
CN201610709710.0A 2016-08-23 2016-08-23 A kind of implementation method and equipment of virtual remote controller Active CN106331806B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610709710.0A CN106331806B (en) 2016-08-23 2016-08-23 A kind of implementation method and equipment of virtual remote controller

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610709710.0A CN106331806B (en) 2016-08-23 2016-08-23 A kind of implementation method and equipment of virtual remote controller

Publications (2)

Publication Number Publication Date
CN106331806A CN106331806A (en) 2017-01-11
CN106331806B true CN106331806B (en) 2019-11-19

Family

ID=57742245

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610709710.0A Active CN106331806B (en) 2016-08-23 2016-08-23 A kind of implementation method and equipment of virtual remote controller

Country Status (1)

Country Link
CN (1) CN106331806B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108021917A (en) * 2017-10-27 2018-05-11 浙江兀兀科技有限公司 A kind of remote controler recognition methods, system and portable electric appts based on image
CN110968716B (en) * 2019-12-03 2023-06-06 上海头豹智能技术有限公司 Method for quickly code matching

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103389978A (en) * 2012-05-07 2013-11-13 联想(北京)有限公司 Method and system for acquiring information through augmented reality technologies
CN104063039A (en) * 2013-03-18 2014-09-24 朱慧灵 Human-computer interaction method of wearable computer intelligent terminal
CN105843054A (en) * 2016-03-22 2016-08-10 美的集团股份有限公司 Method for controlling household devices, intelligent household system and mobile device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20150110257A (en) * 2014-03-21 2015-10-02 삼성전자주식회사 Method and wearable device for providing a virtual input interface
US9900541B2 (en) * 2014-12-03 2018-02-20 Vizio Inc Augmented reality remote control
CN105468142A (en) * 2015-11-16 2016-04-06 上海璟世数字科技有限公司 Interaction method and system based on augmented reality technique, and terminal

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103389978A (en) * 2012-05-07 2013-11-13 联想(北京)有限公司 Method and system for acquiring information through augmented reality technologies
CN104063039A (en) * 2013-03-18 2014-09-24 朱慧灵 Human-computer interaction method of wearable computer intelligent terminal
CN105843054A (en) * 2016-03-22 2016-08-10 美的集团股份有限公司 Method for controlling household devices, intelligent household system and mobile device

Also Published As

Publication number Publication date
CN106331806A (en) 2017-01-11

Similar Documents

Publication Publication Date Title
US10360715B2 (en) Storage medium, information-processing device, information-processing system, and avatar generating method
US9098873B2 (en) Motion-based interactive shopping environment
US20160180593A1 (en) Wearable device-based augmented reality method and system
CN112396679B (en) Virtual object display method and device, electronic equipment and medium
US10373348B2 (en) Image processing apparatus, image processing system, and program
CN112148189A (en) Interaction method and device in AR scene, electronic equipment and storage medium
CN111935489B (en) Network live broadcast method, information display method and device, live broadcast server and terminal equipment
CN110176077A (en) The method, apparatus and computer storage medium that augmented reality is taken pictures
CN113240782A (en) Streaming media generation method and device based on virtual role
JPWO2018008138A1 (en) Cosmetic information providing system, cosmetic information providing apparatus, cosmetic information providing method, and program
CN113115061B (en) Live broadcast interaction method and device, electronic equipment and storage medium
CN112791417B (en) Game picture shooting method, device, equipment and storage medium
EP3819752A1 (en) Personalized scene image processing method and apparatus, and storage medium
CN106406111A (en) Intelligent household electrical appliance operation method based on AR technology and image recognition technology
CN109242940A (en) The generation method and device of three-dimensional dynamic images
CN106686463A (en) Video role replacing method and apparatus
CN109978658A (en) Product introduction method and device
CN106331806B (en) A kind of implementation method and equipment of virtual remote controller
CN110543230A (en) Stage lighting element design method and system based on virtual reality
CN114363689A (en) Live broadcast control method and device, storage medium and electronic equipment
CN112148125A (en) AR interaction state control method, device, equipment and storage medium
CN115379195A (en) Video generation method and device, electronic equipment and readable storage medium
CN115624740A (en) Virtual reality equipment, control method, device and system thereof, and interaction system
CN109509162B (en) Image acquisition method, terminal, storage medium and processor
CN114173142A (en) Object live broadcast display method and device, storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP03 Change of name, title or address
CP03 Change of name, title or address

Address after: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218

Patentee after: Hisense Video Technology Co., Ltd

Address before: 266555, No. 218, Bay Road, Qingdao economic and Technological Development Zone, Qingdao, Shandong

Patentee before: HISENSE ELECTRIC Co.,Ltd.