Summary of the invention
In view of this, the object of the present invention is to provide a kind of remote control self-adaptation control method, the method is used single remote respectively a plurality of target devices to be controlled, and can strengthen the convenience of operability and control.
In order to achieve the above object, the invention provides a kind of remote control self-adaptation control method, the method comprises:
The described arbitrary target device of camera of upper setting of using a teleswitch is taken, by the photo upload of described arbitrary target device of photographing to server;
The recognition result that reception server returns after described arbitrary target device photo is identified, and export described recognition result to the display screen arranged on remote controller, described recognition result comprises the target device list identified;
Receive the confirmation message of user to a target device in described target device list, from each pre-stored target device, corresponding straighforward operation interface information, search straighforward operation interface corresponding to a described target device, and export straighforward operation interface that a described target device is corresponding to the display screen arranged on remote controller.
The present invention also provides a kind of remote controller, and this remote controller comprises: memory cell, uploading unit, receiving element, output unit;
Described memory cell, the corresponding straighforward operation interface information for pre-stored each target device;
Described uploading unit, taken described arbitrary target device for using the camera arranged on this remote controller, by the photo upload of described arbitrary target device of photographing to server;
Described receiving element, for uploading unit by the photo upload of described arbitrary target device to server, the recognition result that reception server returns after described arbitrary target device photo is identified, described recognition result comprises the target device list identified; For exporting described recognition result at output unit after the display screen arranged on this remote controller, receive the confirmation message of user to a target device in described target device list;
Described output unit, when receiving after server is identified described arbitrary target device photo the recognition result returned at receiving element, export described recognition result to the display screen arranged on this remote controller; When at receiving element, receiving the user to the confirmation message of a target device of described target device list, search straighforward operation interface corresponding to a described target device the straighforward operation interface information that pre-stored each target device is corresponding from memory cell, and export straighforward operation interface that a described target device is corresponding to the display screen arranged on this remote controller.
The present invention also provides a kind of remote control Adaptable System, and this system comprises: remote controller, server;
Described remote controller, taken arbitrary target device for using the camera arranged on this remote controller, by the photo upload of described arbitrary target device of photographing to server; The recognition result returned after described arbitrary target device photo is identified for reception server is also exported described recognition result to the display screen arranged on this remote controller, and described recognition result comprises the target device list identified; For receiving the confirmation message of user to a target device of described target device list, from each pre-stored target device, corresponding straighforward operation interface information, search straighforward operation interface corresponding to a described target device, and export straighforward operation interface that a described target device is corresponding to the display screen arranged on this remote controller;
Described server, for receiving the photo of described arbitrary target device that remote controller uploads, photo to described arbitrary target device carries out the characteristic information that the data processing obtains described arbitrary target device, the characteristic information of the characteristic information of described arbitrary target device and pre-stored each target device is mated, the target device list that the match is successful is carried in recognition result and returns to remote controller.
In sum, in the application, the straighforward operation interface that pre-stored each target device of remote controller is corresponding; When needs are used arbitrary target device, the camera of upper setting of using a teleswitch is taken this target device, by the photo upload of the target device taken, to server, the recognition result that reception server returns is also exported described recognition result to the display screen arranged on remote controller; If receive the confirmation message of user to a target device in described recognition result, export straighforward operation interface corresponding to a described target device.The application is controlled a plurality of target devices respectively by the use single remote, but can strengthen the convenience of action row and control.
Embodiment
In order to make purpose of the present invention, technical scheme and advantage clearer, below in conjunction with the accompanying drawing embodiment that develops simultaneously, technical scheme of the present invention is elaborated.
Referring to Fig. 1, Fig. 1 is embodiment of the present invention application networking schematic diagram, the household electrical appliance that comprise the remote controls that need to use a teleswitch such as remote controller, server and TV, home theater, air-conditioning, Set Top Box, light fixture, Pediluvium apparatus, wherein, remote controller and server all are connected to network, and can communicate by network.
As shown in Figure 1, the household electrical appliance such as TV, home theater, air-conditioning, Set Top Box are all target devices of remote controller remote control.In order to realize the remote control to each target device, remote controller need to be stored straighforward operation interface information and operational order (key) corresponding to each function button in this straighforward operation interface that each target device is corresponding, so that for example, when the user need to use a certain target device (TV), export the straighforward operation interface that this target device is corresponding, the user can realize controlling this target device by each function button in this straighforward operation interface.In reality realizes, certain function button in the straighforward operation interface shown in can click/touch display screen of user, to generate the operational order that this function button is corresponding; After remote controller receives this operational order, this operational order can be converted to corresponding infrared signal (pulse+pulsewidth) and send to this target device, thereby realize controlling this target device.
Because remote controller need to be realized the remote control to a plurality of target devices, need to first determine the current target device of wanting remote control, then could export the straighforward operation interface that this target device is corresponding, thereby camera and display screen need to be set, wherein, camera is used for target device is taken pictures, and display screen is for straighforward operation interface corresponding to display-object equipment.The mode that the camera of upper setting of can using a teleswitch is taken the current target device of wanting remote control is obtained the photo of target device, and by the photo upload of the target device that photographs to server, by server, the photo of target device is identified, then recognition result is returned to remote controller.
Server needs the characteristic information of pre-stored each target device.After server receives the photo of arbitrary target device that remote controller uploads, need to carry out to the photo of described arbitrary target device data and process the characteristic information that obtains described arbitrary target device, then the characteristic information of the characteristic information of described arbitrary target device of obtaining and pre-stored each target device can be mated, the target device that the match is successful is the recognition result of server to the photo of described arbitrary target device.
In actual applications, the characteristic information of the characteristic information of described arbitrary target device and pre-stored each target device is mated to the following two kinds of situations that exist:
The first, the characteristic information of each pre-stored target device and the characteristic information of described arbitrary target device all do not mate.
This situation explanation server fails to identify described arbitrary target device, the null object list of devices can be carried in recognition result and feed back to remote controller.After remote controller receives the recognition result of server feedback, if in the discovery recognition result, the target device list is empty, can determine the recognition failures of server to described arbitrary target device, therefore can on display screen, export a general straighforward operation interface, can provide basic function button on the universal remote control operation interface, for example start shooting button, the shutdown button, the user can complete the basic operation to described arbitrary target device by the universal remote control operation interface.
, there is the characteristic information coupling of characteristic information and described arbitrary target device of one or more pre-stored target devices in the second.
This situation explanation server has identified and described arbitrary target device, one or more target device lists that the match is successful can be carried in recognition result and return to remote controller, wherein the target device list comprises each target device information that the match is successful, for example numbering of target device.
In actual applications, server may be wrong to the recognition result of described arbitrary target device, may be also correct, need to judge choice by the user.Therefore, remote controller need to output to recognition result on display screen after receiving after server is identified described arbitrary target device the recognition result returned, and by the user, determines whether correct target device in correct or selective recognition result of recognition result.
When recognition result is incorrect, the user can click/touch button (in the interface of output recognition result, can provide this to deny button) is provided, to generate the message of denying to all target devices in recognition result.Remote controller receives this and denies message, determine that server fails correctly to identify described arbitrary target device, thereby can export the universal remote control operation interface on display screen, make the user complete the basic operation to described arbitrary target device by the universal remote control operation interface.
While having correct target device in recognition result, the user can select this correct target device and click/touch ACK button, to generate the confirmation message of correct target device to this, can carry this correct target device information in acknowledge message.After remote controller receives this acknowledge message, can determine the straighforward operation interface that this correct target device is corresponding, and this straighforward operation interface for users of output is controlled described arbitrary target device on display screen.
In addition, the characteristic information of target device can comprise outline data information and the colouring information of this target device, the outline data information that perhaps only comprises this target device, wherein, described colouring information comprises color (value by R, G, B is determined) and distribution of color information.Server carries out data at the picture to described arbitrary target device to be processed while obtaining the characteristic information of described arbitrary target device, can adopt the Polygonal Approximation in Opencv image library technology, particularly, can adopt Douglas-Pu Ke (Douglas-Peucker) algorithm to obtain the outline data of described arbitrary target device; In addition, can also determine according to the photo of described arbitrary target device the colouring information of described arbitrary target device, can adopt existing image processing method to be processed the photo of described arbitrary target device, determine the colouring information of described arbitrary target device.
More than provided the schematic illustration of embodiment of the present invention remote control adaptive approach and picture recognition method, below be elaborated in conjunction with Fig. 2, Fig. 3 respectively.
Fig. 2 is the flow chart of embodiment of the present invention remote control self-adaptation control method, is applied to remote controller, and described remote controller has camera and display screen, and pre-stored the straighforward operation interface information that each target device is corresponding is arranged; The method mainly comprises the following steps:
The camera of step 201, the upper setting that uses a teleswitch is taken arbitrary target device, by the photo upload of described arbitrary target device of photographing to server.
The recognition result that step 202, reception server return after described arbitrary target device photo is identified is also exported described recognition result to the display screen arranged on remote controller, and described recognition result comprises the target device list identified;
Step 203, receive the confirmation message of user to a target device in described target device list, from each pre-stored target device, corresponding straighforward operation interface information, search straighforward operation interface corresponding to a described target device, and export straighforward operation interface that a described target device is corresponding to the display screen arranged on remote controller.
Shown in Fig. 2, in the embodiment of the present invention, described remote controller can also pre-stored universal remote control operation interface information.After remote controller receives the recognition result to described arbitrary target device photo that server returns, further comprise: the target device list in described recognition result is for empty, perhaps, receive the deny message of user to all target devices in the target device list in described recognition result, export pre-stored universal remote control operation interface.
In addition, operational order corresponding to each function button in all right pre-stored described universal remote control operation interface of described remote controller;
Like this, after the display screen that described output universal remote control operation interface arranges to remote controller, further comprise: if receive the operational order that the user sends by the function button in this universal remote control operation interface, described operational order is converted to infrared signal and is sent to described arbitrary target device.
Shown in Fig. 2 in the embodiment of the present invention, operational order corresponding to each function button in the described remote controller straighforward operation interface that also pre-stored each equipment is corresponding;
After the display screen that straighforward operation interface corresponding to the described target device of described output arranges to remote controller, further comprise: if receive the operational order that the user sends by the function button in this straighforward operation interface, described operational order is converted to infrared signal and is sent to described arbitrary target device.
Shown in Fig. 2 in the embodiment of the present invention, the characteristic information that server can pre-stored each target device.
The method that server is identified the photo of described arbitrary target device is: the photo to described arbitrary target device carries out the characteristic information that the data processing obtains described arbitrary target device; The characteristic information of the characteristic information of described arbitrary target device and pre-stored each target device is mated, the target device list that the match is successful is carried in recognition result and returns to remote controller.
The characteristic information of above-mentioned target device can comprise the outline data information of this target device.In this case, the described photo to described arbitrary target device carries out data to be processed the method for the characteristic information obtain target device and is: adopt Polygonal Approximation to carry out the data processing to the photo of described arbitrary target device, obtain the outline data information of described arbitrary target device, described outline data information comprises the coordinate information of a plurality of points in the profile of described arbitrary target device, and in described a plurality of points, the distance of arbitrary neighborhood point-to-point transmission is less than predeterminable range.
The characteristic information of above-mentioned target device can comprise outline data information and the colouring information of this target device.In this case, the described photo to described arbitrary target device carries out data to be processed the method for the characteristic information obtain target device and is: the colouring information of determining described arbitrary target device according to the photo of described arbitrary target device, and adopt Polygonal Approximation to carry out the data processing to the photo of described arbitrary target device, obtain the outline data information of described arbitrary target device, described outline data information comprises the coordinate information of a plurality of points in the profile of described arbitrary target device, and in described a plurality of points, the distance of arbitrary neighborhood point-to-point transmission is less than predeterminable range.Wherein, determine that according to the photo of described arbitrary target device the colouring information of described arbitrary target device can adopt the several different methods of prior art to obtain, 1), described photo is carried out to preliminary treatment obtain one or more color blocks a kind of possible method comprises the following steps:, detailed process is: R, G, the B value of extracting each pixel of photo, judge whether this pixel is white, this pixel color to be set to white, otherwise be set to black, thereby can generate the binary map that photo is corresponding; 2) described one or more color blocks are carried out to color and extract the prospect that obtains (if select white to make background, can remove all color white pieces, thereby the prospect of obtaining); 3) prospect of utilizing the Fourier transformation method in Opencv image library technology to obtain extraction is carried out noise reduction process; 4) to the prospect after noise reduction, use mixed Gauss model to carry out modeling, can obtain the colouring information of photo.
Above-mentioned Polygonal Approximation is Douglas-Pu Ke Douglas-Peucker algorithm.
Above embodiment of the present invention remote control adaptive approach and picture recognition method are had been described in detail, the present invention also provides a kind of remote controller and a kind of server, below as a result Fig. 3 be elaborated.
Fig. 3 is the structural representation of the remote controller that provides of the embodiment of the present invention, and this remote controller comprises: memory cell 301, uploading unit 302, receiving element 303, output unit 304; Wherein,
Memory cell 301, the corresponding straighforward operation interface information for pre-stored each target device;
Uploading unit 302, taken described arbitrary target device for using the camera arranged on this remote controller, by the photo upload of described arbitrary target device of photographing to server;
Receiving element 303, for uploading unit 302 by the photo upload of described arbitrary target device to server, the recognition result that reception server returns after described arbitrary target device photo is identified, described recognition result comprises the target device list identified; For at the described recognition result of output unit 304 output after the display screen arranged on this remote controller, receive the confirmation message of user to a target device in described target device list;
Output unit 304, when receiving after server is identified described arbitrary target device photo the recognition result returned at receiving element 303, export described recognition result to the display screen arranged on this remote controller; When at receiving element 303, receiving the user to the confirmation message of a target device of described target device list, search straighforward operation interface corresponding to a described target device the straighforward operation interface information that pre-stored each target device is corresponding from memory cell 301, and export straighforward operation interface that a described target device is corresponding to the display screen arranged on this remote controller.
In said apparatus, described memory cell 301, for pre-stored universal remote control operation interface information;
Described receiving element 303, be further used at the described recognition result of output unit 304 output, after the display screen arranged on this remote controller, receiving the deny message of user to all target devices in described target device list;
Described output unit 304, when the target device list in the described recognition result that is further used for receiving at receiving element 303 is empty, perhaps, receiving element 303 receive the user to all target devices in described target device list deny message the time, export the pre-stored universal remote control operation interface of memory cell 301 to the display screen arranged on this remote controller.
This remote controller also comprises remote control unit 305;
Described memory cell 301, for operational order corresponding to pre-stored described each function button of universal remote control operation interface; For operational order corresponding to each function button of straighforward operation interface corresponding to pre-stored each target device;
After the display screen that described receiving element 303 arranges to this remote controller at output unit 304 output universal remote control operation interfaces, be further used for: receive the operational order that the user sends by the function button in this universal remote control operation interface; After output unit 304 is exported the straighforward operation interface that a described target device is corresponding, be further used for: receive the operational order that the user sends by the function button in this straighforward operation interface;
Described remote control unit 305, be converted to infrared signal for the operational order that the function button by the universal remote control operation interface sends by the user and be sent to described arbitrary target device; Be converted to infrared signal for the operational order that the function button at user corresponding straighforward operation interface by a described target device is sent and be sent to described arbitrary target device.
The present invention also provides a kind of remote control adaptive control system, and this system comprises remote controller, server; Wherein,
Remote controller, taken arbitrary target device for using the camera arranged on this remote controller, by the photo upload of described arbitrary target device of photographing to server; The recognition result returned after described arbitrary target device photo is identified for reception server is also exported described recognition result to the display screen arranged on this remote controller, and described recognition result comprises the target device list identified; For receiving the confirmation message of user to a target device of described target device list, from each pre-stored target device, corresponding straighforward operation interface information, search straighforward operation interface corresponding to a described target device, and export straighforward operation interface that a described target device is corresponding to the display screen arranged on this remote controller;
Server, for receiving the photo of described arbitrary target device that remote controller uploads, photo to described arbitrary target device carries out the characteristic information that the data processing obtains described arbitrary target device, the characteristic information of the characteristic information of described arbitrary target device and pre-stored each target device is mated, the target device list that the match is successful is carried in recognition result and returns to remote controller.
The foregoing is only preferred embodiment of the present invention, in order to limit the present invention, within the spirit and principles in the present invention not all, any modification of making, be equal to replacement, improvement etc., within all should being included in the scope of protection of the invention.