WO2016065914A1

WO2016065914A1 - Interface display method, device and terminal

Info

Publication number: WO2016065914A1
Application number: PCT/CN2015/082567
Authority: WO
Inventors: 卢清
Original assignee: 中兴通讯股份有限公司
Priority date: 2014-10-27
Filing date: 2015-06-26
Publication date: 2016-05-06
Also published as: CN105843595A

Abstract

An interface display method, device and terminal. The method comprises: acquiring a front face image of an original remote controller (S102); obtaining a key layer by capturing a key area in the front face image, and saving remaining images as a remote controller interface layer (S104); defining various keys in the key layer and corresponding functions thereof (S106); and superposing and synthesizing the key layer and the remote controller interface layer, and displaying same in a universal remote controller interface (S108). The problem in the related art that a universal remote controller interface cannot perform an adaptive adjustment according to different terminal models is solved, which falls within the technical field of image recognition and software, and facilitates rapidly forming the customization, differentiation and accuracy of a universal remote controller remote control interface of an intelligent terminal, so that a user obtains the most direct remote control experience by using the universal remote controller of the intelligent terminal.

Description

Interface display method, device and terminal

Technical field

The present invention relates to the field of image recognition and software technologies, and in particular, to an interface display method, apparatus, and terminal.

Background technique

At present, as the functions of smart terminals become more and more powerful, there are more and more products with intelligent terminals with universal remote control functions. As the chip manufacturing process has increased, infrared chips including central processing units, buffers, and infrared codec units have matured. The infrared chip has a flexible communication interface, such as SPI, I2C, and UART, and can communicate with an application processor (AP) of the intelligent terminal. The modulated signal output by the infrared chip is converted into an optical signal and transmitted through a modulation circuit. At the same time, the infrared chip also has a self-learning function. The preamplifier converts the received weak optical signal into an electrical signal, and the infrared chip samples the sampled electrical signal and saves its waveform and function.

In general, the infrared chip will develop related application software based on the operating system of the smart terminal. The application software generally requires the user to download the required remote control code library from the remote code server through the type of appliance, appliance brand, and appliance model. However, for different electrical appliances, the remote control interface of the universal remote control has the same button layout, which is defined according to the original user interface. It is difficult for users to judge the current remote control appliances according to different user style interfaces. When the universal remote control requires one-to-many control for most electrical appliances, the user needs to check one by one whether the currently used remote control interface is the appliance brand that the user wants to remotely control, and the ease of use is poor.

In view of the problem that the universal remote controller interface cannot be adjusted according to the terminal model in the related art, an effective solution has not been proposed yet.

Summary of the invention

The present invention provides an interface display method, device, and terminal for solving the above technical problem, in view of the problem that the universal remote controller interface cannot be adjusted according to the terminal model.

According to an aspect of the present invention, an embodiment of the present invention provides an interface display method, wherein the method includes: acquiring a front image of an original remote controller; and obtaining a button map by capturing a button area in the front image. Layer, the remaining image is saved as a remote control interface layer; each key in the button layer and its corresponding function are defined; the button layer and the remote control interface layer are superimposed and combined, and displayed on the universal remote controller interface.

In the embodiment of the present invention, after acquiring the front image of the original remote controller, the method further includes: filtering out an external background in the front image; and adjusting a size and a display position of the front image.

In the embodiment of the present invention, obtaining a button layer by capturing a button region in the front image includes: using an image edge operator in the digital image to draw a button region; and smoothing and filtering the image of each button region; Each of the processed button areas is excavated and saved as the button layer.

In the embodiment of the present invention, defining each button in the button layer and its corresponding function includes: acquiring a remote control code of the original remote controller; and defining each button in the button layer based on the remote control code Its corresponding function.

In the embodiment of the present invention, acquiring the remote control code of the original remote controller includes: downloading a remote control code library of the original remote controller from a network; and/or, starting a self-learning mode, and self-learning the remote control code of the original remote controller .

According to another aspect of the present invention, an embodiment of the present invention further provides an interface display device, where the device includes: an image acquisition module configured to acquire a front image of the original remote controller; and a layer creation module configured to capture The button area in the front image is obtained as a button layer, and the remaining image is saved as a remote control interface layer; the button definition module is set to define each button in the button layer and its corresponding function; the interface display module is set to The button layer and the remote control interface layer are superimposed and displayed on the interface of the universal remote controller.

In an embodiment of the present invention, the device further includes: an image processing module, configured to: after acquiring the front image of the original remote controller, filtering out an external background in the front image; adjusting a size and a display of the front image position.

In the embodiment of the present invention, the layer establishing module includes: an area drawing unit configured to use the image edge operator in the digital image to draw the button area; and the processing unit is configured to smooth the image of each button area And filtering processing; the layer establishing unit is configured to excavate each processed button area and save the button layer.

In the embodiment of the present invention, the button definition module includes: a code acquisition unit configured to acquire a remote control code of the original remote controller; and a function definition unit configured to define the button layer based on the remote control code Each button and its corresponding function.

In the embodiment of the present invention, the code obtaining unit is further configured to download a remote control code library of the original remote controller from a network; and/or, start a self-learning mode, and self-learn the remote control code of the original remote controller.

According to still another aspect of the present invention, an embodiment of the present invention further provides an interface display terminal, wherein the terminal has a universal remote control function, including the interface display device described above, and is connected to each original remote controller.

The beneficial effects of the embodiments of the present invention are as follows:

The embodiment of the invention utilizes image processing technology, and proposes a technical scheme for using the original remote control appearance and button layout of the electric appliance as a prototype of the universal remote control interface, and solves the problem that the universal remote control interface cannot be adapted according to the terminal model in the related art. The problem of the adjustment is that the embodiment of the invention belongs to the field of image recognition and software technology, and facilitates the rapid formation of the customized, differentiated and accurate remote control interface of the universal remote control of the intelligent terminal, so that the user obtains the most direct use of the universal remote controller of the intelligent terminal. Remote control experience.

The above description is only an overview of the technical solutions of the present invention, and the above-described and other objects, features and advantages of the present invention can be more clearly understood. Specific embodiments of the invention are set forth below.

DRAWINGS

1 is a flow chart of an interface display method according to an embodiment of the present invention;

2 is a flow chart of a remote control display interface of a universal remote controller that converts a front photo of an original remote controller into a smart terminal according to an embodiment of the present invention;

3 is a block diagram showing the structure of an interface display device according to an embodiment of the present invention.

detailed description

In order to solve the problem that the universal remote controller interface in the prior art cannot be adjusted according to the different types of the terminal, the present invention provides an interface display method, device and terminal. The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

The embodiment provides an interface display method, which can be implemented on the terminal side. FIG. 1 is a flowchart of an interface display method according to an embodiment of the present invention. As shown in FIG. 1 , the method includes the following steps (step S102- Step S108):

Step S102, obtaining a front image of the original remote controller.

The smart terminal can obtain a front photo of the remote controller through its own camera. The acquisition of the front photo of the remote controller is not limited to the camera of the smart terminal, and can also be obtained by other means, for example, receiving a front photo of the remote controller provided by a third party.

In step S104, the button layer is obtained by capturing the button area in the front image, and the remaining image is saved as a remote control interface layer.

Step S106, defining each button in the button layer and its corresponding function.

In step S108, the button layer and the remote control interface layer are superimposed and combined, and displayed on the interface of the universal remote controller. After superimposing the button layer and the remote control interface layer, you can name it the user's own familiar name.

Through the present embodiment, a technical solution for the appearance of the remote control of the electric appliance and the button layout as the prototype of the universal remote control interface is introduced, and the problem that the universal remote control interface cannot be adjusted according to the different types of the terminal is solved. The invention belongs to the field of image recognition and software technology, and is convenient for the customization, differentiation and accurate formation of the remote control interface of the universal remote controller of the intelligent terminal, so that the user obtains the most direct remote control experience by using the universal remote controller of the intelligent terminal.

After acquiring the front image of the original remote controller in step S102, in order to optimize the display effect of the front image, the following processing may be performed on the front image: filtering out the external background in the front image, adjusting the size and display of the front image position.

Specifically, the application software of the universal remote controller of the smart terminal removes the external background in the photo for the front photo of the original remote control of the electric appliance, and only retains the front image of the remote controller. And make the long side of the image parallel to the long side of the smart terminal, centered in the center of the screen.

In step S104, the button layer is obtained by capturing the button area in the front image, which is realized by the following preferred embodiments: using the image edge operator in the digital image to draw the button area; smoothing and filtering the image of each button area Processing; the processed button areas are excavated and saved as a button layer. Based on the above processing, the similarity between the appearance of the interface of the button layer and the original remote controller is improved, which is beneficial to improving the remote control experience of the user.

Specifically, the image edge operator in the digital image is used to draw the area where the button is located. Throughout the remote control interface, all remote control buttons have a scratched area around them. The image of each area is smoothed and filtered to obtain a smooth edge. Dig out all the button areas and save them as a new layer, named as the button layer. The remaining pictures are saved as the remote control interface layer.

After obtaining the button layer, it is necessary to define each button in the button layer and its corresponding function, thereby facilitating the improvement of the same display interface in the universal remote controller as the original remote controller interface. The above process can be implemented by the following preferred embodiments: obtaining a remote control code of the original remote controller; and based on the remote control code, defining each button in the button layer and its corresponding function.

The above-mentioned remote control code for obtaining the original remote controller can be realized by downloading the remote control code library of the original remote controller from the network; and/or starting the self-learning mode and self-learning the remote control code of the original remote controller.

Specifically: (1) downloading the remote control code library of the model electrical appliance from the network, encapsulating the remote control code of each button into a modulation signal, and starting a series of activities such as a transmitting circuit, as an activity triggered by clicking the function button. (2) If some buttons do not have a corresponding remote control code on the remote server, the universal remote control enters the learning mode. The self-learning process is as follows. First, the universal remote control enters the self-learning mode. Secondly, aim the original remote control to the universal remote control and press the button. At this time, the universal remote control completes the work of learning the remote control code. Secondly, the universal remote controller encapsulates the learned remote control code into a modulated signal and activates a series of activities such as a transmitting circuit. Click this button to trigger this event. Finally, save all the activities triggered by the self-learning button and the remote control code to the local.

2 is a flow chart of converting a front photo of an original remote controller into a remote control display interface of a universal remote controller of the smart terminal according to an embodiment of the present invention. As shown in FIG. 2, the flow includes the following steps:

Step A, the acquisition of the front photo of the original remote control of the appliance. The smart terminal can obtain a front photo of the remote controller through its own camera. The acquisition of the front photo of the remote control is not limited to the camera of the smart terminal, but can also be obtained in other ways.

Step B, filtering out the external background of the front photo. The universal remote control application software of the smart terminal uses the front photo of the original remote control of the appliance to remove the external background in the photo, leaving only the front image of the remote control. And make the long side of the image parallel to the long side of the smart terminal, centered in the center of the screen.

Step C, capturing the button area. Use the image edge operator in the digital image to draw the area where the button is located. Therefore, the entire remote control interface, all remote control buttons have a region that is drawn around. The image of each area is smoothed and filtered to obtain a smooth edge. Dig all the areas and save them as a new layer, named the button layer. The remaining pictures are saved as the remote control interface layer.

Step D, define the button. Through step C, we get the button layer of the universal remote control to be built. According to the software user interface definition, each button is defined as a "button" event, that is, click this button to trigger the corresponding activity.

Step E defines the activity triggered by the button, that is, whether the remote server has a remote control code corresponding to the button. The remote control code library of the model electrical appliance is downloaded from the network, and the remote control code of each button is encapsulated into a modulation signal, and a series of activities such as a transmitting circuit are started, as an activity triggered by clicking the function button. If the remote server does not have the remote control code library of the model or the remote control code is incomplete, proceed to step F, otherwise go to step G.

Step F, self-learning the activity triggered by the button. If some buttons do not have a corresponding remote control code on the remote server, the universal remote control enters the learning mode. The self-learning process is as follows. First, the universal remote control enters the self-learning mode. Secondly, aim the original remote control to the universal remote control and press the button. At this time, the universal remote control completes the work of learning the remote control code. Secondly, the universal remote controller encapsulates the learned remote control code into a modulated signal and activates a series of activities such as a transmitting circuit. Click this button to trigger this event. Finally, save all the activities triggered by the self-learning button and the remote control code to the local.

Step G, defining the activity triggered by the button.

In step H, it is judged whether or not the saving of the triggering activity of all the keys is completed. If not, go to step D, otherwise go to step H.

Step I, save all the button pictures and the corresponding trigger activities. Integrate the user interface, superimpose the button layer and the remote control interface layer, and name it as a familiar name, and the process ends.

In the embodiment of the invention, the front camera of the original remote controller of the electric appliance is recorded and input into the smart terminal through the camera of the intelligent terminal, and the image recognition technology is used to remove the external background, extract the entire appearance of the original remote controller, capture the button area, define the button function, and the like. The series pre-processing method perfectly copies all the functions and appearance of the original remote control of the electric appliance into the universal remote control of the intelligent terminal. Therefore, when the user remotely controls a certain household appliance by using the smart terminal universal remote controller, the remote control interface of the universal remote controller displays the original remote controller, so that the user feels like using the original remote controller of the electrical appliance.

Corresponding to the interface display method introduced in the above embodiment, the embodiment provides an interface display device, which can be disposed on the terminal side to implement the above embodiment. FIG. 3 is a structural block diagram of an interface display device according to an embodiment of the present invention. As shown in FIG. 3, the device includes: an image acquisition module 10, a layer creation module 20, a button definition module 30, and an interface display module 40. The structure is described in detail below.

The image acquisition module 10 is configured to obtain a front image of the original remote controller;

The layer establishing module 20 is connected to the image obtaining module 10, and is configured to obtain a button layer by capturing a button area in the front image, and the remaining image is saved as a remote controller interface layer;

The button definition module 30 is connected to the layer establishing module 20, and is configured to define each button in the button layer and its corresponding function;

The interface display module 40 is connected to the button definition module 30, and is configured to superimpose and synthesize the button layer and the remote controller interface layer to display the interface of the universal remote controller.

Through the embodiment, the problem that the universal remote controller interface cannot be adjusted according to different terminal models is solved in the related art, and the invention belongs to the field of image recognition and software technology, and is beneficial to the customization and differentiation of the remote control interface of the universal remote controller of the intelligent terminal. Accurate and rapid formation enables users to obtain the most direct remote control experience using the universal remote control of the smart terminal.

In order to optimize the display effect of the front image, the apparatus may further include: an image processing module configured to: after acquiring the front image of the original remote controller, filtering out the external background in the front image; adjusting the size and display position of the front image .

In order to improve the similarity between the appearance of the interface of the button layer and the original remote controller and improve the remote control experience of the user, the layer creation module 20 may include: an area drawing unit configured to use the image edge operator in the digital image to draw the button The processing unit is configured to smooth and filter the image of each button area; the layer establishing unit is configured to excavate the processed key areas and save the button layer.

In order to improve the display interface of the universal remote controller and the interface of the original remote controller, the button definition module 30 includes: a code acquisition unit configured to acquire a remote control code of the original remote controller; and a function definition unit configured to be defined based on the remote control code. Each button in the above button layer and its corresponding function. The code acquisition unit is further configured to download the remote control code library of the original remote controller from the network; and/or, start the self-learning mode, and self-learn the remote control code of the original remote controller.

Corresponding to the interface display device introduced in the above embodiment, the embodiment provides an interface display terminal, which has a universal remote control function, and includes the interface display device introduced in the above embodiment, and is connected to each original remote controller.

The interface display terminal introduced in this embodiment may be, for example, a mobile phone that implements different display interfaces by different remote controllers. As for how to implement the adaptation, the above method embodiment provides an example, no matter what kind of application is adopted. As long as the universal remote control function on the mobile phone can be adapted to different remote controllers to provide different display interfaces.

As can be seen from the above description, the technical solution described in the embodiments of the present invention has the following remarkable features:

1) Excellent user experience. This allows the user to use the universal remote control as if it were an original remote control.

2) Easy to distinguish. The user can conveniently distinguish the remote control appliance corresponding to the current remote control interface by the appearance of the original remote controller. Avoid the same remote control interface.

3) Rich features. In general, the universal remote control uses a remote code base and does not cover all the key functions of the original remote control. However, through the application of the invention, the universal remote control can cover all the key functions of the original remote control.

While the preferred embodiments of the present invention have been disclosed for purposes of illustration, those skilled in the art will recognize that various modifications, additions and substitutions are possible, and the scope of the invention should not be limited to the embodiments described above.

Industrial applicability

Claims

An interface display method includes:

Get the front image of the original remote control;

The button layer is obtained by capturing a button area in the front image, and the remaining image is saved as a remote control interface layer;

Defining each button in the button layer and its corresponding function;

The button layer and the remote control interface layer are superimposed and displayed on the interface of the universal remote controller.
The method of claim 1 wherein after obtaining the front side image of the original remote control, the method further comprises:

Filtering an external background in the front image;

The size and display position of the front image are adjusted.
The method of claim 1 wherein obtaining a button layer by capturing a button region in the front image comprises:

Using the image edge operator in the digital image to draw the button area;

Smoothing and filtering the image of each button area;

Each of the processed button areas is excavated and saved as the button layer.
The method of claim 1 wherein defining each of the button layers and their corresponding functions comprises:

Obtaining a remote control code of the original remote controller;

Based on the remote control code, each button in the button layer and its corresponding function are defined.
The method of claim 4, wherein obtaining the remote control code of the original remote controller comprises:

Downloading the remote control code base of the original remote controller from the network; and/or,

The self-learning mode is started, and the remote control code of the original remote controller is self-learned.
An interface display device comprising:

An image acquisition module configured to obtain a front image of the original remote controller;

a layer creation module configured to obtain a button layer by capturing a button area in the front image, and the remaining image is saved as a remote control interface layer;

a button definition module, configured to define each button in the button layer and a corresponding function thereof;

The interface display module is configured to superimpose and synthesize the button layer and the remote control interface layer, and display the interface on the universal remote controller.
The device of claim 6 wherein said device further comprises:

The image processing module is configured to filter out an external background in the front image after acquiring a front image of the original remote controller; and adjust a size and a display position of the front image.
The apparatus of claim 6, wherein the layer building module comprises:

The area drawing unit is configured to use the image edge operator in the digital image to draw the button area;

a processing unit configured to smooth and filter an image of each button area;

The layer establishing unit is configured to excavate the processed button areas and save the button layer.
The device of claim 6, wherein the button definition module comprises:

a code acquisition unit, configured to acquire a remote control code of the original remote controller;

A function definition unit is configured to define each button in the button layer and its corresponding function based on the remote control code.
The device according to claim 9, wherein the code acquisition unit is further configured to download a remote control code library of the original remote controller from a network; and/or, initiate a self-learning mode, and self-learn the original remote controller. Remote control code.
An interface display terminal having a universal remote control function, comprising the interface display device according to any one of claims 6 to 10, connected to each of the original remote controllers.