TWI784630B - Display control method and display control system - Google Patents

Abstract

A display control method and a display control system are disclosed. The method includes: executing an application program; representing an application interface corresponding to the application program in a display interface; receiving a control signal which is generated by triggering a physical button of a remote control device; simulating an operation function corresponding to the control signal as a touch operation behavior in response to that the application program belongs to a first type application program; and operating the application interface according to the touch operation behavior.

Description

Display control method and display control system

The present invention relates to a display control technology, and in particular to a display control method and a display control system.

With the popularity of mobile devices such as smart phones and tablet computers, many application programs have developed versions suitable for different platforms for use by different types of electronic devices. Taking the Netflix audio-visual streaming platform as an example, users of mobile devices can download the mobile version of the Netflix application to the mobile device for use, while users of smart TVs or smart projectors can download the TV version of the Netflix application It can be used in smart TV or smart projector. After downloading and installing, users of mobile devices can operate the mobile version of the Netflix application through touch operations, while users of smart TVs or smart projectors can use the remote control to operate the TV version of the Netflix application.

On the other hand, as the use of smart TVs or smart projectors becomes more and more flexible, some communication platforms also allow users of smart TVs or smart projectors to communicate freely or download unofficial applications. However, once the user downloads the mobile version of the application to the smart TV or the smart projector, the user cannot simply use the remote control to control the smart TV or the smart projector to run the application normally.

In view of this, the present invention provides a display control method and a display control system, which can improve the compatibility of a display device operated and controlled by a remote control device with physical buttons to different versions of application programs.

An embodiment of the present invention provides a display control method for a display device. The display control method includes: running an application program; presenting an application program interface corresponding to the application program on the display interface; receiving a control signal, wherein the control signal is generated by triggering a physical button of the remote control device; responding When the application program belongs to the first type of application program, simulating the operation function corresponding to the control signal as a touch operation behavior; and operating the API according to the touch operation behavior.

An embodiment of the present invention further provides a display control system, which includes a display device and a remote control device. The remote control device has physical buttons. The display device is used to: run an application program; present an application program interface corresponding to the application program on the display interface; receive a control signal, wherein the control signal is generated by triggering a physical button of the remote control device ; in response to the application belonging to the first type of application, simulating the operation function corresponding to the control signal as a touch operation behavior; and operating the application program interface according to the touch operation behavior.

Based on the above, after running the application program and presenting the application program interface corresponding to the application program in the display interface, in response to the application program belonging to the first type of application program, generated by triggering the physical button of the remote control device The operation function corresponding to the control signal can be simulated as a touch operation behavior. This touch operation behavior can be used to operate the API. In this way, the compatibility of the display device with different versions of the application program can be improved by adopting the remote control device with physical buttons for operation control.

FIG. 1 is a schematic diagram of a display control system according to an embodiment of the present invention. Referring to FIG. 1 , the display control system 10 includes a display device 11 and a remote control device 12 . The display device 11 may include various electronic devices with functions of wireless communication, data processing and display, such as a smart TV, a smart display, or a smart projector. The remote control device 12 can be a physical control device wirelessly paired with the display device 11 . In this way, the remote control device 12 can transmit wireless signals such as infrared rays to the display device 11 through a wireless signal transmitting device such as an infrared light transmitter, so as to remotely control the system settings and/or display content of the display device 11 . For example, the remote control device 12 may include a physical remote control.

The remote control device 12 may have multiple physical buttons. These physical buttons can be configured on the surface of the remote control device 12 and can be pressed by the user. In response to a physical button being pressed, the physical button is triggered. According to the triggered (ie pressed) physical button, the remote control device 12 can transmit a control signal corresponding to the physical button to the display device 11 . The display device 11 can perform corresponding operation functions according to the control signal.

In one embodiment, physical buttons 100 - 104 and 111 - 113 may be configured on the upper surface of the remote control device 12 . The physical button 100 is a power button. For example, the physical button 100 is preset to be triggered to instruct the display device 11 to turn on or turn off the power of the display device 11 . The physical buttons 101-104 are direction keys. The physical buttons 111-113 are main page keys, back keys and main menu keys.

It should be noted that the total number and arrangement of the physical buttons 100-104 and 111-113 in FIG. 1 are just examples, not intended to limit the present invention. In another embodiment, the physical buttons of the remote control device 12 can be configured according to practical requirements.

FIG. 2 is a functional block diagram of a display device according to an embodiment of the present invention. Referring to FIG. 1 and FIG. 2 , the display device 11 may include a processor 21 , a storage circuit 22 and an input/output (I/O) interface 23 . The processor 21 may be responsible for the whole or part of the operations of the display device 11 . For example, the processor 21 may include a central processing unit (CPU) or other programmable general-purpose or special-purpose microprocessors, digital signal processors (Digital Signal Processor, DSP), programmable controllers, special application Integrated circuit (Application Specific Integrated Circuits, ASIC), programmable logic device (Programmable Logic Device, PLD) or other similar devices or a combination of these devices.

The storage circuit 22 is coupled to the processor 21 and used for storing data. For example, the storage circuit 22 may include a volatile storage circuit and a non-volatile storage circuit. The volatile storage circuit is used for volatile storage of data. For example, the volatile storage circuit may include random access memory (Random Access Memory, RAM) or similar volatile storage media. The non-volatile storage circuit is used for non-volatile storage of data. For example, the non-volatile storage circuit may include a read-only memory (Read Only Memory, ROM), a solid state disk (solid state disk, SSD) and/or a traditional hard disk (Hard disk drive, HDD) or similar non-volatile Storage media.

The input/output interface 23 is coupled to the processor 21 and used for inputting and outputting signals. For example, the input/output interface 23 may include various input/output devices such as a display, a projection interface, a wireless signal receiver, a network interface card, a control panel, a speaker, a microphone, and/or a power supply circuit. The present invention does not limit the type of the input/output device.

In one embodiment, the display device 11 is a smart TV or a smart display. Therefore, the input/output interface 23 may include at least one display. The display can be used to present image frames for users to watch through a display interface. For example, the display may include plasma (plasma) display, liquid crystal display (liquid crystal display, LCD), thin film transistor (Thin Film Transistor, TFT) liquid crystal display, light emitting diode (light emitting diode, LED) display or organic Light-emitting diode (Organic LED, OLED) displays or various types of displays.

In one embodiment, the display device 11 is a smart projector. Therefore, the input/output interface 23 may include at least one projection interface. The projection interface can be used to project light onto the surface of a specific object (such as a projection screen), so as to present an image on the surface of the object for users to watch. For example, the projection interface may include at least one light emitting element for projecting the light.

In one embodiment, the display device 11 can receive the wireless signal transmitted by the remote control device 12 through the wireless signal receiver in the input/output interface 23 . For example, in one embodiment, the remote control device 12 can transmit an infrared light signal through an infrared light transmitter, and the display device 11 can receive the infrared light signal through an infrared light receiver. It should be noted that, in another embodiment, the remote control device 12 and the display device 11 can communicate wirelessly through other types of wireless signals (such as Bluetooth signals or Wifi signals), and the present invention is not limited thereto.

In one embodiment, the storage circuit 22 stores an application program database 201 and a behavior database 202 . The application program database 201 is used for storing identification information of a plurality of application programs installed in the display device 11 . For example, the identification information may include the program name, version information and/or code of these application programs, etc., which can be used to identify the application program. The behavior database 202 can store remote operation information of at least some applications installed in the display device 11 . For example, the remote operation information may record that one or more applications correspond to the remote operation functions supported by one or more physical buttons on the remote control device 12 . It should be noted that, in one embodiment, according to the information in the behavior database 202 , different application programs may support different remote operation functions corresponding to the same physical button on the remote control device 12 .

In one embodiment, the processor 21 can install an application program (also referred to as a first application program) into the display device 11 . After the first application is installed, the processor 21 can store the identification information of the first application in the application database 201 . For example, the application program database 201 can store the program name, version information and/or code of the first application program, which can be used to identify the first application program.

After the first application is installed, the processor 21 can run the first application. In response to the execution of the first application, the processor 21 may present an API corresponding to the first application on a display interface of the display device 11 . For example, the API can be presented on the display of the display device 11 or projected on a projection screen. After running the first application program, the processor 21 can receive a control signal from the remote control device 12 . The control signal is generated by triggering a physical button of the remote control device 12 . For example, the physical button can be one of the physical buttons 101-104 and 111-113 of the remote control device 12 or other physical buttons. For example, the user may be pressing the physical button and trying to control the application program interface presented by the display device 11 . The processor 21 can determine how to operate the API according to the control signal according to the type of the currently running application program (ie, the first application program).

In one embodiment, the processor 21 can determine whether the application currently running on the display device 11 (ie, the first application) belongs to a certain type of application (also called the first type of application). In response to the fact that the first application program belongs to the first type of application program, the processor 21 can simulate the operation function corresponding to the control signal as a touch operation behavior. Then, the processor 21 can operate the API according to the touch operation behavior. Alternatively, in response to the fact that the first application program does not belong to the first type of application program, the processor 21 may determine the operation function corresponding to the control signal as a default operation function corresponding to the triggered physical button . Then, the processor 21 can operate the API according to the default operation function.

In one embodiment, the processor 21 can obtain the identification information of the first application program from the application program database 201 . The processor 21 can analyze the identification information of the first application program and determine whether the first application program belongs to the first type of application program according to the analysis result. For example, assuming that the program name, version information or program code of the first application meets a specific identification condition, the processor 21 may determine that the first application belongs to the first type of application. Otherwise, the processor 21 may determine that the first application does not belong to the first type of application.

In an embodiment, the first type of application program includes a mobile application program. The API of the first type of application is suitable for operating based on the touch operation behavior. Therefore, in one embodiment, in response to the fact that the first application program is a first-type application program (ie, a mobile application program), the processor 21 can simulate the operation function corresponding to the control signal from the remote control device 12 as a touch touch operation behavior. Thereby, the processor 21 can successfully operate the first application program by executing the touch operation behavior.

On the contrary, in one embodiment, if the first application program is the first type of application program (i.e. the mobile application program), but the processor 21 still judges according to the control signal that the operation function to be executed is the triggered The preset operation function corresponding to the physical button. At this time, the processor 21 may not be able to operate the API smoothly according to the control signal because the default operation function does not conform to the function definition of the mobile version of the application program, thereby affecting the user's operation experience.

FIG. 3 is a schematic diagram illustrating remote operation information of different types of applications according to an embodiment of the present invention. Referring to FIG. 1 to FIG. 3 , the remote operation information 31 can be stored in the behavior database 202 . The remote operation information 31 can record the touch operation behaviors that can be simulated by at least some of the physical buttons of the remote control device 12 and the type The application program of B (for example, the application program of the standard version or the TV version, not the application program of the first type) is preset to perform conventional operation behaviors for at least some physical buttons of the remote control device 12 .

In one embodiment, it is assumed that the application program currently running on the display device 11 (ie, the first application program) is an application program belonging to type A. The application program interface provided by the type A application program is suitable for operations based on touch operation behaviors. In this embodiment, when receiving a control signal sent by the user by triggering a certain physical button of the remote control device 12, according to the remote operation information 31, the processor 21 can control the corresponding operation function of the control signal Simulate the touch operation behavior corresponding to this physical button (such as sliding the screen up, sliding the screen down, sliding the screen to the left, sliding the screen to the right, playing/pausing the video, reversing the video or fast forwarding the video, etc.) . The processor 21 can smoothly operate the API currently presented by the display device 11 according to the touch operation behavior. In one embodiment, the touch operation behavior may also include screen sliding, screen zooming, and cursor movement performed on the application programming interface. These touch operation behaviors may also be triggered by the remote control device 12 Executed by a specific entity button.

FIG. 4 is a schematic diagram of performing screen sliding on an application programming interface according to an embodiment of the present invention. Referring to FIG. 4 , it is assumed that the first application program belongs to the first type of application program, and the application program interface 41 is presented on a display interface by executing the first application program. When performing screen sliding on the application program interface 41 (for example, sliding the screen downward), the presentation content of the areas 401 and 402 in the application program interface 41 will change (for example, the dividing line between the areas 401 and 402 will move) to reflect this Screen slide operation.

FIG. 5 is a schematic diagram of performing screen scaling on an application programming interface according to an embodiment of the present invention. Referring to FIG. 5 , it is assumed that the first application program belongs to the first type of application program, and the application program interface 51 is presented on a display interface by executing the first application program. When zooming in on the API 51 (for example, zooming in), the size of the object 501 presented in the API 51 changes (for example, the size of the object 501 becomes larger) to reflect the zooming operation.

FIG. 6 is a schematic diagram of performing cursor movement on an application programming interface according to an embodiment of the present invention. Referring to FIG. 6 , it is assumed that the first application program belongs to the first type of application program, and the application program interface 61 is presented on a display interface by executing the first application program. When the cursor movement is performed on the API 61, the position of the cursor 601 presented in the API 61 changes (for example, the position of the cursor 601 moves from upper left to lower right of the screen) to reflect the cursor movement operation.

Referring back to FIG. 3 , in one embodiment, it is assumed that the application currently running on the display device 11 (ie, the first application) is an application belonging to Type B. Referring to FIG. The application programming interface provided by the type B application program is suitable for operating based on the preset operation functions provided by each physical button of the remote control device 12 . In this embodiment, when receiving a control signal sent by the user by triggering a certain physical button of the remote control device 12, according to the remote operation information 31, the processor 21 can determine the physical button according to the control signal. A corresponding preset operation function (such as switching objects up, switching objects down, switching objects left, switching objects right, returning to the home page, returning to the previous page or returning to the main menu, etc.). The processor 21 can normally operate the API currently presented by the display device 11 according to the default operation function.

It should be noted that, in one embodiment, the various operation behaviors corresponding to the simulated touch operation of the first type of application in FIGS. 3 to 6 are not supported by each physical button of the remote control device 12 by default. operational behavior. In one embodiment, the processor 21 needs to perform the operation of simulating the operation function corresponding to the specific control signal from the remote control device 12 as a touch operation behavior, so as to successfully apply the application provided by the first type of application program. Program interface to operate (also known as remote touch operation).

In one embodiment, by simulating the operation function corresponding to the specific control signal from the remote control device 12 as an operation of a touch operation behavior, even if the display device 11 accidentally or intentionally installs a mobile version of a specific application program (such as The application program version provided for smart phones or tablet computers), the display device 11 can also respond to the control of the remote control device 12 to normally operate the API provided by the application program. In this way, the compatibility of the display device 11 with applications of different versions (such as mobile version or standard version (TV version)) can be effectively improved.

In an embodiment, the processor 21 may also present auxiliary operation information on the display interface of the display device 11 in response to the application program currently running on the display device 11 (ie, the first application program) belonging to the first type of application program. The auxiliary operation information can provide information on touch operation behaviors corresponding to at least some physical buttons of the remote control device 12 . In this way, when the first application program belongs to the first type of application program, the user can operate the remote control device 12 (such as pressing a specific physical button) according to the auxiliary operation information to execute the application program interface presented on the display interface. Specific touch actions.

FIG. 7 is a schematic diagram of presenting auxiliary operation information according to an embodiment of the present invention. Please refer to FIG. 7 , in an embodiment, auxiliary operation information 701 may be presented on a display interface 71 provided by the display device 11 . The auxiliary operation information 701 can describe the touch operation behaviors corresponding to the physical buttons 101 - 104 and 111 - 113 of the remote control device 12 . In one embodiment, if the display interface 71 is currently displaying the API of the first application program, the auxiliary operation information 701 can also be overlaid or floated on the API of the first application program to provide the user with more The operation information of the API is controlled according to the remote control device 12 .

It should be noted that the configuration of the physical buttons, the simulated touch operation corresponding to each physical button, and the default operation function corresponding to each physical button in the foregoing embodiments are examples. In one embodiment, the configuration of the physical buttons, the simulated touch operation corresponding to each physical button, and the preset operation function corresponding to each physical button in the foregoing embodiments can all be adjusted according to practical requirements.

FIG. 8 is a flowchart of a display control method according to an embodiment of the present invention. Please refer to FIG. 8, in step S801, run the application program. In step S802, an API corresponding to the application is presented on the display interface. In step S803, a control signal is received, wherein the control signal is generated by triggering a physical button of the remote control device. In step S804, it is determined whether the application program belongs to the first type of application program. If the application program belongs to the first type of application program, in step S805, in response to the fact that the application program belongs to the first type of application program, the operation function corresponding to the control signal is simulated as a touch operation behavior. In step S806, the API is operated according to the touch operation behavior. On the other hand, if it is determined in step S804 that the application does not belong to the first type of application, then in step S807, in response to the fact that the application does not belong to the first type of application, the operation corresponding to the control signal The function determines the preset operation function corresponding to the physical button. In step S808, the API is operated according to the preset operation function.

However, each step in FIG. 8 has been described in detail above, and will not be repeated here. It should be noted that each step in FIG. 8 can be implemented as a plurality of program codes or circuits, which is not limited by the present invention. In addition, the method in FIG. 8 may be used in combination with the above embodiments, or may be used alone, which is not limited in the present invention.

To sum up, the display control method and display control system provided by the embodiments of the present invention can dynamically simulate the touch operation behavior or use the preset operation function of the physical button to operate the application program according to the type of the application program currently running on the display device. interface. In this way, the compatibility of the display device with different versions of the application program can be improved by adopting the remote control device with physical buttons for operation control.

10: Display control system 11: Display device 12: Remote control device 100~104,111~113: physical buttons 21: Processor 22: storage circuit 23: Input/output interface 201: Application database 202: Behavior database 31:Remote operation information 41, 51, 61: API 401,402: area 501: object 601: Cursor 71:Display interface 701: Auxiliary operation information S801~S808: steps

FIG. 1 is a schematic diagram of a display control system according to an embodiment of the present invention. FIG. 2 is a functional block diagram of a display device according to an embodiment of the present invention. FIG. 3 is a schematic diagram illustrating remote operation information of different types of applications according to an embodiment of the present invention. FIG. 4 is a schematic diagram of performing screen sliding on an application programming interface according to an embodiment of the present invention. FIG. 5 is a schematic diagram of performing screen scaling on an application programming interface according to an embodiment of the present invention. FIG. 6 is a schematic diagram of performing cursor movement on an application programming interface according to an embodiment of the present invention. FIG. 7 is a schematic diagram of presenting auxiliary operation information according to an embodiment of the present invention. FIG. 8 is a flowchart of a display control method according to an embodiment of the present invention.

S801~S808: steps

Claims (14)

A display control method for a display device, the display control method comprising: run an application; presenting an application programming interface corresponding to the application in a display interface; receiving a control signal, wherein the control signal is generated by triggering a physical button of a remote control device; In response to the application program belonging to a first-type application program, simulating an operation function corresponding to the control signal as a touch operation behavior; and Operate the API according to the touch operation behavior. The display control method as described in claim item 1 further includes: In response to the application program not belonging to the first type of application program, determining a default operation function corresponding to the physical button for the operation function corresponding to the control signal; and Operate the API according to the default operation function. The display control method as described in claim item 1 further includes: analyze an identifying information of the application; and Determine whether the application program belongs to the first type of application program according to an analysis result. The display control method according to claim 1, wherein the first type of application includes a mobile version of the application, and the API of the first type of application is suitable for operating based on the touch operation behavior. The display control method according to claim 1, wherein the touch operation behavior includes at least one of a screen sliding, a screen zooming and a cursor movement performed on the application programming interface. The display control method as described in claim item 1 further includes: In response to the application program belonging to the first type of application program, an auxiliary operation information is presented in the display interface, wherein the auxiliary operation information provides information of the touch operation behavior corresponding to the physical button. A display control system comprising: a display device; and A remote control device with a physical button, Wherein the display device is used for: run an application; presenting an application programming interface corresponding to the application in a display interface; receiving a control signal, wherein the control signal is generated by triggering a physical button of the remote control device; In response to the application program belonging to a first-type application program, simulating an operation function corresponding to the control signal as a touch operation behavior; and Operate the API according to the touch operation behavior. The display control system as described in claim 7, wherein the display device is further used for: In response to the application program belonging to a second type of application program, determining the operation function corresponding to the control signal to a default operation function corresponding to the physical button; and Operate the API according to the default operation function. The display control system as described in claim 7, wherein the display device is further used for: analyze an identifying information of the application; and Determine whether the application program belongs to the first type of application program according to an analysis result. The display control system according to claim 7, wherein the first type of application program includes a mobile version of the application program, and the API of the first type of application program is suitable for operating based on the touch operation behavior. The display control system according to claim 7, wherein the touch operation behavior includes at least one of a screen sliding, a screen zooming and a cursor movement performed on the application programming interface. The display control system as described in claim 7, wherein the display device is further used for: In response to the application program belonging to the first type of application program, an auxiliary operation information is presented in the display interface, wherein the auxiliary operation information provides information of the touch operation behavior corresponding to the physical button. The display control system as claimed in claim 7, wherein the display device includes one of a display and a projection device. The display control system as claimed in claim 7, wherein the remote control device is a physical remote controller.

Images