TW201901485A - Input interface display system and method for portable device - Google Patents

Abstract

An input interface display system for a portable device. The portable device has a plurality of display interfaces. The display system comprises a target screen acquisition module, a main control module, a window adjustment module and a window display module, wherein the target screen acquisition module sends, to the main control module, an acquired target screen of an input interface needing to be displayed; the main control module acquires a screen serial number corresponding to the target screen so as to generate a first display command; the window adjustment module receives the first display command and adjusts, according to screen attribute information, the size of the input interface so as to generate a second display command; and the window display module displays the input interface on the target screen according to the second display command. By means of the input interface display system, an input interface is displayed on different display screens, and the display efficiency of the input interface is improved.

Description

Input interface display system and method for portable device

The present invention relates generally to the field of portable device system design, and more particularly to a system for displaying an input interface in a portable device.

Previous portable devices often have display screens and input devices such as physical keyboards. However, with the rapid development of large-screen smart devices, physical input devices are no longer set on most of today's smart portable devices. For example, physical buttons are no longer set in smart phones for larger display. On the screen, for example, a smart keyboard is no longer set in the smart notebook computer, and another display screen is replaced. The input devices of these entities are replaced by input interfaces (such as virtual keyboards) displayed on the screen, and the operator performs specific text input by clicking a specific position of the input interface on the display screen with touch function.

In most current smart portable devices, the operation of displaying the input interface is performed by the integrated control system in the portable device, and the control system controls the input interface to be displayed on the screen in a specific form and responds to the operator's click. Operation to complete the input of text. Since most of the conventional smart portable devices have only one display screen, the operating system of the smart portable device is designed to display the input interface only on one screen.

However, many smart portable devices now have more than one display screen, such as a display screen on the front and back of the smart phone, or a display screen on the upper and lower covers in the smart notebook computer. For these portable devices with multiple screens, if the existing control system is still used, it can only display the input interface in one screen (also called the main screen), but not on other screens (also called The input interface is displayed in the secondary screen, which greatly affects the use of the portable device. Of course, some improvements have been made to the control system by projecting or displaying a background image similar to the input interface on the secondary screen, using an additional interface to control the background image and the operating system for displaying the input interface on the main screen. The module is connected to respond to the operator's click operation on the secondary screen to complete the input operation of the secondary screen. However, since it does not directly call the relevant function module in the control system, the display efficiency and response speed of the input interface will inevitably decrease, which also affects the use of the portable device to some extent.

Therefore, there is a need for a display system that can display an input interface in different display screens without affecting display efficiency and response speed.

The object of the present invention is to solve the above problem that the display interface and the input interface cannot be displayed on different screens with low display efficiency and low response speed.

In order to solve the above problems, the present invention provides an input interface display system for a portable device, the portable device having a plurality of display screens, wherein the input interface display system has a target screen acquisition module, a main control module, a window adjustment module, and a window display module; the target screen acquisition module is configured to acquire a target screen that needs to display an input interface, and send the target screen to the main control module; The module obtains a screen number corresponding to the target screen from the screen number list to generate a first display command, and sends the first display command including the screen number to the window adjustment module; The group obtains the screen attribute information corresponding to the target screen according to the first display command to generate input interface size information, and combines the input interface size information with the first display command to generate a second display command; The window display module receives the second display command to control the target screen to display the input interface.

The interface display system, wherein the target screen acquisition module further comprises a monitoring unit, the monitoring unit determines whether the target screen changes, and if the target screen changes, the monitoring unit sends the current target screen to the main control module.

The above interface display system, wherein the input interface display system further has a photographing device, a pressure sensing device and/or a gravity sensing device; the photographing device acquires a display screen currently being watched by the user, and sends the display screen to the display a monitoring unit; the pressure sensing device acquires a display screen currently touched by the user, and transmits the display screen to the monitoring unit; the gravity sensing device acquires a display screen placed upward, and displays the display A screen is sent to the monitoring unit.

The interface display system further includes a layout adjustment module, wherein the layout adjustment module controls the target according to the second display command and the display layout information according to display layout information for acquiring the target screen a screen to change a display layout; the display layout information is used to describe a size and a position of a window displayed by the program running in the portable device in the target screen.

The interface display system, wherein the layout adjustment module controls the target screen to reduce the size of a program window displayed in the target screen, or add a scroll in the program window and scroll up the program window.

The above interface display system, wherein the screen attribute information includes a resolution of the screen and dots per inch.

The above interface display system, wherein the input interface size information includes a length, a width, and a position of the input interface.

The present invention also provides an input interface display method for a portable device having a plurality of display screens, characterized in that: obtaining a target screen, obtaining a target screen that needs to display an input interface, and obtaining a target screen corresponding to the target screen Screen number; adjusting the size of the input interface, adjusting the size of the input interface according to the screen attribute information corresponding to the target screen; and displaying the input interface, displaying the size-adjusted input on the target screen interface.

The above method, further comprising: monitoring a target screen, monitoring whether the target screen changes in real time, outputting the current target screen if the target screen changes; and/or adjusting the display layout, adjusting the The display layout of the program window displayed in the target screen.

The above method, wherein the step of monitoring the target screen further comprises: obtaining a display screen that the user is currently watching, if the display screen currently viewed by the user is different from the target screen, determining that the target screen changes; acquiring the current touch of the user Display screen, if the display screen currently touched by the user is different from the target screen, it is determined that the target screen changes; and/or the display screen currently placed upward is obtained, and if the display screen is currently placed upwards, the display screen and the target are displayed. The screen is different, and it is judged that the target screen has changed.

The above method, wherein the step of adjusting the display layout further comprises: reducing a size of the program window; and/or adding a scroll to the program window and scrolling up the program window.

In summary, the present invention has the beneficial effects that the target screen that needs to display the input interface can be acquired and specified by the target screen acquisition module, instead of always displaying the input interface on a pre-designated screen, so that the input of the present invention is made. The interface display system can display the input interface on different screens; in addition, since the target main control module directly displays the input interface according to the target screen, without calling an additional interface module to realize the display of the input interface in different screens, The input interface display interface and response speed are not reduced due to the use of additional interface modules.

The technical solutions of the present invention will be described below in conjunction with the specific embodiments of the present invention and the accompanying drawings. It should be noted that the same reference numbers will be used herein to refer to the elements in the various figures. The accompanying drawings are merely illustrative of the preferred embodiments of the invention,

Please refer to FIG. 1. FIG. 1 is a schematic diagram of a portable device 100 according to an embodiment of the present invention. As can be seen from FIG. 1, the portable device 100 is similar to a commonly used notebook computer having an upper housing. 110 and lower housing 120, and a first screen 130 (also referred to as a main screen) is disposed in the upper housing 110. In a typical notebook computer, a physical keyboard is usually disposed in the lower housing 120 for text. Input, and in the portable device 100, the lower housing 120 is provided with a second screen 140 (also referred to as a sub-screen) instead of the physical keyboard, so that the portable device has two screens and is touched by use. The control function screen realizes the input function of the portable device, so this increases the display content of the portable device and improves the display effect. However, in the case of the current portable device, the operating system (for example, the Android operating system) can only use the function module for displaying the virtual keyboard integrated in the operating system on a fixed screen (for example, portable). An input interface is displayed on the main screen 130) in the device 100, and the input interface can be, for example, a traditional qwerty standard keyboard used on a notebook computer or a smart tablet, or a nine-square format digital keyboard used on a smart phone. The input interface cannot be selected to be displayed on other screens such as the secondary screen 140, which reduces the utility of such portable devices.

Please continue to refer to FIG. 2. FIG. 2 is a schematic diagram of a modular interface display system 200 for acquiring a target screen in the display system 200 according to an embodiment of the present invention. The screen refers to a display screen that needs to display an input interface. Taking the portable device 100 shown in FIG. 1 as an example, when an operator needs to input text on the main screen 130, the input interface needs to be displayed on the main screen 130 ( For example, the virtual keyboard), at this time, the target screen is the main screen 130. Similarly, when the operator needs to input on the sub-screen 140, the input interface needs to be displayed in the sub-screen 140, and the target screen is the sub-screen. 140. The target screen capture module 210 can obtain the target screen through various methods. For example, in some embodiments, the information of the target screen can be saved in the target screen capture module 210 or saved in the target screen capture module 210 in a preset manner. Among the peripheral devices (not shown) that are electrically connected, as the initial target screen. When the user needs to input text, the display system is activated, and the target screen acquisition module 210 can obtain the initial target screen directly from itself or from the peripheral device. In other embodiments, the target screen acquisition module 210 can also acquire the targets sensed by the sensing devices from a plurality of sensing devices (eg, photographic devices, touch sensors, gravity sensors, etc.) connected thereto. Screen. In still other embodiments, the target screen capture module 210 can also have a human-computer interaction interface (not shown) through which the user can specify a target screen on which the input interface needs to be displayed.

After the target screen acquisition module 210 acquires the target screen, the target screen acquisition module 210 sends the target screen to the main control module 220. When the main control module 220 searches the screen number list 251 in the external database 250 according to the information of the target screen, the screen number corresponding to the target screen is retrieved. The screen number list 251 stores the correspondence between all display screens and screen numbers in the portable device. Taking the portable device 100 shown in FIG. 1 as an example, the screen number list 251 can store two display screens, that is, the main screen 130 and the sub-screen 140, and also store two screen numbers, such as ID_0 and ID_1. The main screen 130 corresponds to the screen number ID_0, and the sub screen 140 corresponds to the screen number ID_1. In other embodiments, when the portable device has more than two display screens, the content stored in the screen number list 251 also increases. After obtaining the screen number of the target screen, the main control module 220 generates a first display command through the screen number. The first display command may include other command materials, such as the type of the input interface, in addition to the screen number of the target screen ( For example, the qwerty standard keyboard or the numeric keypad in the form of a nine-square grid, the display level of the input interface (for example, always displayed on the top layer of the target screen), the initial size of the input interface, and a series of basic instructions for displaying the data interface. In a specific implementation, the main control module 220 can be a control circuit with a separate processing chip, or can be a computing module integrated in the operating system. For example, in a specific implementation, the main control module 220 can be Android. The input method service (InputMethodService) in the operating system, through which the Android operating system can initialize and display the input interface in the portable device.

Then, the main control module 220 sends the generated first display command to the window adjustment module 230. After receiving the first display command, the window adjustment module 230 extracts the screen number of the target screen again from the first display command. And the screen attribute information of the target screen corresponding to the screen number is checked in the screen attribute list 252 in the database 250 according to the screen number. In a specific implementation, the screen attribute list 252 stores attributes of all display screens of the portable device, which may include display resolution, physical size, and/or dots per inch (dpi) of the display screen. The window adjustment module 230 adjusts the size of the input interface according to the obtained screen attribute information, so that the input interface is displayed on the target screen in an appropriate manner. In some embodiments, the size of the input interface can be automatically adjusted by using a window management policy service (PhoneWindowManager) in the Android system. For example, the window adjustment module 230 sends the attribute information of the target screen to the window management policy service. The Windows Management Policy Service automatically adjusts the size of the input interface based on these screen attribute information, such as adjusting the length, width, and position of the input interface so that the input interface is properly sized and at the appropriate location on the target screen. The position of the input interface here can be the coordinate of the upper left point of the input interface in the target screen. Of course, other key points of the input interface can also be used to indicate the position of the input interface. After the window adjustment module 230 calculates the size of the input interface, the size information of the input interface is incorporated into the first display command to generate a second display command. Therefore, by setting the window adjustment module 230, the display system 200 can instantly adjust the size of the input interface according to the unique attribute of the target screen, so that the input interface is always presented on the target screen in an optimal manner, which is due to portability. Different display screens in the device often have hardware differences. If you enter the interface now in a fixed size, there may be a mismatch between the input interface and the target screen.

Next, the window display module 240 is configured to execute a second display command to display the input interface on the target screen with a suitable input interface size.

Please refer to FIG. 3 in conjunction with FIG. 2. FIG. 3 is a schematic structural diagram of a target screen acquiring module 210 according to another embodiment of the present invention. In some embodiments, the target screen acquisition module 210 may further have a monitoring unit 211, in the process of displaying the input interface of the target screen, the monitoring unit 211 monitors whether the target screen changes, and when the monitoring unit 211 finds that the target screen changes. The monitoring unit 211 sends the current latest target screen to the main control module 220, so that the control input interface is always displayed on the display screen where the user needs to perform text input. For example, when the user uses the portable device as shown in FIG. 1 , when the user first performs text editing on the main screen 130 by using the text editing software, the target screen acquiring module 210 acquires the current target screen as the main screen. 130 is sent to the main control module 220 to control the main screen 130 to display the input interface, while the monitoring unit 211 always monitors whether the target screen changes. After a period of time, for example, an email program running in the background of the portable device receives a new email, at which point the user may wish to open the email program on the secondary screen 140 and reply to the received email. The monitoring unit 211 can detect that the user is about to use the secondary screen 140 to reply to the mail. Therefore, the monitoring unit 211 determines that the target screen has changed from the main screen 130 to the secondary screen 140, and then the current target screen (ie, the secondary screen 140). ) is sent to the main control module 220 to control the sub-screen 140 to display the input interface. After the user completes the operation of replying to the mail, the monitoring unit 211 detects that the user will return to the text editing before the main screen 130 continues, and the monitoring unit 211 determines that the target screen has changed from the secondary screen 140 to the main screen 130, and the current The target screen (ie, the main screen 130) is sent to the main control module 220, thereby controlling the main screen 130 to display the input interface. As a result, the monitoring unit 211 can instantly detect the latest target screen, so that the input interface is always displayed on the display screen where the user needs to input text, thereby improving the experience of the portable device.

In a specific implementation, the monitoring unit 211 can monitor whether the target screen changes through various sensing devices electrically coupled thereto. In a specific embodiment, the portable device can be provided with a camera 212. The camera 212 can instantly detect the angle of the user's face orientation or the user's eye gaze through various existing face detection algorithms or human eye tracking algorithms. The angle is obtained by analyzing the obtained angle information, and the display screen that the user is currently watching is obtained, and the display screen is fed back to the monitoring unit 211 to assist the monitoring unit 211 to monitor whether the target screen is changed. In another embodiment, the portable device can be provided with a pressure sensor 213 on each display screen, and when the user applies the appropriate force to the display screen, the pressure sensor 213 corresponding to the display screen The power is detected and the display screen is fed back to the monitoring unit 211 to assist the monitoring unit 211 in monitoring whether the target screen has changed. In still another embodiment, the portable device can set the gravity sensor 214 in the vicinity of each display screen. When the user wants to use one of the display screens for text input, the display screen needs to be placed upward. The gravity sensor 214 corresponding to the display screen feeds the display screen placed upwards to the monitoring unit 211 to assist the monitoring unit 211 in monitoring whether the target screen is changed. Of course, in other modes, the portable device can simultaneously use the camera 212, the pressure sensor 213, and the gravity sensor 214 to cooperate with the monitoring unit 211 to monitor whether the target screen changes, for example, when portable. When the device is configured with the above three sensing devices, if more than two sensing devices of the three sensing devices feed back the same display screen to the monitoring unit 211, the monitoring unit 211 displays the display screen and the current display. The target screen of the input interface is compared to determine whether the target screen has changed.

Please refer to FIG. 4. FIG. 4 is a schematic diagram of a modular interface display system 300 according to another embodiment of the invention. The difference between the display system 300 and the display system 200 of FIG. 2 is that the main control module 320 and the window adjustment module 330 respectively have a screen number list 321 and a screen attribute list 331 for the module 320 and the window adjustment. The module 330 can directly find the screen number and screen attribute information of the desired target screen without accessing an external database, which further increases the speed at which the display system 300 displays the input interface. At the same time, the display system 300 further has a layout adjustment module 350. After receiving the second display command from the window adjustment module 330, the layout adjustment module 350 extracts the screen number of the target screen and the size information of the input interface from the second display command. At the same time, the layout adjustment module 350 further has an interface for accessing the display screen corresponding to the screen number according to the screen number, so as to obtain the display layout information of the current display screen from the display screen, the display layout information indicates The display window of the program running in the portable device is displayed on the display screen. Since the layout adjustment module 350 extracts the screen number of the target screen from the second display command, the layout information acquired by the layout adjustment module 350 is the layout information of the target screen. At the same time, the layout adjustment module adjusts the layout of the target screen according to the size information of the input interface so that the display screen of the target screen does not affect the display of other program windows. In a specific implementation manner, the layout adjustment module 350 can reduce the size of other program windows in the target screen according to the size information of the input interface, so that the input interface and other program windows are simultaneously displayed on the target screen without affecting each other, for example, in the figure. In the 5A, a program window 410 is displayed on the target screen 400. For example, the program window 410 can be a window of a text editing program running in the portable device. In FIG. 5B, when the input interface 420 is displayed in the target screen 400, the program is displayed. The window 410 is appropriately zoomed out and moved upward so that the target screen 400 can simultaneously display the program window 410 and the input interface 420 without affecting each other. In a specific implementation manner, the layout adjustment module 350 can add a reel in the program window according to the size of the input interface without changing the display ratio of other program windows, and then scroll up and down in the program window to display the program window. All content inside. For example, in FIG. 5C, when the input interface 420 is displayed in the target screen 400, the program window 410 is appropriately moved upward without changing the display scale, and at the same time, the reel 411 is added to the right side of the program window 410 so that the user can drag the reel 411. To view all the contents in the program window 410, the program window 410 and the input interface 420 do not affect each other. In a specific implementation manner, when the operating system of the portable device is an Android operating system, the window management service (WindowManager Service) in the Android system may also be used to automatically adjust the display layout of the target screen.

Please refer to FIG. 6. FIG. 6 is a flowchart of a method for displaying an input interface according to an embodiment of the present invention, wherein the steps illustrated by the dotted boxes indicate that the steps may be included in some embodiments, or may not be included in others. In a specific embodiment. In step S10, the target screen that needs to display the input interface is acquired, and the screen number corresponding to the target screen is obtained. For example, in some embodiments, the screen number of the target screen can be obtained from a list in which the correspondence between the display screen and the screen number is stored. In step S20, the attributes of the target screen, such as the physical size, resolution, and dpi of the target screen, are obtained according to the screen number of the target screen, and the size of the input interface, such as the length, width, and width of the input interface, is adjusted according to the information of the screen attributes. position. In some embodiments, the properties of the target screen can be found from a list in which all of the display screen attribute information is stored. Next, in step S30, the size-adjusted input interface is displayed on the target screen.

In addition, in some embodiments, step S40 and step S50 may be further included. In step S40, whether the target screen changes or not is changed, and if the target screen changes, steps S20 and S30 are performed on the changed target screen. In a specific embodiment, the angle of the user's face orientation or the angle of the user's eye gaze can be detected by the camera, and the displayed angle information is obtained by analyzing the obtained angle information, and the display screen and the target screen are displayed. A comparison is made to determine if the target screen has changed. If the display screen is different from the target screen, it is determined that the target screen has changed. In a specific embodiment, a display screen that the user is touching or applying force is acquired through the pressure sensor, and the display screen is compared with the target screen to determine whether the target screen changes. If the display screen is different from the target screen, it is determined that the target screen has changed. In a specific embodiment, the display screen currently placed upward is detected by the gravity sensor, and the display screen is compared with the target screen to determine whether the target screen changes. If the display screen is different from the target screen, it is determined that the target screen has changed. In step S50, the display layout of other program windows in the target screen is acquired, and the display layout in the target screen is adjusted according to the size of the input interface, so as not to affect other program windows after the input screen is displayed on the target screen. In a specific implementation, the display layout of the target screen can be adjusted by reducing the size of other program windows. In a specific implementation, the display layout of the target screen can also be adjusted by adding a reel to other program windows.

The above is only the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Those skilled in the art can make various corresponding according to the present invention without departing from the spirit and scope of the present invention. Changes and modifications are intended to be included within the scope of the appended claims.

100‧‧‧ portable device

110‧‧‧Upper casing

120‧‧‧ Lower housing

130‧‧‧ first screen

140‧‧‧ second screen

200‧‧‧Display system

210‧‧‧Getting module

211‧‧‧Monitoring unit

212‧‧‧ camera

213‧‧‧ Pressure Sensor

214‧‧‧Gravity Sensor

220‧‧‧Master Module

230‧‧‧Window Adjustment Module

240‧‧‧Windows display module

250‧‧‧Database

251‧‧‧Screen number list

252‧‧‧Screen Properties List

300‧‧‧Display system

320‧‧‧Master Module

321‧‧‧Screen number list

330‧‧‧Window Adjustment Module

331‧‧‧Screen Properties List

340‧‧‧Window display module

350‧‧‧Layout adjustment module

400‧‧‧ Target screen

410‧‧‧Program Window

411‧‧‧ reel

420‧‧‧Input interface

S10‧‧‧Get target display screen

S20‧‧‧Adjust the size of the input interface

S30‧‧‧ display input interface

S40‧‧‧Monitor target shows whether the screen changes

S50‧‧‧Adjust the display layout

1 is a schematic diagram of a portable device having a plurality of display screens according to an embodiment of the present invention; FIG. 2 is a schematic block diagram of an input interface display system according to an embodiment of the present invention; FIG. 3 is another embodiment of the present invention. FIG. 4 is a schematic diagram of a modular interface display system according to another embodiment of the present invention; FIG. 5 is a schematic diagram of an input interface display system according to another embodiment of the present invention; FIG. 5A to FIG. A layout diagram of a screen; and FIG. 6 is a flowchart of an input interface display method according to an embodiment of the present invention.

Claims (11)

An input interface display system for a portable device, the portable device having a plurality of display screens, wherein the input interface display system has a target screen acquisition module, a main control module, a window adjustment module, and a window a display module; the target screen acquisition module is configured to acquire a target screen that needs to display an input interface, and send the target screen to the main control module; the main control module obtains and reports from the screen number list a screen number corresponding to the target screen to generate a first display command, and send the first display command including the screen number to the window adjustment module; the window adjustment module obtains according to the first display command The screen attribute information corresponding to the target screen is generated to generate input interface size information, and the input interface size information is combined with the first display command to generate a second display command; and the window display module receives the first Second, a command is displayed to control the target screen to display the input interface. The input interface display system of claim 1, wherein the target screen acquisition module further comprises a monitoring unit, the monitoring unit determines whether the target screen changes, and if the target screen changes, the monitoring unit sends the current The target screen is to the main control module. The input interface display system of claim 2, wherein the input interface display system further has a photographing device, a pressure sensing device, and/or a gravity sensing device; the photographing device acquires a display screen currently being watched by a user And sending the display screen to the monitoring unit; the pressure sensing device acquires a display screen currently touched by the user, and sends the display screen to the monitoring unit; the gravity sensing device acquires upward A display screen is placed and the display screen is sent to the monitoring unit. The input interface display system of claim 1, further comprising a layout adjustment module, wherein the layout adjustment module is configured according to the display layout information for acquiring the target screen, and according to the second display command and The display layout information controls the target screen to change a display layout; the display layout information is used to describe a size and a position of a window displayed by the program running in the portable device in the target screen. The input interface display system of claim 4, wherein the layout adjustment module controls the target screen to reduce the size of a program window displayed in the target screen, or add a reel in the program window. Scroll up the program window. The input interface display system of any of claims 1-5, wherein the screen attribute information comprises a resolution of the screen and dots per inch. The input interface display system of any of claims 1-5, wherein the input interface size information comprises a length, a width, and a position of the input interface. An input interface display method for a portable device having a plurality of display screens, wherein: obtaining a target screen, obtaining a target screen that needs to display an input interface, and obtaining a screen number corresponding to the target screen; The step of adjusting the size of the input interface, adjusting the size of the input interface according to the screen attribute information corresponding to the target screen; and displaying the input interface, displaying the size-adjusted input interface on the target screen. According to the method of claim 8, further comprising: monitoring the target screen, monitoring whether the target screen changes in real time, outputting the current target screen if the target screen changes; and/or adjusting The step of displaying the layout adjusts the display layout of the program window displayed in the target screen. The method of claim 9, wherein the step of monitoring the target screen further comprises: obtaining a display screen that the user is currently watching, and determining that the target is different if the display screen currently viewed by the user is different from the target screen The screen changes; the display screen currently touched by the user is obtained, and if the display screen currently touched by the user is different from the target screen, it is determined that the target screen changes; and/or the display screen currently placed upward is obtained, if the current orientation is The display screen placed on the screen is different from the target screen, and it is determined that the target screen has changed. The method of claim 9, wherein the step of adjusting the display layout further comprises: reducing a size of the program window; and/or adding a scroll to the program window and scrolling up the program window.