CN115185414B - Display device and cursor control method - Google Patents

Abstract

Some embodiments of the present application provide a display device and a cursor control method, based on the provided cursor control method, the current position of a cursor can be obtained according to a cursor operation event, so as to obtain the position information of the cursor; determining a display window containing a cursor as a target display window based on the position information of the cursor; analyzing the state identification of the target display window to obtain the operation state of the target display window; if the operation state of the target display window is that the cursor operation is allowed to be accepted, distributing the cursor operation event to the target display window; and if the operation state of the target display window is that the cursor operation is not allowed to be accepted, stopping distributing the cursor operation event. By adopting the technical scheme, the target display window is determined based on the position of the cursor, and different cursor operation events are distributed according to the state identification of the target display window. The cursor is selectively controlled according to different applications or different application scenes, so that the user operation is facilitated.

Description

Display device and cursor control method

Technical Field

The application relates to the technical field of intelligent display equipment, in particular to display equipment and a cursor control method.

Background

The display device refers to a terminal device capable of outputting a specific display screen, and may be a terminal device such as a smart television, a mobile terminal, a smart advertisement screen, and a projector. Taking intelligent electricity as an example, the intelligent television is based on the Internet application technology, has an open operating system and a chip, has an open application platform, can realize a bidirectional man-machine interaction function, and is a television product integrating multiple functions of video, entertainment, data and the like, and the intelligent television is used for meeting the diversified and personalized requirements of users.

In order to facilitate the interaction of a user, the display device supports the mouse to control a cursor of the display screen, the user clicks a video on a browser page through the cursor, scrolls to browse a webpage or clicks a soft keyboard through operating the mouse, information is input on the soft keyboard page, and when an unsupported or unresponsive mouse application and page are operated on the display device, if the application and page responding to the mouse need to be switched to, the situation that the cursor cannot be operated can occur because the mouse is disconnected by an application management layer; at present, a cursor control function is needed to selectively control a cursor according to different applications or different application scenes, so that the user operation is convenient.

Disclosure of Invention

The application provides display equipment and a cursor control method, which can selectively control a cursor according to different applications or different application scenes and facilitate the operation of a user.

In one aspect, some embodiments of the present application provide a display apparatus, including:

a display configured to display a user interface, the user interface comprising at least one display window;

A controller configured to:

responding to a cursor operation event, detecting the current position of the cursor, and obtaining the position information of the cursor;

determining a display window containing the cursor as a target display window based on the position information of the cursor;

Analyzing the state identification of the target display window to obtain the operation state of the target display window;

if the operation state of the target display window is that the cursor operation is allowed to be accepted, distributing the cursor operation event to the target display window so as to execute a control instruction corresponding to the cursor operation event based on the target display window;

and if the operation state of the target display window is that the cursor operation is not allowed to be accepted, stopping distributing the cursor operation event.

In some embodiments of the application, the controller performs determining a display window containing the cursor as a target display window, and is further configured to:

acquiring the last position information of a cursor;

comparing the current position information of the cursor with the last position information of the cursor;

and if the current position information of the cursor and the last position information of the cursor are in different display windows, executing the step of analyzing the state identification of the target display window to obtain the operation state of the target display window.

In some embodiments of the application, the controller execution is further configured to:

Receiving a cursor style modification instruction input by a user;

responding to the cursor style modifying instruction, changing the cursor style into a cursor style designated by the cursor style modifying instruction, and adding a mark for a display window where the cursor is positioned after the cursor style is changed;

Acquiring the current position of the cursor to obtain the position information of the cursor;

Determining a target application corresponding to a display window containing the cursor based on the position information of the cursor;

And if the target application contains a mark, displaying a cursor of a designated cursor style on the display window.

In some embodiments of the present application, the controller executing the change of the target display window, resolving the status identifier of the target display window is further configured to:

detecting operation states of a first display window and a second display window, wherein the first display window is a target display window corresponding to the previous position information of the cursor, and the second display window is a target display window corresponding to the current position information of the cursor;

and if the operation states of the first display window and the second display window allow the cursor operation to be accepted, changing the cursor of the first cursor style of the first display window into the cursor of the second cursor style of the second display window, and displaying the cursor of the second cursor style in the second display window.

In some embodiments of the present application, after obtaining the operation state of the target display window, the controller is further configured to:

identifying an application identifier of the display window and inquiring the type of the application program according to the application identifier;

If the application identifier of the application program is a first type of application identifier, distributing a first cursor operation event in the cursor operation events to the target display window; the types of the application programs corresponding to the first type application identifiers comprise interaction types and text types; the first cursor operation event is a click operation event;

If the application identifier of the application program is a second type application identifier, distributing a first cursor operation event and a second cursor operation event in the cursor operation events to the target display window; the application program type corresponding to the second type application identifier comprises a system type and an audio-video type; the second cursor operation event is a drag and/or roller operation event.

In some embodiments of the present application, after the controller determines that the operation state of the target display window is allowable for accepting a cursor operation, the controller is further configured to:

Identifying a user mode of the display device; the user modes include a first mode and a second mode;

if the user mode of the display device is a first mode, stopping distributing the cursor operation event;

And if the user mode of the display device is a second mode, distributing the cursor operation event to the target display window.

In some embodiments of the application, after determining that the user mode of the display is the second mode, the controller is further configured to:

Acquiring account information of a current login account;

Identifying a user identifier of the account information, and determining an account type according to the user identifier;

if the user identifier is a first user identifier, distributing a first cursor operation event in the cursor operation events to the target display window; and the user type corresponding to the first user identification is an account type which is not verified.

In some implementations of the application, the controller performing the determining of the type of account number from the user identification is further configured to:

and if the account number identification of the account number is a second user identification, distributing a first cursor operation event and a second cursor operation event in the cursor operation events to the target display window, wherein the user type corresponding to the second user identification is the authenticated account number type.

In some embodiments of the application, the controller, in response to the cursor operation event, is further configured to:

Detecting the operation state of a top window in the user interface;

If the operation state of the top-level window is that the cursor operation is allowed to be accepted, sending the cursor operation event to the top-level window;

and if the operation state of the top-level window is not allowed to accept the cursor operation, detecting the operation states of other windows except the top-level window in the user interface, so as to send the cursor operation event to the window allowed to accept the cursor operation.

On the other hand, in some embodiments of the present application, there is also provided a cursor control method applied to a display device, where the display device includes: a display and a controller; the display is used for displaying a user interface, and the user interface comprises a plurality of display windows; the cursor control method comprises the following steps:

responding to a cursor operation event, detecting the current position of the cursor, and obtaining the position information of the cursor;

determining a display window containing the cursor as a target display window based on the position information of the cursor;

Analyzing the state identification of the target display window to obtain the operation state of the target display window;

if the operation state of the target display window is that the cursor operation is allowed to be accepted, distributing the cursor operation event to the target display window so as to execute a control instruction corresponding to the cursor operation event based on the target display window;

and if the operation state of the target display window is that the cursor operation is not allowed to be accepted, stopping distributing the cursor operation event.

As can be seen from the above technical solutions, some embodiments of the present application provide a display device and a cursor control method, based on the provided cursor control method, the current position of the cursor can be obtained according to a cursor operation event, so as to obtain the position information of the cursor; determining a display window containing the cursor as a target display window based on the position information of the cursor; analyzing the state identification of the target display window to obtain the operation state of the target display window; if the operation state of the target display window is that the cursor operation is allowed to be accepted, distributing the cursor operation event to the target display window; and if the operation state of the target display window is that the cursor operation is not allowed to be accepted, stopping distributing the cursor operation event. By adopting the technical scheme, the target display window is determined based on the position of the cursor, and different cursor operation events are distributed according to the state identification of the target display window. The cursor is selectively controlled according to different applications or different application scenes, so that the user operation is facilitated.

Drawings

In order to more clearly illustrate the technical solution of the present application, the drawings that are needed in the embodiments will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

FIG. 1 illustrates a usage scenario of a display device according to some embodiments;

FIG. 2 illustrates a hardware configuration block diagram of a control device according to some embodiments;

FIG. 3 illustrates a hardware configuration block diagram of a display device according to some embodiments;

FIG. 4 illustrates a software configuration diagram in a display device according to some embodiments;

FIG. 5 illustrates a user interface diagram displayed by a display device in some embodiments;

FIG. 6 is a flowchart illustrating steps of a cursor control method according to an embodiment of the present application;

FIG. 7 is a schematic diagram of a mouse system architecture according to some embodiments of the application;

FIG. 8 is a schematic diagram of a scenario in which a cursor control method is performed in an embodiment of the present application;

FIG. 9 is a schematic diagram of another scenario in which a cursor control method is performed in some embodiments of the application;

FIG. 10 is a schematic diagram of a display interface presenting a dispense cursor operation event in some embodiments of the application;

FIG. 11 is a schematic diagram illustrating the distribution of different cursor operation events according to account types in some embodiments of the present application;

Fig. 12 is a timing diagram of a cursor control method according to some embodiments of the present application.

Detailed Description

For the purposes of making the objects and embodiments of the present application more apparent, an exemplary embodiment of the present application will be described in detail below with reference to the accompanying drawings in which exemplary embodiments of the present application are illustrated, it being apparent that the exemplary embodiments described are only some, but not all, of the embodiments of the present application.

Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in fig. 1, the display apparatus 200 is also in data communication with a server 400, and a user can operate the display apparatus 200 through the terminal apparatus 300 or the control device 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display apparatus 200 by inputting a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, and the like.

In some embodiments, the display device may receive instructions not using the smart device or control device described above, but rather receive control of the user by touch or gesture, or the like.

In some embodiments, the terminal device 300 may include any one of a mobile terminal, a tablet, a computer, a notebook, an AR/VR device, and the like.

In some embodiments, the terminal device 300 may also be used to control the display device 200. For example, the display device 200 is controlled using a camera application running on the terminal device.

In some embodiments, the communication of data may also be performed using the terminal device 300 and the display device.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the terminal device 300, for example, the voice instruction control of the user may be directly received through a module configured inside the display device 200 device to obtain voice instructions, or the voice instruction control of the user may be received through a voice control apparatus configured outside the display device 200 device.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

In some embodiments, software steps performed by one step execution body may migrate on demand to be performed on another step execution body in data communication therewith. By way of example, software steps executed by the server 400 may be migrated to be executed on demand on a display device in data communication therewith, and vice versa.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200.

In some embodiments, the communication interface 130 is configured to communicate with the outside, including at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module.

In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, keys, or an alternative module.

Taking the control device 100 as a remote controller as an example, a plurality of functional keys are distributed on the control device 100, a user can generate corresponding control instructions by pressing the keys on the remote controller, and the control instructions are sent to the display device through the remote controller so that the display device executes the control instructions. For example, a function key for indicating the display device to enter a cursor mode is arranged on the control device, a user can perform a selection operation on the key, and a mode selection instruction for indicating to enter the cursor mode is sent to the display device, so that the display device enters the cursor mode, a mapping between a remote controller and a cursor displayed by the display device is established, and the cursor displayed by the display device can be controlled to move by moving the remote controller.

Fig. 3 shows a hardware configuration block diagram of the display device 200 in accordance with an exemplary embodiment.

In some embodiments, display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, memory, a power supply, a user interface.

In some embodiments the controller comprises a central processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, for receiving an image signal from the controller output, for displaying video content, image content, and components of a menu manipulation interface, and a user manipulation UI interface, etc.

In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, the modem 210 receives broadcast television signals via wired or wireless reception and demodulates audio-video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, communicator 220 is a component for communicating with external devices or servers 400 according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; either the detector 230 comprises an image collector, such as a camera, which may be used to collect external environmental scenes, user attributes or user interaction gestures, or the detector 230 comprises a sound collector, such as a microphone or the like, for receiving external sounds.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other operable control. The operations related to the selected object are: displaying an operation of connecting to a hyperlink page, a document, an image, or the like, or executing an operation of a program corresponding to the icon.

In some embodiments, the controller 250 includes at least one of a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (read-only memory), first to nth interfaces for input/output, a communication bus (bus), and the like.

A CPU processor. The system is used for executing the operating system and camera application instructions stored in the memory and executing various camera applications, data and contents according to various interaction instructions received from the outside so as to finally display and play various audio and video contents. The CPU processor may include a plurality of processors. Such as one main processor and one or more sub-processors.

In some embodiments, a graphics processor is used to generate various graphical objects, such as: at least one of icons, operation menus, and user input instruction display graphics. The graphic processor comprises an arithmetic unit, which is used for receiving various interactive instructions input by a user to operate and displaying various objects according to display attributes; the device also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the video processor is configured to receive an external video signal, perform at least one of decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image composition, and the like according to a standard codec protocol of an input signal, and obtain a signal that is displayed or played on the directly displayable device 200.

In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image compositing module, a frame rate conversion module, a display formatting module, and the like.

In some embodiments, a user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Or the user may input the user command by inputting a specific sound or gesture, the user input interface recognizes the sound or gesture through the sensor, and receives the user input command.

In some embodiments, a "user interface" is a media interface for interaction and exchange of information between a camera application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of a user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a graphically displayed user interface that is related to computer operations. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include at least one of a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

In some embodiments, the user interface 280 is an interface (e.g., physical keys on a display device body, or the like) that may be used to receive control inputs.

As shown in fig. 4, the system of the display device is divided into three layers, an application layer, a middleware layer, and a hardware layer, from top to bottom.

The application layer mainly comprises common applications on the television, and an application framework (Application Framework), wherein the common applications are mainly applications developed based on browser, such as: HTML5 APPs; a native application (NAT IVE APPS);

The application framework (Application Framework) is a complete program model with all the basic functions required by standard application software, such as: file access, data exchange, and the interface for the use of these functions (toolbar, status column, menu, dialog box).

The application framework layer in the embodiment of the application comprises a manager (Managers), a Content Provider (Content Provider) and the like, wherein the manager comprises at least one of the following modules: an activity manager (ACTIVITY MANAGER) is used to interact with all activities running in the system; a Location Manager (Location Manager) is used to provide system services or applications with access to system Location services; a package manager (PACKAGE MANAGER) for retrieving various information about the application packages currently installed on the device; a notification manager (Notification Manager) for controlling the display and clearing of notification messages; a Window Manager (Window Manager) is used to manage bracketing icons, windows, toolbars, wallpaper, and desktop components on the user interface.

In some embodiments, the activity manager is used to manage the lifecycle of the individual applications as well as the usual navigation rollback functions, such as controlling the exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of a display screen, judging whether a status bar exists, locking the screen, intercepting the screen, controlling the change of the display window (such as reducing the display window to display, dithering display, distorting display, etc.), detecting whether to start a cursor mode, controlling the cursor to move to a corresponding position after the cursor mode is started, etc., for example, the window manager can call the display parameters of the cursor after detecting that the cursor mode is started, and control the cursor to be displayed in the screen according to the display parameters of the cursor, and can move the cursor to a target position on the screen according to the received cursor movement instruction.

The native application (NATIVE APPS) may support online or offline, message pushing, or local resource access.

The middleware layer includes middleware such as various television protocols, multimedia protocols, and system components. The middleware can use basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, so that the purposes of resource sharing and function sharing can be achieved.

The hardware layer mainly comprises a HAL interface, hardware and a driver, wherein the HAL interface is a unified interface for all the television chips to be docked, and specific logic is realized by each chip. The driving mainly comprises: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

The above embodiments introduce the content of the hardware/software architecture, the functional implementation, etc. of the display device. In some application scenarios, after the display device 200 is started, a preset user interface as shown in fig. 5 may be directly entered, where the user interface includes at least one operation control, a program in an application layer may be displayed through a specific operation control, or may be further displayed after the operation control is selected, in addition, a user may interact with the display device 200 through the control apparatus 100, taking the control apparatus 100 as an example of a remote controller, and the user may generate a corresponding control instruction by pressing a key on the remote controller, and send the control instruction to the display device through the remote controller, so that the display device executes the control instruction. For example, with further reference to fig. 5, a cursor 510 may also be displayed in the user interface of the display device 200, on which the user may control the cursor to move by means of a movement control means.

In some embodiments, the operation mode of the display apparatus 200 includes a cursor mode in which the display apparatus 200 may receive an operation event of a user, call a display parameter of a cursor, and control the display of the cursor in a screen according to the display parameter of the cursor, and may move the cursor to a target position on the screen according to the received cursor movement instruction. Since some applications and pages cannot respond to the cursor, when the user switches from not responding to the cursor to the application and page responding to the cursor, a situation in which the cursor cannot be operated may occur because the cursor has been disconnected by the application management layer.

In order to improve the interactive experience of users, some embodiments of the present application provide a cursor control method, which determines a target display window based on the position of a cursor, and then distributes different cursor operation events according to the state identifier of the target display window, so as to selectively distribute and control the cursor for different applications or different application scenarios, thereby facilitating the user experience.

As shown in fig. 6, the display device 200 may be configured to perform the steps of the cursor control method, where the steps performed by the display device 200 in the following embodiments are performed by the controller 250 in conjunction with other components in the display device 200, unless otherwise specified.

S610: and acquiring a cursor operation event input by a user. The cursor operation event is an operation for controlling a focus cursor in the user interface, and includes controlling a focus cursor moving operation, a selecting operation, a long press operation, a dragging operation, a roller operation, and the like. The display device 200 may monitor user-entered interactions in real-time during use and obtain user-entered cursor manipulation events based on the interactions performed by the user.

In some embodiments, the user may enter the cursor manipulation event through a different device carrier. For example, the user may input an operation event for moving the focus cursor through a direction key on the control apparatus 100 that is provided with the display device 200; the user may also input a cursor operation event in the form of a key, a touch screen, or the like through the terminal device 300 that establishes a communication connection with the display device 200.

The partial display device 200 may also input a cursor operation event by connecting an external device and based on the external device. For example, the display device 200 may be connected to an external device such as a mouse through a USB interface, and a user may input a cursor operation event by performing an operation action such as movement, clicking, or the like on the mouse.

In order to enable the display device 200 to obtain the cursor operation event input by the user, in some embodiments of the present application, a cursor operation event monitoring module for a browser may be built in the display device 200, where the cursor operation event monitoring module may detect the input action of the user in real time during the process that the display device 200 displays the user interface based on the browser, and generate the cursor operation event according to the input action of the user.

S620: and responding to a cursor operation event, detecting the current position of the cursor, and obtaining the position information of the cursor.

The display apparatus 200 may turn on a cursor mode in response to a cursor operation event, which is a mode in which a user can control a cursor to perform the cursor operation event in a user interface through a movement control device. After the controller 250 controls the cursor on mode, the input coordinates of the control device 100 in the reference coordinate system of the sensing area may be detected, so as to control the position of the cursor in the user interface according to the input coordinates.

The sensing area is an area of a real physical space within a certain range around the display device 200, for example, the sensing area may be an area where the display device 200 is placed forward, and the sensing area may be an area in a cube space with length, width and height of a, b and c respectively in front of the display device 200. For convenience of description, in an embodiment of the present application, a reference coordinate system of the sensing area is referred to as a first coordinate system, and a reference coordinate system of the user interface/display apparatus 200 is referred to as a second coordinate system, wherein the first coordinate system is a three-dimensional coordinate system including an X-axis, a Y-axis, and a Z-axis, the second coordinate system is a two-dimensional coordinate system including an X-axis and a Y-axis, the X-axis and the Y-axis may be adjacent two boundaries of the user interface, and the X-axis is the same as the X-axis, the Y-axis is the same as the Y-axis, and the Z-axis is perpendicular to the user interface, i.e., the Z-axis is perpendicular to a plane formed by the X-axis and the Y-axis.

In some embodiments, the control device 100 is a device capable of transmitting a radio frequency signal, when a user sends the radio frequency signal for indicating movement of a cursor in a user interface to the display device 200 through the control device 100 in a sensing area range, the display device 200 receives the radio frequency signal, and obtains input coordinates of a position of a control point in a first coordinate system, and finally obtains position information of the cursor. Wherein the control point is a specific point on the control device, such as a top point, a bottom pad, a center point, etc.

S630: and determining a display window containing the cursor as a target display window based on the position information of the cursor.

When the display device 200 presents a user interface, different display contents can be presented through different display windows, so as to realize different user interaction functions. For example, when a browser is used for browsing a web page, a specific web page browsing interface can be formed through two types of windows with UI functions and browsing functions, and two display contents are presented; for another example, by the split screen mode of the display apparatus 200, different split screen applications are displayed in the first split screen area and the second split screen area of the display 260, respectively, and two display contents are presented; for another example, when a user operates two or more application programs in the foreground through the display device 200, a situation in which a plurality of applications overlap occurs, that is, the application a is at the upper layer of the application B, and the actual display range of the application B is the full screen. Therefore, it is necessary to determine a target display window based on the position information of the cursor so as to distribute a cursor operation event.

In some embodiments, the predominant browser on embedded platforms is a UI system using chromium kernel framework, while being hypertext markup language (Hyper Text Markup Language, HTML) based. The browser has both UI function and web browsing function. Accordingly, when performing functions such as web browsing using the above-described browser, the display device 200 may constitute a specific web browsing interface through two types of windows, i.e., a UI function and a browsing function. Since the display of the user interface depends on the browser, the user can input a cursor operation event for controlling the movement, selection, or the like of the focus cursor through the control device 100 or the terminal apparatus 300. These cursor operation events may be responsive to a display window in accordance with a specific interactive control manner, and for convenience of description, the display window responsive to the browser event will be referred to as a target display window. In the process of browsing the webpage, the window where the webpage content is located is the window which is the uppermost layer and is in a display state, and at the moment, the webpage window can acquire a cursor operation event input by a user.

In some embodiments, when the display apparatus 200 runs a plurality of applications, the application layer acquires process information, and determines the currently running application based on the process information. And acquiring a drawing area of each application, detecting the current position of a cursor at fixed time, and determining a display window containing the cursor as a target display window.

S640: and analyzing the state identification of the target display window to obtain the operation state of the target display window.

After the display device 200 determines the target display window, a status identification of the target display window is acquired. The state identifier of the target display window may be stored in the database of the display device 200 in real time as a state parameter of each display window, and when the display device 200 responds to the cursor operation event, the state identifier corresponding to each current window may be called from the database.

The display device 200 analyzes the state identifier of the target display window to obtain the operation state of the target display window. The operation state is a state attribute set for each display window for the currently displayed user interface, including allowing cursor operation and not allowing cursor operation. For example, in browsing a web page, a UI window and a browsing window may be included in a user interface displayed by the display device 200, and when the content displayed by the UI window is content that does not require user intervention operation, the display device 200 may set the current operation state of the UI window to not allow accepting the cursor operation. Meanwhile, the operation state of the browse window is set to allow the cursor operation to be accepted.

S650: and if the operation state of the target display window is that the cursor operation is allowed to be received, distributing the cursor operation event to the target display window so as to execute a control instruction corresponding to the cursor operation event based on the target display window.

S660: and if the operation state of the target display window is that the cursor operation is not allowed to be accepted, stopping distributing the cursor operation event.

The display device 200 determines whether to dispense the cursor operation event based on the operation state of the target display window. If the operation state of the target display window is that the cursor operation is allowed to be accepted, distributing the cursor operation event to the target display window; and if the operation state of the target display window is that the cursor operation is not allowed to be accepted, stopping distributing the cursor operation event.

As shown in fig. 7, the control apparatus 100 takes a mouse as an example, an application layer (application management layer) monitors a mouse message of the mouse device management layer, and when the mouse device is accessed, the mouse device management layer receives an access notification and sends a message supporting the mouse operation to the application management layer in a notification form. The application management layer initializes the mouse object and distributes the mouse-accessed message to each application. The application which needs to respond to the mouse requests to register to the application management layer, and the mouse object is obtained after the registration is successful. The application management layer will continue to send mouse events to the currently displayed and registered applications. When the mouse is disconnected, the application management layer distributes the message of the disconnection of the mouse to each application, cancels the mouse registration of the application, hides the cursor display corresponding to the mouse, and destroys the cursor object.

When multiple applications are running on the display device 200 and overlap occurs, it is necessary to determine the target display window according to the state identifiers of the display windows corresponding to different applications, and determine whether to distribute the cursor operation event, that is, some applications respond to the cursor operation, other applications do not respond to the cursor operation, or all applications respond to the mouse, the display device 200 will distribute the mouse event according to the state identifiers of the target display window. Therefore, each time the cursor moves, the display device 200 needs to perform the step of acquiring the status identifier of the display window, which makes the operation complicated. To facilitate operation, the controller 250 is further configured to: acquiring the last position information of a cursor; comparing the current position information of the cursor with the last position information of the cursor; and if the current position information of the cursor and the last position information of the cursor are in different display windows, executing the step of analyzing the state identification of the target display window to obtain the operation state of the target display window.

The display device 200 acquires the last position information of the cursor; comparing the position information of the cursor with the last position information of the cursor to obtain a comparison result; determining whether a second display window of the cursor is identical to a first display window of the cursor based on a comparison result; the first display window is a target display window corresponding to the previous position information of the cursor, and the second display window is a target display window corresponding to the current position information of the cursor; if the target display window is changed, analyzing the state identification of the target display window to obtain the operation state of the target display window; if the operation state of the target display window is that the cursor operation is allowed to be received, distributing the cursor operation event to the target display window; and if the operation state of the target display window is that the cursor operation is not allowed to be accepted, stopping distributing the cursor operation event.

As shown in fig. 8, the user interface presented by the display 260 includes a display window of an application a located at an upper layer and a display window of an application B located at a lower layer, since the application a located at the upper layer does not respond to a cursor operation event, the application B located at the lower layer responds to the cursor operation event, and the current cursor position is at point P, and since the display window corresponding to point P does not accept the cursor operation event, the application management layer obtains the drawing area of the application a located at the upper layer and monitors the current cursor position at regular time. When the application B has the requirement of displaying a cursor, initiating a request to an application management layer; the application management layer judges the current position of the cursor, acquires the position of the cursor at the last time, and conceals the cursor if the current position of the cursor is in the display area of the application A, namely the display window is unchanged; when the cursor moves from the point P to the point Q, the display device 200 obtains the last position information of the cursor, i.e., the point P, and at this time, the display window corresponding to the point P is different from the display window corresponding to the point Q, and the cursor is displayed in the display area of the application B due to the current position of the cursor; i.e. when the cursor position is outside the application a, the application management layer will simultaneously distribute the cursor operation event to the application B.

As shown in fig. 9, both the application a located at the upper layer and the application B located at the lower layer respond to the cursor operation mark event, and when the current position of the cursor is in the display area of the application a, the cursor operation event a is distributed to the application a; when the cursor moves from the R point to the S point, i.e., when the current position of the cursor is in the display area of the application B, and distributes the cursor operation event B to the application B.

To enhance the user experience, in some embodiments, the user may modify the style of the cursor. The controller 250 is further configured to: receiving a cursor style modification instruction input by a user; responding to the cursor style modifying instruction, changing the cursor style into a cursor style designated by the cursor style modifying instruction, and adding a mark for a display window where the cursor is positioned after the cursor style is changed; acquiring the current position of the cursor to obtain the position information of the cursor; determining a target application corresponding to a display window containing the cursor based on the position information of the cursor; and if the target application contains a mark, displaying a cursor of a designated cursor style on the display window.

When multiple applications overlap, a window is displayed for the purpose of facilitating user differentiation. The controller 250 is further configured to: detecting operation states of a first display window and a second display window, wherein the first display window is a target display window corresponding to the previous position information of the cursor, and the second display window is a target display window corresponding to the current position information of the cursor; and if the operation states of the first display window and the second display window allow the cursor operation to be accepted, changing the cursor of the first cursor style of the first display window into the cursor of the second cursor style of the second display window, and displaying the cursor of the second cursor style in the second display window.

As shown in fig. 10, the display apparatus 200 transfers the values of the related parameters based on setWindowFlags methods to add window marks to the display window corresponding to the application a and the display window corresponding to the application B in response to the cursor operations on the first display window and the second display window. Because the application A at the upper layer and the application B at the lower layer both respond to the cursor operation mark event, when the current position of the cursor is in the display area of the application A, displaying the cursor style of the application A, and distributing the cursor operation event to the application A; when the cursor moves from the U point to the V point, namely when the current position of the cursor is in the display area of the application B, the cursor pattern of the application B is displayed, and a cursor operation event is distributed to the application B.

Since different applications have different administrative rights, for ease of administration, the controller 250 is configured to: identifying an application identifier of the display window and inquiring the type of the application program according to the application identifier; if the application identifier of the application program is a first type of application identifier, distributing a first cursor operation event in the cursor operation events to the target display window; the types of the application programs corresponding to the first type application identifiers comprise interaction types and text types; the first cursor operation event is a click operation event; if the application identifier of the application program is a second type application identifier, distributing a first cursor operation event and a second cursor operation event in the cursor operation events to the target display window; the application program type corresponding to the second type application identifier comprises a system type and an audio-video type; the second cursor operation event is a drag and/or roller operation event.

In some embodiments, the display device may further include a memory that may be configured to store in real-time an application identification for each display window in the current user interface, and the controller 250 of the display device 200 may send a query request to the memory upon detecting the application identification for the display window in the user interface. Wherein the query request includes a window ID for each display window in the user interface. The memory, upon receiving the query request, may feed back an application identification to the controller 250 according to the window ID in response to the query request.

For example, in response to the cursor operation events a and b, the display device 200 obtains the application identifier of the display window a from the memory, determines that the application identifier of the display window a is the first type of application identifier, that is, the text type, and since the cursor operation event a is a click operation and the cursor operation event b is a drag operation, the display device 200 distributes only the cursor operation event a to the application corresponding to the display window a.

For example, in response to the cursor operation events C and d, the display device 200 obtains the application identifier of the display window C from the memory, determines that the application identifier of the display window C is the second type of application identifier, that is, the video type, and distributes the cursor operation event C and the cursor operation event d to the application corresponding to the display window C, because the cursor operation event C is a click operation and the cursor operation event d is a drag operation.

To accommodate a variety of different application scenarios, the controller 250 is further configured to: identifying a user mode of the display device 200; the user modes include a first mode and a second mode; stopping distributing the cursor operation event if the user mode of the display device 200 is the first mode; the first mode comprises a hotel mode and a mall mode; distributing the cursor operation event to the target display window if the user mode of the display device 200 is a second mode; the second mode includes a home mode and an office mode.

For example, the display device 200 responds to the cursor operation event a, detects the current position of the cursor, determines a target display window, obtains the state identifier of the target display window, analyzes the state identifier of the target display window, and obtains the operation state of the target display window, wherein the operation state of the target display window is the operation state allowing to accept the cursor operation event, and if the display device 200 recognizes that the current user mode is the hotel mode, i.e. the first mode, the distribution of the cursor operation event a is stopped.

For example, the display device 200 responds to the cursor operation event b, detects the current position of the cursor, determines a target display window, obtains the state identifier of the target display window, analyzes the state identifier of the target display window, and obtains the operation state of the target display window, where the operation state of the target display window is that the cursor operation event is allowed to be accepted, and if the display device 200 recognizes that the current user mode is the home mode, that is, the second mode, the cursor operation event b is distributed to the application corresponding to the target display window.

For ease of user management, as shown in fig. 11, the controller 250 is further configured to: acquiring account information of a current login account; identifying a user identification of the account information, and determining the type of the account according to the user identification; if the account number identification of the account number is a first user identification, distributing a first cursor operation event in the cursor operation events to the target display window; the first cursor operation event is a hit and move operation event, the user type corresponding to the first user identifier is an account type which is not verified, and the account type comprises a child account number and a tourist account number. If the account number identification of the account number is a second user identification, distributing a first cursor operation event and a second cursor operation event in the cursor operation events to the target display window; the second cursor operation event is a drag and roller operation event, and the user type corresponding to the second user identifier is an account type passing verification.

For example, the display device 200 detects the current position of the cursor in response to the cursor operation events c and d, and determines a target display window, so as to obtain an operation state of the target display window, where the operation state of the target display window is allowed to accept the cursor operation event; the display device 200 obtains account information of the current login account, determines that the account is of a child account type, wherein the cursor operation event c is a movement event, namely a first cursor operation event, and d is a drag event, namely a second cursor operation event, and the display device 200 distributes the cursor operation event c to a target display window.

For example, the display device 200 detects the current position of the cursor in response to cursor operation events e and f, and determines a target display window, so as to obtain an operation state of the target display window, where the operation state of the target display window is allowed to accept the cursor operation event; the display device 200 obtains account information of a current login account, determines that the account is of the type account 1, the account is an account passing verification, the cursor operation event e is a moving event, namely a first cursor operation event, and f is a dragging event, namely a second cursor operation event, and the display device 200 distributes the cursor operation event e and the cursor operation event f to a target display window.

In the process of browsing the webpage, when the top-level window where the webpage content is located does not support the user interface of the operation event, the problem that the user operation is invalid easily occurs. The controller is further configured to: detecting the operation state of a top window in the user interface; if the operation state of the top-level window is that the cursor operation is allowed to be accepted, sending the cursor operation event to the top-level window; and if the operation state of the top-level window is not allowed to accept the cursor operation, detecting the operation states of other windows in the user interface except the top-level window, so as to send the cursor operation event to the window allowed to accept the cursor operation.

By detecting the operation state of the top-level window, different windows can be determined as focus windows according to different operation states corresponding to the top-level window. If the operation state of the top-level window is that the cursor operation is allowed to be accepted, the current top-level window is indicated to respond to the current cursor operation event, so that the cursor operation event can be sent to the top-level window to trigger the top-level window to display a response picture corresponding to the current cursor operation event.

For example, when the top-level window is a browsing window or a UI window requiring user intervention operation, by detecting an operation state of the top-level window, a table item "Operable condition =1" corresponding to the top-level window may be read, and it may be determined that the current top-level window can respond to the current cursor operation event, that is, may be used as a focus window. Therefore, the controller 250 may send the cursor operation event input by the user to the current top-level window, so that the top-level window executes the cursor operation event to implement interactive control. If the operation state of the top-level window is that the cursor operation is not allowed to be received, the current top-level window is a UI window without user intervention operation, and at this time, if a cursor operation event input by a user is sent to the window, the problem of invalid user operation can occur. To this end, the display apparatus 200 may re-detect the operation states of windows other than the top-level window in the user interface to transmit a cursor operation event to the window allowing the cursor operation to be accepted.

In summary, the cursor control method provided in some embodiments of the present application may enrich the cursor application scene of the display device 200, and support application of different drawing layers. Different applications can customize cursor patterns, present different cursor patterns based on response behaviors of different applications, selectively display cursors and distribute cursor events when applications of different layers overlap, and improve user experience.

Based on the above-mentioned cursor control method, as shown in fig. 12, some embodiments of the present application further provide a display device, including:

A display 260, a controller 250; wherein the display 260 is configured to display a user interface comprising at least one display window; a controller 250 configured to perform the following program steps:

Acquiring a cursor operation event input by a user;

Responding to the cursor operation event, obtaining the current position of the cursor, and obtaining the position information of the cursor;

determining a display window containing the cursor as a target display window based on the position information of the cursor;

Analyzing the state identification of the target display window to obtain the operation state of the target display window;

If the operation state of the target display window is that the cursor operation is allowed to be accepted, distributing the cursor operation event to the target display window;

and if the operation state of the target display window is that the cursor operation is not allowed to be accepted, stopping distributing the cursor operation event.

As can be seen from the above technical solutions, some embodiments of the present application provide a display device and a cursor control method, based on the provided cursor control method, the current position of the cursor can be obtained according to a cursor operation event, so as to obtain the position information of the cursor; determining a display window containing the cursor as a target display window based on the position information of the cursor; analyzing the state identification of the target display window to obtain the operation state of the target display window; if the operation state of the target display window is that the cursor operation is allowed to be accepted, distributing the cursor operation event to the target display window; and if the operation state of the target display window is that the cursor operation is not allowed to be accepted, stopping distributing the cursor operation event. By adopting the technical scheme, the target display window is determined based on the position of the cursor, and different cursor operation events are distributed according to the state identification of the target display window. The cursor is selectively controlled according to different applications or different application scenes, so that the user operation is facilitated.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the application.

Claims (8)

1. A display device, characterized by comprising:

a display configured to display a user interface, the user interface comprising at least one display window;

A controller configured to:

responding to a cursor operation event, detecting the current position of the cursor, and obtaining the position information of the cursor;

acquiring the last position information of the cursor based on the position information of the cursor; comparing the current position information of the cursor with the last position information of the cursor;

if the current position information of the cursor and the last position information of the cursor are in different display windows, determining the display window containing the cursor as a target display window; analyzing the state identification of the target display window to obtain the operation state of the target display window;

if the operation state of the target display window is that the cursor operation is allowed to be accepted, distributing the cursor operation event to the target display window so as to execute a control instruction corresponding to the cursor operation event based on the target display window;

If the operation state of the target display window is that the cursor operation is not allowed to be accepted, stopping distributing the cursor operation event;

Receiving a cursor style modification instruction input by a user;

responding to the cursor style modifying instruction, changing the cursor style into a cursor style designated by the cursor style modifying instruction, and adding a mark for a display window where the cursor is positioned after the cursor style is changed;

Acquiring the current position of the cursor to obtain the position information of the cursor;

Determining a target application corresponding to a display window containing the cursor based on the position information of the cursor;

And if the target application contains a mark, displaying a cursor of a designated cursor style on the display window.

2. The display device of claim 1, wherein the controller performing parsing the status identification of the target display window is further configured to:

detecting operation states of a first display window and a second display window, wherein the first display window is a target display window corresponding to the previous position information of the cursor, and the second display window is a target display window corresponding to the current position information of the cursor;

and if the operation states of the first display window and the second display window allow the cursor operation to be accepted, changing the cursor of the first cursor style of the first display window into the cursor of the second cursor style of the second display window, and displaying the cursor of the second cursor style in the second display window.

3. The display device of claim 1, wherein the controller, upon obtaining the operational state of the target display window, is further configured to:

identifying an application identifier of the display window and inquiring the type of the application program according to the application identifier;

If the application identifier of the application program is a first type of application identifier, distributing a first cursor operation event in the cursor operation events to the target display window; the types of the application programs corresponding to the first type application identifiers comprise interaction types and text types; the first cursor operation event is a click operation event;

If the application identifier of the application program is a second type application identifier, distributing a first cursor operation event and a second cursor operation event in the cursor operation events to the target display window; the application program type corresponding to the second type application identifier comprises a system type and an audio-video type; the second cursor operation event is a drag and or roller operation event.

4. The display device of claim 3, wherein after the controller determines that the operational state of the target display window is acceptable for accepting cursor operations, the controller is further configured to:

Identifying a user mode of the display device; the user modes include a first mode and a second mode;

if the user mode of the display device is a first mode, stopping distributing the cursor operation event;

And if the user mode of the display device is a second mode, distributing the cursor operation event to the target display window.

5. The display device of claim 4, wherein after the controller determines that the user mode of the display is the second mode, the controller is further configured to:

Acquiring account information of a current login account;

Identifying a user identifier of the account information, and determining an account type according to the user identifier;

if the user identifier is a first user identifier, distributing a first cursor operation event in the cursor operation events to the target display window; and the user type corresponding to the first user identification is an account type which is not verified.

6. The display device of claim 5, wherein the controller performs determining the type of account number from the user identification, further configured to:

and if the account number identification of the account number is a second user identification, distributing a first cursor operation event and a second cursor operation event in the cursor operation events to the target display window, wherein the user type corresponding to the second user identification is the authenticated account number type.

7. The display device of claim 1, wherein the controller, in response to the cursor operation event, is further configured to:

Detecting the operation state of a top window in the user interface;

If the operation state of the top-level window is that the cursor operation is allowed to be accepted, sending the cursor operation event to the top-level window;

and if the operation state of the top-level window is not allowed to accept the cursor operation, detecting the operation states of other windows except the top-level window in the user interface, so as to send the cursor operation event to the window allowed to accept the cursor operation.

8. A cursor control method, characterized by being applied to a display device, the display device comprising: a display and a controller; the display is used for displaying a user interface, and the user interface comprises a plurality of display windows; the cursor control method comprises the following steps:

responding to a cursor operation event, detecting the current position of the cursor, and obtaining the position information of the cursor;

acquiring the last position information of the cursor based on the position information of the cursor; comparing the current position information of the cursor with the last position information of the cursor;

if the current position information of the cursor and the last position information of the cursor are in different display windows, determining the display window containing the cursor as a target display window; analyzing the state identification of the target display window to obtain the operation state of the target display window;

if the operation state of the target display window is that the cursor operation is allowed to be accepted, distributing the cursor operation event to the target display window so as to execute a control instruction corresponding to the cursor operation event based on the target display window;

If the operation state of the target display window is that the cursor operation is not allowed to be accepted, stopping distributing the cursor operation event;

Receiving a cursor style modification instruction input by a user;

responding to the cursor style modifying instruction, changing the cursor style into a cursor style designated by the cursor style modifying instruction, and adding a mark for a display window where the cursor is positioned after the cursor style is changed;

Acquiring the current position of the cursor to obtain the position information of the cursor;

Determining a target application corresponding to a display window containing the cursor based on the position information of the cursor;

And if the target application contains a mark, displaying a cursor of a designated cursor style on the display window.