WO2021219002A1

WO2021219002A1 - Display device

Info

Publication number: WO2021219002A1
Application number: PCT/CN2021/090538
Authority: WO
Inventors: 华峰; 王学磊; 张凡文; 薛梅; 王楷; 马志峰; 牛峰
Original assignee: 海信视像科技股份有限公司
Priority date: 2020-04-30
Filing date: 2021-04-28
Publication date: 2021-11-04

Abstract

Disclosed is a display device, which is used for enabling, by means of the centralized management and control of various function accesses for an intelligent touch television, a user to quickly find a function that the user wants, thereby improving the user experience. The display device comprises: a display, wherein the display comprises a touch screen; a user interface; and a controller, which is respectively connected to the display and the user interface, and is used for executing the following: in response to a first input instruction, controlling the display to display a global menu control, wherein the first input instruction is input by a user by means of touching the touch screen with a finger.

Description

display screen

This application requires the Chinese Patent Office filed on December 24, 2020, the application number is 202011551199.9, and the application name is "a display device"; the Chinese Patent Office filed on April 30, 2020, the application number is 202010364836.5, the application The title is "A display method of display device education mode"; the priority of the Chinese patent application filed on September 24, 2020, the Chinese Patent Office, the application number is 202011016939.9, and the application name is "Display device and user collection display method" , Its entire content is incorporated into this application by reference.

Technical field

This application relates to the technical field of display devices, and specifically to a display device.

Background technique

At present, there are few types of home touch display devices on the market, and there are almost no touch-based interactive designs in related technologies. After using the touch screen in the screen selection of the display device, the traditional remote control cannot reflect the advantages of the touch display device, and when the user wants to find the application or tool he wants, the operation steps are relatively cumbersome and the user experience is not good.

Summary of the invention

The embodiment of the present application provides a display device that is used to centrally manage and control various function entries of a smart touch TV, so that users can quickly find the functions they want to use, and improve user experience.

In some embodiments, a display device is provided, including:

A display, the display including a touch screen;

User interface

The controllers connected to the display and the user interface respectively are used to perform:

In response to the first input instruction, the display is controlled to display a global menu control, and the first input instruction is input by the user by touching the touch screen with a finger.

In some embodiments, the controller is also used to execute:

In response to a second input instruction, the display is controlled to display a global menu control at a position where the user's finger stops moving, and the second input instruction is input by the user after pressing the global menu control with a finger and moving on the touch screen.

In some embodiments, the controller is configured to execute:

In response to the third input instruction, the position of the global menu control is synchronously updated according to the center point coordinates of all finger touch coordinates, and the third input instruction is input by the user by touching the touch screen with at least four fingers.

In some embodiments, the controller is also used to execute:

In response to the user's instruction to select the global menu control, controlling the display to display a menu display area, the menu display area including a menu edit control;

The menu display area also includes at least one application or tool control;

The menu display area also includes a global return control.

In some embodiments, the controller is also used to execute:

In response to the user's instruction to select the menu editing control, controlling the display to display the menu editing area;

In response to the user's fourth input instruction, add an application or tool control to the menu display area, or delete an application or tool control in the menu display area, where the fourth input instruction is in the menu editing area The user inputs by clicking or dragging the application or tool control with his finger.

In some embodiments, a display device is provided, including:

A display, the display including a touch screen;

User interface

In response to a first input instruction, the display is controlled to display a global menu control and a global return control, and the first input instruction is input by the user by touching the touch screen with a finger.

In some embodiments, the controller is also used to execute:

In response to the second input instruction, the display is controlled to display the global menu control and the global return control at the position where the user's finger stops moving. Touch screen mobile input.

In some embodiments, the controller is further configured to execute: in response to the third input instruction, the positions of the global menu control and the global return control are synchronously updated according to the center point coordinates of all finger touch coordinates, the third input The instruction is input by the user by touching the touch screen with at least four fingers;

The synchronous update of the positions of the global menu control and the global return control according to the center point coordinates of all finger touch coordinates includes:

Obtain the touch coordinates of each touch point;

Determine the maximum value and minimum value of all touch coordinates;

Calculating the Cartesian coordinate distance between the maximum value of the coordinate and the minimum value of the coordinate;

If the Cartesian coordinate distance is greater than the preset pixels, calculate the center point coordinates of all touch coordinates;

The global menu control and the global return control are displayed at positions corresponding to the coordinates of the center point.

In some embodiments, the controller is also used to execute:

In response to an instruction to rotate the screen input by the user, controlling the rotation component to drive the display to rotate;

Record the drag coordinates of the global menu control and the global return control in real time;

Calculate the scale factor according to the state of the screen before the rotation and the drag coordinate;

Calculating display coordinates according to the scale factor and the state of the rotated screen;

After the rotation is completed, the global menu control and the global return control are displayed at positions corresponding to the display coordinates.

In some embodiments, the controller is also used to execute:

The menu display area also includes at least one application or tool control;

In response to the user's fourth input instruction, add an application or tool control to the menu display area, or delete an application or tool control in the menu display area, where the fourth input instruction is in the menu editing area In the middle, the user inputs by clicking or dragging the application or tool control with his finger;

The adding an application or tool control to the menu display area, or deleting an application or tool control in the menu display area specifically includes:

If it is detected that the user's finger touches the touch screen, obtain the item coordinates of the point where the user's finger falls;

If the project coordinates are valid coordinates and the user's finger touch time exceeds the first preset time period, obtain the background image of the application or tool control corresponding to the current project coordinates, and draw a floating mirror image of the background image;

Hide the application or tool control;

Update the position of the floating mirror image according to the position of the user's finger;

If it is detected that the user's finger leaves the touch screen, the display position of the application or tool control is updated, and the floating mirror image is hidden.

In some embodiments, the present application provides a display device, including:

A display configured to display a user interface, the user interface including a global menu control and/or a global return control;

A controller configured to receive a first input instruction input by a user to select the global menu control;

In response to the first input instruction, the user interface is controlled to display a menu display area, and the menu display area includes at least one application or tool control.

In some embodiments, the controller is configured to:

In response to a second input instruction input by the user, the global menu control and/or the global return control are controlled to be displayed on the user interface.

In some embodiments, the display includes a touch screen, and the second input instruction input by the user is input by the user touching the touch screen.

In some embodiments, the controller is further configured to, in response to a third input instruction, control the display to display the global menu control and/or the global return control at a position where the user's finger stops moving, and the third The input instruction is input by the user moving on the touch screen after pressing the global menu control and/or the global return control with a finger.

In some embodiments, the controller is further configured to, in response to a fourth input instruction, synchronously update the position of the global menu control according to the center point coordinates of all finger touch coordinates, and the fourth input instruction is for the user to pass multiple Touch the touch screen to input with two fingers.

In some embodiments, the controller is further configured to:

In response to the fifth input instruction of the user, an application or tool control is added to the menu display area, or an application or tool control in the menu display area is deleted.

In some embodiments, adding an application or tool control to the menu display area, or deleting an application or tool control in the menu display area specifically includes:

Hide the application or tool control;

In some embodiments, the synchronously updating the positions of the global menu control and the global return control according to the center point coordinates of all finger touch coordinates includes:

Obtain the touch coordinates of each touch point;

Determine the maximum value and minimum value of all touch coordinates;

In some embodiments, it further includes:

A rotating component configured to drive the display to rotate;

The controller is further configured to control the rotation component to drive the display to rotate in response to an instruction to rotate the screen input by the user;

Real-time recording of the drag coordinates of the global menu control and/or the global return control;

After the rotation is completed, the global menu control and/or the global return control are displayed at the position corresponding to the display coordinates.

In some embodiments, the menu display area further includes a mode selection control,

The controller is further configured to, in response to a user input triggering the mode selection control instruction, control the display device to call up a mode selection interface, the mode selection interface including a prompt screen for instructing the user to select a mode;

In response to the selection of the corresponding mode control input by the user, the display is controlled to enter the corresponding mode.

In some embodiments, the menu display area includes a plurality of controls corresponding to a plurality of modes,

The controller is further configured to, in response to a user input, trigger any one of the plurality of controls, and at the same time, control the display to enter a mode corresponding to the triggered control.

In some embodiments, the menu display area further includes a favorite control;

The controller is further configured to receive an instruction to select the favorite control input by the user;

Store the collection data in the corresponding storage area according to the mode of the device;

Among them, the user can only see the favorite data in the mode in which the device is located.

In the above embodiment, by setting and displaying the global menu control and the global return control, the touch characteristics of the display device are fully utilized to make up for the insufficient operation of the remote control. The global menu control and the global return control have also become the unified entrance to the various functions of the smart TV. Centralized management and control of each function allows users to quickly find the functions they want to use and enhance user experience.

Description of the drawings

In order to explain the implementation of the present application more clearly, the following will briefly introduce the drawings needed in the embodiments. Obviously, for those of ordinary skill in the art, without creative labor, Other drawings can also be obtained from these drawings.

FIG. 1A shows a usage scenario of a display device according to some embodiments;

FIG. 1B shows a rear view of a display device according to some embodiments;

FIG. 2 shows a block diagram of the hardware configuration of the control device 100 according to some embodiments;

FIG. 3 shows a block diagram of the hardware configuration of the display device 200 according to some embodiments;

FIG. 4 shows a software configuration diagram in the display device 200 according to some embodiments;

FIG. 5 shows a schematic diagram of a user interface according to some embodiments;

Figures 6-8 show schematic diagrams of a user interface according to some embodiments;

FIG. 9 shows a schematic diagram of a menu display area according to some embodiments;

10-12 show schematic diagrams of global menu controls and global return controls according to some embodiments;

Figure 13 shows a schematic diagram of a global menu control according to some embodiments;

Fig. 14-16 shows another schematic diagram of a user interface according to some embodiments;

Figures 17-20 show schematic diagrams of another menu display area according to some embodiments;

Fig. 21-22 shows another schematic diagram of a user interface according to some embodiments;

Figures 23-27 show schematic diagrams of a menu editing area according to some embodiments;

Fig. 28 is a schematic diagram of two modes according to an embodiment of the present application;

Fig. 29 is an interface diagram of an education mode according to an embodiment of the present application;

Figure 30 is a standard mode interface diagram according to an embodiment of the present application;

FIG. 31 is a schematic diagram of switching between two modes according to an embodiment of the present application;

Fig. 32 is an interface diagram of an education mode according to an embodiment of the present application;

FIG. 33 is a diagram of a topic details interface according to an embodiment of the present application;

FIG. 34 is a diagram of a my collection interface according to an embodiment of the present application;

Fig. 35 is an interface in the education mode according to an embodiment of the present application.

Detailed ways

In order to make the purpose, implementation and advantages of the present application clearer, the exemplary implementations of the present application will be described clearly and completely with reference to the accompanying drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments It is only a part of the embodiments of the present application, but not all of the embodiments.

Based on the exemplary embodiments described in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the appended claims of the present application. In addition, although the disclosure in this application is introduced in accordance with one or several exemplary examples, it should be understood that various aspects of these disclosures can also be individually constituted as a complete implementation. It should be noted that the brief description of the terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood according to their ordinary and usual meanings.

Fig. 1A is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in FIG. 1A, the display device 200 also performs data communication with the server 400, and the user can operate the display device 200 through the smart device 300 or the control device 100. In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, and the display is controlled by wireless or wired methods. Equipment 200. The smart device 300 may include any one of a mobile terminal, a tablet computer, a computer, a notebook computer, and an AR/VR device. The display device 200 may also be controlled in a manner other than the control device 100 and the smart device 300. The display device 200 also performs data communication with the server 400. The display device 200 may be allowed to communicate through a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200.

In some embodiments, the display device can be fixedly placed on a table or wall, or can be placed on a supporting bracket, which can achieve movements such as ascending/descending or rotating, and can also be used as an art display. As shown in FIG. 1B, the display device 200 includes a rotating component 276, a controller 250, a display 275, a terminal interface 278 protruding from the gap on the back plate, and a rotating component 276 connected to the back plate. The rotating component 276 can make the display 275 Rotate. Viewed from the front of the display device, the rotating component 276 can rotate the display screen to the vertical screen state, that is, the state where the vertical side length of the screen is greater than the horizontal side length, or it can rotate the screen to the horizontal screen state, that is, the screen horizontally. The state where the side length is greater than the vertical side length.

FIG. 2 shows a block diagram of the configuration of the control device 100 according to an exemplary embodiment. As shown in FIG. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control device 100 can receive an input operation instruction from a user, and convert the operation instruction into an instruction that can be recognized and responded to by the display device 200, so as to serve as an interactive mediator between the user and the display device 200. The communication interface 130 is used to communicate with the outside, and includes at least one of a WIFI chip, a Bluetooth module, an NFC or an alternative module. The user input/output interface 140 includes at least one of a microphone, a touch panel, a sensor, a button, or an alternative module.

FIG. 3 shows a block diagram of the hardware configuration of the display device 200 according to an exemplary embodiment. As shown in FIG. 3, the display device 200 includes a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface 280. At least one. The controller includes a central processing unit, a video processor, an audio processor, a graphics processor, RAM, ROM, and the first interface to the nth interface for input/output. The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen. The tuner and demodulator 210 receives broadcast television signals through wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals. The detector 230 is used to collect signals from the external environment or interact with the outside. The controller 250 and the tuner and demodulator 210 may be located in different separate devices, that is, the tuner and demodulator 210 may also be in an external device of the main device where the controller 250 is located, such as an external set-top box.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. The user may input a user command on a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

In some embodiments, the "user interface" is a medium interface for interaction and information exchange between an application or operating system and a user, and it realizes the conversion between the internal form of information and the form acceptable to the user. The commonly used form of the user interface is the Graphic User Interface (GUI), which refers to the user interface related to the operation of the computer that is displayed graphically. It can be an icon, window, control and other interface elements displayed on the display screen of an electronic device. The control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets, etc. At least one of the visual interface elements.

Referring to Figure 4, in some embodiments, the system is divided into four layers, from top to bottom, respectively, the application (Applications) layer (referred to as the "application layer"), and the Application Framework layer (referred to as the "framework layer"). "), Android runtime and system library layer (referred to as "system runtime library layer"), and kernel layer. The kernel layer contains at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply Drive etc. The following takes the touch display device as an example to introduce the content of this solution:

Calling of global menu control and global return control

In some embodiments, after the user turns on the display device and enters the startup interface or an application, after the user touches the screen of the display with a finger, the controller controls the display to display global menu controls and global return controls. In some embodiments, after the user touches the screen of the display with a finger, the controller controls the display to display only global menu controls. When the user clicks on the global menu control, the global return control is displayed. In some embodiments, the user invokes the global menu control and the global return control through specific keys on the remote control. In some embodiments, the user can use a specific gesture, for example, the user shows a gesture of spreading five fingers to the camera, and the controller controls the display to display global menu controls and/or global return controls.

In some embodiments, as shown in FIG. 5, the steps of the controller controlling the display to display global menu controls and global return controls include:

Step S51: Monitor the boot broadcast of the display device to pull up the SoftControlService (soft control service); Step S52: Register InputFilter (input filter) monitoring; in some implementations, the display device will pull the soft control service after booting, which can be obtained by registering the input filter monitoring Gesture action instructions or remote control instructions sent by the user. Step S53: Receive the instruction input by the user through the user interface; Step S54: Determine whether the instruction input by the user is a MotionEvent (touch event); after receiving the instruction input by the user, it is necessary to distinguish whether the input instruction is a MotionEvent (touch event) or KeyEvent (keyboard event). If it is a touch event, step S55 is executed. Step S55: Perform algorithm matching processing on the touch event, and determine whether to display the global menu control and the global return control according to the processing result.

In some embodiments, the algorithm matching processing includes pointCount (number of touch points), flinger distance (sliding distance), flinger vector (sliding vector), and so on. In some embodiments, taking the number of touch points as an example, the method of algorithm matching processing for touch events is as follows. The touch events include the following five scenarios: Scenario 1: Only one finger touches the screen, and its coordinates The points can be recorded as: pos=0, X=156.90448, Y=533.3757; Scene 2: Two fingers touch the screen, and the coordinate points can be recorded as: pos=0, X=156.90448, Y=533.3757, os=1 , X=119.90448, Y=747.3757; Scene 3: Three fingers touch the screen, the coordinate points can be recorded as: pos=0, X=156.90448, Y=533.3757, pos=1, X=119.90448, Y=747.3757, pos=2, X=229.90448, Y=678.3757; Scene 4: Four fingers touch the screen, the coordinate points can be recorded as: pos=0, X=156.90448, Y=533.3757, pos=1, X=119.90448, Y=747.3757, pos=2, X=229.90448, Y=678.3757, pos=3, X=236.90448, Y=603.3757; Scene 5: Five fingers touch the screen, and the coordinate points can be recorded as: pos=0, X=156.90448, Y=533.3757, pos=1, X=119.90448, Y=747.3757, pos=2, X=229.90448, Y=678.3757, pos=3, X=236.90448, Y=603.3757, pos=4, X= 210.90448, Y=574.3757. The number of touch points in the above scene 1 to scene 5 corresponds to 1-5 respectively.

In some embodiments, only when the number of touch points is 1-3, the display is controlled to display global menu controls and global return controls. In some embodiments, when the number of touch points is 1, the display is controlled to display global menu controls and global return controls; when the number of touch points is 2, the Cartesian distance between the two touch points needs to be calculated. When the distance is greater than 100px, control the display to display the global menu control and global return control; when the number of touch points is 3, it is necessary to calculate the Cartesian distance of the maximum and minimum coordinates of the three touch points, when the Cartesian distance is greater than 200px When, control the display to display global menu controls and global return controls.

In some embodiments, in an ideal state, when two fingers or three fingers touch the screen of the display at the same time, the global menu control and the global return control will be displayed. However, after the user touches the screen of the display, the finger often touches the screen successively. When a finger touches the screen, the global menu control and global return control are often displayed directly. In some embodiments, the default display state of the global menu control and the global return control is displayed. After the global menu control is clicked, the custom menu display area is displayed. The global menu control and global return control are suspended above all applications and are visible in the whole scene.

In some embodiments, after the display device is turned on, except for some specific scenarios, as long as the user's finger touches the screen of the display, the global menu control and the global return control can be displayed. Among them, in order not to interrupt the ATV search process, the global menu control and global return control will not be displayed after the user's finger touches the screen of the display during the ATV search process; in some modes that require remote control operation to complete, or In the process of basic parameter setting, the global menu controls and global return controls are not displayed after the user's finger touches the screen of the monitor, such as in factory mode and during boot navigation; when the finger touches the screen to complete drawing or text annotation , The same does not display the global menu controls and global return controls, such as in whiteboard applications and annotation applications; the display of the rotation animation on the display interface during the display rotation does not require the display of the global menu controls and global return controls. Therefore, during the display rotation After the user's finger touches the screen of the display, the global menu controls and global return controls are not displayed.

In some embodiments, after turning on the display device, the user enters the startup homepage or enters an application through a remote control operation. As shown in FIG. 7, when the user's finger touches any position on the display screen, as shown in FIG. 6 or 8, the display device provides a schematic diagram of the user interface to the display. The user interface of FIG. 6 adds a global menu control 61 and a global return control 62 on the basis of the user interface of FIG. 7. In some embodiments, the user interface of FIG. 8 adds a global menu control 61 on the basis of the user interface of FIG. 7. In FIG. 8, when the user clicks the global menu control 61, the menu display area 63 displays the global return control 62, as shown in FIG. 9. The global menu control 61 and the global return control 62 can be suspended or embedded in the user interface of FIG. 7.

It should be noted that a control refers to a visual object displayed on a user interface of a display device to represent corresponding content such as icons, thumbnails, video clips, links, and so on. The display form of the control is usually diversified. For example, the control may include text content and/or an image for displaying thumbnails related to the text content. For another example, the control can be the text and/or icon of the application. In some embodiments, as shown in FIG. 10, the global menu control 61 and the global return control 62 may be simplified graphics; as shown in FIG. 11, the global menu control 61 and the global return control 62 may be text; as shown in FIG. The global menu control 61 and the global return control 62 can be simplified graphics and text; as shown in FIG. 13, the global menu control 61 can be a character image.

In some embodiments, the current user interface displays global menu controls and global return controls, but the user does not input any instructions within the second preset time period, and the controller controls the display to display the global menu controls and global return controls in a semi-transparent state; The user has not input any instructions for the third preset period of time, and the display does not display global menu controls and global return controls. In some embodiments, as shown in FIG. 6, when the global menu control 61 and the global return control 62 are not received within 5 seconds after the user input is not received, the global menu control 61 and the global return control 62 become translucent. , As shown in Figure 14; after another 5 seconds, the user input is not received, the global menu control 61 and the global return control 62 automatically disappear, as shown in the user interface in Figure 7.

Design scheme of rotating scene

In some embodiments, the user uses at least two fingers to rotate and slide on the screen or input an instruction to rotate the screen through a remote control, so as to realize the operation of controlling the rotation component to drive the display to rotate. During the rotation of the monitor, the rotation animation is displayed and the global menu controls and global return controls are not displayed. After receiving the user's rotation instruction, the drag coordinates of the global menu control and the global return control are recorded in real time, which helps to determine the actual coordinates of the global menu control and the global return control before the rotation. In FIG. 6, when the user inputs a rotation instruction, the rotation component drives the display to rotate, and the rotation animation is displayed during the rotation. After the rotation is completed, the user interface as shown in FIG. 15 is displayed.

In some embodiments, the drag coordinates of the global menu control and the global return control can be the coordinates of the center point of the global menu control and the global return control, or the coordinates of a certain point on the edge of the global menu control and the global return control, or Pre-set the coordinates of any point in the global menu control and the global return control. Calculate the scale factor according to the state of the screen before rotating and the drag coordinates; the calculation method of the scale factor: scaleX=moveX/wide1; scaleY=moveY/high1; where scaleX and scaleY are scale factors, moveX and moveY are global menu controls and global Returns the drag coordinates of the control, wide1 is the width of the screen in pixels before rotation, and high1 is the height of the screen in pixels before rotation. Calculate the display coordinates according to the scale factor and the state of the screen after rotation;

In some embodiments, the display coordinates are calculated as follows: showX=scaleX/wide2; showY=scaleY/high2; where scaleX and scaleY are scale factors, showX and showY are the display coordinates of the global menu control and the global return control, wide2 Is the pixel width of the screen after rotation, and high2 is the pixel height of the screen after rotation. In some embodiments, taking a display device with a resolution of 1920*1080 as an example, if the state of the screen before rotation is the portrait state, the calculation method of the scale factor: scaleX=moveX/1080; scaleY=moveY/1920; after rotation The state of the screen is the horizontal state, the calculation method of the display coordinates: showX=scaleX/1920; showY=scaleY/1080; if the state of the screen before rotation is the horizontal state, the calculation method of the scale factor: scaleX=moveX/1920; scaleY=moveY/1080; the state of the screen after rotation is the vertical state, the calculation method of the display coordinates: showX=scaleX/1080; showY=scaleY/1920. After the rotation is completed, display the global menu control and the global return control at the position corresponding to the display coordinates; call the updateViewLayout (update interface layout) method to update the position of the global menu control and the global return control.

Global menu control and global return control drag and drop

In some embodiments, the user presses the global menu control or the global return control with a finger and moves on the touch screen to drive the global menu control and the global return control to move on the screen. Users can select the global menu control and global return control with their fingers, and drag the global menu control and global return control to any position on the screen. In some embodiments, it is possible to determine whether the user performs a click operation or a drag operation on the global menu control and the global return control by comparing the moving distance of the user's finger on the screen with the preset pixels. For example, when the moving distance of the user's finger on the screen is greater than 4px, it can be determined that the user is performing a drag operation and move the global menu control and global return control to the position where the finger stops. At this point, the user can keep the finger on the screen in order to continue to move the global menu control and the global return control to the next required position. The user can also take his finger off the screen, and the global menu control and global return control will no longer move. When the moving distance of the user's finger on the screen is not greater than 4px, it can be judged that the user is clicking. If the user clicks the global menu control, the operation of displaying the menu display area is executed; if the user clicks the global return control, the return is executed The instruction of the previous step.

The embodiment of the application makes full use of the touch characteristics of the display device and supports the global drag and drop function. The global menu control and the global return control can be dragged to any position on the display screen, which is convenient for operation and improves user experience. In some embodiments, the user touches the touch screen with at least four fingers, so that the global menu control and the global return control are displayed on the coordinates of the center point of the user's finger, realizing multiple designated positions.

In some embodiments, the step of specifying multiple positions includes: intercepting MotionEvent (touch event) based on the InputFilter (input filtering) mechanism; by intercepting the touch event, action_down (downward operation) and action_up (upward operation) can be obtained. Control events. Customize GestureDetectManager (gesture management class) based on touch events. Among them, the custom gesture management class includes: record a complete action_down (downward operation) and action_up (upward operation) multi-finger touch events, and record the coordinates of each click in the form of an array, that is, the touch of each touch point Control coordinates; determine the maximum and minimum coordinates of all touch coordinates; calculate the Cartesian coordinate distance between the maximum and minimum coordinates; if the Cartesian coordinate distance is greater than the preset pixels, calculate the center point of all touch coordinates Coordinates; display the global menu control and global return control at the position corresponding to the center point coordinates.

In some embodiments, taking five designated bits as an example, the coordinates of each click are recorded in the form of an array, as shown below: pos=0, X0=623.98535, Y0=388.89227; pos=1, X1=778.3119, Y1= 307.42264; pos=2, X2=741.2829, Y2=381.04852; pos=3, X3=774.5621, Y3=270.57675; pos=4, X4=737.88464, Y4=214.87946;

In some embodiments, the method of determining the maximum and minimum coordinates of all touch points is as follows: define initial values minX=maxX=X0 and minY=maxY=Y0; if (X1>X0), maxX=X1, minX= X0; if (X1<X0), minX=X1, maxX=X0; compare the X and Y coordinates of the five points by analogy to obtain (minX, minY) and (maxX, maxY), namely (623.98535, 214.87946) and ( 778.3119, 388.89227); Calculate the Cartesian coordinate distance of the above two points, the Cartesian coordinate distance calculation result is d;

In some embodiments, the number of touch points is 5, and the preset pixel is 300px. If the Cartesian coordinate distance d of the above two points is not greater than 300, it is determined that it is not a valid five-finger operation; if the Cartesian coordinate distance d of the above two points is greater than 300, it can be determined that it is a valid five-finger operation. When the gesture conforms to the established algorithm, that is, after it is judged as a valid five-finger operation, the center point coordinates are calculated; in some embodiments, the center point coordinates are the average value of the five touch point coordinates x and y, and the center point coordinates of the current data are : CenterX=731.2054, centerY=312.56396; According to the centerX and centerY coordinates, the display positions of the global menu control and the global return control are updated synchronously. In some embodiments, as shown in FIG. 7, the current global menu control and global return control are displayed at the bottom left of the display screen. When the user touches five fingers to the lower right of the display screen, as shown in Figure 16, the global menu controls and global return controls are displayed on the lower right of the display screen.

The embodiment of the application makes full use of the touch characteristics of the display device, and can directly change the display position of the global menu control and the global return control on the display screen through five designated positions, without dragging the global menu control and the global return control, and the operation is convenient. Improve user experience.

Customization of global menu controls

In some embodiments, after the user clicks the global menu control, the display displays a menu display area, the menu display area includes menu editing controls, and the menu display area may also include at least one application or tool control. If the global return control is not displayed together with the global menu control, the menu display area may also include the global return control. In some embodiments, as shown in FIG. 10, the global menu control 61 can be displayed with an expand arrow, and the global return control 62 can be displayed with a return arrow; when the user clicks the global menu control 61, if no tool is currently added Or application, as shown in FIG. 17, the menu display area 63 includes the add tool/application control 64 and the menu retract control 66. When the user clicks the add tool/application control 64, the menu editing interface can be entered, as shown in FIG. 22; When the user clicks the menu retract control 66, the menu display area 63 can be retracted, as shown in FIG. 10. If a tool or application has been added currently, as shown in Figure 18, the menu display area 63 includes at least one application or tool control, a menu retracting control 66, and a menu editing control 65. When the user clicks the menu editing control 65, he can enter the menu editing The interface is shown in Figure 22. Wherein, when there are too many applications or tool controls in the menu display area 63, the display controls in the menu display area 63 can be changed by sliding the finger left and right on the display screen. Among them, the position of the menu retracting control 66 is always displayed in the menu display area 63; when the user's finger slides to the right, the menu display area 63 is as shown in FIG. 19. In FIG. 19, when the user clicks on the volume control 67, as shown in FIG. 20, a volume adjustment bar 68 is displayed in the menu display area 63, and the user can change the volume level by sliding a finger left and right on the display screen.

In some embodiments, in FIGS. 17-19, the menu display area 63 is automatically retracted without any operation by the user during the custom time. In FIG. 20, the volume adjustment bar 68 is automatically retracted without any operation by the user during the custom time, as shown in FIG. 19. In some embodiments, the user clicks on the menu editing control, and the display displays the menu editing area; in the menu editing area, the user can add applications or tool controls to the menu display area by clicking on an application or tool control with a finger, or delete items in the menu display area. Application or tool control.

In some embodiments, in the user interface shown in FIG. 21, the user can select the menu display area 63 with a finger and drag the menu display area 63 to any position on the screen. To ensure that the contents of the menu display area are displayed completely, when the menu When the edge of the display area 63 coincides with the edge of the screen, the user cannot continue to drag in the original direction, and a prompt message can be displayed when it cannot move. The user can also display the menu display area on the center coordinate point of the finger on the touch screen by specifying multiple positions. In some embodiments, when the global menu control 61 is dragged to the far right end of the screen, when the global menu control 61 is clicked, the menu display area 63 can be moved to the left adaptively, so that the contents of the menu display area are fully displayed. In FIG. 21, when the user clicks the menu editing control 65, as shown in FIG. 22, the display device provides a user interface to the display, and the menu editing area 71 is included in the user interface. The menu editing area 71 includes a selected menu area 72, a to-be-selected menu area 73, a reset control 74, and a completion control 75. The selected menu area 72 includes applications or tool controls that have been selected to be displayed in the menu display area 63, and the to-be-selected menu area 73 includes applications or tool controls that have not been selected to be displayed in the menu display area. When the user clicks the reset control 74, the application or tool control in the selected menu area 72 is cleared; when the user clicks the completion control 75, it returns to the user interface shown in FIG. 21. The application or tool control displayed in the menu display area 63 is the application or tool control in the menu area 72 that has been selected before the completion control 75 is clicked.

In the menu editing area as shown in FIG. 23, when the user clicks the relatives and friends circle control 76 in the to-be-selected menu area 73, as shown in Fig. 24, the relatives and friends circle control 76 moves from the to-be-selected menu area 73 to the selected menu area 72 , Where, click on the application or tool control in the to-be-selected menu area 73 to add the application or tool control to the end of the selected menu area 72. When the number of applications or tool controls in the selected menu area 72 reaches the preset number, if the user continues to add applications or tool controls, a prompt message "Up to 13 applications or tools can be added" pops up. In FIG. 24, when the user clicks the delete control 77 on the friends circle control 76, as shown in FIG. 23, the friends circle control 76 moves from the selected menu area 72 to the to-be-selected menu area 73. In some embodiments, when the user deletes an application or tool control in the selected menu area 72, the application or tool control may be displayed in the first position of the tool or application list. In some embodiments, the user can add applications or tool controls to the menu display area by dragging applications or tool controls with a finger in the menu editing area, or delete applications or tool controls in the menu display area.

In some embodiments, the step of adding an application or tool control to the menu display area, or deleting an application or tool control in the menu display area specifically includes: detecting whether an action_down event occurs; if an action_down event is detected, it is detected The user's finger touches the touch screen, and pointToPosition (pointToPosition function) obtains the item coordinates (item coordinates) of the drop position; determines whether the item coordinates are valid; in some embodiments, the method for determining whether the item coordinates are valid is to determine the item Whether the coordinates have application or tool controls. If the item coordinate does not have any application or tool control, the item coordinate is invalid; if the item coordinate is within the range of a certain application or tool control, the item coordinate is valid; if the item coordinate is invalid, execute the step of detecting whether an action_down event occurs; if the item If the coordinates are valid, send a long press determination message; determine whether the action_down event exceeds the first preset duration, that is, whether the user's finger touch duration exceeds the first preset duration; in some embodiments, the first preset duration is 800 milliseconds; if Whether the action_down event exceeds the first preset duration, obtain the background image of the application or tool control corresponding to the current project coordinate, and draw the floating mirror of the background image through the window manager (window management); hide the application or tool control; detect action_move (moving operation) ) Event, update the mirror position, that is, update the position of the floating mirror according to the position of the user's finger movement; detect whether an action_up event occurs; if an action_up event is detected, it is detected that the user's finger has left the touch screen, and the display of the application or tool control is updated Position, and hide the floating mirror.

In some embodiments, the display position of the application or tool control can be updated to the position where the user's finger leaves the touch screen, or it can be updated to a preset position, such as the end of the selected application or tool control. If the action_up event is not detected, perform the steps of detecting the action_move event and updating the mirror position.

In some embodiments, the user can drag the application or tool control in the to-be-selected menu area 73 to the range of the selected menu area 72. When the user drags an application or tool control in the to-be-selected menu area 73 to the range of the selected menu area 72, the application or tool control can be added to the end of the selected menu area 72. In the menu editing area as shown in FIG. 23, when the user selects the relatives and friends circle control 76 in the to-be-selected menu area 73, and drags the relatives and friends circle control 76 from the to-be-selected menu area 73 by the gesture drag method as shown in FIG. Drag to the selected menu area 72, as shown in Figure 24. When the number of applications or tool controls in the selected menu area 72 reaches the preset number, if the user continues to add applications or tool controls, a prompt message "Up to 13 applications or tools can be added" pops up.

In some embodiments, the user can drag an application or tool control in the to-be-selected menu area 73 to a designated position in the selected menu area 72. If the specified position is located between two selected applications or tool controls, the dragged application or tool control is displayed at the position of the next selected application or tool control, and the next selected application or tool control is moved to the next position , Other applications or tool controls move to the next position in turn. If the designated position is not occupied by an application or tool control, the dragged application or tool control can be directly added to the designated position or added to the end of the selected menu area 72. If the position is already occupied by an application or tool control, the dragged application or tool control will be added to the specified position; and the original application or tool control at this position can be directly moved to the tool or application list in the menu area 73 to be selected. One bit, to realize the replacement of two application or tool control positions.

In some embodiments, in FIG. 26, when the user drags the annotation control 78 in the to-be-selected menu area 73 to the position of the home page control 79 in the selected menu area 72, the position is already occupied by the home page control 79. As shown in FIG. 27, the comment control 78 will be added to this position; and the original homepage control 79 in this position can be moved to the next position in sequence, and other application or tool controls can be moved to the next position in sequence. If the number of applications or tool controls in the selected menu area 72 reaches the preset number, the application or tool controls at the end of the original menu can be moved to the menu area 73 to be selected. In FIG. 24, when the user selects the friends circle control 76 in the selected menu area 72, and drags the friends circle control 76 from the selected menu area 72 to the to-be-selected menu area 73, as shown in FIG. 23. In some embodiments, when the user deletes an application or tool control in the selected menu area 72, the application or tool control may be the first in the list of tools or applications in the to-be-selected menu area 73.

The embodiments of the present application make full use of the touch characteristics of the display device, customize menu options, centrally control various functions, and improve user experience. In the above embodiment, by setting and displaying the global menu control and the global return control, the touch characteristics of the display device are fully utilized to make up for the insufficient operation of the remote control. The global menu control and the global return control have also become the unified entrance to the various functions of the smart TV. Centralized management and control of each function allows users to quickly find the functions they want to use and enhance user experience.

Standard Mode and Education Mode

In some embodiments, the display device can call up the mode selection interface through the global menu control, including a prompt screen for instructing the user to select the mode. For example, FIG. 28 is a schematic diagram of two modes according to an embodiment of the present application. As shown in FIG. 28, a designated prompt pattern is set on the background of the two controls of "Standard Mode" and "Education Mode"; and below the two controls Set the prompt text, such as "Please select the mode you want to use. After entering the homepage, you can still switch the TV mode at will", so as to guide the user to complete the mode selection operation through graphics or text. In the mode selection interface, the focus flag can also be set on a mode control by default according to the operating conditions of the display device. For example, after the mode selection interface pops up, the focus flag can be set on the control corresponding to the education mode by default. The user can control the focus mark to move to other controls according to the operation mode they want to enter. For example, the user uses the "left" button on the control device (remote control) to move the focus mark to the control corresponding to the standard mode. Obviously, the focus mark can present different display shapes according to different interface styles. For example, the focus mark can be a box that selects the control; it can also be a processing mark for highlighting or changing the color of the control, thereby indicating the position of the focus. In some embodiments, the mode selection interface presented by the display device may also change according to the change of the user's control action. For example, as the focus mark is switched between the two controls, the prompt pattern and prompt text on the interface also change, that is, the description interface and description content corresponding to the control mode are converted. When the user selects the "education mode" control in the mode selection interface, the operating system of the display device can further jump to the interface related to the education mode. In some embodiments, a mode selection control may be provided in the menu display area under the global menu control, and the above process can be realized through the mode selection control.

Wherein, FIG. 29 is an interface diagram of an education mode according to an embodiment of the present application. As shown in FIG. 29, the education mode homepage may include multiple display areas, for example, the Header area at the top of the display homepage, The content area in the middle, and the switching area (channel Tab) at the bottom of the displayed homepage. In some embodiments, the Header area is used to display functional controls, for example, "mode switch", "voice", "search", "user", "grade", "points", "wifi status", "time" Wait. The user can realize the corresponding function by moving the focus mark to any functional control. FIG. 30 is a standard mode interface diagram according to an embodiment of the present application. As shown in FIG. 30, the Header area can be set at the top of the entire display screen, including multiple functional controls, such as "search", "member", "Message", "Terminal Connection Status", "Network Connection Status", "Weather", "Time", etc. Each control can pop up the actual corresponding interface after clicking. For example, when the user clicks the "message" control, a message interface can pop up, and various messages published by the server or pushed by the application can be displayed in the message interface to form a message list. And, each message includes two states: read/unread. When there are unread messages in the message list, you can add prompt patterns on the "message" control. The content area can occupy most of the area of the display screen, including the middle and bottom, so as to display resource cards, setting function cards and other content. Click on different cards to perform different functions. Multiple controls indicating different function pages can be set in the switching area, such as: "my", "channel", "movie", "VIP", "epidemic", "sports", "mall", "game", " "Apply", "Discover", etc.

In some embodiments, FIG. 31 is a schematic diagram of switching between two modes according to an embodiment of the present application. As shown in FIG. 31 and FIG. 18-21, you can click the related application in the menu display area 63 displayed by the global menu control. , To realize the switch of TV mode. In some embodiments, click on the "smart whiteboard" application, if the current display device is in the standard mode, the "smart whiteboard" application will be opened, and the display device will also switch the current standard mode to the education mode, and exit at this time. After the application of "Smart Whiteboard", the display device is still in education mode. In some embodiments, the global menu may be displayed on all screen content after the call, including "mode switching", which the user can directly click to switch. For example, in standard mode, the "mode switch" control position displays "education mode" to switch to education mode after clicking; in education mode, the "mode switch" control position displays "standard mode" to switch after clicking To standard mode. Refer to the previous introduction for calling up the global menu.

In some embodiments, it can also be realized by a designated button on the control device. Referring to FIG. 31, the user can control the display device to switch to the corresponding mode by pressing the "mode switch" or "education mode" button on the control device. Among them, the "mode switch" button can have different functions in different modes. For example, in the standard mode, press the "mode switch" button to switch to the education mode, and in the education mode, press the "mode switch" Key to switch to standard mode. Since the education mode is an operation mode that is relatively infrequently used, a simpler mode switching method can also be set in the education mode. For example, FIG. 32 is an interface diagram of an education mode according to an embodiment of the present application. As shown in FIG. 32, a global return control can also be set in the lower left corner of the education mode homepage. When the user clicks, it directly exits the education mode and enters the standard model.

In some embodiments, switching can also be achieved through an intelligent voice system. After starting the intelligent voice system, the user can input voice commands, such as "education mode", "switch to education mode", "return to education homepage", etc. The display device can directly execute the switching command after receiving the above voice input, from The standard mode is switched to the education mode.

Collection function introduction

In some embodiments, the user can collect a number of different types of topics, such as: a certain actor's film and television topic 1, a certain variety show highlights topic 2, a small bridging course topic 3, where the topic 1 includes 5 types: For film and television drama media resources, Topic 2 includes 10 types of film media resources for variety shows, and Topic 3 includes 4 types of education media resources. The display device can set the collection interface to display the user's favorite topics. However, when the user has many favorite topics, if these favorite topics are directly mixed together, the collection interface will look messy, and the user looks for a certain one they want to watch The topic often takes more time. In order to solve the above problems, this application sets up multiple scene modes to display topics, so that users will not be interfered by other types of topics when searching for topics.

In some embodiments, a favorite control may also be set in the menu display area, and the favorite control is triggered to jump to the favorite interface. In some embodiments, when the user searches for a favorite topic on the educational touch TV, the response method of the display device specifically includes: Step S100: Receive an instruction input by the user to start the favorite interface. Step S110: When the display device is in the first scene mode, control the display to display the collection interface according to the collection data of all the topic types. In some embodiments, the first scene mode is the standard mode. Generally, the user uses this mode more times and may also collect more topics. In order to display comprehensive thematic collection data, the display device can be based on all topic types. The collection data of, controls the display to display the collection interface, so that all the topics of the collection of the currently logged-in user are displayed on the collection interface. In some embodiments, the display device may display the topics that the user favorites according to topic types, so as to facilitate the user to find topics. Step S120: When the display device is in the second scene mode, control the display to display the favorite interface according to the favorite data of the preset theme type. In some embodiments, the second scene mode is an education mode. Normally, the user has a strong purpose of educating children when using this mode. In order to prevent the user from being interfered by other types of topics when searching for topics, the display device may only display Preset the collection data of the topic type, such as the collection data of the education topic type, so that only the education topics collected by the currently logged-in user are displayed on the collection interface.

In some embodiments, FIG. 33 is a diagram of a topic details interface according to an embodiment of the present application, and the display device can generate the topic details interface according to the detailed data of the topic. Refer to Figure 33. The topic details interface is the details page of topic A. On the topic details interface, the topic posters, topic descriptions, topic media resources and topic collection controls can be displayed. Among them, the topic collection controls can be located in the upper right corner of the topic details page. When the user has not favorited the topic, the topic favorite control can display "Favorite", thereby prompting the user that the topic can be favorited. The topic poster can be filled with the topic details interface, the topic introduction can include a text description of the topic, the number of the topic media assets can include multiple, such as media assets A1, media assets A2, media assets A3, media assets A4, media assets A5 , Media Asset A6, Media Asset A7 and Media Asset A8. Receive the topic collection instruction input by the user on the topic details interface, in response to the topic collection instruction, obtain the topic type corresponding to the topic collection instruction, and send a collection request containing the topic type to the server, so that the server generates and stores Contains thematic collection data of the thematic type. Receive an instruction to start the collection interface input by the user, and in response to the instruction to start the collection interface, control the display to display the collection interface according to the collection data of all the topic types.

In some embodiments, the user can trigger the "My" column control from the homepage in the standard mode to enter the "My" column interface. The "My" column interface can be provided with a collection display control, and the user can input through the collection display control The instruction to start the favorite interface. Fig. 34 is a diagram of a my collection interface according to an embodiment of the application. Referring to Fig. 34, the collection interface can be a collection interface of all themes with a topic navigation bar. The topic navigation bar can include multiple topic type controls, such as " Movie, "Education", "K song", "Actor" and "Special topic", among them, each topic type control can display the collection data of the corresponding topic type in the collection interface in response to triggering, so that users can find the collection according to the topic type. In response to triggering, the “topic” control can display all the collection data of the topic types on the collection interface, which is convenient for users to view all the collection topics. Each topic type control is triggered in response to selection. The selection method may include the user touching the topic type control on the touch screen of the display device, or the user selecting the topic type control through the direction selection key on the remote control. The user can obtain different types of thematic collection data by switching the selected thematic type controls.

In some embodiments, in the education mode, the user's interaction with the educational touch-sensitive TV also includes the interaction when operating the topic, such as obtaining the detail page, collecting the topic, and interacting with the display device when searching for the topic in the favorite interface. Step S201: Receive a topic detail instruction input by a user, and in response to the topic detail instruction, obtain from the server the detail data of the topic corresponding to the topic detail instruction and the topic type of the topic corresponding to the topic detail instruction, according to the details The data controls the display to display the topic details interface, and stores the topic type. Step S202: Receive the special topic collection instruction input by the user on the topic details interface, in response to the topic collection instruction, obtain the type of the topic corresponding to the topic collection instruction, and send a collection request containing the topic type to the server, so that the server Generate and store thematic collection data containing the thematic type. Step S203: Receive an instruction to start a favorite interface input by the user, and in response to the instruction to start a favorite interface, control the display to display the favorite interface according to the favorite data of the preset topic type. Fig. 35 is an interface in the education mode according to an embodiment of the application. Referring to Fig. 35, the collection interface of the education mode may be provided with a topic navigation bar. The topic navigation bar may include two topic type controls, such as "education" and "topic ", these two topic type controls can display the collection data of the education topic type on the collection interface in response to triggering.

Since the above embodiments are all described by reference and combination in other ways, different embodiments have the same parts, and the same and similar parts between the various embodiments in this specification can be referred to each other. I will not elaborate on it here.

After considering the specification and practicing the disclosure of the invention herein, those skilled in the art will easily think of other embodiments of the present application. This application is intended to cover any variations, uses, or adaptive changes of the present invention. These variations, uses, or adaptive changes follow the general principles of this application and include common knowledge or customary technical means in the technical field that are not disclosed in this application. . The description and the examples are only regarded as some examples, and the true scope and spirit of the application are pointed out by the content of the claims. The above implementations of the application do not constitute a limitation on the protection scope of the application.

For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above discussion in some embodiments is not intended to be exhaustive or to limit the implementation to the specific form disclosed above. According to the above teaching, various modifications and variations can be obtained. The selection and description of the foregoing embodiments are for better explaining the principles and practical applications, so that those skilled in the art can better use the embodiments and various modified embodiments suitable for specific use considerations.

Claims

A display device including:

A display configured to display a user interface, the user interface including a global menu control and/or a global return control;

A controller configured to receive a first input instruction input by a user to select the global menu control;

In response to the first input instruction, the user interface is controlled to display a menu display area, and the menu display area includes at least one application or tool control.
The display device according to claim 1, the controller is configured to:

In response to a second input instruction input by the user, the global menu control and/or the global return control are controlled to be displayed on the user interface.
The display device according to claim 2, wherein the display comprises a touch screen, and the second input instruction input by the user is input by the user touching the touch screen.
The display device according to claim 1, wherein the controller is further configured to, in response to a third input instruction, control the display to display the global menu control and/or the global return control at a position where the user's finger stops moving, The third input instruction is input by the user moving on the touch screen after pressing the global menu control and/or the global return control with a finger.
The display device according to claim 3, the controller is further configured to, in response to a fourth input instruction, synchronously update the position of the global menu control according to the center point coordinates of all finger touch coordinates, the fourth input instruction Input for the user by touching the touch screen with multiple fingers.
According to the display device of any of claims 1-5, the controller is further configured to:

In response to the fifth input instruction of the user, an application or tool control is added to the menu display area, or an application or tool control in the menu display area is deleted.
The display device according to claim 6,

The adding an application or tool control to the menu display area, or deleting an application or tool control in the menu display area specifically includes:

If it is detected that the user's finger touches the touch screen, obtain the item coordinates of the point where the user's finger falls;

If the project coordinates are valid coordinates and the user's finger touch time exceeds the first preset time period, obtain the background image of the application or tool control corresponding to the current project coordinates, and draw a floating mirror image of the background image;

Hide the application or tool control;

Update the position of the floating mirror image according to the position of the user's finger;

If it is detected that the user's finger leaves the touch screen, the display position of the application or tool control is updated, and the floating mirror image is hidden.
The display device according to claim 5, wherein said synchronously updating the positions of the global menu control and the global return control according to the center point coordinates of all finger touch coordinates specifically includes:

Obtain the touch coordinates of each touch point;

Determine the maximum value and minimum value of all touch coordinates;

Calculating the Cartesian coordinate distance between the maximum value of the coordinate and the minimum value of the coordinate;

If the Cartesian coordinate distance is greater than the preset pixels, calculate the center point coordinates of all touch coordinates;

The global menu control and the global return control are displayed at positions corresponding to the coordinates of the center point.
The display device according to claim 1, comprising:

A rotating component configured to drive the display to rotate;

The controller is also configured to,

In response to an instruction to rotate the screen input by the user, controlling the rotation component to drive the display to rotate;

Real-time recording of the drag coordinates of the global menu control and/or the global return control;

Calculate the scale factor according to the state of the screen before the rotation and the drag coordinate;

Calculating display coordinates according to the scale factor and the state of the rotated screen;

After the rotation is completed, the global menu control and/or the global return control are displayed at the position corresponding to the display coordinates.
The display device according to claim 1,

The menu display area also includes a mode selection control,

The controller is further configured to, in response to a user input triggering the mode selection control instruction, control the display device to call up a mode selection interface, the mode selection interface including a prompt screen for instructing the user to select a mode;

In response to the selection of the corresponding mode control input by the user, the display is controlled to enter the corresponding mode.
The display device according to claim 10,

The menu display area includes a plurality of controls corresponding to a plurality of modes,

The controller is further configured to, in response to a user input, trigger any one of the plurality of controls, and at the same time, control the display to enter a mode corresponding to the triggered control.
The display device according to claim 11,

The menu display area also includes a favorite control;

The controller is further configured to receive an instruction to select the favorite control input by the user;

Store the collection data in the corresponding storage area according to the mode of the device;

Among them, the user can only see the favorite data in the mode in which the device is located.