WO2022227159A1

WO2022227159A1 - Display device and control method

Info

Publication number: WO2022227159A1
Application number: PCT/CN2021/096003
Authority: WO
Inventors: 田德利; 唐高明; 程晋; 华峰
Original assignee: 海信视像科技股份有限公司
Priority date: 2021-04-30
Filing date: 2021-05-26
Publication date: 2022-11-03

Abstract

A display device (200) and a control method. A display (260) of the display device (200) can be driven by a rotating assembly (292) and/or a height-adjusting assembly (291) to rotate and/or be ascend or descend. A controller (250) of the display device (200) is configured to: receive an input user gesture; if the user gesture is a predetermined rotation gesture, according to the user gesture, control a rotation driving device to drive the display (260) to rotate; and if the user gesture is a predetermined height-adjusting gesture, according to the user gesture, control a height-adjusting driving device to drive the display (260) to ascend or descend.

Description

Display device and control method

This application claims the priority of the Chinese patent application with the application number 202110499421.3 and the application title "display device and its control method" filed with the Chinese Patent Office on April 30, 2021, and the Chinese patent application filed on April 30, 2021 Bureau, the application number is 202110480012.9, and the application title is "a display device and a touch lifting method" of the Chinese patent application, the entire content of which is incorporated in this application by reference.

technical field

The present application relates to the technical field of display devices, and in particular, to a display device and a control method.

Background technique

Smart TV is a display device that can provide users with playback pictures such as audio, video, pictures, etc. It can not only provide users with live TV program content received through data broadcasting, but also provide users with various content such as online video programs, online games, etc. application and service content.

In the process of viewing the media resource picture through the smart TV, the screen of the smart TV is usually located at a fixed height or a fixed presentation direction. For example, the smart TV can be fixed on the wall through the back mounting bracket, or placed on objects such as TV cabinets through the bottom bracket, so that the smart TV can be fixed at a height of 80-100cm from the ground.

However, this fixed installation height or fixed presentation direction cannot meet the experience of different users and rich application scenarios, which is not conducive to users' interactive operations on the smart TV, and reduces the comprehensive experience of users.

SUMMARY OF THE INVENTION

This application provides some display devices, including:

monitor,;

at least one of a rotating assembly and a lifting assembly, the rotating assembly is used to drive the display to rotate, and the lifting assembly is used to drive the display to rise and fall;

a touch component, configured to detect a touch action input by a user;

Controller, configured as:

Receive control instructions input on the touch component through user gestures;

If the user gesture is a predetermined rotation gesture, controlling the rotation component to drive the display to rotate according to the user gesture;

If the user gesture is a predetermined lifting gesture, the lifting component is controlled to drive the display to rise or fall according to the user gesture.

The second aspect of the embodiments of the present application shows some touch lifting methods, which are applied to a display device, where the display device includes a display, a touch component, a lifting component, and a controller, and the touch lifting method includes:

obtaining a control instruction input by the user for adjusting the height of the display, where the control instruction includes a multi-finger sliding action input through the touch component;

In response to the control instruction, detecting the sliding distance and sliding direction in the control instruction;

According to the sliding distance, a lifting instruction is sent to the lifting assembly to control the lifting assembly to adjust the height of the display according to the sliding direction.

Description of drawings

In order to illustrate the embodiments of the present application more clearly, the accompanying drawings required in the embodiments will be briefly introduced below. Obviously, for those of ordinary skill in the art, without creative efforts Additional drawings can be obtained from these drawings.

FIG. 1 is a usage scenario of a display device in some embodiments of the present application;

2 is a block diagram of a hardware configuration of a control device in some embodiments of the present application;

3 is a hardware configuration diagram of a display device in some embodiments of the present application;

FIG. 4 is a software configuration diagram of a display device in some embodiments of the present application;

5 is a schematic structural diagram of a lifting assembly in some embodiments of the present application;

6 is a schematic diagram of a predetermined rotation gesture and a display device posture shown in some embodiments of the present application;

7 is a schematic diagram of a contact trajectory corresponding to a predetermined rotation gesture shown in some embodiments of the present application;

8 is a schematic diagram of a contact trajectory corresponding to a predetermined rotation gesture shown in some embodiments of the present application;

9 is a schematic diagram of a predetermined rotation gesture and a display device posture shown in some embodiments of the present application;

10 is a schematic diagram of an operation of adjusting the height of a display through a setting interface in some embodiments of the present application;

FIG. 11 is a flowchart of a touch lifting method in some embodiments of the present application;

FIG. 12 is a schematic diagram of the upward sliding and lifting effect in some embodiments of the present application;

FIG. 13 is a schematic diagram of a slippage reduction effect in some embodiments of the present application;

14 is a schematic diagram of sliding distance in some embodiments of the present application;

15 is a schematic flowchart of adjusting the height of the display according to the sliding distance in some embodiments of the present application;

16 is a schematic diagram of the effect of short-distance sliding adjustment of height in some embodiments of the present application;

17 is a schematic diagram of the effect of long-distance sliding adjustment of height in some embodiments of the present application;

FIG. 18 is a schematic diagram of the effect of stopping the lift according to multi-finger touches in some embodiments of the present application;

FIG. 19 is a schematic diagram of a flow chart of stopping lifting according to the detection of a limiter in some embodiments of the present application;

20 is a schematic diagram of a prompt screen used to indicate that the limit height has been reached in some embodiments of the present application;

FIG. 21 is a schematic diagram of the blocking detection process in some embodiments of the present application;

FIG. 22 is a schematic diagram of a prompt screen for indicating abnormal blocking in some embodiments of the present application;

23 is a schematic diagram of a triggering operation interface in some embodiments of the present application;

FIG. 24 is a schematic flowchart of detecting a connection state in some embodiments of the present application;

FIG. 25 is a schematic diagram of a prompt screen for prompting connection of a lifting component in some embodiments of the present application;

FIG. 26 is a flowchart of a method for controlling a display device shown in some embodiments of the present application.

Detailed ways

In order to make those skilled in the art better understand the embodiments of the present application, the following will clearly and completely describe the embodiments of the embodiments of the present application with reference to the drawings in the embodiments of the present application. The embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the scope of protection of the present application.

The term "module" used in the various embodiments of the present application may refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware or/and software codes capable of executing the execution associated with the element function.

The term "remote control" used in various embodiments of the present application refers to a component of an electronic device (such as the display device disclosed in the present application), which can usually wirelessly control the electronic device within a short distance range. The component can generally use infrared and/or radio frequency (RF) signals and/or Bluetooth to connect with electronic devices, and may also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors. For example, a hand-held touch remote control replaces most of the physical built-in hard keys in a general remote control device with a user interface in a touch screen.

The term "gesture" used in various embodiments of the present application refers to a user behavior that is used by a user to express an expected idea, action, purpose/or result through an action such as a change of hand shape or hand movement.

The term "hardware system" used in the various embodiments of this application may refer to a computer system composed of mechanical, optical, electrical, and magnetic devices such as an integrated circuit (IC) and a printed circuit board (PCB). , physical components that control, store, input, and output functions. In various embodiments of the present application, the hardware system is also commonly referred to as a motherboard or a main chip or a controller.

Referring to FIG. 1 , it is an application scenario diagram of a display device provided by some embodiments of the present application. As shown in FIG. 1 , communication between the control apparatus 100 and the display device 200 may be performed in a wired or wireless manner.

The control device 100 is configured to control the display device 200 , which can receive operation instructions input by the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, acting as an intermediary for the interaction between the user and the display device 200 . effect. For example, the user operates the channel addition and subtraction keys on the control device 100, and the display device 200 responds to the channel addition and subtraction operation.

The control apparatus 100 may be a remote controller 100A, including infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, etc., and controls the display device 200 by wireless or other wired methods. The user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, and the like. For example, the user can control the display device 200 by inputting corresponding control commands through the volume up/down key, channel control key, up/down/left/right movement keys, voice input key, menu key, power-on/off key, etc. on the remote control. function.

The control apparatus 100 may also be a smart device, such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, and the like. For example, the display device 200 is controlled using an application running on the smart device. The app can be configured to provide users with various controls through an intuitive user interface (UI) on the screen associated with the smart device.

Exemplarily, the mobile terminal 100B may install a software application with the display device 200, and implement connection communication through a network communication protocol, so as to achieve the purpose of one-to-one control operation and data communication. For example, the mobile terminal 100B and the display device 200 can be made to establish a control instruction protocol, and by operating various function keys or virtual controls of the user interface provided on the mobile terminal 100B, the functions of the physical keys arranged by the remote control 100A can be realized. The audio and video content displayed on the mobile terminal 100B may also be transmitted to the display device 200 to implement a synchronous display function.

The display apparatus 200 may provide a broadcast receiving function and a network TV function of a computer support function. The display device may be implemented as digital TV, Internet TV, Internet Protocol TV (IPTV), or the like.

The display device 200 may be a liquid crystal display, an organic light emitting display, or a projection device. The specific display device type, size and resolution are not limited.

The display device 200 also performs data communication with the server 300 through various communication methods. Here, the display device 200 may be allowed to be communicatively connected through a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 300 may provide various contents and interactions to the display device 200 . By way of example, display device 200 may send and receive information, such as receiving electronic program guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library. The server 300 may be in one group, or in multiple groups, or in one or more types of servers. Other network service contents such as video-on-demand and advertising services are provided through the server 300 .

FIG. 2 exemplarily shows a configuration block diagram of the control apparatus 100 according to an exemplary embodiment. As shown in FIG. 2 , the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory, and a power supply. The control device 100 can receive the user's input operation instruction, and convert the operation instruction into an instruction that the display device 200 can recognize and respond to, and play an intermediary role between the user and the display device 200 .

FIG. 3 is a block diagram showing a hardware configuration of the display apparatus 200 according to an exemplary embodiment.

The display apparatus 200 includes at least one of a tuner-demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

The display 260 includes a display screen component for presenting pictures, and a driving component for driving image display, for receiving image signals output from the controller, components for displaying video content, image content, and menu manipulation interfaces, and user manipulation UI interfaces . The display 260 may be a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

The communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220 .

The user interface can be used to receive control signals from the control device 100 (eg, an infrared remote control, etc.).

The detector 230 is used to collect external environment or external interaction signals. For example, the detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes or user interaction gestures, or , the detector 230 includes a sound collector, such as a microphone, for receiving external sound.

The external device interface 240 may include, but is not limited to, the following: any one of high-definition multimedia interface (HDMI), analog or data high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. or multiple interfaces. It may also be a composite input/output interface formed by a plurality of the above-mentioned interfaces.

The controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display apparatus 200 . For example, in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

Objects can be any of the optional objects, such as hyperlinks, icons, or other actionable controls. The operations related to the selected object include: displaying operations connected to hyperlinked pages, documents, images, etc., or executing operations of programs corresponding to the icons.

In some embodiments, the user may input user commands on a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input commands through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.

"User interface" can refer to the medium interface for interaction and information exchange between application programs or operating systems and users, which realizes the conversion between the internal form of information and the form acceptable to users. The commonly used form of user interface is Graphical User Interface (GUI), which refers to a user interface related to computer operations displayed in a graphical manner. It can be an icon, window, control and other interface elements displayed on the display screen of the electronic device, wherein the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets, etc. visual interface elements.

As shown in FIG. 4 , the application framework layer in the embodiment of the present application includes managers (Managers), content providers (Content Provider), etc., wherein the manager includes at least one of the following modules: an activity manager (Activity Manager) uses Interacts with all activities running in the system; Location Manager is used to provide system services or applications with access to system location services; Package Manager is used to retrieve files currently installed on the device Various information related to the application package; Notification Manager (Notification Manager) is used to control the display and clearing of notification messages; Window Manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers on the user interface and desktop widgets.

In some embodiments, the activity manager is used to manage the life cycle of the various applications and general navigation rollback functions, such as controlling the exit, opening, rollback, etc. of the application. The window manager is used to manage all window programs, such as obtaining the size of the display screen, judging whether there is a status bar, locking the screen, taking screenshots, and controlling the change of the display window (such as reducing the display window, shaking display, distorting display, etc.), etc.

In some embodiments, the kernel layer is the layer between hardware and software. As shown in Figure 4, the kernel layer at least includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensors, etc.), and power drives, etc.

Compared with the traditional smart TV, the rotary lift smart TV adds the function of rotation and lift. Based on this function, the TV can rotate, rise and fall under the drive of the corresponding driving device, thereby achieving different postures. For example, rotate from landscape orientation to portrait orientation, and then rotate from portrait orientation to landscape orientation. For another example, the current height is based on a rise of 10cm, or a fall of 5cm, etc.

In some embodiments, the above-mentioned display device 200 may be a touch display device, and the display thereof is a touch display composed of a touch component and a screen. The touch display device supports the touch interaction function, which allows the user to operate the host by simply touching the display with their fingers, thus getting rid of the keyboard, mouse, and remote control operations, making the human-computer interaction more straightforward. On the touch display, the user can input different control commands through touch operations. For example, the user can input touch commands such as click, slide, long press, and double click, and different touch commands can represent different control functions.

In order to realize the above-mentioned different touch actions, the touch component can generate different electrical signals when the user inputs different touch actions, and send the generated electrical signals to the controller 250 . The controller 250 may perform feature extraction on the received electrical signal, so as to determine the control function to be performed by the user according to the extracted features. For example, when the user inputs a click and touch action at any program icon position in the application program interface, the touch component will sense the touch action to generate an electrical signal. After receiving the electrical signal, the controller 250 may first determine the duration of the level corresponding to the touch action in the electrical signal, and when the duration is less than the preset time threshold, identify that the user input is a click touch command. The controller 250 then extracts the position feature generated by the electrical signal, so as to determine the touch position. When the touch position is within the display range of the application icon, it is determined that the user has input a click touch instruction at the position of the application icon. Correspondingly, the click touch command is used to execute the function of running the corresponding application program in the current scene, so the controller 250 can start and run the corresponding application program.

For another example, when the user inputs a sliding action on the media asset display page, the touch component also sends the sensed electrical signal to the controller 250 . The controller 250 first determines the duration of the signal corresponding to the touch action in the electrical signal. When it is determined that the duration is greater than the preset time threshold, the position change of the signal is then judged. Obviously, for the interactive touch action, the signal generation position will change, so that it is determined that the user has input the sliding touch command. The controller 250 then judges the sliding direction of the sliding touch command according to the change of the position where the signal is generated, and controls to turn the display screen on the media asset display page to display more media asset options. Further, the controller 250 can also extract features such as sliding speed and sliding distance of the sliding touch command, and perform screen control of page turning according to the extracted features, so as to achieve a follow-up effect and the like.

Similarly, for touch commands such as double-click, long-press, etc., the controller 250 can extract different features, determine the type of touch command by the feature judgment, and execute corresponding control functions according to preset interaction rules. In some embodiments, the touch component 276 also supports multi-touch, so that the user can input touch actions through multi-finger on the touch screen, for example, multi-finger click, multi-finger long press, multi-finger swipe, and the like.

The above touch actions can also be combined with specific applications to achieve specific functions. For example, when the user opens the "presentation whiteboard" application, the display 260 can present a drawing area, the user can draw a specific touch movement track in the drawing area by sliding the touch command, and the controller 250 can use the touch component detected by the touch component to draw a specific touch movement track. action, determine the touch action pattern, and control the display 260 to display in real time to meet the demonstration effect. For example, it is a basic function of the touch screen display device that the user controls the rotation of the displayed picture on the display by rotating the finger touched on the display. The current interaction method is that after multiple fingers are rotated on the screen, the picture is immediately rotated to a horizontal or vertical angle according to the rotation direction of the fingers. There is no interaction process, and the user experience is poor.

In some embodiments, the display device 200 also has a built-in or an external drive assembly 290 , and the drive assembly 290 is used to adjust the use posture of the display 260 . For example, the driving component 290 can drive the display 260 to move in a specific direction to adjust the position of the display 260 . The driving component 290 can also drive the display 260 to rotate around the screen to adjust the tilt of the display 260 .

Based on the above-mentioned display device, the display device can support rotation and/or lift functions by adding a driving component and a posture detection component. Generally, the driving component includes a rotating component 291 and/or a lifting component 292, and the controller 250 can communicate with the rotating component and/or the lifting component, so as to control the rotating component to drive the display to rotate when the display needs to be rotated, and rotate the display when the display needs to be rotated. When ascending or descending, control the lifting assembly to drive the display to ascend or descend.

In a possible implementation manner, the driving component 290 is provided with a GPIO interface, and the controller changes the GPIO interface state of the rotating component and/or the lifting component by reading the GPIO interface. When the state of the GPIO interface changes, the driving component 290 drives the display to rotate and/or lift according to the changed state of the GPIO interface.

In a possible implementation manner, the driving component 290 includes an MCU chip, and a Bluetooth module is integrated on the MCU chip, so that the lifting component and/or the lifting component support a Bluetooth function, such as Bluetooth Low Energy (BLE), and further, the controller 250 can be based on The Bluetooth protocol communicates with the lift assembly and/or the lift assembly.

In some embodiments, the detection assembly includes a sensor for detecting a display rotation state and a sensor for detecting a display lift state. During the rotation or lifting process of the display, the controller monitors the rotation state or the lifting state of the display in real time according to the data detected by the attitude detection component. For example, in the process of controlling the rotation of the display, information such as rotation angle and angular velocity can be obtained by monitoring the data of the sensor. In the process of controlling the rise and fall of the display, the information such as the lifting distance and the lifting speed can be obtained by monitoring the data of the sensor.

In some embodiments, the detection assembly is included in the drive assembly. For example, a sensor for detecting the rotational state of the display is included in the rotating assembly, and together with the rotating assembly described above constitutes the rotating assembly. The sensor for detecting and displaying the lifting state is included in the lifting assembly, and together with the lifting assembly, the lifting assembly is constituted.

FIG. 5 is a schematic view of the back of a display device shown in some exemplary embodiments of the present application. As shown in FIG. 5 , the display device includes a display 260 and a lifting assembly 291 . In some exemplary embodiments, the lift assembly 291 may include a bracket 2911, a guide mechanism 2912, a drive mechanism 2913, and the like. The rotating assembly 292 is disposed on the inner side of the lifting assembly 291 , that is, between the lifting assembly 291 and the display, which is not shown in FIG. 5 .

During specific implementation, the same control interface is provided for each application through the rotary lift control system, including clockwise rotation, counterclockwise rotation, stop rotation, short-distance lift, long-distance lift, stop lift and other unique control entrances to avoid lifting operations. It is carried out at the same time as the rotation operation to ensure the safety of the rotation and lifting control. In addition, the rotary lift control system performs unified logical processing and judgment on the control instructions issued by each application. For example, before controlling the rotation, it is necessary to judge whether it is in the lifting and lowering process, and if not, control the rotation again. When the rotation starts, each application is notified by broadcast to ensure that each application receives the same notification information. In the process of controlling the rotation, the monitoring sensor detects big data to obtain information such as rotation angle and angular velocity and update the parameters. These parameter information can also be fed back to each application. The system performs a rotation completion detection every preset time (eg 200ms), and sends a broadcast notification to the application when the rotation is completed.

The display 260 can be fixed on the bracket 2911 . The drive mechanism 2913 includes a drive motor, transmission components, and the like. The power output shaft of the drive motor is connected to the guide mechanism 2912 through a transmission component. The transmission component can convert the rotary motion output by the drive motor into linear motion, and can be, for example, a ball screw, a rack and pinion, and other structures. After the transmission component converts the rotational motion output by the driving motor into linear motion, the support 2911 can be driven to move along the guide mechanism 2912 , thereby adjusting the height of the display 260 .

In some embodiments, the user may operate the remote control, open the system setting application, and enter an interface for operating the rotation and elevation of the display, and then control the rotation or elevation of the display through corresponding items in the operation interface.

For touch display devices, in order to save user operations and make it easier for users to rotate and lift the display, the user can also touch the touch display to input user gestures, if the input user gestures are used to control rotation or lift If a predetermined gesture is used, the controller 250 controls the rotating component or the lifting component to drive the display to rotate or ascend.

In some embodiments, the controller 250 is configured to receive an input user gesture. Determine whether the user gesture corresponds to a predetermined gesture. If the user gesture is a predetermined rotation gesture, the rotation component is controlled according to the user gesture to drive the display to rotate through the rotation component; if the user gesture is a predetermined lift gesture, the lift component is controlled according to the user gesture to drive the display through the lift component rise or fall.

It should be understood that, in the above embodiment, the user gesture refers to the contact trajectory between the user and the display screen. The controller 250 determines whether the input user gesture is a predetermined rotation gesture or a predetermined lift gesture by matching the characteristics of the contact trajectory with the characteristics corresponding to the predetermined rotation gesture and the predetermined lift gesture. The matching process is the process of recognizing the user's gesture.

In some embodiments, to input a predetermined rotation gesture or a predetermined lift gesture, the user must input a predetermined trigger gesture. In the process of recognizing the user gesture, if a predetermined trigger gesture is recognized, a preset picture is displayed on the top layer of the user interface, and the preset picture is used as a mask, which is a graphical interactive object in the user interface to prevent the user from entering a predetermined rotation. A graphic interaction object in the user interface is touched during the gesture or the predetermined lift gesture, resulting in a false trigger. In the case of displaying the preset picture, continue to identify the contact trajectory of the subsequent input. If the complete contact trajectory does not correspond to the predetermined rotation gesture or the predetermined lift gesture, cancel the preset picture to restore the original user interface; if the complete contact trajectory does not correspond to the predetermined rotation gesture or predetermined lift gesture Corresponding to the predetermined rotation gesture or the predetermined lift gesture, when it is detected that the contact between the user and the display is disconnected, the preset picture is cancelled to restore the original user interface.

In some embodiments, if the multi-finger continuous contact is recognized and the duration exceeds the third preset time, it is confirmed that the predetermined trigger gesture is recognized. Exemplarily, when it is detected that the user's five fingers are in contact with the touch display at the same time for more than 2 seconds, it is confirmed that the predetermined trigger gesture is received.

In some embodiments, if the input user gesture includes synchronously input single-finger continuous fixed contact and multi-finger arc sliding contact, it is determined that the user gesture is a predetermined rotation gesture.

For example, as shown in Figure 6, the user can touch any position of the screen with five fingers at the same time, keep the thumb still, and slide the other four fingers in a clockwise or counterclockwise arc based on the thumb to input a predetermined rotation gesture. In this example, the contact generated by the thumb is a single-finger continuous fixed contact, and the contact generated by the other four fingers is a multi-finger arc sliding contact. Finger-dash sliding contact is input synchronously.

FIG. 7 is a schematic diagram of a user contact trajectory shown in some exemplary embodiments of the present application. Among them, A1, A2, A3, A4, and A5 are the starting points of the five-finger contact, respectively, and B1, B2, B3, B4, and B5 are the breaking points of the five-finger contact, respectively. A1 coincides with B1, that is, a single point of continuous contact. The arcs formed by A2 and B2, A3 and B3, A4 and B4, and A5 and B5 are the arc contact trajectories corresponding to the other four-finger sliding. The starting point of each contact trajectory is the corresponding starting point, and the end point is the corresponding Disconnect point. The four contact tracks enclose the contact point A1 (B1) of the single-point contact. With reference to FIG. 7 , the display device receives the user gesture by detecting the contact trajectory of the user's contact with the screen. If a single-point contact and four arc contact trajectories surrounding the contact point of the single-point contact are simultaneously detected, it is determined that the user gesture is a predetermined rotation gesture.

It should be understood that the user can also touch the thumb, index finger and middle finger to any position on the screen at the same time, keep the thumb still, and slide the other two fingers in a clockwise or counterclockwise arc based on the thumb to input a predetermined rotation gesture. . In this example, the contact generated by the thumb is a single-finger continuous fixed contact, and the contact generated by the other two fingers is a multi-finger arc sliding contact. The single-finger continuous fixed contact and the multi-finger dash sliding contact are input synchronously. . Users can also use other fingers instead of the thumb to enter single-finger continuous fixed contact.

In other embodiments, if the input contact is a synchronously input single-point continuous fixed contact and a multi-finger arc sliding contact, and the angle corresponding to the multi-finger arc sliding contact is greater than a preset angle, it is determined that the contact corresponds to a predetermined rotation gesture. It is worth noting that the criterion for the relationship between the angle corresponding to the multi-finger arc sliding contact and the preset angle can be preset according to requirements. For example, if the angle corresponding to any arc sliding contact is greater than the preset angle, it is determined that the angle corresponding to the multi-finger arc sliding contact is greater than the preset angle. Or, for example, if the angle corresponding to each arc sliding contact is greater than the preset angle, it is determined that the angle corresponding to the multi-finger arc sliding contact is greater than the preset angle.

Exemplarily, in the example shown in FIG. 6 , if the other four fingers rotate clockwise or counterclockwise with the thumb as a reference, the angle exceeds the preset angle, the input contact corresponds to the predetermined rotation gesture.

FIG. 8 is a schematic diagram of a user contact trajectory shown in some exemplary embodiments of the present application. Among them, C1, C2, C3, C4, C5 are the starting points of the five-finger contact, respectively, and D1, D2, D3, D4, and D5 are the disconnection points of the five-finger contact, respectively. C1 coincides with D1, which is a single point continuous contact. The arcs formed by C2 and D2, C3 and D3, C4 and D4, and C5 and D5 are the arc contact trajectories corresponding to the other four fingers. The starting point of each contact trajectory is the corresponding starting point, and the end point is the corresponding breaking point. Open. The four contact tracks enclose the contact point C1 (D1) of the single-point contact. The angle between C1C2 and D1D2∠1 is the sliding angle of the index finger, the angle between C1C3 and D1D3∠2 is the sliding angle of the middle finger, the angle between C1C4 and D1D4∠3 is the sliding angle of the ring finger, and the angle between C1C5 and D1D5∠4 is the sliding angle of the little finger. With reference to FIG. 9 , the display device receives the user gesture by detecting the contact trajectory of the user in contact with the screen. If a single-point contact and four contact tracks surrounding the contact point of the single-point contact are detected at the same time, and the angle corresponding to each contact track is greater than a preset angle, the user gesture is determined to be a predetermined rotation gesture. In some embodiments, if the input contact corresponds to a predetermined rotation gesture, the rotation component is controlled to drive the display to rotate 90° in the direction of the multi-finger arc sliding. The direction of the multi-finger arc sliding is the direction from the start point to the end point of the contact track. In the example shown in FIG. 8 , it is determined according to any contact trajectory, and the direction from the start point to the end point is clockwise. In the example shown in FIG. 8 , according to any contact trajectory, the direction from the start point to the end point is the counterclockwise direction.

In a specific implementation manner, the input user gesture is recognized by the application layer, and when the predetermined rotation gesture is recognized and the sliding direction of the input multi-finger arc sliding is clockwise, the clockwise direction is sent to the rotation lifting control system. Rotation instruction; when a predetermined rotation gesture is recognized and the sliding direction of the input multi-finger arc sliding is counterclockwise, a counterclockwise rotation instruction is sent to the rotation lift control system. After the rotary lift control system receives the clockwise rotation command or the counterclockwise rotation command, it determines whether the lifting component is in working state. When the component is in a working state, after the lifting component stops, a clockwise rotation command or a counterclockwise rotation command is sent to the rotating component. The rotation assembly will control the display to rotate 90° clockwise in response to the clockwise rotation command, and control the display to rotate 90° counterclockwise in response to the counterclockwise rotation command.

In some embodiments, in order to be able to control the display rotation according to the complete contact trajectory, when a predetermined rotation gesture is recognized, when it is detected that the user's contact with the touch display is disconnected, the display rotation is controlled according to the input contact.

Exemplarily, referring to FIG. 6 , when the display is in a landscape orientation, if the user touches the display with five fingers at the same time and keeps the thumb still, the other four fingers rotate clockwise by more than 30° based on the thumb and then lift the five fingers. Driven by the rotating component, the display will rotate 90° along the clockwise pointer to present the vertical screen posture shown in FIG. 10 . Referring to Figure 9, when the display is in the vertical screen position, if the user touches the display with five fingers at the same time and keeps the thumb still, the other four fingers rotate counterclockwise with the thumb as the reference and then lift the five fingers, the display will rotate Driven by the assembly, it rotates 90° along the counter-pointer to reset to the horizontal screen posture shown in Figure 6.

In some embodiments, if the contact trajectory corresponding to the input user gesture is a multi-finger linear sliding contact, and the direction of the multi-finger sliding contact matches the vertical direction, it is determined that the contact corresponds to a predetermined lift gesture.

Obviously, the lift assembly 291 supports reciprocating motion to raise and lower the height of the display 260 . For example, the drive motor can be controlled to rotate forward to drive the stand 2911 to move upward and the height of the display 260 can be raised; the drive motor can also be controlled to rotate reversely to drive the stand 2911 to move downward to reduce the height of the display 260 .

Wherein, in order to realize the reciprocating motion, the driving motor of the driving mechanism 2913 may be a servo motor, a stepping motor, etc. that support steering control. In addition, the drive motor also supports a self-locking function, that is, the angle of the rotating shaft can be locked after the rotation is completed, so as to maintain the display 260 at the adjusted height, so as to avoid being affected by the gravity of the display 260 and changing the adjusted height.

The elevator assembly 291 can also establish a communication connection with the controller 250 of the display device 200 , that is, the controller 250 can send various control commands to the elevator assembly 291 to control the elevator assembly 291 to start, pause, stop, and reverse. For example, when the user wants to raise the height of the display 260, the controller 250 can generate a command for controlling the forward rotation of the driving motor through an interactive action, and send the command to the driving motor. After receiving the command, the driving motor can rotate in the forward direction, thereby driving the bracket 2911 to move upwards and raising the height of the display 260 .

It should be noted that, in order to enable the controller 250 to send an instruction to the lift assembly 291, different communication connection modes may be used between the controller 250 and the lift assembly 291 according to the difference of the display device 200. When the lift assembly 291 is a component of the display device 200 , the controller 250 can implement the transmission of instructions through the internal signal lines of the display device 200 . When the lift assembly 291 is an external component of the display device 200 , the controller 250 may send the instruction to the lift assembly 291 through the external device interface 240 or the communicator 220 of the display device 200 . For example, the lifting component 291 may be provided with a Bluetooth module, and the display device 200 may establish a communication connection with the lifting component 291 through a Bluetooth connection, so that the instructions sent by the controller 250 may be sent to the lifting component 291 through the Bluetooth module.

A series of function commands may also be included in the instructions sent by the controller 250 to the lifting assembly 291 to achieve more detailed functions. For example, the controller 250 can add an adjustment height value of 10cm to the sent instruction, and the adjustment method is raising, and after receiving the instruction, the drive motor can rotate the corresponding number of turns in the forward direction according to the adjustment height value, such as 100 turns , to drive the bracket 2911 up 10cm.

Also, for example, the controller 250 may not specify the adjustment height value in the sent instruction, but only specify the adjustment method as raising, and after receiving the instruction, the drive motor may rotate in the forward direction until the display 260 is adjusted to the highest point Location. To this end, the lifting assembly 291 may further include a limiting member.

In some exemplary embodiments, the limiter can detect whether the display 260 reaches the highest point or the lowest point, so as to feed back the height information to the driving motor when the display 260 reaches the highest point or the lowest point. The limiting member may specifically be a proximity switch, an electromagnetic distance sensor, a grating distance sensor, and the like. When the bracket 2911 or the display 260 reaches the limit height, it can contact the limiter, or enter the detection area of the limiter, the limiter can generate a feedback signal and send it to the drive motor to control the drive motor to stop rotating.

In order to be able to detect the limit height, a limiter can be provided at the end of the guide mechanism 2912, so that the bracket 2911 can contact the limiter when it moves to the limit height. In some embodiments, the limiting member may also be an angle sensor disposed at the position of the rotating shaft of the driving motor, and the angle sensor may detect the angle rotated by the driving motor, thereby indirectly detecting the adjusted height value. The detected height value is then summed with the recorded height value to obtain the total height value. When the total height value obtained by the detected angle conversion is less than the height limit, the drive motor continues to work until the display 260 is adjusted to the set height; and when the total height value is greater than or equal to the height limit, a stop signal is fed back to Control the drive motor to stop running.

When the angle sensor is provided at the position of the drive motor shaft, a speed sensor capable of detecting the rotational speed can also be provided. Obviously, the speed sensor can be composed of an angle sensor, that is, after the angle sensor detects the rotation angle of the driving motor, the rotation speed can be obtained by calculating the ratio of the rotation angle to the time. By detecting the rotation speed, it can be determined whether the height adjustment process is running normally, that is, whether there are abnormal conditions such as blocking. For example, when there is no obstruction during height adjustment, the rotational speed of the drive motor should be stabilized at a specific value. However, when the height adjustment process is blocked or the like, the output speed of the drive motor will be slowed down due to the blocking effect. Therefore, in this embodiment, by detecting the rotation speed, the abnormal condition of blocking can be indirectly detected, so that when the height adjustment process encounters blocking, the rotation can be stopped in time to avoid long-term blocking and damage to the drive motor.

Based on the above lift assembly 291 , the user can control the lift assembly 291 to start/stop running by performing different interactive actions on the display device 200 . For example, the control device 100 may be provided with a lift function button. The lift function buttons include a "raise" button and a "lower" button. The user can control the lift assembly 291 to start running by pressing the "raise" button to raise the display. 260 height. And after starting the operation, the user can also press the "raise" button again or press the "lower" button to control the lifting assembly 291 to stop running.

The display device 200 can also support other types of interaction, and the user can control and adjust the lifting process through the corresponding interaction. In some embodiments, the display device 200 supports touch operations, that is, the display device 200 further includes a touch component, and the touch component is a touch panel disposed on the screen of the display 260 , which can detect the user's touch on the display 260 in real time. operate. The touch component is also connected to the controller 250 to send the detected touch operation signal to the controller 250 . The controller 250 then enables the user to complete different control operations through touch actions according to the interaction strategy preset in the operating system of the display device 200 .

Obviously, the user can control the lift assembly 291 to start/stop running through a specific touch action. For example, as shown in FIG. 10 , the user can click the height adjustment option through a touch operation in the setting interface presented by the display device 200 , and drag the activity logo on the pop-up height adjustment scroll bar to set the adjustment height. After the user performs the touch action, the controller 250 generates a lift command and sends it to the lift component 291 to control the lift component 291 to adjust the height of the display 260 .

It can be seen that the operation process of height adjustment through the setting interface is relatively complicated, so in some embodiments, the specified interactive control strategy can also be implemented by configuring specific program steps for the controller 250 of the display device 200 . That is, when the controller 250 determines that a specific touch action is input by the user, the controller 250 automatically controls the elevating component 291 to start or stop running to complete the touch height adjustment. As shown in Figure 11, it specifically includes the following:

A control instruction for adjusting the height of the display 260 input by the user is obtained. Wherein, the control instruction includes a multi-finger sliding action input through the touch component. For example, as shown in FIG. 12 and FIG. 13 , the multi-finger sliding action can be five-finger sliding, that is, when the user wants to adjust the height of the display 260, he can reach out and touch the screen of the display 260 and keep five fingers in contact with the screen of the display 260 all the time. At this time, the touch component can detect that the number of touch points in the user's touch action is 5, and determine that it is currently a 5-finger touch according to the number of touch points.

If the user keeps five fingers in constant contact with the display 260 and moves the palm up or down, the position of the touch point on the screen of the display 260 changes. Therefore, the touch component can detect that the touch action currently input by the user is a sliding action. The touch component then sends the detected touch action to the controller 250 , so that the controller 250 can obtain a control instruction for adjusting the height of the display 260 .

Obviously, the specific form of the multi-finger sliding action can be set according to the interaction strategy of the control system of the display device 200 . For example, the multi-finger sliding action may be two-finger sliding, three-finger sliding, four-finger sliding, and five-finger sliding. The multi-finger swipe action for the height adjustment function cannot be the same as the multi-finger swipe action for other functions to avoid control conflicts. For example, in the operating system of some display devices 200, the touch action of three-finger sliding is set as a screenshot function, and for such display devices 200, the height adjustment function cannot be realized by the three-finger sliding action.

In order to achieve more precise interactive control, in some embodiments, the control instruction for adjusting the height of the display 260 may also add a more detailed detection process based on the multi-finger sliding action. For example, only a multi-finger swipe action in an upward or downward direction is determined as a control command for adjusting the height of the display 260 . In this regard, after the user inputs the multi-finger sliding action, the controller 250 may further determine whether the multi-finger sliding action satisfies the lifting condition. For example, determine whether the moving distance of the five fingers is greater than 255px, and determine whether the sliding direction is the vertical direction, that is, whether the angle between the line connecting the starting point and the ending point of the sliding and the horizontal line is within the range of 80-100 degrees.

A long-press action can also be added before the multi-finger sliding action, that is, the user first touches the screen of the display 260 continuously with five fingers for 2 s, and then triggers the controller 250 to detect the subsequent sliding action, so as to improve the touch detection accuracy and alleviate misoperation.

After acquiring the control instruction for adjusting the height of the display 260, the controller 250 may detect the sliding distance and sliding direction corresponding to the control instruction in response to the control instruction. The sliding distance may be the real-time sliding distance of the user's finger, or may be the total sliding distance in the process of completing a multi-finger sliding action.

For the real-time sliding distance, the controller 250 can obtain the coordinates of each touch point from the touch component according to the set detection period after judging that the user inputs a multi-finger sliding action, and compare the coordinates of the touch point with the starting coordinates, Thereby, the sliding distance of the user's finger at different times is determined.

As for the total sliding distance, the controller 250 may determine the coordinates of the start point and the end point from the coordinates of the recorded touch point after the user's finger leaves the screen of the display 260 . Moreover, by comparing the coordinates of the starting point and the ending point, the total distance slid by the user in the entire multi-finger sliding process can be determined.

As shown in Figure 14, the sliding distance detected by the control command can be the actual distance D1 moved by the finger, that is, the vector sum of the horizontal distance D2 and the vertical distance D3; it can also be the distance that the finger moves in the height direction, that is, only includes Longitudinal distance D3. Obviously, for different sliding distances, different detection methods need to be adopted. For example, for the actual distance moved by the finger, the specific distance value needs to be determined by the trigonometric function relationship between the coordinates of the starting point and the ending point; and for the distance in the height direction, it is only necessary to compare the difference between the ordinates of the starting point and the ending point to determine the specific distance value. distance value.

The sliding direction can be determined by the relative orientation between the starting position and the ending position of the multi-finger sliding action of the user. For example, when the end position of the multi-finger sliding action is above the starting position, the sliding direction is upward; when the end position of the multi-finger sliding action is below the starting position, the sliding direction is downward.

Since the embodiment of the present application aims to adjust the height of the display 260, the horizontal direction may not be considered when determining the sliding direction. For example, when the user swipes up and left with five fingers inclined, the swipe direction is also determined to be upward. Correspondingly, when the controller 250 detects the sliding direction, it can only compare the longitudinal coordinates of the starting point position and the ending point position, and when the longitudinal coordinate of the ending point position is greater than the longitudinal coordinate of the starting point position, the sliding direction is determined to be upward; When the coordinate is smaller than the longitudinal coordinate of the starting point, the sliding direction is determined to be downward.

After detecting the sliding distance and the sliding direction from the control command, the controller 250 sends a lifting command to the lifting component according to the sliding distance, so as to control the lifting component to adjust the height of the display according to the sliding direction. For example, by detecting the control instruction, it is determined that the user's touch action is to slide up 8 cm, that is, the sliding direction is upward and the sliding distance is 8 cm. Therefore, the controller 250 can generate a lift command according to the detected sliding distance, and then send the lift command to the lift assembly 291 to control the lift assembly 291 to start running. For example, the lift command can control the drive motor of the lift assembly 291 to rotate forward for 80 revolutions, so as to raise the bracket 2911 by 8 cm and raise the height of the display 260 .

In the process of performing the lifting control through the multi-finger sliding touch operation, the controller 250 can control the lifting component 291 to raise or lower the height of the display 260 to be the same as the sliding distance in the multi-finger sliding operation, so as to obtain the following effect, that is, the user When the height you want to adjust is higher, you can slide a longer distance, and when the user wants to fine-tune the height of the display 260, you can slide a shorter distance.

However, when the height adjustment stroke of the lift assembly 291 is relatively large, the distance that the user needs to touch and slide on the display 260 is too long, which is inconvenient for the user to operate. Therefore, in some embodiments of the present application, as shown in FIG. 15 , the display device 200 can adjust the height of the display 260 in different ways according to different sliding distances input by the user. For example, when the sliding distance input by the user is relatively short, the raising or lowering distance of the display 260 can be set to be equal to the sliding distance input by the user, so as to realize a short-distance height adjustment; when the sliding distance input by the user is long, the lifting or lowering distance can be controlled. The assembly continues to raise or lower the height of the display 260 .

For this reason, in the step of sending a lifting instruction to the lifting component 291 according to the sliding distance, the controller 250 may also compare the sliding distance with the distance judgment threshold. The distance judgment threshold may be set to a specific value according to the screen size of the display 260 . For example, for a 65-inch monitor 260, the width and height of the monitor 260 are 1440×810mm, the distance judgment threshold can be set to 150mm, that is, the multi-finger sliding action whose sliding distance exceeds 150mm is judged as long-distance sliding, and the sliding distance does not exceed 150mm. A multi-finger swipe motion of 150mm is judged as a short-distance swipe.

For short-distance sliding, that is, the sliding distance is less than the distance judgment threshold, as shown in FIG. 16 , the controller 250 can send a lifting command with an adjustment height value to the lifting component 291 to control the adjustment height of the display 260 to be equal to the sliding distance. For example, when the multi-finger sliding action input by the user is to slide upward by 100 mm, it is parsed from the control instruction that the corresponding sliding distance is 100 mm, and the sliding direction is upward. Since the sliding distance of 100mm is less than the distance judgment value of 150mm, that is, it is determined that the multi-finger sliding action input by the current user is a short-distance sliding. Therefore, a lifting command including an adjustment height value of 100 mm can be generated, and the lifting command can be sent to the lifting component 291 to control the The lift assembly 291 drives the display 260 to rise by 100mm.

For long-distance sliding, that is, the sliding distance is greater than or equal to the distance judgment value, as shown in FIG. 17 , the controller 250 can send a lifting command with a continuous running command to the lifting component 291 to continuously raise or lower the display 260. high. For example, when the multi-finger sliding action input by the user is to slide upward by 200 mm, it is parsed from the control instruction that the corresponding sliding distance is 200 mm, and the sliding direction is upward. It can be seen that in this interaction process, the sliding distance of 200mm is greater than the distance judgment threshold of 150mm, that is, it is determined that the multi-finger sliding action input by the current user is a long-distance sliding, so the controller 250 can generate a lifting command for controlling the continuous operation of the lifting component 291. The lift command is sent to the lift assembly 291 , and the drive motor of the lift assembly 291 continues to rotate after receiving the lift command to continuously raise the height of the display 260 .

It can be seen from the above technical solutions that, in this embodiment, the controller 250 of the display device 200 can determine whether the user's multi-finger sliding action is one of short-distance sliding or long-distance sliding, so that when the user inputs different sliding distances , using different height adjustment methods, which can not only satisfy the followability of short-distance sliding, but also enable the user to complete the touch operation within a suitable range, and improve the interaction mode of the user's input of a sliding distance that is too long or repeated input multiple times. Improve user experience.

Obviously, when the lifting command sent by the controller 250 to the lifting assembly 291 includes a command for controlling continuous operation, the lifting assembly 291 cannot permanently drive the display 260 to move. The operation state is judged by the controller 250 or actively inputted by the user, and the lifting assembly 291 is controlled to stop running. That is, as shown in FIG. 18 , in some embodiments, after the step of sending a lifting instruction with a continuous running command to the lifting assembly 291 , the controller 250 may receive a stop input for controlling the lifting assembly 291 to stop running. command, and in response to the stop command, the lifting assembly 291 is controlled to stop running. Wherein, the stop instruction is a multi-finger touch action input by the user through the touch component.

For example, after the user triggers the lift assembly 291 to continuously raise the height of the display 260 upward by sliding up 200mm with five fingers, the user's hand can leave the screen of the display 260 and wait for the height of the display 260 to rise. When the display 260 rises to an appropriate height, the user can touch the screen of the display 260 with five fingers again to input a stop command for controlling the lifting assembly 291 to stop running. At this time, the controller 250 may send a command to control the driving motor to stop running to the lifting component 291 in response to the stop command, so as to control the touch component 291 to stop running and maintain the display 260 at a suitable height.

It can be seen that through the above touch interaction process, the user can trigger the continuous raising and lowering of the display 260 through a long-distance multi-finger sliding motion, and then control the raising and lowering through the multi-finger touch operation, so that the display device 200 can be adjusted to any height within the effective stroke. At the same time, the multi-finger sliding action and the multi-finger touch action are two similar touch interaction actions, and the similar interaction actions can facilitate the user to operate continuously, facilitate the user's memory, enable the user to quickly complete the interaction action input, and improve the user experience.

The user may not input a stop instruction after inputting a long-distance multi-finger sliding motion, that is, not inputting a multi-finger touch motion. Therefore, in order to be able to control the lifting assembly 291 to stop running, as shown in FIG. 19 , in some embodiments, after the step of sending a lifting command with a continuous running command to the lifting assembly 291 , the controller 250 can also receive the information sent by the lifting assembly 291 The height information detected by the middle limiter is used to determine whether the current display 260 is adjusted to the limit height according to the detected height information, so as to determine whether to stop the operation of the lift assembly 291 .

Depending on the type of the stopper, the height information that can be detected by the stopper is also different. For example, if the limiter is an infrared proximity switch disposed at the end of the guide mechanism 2912, when the bracket 2911 reaches the end of the guide mechanism 2912, the infrared proximity switch can detect that the infrared signal is blocked, that is, generate an electrical signal. The infrared proximity switch then sends the generated electrical signal to the controller 250 . The controller 250 can determine whether the current display 260 has reached the limit height whether it receives the electrical signal sent by the infrared proximity switch.

When the infrared proximity switch detects that the bracket 2911 has not reached the end of the guide mechanism 2912, it is determined that the height information is that the current display 260 has not reached the limit height, and the controller 250 may not send any instruction to the lifting assembly 291 to keep the lifting assembly 291 running ; When the infrared proximity switch detects that the bracket 2911 reaches the end of the guide mechanism 2912, that is, the height information is that the current display 260 reaches the limit height, the controller 250 can generate a stop command, and send the stop command to the lift assembly 291 to control the lift Component 291 stops functioning.

The limiter can realize automatic stop of operation after the display 260 is adjusted to the limit height, avoid excessive travel, and relieve the lifting assembly 291 from being damaged by collision during operation. In addition, after the display device 200 controls the lifting assembly 291 to automatically stop running through the limiter, it can also control the display 260 to display a prompt screen indicating that the limit height has been reached. For example, as shown in FIG. 20, after the lift assembly 291 automatically stops running, a prompt text box may pop up in the user interface currently displayed on the display 260, and the text box may include "already the highest (or lowest)" to prompt the user that the current The height adjustment process is complete.

As can be seen from the above technical solutions, after the user inputs a long-distance multi-finger sliding command, the lift assembly 291 can drive the display 260 to move continuously until the user inputs a stop command through a multi-finger touch action or the display 260 is adjusted to the limit height and then stops. Therefore, the user can realize the control of the lifting process at a long distance without keeping the sliding for an excessively long distance.

In the process of lift adjustment, due to the influence of objects in the environment, it can cause abnormal blocking within the effective range of travel. For example, when the user controls the lift assembly 291 to lower the height of the display 260 , there may be items such as desktops, ornaments, etc. under the display 260 to prevent the display 260 from continuing to move downward. At this time, the drive motor in the lift assembly 291 cannot continue to rotate, and if the motor is still controlled to rotate, the motor is likely to be burned out.

To this end, as shown in FIG. 21 , in some embodiments, the display device 200 or the lift assembly 291 may further include a sensor element for detecting whether the display 260 is blocked, such as a speed sensor or the like. After the sensor detects that the movement of the display 260 is blocked, an electrical signal can be fed back to the controller 250, so that the controller 250 stops controlling the rotation of the motor in time. That is, after the step of sending a lift command to the lift assembly according to the sliding distance, the controller 250 can also detect the height adjustment speed of the display through the lift assembly.

Among them, the height adjustment speed can be obtained by calculating the distance value detected by the grating distance sensor and the time spent adjusting to the distance value. Since the speed of the driving motor of the lift assembly 291 is relatively stable except for a short time of starting and stopping, that is, the height adjustment speed is stable. When the display 260 is blocked, the adjustment speed of the display 260 is bound to decrease. Therefore, it can be determined whether the display 260 is blocked by detecting the change of the height adjustment speed. Similarly, the height adjustment speed can also be detected by the angular velocity sensor set at the motor shaft.

When the height adjustment speed detected by the sensor is less than the preset speed threshold, it can be determined that the movement process of the display 260 may be blocked, so the controller 250 can send a stop instruction to the lift assembly 291 to control the lift assembly 291 to stop running to avoid prolonged operation. Stalled rotor damages the drive motor. For example, when there is no obstruction, the moving speed at which the lift assembly 291 drives the display 260 is 0.06 m/s on average, and the preset speed threshold can be 0.05 m/s. When it is detected that the height adjustment speed is 0 m/s, it can be determined that the current display 260 may be blocked. At this time, the controller 250 may send a stop instruction to the lift assembly 291 to control the motor in the lift assembly 291 to stop running.

It should be noted that, in order to prevent the operation speed during startup from affecting the detection process of the blocking abnormality, in this embodiment, the above program steps may also be set to delay startup. For example, if the adjustment speed of the display 260 can reach a stable state within 2s, the detection of the height adjustment speed can be started after the raising/lowering speed of the display 260 reaches a stable value, that is, after the start command is sent to the lifting component 291 for 2s .

In addition, after it is detected that the display 260 is blocked and the operation of the lifting assembly 291 is stopped, the display 260 can also be controlled to display a prompt screen indicating abnormal blocking. For example, as shown in FIG. 22, after the control lift assembly 291 stops running, a prompt text box may pop up in the user interface currently displayed on the display 260, and the text content is "Detection of obstruction, can not continue to lower (or raise)" , to prompt the user to deal with the abnormal situation in time.

In the above embodiment, the user can input control instructions through a multi-finger sliding touch action, so that the display device 200 can adjust the height of the display 260 according to the sliding distance and sliding direction in the multi-finger sliding action. Since the multi-finger sliding action includes multiple touch points and is affected by the user in different operation processes, there are some differences in the sliding distance and sliding direction corresponding to different touch points.

Therefore, in order to overcome the difference caused by the multi-touch action to detect the sliding distance and the sliding direction from the control command, in some embodiments, in the step of detecting the sliding distance and the sliding direction in the control command, the controller 250 The touch position coordinates can be obtained from the control command first. Wherein, the touch position coordinates include start coordinates and end coordinates of multiple touch points during the sliding touch process.

In the actual detection process, the touch component may continuously send the coordinates of the touch position detected in the touch process to the controller 250 according to the set frequency. The controller 250 can record the coordinates of the touch position and detect the corresponding touch action. Therefore, the controller 250 may use the touch position coordinates recorded at the start of the touch as the start point coordinates, and use the new touch position coordinates as the end point coordinates as the touch process continues until the touch action ends.

After determining that the touch action ends, the controller 250 can compare the ordinate values in the coordinates of the start point and the coordinates of the end point to obtain the sliding direction. For example, when the ordinate value of the start point coordinate is greater than the ordinate value of the end point coordinate, the sliding direction can be determined to be downward; when the ordinate value of the start point coordinate is smaller than the ordinate value of the end point coordinate, the sliding direction can be determined to be upward.

While determining the sliding direction, the controller 250 can also calculate the difference between the ordinate values in the coordinates of the start point and the end point according to the recorded touch position coordinates, and calculate the average value of the ordinate difference values of the multiple touch points, to get the sliding distance. For example, during the user's five-finger sliding operation, the controller 250 records the coordinates of the five starting points as (x1, y1), (x2, y2), (x3, y3), (x4, y4), and (x5, y5); the coordinates of the end points are (x1', y1'), (x2', y2'), (x3', y3'), (x4', y4'), (x5', y5'). Calculate the ordinate difference values of the five touch points respectively, then the difference values Δy1=y1'-y1, Δy2=y2'-y2, Δy3=y3'-y3, Δy4=y4'-y4, Δy5=y5'- y5. Finally, the sliding distance can be obtained by calculating the average value of the five ordinate differences, that is, the sliding distance D=(Δy1+Δy2+Δy3+Δy4+Δy5)/5.

It can be seen that by calculating the average value of the sliding distances of multiple touch points, the influence of the palm shape and the input action difference on the sliding distance detection process can be reduced, and the accuracy of the detection process can be improved.

In the above-mentioned embodiment, the touch position coordinates sent by the touch component to the controller 250 are generally expressed in units of pixels, so the sliding distance obtained by detection is generally expressed in units of pixels. However, for displays 260 with different resolutions, the actual distances corresponding to the same number of pixels may be different. Therefore, in the process of adjusting the height of the display 260 according to the sliding distance, the height adjustment distances corresponding to the sliding distances of the same number of pixels are different. Some display apparatuses 200 are prone to reduce the followability of the height adjustment process.

To this end, in some embodiments, the sliding distance may be represented by the actual distance, that is, in the step of detecting the sliding distance and sliding direction in the control instruction, the controller 250 may first obtain the screen size and display resolution of the display 260 . The screen size and display resolution can be obtained by reading the device information of the display device 200, or the physical resolution of the model of the display device 200 can be obtained through a specific interface. For example, the resolution of a 65-inch 4K monitor 260 is 3840×2160, and the corresponding screen size is 1440×810mm.

After acquiring the screen size and display resolution, the controller 250 may calculate the pixel ratio according to the screen size and display resolution. Wherein, the pixel ratio is used to represent the actual distance corresponding to each pixel point. For example, in the height direction, the pixel ratio is 810/2160=0.375mm/pix, that is, the actual distance corresponding to one pixel is 0.375mm.

Then, the absolute distance value of the sliding distance is calculated according to the pixel ratio, so as to adjust the height of the display 260 according to the absolute distance value. For example, when the detected sliding distance is 800 pixels, the corresponding actual distance is 0.375×800=300mm. That is, the sliding distance of the multi-finger sliding action of the user is 300mm.

By controlling the lifting process of the display 260 by the actual distance, the height of the display 260 can be adjusted according to the actual sliding distance when inputting multi-finger sliding actions on the display 260 of different resolutions, ensuring the followability of the adjustment process and improving the user experience.

In some embodiments, in order to be able to accurately distinguish the touch command for adjusting the height of the display 260 from the multi-finger sliding command of other functions, a pre-judgment process may also be added to the touch command, that is, the control command also includes a touch control component. Enter the multi-finger long press action. For example, in the actual interaction process, the user may first touch the screen of the display 260 with five fingers for a period of time to trigger the controller 250 to detect the multi-finger sliding action.

Therefore, in the step of acquiring the control instruction for adjusting the height of the display 260 input by the user, the controller 250 may first detect the duration of the multi-finger long press action. When the duration of the long-pressing action is greater than or equal to the time judgment threshold, the controller 250 is triggered to detect the sliding distance and sliding direction of the subsequent multi-finger sliding action, so as to control the lifting component 291 to start running, so as to drive the display 260 to the same direction as the sliding direction Movement to adjust the height of the display 260.

Among them, in order to facilitate the user's operation, the time judgment threshold should not be set too long or too short. For example, the time judgment threshold can be set to 2s. After the user's five fingers touch continuously for more than 2s, it is determined that the user wants to adjust the height of the display 260. Therefore, The recording program can be started to record the coordinates of the starting point and the ending point in the subsequent five-finger sliding process, so as to detect the sliding distance and the sliding direction.

After the user inputs the multi-finger long press instruction, the display device 200 may further display, through the display 260, a prompting interface for prompting the input of a sliding touch action. The prompt interface may be a pattern, animation, or text suspended on the current user interface, which is used to prompt the user to complete the subsequent multi-finger sliding action. For example, as shown in Figure 23, after the user's five fingers touch continuously for more than 2s, the hand pattern and prompt text can be displayed based on the touch position, such as "slide up with five fingers to raise the screen" and "slide down with five fingers to lower the screen" , prompting the user to complete the multi-finger swipe action.

In addition, if the user does not continue to input the multi-finger sliding action after inputting the multi-finger long press command, it can be determined that the user does not want to adjust the height of the display 260, so the controller 250 will not send the lifting and lowering command to the lifting component 291, and can be used when the user's finger leaves After the screen is displayed on the display 260, the prompt interface for prompting the input of the sliding touch action can be cancelled, and the display of the original user interface can be continued.

It can be seen that this embodiment can complete the judgment of the height adjustment control instruction through the combination of two-stage touch interaction operations, so that the display device 200 can more accurately judge whether the user adjusts the height of the display 260, reduce user misoperations, and improve user experience.

In the above-mentioned embodiment, the height adjustment of the display 260 can be completed by the lift assembly 291 , and the lift assembly 291 can be an internal component of the display device 200 or an external accessory of the display device 200 . When the lift assembly 291 is used as an external accessory, the display device 200 needs to further include an external device interface 240 or a communicator 220 , and the external device interface 240 and the communicator 220 are used to connect the lift assembly 291 .

In some embodiments, as shown in FIG. 24 , for the display device 200 in the form of an external accessory, when adjusting the height of the display 260 , it is also necessary to determine whether the lift assembly 291 is connected to the display device 200 . That is, after obtaining the control instruction for adjusting the height of the display input by the user, the controller 250 may first detect the connection state of the lift assembly 291 .

The connection state can be detected in different ways according to the different connection ways between the lift assembly 291 and the display device 200 . For example, when the lift assembly 291 is connected to the display device 200 through Bluetooth, the controller 250 may determine whether to connect the lift assembly 291 by detecting the Bluetooth pairing status of the display device 200 . When the lift assembly 291 is connected to the display device 200 through the external device interface 240 , the controller 250 may determine whether to connect the lift assembly 291 by detecting the device access condition of the external device interface 240 .

If the connection state is that the lift assembly 291 is connected, the step of detecting the sliding distance and the sliding direction in the control instruction can be performed; if the connection state is that the lift assembly 291 is not connected, the display 260 can be controlled to display A prompt screen prompting the connection of the lift assembly 291. For example, as shown in FIG. 25 , the controller 250 obtains a list of Bluetooth devices and traverses the lifting component 291 from the list of Bluetooth devices. When the lift assembly 291 does not exist in the Bluetooth device list, it is determined that the connection status is that the lift assembly 291 is not connected, and a text box can pop up in the currently displayed user interface, including the text content "Please connect the lift frame" to prompt the user to connect the lift Component 291.

It can be seen from the above embodiments that, based on the display device provided by the embodiments of the present application, the user can control the rotation or elevation of the display by inputting a predetermined gesture for controlling the rotation or elevation of the display, so that the user can more conveniently operate the rotation and elevation of the display. Save user operations and improve user experience.

It should be noted that the user gesture includes a touch gesture collected based on a touch component and an air gesture collected from a user image collected by a camera. Based on the idea of controlling the rotation and/or raising/lowering of the display device through touch gestures in the embodiments of the present application, those skilled in the art can obtain the technology of controlling the rotation and/or raising/lowering of the display device through air gestures without any creative effort. Program.

Based on the display device provided by the embodiment of the present application, the embodiment of the present application also provides some display device control methods. As shown in FIG. 26 , the method may include:

S261, receiving an input user gesture.

S262, if the user gesture is a predetermined rotation gesture, control the rotation component to drive the display to rotate according to the user gesture.

In some embodiments, if the user gesture is a synchronously input single-finger continuous fixed contact and a multi-finger arc sliding contact, it is determined that the user gesture is a predetermined rotation gesture. For example, Figures 6 to 8 correspond to the user gestures introduced in the embodiments.

In other embodiments, if the user gesture is a synchronously input single-point continuous fixed contact and a multi-finger arc sliding contact, and the angle corresponding to the multi-finger arc sliding contact is greater than a preset angle, it is determined that the user The gesture is a predetermined rotation gesture.

In some embodiments, if the sliding direction of the multi-finger arc sliding contact is clockwise, the rotating component is controlled to drive the display to rotate 90° in the clockwise direction; if the multi-finger arc sliding contact If the sliding direction is counterclockwise, the rotating component is controlled to drive the display to rotate 90° in the counterclockwise direction.

S263, if the user gesture is a predetermined lift gesture, control the lift component to drive the display to rise or fall according to the user gesture.

In some embodiments, if the user gesture is a multi-finger linear sliding contact and the sliding direction of the multi-finger linear sliding contact matches the vertical direction, it is determined that the user gesture is a predetermined lift gesture. For example, FIGS. 12-13 correspond to the user gestures shown in the embodiment.

In some embodiments, if the sliding direction of the multi-finger linear sliding contact matches the upward direction, the lifting component is controlled to drive the display to rise; if the sliding direction of the multi-finger linear sliding contact matches the downward direction If the directions are matched, the lifting assembly is controlled to drive the display to descend.

In addition, according to the preset correspondence between the sliding distance and the lifting distance, the lifting distance corresponding to the sliding distance of the multi-finger linear sliding contact is determined; the lifting component is controlled to drive the display to rise or fall by the lifting distance.

In a specific implementation, the present application also provides some non-volatile computer storage media, wherein the computer storage medium can store a program, and when the program is executed, it can include some or all of the steps in the various embodiments of the method provided by the present application, When the controller 250 of the display device provided by the present application executes the computer program instructions, the controller 250 performs the steps in which the controller 250 is configured as described in the present application. The storage medium may be a magnetic disk, an optical disk, a read-only memory (English: read-only memory, abbreviated as: ROM) or a random access memory (English: random access memory, abbreviated as: RAM) and the like.

For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussions are not intended to be exhaustive or to limit implementations to the specific forms disclosed above. Numerous modifications and variations are possible in light of the above teachings. The above embodiments are chosen and described to better explain the principles and practical applications, so as to enable those skilled in the art to better utilize the described embodiments and various modified embodiments suitable for specific use considerations.

Claims

A display device comprising:

monitor,

at least one of a rotating assembly and a lifting assembly, the rotating assembly is used to drive the display to rotate, and the lifting assembly is used to drive the display to rise and fall;

a touch component, configured to detect a touch action input by a user;

Controller, configured as:

Receive control instructions input on the touch component through user gestures;

If the user gesture is a predetermined rotation gesture, controlling the rotation component to drive the display to rotate according to the user gesture;

If the user gesture is a predetermined lifting gesture, the lifting component is controlled to drive the display to rise or fall according to the user gesture.
The display device of claim 1, the controller configured to:

If the user gesture is a synchronously input single-finger continuous fixed contact and multi-finger arc sliding contact, determine that the user gesture is a predetermined rotation gesture;

If the user gesture is a multi-finger linear sliding contact and the sliding direction of the multi-finger linear sliding contact matches the vertical direction, it is determined that the user gesture is a predetermined lift gesture.
The display device of claim 1, the controller further configured to:

obtaining a control instruction input by the user for adjusting the height of the display, where the control instruction includes a multi-finger sliding action input through the touch component;

In response to the control instruction, detecting the sliding distance and sliding direction in the control instruction;

According to the sliding distance, a lifting instruction is sent to the lifting assembly to control the lifting assembly to adjust the height of the display according to the sliding direction.
The display device according to claim 3, in the step of sending a lifting instruction to the lifting component according to the sliding distance, the controller is further configured to:

Compare the sliding distance with the distance judgment threshold;

If the sliding distance is less than the distance judgment threshold, sending a lifting instruction with an adjustment height value to the lifting component, so as to control the adjustment height of the display to be equal to the sliding distance;

If the sliding distance is greater than or equal to the distance judgment value, a lift command with a continuous operation command is sent to the lift assembly to continuously raise or lower the height of the display.
The display device according to claim 4, after the step of sending a lift command with a continuous operation command to the lift assembly, the controller is further configured to:

receiving a stop command input by the user for controlling the lifting component to stop running, the stop command being a multi-finger touch action input by the user through the touch component;

In response to the stop instruction, the lifting assembly is controlled to stop running.
The display device according to claim 4, after the step of sending a lift command with a continuous operation command to the lift assembly, the controller is further configured to:

receiving the height information detected by the limiter in the lifting assembly;

If the height information is that the current display does not reach the limit height, control the lifting assembly to continue to run;

If the height information is that the current display reaches the limit height, the lifting assembly is controlled to stop running, and the display is controlled to display a prompt screen indicating that the limit height has been reached.
The display device according to claim 3, in the step of detecting the sliding distance and the sliding direction in the control instruction, the controller is further configured to:

Acquiring touch position coordinates from the control instruction, where the touch position coordinates include start coordinates and end coordinates of multiple touch points in the sliding touch process;

Comparing the ordinate values in the coordinates of the start point and the coordinates of the end point to obtain the sliding direction;

Calculate the difference between the ordinate values of the start point coordinate and the end point coordinate, and calculate the average value of the ordinate difference values of multiple touch points to obtain the sliding distance.
The display device according to claim 3, in the step of detecting the sliding distance and the sliding direction in the control instruction, the controller is further configured to:

Obtain the screen size and display resolution of the display;

Calculate a pixel ratio according to the screen size and the display resolution, where the pixel ratio is used to represent the actual distance corresponding to each pixel;

According to the pixel ratio, an absolute distance value of the sliding distance is calculated to adjust the height of the display according to the absolute distance value.
The display device according to claim 3, after the step of sending a lifting instruction to the lifting component according to the sliding distance, the controller is further configured to:

Detecting the height adjustment speed of the display by the lift assembly;

If the height adjustment speed is less than a preset speed threshold, controlling the lifting assembly to stop running;

The control display displays a prompt screen for indicating abnormal blocking.
The display device according to claim 3, wherein the control instruction further comprises a multi-finger long press action input through the touch component; in the step of acquiring the control instruction input by the user for adjusting the height of the display, the controller is further Configured as:

Detect the duration of the multi-finger long press;

If the duration is greater than or equal to the time judgment threshold, the display is controlled to display a prompt interface for prompting input of a sliding touch action.
The display device according to claim 3, wherein the control instruction further comprises a multi-finger long press action input through the touch component; in the step of acquiring the control instruction input by the user for adjusting the height of the display, the controller is further Configured as:

Detect the duration of the multi-finger long press;

If the duration is greater than or equal to the time judgment threshold, the display is controlled to display a prompt interface for prompting input of a sliding touch action.
The display device of claim 1, the controller further configured to:

If the user gesture is a predetermined trigger gesture, displaying a preset picture on the top layer of the user interface to cover the graphical interaction object in the user interface;

And, when it is determined that the user gesture is not the predetermined rotation gesture or the predetermined lift gesture, or when it is detected that the user's contact with the display is disconnected, the preset picture is canceled.
A touch lifting method is applied to a display device, the display device includes a display, a touch component, a lifting component and a controller, and the touch lifting method includes:

obtaining a control instruction input by the user for adjusting the height of the display, where the control instruction includes a multi-finger sliding action input through the touch component;

In response to the control instruction, detecting the sliding distance and sliding direction in the control instruction;

According to the sliding distance, a lifting instruction is sent to the lifting assembly to control the lifting assembly to adjust the height of the display according to the sliding direction.