WO2022001855A1

WO2022001855A1 - Display device and image cropping method

Info

Publication number: WO2022001855A1
Application number: PCT/CN2021/102290
Authority: WO
Inventors: 吴汉勇; 贾亚洲; 张安祺; 初德进; 司洪龙; 甄凌云; 刘清友; 李晓平; 陈许; 王之奎; 王秉清; 马会会; 于硕; 刘晋
Original assignee: 海信视像科技股份有限公司
Priority date: 2020-06-29
Filing date: 2021-06-25
Publication date: 2022-01-06
Also published as: CN116391155A; CN116391156A; WO2022001853A1; CN116391357A; WO2022001854A1; CN117012099A

Abstract

Disclosed are a display device and an image cropping method. The display device comprises: a projection assembly; a screen, which is configured to be capable of curling up and down; a driving assembly, which is used for driving the screen so that same is unfolded or curled; a monitoring assembly, which is used for monitoring state information of the screen during the unfolding or curling process, and feeding back the state information of the screen to a controller; and the controller, which is used for executing: during the process of the screen being unfolded or curled according to a preset speed curve, and the projection assembly projecting a preset image according to a preset height curve, determining the current height of the screen according to the state information of the screen; if the current height of the screen is lower than the display height of the preset image, dividing the preset image into a first image and a second image according to the current height of the screen, wherein the height of the second image is not greater than the current height of the screen; and controlling the projection assembly to project the preset image, such that the screen only displays the second image.

Description

Display device and image cropping method

This application is required to be submitted on March 19, 2021, the application number is 202110296908.1, and the application name is "a display device"; submitted on March 19, 2021, the application number is 202110298436.3, and the application name is "a display device" equipment"; submitted on March 19, 2021, application number 202110298513.5, application name "projection component calibration method for display equipment and display equipment"; submitted on March 19, 2021, application number 202110298485.7, application The name is "screen correction method and display device for display devices; submitted on March 19, 2021, application number 202110297021.4, and the application name is "a display device; submitted on June 29, 2020, application number is 202010603016.7, the priority of the Chinese patent application entitled "A Display Device", the entire contents of which are incorporated in this application by reference.

technical field

The present application relates to the technical field of display devices, and in particular, to a display device and an image cropping method.

Background technique

Laser TV is a TV product that uses a laser light source as a display light source and cooperates with projection display technology to form images. It is equipped with a special projection screen and can receive radio TV programs or Internet TV programs. In addition to using a top-to-bottom screen, the laser TV also uses a bottom-up screen from the TV cabinet. The latter specifically sets the optical machine and the lifting screen in the TV cabinet. When the TV is turned on, the screen is removed from the TV cabinet. The middle slowly rises, and the image of the optical machine will hit the global position behind.

SUMMARY OF THE INVENTION

Some embodiments of the present application provide a display device, including:

Projection component;

The screen, which is configured to be rolled up and down;

a driving component for driving the screen to unfold or curl;

a monitoring component for monitoring state information during the unfolding or rolling of the screen, and feeding back the state information of the screen to the controller;

Controller, which executes:

During the process that the screen is unfolded or curled according to the preset speed curve and the projection component projects the preset image according to the preset height curve, the height of the current screen is determined according to the status information of the screen;

If the height of the current screen is lower than the display height of the preset image, the preset image is divided into a first image and a second image according to the height of the current screen, and the height of the second image is not greater than the height of the current screen;

The projection component is controlled to project a preset image, so that the screen only displays the second image.

In some embodiments, the controller is further configured to perform:

If the height of the screen is not lower than the display height of the preset image, continue to unfold or curl the screen according to the preset speed curve and project the preset image according to the preset height curve.

In some embodiments, the controller controls the projection component to project a preset image in the following manner, so that the screen only displays the second image:

Set a floating layer window with a black interface loaded on the upper layer of the first image, or set the pixels of the first image to be black to obtain a processed preset image;

The projection component is controlled to project the processed preset image.

In some embodiments, the state information of the screen includes the number of rotations of the driving component or the image information of the screen, and the controller determines the height of the current screen according to the state information of the screen in the following manner:

Calculate the height of the current screen according to the number of rotations of the drive assembly;

Or, the height of the current screen is determined according to the image information of the screen.

In some embodiments, the controller is used to perform:

If the height of the current screen is lower than the display height of the preset image, the preset image is cropped into a first image and a second image according to the height of the current screen, and the height of the first image is not greater than the height of the current screen;

Coordinate conversion processing is performed on the first image, so that the screen displays the first image.

In some embodiments, the controller is further configured to perform:

In some embodiments, the state information of the screen includes the number of rotations of the driving component, and the controller performs the following manner to determine the height of the current screen according to the state information of the screen:

The height of the current screen is calculated according to the number of rotations of the driving assembly.

In some embodiments, the state information of the screen includes image information of the screen, and the controller determines the height of the current screen according to the state information of the screen in the following manner:

The height of the current screen is determined according to the image information of the screen.

In some embodiments, the controller is used to perform:

During the process that the screen is unfolded according to the preset speed curve, the keys and sounds are shielded;

When it is detected that the height of the screen reaches the preset height, the projection component is controlled to project the preset image according to the preset height curve and release the button and sound shielding;

If the height of the screen is lower than the display height of the preset image, the preset image is divided into a first image and a second image according to the height of the current screen, and the height of the second image is not greater than the height of the current screen;

In some embodiments, the controller is used to perform:

Some embodiments of the present application provide an image cropping method, which is applied to the above-mentioned display device, and the method includes:

In some embodiments, including:

The projection component is controlled to project the processed preset image.

In some embodiments, including:

The status information of the screen includes the number of rotations of the driving assembly or the image information of the screen, and the height of the current screen is calculated according to the number of rotations of the driving assembly; or, the height of the current screen is determined according to the image information of the screen .

In some embodiments, including:

The status information of the screen includes the number of rotations of the driving assembly, and the current height of the screen is calculated according to the number of rotations of the driving assembly.

In some embodiments, including:

Description of drawings

FIG. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to one or more embodiments of the present application;

FIG. 2 is a block diagram of a hardware configuration of a display device 200 according to one or more embodiments of the present application;

FIG. 3 is a block diagram of the hardware configuration of the control device 100 according to one or more embodiments of the present application;

FIG. 4 is a schematic diagram of software configuration in a display device 200 according to one or more embodiments of the present application;

5A-5B are schematic structural diagrams of a curling laser device according to one or more embodiments of the present application;

6-8 are schematic diagrams of components of a curling laser device according to one or more embodiments of the present application;

9 is a schematic diagram of image projection according to one or more embodiments of the present application;

10A-10B are schematic diagrams of software of a curling laser device according to one or more embodiments of the present application;

11-13, 14A-14B, 15, 16A-16C and 17 are schematic diagrams of image cropping according to one or more embodiments of the present application;

18 is a schematic diagram of a display interface according to one or more embodiments of the present application;

19 is a schematic diagram of a preset speed curve according to one or more embodiments of the present application;

20 is a schematic diagram of a speed curve provided according to one or more embodiments of the present application;

FIG. 21 is a flowchart of exception handling provided according to one or more embodiments of the present application;

22-23 are schematic diagrams of user interfaces according to one or more embodiments of the present application;

24 is a schematic diagram of a speed curve according to one or more embodiments of the present application;

FIG. 25 is a flowchart of exception handling according to one or more embodiments of the present application.

detailed description

In order to make the objectives, implementations and advantages of the present application clearer, the exemplary embodiments of the present application will be described clearly and completely below with reference to the accompanying drawings in the exemplary embodiments of the present application. Obviously, the exemplary embodiments described It is only a part of the embodiments of the present application, but not all of the embodiments.

Based on the exemplary embodiments described in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the appended claims of this application. Furthermore, although the disclosures in this application have been presented in terms of illustrative example or instances, it should be understood that various aspects of this disclosure may also constitute a complete embodiment in isolation. It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the embodiments described below, rather than intended to limit the embodiments of the present application. Unless otherwise specified, these terms are to be understood according to their ordinary and ordinary meanings.

FIG. 1 is a schematic diagram of an operation scenario between a display device and a control device according to one or more embodiments of the present application. As shown in FIG. 1 , a user can operate the display device 200 through a mobile terminal 300 and the control device 100 . The control apparatus 100 may be a remote control, and the communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, and wireless or other wired ways to control the display device 200 . The user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, and the like. In some embodiments, mobile terminals, tablet computers, computers, notebook computers, and other smart devices may also be used to control the display device 200 .

In some embodiments, the mobile terminal 300 may install a software application with the display device 200 to implement connection communication through a network communication protocol, so as to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 may also be transmitted to the display device 200 to realize a synchronous display function. The display device 200 also performs data communication with the server 400 through various communication methods. The display device 200 may be allowed to communicate via local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200 . The display device 200 may be a liquid crystal display, an OLED display, or a projection display device. The display device 200 may additionally provide an intelligent network television function that provides a computer-supported function in addition to the function of broadcasting and receiving television.

FIG. 2 exemplarily shows a configuration block diagram of the control apparatus 100 according to an exemplary embodiment. As shown in FIG. 2 , the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory, and a power supply. The control device 100 can receive the user's input operation instruction, and convert the operation instruction into an instruction that the display device 200 can recognize and respond to, and play an intermediary role between the user and the display device 200 . The communication interface 130 is used for external communication, and includes at least one of a WIFI chip, a Bluetooth module, NFC or an alternative module. The user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, a key or an alternative module.

FIG. 3 is a block diagram showing a hardware configuration of the display apparatus 200 according to an exemplary embodiment. As shown in FIG. 3, the display device 200 includes a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface 280. at least one. The controller includes a central processing unit, a video processing unit, an audio processing unit, a graphics processing unit, a RAM, a ROM, and a first interface to an nth interface for input/output. The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen. The tuner-demodulator 210 receives broadcast television signals through wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals. The detector 230 is used to collect external environment or external interaction signals. The controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

In some embodiments, the controller 250, through various software control programs stored on the memory, controls the operation of the display device and responds to user operations. The controller 250 controls the overall operation of the display apparatus 200 . A user may input a user command on a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.

In some embodiments, a "user interface" is a medium interface for interaction and information exchange between an application program or an operating system and a user, which enables conversion between an internal form of information and a form acceptable to the user. The commonly used form of user interface is Graphical User Interface (GUI), which refers to a user interface related to computer operations displayed in a graphical manner. It can be an icon, window, control and other interface elements displayed on the display screen of the electronic device, wherein the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets, etc. at least one of the visual interface elements.

FIG. 4 is a schematic diagram of software configuration in the display device 200 according to one or more embodiments of the present application. As shown in FIG. 4 , the system is divided into four layers. Layer"), the Application Framework layer (referred to as the "framework layer"), the Android runtime (Android runtime) and the system library layer (referred to as the "system runtime layer"), and the kernel layer. The kernel layer contains at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive etc.

Documents to be applied for earlier, application date: February 5, 2020, application number: 202010115288.2, name: laser projection system, rising and falling control method of projection screen; application date: February 5, 2020, application number: 202010115275.5 , Name: Laser projection system, rising and falling control method of projection screen; Application date: February 5, 2020, Application number: 202010115286.3, Name: Laser projection system, rising and falling control method of projection screen; Application date: 2020 On November 27, 2019, the application number: 202011364537.8, the title: projection equipment, is incorporated in this application in its entirety.

5A-5B are schematic structural diagrams of a curling laser device according to one or more embodiments of the present application, and FIGS. 6-8 are schematic diagrams of components of a curling laser device according to one or more embodiments of the present application; FIGS. 5A and 5B 6. As shown in FIG. 6, the rolling screen 275 in this embodiment can be driven by the driving component 276 to complete the rolling or extending action. The drive assembly 276 includes a plurality of sets of lift assemblies and beams 231, each set of lift assemblies includes a lift frame 232, a lift motor 233 and a reduction gear set 234; the first end of the lift frame 232 is rotatably connected to the base 21, and the first end of the lift frame 232 The two ends are rotatably connected to the beam 231 , the reduction gear set 234 is respectively connected to the lift motor 233 and the lift frame 232 , the second side of the curling screen 275 is fixedly connected to the beam 231 ; the lift motor 233 can drive the lift frame through the reduction gear set 234 When the lift frame 232 is lifted, the beam 231 is supported to unwind and roll the screen 275 . The lift motor 233 and the reduction gear set 234 are fixed on the base 21 , and the reduction gear set 234 is fixedly connected to the first end of the lift frame 232 . The gears included in the reduction gear set 234 are rotatably fixed on the base 21 through the gear bracket, or the gears in the reduction gear set 234 except the gears connected with the lift frame 232 and/or the lift motor 233 can be rotatably fixed on the base 21 through the gear bracket. It is rotatably fixed on the base 21 .

In some embodiments, the curling screen 275 can be in three states: the first is that the curling screen 275 needs to be curled up in a non-playing scene to reduce the occupied space of the display device. At this time, the curling screen 275 is in a rolling state. For details, please refer to FIG. 7 . In the second play scenario, the curling screen 275 needs to be extended, so that the extended screen can carry the media resources projected by the projection component 278 . For details, please refer to Figure 8. The third is a transition state (not shown) in which the curling screen 275 is in a state of transition between the rolled state and the expanded state during the upward or downward movement of the curling screen 275 .

In some embodiments, the roll-up screen 275 can carry the media assets projected by the projection component 278, presenting the media assets to the user. The curling screen 275 can also be an OLED screen, which directly displays media resources to the user. The media resource may be an image or a video, wherein the video is displayed as a frame-by-frame image, so in this embodiment, the media resource may be collectively referred to as an image. In some embodiments, the curled screen 275 may be a diffuse screen, or a retrograde screen. The drive assembly 276, connected to the curling screen 275, is configured to drive the curling screen 275 to move, including upward movement or downward movement. The driving component 276 can drive the curling screen 275 to rewind or extend based on the control of the controller 250 . The drive assembly 276 may be a retractable crawler or a motor in some embodiments. The motor can be set with a motor at the left and right ends of the screen, or a reel lift motor can be set in the middle of the screen, and a motor can be set at the left and right ends of the lift screen. Reel lift motor.

In some embodiments, the monitoring component 277 includes an image collector, and accordingly, the information monitored by the monitoring component 277 may be image information. Specifically, the monitoring component 277 includes a camera, and the corresponding monitoring information can be obtained by taking pictures of the screen. The number of cameras 279 may be one or more, wherein, at least one camera has a camera area that is a curled screen area, and the camera is used to take pictures of the screen and display images during the lifting process. When the number of cameras is 2, the two cameras are respectively arranged on two sides of the projection assembly. In some embodiments, the camera can be rotated on a horizontal plane, and when it is necessary to take a picture of the screen and display an image, the camera is rotated to the screen orientation; when it is required to take a photo of the user, the camera is rotated to the user. In some embodiments, the monitoring assembly 277 includes an angle monitor to monitor the real-time rotational angle of the drive assembly 276 . In some embodiments, the monitoring component 277 includes a gravitational acceleration sensor. During the rotation of the driving component 276, by monitoring the information of the gravity sensor in three directions of the space coordinate system (x, y, z), any arbitrary information of the driving component 276 can be obtained. The posture corresponding to the moment. The rotation angle of the driving assembly 276 is calculated according to the attitude. In some embodiments, the monitoring component 277 includes an infrared sensor, and the information monitored by the corresponding monitoring component 277 is whether there is a foreign object above the curling screen. When a foreign object is detected above the curling screen, the curling screen ascending process can be temporarily suspended.

In some embodiments, the screen curling and unrolling may be that the screen rises from bottom to top or descends from top to bottom, or can be unrolled from left to right or right to left. The present application describes the direction and form of screen curling and unrolling Not limited.

In some embodiments, taking the screen rising during the power-on process as an example, the user presses the power-on button of the control device or the power-on button on the display device to power on the projection assembly and the controller. After the controller is powered on, the control slide is opened and the notification screen rises to offset zero. Among them, the sliding cover is used to cover the top of the screen in the rolled state when the screen is in the rolled state, so as to prevent dust from falling on the surface of the screen. At the same time, after the controller is powered on, the screen control system and the start-up display service are run. The screen control system is connected to the monitoring component, and the status parameters of the drive component are obtained through the monitoring component, so as to obtain information such as the height and status of the screen, and the start-up display service is ready to play Preset image. The preset image may be a preset picture, a preset animation or video, or a preset start-up advertisement or the like.

During the rising process of the screen, the controller will poll and send instructions to the monitoring component, so as to obtain information such as the current status and height of the screen provided by the monitoring component. The controller judges whether the current screen is at a position relative to the zero point according to the height and status information of the screen. If the current screen does not reach the relative zero position, judge whether the difference between the time when the notification screen rises to the relative zero point and the current time exceeds the preset time difference; if the difference between the time when the notification screen rises to the relative zero point and the current time does not exceed the preset time difference Time difference, continue to judge whether the current screen is at the relative zero position; if the difference between the time when the notification screen rises to the relative zero point and the current time exceeds the preset time difference, it means that the detection is overtime and an alarm prompt is issued. If the current screen reaches the position relative to the zero point, the control screen will rise according to the preset speed curve, and the startup display service will display the preset image according to the preset height curve. FIG. 9 is a schematic diagram of image projection according to one or more embodiments of the present application. As shown in FIG. 9 , the graphic image service collects layers drawn by different applications, synthesizes a bitmap, and combines the The image is sent to the projection component so that the projection component projects the image onto the screen. In some embodiments, the preset speed curve refers to a curve between time and screen height, and the preset height curve refers to a curve between time and preset image display height. The preset height curve and the preset speed curve can be consistent from the relative zero point to the highest point. In some embodiments, the control of the screen rising according to the preset speed curve and the power-on display service playing the preset image according to the preset height curve may be performed simultaneously, or may be performed sequentially.

In some embodiments, FIGS. 10A-10B are schematic diagrams of software of a curling laser device according to one or more embodiments of the present application. As shown in FIG. 10A , the software architecture includes: a geometric computing service is used to connect a camera to capture images, Real-time processing is performed and the calculation results are fed back to the on-screen control system of the controller. The geometric calculation service also includes data acquisition, data processing, feature calculation, and result distribution. The screen control system is used to control the screen, perform automatic geometric correction, and provide real-time screen rising status information to upper-layer applications. The screen control system also includes: transport layer, protocol layer, business layer, etc.; the application includes startup animation, setting, and shutdown animation, all of which are used to control the playback of the current effective display interface in real time through the screen control system; the graphic image service is responsible for synthesizing and displaying images, The graphic image service also includes: a media player, a graphic image processing module, and the like.

In some embodiments, as shown in FIG. 10B , the camera collects data and sends it to the geometric computing service; the geometric computing service calculates the curling or unfolding state of the current screen and the display area state of the laser display in real time; In the unfolded state, the speed of the left and right motors is dynamically adjusted to keep the screen horizontal; the laser projection matrix is dynamically adjusted according to the state of the display area displayed by the laser, so as to achieve the effect that the optical-mechanical projection is always forward; applications such as boot animation can read the curl or Expand the status information, dynamically adjust the effective display area in the current business module to match the height of the screen display; the boot animation, etc. are displayed through the graphic image service.

In some embodiments, the step of obtaining the height of the screen includes: the controller obtains image information of the current screen through an image collector, and measures the height of the screen according to the image information to obtain the height of the current screen. Determine whether the height of the current screen is lower than the display height of the preset image; wherein, the height of the current screen is obtained according to the information fed back by the monitoring component, and the display height of the preset image can be obtained according to the preset height curve and the current time.

In some embodiments, if the height of the current screen is lower than the display height of the preset image, the current preset image is divided into the first image and the second image according to the height of the screen; for example, the controller may The width of the screen is used to generate a display area; the first coordinate corresponding to the display area is read; the image corresponding to the first coordinate in the preset image is the second image, and the rest of the images are the first image. The first coordinate system is established with the lower left corner of the screen as the origin. The second coordinate system is established with the lower left corner of the preset image as the origin. 11-13, 14A-14B, 15, 16A-16C, and 17 are schematic diagrams of cropping images according to one or more embodiments of the present application. As shown in FIG. 11, the coordinate system 1 is the first coordinate The coordinate system 2 is the second coordinate system. In some embodiments, when the screen is raised, the size of the screen is 1920mm*1080mm, correspondingly, the screen can be cut into 1920*1080 display blocks, and the coordinate value of each display block in the first coordinate system is known . During the upward movement of the screen, the controller calculates that the height of the screen is 678mm at a certain moment, and the first coordinates corresponding to the display area are: (0,0)(0,1)...(0,1920); (1, 0)(1,1)…(1,1920);…(678,0)(678,1)…(678,1920). The image corresponding to the first coordinate in the preset image is the second image, and the rest of the images are the first images. For details, please refer to FIG. 12 .

In some embodiments, when the screen is raised, the size of the screen is 1920mm*1080mm. When the screen moves upwards, the controller calculates that the height of the screen is 678mm at a certain moment, the image corresponding to the preset image with a height of 678mm from the bottom is the second image, and the rest of the images are the first image. For details, please refer to the figure. 13. Blackout processing is performed on the first image to obtain a processed image; for example, a floating layer window can be set on the upper layer of the first image, the size of the floating layer window is equal to the size of the first image, and the floating layer window is used to load the black interface, The final processed image can be seen in Figure 14A. For another example, the color of each pixel in the first image may be set to black, and the finally obtained processed image may refer to FIG. 14B . After the graphic image service divides and masks the preset image, it sends the processed image to the projection component, so that the projection component projects the processed image on the screen. In some embodiments, if the height of the current screen is not lower than the display height of the preset image, the screen continues to rise according to the preset speed curve and the preset image is projected according to the preset height curve. In the above embodiment, in the process of the screen rising, the processed image projected out can refer to FIG. 15 . In some embodiments, the methods provided by some embodiments of the present application are also applicable to the shutdown process.

In some embodiments, if the height of the current screen is lower than the display height of the preset image, the current preset image is cut into the first image and the second image according to the height of the screen, and the projection component is controlled to project the first image on the current screen. On the screen; for example, crop the preset image horizontally at the height of the screen from the top to obtain the first image and the second image. Move the first image to the lower part of the laser projection area after coordinate transformation. The upper part of the laser projection area can be replaced by a black image or black pixels. The graphic image service combines the black image with the first image after coordinate transformation. into a processed image, and display the processed image on the current screen.

In some embodiments, the coordinate transformation method subtracts the difference between the highest point of the screen and the current screen height from the ordinate of the first image, and the abscissa remains unchanged. For example: when the screen is raised, the size of the screen is 1920mm*1080mm, correspondingly, the screen can be cut into 1920*1080 display blocks, and the coordinate value of each display block in the first coordinate system is known. During the upward movement of the screen, the controller calculates that the height of the screen is 678mm at a certain moment, and the preset image is horizontally cropped at a height of 678mm from the top to obtain the first image and the second image. As shown in Fig. 16A, the coordinates of the current first image are (1080,0)(1080,1)...(1080,1920);(1079,0)(1079,1)...(1079,1920);... ...(402,0)(402,1)...(402,1920); the difference between the highest point of the screen and the current screen height is 402. After coordinate transformation, that is, the ordinate of the first image is subtracted by 402 to obtain the first image. The coordinates of the image are (402,0)(402,1)...(402,1920);(401,0)(401,1)...(401,1920);...(0,0)(0, 1)...(0,1920), as shown in Figure 16B. The upper part of the laser projection area can be replaced by an all-black image or all-black pixels, and the graphic image service merges the all-black image and the coordinate-transformed first image into a processed image, as shown in FIG. 16C . After the graphic image service performs cropping, coordinate conversion, and blackout processing on the preset image, it sends the processed image to the projection component, so that the projection component projects the processed image on the screen. In the above embodiment, when the screen is raised, the projected image can be referred to FIG. 17 . In some embodiments, the methods provided by some embodiments of the present application are also applicable to the shutdown process.

In other embodiments, after the current screen height is acquired, the preset image is cropped to be the same height as the current screen, and when the projection component projects the image, only the current screen area is projected. This method only has laser projection on the screen and no projection outside the screen, which is more in line with the design constraints and will not leak light to the outside of the screen.

In some embodiments, the user presses the power-on button of the control device or the power-on button on the display device to power on the projection assembly and the controller, the controller notifies the screen to rise, the system blocks sound and keys, and the projection assembly does not project images, The boot animation program cyclically detects the current screen rising status by reading GPIO, etc. After the screen rises to the highest point, the boot animation program notifies the projection component to project the image, and releases the button shielding and sound shielding to enter the main system. In some embodiments, the user powers up the projection assembly and the controller by pressing the power button of the control device or pressing the power button on the display device. The controller notifies that the screen goes up and, at the same time, blocks keystrokes and sounds. During the previous screen rise, the projection assembly does not project an image, but the image is still playing in the background. The purpose of shielding the buttons and sounds is to prevent the sound attached to the image from being played or the user accidentally pressing the button on the control device to trigger the corresponding function, so as to make the user mistakenly think that there is an error in the operation of the display device, delay the boot process, and cause a bad user experience. . When it is detected that the screen rises to a preset height, the projection component is controlled to project a preset image and release the key and sound shielding; wherein, the preset height can be half of the total height of the screen.

In some embodiments, FIG. 18 is a schematic diagram of a display interface according to one or more embodiments of the present application. When it is detected that the screen has risen to the preset height, the screen will display a prompt message, prompting "the screen is starting, press any key to turn on the screen" and release the key shield. At this time, only the font is colored, and other areas are black, such as shown in Figure 18. If it is detected that the user manually triggers the button after the prompt information is displayed, the screen brightening action is triggered, and the projection component is controlled to project a preset image and cancel the sound shielding. The preset image rises according to the preset speed curve; the height of the screen is obtained in real time, if the height of the screen is lower than the display height of the preset image, the preset image is processed according to the height of the screen, so that the display height of the preset image is the same as that of the screen. Match the rising height; if it is not detected that the user manually triggers the button after the prompt message is displayed, and after the screen rises to the highest point, control the projection component to project the preset image and release the sound shielding.

In some embodiments, the curling screen is controlled to ascend according to a preset speed curve, wherein the preset speed curve refers to a curve between time and curling screen height, and the preset height curve refers to a curve between time and preset image display height. The curve of time vs. curl screen height and the curve of time vs. preset image display height can be the same or different. In some embodiments, FIG. 19 is a schematic diagram of a preset speed curve according to one or more embodiments of the present application. The preset speed curve adopts the default ascending curve parameters of the display device when it leaves the factory, as shown in Route 1 in FIG. 19 . However, due to the inherent characteristics of mechanical equipment, the influence of temperature and humidity in north and south, temperature and humidity in winter and summer, and mechanical aging on machinery, there is a loss in the rise of machinery. In a long process or in different environments, the performance of the same machinery may be different, or even The performance of two mechanical devices of the same specification is not the same. At present, there are mainly two kinds of aging problems. One is that the screen TV is gradually aging, and the rotation speed decreases, which causes the screen to lift up longer than before, as shown in route 2 in Figure 19; the second is screen aging. The actual height should be lower or higher, as shown in line 3 of Figure 19.

Some embodiments of the present application provide a set of rising curve databases. Curve formula:

Real-time height h=Hmax*(Math.cos((t/Tmax+1)*Math.PI)/2.0f)+0.5f) Formula 1

Among them, Hmax is the total height of the screen rising this time, t is the current time, and Tmax is the total time that the screen is rising this time.

The actual height and ascent time of each ascent will be used as the basis, and stored in the historical database as a reference for the next startup. The specific implementation method is as follows: 1. In the interface design, design an interface for adding the screen to rise according to the parameters (pass the current rising height and the total time to the screen as parameters). 2. Each time the machine is powered on, the parameters of the current boot (for example, the ascent time, according to the real-time altitude, the total duration through the curve formula, inversely deduce the speed, acceleration and other information of the current ascent). 3. Due to aging, temperature and humidity are gradually affected, so nearly 10 times of startup can be taken as the basis for calculating the initial speed, height and acceleration of this startup. 4. The user interface shows that the system fits a new rising curve according to the calculated parameters. The control screen display image rises. At the same time, the serial port command is sent to the monitoring component, and it rises synchronously. 5. When the screen rises to the highest point, the parameters of this startup will be included in the rising curve database again for the next startup.

In some embodiments, during the process of ascending the curling screen according to the preset speed curve and projecting the preset image according to the preset height curve, if it is detected that the height of the curling screen does not change within a preset time, stop projecting the preset image and rising curling the screen; in some embodiments, during the process of ascending the curling screen according to the preset speed curve and projecting the preset image according to the preset height curve, if the abnormal state information sent by the monitoring component is received, the projecting of the preset image is stopped and the ascending is stopped Curling the screen; wherein, the height of the curling screen specifically refers to the distance between the highest point of the curling screen and the bottom (absolute zero point) of the curling screen.

In some embodiments, the method for calculating the height of the curling screen includes: the controller obtains the number of rotations of the driving component through the monitoring component; the screen display calculation service run by the controller calculates the height of the current curling screen according to the number of rotations of the driving component, The specific formula is:

r2=r1+xh Formula 2

Among them, H is the height of the current curling screen, r1 is the inner diameter of the reel, h is the thickness of the curling screen, x is the current number of turns, and r2 is the current maximum radius.

In some embodiments, when the height of the curled screen does not change within a preset time, it means that the screen is stuck at this time. The curling screen is controlled to enter the reset state, so that the curling screen returns to the relative zero point and then rises according to the preset speed curve again, and the projection component projects the preset image according to the preset height curve again. FIG. 20 is a schematic diagram of a speed curve provided according to one or more embodiments of the present application. During this process, a graph of time versus curling screen height is shown in Figure 20. In some embodiments, the reset state refers to re-entering the normal boot process after the curling screen is lowered to the absolute zero point.

In some embodiments, FIG. 21 is a flowchart of exception handling provided according to one or more embodiments of the present application. As shown in Figure 21, when the screen control system polls and sends instructions to the monitoring component to obtain the current state, height and abnormal information of the curling screen, it controls the graphic image service to stop sending images to the projection component; controls the curling screen to enter reset (reset) ) state, when the curling screen drops to the absolute zero point and then rises to the relative zero point, the screen control system sends a screen-raising command to control the curling screen to rise according to the preset speed curve, and at the same time, notify the graphic image service to send the image to the preset curve according to the preset curve. The projection assembly projects onto the curled screen. In the process of the curling screen rising again, the screen control system still needs to poll and send an instruction to the monitoring component to obtain information such as the current state and height of the curling screen. The rising height of the curling screen and the display height of the image are kept in sync. When the curling screen rises to the highest point, the monitoring component feeds back the state to the screen control system, and the curling screen is lifted up.

In some embodiments, the step of keeping the rising height of the curling screen and the display height of the image in a synchronized state specifically includes: acquiring the current height of the curling screen in real time, and comparing the current height of the curling screen with the display height of the image. If the height of the current curling screen is lower than the display height of the image, the image will be cropped to the same size as the height of the curling screen, and the area of the non-curling screen will be blacked out; if the height of the current curling screen is not lower than the display height of the image, continue to follow the The preset curve rises to curl the screen and display the image. In some embodiments, during the process of ascending the curling screen according to the preset speed curve and projecting the preset image according to the preset height curve, if it is detected that the height of the curling screen does not change within a preset time, the projecting of the preset image and the rising curl screen;

In some embodiments, during the process of rising and curling the screen according to the preset curve and projecting the preset image, if abnormal status information sent by the monitoring component is received, the projection of the preset image and the rising and curling of the screen are suspended; After the curling screen is raised, the projection assembly is controlled to project a user interface on the curling screen, and the user interface includes abnormal information prompt information. In some embodiments, the abnormal information prompt information includes abnormal information prompt text and abnormal information prompt box. The abnormal information prompt box has a certain height, which can be set as a preset height. The steps of controlling the projection component to project the user interface include: determining the effective display area and the non-effective display area of the user interface according to the current height of the curling screen; masking the non-effective display area; judging whether the current curling screen height exceeds a preset height; When the height of the curling screen does not exceed the preset height, set the abnormal information prompt text at the preset position of the effective display area to obtain the processed user interface; if the current curling screen height exceeds the preset height, set the abnormal information prompt box in The preset position of the effective display area is obtained, and the processed user interface is obtained; the projection component is controlled to project the processed user interface onto the curling screen.

In some embodiments, FIGS. 22-23 are schematic diagrams of user interfaces according to one or more embodiments of the present application. When the height of the curling screen does not exceed the preset height, the user interface displays the abnormal information prompt text, as shown in Figure 22. When the height of the current curling screen exceeds the preset height, the user interface displays an abnormal information prompt box, and the abnormal information prompt box can be displayed in the center, as shown in Figure 23. The abnormal state and the fault code of the abnormal state can be displayed in the abnormal information prompt text or abnormal information prompt box, and also includes a “continue” control 141 , a “shutdown” control 142 and a “restart” control 143 . Among them, when the user selects the "continue" control 141, the curling screen will continue to perform the ascending operation; when the user selects the "shutdown" control 142, the curling screen will perform the descending operation and after the curling screen drops to the absolute zero point, the display device is powered off ; When the user selects the "restart" control 143, the curling screen will perform a descending operation and re-enter the normal boot process after the curling screen drops to the absolute zero point.

In some embodiments, after the user checks the fault code from the abnormal information prompt box and knows the cause of the fault, the fault is cleared. For example, during the ascending process of the curling screen, it is detected that a foreign object has moved into the ascending range of the curling screen. When the curling screen is stopped, the abnormal information prompt box will be displayed. After the user moves the foreign object out of the rising range of the curling screen, the user selects the “continue” control 141 to issue an instruction to continue to ascend the curling screen. In response to the user's instruction to continue to ascend the curling screen, the controller redraws the speed curve according to the current curling screen height, the total height of the curling screen, the time that the curling screen has risen and the total rising time of the curling screen; and controls the curling screen according to the redrawn The speed curve rises and curls the screen; at the same time, the projection component is controlled to project a preset image on the curling screen according to the speed curve. In some embodiments, the velocity curve formula can be expressed as:

Real-time height h=Hmax*(Math.cos((t/Tmax+1)*Math.PI)/2.0f)+0.5f)

Formula 3

In some embodiments, the same curve formula can be used for the roll-up screen rise and the image display. The current curve state is determined by the incoming vertex height Hmax and Tmax. FIG. 24 is a schematic diagram of a speed curve according to one or more embodiments of the present application. As shown in FIG. 24 , the method for redrawing the speed curve is as follows: when the screen stops abnormally, the screen should continue to be raised after failure recovery. The time T remains unchanged. According to the time T1 that has been raised before the fault, the remaining lifting time T2=T-T1 can be obtained. In order to ensure that the total lifting height H remains unchanged, the time that has been raised before the failure H1, the remaining time to lift H2=H-H1 is obtained. The formula for calculating the running curve during this recovery is:

h=H2*(Math.cos((t/T2+1)*Math.PI)/2.0f)+0.5f) Formula 4

In some embodiments, FIG. 25 is a flowchart of exception handling according to one or more embodiments of the present application. As shown in FIG. 25 , when the screen control system polls and sends an instruction to the monitoring component, obtains the current state and height of the curling screen. After correcting the abnormal information, control the graphics and image service to suspend sending the image to the projection component; control the graphics and image service to send the abnormal information prompt box to the projection component; after troubleshooting, the user issues an instruction to continue to rise and curl the screen; the screen control system can The redrawn speed curve and the screen raising command are sent to the drive unit together, and the drive unit controls the curling screen to rise according to the newly drawn upward curve, and at the same time, informs the graphic image service to send the image to the projection unit to project on the curling screen according to the newly drawn upward curve. superior. In the process that the curling screen continues to rise, the screen control system still needs to poll and send commands to the monitoring component to obtain information such as the current state and height of the curling screen. The rising height of the curling screen and the display height of the image are kept in sync. When the curling screen rises to the highest point, the monitoring component feeds back the state to the screen control system, and the curling screen is lifted up. In some embodiments, the above method is also applicable to the case where the curled screen drops when the device is turned off, and details are not described herein again.

During the rising or falling process of the curling screen, an unexpected power failure may occur, causing the curling screen to stop at a position other than the absolute zero point. After restarting, the controller detects that the current curling screen is not at the absolute zero position in response to the power-on command input by the user, and in some embodiments, controls the curling screen to enter a reset state, so that the curling screen returns to the relative zero position and then restarts. Ascent according to the preset speed curve, the projection component re-projects the preset image according to the preset height curve. In some embodiments, a rising curve is drawn up according to the current height of the curling screen and the total height of the curling screen; wherein, the time to rise to the current height of the curling screen can be determined according to the current height of the curling screen and a preset curve, and the total rising time is subtracted from the height of the current curling screen. Go to the time corresponding to the current altitude, you can get the time required to rise from the current position to the highest point, and then the speed curve and the altitude curve can be redrawn. Control the curling screen to ascend the curling screen according to the re-drawn speed curve; control the projection component to project a preset image on the curling screen according to the newly-drawn height curve.

In the process of the curling screen rising again, the screen control system still needs to poll and send an instruction to the monitoring component to obtain information such as the current state and height of the curling screen. The rising height of the curling screen and the display height of the image are kept in sync. When the curling screen rises to the highest point, the monitoring component feeds back the state to the screen control system, and the curling screen is lifted up.

Some embodiments of the present application provide an image cropping method, which is applied to any of the above-mentioned display devices. The method includes: when the screen is unfolded or curled according to a preset speed curve and the projection component projects a preset according to a preset height curve During the image process, the height of the current screen is determined according to the status information of the screen; if the height of the current screen is lower than the display height of the preset image, the preset image is divided into the first image and the second image according to the height of the current screen, so The height of the second image is not greater than the height of the current screen; the projection component is controlled to project a preset image, so that the screen only displays the second image.

In some embodiments, the image cropping method includes: if the height of the screen is not lower than the display height of the preset image, continuing to expand or curl the screen according to the preset speed curve and project the preset image according to the preset height curve.

In some embodiments, the image cropping method includes: setting a floating layer window with a black interface loaded on top of the first image, or setting pixels of the first image to black to obtain a processed preset image ; Control the projection component to project the processed preset image.

In some embodiments, the image cropping method includes: the state information of the screen includes the rotation number of the driving component or the image information of the screen, and calculating the height of the current screen according to the rotation number of the driving component; or, according to The image information of the screen determines the height of the current screen.

In some embodiments, the image cropping method includes: during the process that the screen is unfolded or curled according to a preset speed curve and the projection component projects a preset image according to a preset height curve, determining the current screen according to the state information of the screen. height; if the height of the current screen is lower than the display height of the preset image, the preset image is cropped into a first image and a second image according to the height of the current screen, and the height of the first image is not greater than the height of the current screen ; Perform coordinate transformation processing on the first image, so that the screen displays the first image.

In some embodiments, the image cropping method includes: the state information of the screen includes the number of rotations of the driving component, and the height of the current screen is calculated according to the number of rotations of the driving component.

In some embodiments, the image cropping method includes: during the process of expanding the screen according to a preset speed curve, shielding keys and sounds; when it is detected that the height of the screen reaches a preset height, controlling the projection component to follow the preset height Curve projection of the preset image and release the button and sound shielding; if the height of the screen is lower than the display height of the preset image, the preset image is divided into a first image and a second image according to the height of the current screen, the second image The height of the image is not greater than the height of the current screen; the projection component is controlled to project a preset image, so that the screen only displays the second image.

In some embodiments, the image cropping method includes: during the process of expanding the screen according to a preset speed curve, shielding keys and sounds; when it is detected that the height of the screen reaches a preset height, controlling the projection component to follow the preset height Curve projection preset image and release button and sound shielding; if the height of the current screen is lower than the display height of the preset image, the preset image is trimmed into a first image and a second image according to the height of the current screen, the first image The height of the first image is not greater than the height of the current screen; the coordinate transformation process is performed on the first image, so that the screen displays the first image.

For the specific image cropping method, reference may be made to the above-mentioned embodiments of the display device, which will not be described in detail here.

For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above discussion in some embodiments is not intended to be exhaustive or to limit implementations to the specific forms disclosed above. Numerous modifications and variations are possible in light of the above teachings. The above embodiments have been chosen and described to better explain the principles and practical applications, so as to enable those skilled in the art to better utilize the embodiments and various modified embodiments suitable for specific use considerations.

Claims

A display device comprising:

Projection component;

The screen, which is configured to be rolled up and down;

a driving component for driving the screen to unfold or curl;

a monitoring component for monitoring state information during the unfolding or rolling of the screen, and feeding back the state information of the screen to the controller;

Controller, which executes:

During the process that the screen is unfolded or curled according to the preset speed curve and the projection component projects the preset image according to the preset height curve, the height of the current screen is determined according to the status information of the screen;

If the height of the current screen is lower than the display height of the preset image, the preset image is divided into a first image and a second image according to the height of the current screen, and the height of the second image is not greater than the height of the current screen;

The projection component is controlled to project a preset image, so that the screen only displays the second image.
The display device of claim 1, wherein the controller is further configured to perform:

If the height of the screen is not lower than the display height of the preset image, continue to unfold or curl the screen according to the preset speed curve and project the preset image according to the preset height curve.
The display device according to claim 1, wherein the controller controls the projection component to project a preset image in the following manner, so that the screen only displays the second image:

Set a floating layer window with a black interface loaded on the upper layer of the first image, or set the pixels of the first image to be black to obtain a processed preset image;

The projection component is controlled to project the processed preset image.
The display device according to claim 1, wherein the status information of the screen includes the number of rotations of the driving component or the image information of the screen, and the controller performs the determination of the height of the current screen according to the status information of the screen in the following manner :

Calculate the height of the current screen according to the number of rotations of the drive assembly;

Or, the height of the current screen is determined according to the image information of the screen.
The display device of claim 1, the controller to perform:

During the process that the screen is unfolded or curled according to the preset speed curve and the projection component projects the preset image according to the preset height curve, the height of the current screen is determined according to the status information of the screen;

If the height of the current screen is lower than the display height of the preset image, the preset image is cropped into a first image and a second image according to the height of the current screen, and the height of the first image is not greater than the height of the current screen;

Coordinate conversion processing is performed on the first image, so that the screen displays the first image.
The display device of claim 5, wherein the controller is further configured to perform:

If the height of the screen is not lower than the display height of the preset image, continue to unfold or curl the screen according to the preset speed curve and project the preset image according to the preset height curve.
The display device according to claim 5, wherein the state information of the screen includes the number of rotations of the driving component, and the controller performs determining the height of the current screen according to the state information of the screen in the following manner:

The height of the current screen is calculated according to the number of rotations of the driving assembly.
The display device according to claim 5, the state information of the screen comprises the image information of the screen, and the controller adopts the following manner to perform determining the height of the current screen according to the state information of the screen:

The height of the current screen is determined according to the image information of the screen.
The display device of claim 1, the controller to perform:

During the process that the screen is unfolded according to the preset speed curve, the keys and sounds are shielded;

When it is detected that the height of the screen reaches the preset height, the projection component is controlled to project the preset image according to the preset height curve and release the button and sound shielding;

If the height of the screen is lower than the display height of the preset image, the preset image is divided into a first image and a second image according to the height of the current screen, and the height of the second image is not greater than the height of the current screen;

The projection component is controlled to project a preset image, so that the screen only displays the second image.
The display device of claim 1, the controller to perform:

During the process that the screen is unfolded according to the preset speed curve, the keys and sounds are shielded;

When it is detected that the height of the screen reaches the preset height, the projection component is controlled to project the preset image according to the preset height curve and release the button and sound shielding;

If the height of the current screen is lower than the display height of the preset image, the preset image is cropped into a first image and a second image according to the height of the current screen, and the height of the first image is not greater than the height of the current screen;

Coordinate conversion processing is performed on the first image, so that the screen displays the first image.
An image cropping method of a display device, the method comprising:

During the process that the screen of the display device is unfolded or curled according to the preset speed curve and the projection component projects the preset image according to the preset height curve, the height of the current screen is determined according to the status information of the screen;

If the height of the current screen is lower than the display height of the preset image, the preset image is divided into a first image and a second image according to the height of the current screen, and the height of the second image is not greater than the height of the current screen;

The projection component is controlled to project a preset image, so that the screen only displays the second image.
The method of claim 11, comprising:

If the height of the screen is not lower than the display height of the preset image, continue to unfold or curl the screen according to the preset speed curve and project the preset image according to the preset height curve.
The method of claim 11, comprising:

Set a floating layer window with a black interface loaded on the upper layer of the first image, or set the pixels of the first image to be black to obtain a processed preset image;

The projection component is controlled to project the processed preset image.
The method of claim 11, comprising:

The status information of the screen includes the number of rotations of the drive assembly or the image information of the screen, and the height of the current screen is calculated according to the number of rotations of the drive assembly; or, the height of the current screen is determined according to the image information of the screen .
The method of claim 11, comprising:

During the process that the screen is unfolded or curled according to the preset speed curve and the projection component projects the preset image according to the preset height curve, the height of the current screen is determined according to the status information of the screen;

If the height of the current screen is lower than the display height of the preset image, the preset image is cropped into a first image and a second image according to the height of the current screen, and the height of the first image is not greater than the height of the current screen;

Coordinate conversion processing is performed on the first image, so that the screen displays the first image.
The method of claim 15, comprising:

If the height of the screen is not lower than the display height of the preset image, continue to unfold or curl the screen according to the preset speed curve and project the preset image according to the preset height curve.
The method of claim 15, comprising:

The status information of the screen includes the number of rotations of the driving assembly, and the current height of the screen is calculated according to the number of rotations of the driving assembly.
The method of claim 11, comprising:

During the process that the screen is unfolded according to the preset speed curve, the keys and sounds are shielded;

When it is detected that the height of the screen reaches the preset height, the projection component is controlled to project the preset image according to the preset height curve and release the button and sound shielding;

If the height of the screen is lower than the display height of the preset image, the preset image is divided into a first image and a second image according to the height of the current screen, and the height of the second image is not greater than the height of the current screen;

The projection component is controlled to project a preset image, so that the screen only displays the second image.
The method of claim 11, comprising:

During the process that the screen is unfolded according to the preset speed curve, the keys and sounds are shielded;

When it is detected that the height of the screen reaches the preset height, the projection component is controlled to project the preset image according to the preset height curve and release the button and sound shielding;

If the height of the current screen is lower than the display height of the preset image, the preset image is cropped into a first image and a second image according to the height of the current screen, and the height of the first image is not greater than the height of the current screen;

Coordinate conversion processing is performed on the first image, so that the screen displays the first image.