CN116391156A

CN116391156A - Display device and image clipping method

Info

Publication number: CN116391156A
Application number: CN202180046540.1A
Authority: CN
Inventors: 吴汉勇; 贾亚洲; 张安祺; 初德进; 司洪龙; 甄凌云; 刘清友; 李晓平; 陈许; 王之奎; 王秉清; 马会会; 于硕; 刘晋
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2020-06-29
Filing date: 2021-06-25
Publication date: 2023-07-04
Also published as: WO2022001853A1; WO2022001854A1; CN116391155A; CN116391357A; CN117012099A; WO2022001855A1

Abstract

Some embodiments of the application disclose a display device and an image clipping method, the display device includes: a projection assembly; a screen configured to be curlable up and down; a driving assembly for driving the screen to be unfolded or curled; the monitoring component is used for monitoring state information in the process of unfolding or curling the screen and feeding back the state information of the screen to the controller; a controller for performing: determining the height of the current screen according to the state information of the screen in the process that the screen is unfolded or curled according to a preset speed curve and the projection component projects a preset image according to a preset height curve; if the height of the current screen is lower than the display height of the preset image, dividing the preset image into a first image and a second image according to the height of the current screen, wherein the height of the second image is not greater than the height of the current screen; and controlling the projection assembly to project a preset image so that the screen only displays the second image.

Description

Display device and image clipping method

The application claims a display device with application number 202110296908.1 and application name "a display device" filed on day 19 of 3 months 2021; a display device filed on 19/3/2021 under application number 202110298436.3; projection component correction method and display device filed on 19/3/2021 under application number 202110298513.5 and application name "display device"; a screen correction method of a display device and a display device filed on 19 th 3 of 2021 and having application number 202110298485.7; a display device filed on 19/3/2021 under application number 202110297021.4; priority of chinese patent application No. 202010603016.7, entitled "a display device", filed on 29 th month 6 of 2020, the entire contents of which are incorporated herein by reference.

Technical Field

The application relates to the technical field of display equipment, in particular to display equipment and an image clipping method.

Background

The laser television adopts a laser light source as a display light source and forms images by matching with a projection display technology, is provided with a special projection screen, and can receive broadcast television programs or internet television programs. Besides adopting a screen which is unfolded from top to bottom, the laser television also adopts a screen which is unfolded from bottom to top from a television cabinet, and the rear part of the screen is provided with a light machine and a lifting screen in the television cabinet, when the television is started, the screen is slowly lifted from the television cabinet, and the image of the light machine can be beaten at the rear global position.

Disclosure of Invention

Some embodiments of the present application provide a display device, including:

a projection assembly;

a screen configured to be curlable up and down;

a driving assembly for driving the screen to be unfolded or curled;

the monitoring component is used for monitoring state information in the process of unfolding or curling the screen and feeding back the state information of the screen to the controller;

a controller for performing:

determining the height of the current screen according to the state information of the screen in the process that the screen is unfolded or curled according to a preset speed curve and the projection component projects a preset image according to a preset height curve;

If the height of the current screen is lower than the display height of the preset image, dividing the preset image into a first image and a second image according to the height of the current screen, wherein the height of the second image is not greater than the height of the current screen;

and controlling the projection assembly to project a preset image so that the screen only displays the second image.

In some embodiments, the controller is further configured to perform:

if the height of the screen is not lower than the display height of the preset image, continuing to expand or curl the screen according to the preset speed curve and projecting the preset image according to the preset height curve.

In some embodiments, the controller performs controlling the projection assembly to project a preset image such that the screen displays only the second image in the following manner:

setting a floating layer window loaded with a black interface on the upper layer of the first image, or setting the pixel point of the first image to be black to obtain a processed preset image;

and controlling the projection assembly to project the processed preset image.

In some embodiments, the status information of the screen includes a number of rotations of the driving assembly or image information of the screen, and the controller performs determining the height of the current screen according to the status information of the screen in the following manner:

Calculating the height of the current screen according to the rotation number of the driving assembly;

or determining the height of the current screen according to the image information of the screen.

In some embodiments, the controller is configured to perform:

if the height of the current screen is lower than the display height of the preset image, cutting the preset image into a first image and a second image according to the height of the current screen, wherein the height of the first image is not greater than the height of the current screen;

and performing coordinate conversion processing on the first image so that the screen displays the first image.

In some embodiments, the controller is further configured to perform:

In some embodiments, the status information of the screen includes a number of rotations of the driving assembly, and the controller performs determining the height of the current screen according to the status information of the screen in the following manner:

And calculating the height of the current screen according to the rotation number of the driving assembly.

In some embodiments, the status information of the screen includes image information of the screen, and the controller performs determining the height of the current screen according to the status information of the screen in the following manner:

and determining the height of the current screen according to the image information of the screen.

In some embodiments, the controller is configured to perform:

shielding keys and sounds in the process that the screen is unfolded according to a preset speed curve;

when the screen height is detected to reach the preset height, controlling the projection assembly to project a preset image according to a preset height curve and removing keys and sound shielding;

if the height of the screen is lower than the display height of the preset image, dividing the preset image into a first image and a second image according to the height of the current screen, wherein the height of the second image is not greater than the height of the current screen;

In some embodiments, the controller is configured to perform:

Some embodiments of the present application provide an image cropping method, which is applied to the above display device, and the method includes:

In some embodiments, comprising:

and controlling the projection assembly to project the processed preset image.

In some embodiments, comprising:

the state information of the screen comprises the number of rotations of the driving assembly or the image information of the screen, and the height of the current screen is calculated according to the number of rotations of the driving assembly; or determining the height of the current screen according to the image information of the screen.

In some embodiments, comprising:

the state information of the screen comprises the rotation number of the driving assembly, and the height of the current screen is calculated according to the rotation number of the driving assembly.

In some embodiments, comprising:

Drawings

FIG. 1 is a schematic diagram of an operational scenario between a display device and a control apparatus according to one or more embodiments of the present application;

FIG. 2 is a block diagram of a hardware configuration of a display device 200 in accordance with one or more embodiments of the present application;

fig. 3 is a hardware configuration block diagram of the control device 100 according to one or more embodiments of the present application;

FIG. 4 is a schematic diagram of a software configuration in a display device 200 according to one or more embodiments of the present application;

FIGS. 5A-5B are schematic illustrations of a coiled laser apparatus structure according to one or more embodiments of the present application;

FIGS. 6-8 are schematic illustrations of components of a crimping laser apparatus in accordance with one or more embodiments of the present application;

FIG. 9 is a schematic image projection diagram in accordance with one or more embodiments of the present application;

FIGS. 10A-10B are schematic diagrams of crimping laser apparatus software in accordance with one or more embodiments of the present application;

FIGS. 11-13, 14A-14B, 15, 16A-16C, and 17 are schematic diagrams of image cropping according to one or more embodiments of the present application;

FIG. 18 is a schematic diagram of a display interface according to one or more embodiments of the present application;

FIG. 19 is a schematic diagram of a preset speed profile in accordance with one or more embodiments of the present application;

FIG. 20 is a schematic diagram of a velocity profile provided in accordance with one or more embodiments of the present application;

FIG. 21 is a flow diagram of exception handling provided in accordance with one or more embodiments of the present application;

FIGS. 22-23 are user interface diagrams in accordance with one or more embodiments of the present application;

FIG. 24 is a schematic diagram of a velocity profile according to one or more embodiments of the present application;

FIG. 25 is a flow diagram of exception handling in accordance with one or more embodiments of the present application.

Detailed Description

For purposes of clarity, embodiments and advantages of the present application, the following description will make clear and complete the exemplary embodiments of the present application, with reference to the accompanying drawings in the exemplary embodiments of the present application, it being apparent that the exemplary embodiments described are only some, but not all, of the examples of the present application.

Based on the exemplary embodiments described herein, all other embodiments that may be obtained by one of ordinary skill in the art without making any inventive effort are within the scope of the claims appended hereto. Furthermore, while the disclosure is presented in the context of an exemplary embodiment or embodiments, it should be appreciated that the various aspects of the disclosure may, separately, comprise a complete embodiment. It should be noted that the brief description of the terms in the present application is only for convenience in understanding the embodiments described below, and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to one or more embodiments of the present application, and as shown in fig. 1, a user may operate the display device 200 through the mobile terminal 300 and the control apparatus 100. The control apparatus 100 may be a remote control, and the communication between the remote control and the display device includes infrared protocol communication, bluetooth protocol communication, and wireless or other wired manner to control the display device 200. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc. In some embodiments, mobile terminals, tablet computers, notebook computers, and other smart devices may also be used to control the display device 200.

In some embodiments, the mobile terminal 300 may install a software application with the display device 200, implement connection communication through a network communication protocol, and achieve the purpose of one-to-one control operation and data communication. The audio/video content displayed on the mobile terminal 300 may also be transmitted to the display device 200, so that the display device 200 may also perform data communication with the server 400 through various communication modes. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The display device 200 may be a liquid crystal display, an OLED display, a projection display device. The display device 200 may additionally provide an intelligent network television function of a computer support function in addition to the broadcast receiving television function.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200. The communication interface 130 is configured to communicate with the outside, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module. The user input/output interface 140 includes at least one of a microphone, a touch pad, a sensor, keys, or an alternative module.

Fig. 3 shows a hardware configuration block diagram of the display device 200 in accordance with an exemplary embodiment. The display apparatus 200 shown in fig. 3 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface 280. The controller includes a central processor, a video processor, an audio processor, a graphic processor, a RAM, a ROM, and first to nth interfaces for input/output. The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen. The modem 210 receives broadcast television signals through a wired or wireless reception manner, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals. The detector 230 is used to collect signals of the external environment or interaction with the outside. The controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

In some embodiments, a "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include at least one of a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

Fig. 4 is a schematic view of software configuration in a display device 200 according to one or more embodiments of the present application, as shown in fig. 4, the system is divided into four layers, namely, an application layer (application layer), an application framework layer (Application Framework layer), an Android run layer and a system library layer (system runtime layer), and a kernel layer from top to bottom. The kernel layer contains at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

The prior application file and application date: month 2 and 5 of 2020, application number: 202010115288.2, name: a laser projection system, a projection screen ascending and descending control method; filing date: month 2 and 5 of 2020, application number: 202010115275.5, name: a laser projection system, a projection screen ascending and descending control method; filing date: month 2 and 5 of 2020, application number: 202010115286.3, name: a laser projection system, a projection screen ascending and descending control method; filing date: 11 months and 27 days 2020, application number: 202011364537.8, name: projection devices are incorporated herein by reference in their entirety.

FIGS. 5A-5B are schematic illustrations of a structure of a crimping laser device according to one or more embodiments of the present application, and FIGS. 6-8 are schematic illustrations of components of a crimping laser device according to one or more embodiments of the present application; as shown in fig. 5A, 5B, and 6, the curled screen 275 of the present embodiment may be driven by the driving component 276 to perform a winding or stretching operation. The drive assembly 276 includes a plurality of sets of lift assemblies and a cross beam 231, each set of lift assemblies including a lift frame 232, a lift motor 233, and a reduction gear set 234; a first end of the lifting frame 232 is rotatably connected with the base 21, a second end of the lifting frame 232 is rotatably connected with the cross beam 231, the reduction gear set 234 is respectively connected with the lifting motor 233 and the lifting frame 232, and a second side edge of the curled screen 275 is fixedly connected with the cross beam 231; the lift motor 233 can drive the lift 232 to lift through the reduction gear set 234, and the lift 232 lifts up the cross beam 231 to unwind the roll screen 275. The lift motor 233 and the reduction gear set 234 are fixed to the base 21, and the reduction gear set 234 is fixedly connected to the first end of the lift frame 232. Wherein the gear included in the reduction gear set 234 is rotatably fixed to the base 21 through a gear bracket, or the remaining gears of the reduction gear set 234 except for the gears connected to the elevation frame 232 and/or the elevation motor 233 are rotatably fixed to the base 21 through a gear bracket.

In some embodiments, the curled screen 275 may be in three states: the first is that the curled screen 275 needs to be rolled up in a non-playing scene to reduce the footprint of the display device. At this time, the curled screen 275 is in a rolled state, and particularly, reference may be made to fig. 7. The second type of scene that is played requires the curled screen 275 to be extended so that the extended screen can carry the media assets projected by the projection component 278. See fig. 8 for details. The third is that the curl screen 275 is in an excessive state (not shown) between the rolled state and the extended state during the upward movement or the downward movement of the curl screen 275.

In some embodiments, the curled screen 275 may carry media assets projected by the projection component 278 for presentation to a user. The curled screen 275 may also be an OLED screen, displaying media assets directly to the user. The media assets can be images or videos, where the videos are presented in a frame-by-frame image, and thus in this embodiment the media assets can be collectively referred to as images. In some embodiments, the curled screen 275 may be a diffuse reflective screen, or a retro-type screen. A drive assembly 276 coupled to the curled screen 275 and configured to drive movement of the curled screen 275, the movement comprising upward movement or downward movement. The driving assembly 276 may cause the curled screen 275 to wind up or extend based on the control of the controller 250. In some embodiments, the drive assembly 276 may be a retractable track device or a motor. The motor can be respectively arranged at the left end and the right end of the screen, a scroll lifting motor can be arranged at the middle section of the screen, and the motor can be respectively arranged at the left end and the right end of the lifting screen, and meanwhile, a scroll lifting motor is arranged at the middle section of the lifting screen.

In some embodiments, the monitoring component 277 includes an image collector, and accordingly, the information monitored by the monitoring component 277 may be image information. Specifically, the monitoring component 277 includes a camera, and the corresponding monitored information may be obtained through a picture of a screen taken. The number of cameras 279 may be one or more, wherein the image capturing area of at least one camera is a curled screen area, and the camera is used for capturing pictures of a screen and a display image during lifting. When the quantity of cameras is 2, two cameras are located projection assembly's both sides respectively. In some embodiments, the camera may be rotated in a horizontal plane, rotating the taking lens to the screen orientation when it is desired to take a screen and display an image photograph; when a photograph of a user needs to be taken, the photographing lens is rotated to the user. In some embodiments, the monitoring assembly 277 includes an angle monitor to monitor the real-time rotation angle of the drive assembly 276. In some embodiments, the monitoring assembly 277 includes a gravitational acceleration sensor that monitors information from the gravitational sensor in the 3 directions of the spatial coordinate system (x, y, z) during rotation of the drive assembly 276 to obtain a corresponding pose of the drive assembly 276 at any time. The rotation angle of the drive assembly 276 is calculated from the pose. In some embodiments, the monitoring component 277 includes an infrared sensor, and the information monitored by the corresponding monitoring component 277 is whether there is a foreign object above the curled screen, and the curled screen ascent process may be suspended in time when a foreign object above the curled screen is detected.

In some embodiments, the screen curl and expand may be the screen rise from bottom to top or the screen fall from top to bottom, or the screen curl and expand from left to right or from right to left, and the direction and form of the screen curl and expand are not limited in this application.

In some embodiments, taking a screen rising during power-on as an example, a user powers up the projection assembly and the controller by pressing a power-on key of the control device or pressing a power-on key on the display device. After the controller is powered on, the sliding cover is controlled to be opened, and the screen is notified to rise to a relative zero point (offset zero). The sliding cover is used for covering the upper part of the screen in a curled state when the screen is in a rolled state, and dust is prevented from falling on the surface of the screen. Meanwhile, the controller runs a screen control system and a startup display service after being electrified, wherein the screen control system is connected with a monitoring component, and the monitoring component is used for acquiring state parameters of a driving component, so that information such as the height and the state of a screen is acquired, and the startup display service is ready to play a preset image. The preset image can be a preset picture, a preset animation or video, a preset startup advertisement and the like.

In the process of ascending the screen, the controller polls and sends an instruction to the monitoring component, so that the current state, the height and other information of the screen provided by the monitoring component are obtained. And the controller judges whether the current screen is at the position of the relative zero point according to the height and state information of the screen. If the current screen does not reach the position of the relative zero point, judging whether the difference value between the time for informing the screen to rise to the relative zero point and the current time exceeds a preset time difference; if the difference value between the time when the notification screen rises to the relative zero point and the current time does not exceed the preset time difference, continuously judging whether the current screen is at the position of the relative zero point; if the difference value between the time when the notification screen rises to the relative zero point and the current time exceeds the preset time difference, the detection is overtime, and an alarm prompt is sent out. If the current screen reaches the position of the relative zero point, the control screen rises according to a preset speed curve, and the startup display service displays a preset image according to a preset height curve. Fig. 9 is a schematic view of image projection according to one or more embodiments of the present application, as shown in fig. 9, in which a graphic image service collects layers (layers) drawn by different applications, synthesizes one image (bitmap), and sends the synthesized image to a projection component so that the projection component projects the image onto a screen. In some embodiments, the predetermined speed profile is a profile of time versus screen height, and the predetermined height profile is a profile of time versus display height of the predetermined image. The preset height profile and the preset speed profile may be consistent with each other from a relative zero point to a highest point. In some embodiments, the control screen may be raised according to a preset speed profile and the startup display service may be performed simultaneously or sequentially with playing the preset image according to a preset height profile.

In some embodiments, fig. 10A-10B are software schematic diagrams of a crimping laser device, as shown in fig. 10A, according to one or more embodiments of the present application, the software architecture includes: the geometric calculation service is used for being connected with the camera to shoot images, processing the images in real time and feeding back calculation results to the screen control system of the controller. The geometric calculation service also comprises data acquisition, data processing, feature calculation, result distribution and other plates; the screen control system is used for controlling the screen, automatically correcting the geometry and providing the screen rising state information to the upper layer application in real time. The screen control system further includes: a transport layer, a protocol layer, a service layer, etc.; the application comprises a startup animation, a setting and a shutdown animation, and the current effective display interface is controlled to be played in real time through a screen control system; the graphic image service is responsible for compositing and displaying images, and further includes: a media player, a graphics image processing module, etc.

In some embodiments, as shown in fig. 10B, the camera collects data, which is sent to the geometry computation service; the geometric calculation service calculates the curl or unfolding state of the current screen and the display area state of the laser display in real time; the display control module dynamically adjusts the speed of the left motor and the right motor according to the curled or unfolded state of the screen to achieve the aim that the screen is always horizontal; dynamically adjusting a laser projection matrix according to the state of a display area of laser display, so as to achieve the effect that the light machine projection always projects forward; the application such as starting-up animation reads the curling or unfolding state information in real time through the display control module, and dynamically adjusts the effective display area in the current service module to be highly matched with the screen display; a startup animation or the like is displayed by the graphic image service.

In some embodiments, the step of obtaining the height of the screen comprises: the controller acquires the image information of the current screen through the image collector, and measures the height of the screen according to the image information to obtain the height of the current screen. Judging whether the height of the current screen is lower than the display height of a preset image or not; the height of the current screen is obtained according to the information fed back by the monitoring component, and the display height of the preset image can be obtained according to a preset height curve and the current time.

In some embodiments, if the height of the current screen is lower than the display height of the preset image, dividing the current preset image into a first image and a second image according to the height of the screen; for example, the controller may generate the display area according to the height of the screen and the width of the screen; reading a first coordinate corresponding to the display area; the image corresponding to the first coordinate in the preset image is a second image, and the rest images are first images. And establishing a first coordinate system by taking the lower left corner of the screen as an origin. And establishing a second coordinate system by taking the lower left corner of the preset image as an origin. Fig. 11-13, 14A-14B, 15, 16A-16C, and 17 are schematic diagrams of image cropping according to one or more embodiments of the present application, as shown in fig. 11, with coordinate system 1 being a first coordinate system and coordinate system 2 being a second coordinate system. In some embodiments, when the screen is raised, the screen may be sized to be 1920 x 1080mm, and the screen may be cut into 1920 x 1080 display tiles, each of which has a known coordinate value in the first coordinate system. In the process of upward movement of the screen, at a certain moment, the controller calculates that the height of the screen is 678mm, and the first coordinate corresponding to the display area is as follows: (0, 0) (0, 1) … … (0,1920); (1, 0) (1, 1) … … (1,1920); … … (678,0) (678,1) … … (678,1920). The image corresponding to the first coordinate in the preset image is a second image, and the rest of the images are first images, which can be specifically seen in fig. 12.

In some embodiments, the screen is 1920mm x 1080mm in size as the screen is raised. In the process of upward movement of the screen, at a certain moment, the controller calculates that the height of the screen is 678mm, the image corresponding to the preset image with the height of 678mm from the bottom end is the second image, and the rest images are the first images, and specifically, refer to fig. 13. Black shading is carried out on the first image, and a processed image is obtained; for example, a floating layer window may be disposed on the upper layer of the first image, where the size of the floating layer window is equal to the size of the first image, and the floating layer window is used to load a black interface, and the finally obtained processed image may refer to fig. 14A. For another example, the color of each pixel in the first image may be set to black, and the resulting processed image may refer to fig. 14B. After the graphic image service divides and blackens the preset image, the processed image is sent to the projection component, so that the projection component projects the processed image on a screen. In some embodiments, if the height of the current screen is not lower than the display height of the preset image, continuing to raise the screen according to the preset speed profile and projecting the preset image according to the preset height profile. In the above embodiment, the projected processed image can be referred to as fig. 15 during the screen rising. In some embodiments, the methods provided by some embodiments of the present application are equally applicable to shutdown processes.

In some embodiments, if the height of the current screen is lower than the display height of the preset image, clipping the current preset image into a first image and a second image according to the height of the screen, and controlling the projection component to project the first image on the current screen; for example: and transversely cutting the preset image at the position with the height from the top end being the height of the screen to obtain a first image and a second image. And moving the first image to the lower part of the laser projection area after coordinate conversion, wherein the upper part of the laser projection area can be replaced by a full black image or full black pixels, and combining the full black image and the first image after coordinate conversion into a processed image by the graphic image service, and displaying the processed image on the current screen.

In some embodiments, the coordinate conversion is performed by subtracting the difference between the highest point of the screen and the current screen height from the ordinate of the first image, and the abscissa is unchanged. For example: when the screen is lifted, the size of the screen is 192mm or 1080mm, and the screen can be cut into 1920 or 1080 display blocks, and the coordinate value of each display block in the first coordinate system is known. In the process of upward movement of the screen, the controller calculates that the height of the screen is 678mm at a certain moment, and transversely cuts out a preset image at the position which is 678mm away from the top end, so as to obtain a first image and a second image. As shown in fig. 16A, the coordinates of the current first image are (1080,0) (1080,1) … … (1080,1920); (1079,0) (1079,1) … … (1079,1920); … … (402,0) (402,1) … … (402,1920); the difference between the highest point of the screen and the current screen height is 402, and the coordinate of the first image is (402,0) (402,1) … … (402,1920) obtained by coordinate conversion, namely subtracting 402 from the ordinate of the first image; (401,0) (401,1) … … (401,1920); … … (0, 0) (0, 1) … … (0,1920), as shown in fig. 16B. The upper portion of the laser projection area may be replaced by a full black image or full black pixels, and the graphic image service combines the full black image with the coordinate-converted first image into a processed image, as shown in fig. 16C. The graphic image service cuts out, converts coordinates and blackens the preset image, and then sends the processed image to the projection component so that the projection component projects the processed image on a screen. In the above embodiment, the projected image during the screen rising can be referred to as fig. 17. In some embodiments, the methods provided by some embodiments of the present application are equally applicable to shutdown processes.

In other embodiments, after the current screen height is obtained, the preset image is cut out to be the same as the current screen height, and only the current screen area is projected when the projection component projects the image. The mode only has laser projection at the screen, no projection exists outside the screen, the design constraint is more met, light cannot leak outside the screen, but hardware equipment such as a projection component and the like is required to be changed, and the development period is long.

In some embodiments, the user presses a start key of the control device or presses a start key on the display device, so that the projection assembly and the controller are powered on, the controller notifies the screen to ascend, the system shields sound and keys, the projection assembly does not project images, the start animation program circularly detects the current ascending state of the screen by reading GPIO and the like, and after the screen ascends to the highest point, the start animation program notifies the projection assembly to project images, releases the key shielding, releases the sound shielding and enters the main system. In some embodiments, the user powers up the projection assembly and the controller by pressing a power-on key of the control device or pressing a power-on key on the display device. The controller notifies the screen to rise while masking the key and sound. During the ascent of the front screen, the projection assembly does not project an image, but the image is still playing in the background. The purpose of shielding the keys and the sounds is to prevent the sounds attached to the images from being played or the users from pressing the keys on the control device by mistake to trigger the corresponding functions, so that the users can mistakenly cause errors to occur to the display equipment in operation, the starting-up process is delayed, and the user experience is poor. When the screen is detected to rise to a preset height, controlling the projection assembly to project a preset image and releasing the key and the sound shielding; wherein the preset height may be half of the total height of the screen.

In some embodiments, fig. 18 is a schematic diagram of a display interface according to one or more embodiments of the present application. When the screen is detected to rise to the preset height, the screen displays prompt information, prompts that the screen is started, any key is pressed to lighten the screen, and key shielding is released, at the moment, only the font is colored, and other areas are black, as shown in fig. 18. If the fact that the user displays the prompt information is detected, the key is triggered manually, the action of lighting the screen is triggered, and the projection assembly is controlled to project a preset image and remove sound shielding. The preset image rises according to a preset speed curve; acquiring the height of a screen in real time, and if the height of the screen is lower than the display height of a preset image, processing the preset image according to the height of the screen so that the display height of the preset image is matched with the rising height of the screen; if the fact that the user does not detect that the user displays the prompt information is achieved, the key is triggered manually, and after the screen rises to the highest point, the projection assembly is controlled to project a preset image and the sound shielding is relieved.

In some embodiments, the curl screen is controlled to rise according to a predetermined speed profile, wherein the predetermined speed profile is a profile of time versus curl screen height, and the predetermined height profile is a profile of time versus predetermined image display height. The curve of time and the height of the curled screen and the curve of time and the height of the preset image display can be the same or different. In some embodiments, fig. 19 is a schematic diagram of a preset speed profile according to one or more embodiments of the present application, where the preset speed profile uses default ascending profile parameters of the display device when shipped, as shown in route 1 of fig. 19. However, due to the inherent characteristics of the mechanical equipment, the north-south humiture, the winter-summer humiture and the mechanical aging effect on the machinery, the mechanical rising is lossy, and the performance of the same machinery may be different even if the performance of two mechanical equipment with the same specification is different in a long process or in different environments. There are two main aging problems at present, one is that the screen television gradually ages, the rotation speed is reduced, the screen is lifted longer than before, and the screen television is shown in a route 2 of fig. 19; the second is that the screen ages and the screen rises to a lower or higher level than the actual level, as shown by route 3 of fig. 19.

Some embodiments of the present application provide a set of ascending curve databases. The curve formula:

real-time height h=hmax (math.cos ((t/tmax+1) math.pi)/2.0 f) +0.5 f) formula 1

Wherein Hmax is the total height of the screen rising, t is the current time, and Tmax is the total duration of the screen rising.

The actual height and the rising time of each rising are used as the basis and stored in a historical database to be used as the reference basis for the next starting. The specific implementation method is as follows: 1. in interface design, an interface is designed to increase the screen according to the parameters (the current rising height, total time is used as the parameters to be transmitted to the screen end). 2. Each time the power-on machine starts, the power-on parameters (for example, the rising time, the total duration and the like are reversely deduced according to the real-time height and the curve formula). 3. Because ageing and temperature and humidity are slowly influenced, nearly 10 times of starting can be taken as the basis for calculating the initial speed, the height and the acceleration of the starting. 4. The user interface display system fits a new rising curve according to the calculated parameters. The control screen displays an image rising. And simultaneously, a serial port command is sent to the monitoring assembly to synchronously rise. 5. When the screen rises to the highest point, the parameters of the current startup are calculated into the rising curve database again for the next startup.

In some embodiments, in the process of rising the curled screen according to the preset speed curve and projecting the preset image according to the preset height curve, if no change in the height of the curled screen is detected within the preset time, stopping projecting the preset image and rising the curled screen; in some embodiments, in the process of rising the curled screen according to the preset speed curve and projecting the preset image according to the preset height curve, if the monitoring component is received to send abnormal state information, stopping projecting the preset image and stopping rising the curled screen; the height of the curled screen specifically refers to the distance between the highest point of the curled screen and the bottom (absolute zero point) of the curled screen.

In some embodiments, a method of calculating a curled screen height includes: the controller acquires the rotation number of the driving assembly through the monitoring assembly; the screen display calculating service operated by the controller calculates the height of the current curled screen according to the rotation number of the driving component, and the specific formula is as follows:

r2=r1+xh equation 2

Wherein H is the height of the current curled screen, r1 is the inner diameter of the scroll, H is the thickness of the curled screen, x is the current number of turns, and r2 is the current maximum radius.

In some embodiments, when the height of the convoluted screen has not changed within a preset time, this indicates that the screen has stuck. And controlling the curled screen to enter a reset state so as to enable the curled screen to rise again according to a preset speed curve after returning to a relative zero point, and enabling the projection assembly to project a preset image again according to a preset height curve. FIG. 20 is a schematic diagram of a velocity profile provided in accordance with one or more embodiments of the present application. In this process, a graph of time versus curl screen height is shown in fig. 20. In some embodiments, the reset state refers to the normal power-on process being re-entered after the curled screen is reduced to an absolute zero.

In some embodiments, FIG. 21 is a flow diagram of exception handling provided in accordance with one or more embodiments of the present application. As shown in fig. 21, when the screen control system polls the monitoring component for transmitting an instruction, and acquires the current state, the height and the abnormality information of the curled screen, the graphic image service is controlled to stop transmitting the image to the projection component; and controlling the curled screen to enter a reset (reset) state, and when the curled screen is lowered to an absolute zero point and then raised to a relative zero point, sending a screen raising instruction by the screen control system, controlling the curled screen to rise according to a preset speed curve, and simultaneously informing a graphic image service to send an image to a projection component according to the preset curve to be projected on the curled screen. In the process of rising the curled screen again, the screen control system still needs to poll and send instructions to the monitoring component to acquire the current state, the height and other information of the curled screen. The rising height of the curled screen and the display height of the image are kept in a synchronized state. When the curled screen rises to the highest point, the monitoring component feeds back the state to the screen control system, and the curled screen rises completely.

In some embodiments, the step of maintaining the synchronous state of the rising height of the curled screen and the display height of the image specifically includes: the height of the current curled screen is acquired in real time and compared with the display height of the image. If the height of the current curled screen is lower than the display height of the image, cutting the image into the same size as the height of the curled screen, and blackening the non-curled screen area; if the height of the current curled screen is not lower than the display height of the image, continuously rising the curled screen and displaying the image according to a preset curve. In some embodiments, in the process of rising the curled screen according to the preset speed curve and projecting the preset image according to the preset height curve, if no change in the height of the curled screen is detected within the preset time, suspending projecting the preset image and rising the curled screen;

in some embodiments, if the monitoring component sends abnormal state information in the process of rising the curled screen according to the preset curve and projecting the preset image, suspending projecting the preset image and rising the curled screen; after suspending the projection of the preset image and raising the curled screen, controlling the projection component to project a user interface on the curled screen, wherein the user interface comprises abnormal information prompt information. In some embodiments, the anomaly information prompt includes an anomaly information prompt text and an anomaly information prompt box. The abnormal information prompt box has a certain height, and the height can be set to be a preset height. The step of controlling the projection assembly to project the user interface comprises: determining an effective display area and a non-effective display area of the user interface according to the current curled screen height; black out the non-effective display area; judging whether the current height of the curled screen exceeds a preset height; if the height of the current curled screen does not exceed the preset height, setting the abnormal information prompt text at the preset position of the effective display area to obtain a processed user interface; if the current height of the curled screen exceeds the preset height, setting an abnormal information prompt box at a preset position of an effective display area to obtain a processed user interface; the projection assembly is controlled to project the processed user interface onto the curled screen.

In some embodiments, fig. 22-23 are user interface diagrams in accordance with one or more embodiments of the present application. When the height of the curled screen does not exceed the preset height, the user interface displays an abnormal information prompt text, as shown in fig. 22. When the current curl screen height exceeds the preset height, the user interface displays an anomaly information prompt box, which may be centrally displayed as shown in fig. 23. The abnormal information prompt text or the abnormal information prompt box can display an abnormal state and a fault code of the abnormal state, and further comprises a 'continue' control 141, a 'shutdown' control 142 and a 'restart' control 143. Wherein, when the user selects the "continue" control 141, the curled screen continues to perform the rising operation; when the user selects the "shutdown" control 142, the curled screen performs a lowering operation and after the curled screen is lowered to an absolute zero, the display device is powered off; when the user selects the "restart" control 143, the curled screen performs a lowering operation and re-enters the normal startup procedure after the curled screen falls to the absolute zero.

In some embodiments, after the user views the fault code from the anomaly information prompt box and knows the cause of the fault, the fault is cleared, for example: in the process of rising the curled screen, it is detected that a foreign object moves into the rising range of the curled screen, at this time, the rising of the curled screen is stopped, an abnormal information prompt box is displayed, after the foreign object moves out of the rising range of the curled screen, the user selects the "continue" control 141, and issues an instruction to continue rising the curled screen. The controller responds to the instruction of continuously rising the curled screen input by the user, and re-formulates a speed curve according to the current curled screen height, the total height of the curled screen, the rising time of the curled screen and the rising total time of the curled screen; and controlling the curled screen to rise according to the redevelophed speed curve; meanwhile, the projection component is controlled to project a preset image on the curled screen according to the speed curve. In some embodiments, the speed profile formula may be expressed as:

Real-time height h=hmax (math.cos ((t/tmax+1) math.pi)/2.0 f) +0.5 f)

Equation 3

In some embodiments, the scrolling screen rising and image display may use the same curve formula. The current curve state is determined by the incoming vertex heights Hmax and Tmax. FIG. 24 is a schematic diagram of a speed profile according to one or more embodiments of the present application, as shown in FIG. 24, and the method of re-plotting the speed profile is as follows: when the screen is abnormally stopped, the screen is continuously lifted by fault recovery, the left lifting time period T2=T-T1 can be obtained according to the lifted time T1 before the fault in order to ensure that the total lifting time T is unchanged, and the left lifting time period H2= H-H1 can be obtained according to the lifted time H1 before the fault in order to ensure that the total lifting height H is unchanged. The operation curve formula during the recovery is calculated as follows:

h=h2 (math.cos ((T/t2+1) ×math.pi)/2.0 f) +0.5 f) formula 4

In some embodiments, fig. 25 is an exception handling flowchart according to one or more embodiments of the present application, as shown in fig. 25, when a screen control system polls a monitoring component for sending instructions, and after obtaining the current state, height and exception information of a curled screen, a graphical image service is controlled to suspend sending images to a projection component; controlling the graphic image service to send an abnormal information prompt box to the projection component; after the fault is removed, the user sends out an instruction for continuously lifting the curled screen; the screen control system can send the re-formulated speed curve and the screen rising instruction to the driving component, the driving component controls the rising of the curled screen according to the re-formulated rising curve, and meanwhile, the graphic image service is informed to send the image to the projection component to be projected on the curled screen according to the re-formulated rising curve. In the process of continuously rising the curled screen, the screen control system still needs to poll and send instructions to the monitoring component to acquire the current state, the height and other information of the curled screen. The rising height of the curled screen and the display height of the image are kept in a synchronized state. When the curled screen rises to the highest point, the monitoring component feeds back the state to the screen control system, and the curled screen rises completely. In some embodiments, the above method is also applicable to the case that the curled screen is lowered when the machine is turned off, and will not be described herein.

During the rising or falling of the curled screen, an unexpected power failure may occur, so that the curled screen is stopped at a position other than the absolute zero point. When the device is restarted, the controller responds to a starting instruction input by a user, detects that the current curled screen is not at an absolute zero position, and in some embodiments, controls the curled screen to enter a reset state so as to enable the curled screen to rise again according to a preset speed curve after returning to the relative zero position, and the projection component projects a preset image again according to a preset height curve. In some embodiments, the rising curve is formulated based on the current curled screen height and the curled screen total height; the time for rising to the current curled screen height can be determined according to the current curled screen height and a preset curve, the time corresponding to the current height is subtracted from the total rising time, the time required for rising to the highest point from the current position can be obtained, and the speed curve and the height curve can be drawn again. Controlling the curled screen to rise according to the redevelopred speed curve; the projection component is controlled to project a preset image on the curled screen according to the redefined height curve.

In the process of rising the curled screen again, the screen control system still needs to poll and send instructions to the monitoring component to acquire the current state, the height and other information of the curled screen. The rising height of the curled screen and the display height of the image are kept in a synchronized state. When the curled screen rises to the highest point, the monitoring component feeds back the state to the screen control system, and the curled screen rises completely.

Some embodiments of the present application provide an image clipping method applied to any one of the above display devices, where the method includes: determining the height of the current screen according to the state information of the screen in the process that the screen is unfolded or curled according to a preset speed curve and the projection component projects a preset image according to a preset height curve; if the height of the current screen is lower than the display height of the preset image, dividing the preset image into a first image and a second image according to the height of the current screen, wherein the height of the second image is not greater than the height of the current screen; and controlling the projection assembly to project a preset image so that the screen only displays the second image.

In some embodiments, an image cropping method includes: if the height of the screen is not lower than the display height of the preset image, continuing to expand or curl the screen according to the preset speed curve and projecting the preset image according to the preset height curve.

In some embodiments, an image cropping method includes: setting a floating layer window loaded with a black interface on the upper layer of the first image, or setting the pixel point of the first image to be black to obtain a processed preset image; and controlling the projection assembly to project the processed preset image.

In some embodiments, an image cropping method includes: the state information of the screen comprises the number of rotations of the driving assembly or the image information of the screen, and the height of the current screen is calculated according to the number of rotations of the driving assembly; or determining the height of the current screen according to the image information of the screen.

In some embodiments, an image cropping method includes: determining the height of the current screen according to the state information of the screen in the process that the screen is unfolded or curled according to a preset speed curve and the projection component projects a preset image according to a preset height curve; if the height of the current screen is lower than the display height of the preset image, cutting the preset image into a first image and a second image according to the height of the current screen, wherein the height of the first image is not greater than the height of the current screen; and performing coordinate conversion processing on the first image so that the screen displays the first image.

In some embodiments, an image cropping method includes: the state information of the screen comprises the rotation number of the driving assembly, and the height of the current screen is calculated according to the rotation number of the driving assembly.

In some embodiments, an image cropping method includes: shielding keys and sounds in the process that the screen is unfolded according to a preset speed curve; when the screen height is detected to reach the preset height, controlling the projection assembly to project a preset image according to a preset height curve and removing keys and sound shielding; if the height of the screen is lower than the display height of the preset image, dividing the preset image into a first image and a second image according to the height of the current screen, wherein the height of the second image is not greater than the height of the current screen; and controlling the projection assembly to project a preset image so that the screen only displays the second image.

In some embodiments, an image cropping method includes: shielding keys and sounds in the process that the screen is unfolded according to a preset speed curve; when the screen height is detected to reach the preset height, controlling the projection assembly to project a preset image according to a preset height curve and removing keys and sound shielding; if the height of the current screen is lower than the display height of the preset image, cutting the preset image into a first image and a second image according to the height of the current screen, wherein the height of the first image is not greater than the height of the current screen; and performing coordinate conversion processing on the first image so that the screen displays the first image.

The specific image cropping method can be found in the embodiments of the display device described above, and will not be described in detail here.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the above discussion in some examples is not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

A display device, comprising:

a projection assembly;

a screen configured to be curlable up and down;

a driving assembly for driving the screen to be unfolded or curled;

the monitoring component is used for monitoring state information in the process of unfolding or curling the screen and feeding back the state information of the screen to the controller;

a controller for performing:

determining the height of the current screen according to the state information of the screen in the process that the screen is unfolded or curled according to a preset speed curve and the projection component projects a preset image according to a preset height curve;

If the height of the current screen is lower than the display height of the preset image, dividing the preset image into a first image and a second image according to the height of the current screen, wherein the height of the second image is not greater than the height of the current screen;

and controlling the projection assembly to project a preset image so that the screen only displays the second image.
The display device of claim 1, the controller further to perform:

if the height of the screen is not lower than the display height of the preset image, continuing to expand or curl the screen according to the preset speed curve and projecting the preset image according to the preset height curve.
The display apparatus according to claim 1, the controller performing control of the projection assembly to project a preset image such that the screen displays only the second image by:

setting a floating layer window loaded with a black interface on the upper layer of the first image, or setting the pixel point of the first image to be black to obtain a processed preset image;

and controlling the projection assembly to project the processed preset image.
The display apparatus of claim 1, the status information of the screen including a number of rotations of the driving assembly or image information of the screen, the controller performing the determining of the height of the current screen according to the status information of the screen by:

Calculating the height of the current screen according to the rotation number of the driving assembly;

or determining the height of the current screen according to the image information of the screen.
The display device of claim 1, the controller to perform:

determining the height of the current screen according to the state information of the screen in the process that the screen is unfolded or curled according to a preset speed curve and the projection component projects a preset image according to a preset height curve;

if the height of the current screen is lower than the display height of the preset image, cutting the preset image into a first image and a second image according to the height of the current screen, wherein the height of the first image is not greater than the height of the current screen;

and performing coordinate conversion processing on the first image so that the screen displays the first image.
The display device of claim 5, the controller further to perform:

if the height of the screen is not lower than the display height of the preset image, continuing to expand or curl the screen according to the preset speed curve and projecting the preset image according to the preset height curve.
The display apparatus of claim 5, the status information of the screen including a number of rotations of the driving assembly, the controller performing the determining of the height of the current screen according to the status information of the screen by:

And calculating the height of the current screen according to the rotation number of the driving assembly.
The display apparatus of claim 5, the status information of the screen including image information of the screen, the controller performing the determining of the height of the current screen according to the status information of the screen in the following manner:

and determining the height of the current screen according to the image information of the screen.
The display device of claim 1, the controller to perform:

shielding keys and sounds in the process that the screen is unfolded according to a preset speed curve;

when the screen height is detected to reach the preset height, controlling the projection assembly to project a preset image according to a preset height curve and removing keys and sound shielding;

if the height of the screen is lower than the display height of the preset image, dividing the preset image into a first image and a second image according to the height of the current screen, wherein the height of the second image is not greater than the height of the current screen;

and controlling the projection assembly to project a preset image so that the screen only displays the second image.
The display device of claim 1, the controller to perform:

shielding keys and sounds in the process that the screen is unfolded according to a preset speed curve;

When the screen height is detected to reach the preset height, controlling the projection assembly to project a preset image according to a preset height curve and removing keys and sound shielding;

if the height of the current screen is lower than the display height of the preset image, cutting the preset image into a first image and a second image according to the height of the current screen, wherein the height of the first image is not greater than the height of the current screen;

and performing coordinate conversion processing on the first image so that the screen displays the first image.
A method of image cropping for a display device, the method comprising:

in the process that the screen of the display device is unfolded or curled according to a preset speed curve and the projection component projects a preset image according to a preset height curve, determining the height of the current screen according to the state information of the screen;

if the height of the current screen is lower than the display height of the preset image, dividing the preset image into a first image and a second image according to the height of the current screen, wherein the height of the second image is not greater than the height of the current screen;

and controlling the projection assembly to project a preset image so that the screen only displays the second image.
The method of claim 11, comprising:

if the height of the screen is not lower than the display height of the preset image, continuing to expand or curl the screen according to the preset speed curve and projecting the preset image according to the preset height curve.
The method of claim 11, comprising:

setting a floating layer window loaded with a black interface on the upper layer of the first image, or setting the pixel point of the first image to be black to obtain a processed preset image;

and controlling the projection assembly to project the processed preset image.
The method of claim 11, comprising:

the state information of the screen comprises the number of rotations of the driving assembly or the image information of the screen, and the height of the current screen is calculated according to the number of rotations of the driving assembly; or determining the height of the current screen according to the image information of the screen.
The method of claim 11, comprising:

determining the height of the current screen according to the state information of the screen in the process that the screen is unfolded or curled according to a preset speed curve and the projection component projects a preset image according to a preset height curve;

if the height of the current screen is lower than the display height of the preset image, cutting the preset image into a first image and a second image according to the height of the current screen, wherein the height of the first image is not greater than the height of the current screen;

And performing coordinate conversion processing on the first image so that the screen displays the first image.
The method of claim 15, comprising:

if the height of the screen is not lower than the display height of the preset image, continuing to expand or curl the screen according to the preset speed curve and projecting the preset image according to the preset height curve.
The method of claim 15, comprising:

the state information of the screen comprises the rotation number of the driving assembly, and the height of the current screen is calculated according to the rotation number of the driving assembly.
The method of claim 11, comprising:

shielding keys and sounds in the process that the screen is unfolded according to a preset speed curve;

when the screen height is detected to reach the preset height, controlling the projection assembly to project a preset image according to a preset height curve and removing keys and sound shielding;

if the height of the screen is lower than the display height of the preset image, dividing the preset image into a first image and a second image according to the height of the current screen, wherein the height of the second image is not greater than the height of the current screen;

and controlling the projection assembly to project a preset image so that the screen only displays the second image.
The method of claim 11, comprising:

shielding keys and sounds in the process that the screen is unfolded according to a preset speed curve;

when the screen height is detected to reach the preset height, controlling the projection assembly to project a preset image according to a preset height curve and removing keys and sound shielding;

if the height of the current screen is lower than the display height of the preset image, cutting the preset image into a first image and a second image according to the height of the current screen, wherein the height of the first image is not greater than the height of the current screen;

and performing coordinate conversion processing on the first image so that the screen displays the first image.