CN112698905B

CN112698905B - Screen saver display method, display device, terminal device and server

Info

Publication number: CN112698905B
Application number: CN202110031013.5A
Authority: CN
Inventors: 苑衍梅; 刘承龙; 李东航
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2021-01-11
Filing date: 2021-01-11
Publication date: 2023-07-14
Anticipated expiration: 2041-01-11
Also published as: CN112698905A

Abstract

The invention discloses a screen saver display method, display equipment, terminal equipment and a server, wherein a screen picture card is displayed in response to receiving indication information sent by the terminal equipment, so that the terminal equipment acquires a first image, and the first image comprises the screen picture card and a background area image of the periphery of the screen picture card; the indication information is sent by the terminal equipment after receiving the customized screen saver operation input by the user; the method comprises the steps that a receiving server generates and sends a first screen saver image according to the first image, and if intelligent information is started to be displayed, a target pattern is obtained according to attribute characteristics of the first screen saver image and preset intelligent information; and displaying the intelligent information on the first screen saver image according to the target style. When the screen protection is needed, the first screen protection image can be displayed, and the intelligent information is displayed on the first screen protection image according to the target style, so that the matching degree of the intelligent information and the screen protection attribute characteristics is higher, and the screen protection display effect of the fusion screen is improved.

Description

Screen saver display method, display device, terminal device and server

Technical Field

The present invention relates to the field of display devices, and in particular, to a screen saver display method, a display device, a terminal device, and a server.

Background

The screen saver application can be installed in the display equipment, and the screen saver application can comprise screen saver images which are pushed regularly by the background and customized by a user, and when the equipment does not detect an operation signal input by the user within a certain time, the current screen saver image is loaded on a screen to be displayed, so that the purpose of protecting the screen is achieved.

In some application scenes, wall paper may be attached to the television background wall, for example, the wall paper is in pure color or has pattern, so that screen saver images consistent with the wall paper can be displayed for improving the visual effect of screen saver display, and thus the television background wall and the screen wallpaper are in fusion matching effect in the presence of a user, that is, a fusion screen is realized, but the screen saver display under the current fusion screen cannot be well matched with the television background wall wallpaper.

Disclosure of Invention

In order to solve the problems in the background art, the invention provides a screen saver display method, a display device, a terminal device and a server.

The display device provided in the first aspect includes:

a display for displaying the screen graphics card and the screen saver image;

The communicator is used for being in communication connection with the server and the terminal equipment;

a controller configured to perform:

in response to receiving indication information sent by the terminal equipment, controlling a display to display a screen graphics card, so that the terminal equipment acquires a first image, wherein the first image comprises the screen graphics card and a background area image of the periphery of the screen graphics card; the indication information is sent by the terminal equipment after receiving the customized screen saver operation input by the user;

the method comprises the steps that a receiving server generates and sends a first screen saver image according to the first image, and if intelligent information is started to be displayed, a target pattern is obtained according to attribute characteristics of the first screen saver image and preset intelligent information;

and controlling a display to display the intelligent information on the first screen saver image according to the target pattern.

The terminal device provided in the second aspect includes:

a display for displaying a relevant interface of the customized screen saver image;

the image acquisition device is used for shooting a first image, wherein the first image comprises a screen image card displayed by display equipment and a background area image at the periphery of the screen image card;

a communicator for communication connection with the display device and the server;

A controller configured to perform:

responding to the customized screen saver operation input by a user, sending indication information to display equipment, and controlling an image collector to collect a first image; the indication information is used for indicating the display equipment to display the screen graphic card;

and sending the first image to a server so that the server generates a first screen saver image according to the first image, sending the first screen saver image to a display device, acquiring a target pattern according to the attribute characteristics of the first screen saver image and preset intelligent information when the display device starts to display the intelligent information, and displaying the intelligent information on the first screen saver image according to the target pattern.

The server provided in the third aspect includes:

a communicator for communication connection with the display device and the terminal device;

a controller configured to perform:

receiving a first image sent by a terminal device, wherein the first image comprises a screen image card displayed by a display device and a background area image at the periphery of the screen image card;

identifying a screen position area of the display device in the first image according to the screen graphic card;

acquiring target features contained in a background wall where display equipment is located according to the background area image, and generating a matched first screen saver image according to the target features and the screen position area;

And sending the first screen saver image to a display device, so that when the display device starts to display intelligent information, a target pattern is obtained according to the attribute characteristics of the first screen saver image and preset intelligent information, and the intelligent information is displayed on the first screen saver image according to the target pattern.

A screen saver display method in a display device provided in a fourth aspect includes:

in response to receiving indication information sent by the terminal equipment, displaying a screen image card so that the terminal equipment acquires a first image, wherein the first image comprises the screen image card and a background area image of the periphery of the screen image card; the indication information is sent by the terminal equipment after receiving the customized screen saver operation input by the user;

and displaying the intelligent information on the first screen saver image according to the target style.

The screen saver display method in the terminal device provided in the fifth aspect includes:

responding to the customized screen saver operation input by a user, sending indication information for indicating the display equipment to display a screen graphic card to the display equipment, and acquiring a first image; the first image comprises a background area image of the screen image card and the periphery of the screen image card;

The screen saver display method in the server provided in the sixth aspect includes:

The technical scheme is suitable for the display equipment supporting the screen saver function under the fusion screen, interaction relates to the display equipment, a server and terminal equipment, after a user inputs customized screen saver operation through the terminal equipment, the terminal sends indication information to the display equipment, the display equipment displays a screen picture card after receiving the indication information, at the moment, the terminal equipment enters a shooting interface, the user adjusts the position of the terminal through shooting preview, and shoots to obtain a first image, the first image comprises the screen picture card for identifying a screen position area, and the peripheral area of the screen picture card is a background area image of a background wall part where the display equipment is located. The terminal uploads the shot first image to a server, the server calculates the first image, generates a first screen saver image which can be fused and matched with the background wall pattern, and sends the first screen saver image to a display device side. When the screen saver setting is carried out at the display equipment end, a user can pre-select to start or close the function of displaying the intelligent information according to the requirement, and when the intelligent information is started to be displayed, the type and the quantity of the intelligent information to be displayed can be set, for example, the intelligent information can be weather, clock, equipment information of the intelligent equipment obtained by the association of the display equipment and the like. The display device can acquire a target style according to preset intelligent information and attribute characteristics of the first screen saver image, wherein the attribute characteristics are pure colors or colors, the target style relates to the display effect of the intelligent information on the first screen saver image, when the user customizes the first screen saver image, the first screen saver image can be displayed when the user needs to display the screen saver image, the intelligent information is displayed on the first screen saver image according to the target style, and the matching degree of the intelligent information and the attribute characteristics of the screen saver is higher, so that the screen saver display effect of the fusion screen is improved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following description will briefly explain the drawings required for the embodiments, and it is apparent that the drawings in the following description are only some embodiments of the present invention and that other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 illustrates a usage scenario of a display device according to some embodiments;

fig. 2 shows a hardware configuration block diagram of the control apparatus 100 according to some embodiments;

fig. 3 illustrates a hardware configuration block diagram of a display device 200 according to some embodiments;

FIG. 4 illustrates a software configuration diagram in a display device 200 according to some embodiments;

FIG. 5 illustrates an icon control interface display diagram for an application in a display device 200 according to some embodiments;

FIG. 6 is a schematic diagram illustrating a display device side screen saver setup page;

a schematic of a course page for a display device AI customizing a television wall screen saver is shown schematically in fig. 7;

FIG. 8 is a schematic diagram illustrating an operational description page of a terminal device customized screen saver;

a schematic diagram of the terminal device capturing a first image is exemplarily shown in fig. 9;

A schematic diagram when the terminal device successfully uploads the first image is exemplarily shown in fig. 10;

fig. 11 is an interface schematic diagram of a display device side when the terminal device successfully uploads the first image;

FIG. 12 is a schematic diagram illustrating a screen saver setup page after a display device receives a first screen saver image;

a schematic diagram of a display device displaying a first screen saver image is illustrated in fig. 13;

FIG. 14 schematically illustrates a display device when a first screen saver image is not received;

a schematic diagram of the display effect when the first screen saver image is a flower background is exemplarily shown in fig. 15;

FIG. 16 is a schematic diagram illustrating a display effect when the first screen saver image is a solid background;

an interactive flow chart of a screen saver display method is illustrated in FIG. 17;

an interactive flow chart of another screen saver display method is illustrated in FIG. 18;

FIG. 19 (a) is a schematic diagram illustrating a screen saver image of a rhomboid flower background;

FIG. 19 (b) is a schematic diagram illustrating a screen saver image of an gradient type flower background;

FIG. 20 (a) schematically illustrates a partial color drawing of FIG. 19 (a);

FIG. 20 (b) schematically illustrates another partial color rendering of FIG. 19 (a);

fig. 20 (c) schematically shows a partial color drawing of fig. 19 (b).

Detailed Description

For purposes of clarity and implementation of the present application, the following description will make clear and complete descriptions of exemplary implementations of the present application with reference to the accompanying drawings in which exemplary implementations of the present application are illustrated, it being apparent that the exemplary implementations described are only some, but not all, of the examples of the present application.

It should be noted that the brief description of the terms in the present application is only for convenience in understanding the embodiments described below, and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms "first," second, "" third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for limiting a particular order or sequence, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the function associated with that element.

Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in fig. 1, the display device 200 is also in data communication with a server 400, and a user can operate the display device 200 through the smart device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display apparatus 200 by inputting a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, and the like.

In some embodiments, the smart device 300 may include any one of a mobile terminal, tablet, computer, notebook, AR/VR device, etc.

In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device.

In some embodiments, the smart device 300 and the display device may also be used for communication of data.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control apparatus configured outside the display device 200 device.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

In some embodiments, software steps performed by one step execution body may migrate on demand to be performed on another step execution body in data communication therewith. For example, software steps executed by the server may migrate to be executed on demand on a display device in data communication therewith, and vice versa.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200.

In some embodiments, the communication interface 130 is configured to communicate with the outside, including at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module.

In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, keys, or an alternative module.

Fig. 3 shows a hardware configuration block diagram of the display device 200 in accordance with an exemplary embodiment.

In some embodiments, display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, memory, a power supply, a user interface.

In some embodiments the controller comprises a central processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, for receiving an image signal from the controller output, for displaying video content, image content, and components of a menu manipulation interface, and a user manipulation UI interface, etc.

In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, the modem 210 receives broadcast television signals via wired or wireless reception and demodulates audio-video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, or the like. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other operable control. The operations related to the selected object are: displaying an operation of connecting to a hyperlink page, a document, an image, or the like, or executing an operation of a program corresponding to the icon.

In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), video processor, audio processor, graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.

A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions received from the outside, so as to finally display and play various audio and video contents. The CPU processor may include a plurality of processors. Such as one main processor and one or more sub-processors.

In some embodiments, a graphics processor is used to generate various graphical objects, such as: at least one of icons, operation menus, and user input instruction display graphics. The graphic processor comprises an arithmetic unit, which is used for receiving various interactive instructions input by a user to operate and displaying various objects according to display attributes; the device also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the video processor is configured to receive an external video signal, perform at least one of decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image composition, and the like according to a standard codec protocol of an input signal, and obtain a signal that is displayed or played on the directly displayable device 200.

In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image compositing module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the demultiplexed video signal, including decoding, scaling and the like. And an image synthesis module, such as an image synthesizer, for performing superposition mixing processing on the graphic generator and the video image after the scaling processing according to the GUI signal input by the user or generated by the graphic generator, so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received frame rate into a video output signal and changing the video output signal to be in accordance with a display format, such as outputting RGB data signals.

In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode according to a standard codec protocol of an input signal, and at least one of noise reduction, digital-to-analog conversion, and amplification, to obtain a sound signal that can be played in the speaker.

In some embodiments, a user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

In some embodiments, a "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include at least one of a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

In some embodiments, the user interface 280 is an interface (e.g., physical keys on a display device body, or the like) that may be used to receive control inputs.

In some embodiments, a system of display devices may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together form the basic operating system architecture that allows users to manage files, run programs, and use the system. After power-up, the kernel is started, the kernel space is activated, hardware is abstracted, hardware parameters are initialized, virtual memory, a scheduler, signal and inter-process communication (IPC) are operated and maintained. After the kernel is started, shell and user application programs are loaded again. The application program is compiled into machine code after being started to form a process.

Referring to FIG. 4, in some embodiments, the system is divided into four layers, from top to bottom, an application layer (referred to as an "application layer"), an application framework layer (Application Framework layer) (referred to as a "framework layer"), a An Zhuoyun row (Android run) and a system library layer (referred to as a "system runtime layer"), and a kernel layer, respectively.

In some embodiments, at least one application program is running in the application program layer, and these application programs may be a Window (Window) program of an operating system, a system setting program, a clock program, or the like; or may be an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.

The framework layer provides an application programming interface (application programming interface, API) and programming framework for application programs of the application layer. The application framework layer includes a number of predefined functions. The application framework layer corresponds to a processing center that decides to let the applications in the application layer act. Through the API interface, the application program can access the resources in the system and acquire the services of the system in the execution.

As shown in fig. 4, the application framework layer in the embodiment of the present application includes a manager (manager), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used to interact with all activities that are running in the system; a Location Manager (Location Manager) is used to provide system services or applications with access to system Location services; a Package Manager (Package Manager) for retrieving various information about an application Package currently installed on the device; a notification manager (Notification Manager) for controlling the display and clearing of notification messages; a Window Manager (Window Manager) is used to manage bracketing icons, windows, toolbars, wallpaper, and desktop components on the user interface.

In some embodiments, the activity manager is used to manage the lifecycle of the individual applications as well as the usual navigation rollback functions, such as controlling the exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of the display screen, judging whether a status bar exists or not, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window to display, dithering display, distorting display, etc.), etc.

In some embodiments, the system runtime layer provides support for the upper layer, the framework layer, and when the framework layer is in use, the android operating system runs the C/C++ libraries contained in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the kernel layer contains at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

In some embodiments, the display device may directly enter the preset vod program interface after being started, where the vod program interface may include at least a navigation bar 510 and a content display area located below the navigation bar 510, as shown in fig. 5, where the content displayed in the content display area may change with the change of the selected control in the navigation bar. The program in the application program layer can be integrated in the video-on-demand program and displayed through one control of the navigation bar, and can be further displayed after the application control in the navigation bar is selected.

In some embodiments, the display device may directly enter the display interface of the signal source selected last time after being started, or the signal source selection interface, where the signal source may be a preset video on demand program, or may be at least one of an HDMI interface, a live tv interface, etc., and after the user selects a different signal source, the display may display the content obtained from the different signal source.

The above embodiments introduce the content of the hardware/software architecture, the functional implementation, etc. of the display device. In some application scenarios, the display device may install a screen saver application in which a user may set a screen saver image and a screen saver effect desired to be displayed.

In some embodiments, after the user opens the screen saver application, the user may enter a screen saver setting page as illustrated in fig. 6, where the interface supports the user to set a timed screen saver, for example, when the timed screen saver is set to 2 minutes, the user may start to display the screen saver when the display device detects no user operation input within 2 minutes, and may select a screen saver mode, such as a picture album mode or a television wall mode, where the picture album mode is a conventional screen saver mode, and the television wall mode may implement fusion matching of screen wallpaper and background wallpaper. For example, when the television wall mode is selected, a screen saver sequence is displayed on the page, and the screen saver sequence generally comprises preset screen saver images of the display device (i.e. wallpaper carried by the device when the device leaves a factory), screen saver images issued by a server corresponding to the screen saver application (i.e. wallpaper pushed by an application background) and screen saver images customized by a user. FIG. 6 illustrates a case where only preset screen saver images are included in a screen saver sequence, and the screen saver images having focus in the screen saver sequence are in a selected state, and when the condition for displaying the screen saver is satisfied, the screen saver images currently in the selected state are loaded and displayed.

In some embodiments, the user may also set an intelligent information display, and the screen saver setting page has an intelligent information switch control therein, and when the user operates the switch control to an off state, the screen of the display device only displays the screen saver image, and does not display any intelligent information. When the user operates the switch control to be in an on state, the type and the quantity of the intelligent information can be selected according to personal requirements, the type of the intelligent information comprises but is not limited to weather, clock, background music, equipment information of AIOT (Artificial Intelligence & Internet of Things, artificial intelligent Internet of things) equipment and the like, and the intelligent information selected by the user is displayed on the screen saver image according to a preset style and layout of the application. The weather information can display the contents such as the current temperature, weather conditions and the like of the place where the display equipment is located; the clock displays the current time in a clock mode; the user can set background music so as to play the background music at the same time when the screen saver image is displayed; the AIOT device can be intelligent devices in the Internet of things of home, such as an intelligent air conditioner, a water heater, a sweeping robot, an intelligent washing machine, an intelligent refrigerator and the like, and the display device can acquire device information of other intelligent devices through AIOT association, wherein the device information is information such as an appearance image, a current working state and the like of the intelligent devices. By opening the display of the intelligent information, the user can know weather, time and related information of the intelligent device in the screen protection state of the display device, and the user use experiment is promoted.

In some embodiments, in order to avoid poor screen protection effect caused by excessive display quantity of intelligent information due to numerous AIOT devices involved in a home scene, an upper display limit of device information of the AIOT devices may be set, for example, a maximum of 4 AIOT devices are supported to be selected, and when the number of AIOT devices selected by a user exceeds the upper limit, a toast prompts "add 4 AIOT devices at maximum". When the equipment information of the AIOT equipment is displayed, the real user equipment needs to be displayed, and if the network abnormality or the account number is not logged in and other problems exist, the virtual equipment can be displayed.

In some embodiments, when a user selects a tv wall mode, a matched screen saver image may be AI customized according to wallpaper or background effect of a current tv wall, a screen saver setting page has a first screen saver customization control, that is, "AI customization" in fig. 6, the user clicks the control, that is, inputs a customized screen saver operation, at this time, the display device may jump to a course page as shown in fig. 7, information such as an operation flow and notes for guiding the user AI to customize the screen saver image matched with the tv wall may be displayed in the course page, in this application, the screen saver AI customization in the tv wall mode requires interaction of the terminal device, the user takes a picture of the tv wall including the tv screen by using the terminal device, and reports the picture to the server to identify and generate the matched screen saver image, which requires that the display device and the terminal device are connected to the same WiFi network. The user can cooperate with the screen saver image of the customized television wall through the target application program corresponding to the terminal equipment, for example, a glowing application is opened, and the user enters a relevant screen saver customization operation interface through the operation path of My common tool TV wall, so that the screen saver customization is completed according to the application operation prompt in the terminal equipment. The tutorial page of fig. 7 may display a two-dimensional code of the target application in the mobile terminal, and the user may install and use the target application by scanning the two-dimensional code using the terminal device. The terminal equipment in the application comprises mobile terminals such as smart phones, tablet computers and the like.

In some embodiments, after viewing the tutorial page displayed by the display device, the user may scan the two-dimensional code installation target application, directly access the portal of the customized television wall screen saver if the target application has been previously installed, and the terminal device jumps to the operation instruction page as shown in fig. 8. The operation instruction page can display prompt information, such as 'a mobile phone shoots a television wall photo and uploads the television wall photo, intelligent recognition is performed to generate a screen saver matched with a home background', a second screen saver customization control is arranged in the operation instruction page, namely 'starting customization', in fig. 8, when a user clicks 'starting customization', shooting preview of a terminal camera is automatically started, meanwhile, the terminal equipment also needs to send indication information to a display device, and after the indication information is received by the display device, a UI is switched to a display screen picture card from a course page.

In some embodiments, as shown in fig. 9, a camera of the terminal device (generally, a rear camera is adopted) faces a television wall, a screen image card is displayed on the display device, the screen image card generally includes a plurality of cross feature points arranged in an array for identifying a screen position area, the periphery of a frame of the screen is a background wall of the television, and the background wall can be solid color or has texture effects such as patterns and patterns; the terminal equipment enters into shooting preview at the moment, a rectangular positioning wire frame is arranged in a shooting preview interface, the positioning wire frame is consistent with the aspect ratio of a screen of the display equipment, a user adjusts the shooting position and angle of the terminal by operating limbs, so that a screen picture card in the shooting preview is just positioned in the rectangular positioning wire frame, a local background area of a television wall is positioned outside the boundary line of the positioning wire frame, and the local background area can carry attribute characteristics such as color, texture and pattern of the background wall, thereby being convenient for subsequent customization to generate a matched screen saver image. When the terminal equipment recognizes that the television screen is positioned in the positioning wire frame, the user can be prompted to click a shooting control to shoot, for example, prompt information of 'please click on a right shooting button' is displayed, at the moment, the shot image comprises a screen picture card and a background area at the periphery of the screen picture card, the image is named as a first image in the application, and the terminal equipment automatically uploads the first image to a server after collecting the first image. If the screen image card is not in the positioning wire frame or is not completely in the positioning wire frame, the shooting control is not available, so that the first image acquisition error caused by false triggering of the shooting control when the shooting position is not positioned by a user is avoided. The rectangular positioning wire frame can be set at the center of the shooting preview interface or at other positions.

In some embodiments, after the terminal device shoots and uploads the first image to the server, if the uploading is successful, the terminal device switches to an interface as shown in fig. 10, in which the terminal device may be prompted to end-user customization operation completion information, such as "completed, quick-going tv end view customized screen saver bar", to indicate that the first image has been uploaded to the server, and since the server needs to process and generate the customized screen saver image (i.e. the first screen saver image named in the present application) after receiving the first image, the display device end displays the waiting and loading effect as shown in fig. 11 at this time, and after receiving the first screen saver image, the display device end may load to successfully display the first screen saver image.

In some embodiments, after the display device receives the first screen saver image generated and sent by the server, the first screen saver image is stored, as shown in fig. 12, the first screen saver image may be inserted into the first position of the screen saver sequence, and meanwhile, the first screen saver image is marked as a selected state, and when the condition of displaying the screen saver is met, the display device displays the first screen saver image in the selected state currently, so that the customized first screen saver image and the television wall have an integrated effect, and if the intelligent information switch is turned on, the intelligent information preset by the user needs to be displayed on the first screen saver image in a superimposed manner.

In some embodiments, the screen saver sequences may be ordered according to a certain priority, for example, the first screen saver image customized by the user is placed in the first order and the first order of the screen saver sequence, then the preset screen saver image and the screen saver image issued by the server are respectively arranged, that is, the screen saver customized by the user has the highest priority, and then the screen saver issued by the preset screen saver and the server is arranged. The display order of the screen saver sequence is not limited.

In some embodiments, the user clicks the "AI customization" control to customize the first screen saver image that is fusion matched to the television wall; if the user clicks on any one of the images in the screen saver sequence, the focus in the selected state is switched and a screen saver preview of the clicked image is displayed.

In some embodiments, if the display device receives the first screen saver image, as shown in fig. 13, the first screen saver image is displayed on a screen, and a setting control, such as "remove setting" in fig. 13, may be further provided on the first screen saver image, and the user clicks the setting control on the interface on which the first screen saver image is displayed, so that the user may directly enter the screen saver setting page, so as to facilitate the user to quickly switch the screen saver image and the setting options for adjusting the screen saver effect thereof.

In some embodiments, the display device may not receive the first screen saver image sent by the server due to some abnormal factors, for example, the server itself does not successfully generate the first screen saver image, or the display device may not display the first screen saver image customized currently because of network abnormality, and the display device may display a prompt message of failure in downloading the screen saver image, for example, "current network abnormality, failure in downloading the screen saver image, please check the network and retry", and display a set network control in the interface, and when the user clicks "set network", check and reconnect the network. After the network is recovered to be normal, if the received first screen protection image is displayed on the screen, if the first screen protection image still cannot be received, the fact that the acquisition of the customized image is failed due to non-network factors is indicated, and the customization can be retried according to the mode.

In practical application, as the background of the television wall is different, for example, the television wall is a solid background, and for some television wall is a colored background with patterns, figures, stripes and other textures, the first screen saver image generated by matching has corresponding attribute characteristics, and under the condition of starting to display intelligent information, for example, a set of thick and solid intelligent information is displayed on the first screen saver image with the solid background, people can feel abrupt visually, and the visual aesthetic feeling of users can not be met; for example, a set of intelligent information with transparent patterns is displayed on the first screen saver image with the background of the color, and especially when the color is complex, the user may not be able to see the intelligent information with transparent effects on the first screen saver image. In this regard, in the solution of the present application, after the display device receives the first screen saver image, it is necessary to analyze the attribute characteristics of the first screen saver image, identify whether the first screen saver image is a solid color background or a color (non-solid color) background, and then combine the type and the number of the intelligent information preset by the user to obtain the target style used when the intelligent information is displayed.

In some embodiments, as shown in fig. 15, when the first screen saver image is a color background, the intelligent information is displayed on the first screen saver image in a superimposed manner by adopting a relatively thick entity pattern, in fig. 15, the preset intelligent information of the user includes weather, a clock and an AIOT device, the AIOT device includes a washing machine, a sweeping robot and a water heater, the intelligent information is displayed according to a preset layout entity applied by the screen saver, the preset layout in fig. 15 is that the clock is in the center of the wallpaper, the left side of the wallpaper displays the time of the weather and the clock, the right side of the wallpaper vertically displays the device information of the washing machine, the sweeping robot and the water heater, and the device information may include a real picture of the device, a name of the device and a current working state of the device, for example, the current working state of the sweeping robot is in charging, and the working state of the washing machine is started. After the color background is identified, the user can more clearly view the intelligent information by adopting the relatively thick entity style, so that the user experience is improved.

In some embodiments, as shown in fig. 16, when the first screen saver image is a solid background, the intelligent information is displayed on the first screen saver image in a superimposed manner by adopting a transparent pattern, the preset intelligent information of the user in fig. 16 comprises weather and a clock, the preset local part is a left display clock of the wallpaper, and the right side of the wallpaper is transversely and sequentially displayed with time and weather of the clock.

It should be noted that, the scheme of adaptively matching the display style of the intelligent information according to the background feature of the screen saver wallpaper is not only suitable for the first screen saver image customized by the user, but also suitable for other screen saver images in the screen saver sequence, such as preset screen saver images and screen saver images issued by the server periodically. In addition, the preset layout of the intelligent information in the target pattern can be set according to the type and the quantity of the intelligent information, the preset layout is not limited, and when the screen saver image is loaded and displayed after the preset layout is set, the template of the target pattern can be directly called to display the intelligent information and the screen saver image in a superimposed mode. In addition, the intelligent information is not limited to the embodiment of the application and the drawings, and other information types, such as web page links pushed by a server, advertisements, or messages received by an application program, can be added in practical application.

Referring to the foregoing UI interaction description, as shown in fig. 17, the interaction process involves three terminals, that is, a display device, a server, and a terminal device, and after a user starts a target application installed by the terminal device and enters a page shown in fig. 8, the interaction process includes:

Step (A1), the terminal device executes: and in response to receiving the user input of the customized screen saver operation, sending indication information to the display equipment, and entering a shooting preview interface.

Step (B1), the display device side executes: and controlling the display to display the screen graphics card in response to receiving the indication information sent by the terminal equipment.

Step (C1), the terminal device executes: the first image is acquired and sent to the server. The first image comprises a screen picture card captured in a rectangular positioning frame line and a background area image at the periphery of the screen picture card, wherein the background area image is an area between the positioning frame line and the boundary of the terminal screen.

Step (D1), the server executes: the method includes receiving a first image, generating a first screen saver image from the first image, and transmitting the first screen saver image to a display device.

In some embodiments, the server processes the first image, and may identify a screen location area of the display device in the first image according to the screen graphics card; and obtaining target characteristics contained in a background wall where the display equipment is located according to the background area image, wherein the target characteristics comprise characteristics such as colors, patterns, textures and the like of the background wall, and then generating a first screen saver image which is matched with a screen of the display equipment according to the target characteristics and the screen area position and can be integrated with the background wall to realize the screen effect of integration.

Step (E1), the display device side executes: after receiving the first screen saver image, detecting whether to start displaying intelligent information.

Step (F1), the display device side executes: if the intelligent information is started to be displayed, a target pattern is obtained according to the attribute characteristics of the first screen saver image and preset intelligent information, and the display is controlled to display the intelligent information on the first screen saver image according to the target pattern. The method comprises the steps of judging whether the background of a first screen saver image is solid or colored according to attribute characteristics of the first screen saver image, determining that intelligent information is displayed in a transparent or solid mode according to the judged attribute characteristics, obtaining corresponding preset layout according to the type and the number of the intelligent information set by a user, obtaining a target mode through the preset layout and the transparent/solid mode, calling the target mode to display the intelligent information on the first screen saver image in a superimposed mode when the first screen saver image is displayed, and therefore completing screen saver display under a fusion screen.

And (G1) if the intelligent information is not started to be displayed, controlling the display to only display the first screen saver image, and not displaying any intelligent information, namely, the screen saver in the pure wallpaper mode.

The interaction logic of another more refined screen saver display method shown in fig. 18, the interaction process involves three terminals, namely a display device, a server and a terminal device, the user starts a target application program installed by the terminal device, and after entering the page shown in fig. 8, after clicking a second custom control, the interaction process includes:

Step (A2), the terminal device executes: and in response to receiving the user input of the customized screen saver operation, sending indication information to the display equipment, and entering a shooting preview interface.

Step (B2), the display device side executes: and controlling the display to display the screen graphics card in response to receiving the indication information sent by the terminal equipment.

Step (C2), the terminal device executes: the first image is acquired and sent to the server.

Step (D2), the server executes: receiving a first image, and identifying a screen position area of the display device in the first image according to the screen graphic card; and acquiring target characteristics contained in a background wall where the display equipment is located according to the background area image, generating a matched first screen saver image according to the target characteristics and the screen position area, and sending the first screen saver image to the display equipment.

Step (E2), the display device side executes: after receiving the first screen saver image, inserting the first screen saver image into the first position of the screen saver sequence, and marking the first screen saver image as a selected state. This step mainly completes the saving of the first screen saver image and the updating of the screen saver sequence after the first screen saver image has been customized.

Step (F2), the display device side executes: after receiving the first screen saver image, detecting whether to start displaying intelligent information. If the intelligent information is started to be displayed, executing the steps (G2) to (M2); if the display of the smart information is not started, step (N2) is performed.

And (G2) compressing the first screen saver image, wherein the image compression can reduce the calculation amount of the attribute characteristics of the first screen saver image for subsequent identification, and further improve the operation efficiency. This step is not necessary, and the identification of the attribute features can be directly performed on the original image of the first screen saver image during actual calculation.

Step (H2), the display device side performs: an edge detection algorithm is used to identify whether the attribute feature of the first screen saver image is solid.

In some embodiments, a pixel point set with obvious color change in an image can be obtained by utilizing an edge detection algorithm, a target pixel point with a color value exceeding a first threshold range is screened from the pixel point set, and if the proportion r of the target pixel point is larger than a preset threshold P1 (close to 1), the image is identified as a color background; if the proportion r of the target pixel is smaller than the preset threshold P2 (close to 0), the image is primarily considered to be possibly of a solid background.

Step (I2), the display device side executes: if the edge detection identifies that the attribute characteristic of the first screen saver image is non-solid color (namely, belongs to the color background), determining that the target style is a preset layout matched with the type and the quantity of the intelligent information and the entity display of the intelligent information.

When the edge detection recognizes that the attribute feature of the first screen saver image is a solid color, the image cannot be accurately determined to be the solid color, which is caused by the calculation mode of the edge detection algorithm and the difference of the texture features of different images. For example, fig. 19 (a) is an image composed of a plurality of rhombuses, and the color difference among the rhombuses is not significant, so that the image may be identified as solid color by using an edge detection algorithm, but the image should be actually colored; for example, fig. 19 (b) shows a stripe gradient color, the colors of the points on the same stripe are the same, the color difference between the adjacent stripes is not obvious, and the adjacent stripes can be identified as a pure color by using an edge detection algorithm, but the adjacent stripes are actually the colors. It can be seen that, for the images with the same or similar texture features as those of fig. 19 (a) and 19 (b), such images have the problem of inconspicuous edges, so that erroneous judgment is easily caused, and once the color background is identified as a solid color background, intelligent information is displayed in a transparent mode, so that the intelligent information cannot be clearly displayed to a user under the influence of the color background. Further step (J2) is required for this.

Step (J2), the display device side performs: if the edge detection identifies that the attribute characteristic of the first screen protection image is solid color, a plurality of pixel points are locally selected in the first screen protection image, and whether the color values of the pixel points are all in a threshold range is judged.

The edge detection is global discrimination, and step (J2) is to select a plurality of points in the first screen saver image for local discrimination, wherein the selection number of the local selection mechanisms is not limited, but the color difference of the selected pixel points is ensured to be obvious as much as possible. For example, fig. 20 (a) is a view of selecting a plurality of spacing points on two diagonals of fig. 19 (a); FIG. 20 (b) is a view of the vertical lines of FIG. 19 (a) taken in parallel with each other, and with a plurality of spacer points taken on each vertical line; fig. 20 (c) is a view of the lateral center line of fig. 19 (b), and a plurality of spacing points are selected from the lateral center lines. When the color values of the locally selected pixel points are all within the threshold range, the first screen protection image can be identified as the solid color background, otherwise, the color background is identified.

In both the step (H2) and the step (J2), the threshold range is used when discriminating the image attribute feature, because the probability of 100% solid color (i.e., only one color value) of the first screen saver image calculated and generated after the user photographs under the actual environment is almost zero, so that the threshold range is set to discriminate based on the fact that the probability of approaching solid color is considered, and the threshold ranges used in the step (H2) and the step (J2) may be the same or different.

Step (K2), the display device side performs: and if the color values of the pixel points are all in the threshold range, determining that the target pattern is the preset layout matched with the type and the quantity of the intelligent information and transparent display of the intelligent information.

Step (L2), the display device side performs: and if the color value of at least one of the pixel points exceeds the threshold range, determining that the target style is the entity display of the preset layout and the intelligent information matched with the type and the quantity of the intelligent information. Through the steps (G2) to (L2), the possible misjudgment problem of the edge detection algorithm can be eliminated, the accuracy of judging the pure color/color characteristics of the screen saver image is improved, the matching degree between intelligent information and the attribute characteristics of the screen saver image is further improved, and the display effect of the screen saver is improved.

Whether the image is solid or not is further determined by partial color extraction, and the specific implementation is not limited to the steps (J2) to (L2). In some embodiments, for example, the color values of the locally selected pixels in the step (J2) may be compared, the number num of the pixels with different color values is counted, if the number num exceeds a preset threshold P3, the first screen saver image is determined to be a color background, and the target pattern is a preset layout matched with the type and the number of the intelligent information and the entity display of the intelligent information; if the number num is smaller than or equal to the preset threshold value P3, the first screen saver image can be truly determined to be a solid image, and the target pattern is preset layout matched with the type and the number of the intelligent information and transparent display of the intelligent information.

In some embodiments, for example, the color values of the locally selected pixels in the step (J2) may be sorted, so as to screen out the maximum color value color_max and the minimum color value color_min, calculate the color value difference S according to s=color_max-color_min, and if the color value difference S is greater than the preset threshold P4, determine that the first screen-saver image is a color background; if the color value difference is smaller than or equal to the preset threshold value P4, the first screen saver image can be truly determined to be a solid color image.

Step (M2), the display device side performs: and controlling a display to display the intelligent information on the first screen saver image according to the target pattern.

Step (N2), the display device side executes: the display is controlled to only display the first screen saver image and does not display any intelligent information, namely the screen saver in the pure wallpaper mode.

In some embodiments, the screen saver sequence is dynamically maintained and updated in the display device all the time, and any one of the screen saver images in the screen saver sequence can be determined to be a solid background or a color background by adopting the methods from the step (G2) to the step (L2), so as to determine the corresponding target style of each screen saver image. After the target pattern of each screen saver image is determined, the corresponding relation between the screen saver image and the target pattern template thereof can be stored, so that when the screen saver images stored in the sequence are displayed later, the steps (G2) to (L2) are not required to be executed again, and only the target pattern template corresponding to the screen saver image is required to be called.

In some embodiments, if the first customized screen saver image is not included in the screen saver sequence, the user is not customized to the screen saver image in the fusion screen mode before, and the screen saver image in the currently selected state in the screen saver sequence is displayed, where the screen saver sequence may include only preset screen saver images or include both the preset screen saver images and the screen saver wallpaper issued by the server in a periodical update mode. Generally, only one screen saver image in the screen saver sequence is in the selected state.

It should be noted that the UI provided in the drawings of the present application is merely exemplary, and is specific to practical applications and designs. According to the method and the device, the first screen saver image which is fused and matched with the television background wall is generated by means of strong computing processing capacity of the server between the terminal equipment and the display equipment, so that the operation pressure of the display equipment end can be reduced, and the stable operation of the display equipment end is ensured.

The application scene of the technical scheme is not limited to screen saver setting and display in a television wall/fusion screen mode, can be adaptively used in other identical or similar scenes/application programs, can be fused with a television wall background when other application programs such as an artistic gallery application, a wallpaper application and the like are operated, and is adaptive to adjust a display style based on background characteristics (color or pure color).

It will be apparent to those skilled in the art that the techniques of embodiments of the present invention may be implemented in software plus a necessary general purpose hardware platform. In a specific implementation, the present invention also provides a computer storage medium, where the program may be stored. When the computer storage medium is located in any one of the display device, the server, and the terminal device, the program may include program steps related to a screen saver display method that the controller of any one of the three terminals is configured to execute when executed. The computer storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), or the like.

In the present application, the single-ended devices and the screen saver display method executed by the configuration of the single-ended devices are listed in UI interaction and interaction flows, and the same similar parts of the embodiments are referred to each other, so that the relevant contents are not repeated.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, characterized by comprising:

a display for displaying the screen graphics card and the screen saver image;

a controller configured to perform:

the receiving server generates and sends a first screen saver image according to the first image;

Starting to display intelligent information, and identifying attribute features of the first screen saver image through an edge detection algorithm;

when the edge detection identifies that the attribute characteristics of the first screen saver image are non-solid colors, acquiring corresponding preset layouts according to the types and the quantity of the intelligent information, and acquiring target patterns through the preset layouts and entity forms;

when the edge detection identifies that the attribute characteristics of the first screen saver image are solid colors, locally selecting a plurality of pixel points in the first screen saver image, and judging whether the color values of the pixel points are all in a threshold range or not: if the color values of the pixel points are all in the threshold range, acquiring corresponding preset layouts according to the types and the quantity of the intelligent information, and obtaining a target pattern through the preset layouts and the transparent form; if the color value of at least one of the pixel points exceeds a threshold range, acquiring a corresponding preset layout according to the type and the number of the intelligent information, and obtaining a target pattern through the preset layout and the entity form;

2. The display device of claim 1, wherein after receiving the first screen saver image, the controller is further configured to perform:

and if intelligent information is not started to be displayed, controlling a display to only display the first screen saver image.

3. The display device of claim 1, wherein the controller is further configured to perform:

after the first screen saver image is received, inserting the first screen saver image into the first position of a screen saver sequence, and marking the first screen saver image as a selected state; the screen saver sequence further comprises preset screen saver images and the server updates the issued screen saver images to the display equipment periodically.

4. A display device according to claim 3, wherein the controller is further configured to perform:

and if the customized first screen saver image is not contained in the screen saver sequence, controlling a display to display the screen saver image in the selected state.

5. A terminal device, comprising:

a controller configured to perform:

transmitting the first image to a server so that the server generates a first screen saver image according to the first image;

the first screen saver image is sent to display equipment, and when the display equipment starts to display intelligent information, attribute characteristics of the first screen saver image are identified through an edge detection algorithm;

6. A server, comprising:

a controller configured to perform:

the first screen saver image is sent to display equipment, so that when the display equipment starts to display intelligent information, attribute characteristics of the first screen saver image are identified through an edge detection algorithm;

7. A screen saver display method in a display device, comprising:

8. A screen saver display method in a terminal device, comprising:

9. A screen saver display method in a server, comprising: