CN112698905A

CN112698905A - Screen protection display method, display device, terminal device and server

Info

Publication number: CN112698905A
Application number: CN202110031013.5A
Authority: CN
Inventors: 苑衍梅; 刘承龙; 李东航
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2021-01-11
Filing date: 2021-01-11
Publication date: 2021-04-23
Anticipated expiration: 2041-01-11
Also published as: CN112698905B

Abstract

The invention discloses a screen saver display method, display equipment, terminal equipment and a server, wherein a screen graphic card is displayed in response to receiving indication information sent by the terminal equipment so that the terminal equipment acquires a first image, and the first image comprises the screen graphic card and a peripheral background area image thereof; the indication information is sent by the terminal equipment after receiving the customized screen saver operation input by the user; receiving a first screen saver image generated and sent by a server according to the first image, and if the intelligent information display is started, acquiring a target style according to the attribute characteristics of the first screen saver image and preset intelligent information; and displaying the intelligent information on the first screen saver image according to the target style. When the screen saver is required to be displayed, the first screen saver image can be displayed, the intelligent information is displayed on the first screen saver image according to the target style, the matching degree of the intelligent information and the attribute characteristics of the screen saver is higher, and therefore the screen saver display effect of the fusion screen is improved.

Description

Screen protection display method, display device, terminal device and server

Technical Field

The invention relates to the field of display equipment, in particular to a screen saver display method, display equipment, terminal equipment and a server.

Background

The screen saver application can be installed in the display device, the screen saver application can comprise screen saver images which are periodically pushed by a background and customized by a user, and when the device does not detect an operation signal input by the user within a certain time, the current screen saver image can be loaded and displayed on a screen, so that the purpose of protecting the screen is achieved.

In some application scenes, wall paper may be pasted on the television background wall, the wall paper is pure color or has patterns, and screen saver images consistent with the wall paper can be displayed in order to improve the visual effect of screen saver display, so that a user sees that the television background wall and the screen paper have a fusion matching effect, namely a fusion screen is realized, but the screen saver display under the current fusion screen cannot well match the television background wall paper.

Disclosure of Invention

In order to solve the problems in the background art, the invention provides a screen saver display method, a display device, a terminal device and a server.

A first aspect provides a display device comprising:

a display for displaying a screen card and a screen saver image;

the communicator is used for being in communication connection with the server and the terminal equipment;

a controller configured to perform:

responding to received indication information sent by the terminal equipment, controlling a display to display a screen graphic card so as to enable the terminal equipment to acquire a first image, wherein the first image comprises the screen graphic card and a peripheral background area image thereof; the indication information is sent by the terminal equipment after receiving the customized screen saver operation input by the user;

receiving a first screen saver image generated and sent by a server according to the first image, and if the intelligent information display is started, acquiring a target style according to the attribute characteristics of the first screen saver image and preset intelligent information;

and controlling a display to display the intelligent information on the first screen saver image according to the target style.

A second aspect provides a terminal device, including:

the display is used for displaying a related interface of the customized screen saver image;

the image acquisition device is used for shooting a first image, and the first image comprises a screen image card displayed by display equipment and a background area image at the periphery of the screen image card;

the communicator is used for being in communication connection with the display device and the server;

a controller configured to perform:

responding to a customized screen saver operation input by a user, sending indication information to display equipment, and controlling an image collector to collect a first image; the indication information is used for indicating display equipment to display the screen graphic card;

and sending the first image to a server so that the server generates a first screen saver image according to the first image, sending the first screen saver image to a display device, acquiring a target style according to the attribute characteristics of the first screen saver image and preset intelligent information when the display device starts to display the intelligent information, and displaying the intelligent information on the first screen saver image according to the target style.

A third aspect provides a server comprising:

the communicator is used for being in communication connection with the display equipment and the terminal equipment;

a controller configured to perform:

receiving a first image sent by a terminal device, wherein the first image comprises a screen graphic card displayed by a display device and a background area image at the periphery of the screen graphic card;

identifying a screen position area of the display equipment in the first image according to the screen graphic card;

acquiring target characteristics contained in a background wall where the display equipment is located according to the background area image, and generating a first matched screen saver image according to the target characteristics and the screen position area;

and sending the first screen saver image to display equipment so that when the display equipment starts to display intelligent information, a target style is obtained according to the attribute characteristics of the first screen saver image and preset intelligent information, and the intelligent information is displayed on the first screen saver image according to the target style.

A screen saver display method in a display device provided in a fourth aspect, includes:

responding to received indication information sent by terminal equipment, displaying a screen graphic card so that the terminal equipment collects a first image, wherein the first image comprises the screen graphic card and a peripheral background area image thereof; the indication information is sent by the terminal equipment after receiving the customized screen saver operation input by the user;

and displaying the intelligent information on the first screen saver image according to the target style.

A screen saver display method in a terminal device provided by the fifth aspect includes:

responding to a customized screen saver operation input by a user, sending indication information for indicating the display equipment to display a screen picture card to the display equipment, and collecting a first image; the first image comprises the screen graphic card and a peripheral background area image thereof;

A screen saver display method in a server according to a sixth aspect includes:

The technical scheme is suitable for supporting the display equipment with the screen saver fusing function under the screen, the interaction relates to the display equipment, the server and the terminal equipment, after a user inputs the screen saver customizing operation through the terminal equipment, the terminal sends the indication information to the display equipment, the display equipment receives the indication information and then displays the screen graphic card, the terminal equipment enters the shooting interface at the moment, the user adjusts the position of the terminal through shooting preview, and a first image is obtained through shooting, the first image comprises the screen graphic card used for identifying the screen position area, and the peripheral area of the screen graphic card is a local background area image of a background wall where the display equipment is located. The terminal uploads the shot first image to the server, the server performs calculation processing on the first image, a first screen saver image which can be fused and matched with the background wall pattern is generated, and the first screen saver image is sent to the display equipment terminal. When the screen saver is set at the display device side, a user can pre-select to start or close the function of displaying the intelligent information according to requirements, and when the intelligent information is started to be displayed, the type and the quantity of the intelligent information to be displayed can be set, for example, the intelligent information can be equipment information of the intelligent equipment obtained by association of weather, a clock and the display device. The display equipment can acquire a target style according to preset intelligent information and attribute characteristics of the first screen saver image, wherein the attribute characteristics are pure color or color, the target style relates to the display effect of the intelligent information on the first screen saver image, when a user customizes the first screen saver image and needs to display the screen saver image, the first screen saver image can be displayed, the intelligent information is displayed on the first screen saver image according to the target style, the matching degree of the intelligent information and the screen saver attribute characteristics is higher, and therefore the screen saver display effect of the fusion screen is improved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings to be accessed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.

FIG. 1 illustrates a usage scenario of a display device according to some embodiments;

fig. 2 illustrates a hardware configuration block diagram of the control apparatus 100 according to some embodiments;

fig. 3 illustrates a hardware configuration block diagram of the display apparatus 200 according to some embodiments;

FIG. 4 illustrates a software configuration diagram in the display device 200 according to some embodiments;

FIG. 5 illustrates an icon control interface display of an application in display device 200, in accordance with some embodiments;

FIG. 6 is a schematic diagram illustrating a display device end screen saver settings page;

fig. 7 is a schematic diagram of a tutorial page showing the customization of the tv wall screen saver by the display device AI;

FIG. 8 is a schematic diagram illustrating an operation instruction page of the terminal device customized screen saver;

fig. 9 is a schematic diagram illustrating a terminal device capturing a first image;

fig. 10 is a schematic diagram illustrating a case where the terminal device successfully uploads the first image;

fig. 11 is an interface diagram of the display device side when the terminal device successfully uploads the first image;

FIG. 12 is a schematic diagram illustrating a screen saver settings page after the display device receives a first screen saver image;

FIG. 13 is a schematic diagram illustrating a display device displaying a first screen saver image;

FIG. 14 is a schematic diagram illustrating the display device receiving no first screen saver image;

fig. 15 is a schematic diagram illustrating a display effect when the first screen saver image is a suit background;

fig. 16 is a schematic diagram illustrating a display effect of the first screen saver image with a solid background;

FIG. 17 is an interactive flow diagram illustrating a method of screen saver display;

FIG. 18 is an interaction flow diagram illustrating another screen saver display method;

fig. 19(a) is a schematic diagram illustrating a screen saver image with a diamond lattice type suit background;

fig. 19(b) is a schematic diagram illustrating a screen saver image with a gradient colored fancy background;

FIG. 20(a) is a schematic diagram illustrating a partial color sampling of FIG. 19 (a);

FIG. 20(b) is another schematic diagram illustrating partial coloring of FIG. 19 (a);

fig. 20(c) schematically shows a partial color sampling of fig. 19 (b).

Detailed Description

To make the purpose and embodiments of the present application clearer, the following will clearly and completely describe the exemplary embodiments of the present application with reference to the attached drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.

It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.

The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in fig. 1, the display apparatus 200 is also in data communication with a server 400, and a user can operate the display apparatus 200 through the smart device 300 or the control device 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, and controls the display device 200 in a wireless or wired manner. The user may control the display apparatus 200 by inputting a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, and the like.

In some embodiments, the smart device 300 may include any of a mobile terminal, a tablet, a computer, a laptop, an AR/VR device, and the like.

In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device.

In some embodiments, the smart device 300 and the display device may also be used for communication of data.

In some embodiments, the display device 200 may also be controlled in a manner other than the control apparatus 100 and the smart device 300, for example, the voice instruction control of the user may be directly received by a module configured inside the display device 200 to obtain a voice instruction, or may be received by a voice control apparatus provided outside the display device 200.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers.

In some embodiments, software steps executed by one step execution agent may be migrated on demand to another step execution agent in data communication therewith for execution. Illustratively, software steps performed by the server may be migrated to be performed on a display device in data communication therewith, and vice versa, as desired.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction from a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200.

In some embodiments, the communication interface 130 is used for external communication, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module.

In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, a key, or an alternative module.

Fig. 3 shows a hardware configuration block diagram of the display apparatus 200 according to an exemplary embodiment.

In some embodiments, the display apparatus 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, a user interface.

In some embodiments the controller comprises a central processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.

In some embodiments, the display 260 includes a display screen component for displaying pictures, and a driving component for driving image display, a component for receiving image signals from the controller output, displaying video content, image content, and menu manipulation interface, and a user manipulation UI interface, etc.

In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, the tuner demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio/video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which may be used to collect external environment scenes, attributes of the user, or user interaction gestures, or the detector 230 includes a sound collector, such as a microphone, which is used to receive external sounds.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, and the like. The interface may be a composite input/output interface formed by the plurality of interfaces.

In some embodiments, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other actionable control. The operations related to the selected object are: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon.

In some embodiments the controller comprises at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphics Processing Unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory), a first to nth interface for input/output, a communication Bus (Bus), and the like.

A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions receiving external input, so as to finally display and play various audio-video contents. The CPU processor may include a plurality of processors. E.g. comprising a main processor and one or more sub-processors.

In some embodiments, a graphics processor for generating various graphics objects, such as: at least one of an icon, an operation menu, and a user input instruction display figure. The graphic processor comprises an arithmetic unit, which performs operation by receiving various interactive instructions input by a user and displays various objects according to display attributes; the system also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the video processor is configured to receive an external video signal, and perform at least one of video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a signal displayed or played on the direct display device 200.

In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image composition module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like. And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received video output signal after the frame rate conversion, and changing the signal to be in accordance with the signal of the display format, such as an output RGB data signal.

In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform at least one of noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in the speaker.

In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on display 260, and the user input interface receives the user input commands through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. visual interface elements.

In some embodiments, user interface 280 is an interface that may be used to receive control inputs (e.g., physical buttons on the body of the display device, or the like).

In some embodiments, a system of a display device may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together make up the basic operating system structure that allows users to manage files, run programs, and use the system. After power-on, the kernel is started, kernel space is activated, hardware is abstracted, hardware parameters are initialized, and virtual memory, a scheduler, signals and interprocess communication (IPC) are operated and maintained. And after the kernel is started, loading the Shell and the user application program. The application program is compiled into machine code after being started, and a process is formed.

Referring to fig. 4, in some embodiments, the system is divided into four layers, which are an Application (Applications) layer (abbreviated as "Application layer"), an Application Framework (Application Framework) layer (abbreviated as "Framework layer"), an Android runtime (Android runtime) and system library layer (abbreviated as "system runtime library layer"), and a kernel layer from top to bottom.

In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (windows) programs carried by an operating system, system setting programs, clock programs or the like; or an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.

The framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions. The application framework layer acts as a processing center that decides to let the applications in the application layer act. The application program can access the resources in the system and obtain the services of the system in execution through the API interface.

As shown in fig. 4, in the embodiment of the present application, the application framework layer includes a manager (Managers), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used for interacting with all activities running in the system; the Location Manager (Location Manager) is used for providing the system service or application with the access of the system Location service; a Package Manager (Package Manager) for retrieving various information related to an application Package currently installed on the device; a Notification Manager (Notification Manager) for controlling display and clearing of Notification messages; a Window Manager (Window Manager) is used to manage the icons, windows, toolbars, wallpapers, and desktop components on a user interface.

In some embodiments, the activity manager is used to manage the lifecycle of the various applications as well as general navigational fallback functions, such as controlling exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of a display screen, judging whether a status bar exists, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window, displaying a shake, displaying a distortion deformation, and the like), and the like.

In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer, and when the framework layer is used, the android operating system runs the C/C + + library included in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the core layer includes at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..

In some embodiments, the display device may directly enter the interface of the preset vod program after being activated, and the interface of the vod program may include at least a navigation bar 510 and a content display area located below the navigation bar 510, as shown in fig. 5, where the content displayed in the content display area may change according to the change of the selected control in the navigation bar. The programs in the application program layer can be integrated in the video-on-demand program and displayed through one control of the navigation bar, and can also be further displayed after the application control in the navigation bar is selected.

In some embodiments, the display device may directly enter a display interface of a signal source selected last time after being started, or a signal source selection interface, where the signal source may be a preset video-on-demand program, or may be at least one of an HDMI interface, a live tv interface, and the like, and after a user selects different signal sources, the display may display contents obtained from different signal sources.

The above embodiments describe the hardware/software architecture and functional implementation of the display device. In some application scenarios, the display device may install a screen saver application in which a user may set a screen saver image and a desired screen saver effect to be displayed.

In some embodiments, after the user opens the screen saver application, the user may enter a screen saver setting page as illustrated in fig. 6, where the interface enables the user to set the timing screen saver, for example, when the timing screen saver is set to 2 minutes, the display screen saver is started when the display device detects no user operation input within 2 minutes, the user may further select a screen saver mode, for example, an album mode or a television wall mode, where the album mode is a conventional screen saver mode, and the television wall mode may implement blending and matching of the screen wallpaper and the background wall wallpaper. For example, when the television wall mode is selected, a screen saver sequence is displayed on the page, and the screen saver sequence may generally include a preset screen saver image of the display device (i.e., a wallpaper carried by the device when the device leaves a factory), a screen saver image that is periodically updated and issued by a server corresponding to the screen saver application (i.e., a wallpaper pushed by the application background), and a screen saver image customized by the user. Fig. 6 shows a case where only the preset screen saver image is included in the screen saver sequence, the screen saver image having the focus in the screen saver sequence is in the selected state, and when a condition for displaying the screen saver is satisfied, the screen saver image currently in the selected state is loaded and displayed.

In some embodiments, the user can also set intelligent information display, the screen saver setting page is provided with an intelligent information switch control, and when the user operates the switch control to be in an off state, the screen of the display device only displays the screen saver image and does not display any intelligent information. When the user operates the switch control to be in an open state, the type and the amount of the intelligent information can be selected according to personal requirements, the type of the intelligent information includes but is not limited to "weather", "clock", "background music" and equipment information of AIOT (Artificial Intelligent Internet of Things) equipment, and the like, and the intelligent information selected by the user is displayed on the screen saver image according to a preset application style and layout. The weather information can show the current temperature, the weather condition and other contents of the location of the display equipment; the clock displays the current time in a clock mode; the user can set background music so as to play the background music when the screen saver image is displayed; the AIOT equipment can be intelligent equipment in a home Internet of things, such as an intelligent air conditioner, a water heater, a floor sweeping robot, an intelligent washing machine, an intelligent refrigerator and the like, the display equipment can acquire equipment information of other intelligent equipment through AIOT association, and the equipment information is information such as appearance images and current working states of the intelligent equipment. Through opening the display of intelligent information, can make the user know weather, time and know the relevant information of intelligent equipment under display device screen protection state, promoted the user and used the experiment.

In some embodiments, since there are many AIOT devices involved in a home scene, in order to avoid that the screen saver effect is poor due to an excessive amount of displayed intelligent information, an upper display limit of device information of the AIOT devices may be set, for example, at most 4 AIOT devices are selected, and when the number of the AIOT devices selected by the user exceeds the upper limit, toast prompts "at most 4 AIOT devices are added". When the device information of the AIOT device is displayed, real user equipment needs to be displayed, and if the problems of network abnormality or account non-login and the like exist, virtual equipment can be displayed.

In some embodiments, when the user selects the tv wall mode, the matched screen saver image may be customized according to the wallpaper or background effect of the current tv background wall, the screen saver setting page has a first screen saver customization control, that is, the "AI customization" user in fig. 6 clicks the control to input the customized screen saver operation, at this time, the display device may jump to the tutorial page shown in fig. 7, and the tutorial page displays the operation flow and notice for guiding the user AI to customize the screen saver image matched with the tv wall, in this application, the screen saver AI customization in the tv wall mode requires interactive cooperation of the terminal device, the user uses the terminal device to take a picture of the tv wall including the tv screen and reports the picture to the server to identify and generate the matched screen saver image, which requires the display device and the terminal device to be connected to the same WiFi network, since a plurality of WiFi may be set in the home scene, the tutorial page can display the WiFi currently connected with the display device, such as TP-LINK _09F8, so that the user can conveniently connect the WiFi at the mobile phone end. The user can cooperate with customizing the screen saver image of the television wall through a target application program corresponding to the terminal device, for example, the focused good-looking application is opened, and the screen saver customized related operation interface is entered through the operation path of my, common tool and television wall, so that the screen saver customization is completed according to the application operation prompt in the terminal device. The two-dimensional code of the target application program in the mobile terminal can be displayed in the tutorial page in fig. 7, and the user can install and use the target application program by scanning the two-dimensional code with the terminal device. The terminal equipment comprises a mobile terminal such as a smart phone and a tablet personal computer.

In some embodiments, after viewing the tutorial page displayed on the display device, the user may scan the two-dimensional code to install the target application program, and if the target application program has been installed previously, the user directly accesses the entry of the customized tv wall screen saver, and the terminal device jumps to the operation instruction page shown in fig. 8. The operation instruction page can display prompt information, for example, "a mobile phone shoots a television wall photo and uploads the television wall photo, and intelligent recognition generates a screen saver matched with a home background", a second screen saver customizing control is arranged in the operation instruction page, namely, "start customization" in fig. 8, when a user clicks the "start customization", shooting preview of a terminal camera is automatically started, meanwhile, the terminal equipment also needs to send indication information to the display equipment, and the display equipment receives the indication information and then switches the UI from a tutorial page to a display screen graphic card.

In some embodiments, as shown in fig. 9, a camera (generally, a rear camera) of the terminal device faces a television wall, the display device displays a screen card at this time, the screen card generally includes a plurality of cross feature points arranged in an array for identifying a screen position region, a background wall of the television is provided on the periphery of a screen frame, and the background wall may be a solid color or have texture effects such as patterns and decorative patterns; the terminal equipment enters shooting preview at the moment, a rectangular positioning wire frame is arranged in a shooting preview interface, the length-width ratio of the positioning wire frame is consistent with that of a screen of the display equipment, a user adjusts the shooting position and angle of the terminal by operating the body of the user, so that a screen graphic card in the shooting preview is just positioned in the rectangular positioning wire frame, a local background area of a television wall is arranged outside the boundary line of the positioning wire frame, and the local background area can carry the attribute characteristics of the color, texture, pattern and the like of the background wall, and is convenient for subsequent customization to generate a matched screen saver image. When the terminal device identifies that the television screen is located in the positioning wire frame, the user can be prompted to click the shooting control for shooting, for example, prompt information of 'please click a right shooting button' is displayed, the shot image comprises the screen image card and a background area on the periphery of the screen image card, the image is named as a first image in the application, and the first image is automatically uploaded to the server after the terminal device collects the first image. If the screen graphic card is not positioned in the positioning wire frame or is not completely positioned in the positioning wire frame, the shooting control is unavailable, and therefore the situation that the shooting control is triggered by mistake when the user does not position the shooting position well so as to cause the error of the first image acquisition is avoided. The rectangular positioning wire frame may be set at the center of the shooting preview interface, or may be set at another position.

In some embodiments, after the terminal device shoots and uploads the first image to the server, if the uploading is successful, the terminal device switches to the interface shown in fig. 10, and the interface may prompt the terminal device to complete the customization operation, for example, "complete, go to the television terminal to check the customized screen saver bar" indicating that the first image has been uploaded to the server, and since the server receives the first image, it needs to process and generate the customized screen saver image (i.e., the first screen saver image named in this application), the display device displays the waiting and loading effects shown in fig. 11 at this time, and after receiving the first screen saver image, it may load and successfully display the first screen saver image.

In some embodiments, after the display device receives the first screen saver image generated and sent by the server, the first screen saver image is stored, as shown in fig. 12, the first screen saver image may be inserted into a head of the screen saver sequence, and the first screen saver image is marked in a selected state at the same time, so that when a condition for displaying the screen saver is satisfied, the display device displays the first screen saver image in the selected state, so that the customized first screen saver image and the television wall have an integrated effect, and if the intelligent information switch is turned on, the first screen saver image is also required to be superimposed with and displayed with the intelligent information preset by the user.

In some embodiments, the screen saver sequence may be sorted according to a certain priority, for example, the first screen saver image customized by the user is placed at the first position and the front position of the screen saver sequence, and then the preset screen saver image and the screen saver image issued by the server are respectively arranged and updated periodically, that is, the priority of the screen saver customized by the user is the highest, and then the preset screen saver and the screen saver issued by the server are arranged. The order of presentation of the screensaver sequence is not limited.

In some embodiments, a user clicks the "AI customization" control, and can customize a first screen saver image that is fusion matched with the video wall; if the user clicks on any one of the images in the sequence of screen savers, the focus in the selected state is switched and a screen saver preview of the clicked image is displayed.

In some embodiments, if the display device receives the first screen saver image, as shown in fig. 13, the first screen saver image is displayed on the screen, the first screen saver image may further have a setting control, for example, "go to set" in fig. 13, and a user may directly enter a screen saver setting page by clicking the setting control on an interface displaying the first screen saver image, so that the user can quickly switch the screen saver image and setting options for adjusting the screen saver effect.

In some embodiments, the display device may not receive the first screen saver image sent by the server due to some abnormal factors, for example, the server itself does not successfully generate the first screen saver image, or the first screen saver image fails to be sent due to a network abnormality, the display device may not display the currently customized first screen saver image, the display device may display a prompt message of the screen saver image download failure, for example, the example of fig. 14 shows "current network abnormality, screen saver image download failure, please try again after checking the network", and a set network control is displayed in the interface, and when the user clicks "set network", the network may be checked and reconnected. After the network is recovered to normal, if the received first screen saver image is displayed on the screen, if the first screen saver image still cannot be received, it is indicated that the customized image acquisition fails due to non-network factors, and retry can be performed according to the method and customization can be performed again.

In practical application, because the backgrounds of the television wall are different, for example, some are solid backgrounds, and some are design and color backgrounds with patterns, stripes and other textures, the first screen saver image generated by matching also has corresponding attribute characteristics, under the condition that the display of the intelligent information is started, for example, a set of thick and solid intelligent information is displayed on the first screen saver image of the solid background, so that a very sharp feeling is visually given to people, and the visual aesthetic feeling of a user may not be met; for example, a set of transparent intelligent information is displayed on the first screen saver image of the design and color background, and especially when the design and color are complicated, the user may not be able to clearly see the intelligent information of the transparent effect on the first screen saver image. In contrast, in the scheme of the application, after the display device receives the first screen saver image, the attribute characteristics of the first screen saver image need to be analyzed, whether the first screen saver image is a solid background or a colored (non-solid) background is identified, and then the target style used in the intelligent information display is acquired by combining the type and the quantity of the intelligent information preset by the user.

In some embodiments, as shown in fig. 15, when the first screen saver image is a patterned background, the intelligent information is displayed on the first screen saver image in an overlaid manner by using a relatively thick entity style, the intelligent information preset by the user in fig. 15 includes weather, a clock and AIOT equipment, the AIOT equipment includes a washing machine, a sweeping robot and a water heater, and the intelligent information is displayed according to a preset layout entity of the screen saver application, the preset layout in fig. 15 is that the clock is in the center of wallpaper, the left side of the wallpaper displays the time of the weather and the clock, the right side of the wallpaper longitudinally displays equipment information of the washing machine, the sweeping robot and the water heater, and the equipment information may include an equipment real picture, an equipment name and a current working state, for example, the current working state of the sweeping robot is in charging, and the working state of the washing machine is turned on. After the colored background is recognized, the relatively thick and heavy entity style is adopted, so that the user can check the intelligent information more clearly, and the user experience is improved.

In some embodiments, as shown in fig. 16, when the first screen saver image is a solid background, the intelligent information is displayed on the first screen saver image in a superimposed manner by using a transparent style, the intelligent information preset by the user in fig. 16 includes weather and a clock, the preset part is the clock displayed on the left side of the wallpaper, and the right side of the wallpaper horizontally displays the time and the weather of the clock in sequence.

It should be noted that, the scheme of adaptively matching the display style of the intelligent information according to the background features of the screen saver wallpaper is not only applicable to the first screen saver image customized by the user, but also applicable to other screen saver images in the screen saver sequence, such as a preset screen saver image and a screen saver image periodically issued by the server. In addition, the preset layout of the intelligent information in the target style can be set according to the type and the number of the intelligent information, the preset layout is not limited, and after the preset layout is set, when the screen saver image is loaded and displayed, the template of the target style can be directly called, and the intelligent information and the screen saver image are displayed in a superposition mode. In addition, the intelligent information is not limited to the embodiment and the drawings, and other information types, such as web page links pushed by a server, advertisements, or messages received by an application program, may also be added in practical applications.

Referring to the foregoing UI interaction description, as an interaction logic of the screen saver display method shown in fig. 17, an interaction process involves three ends, namely, a display device, a server, and a terminal device, and after a user starts a target application installed in the terminal device and enters a page shown in fig. 8, an interaction flow includes:

step (a1), the terminal device executes: and responding to the received customized screen saver operation input by the user, sending indication information to the display equipment, and simultaneously entering a shooting preview interface.

And (B1), the display device executes: and controlling the display to display the screen graphic card in response to receiving the indication information sent by the terminal equipment.

Step (C1), the terminal device executes: the method comprises the steps of collecting a first image and sending the first image to a server. The first image comprises a screen graphic card captured in the rectangular positioning frame line and a background area image at the periphery of the screen graphic card, wherein the background area image is an area between the positioning frame line and the boundary of the terminal screen.

Step (D1), the server executes: the method comprises the steps of receiving a first image, generating a first screen saver image according to the first image, and sending the first screen saver image to display equipment.

In some embodiments, the server processes the first image and may identify a screen location area of the display device in the first image from the screen card; the method comprises the steps of obtaining target characteristics contained in a background wall where display equipment is located according to a background area image, wherein the target characteristics comprise characteristics such as color, patterns and textures of the background wall, generating a first screen saver image which is matched with a screen of the display equipment according to the target characteristics and the position of a screen area, and can be integrated with the background wall to achieve a screen effect.

Step (E1), the display device performs: and after receiving the first screen saver image, detecting whether to start displaying intelligent information.

Step (F1), the display device side performs: and if the display of the intelligent information is started, acquiring a target style according to the attribute characteristics of the first screen saver image and the preset intelligent information, and controlling the display to display the intelligent information on the first screen saver image according to the target style. The method comprises the steps of judging whether the background of a first screen saver image is pure color or color according to the attribute characteristics of the first screen saver image, determining whether intelligent information is displayed in a transparent or solid mode according to the judged attribute characteristics, obtaining a corresponding preset layout according to the type and the quantity of the intelligent information set by a user, obtaining a target mode according to the preset layout and the transparent/solid mode, calling the target mode to display the intelligent information on the first screen saver image in a superposed mode when the first screen saver image is displayed, and accordingly completing screen saver display under a fusion screen.

And step (G1), if the intelligent information display is not started, controlling the display to only display the first screen saver image and not displaying any intelligent information, namely the screen saver in the pure wallpaper mode.

As shown in fig. 18, the interaction logic of another more detailed screen saver display method is that the interaction process involves three ends, namely, a display device, a server and a terminal device, and after a user starts a target application installed on the terminal device and enters a page shown in fig. 8, and clicks a second customized control, the interaction process includes:

step (a2), the terminal device executes: and responding to the received customized screen saver operation input by the user, sending indication information to the display equipment, and simultaneously entering a shooting preview interface.

And (B2), the display device executes: and controlling the display to display the screen graphic card in response to receiving the indication information sent by the terminal equipment.

Step (C2), the terminal device executes: the method comprises the steps of collecting a first image and sending the first image to a server.

Step (D2), the server executes: receiving a first image, and identifying a screen position area of display equipment in the first image according to a screen graphic card; the method comprises the steps of obtaining target characteristics contained in a background wall where the display equipment is located according to a background area image, generating a first screen saver image matched with the target characteristics according to a screen position area, and sending the first screen saver image to the display equipment.

Step (E2), the display device performs: after receiving the first screen saver image, inserting the first screen saver image into the head of the screen saver sequence, and marking the first screen saver image as a selected state. This step essentially completes the saving of the first screen saver image and the updating of the screen saver sequence after customization of the first screen saver image.

Step (F2), the display device side performs: and after receiving the first screen saver image, detecting whether to start displaying intelligent information. If the intelligent information is started to be displayed, executing the steps (G2) to (M2); if the display of the intelligent information is not enabled, step (N2) is performed.

And (G2) compressing the first screen saver image, wherein the image compression can reduce the calculation amount of the attribute features of the first screen saver image for subsequent identification, and further improve the operation efficiency. This step is not necessary, and the original image of the first screen saver image may be directly identified for attribute features during actual calculation.

Step (H2), the display device side performs: and identifying whether the attribute feature of the first screen saver image is a pure color or not by utilizing an edge detection algorithm.

In some embodiments, an edge detection algorithm may be used to obtain a pixel point set with obvious color change in an image, a target pixel point with a color value exceeding a first threshold range is screened from the pixel point set, and if the proportion r of the target pixel point is greater than a preset threshold P1 (close to 1), the image is identified as a color background; if the proportion r of the target pixel points is smaller than a preset threshold value P2 (close to 0), the image is preliminarily considered to possibly belong to a solid background.

And step (I2), the display device executes: and if the edge detection identifies that the attribute features of the first screen saver image are non-solid colors (namely belong to the design and color background), determining that the target style is the entity display of the preset layout and the intelligent information, which is matched with the type and the quantity of the intelligent information.

When the edge detection identifies that the attribute feature of the first screen saver image is a pure color, it still cannot be accurately determined that the image must be the pure color, which is caused by the calculation mode of the edge detection algorithm and the difference of texture features of different images. For example, fig. 19(a) is an image composed of a plurality of diamonds, where the color difference between the diamonds is not significant, and the image may be recognized as a pure color by using an edge detection algorithm, but the image is actually a flower color; for another example, fig. 19(b) shows a stripe gradient color type, the colors of the points on the same stripe are the same, the color difference between the adjacent stripes is not significant, and the stripes may be identified as pure colors by using an edge detection algorithm, but they should be flower colors. As can be seen, for the images having the same or similar texture features as those in fig. 19(a) and 19(b), such images have a problem of inconspicuous edges, which easily causes misjudgment, and once the design and color background is recognized as a solid color background, the intelligent information is displayed in a transparent manner, which easily causes that the intelligent information cannot be clearly displayed to the user under the influence of the design and color background. For this, a further step (J2) is required.

And step (J2), the display device executes: if the edge detection identifies that the attribute feature of the first screen saver image is a pure color, a plurality of pixel points are locally selected in the first screen saver image, and whether the color values of the pixel points are all in the threshold range is judged.

The edge detection is a global judgment, the step (J2) is to select a plurality of points in the first screen saver image for local judgment, and the number of the selected points is not limited, but the color difference of the selected pixels is ensured to be obvious as much as possible. For example, FIG. 20(a) shows a plurality of spaced points on two diagonal lines of FIG. 19 (a); FIG. 20(b) is a view showing several vertical lines parallel to each other in FIG. 19(a) and a plurality of spaced points on each vertical line; fig. 20(c) is a view of fig. 19(b) taken of a transverse centerline and a plurality of spaced points in the transverse centerline. When the color values of the locally selected pixel points are all in the threshold range, the first screen saver image can be determined to be a pure color background, and otherwise, the first screen saver image is the design color background.

In the step (H2) and the step (J2), when the image attribute features are discriminated, the threshold range is used, because the probability that 100% of the pure color (i.e. only one color value) of the first screen saver image generated by calculation after the user takes a picture in the actual environment is almost zero, the situation close to the pure color needs to be considered, the threshold range is set for discrimination based on the probability, and the threshold ranges used in the step (H2) and the step (J2) can be the same or different.

And (K2), the display device executes: and if the color values of the pixel points are all in the threshold range, determining that the target style is the preset layout matched with the type and the quantity of the intelligent information and the transparent display of the intelligent information.

Step (L2), the display device performs: and if the color value of at least one point in the plurality of pixel points exceeds the threshold range, determining that the target style is the entity display of the preset layout and the intelligent information, which is matched with the type and the quantity of the intelligent information. Through the steps (G2) to (L2), the problem of misjudgment possibly occurring in the edge detection algorithm can be solved, the accuracy of judging the pure color/color characteristic of the screen saver image is improved, the matching degree between the intelligent information and the attribute characteristic of the screen saver image is further improved, and the display effect of the screen saver is improved.

Whether the image is a pure color or not is further determined by local color matching, and the specific implementation is not limited to the steps (J2) to (L2). In some embodiments, for example, the color values of the plurality of pixel points locally selected in step (J2) may be compared, the number num of the pixel points with different color values is counted, and if the number num exceeds a preset threshold P3, it is determined that the first screen saver image is a design and color background, and the target style is an entity presentation of the preset layout + the intelligent information that matches the type and the number of the intelligent information; if the number num is less than or equal to the preset threshold P3, it can be really determined that the first screen saver image is a solid color image and the target style is a preset layout that matches the type and number of the smart information plus a transparent presentation of the smart information.

In some embodiments, for example, the color values of the plurality of pixels locally selected in step (J2) may be sorted, so as to screen out a maximum color value color _ max and a minimum color value color _ min, and a color value difference S is calculated according to S ═ color _ max-color _ min, and if the color value difference S is greater than a preset threshold P4, the first screen saver image is determined to be the suited background; if the color value difference is less than or equal to the preset threshold P4, the first screen saver image can be truly determined to be a solid color image.

Step (M2), the display device performs: and controlling the display to display the intelligent information on the first screen saver image according to the target style.

And (N2), the display device executes: the display is controlled to display only the first screen saver image without showing any intelligent information, i.e. the screen saver in pure wallpaper mode.

In some embodiments, a screen saver sequence is maintained and updated dynamically in the display device, and any one screen saver image in the screen saver sequence can be distinguished to be a solid color background or a flower color background by adopting the method of the steps (G2) to (L2), so that the target style corresponding to each screen saver image is determined. After the target style of each screen saver image is determined, the corresponding relation between the screen saver image and the target style template thereof can be stored, so that when screen saver images stored in a subsequent display sequence are displayed, the steps (G2) to (L2) do not need to be executed again, and only the target style template corresponding to the screen saver images needs to be called.

In some embodiments, if the screen saver sequence does not include the customized first screen saver image, it indicates that the user has not previously customized the screen saver image in the fusion screen mode, and the screen saver image currently in the selected state in the screen saver sequence is displayed, in which case, the screen saver sequence may include only the preset screen saver image, or both the preset screen saver image and the screen saver wallpaper issued by the server periodically. Generally, only one screen saver image in the sequence of screen savers is in the selected state.

It should be noted that the UI provided in the drawings of the present application is only exemplary, and is subject to practical application and design. According to the method and the device, the strong calculation processing capacity of the server is arranged between the terminal device and the display device, the first screen saver image which is fused and matched with the television background wall is generated, the operation pressure of the display device end can be reduced, and the stable operation of the display device end is guaranteed.

The application scene of the technical scheme is not limited to the screen saver setting and display in the television wall/fusion screen mode, and can be adaptively used in other identical or similar scenes/application programs, for example, when other application programs such as an artistic gallery application and a wallpaper application are run, the application scene can be fused with the background of the television wall, and the display style can be adaptively adjusted based on background characteristics (flower color or pure color).

Those skilled in the art will readily appreciate that the techniques of the embodiments of the present invention may be implemented as software plus a required general purpose hardware platform. In a specific implementation, the invention also provides a computer storage medium, which can store a program. When the computer storage medium is located in any one of the display device, the server, and the terminal device, the program when executed may include program steps involved in a screen saver display method in which a controller of any one of the three terminals is configured to execute. The computer storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM) or a Random Access Memory (RAM).

In the application, the single-ended devices and the screensaver display method executed by the configuration of the single-ended devices are listed in the UI interaction and interaction flows, the same and similar parts among the embodiments can be referred to one another, and the related contents are not repeated.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, comprising:

a display for displaying a screen card and a screen saver image;

a controller configured to perform:

2. The display device of claim 1, wherein after receiving the first screen saver image, the controller is further configured to perform:

and if the intelligent information is not started to be displayed, controlling the display to only display the first screen saver image.

3. The display device according to claim 1, wherein the controller is configured to acquire the target style as follows:

identifying whether the attribute features of the first screen saver image are pure colors by using an edge detection algorithm;

and if the attribute feature of the first screen saver image is identified to be a non-pure color by edge detection, displaying the intelligent information in an entity form according to a preset layout matched with the type and the quantity of the intelligent information in the target style.

4. The display device according to claim 3, wherein the controller is configured to acquire the target style as follows:

if the edge detection identifies that the attribute feature of the first screen saver image is a pure color, locally selecting a plurality of pixel points in the first screen saver image, and judging whether the color values of the pixel points are all in a threshold range;

if the color values of the pixel points are all within the threshold range, the target style is a preset layout matched with the type and the number of the intelligent information, and the intelligent information is displayed in a transparent form;

and if the color value of at least one point in the pixel points exceeds a threshold range, displaying the intelligent information in an entity form according to a preset layout matched with the type and the quantity of the intelligent information in the target style.

5. The display device according to claim 1, wherein the controller is further configured to perform:

after receiving the first screen saver image, inserting the first screen saver image into the head of a screen saver sequence, and marking the first screen saver image in a selected state; the screen saver sequence also comprises a preset screen saver image and a screen saver image which is periodically updated and issued to the display equipment by the server.

6. The display device according to claim 5, wherein the controller is further configured to perform:

and if the customized first screen saver image is not contained in the screen saver sequence, controlling a display to display the screen saver image in the selected state.

7. A terminal device, comprising:

a controller configured to perform:

8. A server, comprising:

a controller configured to perform:

9. A method of displaying a screen saver in a display device, comprising:

10. A screen saver display method in a terminal device is characterized by comprising the following steps:

11. A method for displaying a screen saver in a server, comprising: