CN114866636B

CN114866636B - Message display method, terminal equipment, intelligent equipment and server

Info

Publication number: CN114866636B
Application number: CN202110157160.7A
Authority: CN
Inventors: 管春辉
Original assignee: Juhaokan Technology Co Ltd
Current assignee: Juhaokan Technology Co Ltd
Priority date: 2021-02-04
Filing date: 2021-02-04
Publication date: 2023-05-05
Anticipated expiration: 2041-02-04
Also published as: CN114866636A

Abstract

The invention discloses a message display method, terminal equipment, intelligent equipment and a server, which are used for the intelligent equipment end: receiving a message request sent by a server; when the screen-over identification is not recognized in the message request, displaying prompt information for prompting a user to check a new message; identifying a screen-warming identification in the message request, and displaying prompt information for prompting a user to check a new message when the screen-warming message function of the local terminal is not started; and when the message request identifies the screen-warming identification and the screen-warming message function of the local terminal is started, controlling a display to automatically display a message body in the message request in a floating layer mode at the upper layer of the current interface. The method and the device have the advantages that the ornamental and the significance of the message information are improved, and message display of intelligent equipment in a home scene is realized through remote control of the cross-terminal.

Description

Message display method, terminal equipment, intelligent equipment and server

Technical Field

The invention relates to the field of intelligent interaction, in particular to a message display method, terminal equipment, intelligent equipment and a server.

Background

At present, many intelligent devices such as televisions and refrigerators are added with a message board function, so that a user can input expected message information through the message board function, and can also check history or newly received message information through the message board. If family members comprise children, father and mother, the children can input message information to the refrigerator message board, namely 'damama' when going out, i have the message, the dinner is not at home, eggs and tomatoes are arranged in the refrigerator, the refrigerator can add the message information to the message board and display the message information on a refrigerator screen, and after the father or mother looks up the prompt of the message information, the situation of the children can be known and the attention of the children can be felt. The message board function provides a personalized and humanized message leaving mode for the intelligent equipment, expands the actual application and interaction functions of the intelligent equipment, and improves the user experience. What is currently considered in the art is how to further enhance the message board function.

Disclosure of Invention

The invention provides a message display method, terminal equipment, intelligent equipment and a server, which realize the operation of a cross-terminal message and can improve the prompt display effect of the message.

The terminal device provided in the embodiment of the first aspect includes:

the display is used for displaying a related interface of the message operation;

the communicator is used for being in communication connection with the server;

a controller configured to perform:

receiving an operation of starting a message board application, and controlling a display to display a first message board interface, wherein the first message board interface comprises a custom screen-warming message control;

receiving clicking operation of the custom screen message control, and controlling a display to display a screen theme list interface;

receiving selection operation of a first target image in the screen-king theme list interface, and controlling a display to display a second message board interface, wherein the second message board interface comprises an information input frame overlapped with the first target image;

the method comprises the steps of receiving first message information input by a user in an information input box, generating and sending a first message request to a server according to the first message information, wherein the first message request comprises a self-defined identifier, the first message request is used for enabling the server to assemble the first message information and a first target image into a first message body according to the self-defined identifier, and sending a second message request to an intelligent device, the second message request comprises the first message body and an automatic display screen identifier, and the second message request is used for enabling the intelligent device to automatically display the first message body in a floating layer mode on the upper layer of a current interface after the automatic display screen identifier is identified.

An embodiment of the second aspect provides another terminal device, including:

the communicator is used for being in communication connection with the server;

a controller configured to perform:

receiving an operation of starting a message board application, and controlling a display to display a message board interface;

after receiving a selection of a local first target image by a user, generating a first message request containing a custom identifier according to input message information, wherein the first message request is used for enabling a server to assemble the message information and the first target image into a first message body according to the custom identifier, and sending a second message request to an intelligent device, the second message request comprises the first message body and an over screen identifier, and the second message request is used for enabling the intelligent device to automatically display the first message body in a floating layer form on the upper layer of a current interface after identifying the over screen identifier;

when the selection of the first target image by the user is not received, a third message request is generated according to the input message information, the third message request does not contain a custom identifier, the third message request is used for enabling a server to automatically match a second target image according to the message information, the message information and the second target image are assembled into a second message body, a fourth message request is sent to the intelligent device, the fourth message request comprises the second message body and an identifier of an over screen, and the fourth message request is used for enabling the intelligent device to automatically display the second message body on the upper layer of a current interface in a floating layer mode after the identifier of the over screen is identified.

In the terminal device provided in the first aspect, the user selects the first target image through a preset screen-warming theme list at the server side, and in the terminal device provided in the second aspect, the user selects the first target image from the local images, that is, two implementation modes of self-defining screen-warming themes are provided.

The server provided in the third aspect includes:

the communicator is used for being in communication connection with the terminal equipment and the intelligent equipment;

a controller configured to perform:

receiving a message request sent by terminal equipment; the terminal equipment is further used for adding a self-defined identifier to the message request if the message request is generated after a user selects a first target image from a screen-super theme list interface, and otherwise, not adding the self-defined identifier;

when the user-defined identification is identified, a first target image and message information are assembled into a first message body, and a second message request comprising the first message body and a screen-in-screen identification is sent to the intelligent equipment, wherein the second message request is used for enabling the intelligent equipment to automatically display the first message body in a floating layer mode on the upper layer of a current interface after the screen-in-screen identification is identified;

When the user-defined identification is not identified, automatically matching a second target image according to the message information, assembling the second target image and the message information into a second message body, and sending a fourth message request comprising the second message body and the screen identification to the intelligent device, wherein the fourth message request is used for enabling the intelligent device to automatically display the second message body in a floating layer mode on the upper layer of the current interface after the screen identification is identified.

The smart device provided in the fourth aspect includes:

the display is used for interactively displaying the message information input by the terminal equipment;

the communicator is used for being in communication connection with the server;

a controller configured to perform:

receiving a message request sent by a server;

when the screen-over identification is not recognized in the message request, displaying prompt information for prompting a user to check a new message;

identifying a screen-warming identification in the message request, and displaying prompt information for prompting a user to check a new message when the screen-warming message function of the local terminal is not started;

and when the message request identifies the screen-warming identification and the screen-warming message function of the local terminal is started, controlling a display to automatically display a message body in the message request in a floating layer mode at the upper layer of the current interface.

The message display method in the terminal device provided in the fifth aspect includes:

receiving an operation of starting a message board application, and displaying a first message board interface, wherein the first message board interface comprises a custom screen message control;

receiving clicking operation of the custom screen message control, and displaying a screen theme list interface;

receiving selection operation of a first target image in the screen-king theme list interface, and displaying a second message board interface, wherein the second message board interface comprises an information input box overlapped with the first target image;

The message display method in the server provided in the sixth aspect includes:

The message display method in the intelligent device provided in the seventh aspect includes:

receiving a message request sent by a server;

According to the technical scheme, the cross-equipment interaction message from the terminal equipment to the intelligent equipment is realized, the interaction three ends comprise the terminal equipment, the server and the intelligent equipment, the terminal equipment is a mobile terminal such as a mobile phone, a tablet and the like, and the intelligent equipment is an intelligent household appliance such as a television, a refrigerator and the like. On the basis of the conventional message board application, the intelligent equipment is additionally provided with the message-leaving function of the screen, and if the message-leaving function of the screen is not started, the processing logic of the common message is executed; if the message leaving function of the screen is started, the server assembles the image with the background of the screen and the message information input by the user in the terminal equipment into a message body, so that the intelligent equipment end displays the message body on the upper layer of the current interface of the intelligent equipment in a floating layer, and the prompting effect of the screen leaving is presented.

The user can select the screen-warming theme in a user-defined manner at the terminal equipment, and the specific operation flow is as follows: after the user starts the message board application, the user enters a first message board interface, clicks a custom screen-based message control in the first message board interface, the terminal device displays a screen-based theme list interface, the interface comprises background images of various themes preset by various operation ends, for example, the content of a message which the user wants to leave is 'happy birthday', a first target image matched with the themes such as birthday cakes or gifts can be custom selected from the screen-based theme list interface, the interface is then jumped to a second message board interface, the background effect of the first target image is superimposed on an information input frame of the interface, the effect of the screen-based theme can be conveniently previewed by a message person at the user end, then the user inputs first message information in an information input frame, after clicking and sending, the terminal generates a first message request according to the first message information and sends the first message request to the server, the server recognizes that the first message request has a custom identifier, and can know that a user has selected a first target image in a self-defined manner at the terminal, the server does not need to automatically match a screen-warming theme according to the message information, the first target image selected by the user in a self-defined manner is directly acquired and assembled with the first message information to form a first message body, and then a second message request comprising the first message body and the screen-warming identifier is generated and sent to the intelligent device, or a message person can also independently select a proper first target image from the local images. When the server does not recognize the self-defined identification, the fact that the message sender does not self-define the first target image is indicated, the server can automatically match the second target image according to the message information, the second target image and the message information are assembled into a second message body, and a fourth message request comprising the second message body and the screen identification is sent to the intelligent device.

After receiving the message request sent by the server, the intelligent device needs to further detect the switch state (namely whether to start) of the self-set screen-warming message function when identifying that the intelligent device has the screen-warming identifier; if the message-leaving function of the screen-exceeding is not started, even if the message-leaving request has the screen-exceeding mark, the message body cannot be displayed in the screen-exceeding message-leaving mode, the common message-leaving mode is adopted, the prompt information is displayed, the user is prompted to receive a new message, and the user can conveniently check the message in the message board application of the intelligent equipment terminal; if the message-leaving function of the screen-leaving is started, a screen-leaving message can be carried out, namely a floating layer is established, the target image and the message information in the message body are fused into the corresponding display control in the floating layer, and the floating layer is displayed on the upper layer of the current interface, so that the message-leaving effect of the screen-leaving is realized; and when the intelligent device does not recognize the screen-warming identification (or recognizes the non-screen-warming identification), the common message mode is executed no matter whether the screen-warming message function of the intelligent device is started or not.

According to the method and the device, the assembled message body can be combined with the text, the display effect of the message is improved, the message body is finally displayed on the screen of the intelligent device in a screen-free message mode, the message is improved in view of appreciation and significance, the user operates the message at the terminal device end, the message display of the intelligent device in the home scene is realized through communication interaction among the devices, the message information is not limited to be input and displayed at the local end of the intelligent device, the application function of the message board is improved and improved, the message mode is expanded, more diversified message modes are provided for the user, and the practical application experience of the user is improved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following description will briefly explain the drawings required for the embodiments, and it is apparent that the drawings in the following description are only some embodiments of the present invention and that other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 illustrates a usage scenario of a display device according to some embodiments;

fig. 2 shows a hardware configuration block diagram of the control apparatus 100 according to some embodiments;

fig. 3 illustrates a hardware configuration block diagram of a display device 200 according to some embodiments;

FIG. 4 illustrates a software configuration diagram in a display device 200 according to some embodiments;

FIG. 5 illustrates an icon control interface display diagram for an application in a display device 200 according to some embodiments;

FIG. 6 is a schematic diagram illustrating an interface of a message board in a display device;

a schematic diagram of a device list interface in a terminal device is exemplarily shown in fig. 7;

fig. 8 is a schematic diagram schematically illustrating a first message board interface in a terminal device;

fig. 9 is a schematic diagram illustrating a first message board interface after clicking an extended function control in a terminal device;

Fig. 10 is a schematic diagram schematically illustrating a screen theme list interface in a terminal device;

fig. 11 is a schematic diagram schematically showing a second message board interface in the terminal device;

a schematic diagram of a display device display message body is exemplarily shown in fig. 12;

fig. 13 is a schematic diagram illustrating an interface after a message board in a display device is updated after a message is withdrawn from a screen;

fig. 14 is a schematic diagram schematically showing update transmission records of a first message board interface in a terminal device;

fig. 15 is a flowchart schematically showing a message display method executed by the terminal device side;

a flowchart of a message display method performed by the server side is exemplarily shown in fig. 16;

fig. 17 is a flowchart schematically showing a message display method executed by the smart device side;

FIG. 18 is a schematic diagram illustrating three-terminal interaction logic corresponding to an AI Bascreen mode;

a schematic diagram of three-terminal interaction logic corresponding to the custom screen-up mode is shown in fig. 19.

Detailed Description

For purposes of clarity and implementation of the present application, the following description will make clear and complete descriptions of exemplary implementations of the present application with reference to the accompanying drawings in which exemplary implementations of the present application are illustrated, it being apparent that the exemplary implementations described are only some, but not all, of the examples of the present application.

It should be noted that the brief description of the terms in the present application is only for convenience in understanding the embodiments described below, and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms "first," second, "" third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for limiting a particular order or sequence, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the function associated with that element.

Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in fig. 1, the display device 200 is also in data communication with a server 400, and a user can operate the display device 200 through the smart device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display apparatus 200 by inputting a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, and the like.

In some embodiments, the smart device 300 may include any one of a mobile terminal, tablet, computer, notebook, AR/VR device, etc.

In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device.

In some embodiments, the smart device 300 and the display device may also be used for communication of data.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control apparatus configured outside the display device 200 device.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

In some embodiments, software steps performed by one step execution body may migrate on demand to be performed on another step execution body in data communication therewith. For example, software steps executed by the server may migrate to be executed on demand on a display device in data communication therewith, and vice versa.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200.

In some embodiments, the communication interface 130 is configured to communicate with the outside, including at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module.

In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, keys, or an alternative module.

Fig. 3 shows a hardware configuration block diagram of the display device 200 in accordance with an exemplary embodiment.

In some embodiments, display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, memory, a power supply, a user interface.

In some embodiments the controller comprises a central processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, for receiving an image signal from the controller output, for displaying video content, image content, and components of a menu manipulation interface, and a user manipulation UI interface, etc.

In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, the modem 210 receives broadcast television signals via wired or wireless reception and demodulates audio-video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, or the like. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other operable control. The operations related to the selected object are: displaying an operation of connecting to a hyperlink page, a document, an image, or the like, or executing an operation of a program corresponding to the icon.

In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), video processor, audio processor, graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.

A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions received from the outside, so as to finally display and play various audio and video contents. The CPU processor may include a plurality of processors. Such as one main processor and one or more sub-processors.

In some embodiments, a graphics processor is used to generate various graphical objects, such as: at least one of icons, operation menus, and user input instruction display graphics. The graphic processor comprises an arithmetic unit, which is used for receiving various interactive instructions input by a user to operate and displaying various objects according to display attributes; the device also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the video processor is configured to receive an external video signal, perform at least one of decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image composition, and the like according to a standard codec protocol of an input signal, and obtain a signal that is displayed or played on the directly displayable device 200.

In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image compositing module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the demultiplexed video signal, including decoding, scaling and the like. And an image synthesis module, such as an image synthesizer, for performing superposition mixing processing on the graphic generator and the video image after the scaling processing according to the GUI signal input by the user or generated by the graphic generator, so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received frame rate into a video output signal and changing the video output signal to be in accordance with a display format, such as outputting RGB data signals.

In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode according to a standard codec protocol of an input signal, and at least one of noise reduction, digital-to-analog conversion, and amplification, to obtain a sound signal that can be played in the speaker.

In some embodiments, a user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

In some embodiments, a "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include at least one of a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

In some embodiments, the user interface 280 is an interface (e.g., physical keys on a display device body, or the like) that may be used to receive control inputs.

In some embodiments, a system of display devices may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together form the basic operating system architecture that allows users to manage files, run programs, and use the system. After power-up, the kernel is started, the kernel space is activated, hardware is abstracted, hardware parameters are initialized, virtual memory, a scheduler, signal and inter-process communication (IPC) are operated and maintained. After the kernel is started, shell and user application programs are loaded again. The application program is compiled into machine code after being started to form a process.

Referring to FIG. 4, in some embodiments, the system is divided into four layers, from top to bottom, an application layer (referred to as an "application layer"), an application framework layer (Application Framework layer) (referred to as a "framework layer"), a An Zhuoyun row (Android run) and a system library layer (referred to as a "system runtime layer"), and a kernel layer, respectively.

In some embodiments, at least one application program is running in the application program layer, and these application programs may be a Window (Window) program of an operating system, a system setting program, a clock program, or the like; or may be an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.

The framework layer provides an application programming interface (application programming interface, API) and programming framework for application programs of the application layer. The application framework layer includes a number of predefined functions. The application framework layer corresponds to a processing center that decides to let the applications in the application layer act. Through the API interface, the application program can access the resources in the system and acquire the services of the system in the execution.

As shown in fig. 4, the application framework layer in the embodiment of the present application includes a manager (manager), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used to interact with all activities that are running in the system; a Location Manager (Location Manager) is used to provide system services or applications with access to system Location services; a Package Manager (Package Manager) for retrieving various information about an application Package currently installed on the device; a notification manager (Notification Manager) for controlling the display and clearing of notification messages; a Window Manager (Window Manager) is used to manage bracketing icons, windows, toolbars, wallpaper, and desktop components on the user interface.

In some embodiments, the activity manager is used to manage the lifecycle of the individual applications as well as the usual navigation rollback functions, such as controlling the exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of the display screen, judging whether a status bar exists or not, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window to display, dithering display, distorting display, etc.), etc.

In some embodiments, the system runtime layer provides support for the upper layer, the framework layer, and when the framework layer is in use, the android operating system runs the C/C++ libraries contained in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the kernel layer contains at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

In some embodiments, the display device may directly enter the preset vod program interface after being started, where the vod program interface may include at least a navigation bar 510 and a content display area located below the navigation bar 510, as shown in fig. 5, where the content displayed in the content display area may change with the change of the selected control in the navigation bar. The program in the application program layer can be integrated in the video-on-demand program and displayed through one control of the navigation bar, and can be further displayed after the application control in the navigation bar is selected.

In some embodiments, the display device may directly enter the display interface of the signal source selected last time after being started, or the signal source selection interface, where the signal source may be a preset video on demand program, or may be at least one of an HDMI interface, a live tv interface, etc., and after the user selects a different signal source, the display may display the content obtained from the different signal source.

The above embodiments introduce the content of hardware/software architecture, function implementation, etc. of the display device, and in the practical application scenario, the intelligent device for displaying the message information is not limited to the above display device (such as a television), but may be applied to devices that support the message board function and have UI display capability, such as an intelligent refrigerator, a smart desk lamp, etc. The user A can directly input the expected message information at the local end of the intelligent equipment, so that other users except the user A in the scene can view the message information of the user A in the message board. In more application scenarios, the local direct message may not be easy to implement, for example, the user a is not at home, but still wants to make the refrigerator at home display his message information, and then the cross-end remote message needs to be implemented through communication interaction between devices. For the interaction three-terminal in the application relates to terminal equipment, a server and intelligent equipment, wherein the terminal equipment can be mobile terminals such as smart phones, tablets, notebook computers and the like, or terminals such as desktop computers and the like, and a user inputs message information in the terminal equipment; the server is used for fusing the message information with the screen-warming effect so as to assemble a message body, and pushing the message input by the user at the terminal equipment to the intelligent equipment at the far end; the intelligent device receives the message information (common message mode) or message body (screen-display message mode) sent by the server, and displays the message according to the corresponding mode.

In some embodiments, the terminal device and the intelligent device can synchronously install the message board application, and the user can click on an icon of the message board application to access the message board and view a message record in the message board, wherein the message record comprises historical message information and newly received message information which has not been read. For example, in the example of fig. 5, the icon of the message board application is shown on the homepage of the display device, and in the practical application, the icon of the message board application can also be accessed through other paths, such as an application center or a toolbar of the intelligent device.

In some embodiments, the message records in the message board may be ordered in chronological order, such as by showing the most recent message information in the highest order bit of the message board. For example, if the message record in the message board is displayed along the transverse direction, the latest message information is displayed at the first position of the message board; if the message record in the message board is displayed longitudinally, the latest message information is displayed at the last position of the message board, so that a user can quickly position and read the latest message without turning pages.

In some embodiments, fig. 6 is an example of an interface of a message board provided by taking an intelligent device as a display device, in which each message is displayed in a lateral direction, and a user may operate a remote control or touch to switch a focus, so as to locate and switch the message to be viewed. The message information can be in the forms of text, video, audio, pictures and the like, and each message information can be used for remarking message persons, state information and sending time. For example, in fig. 6, the first message is that the message is in today 17:30, the message is sent in a text form, the message person is a son in a family member, the state information of the remark of the message is 'unread', and the fact that the message is not read by any user at the display equipment end after being received is indicated; the second message in fig. 6 is the message in the form of video sent by the message taker at 9:10 of the present day, and the message is recorded in the table of the family member and sent, and the remarked state information is "read", which indicates that the message has been checked before and belongs to the category of the history message record.

In some embodiments, the message board has different display effects of different forms of message information, for example, text forms directly display text; the video form can select one frame of image as a background image, a video playing control is arranged on the background image, the video duration is marked, and a user can watch a video message by clicking the video playing control; the voice playing control is displayed in the audio form, the audio time length is marked, and the user clicks the voice playing control, so that a voice message played by the intelligent equipment can be heard; the picture form is just to directly display the picture.

In some embodiments, when the smart device receives the message from the touch screen, the message body may be displayed in the message board. If the target image in the message body is a static background, the message record inserted in the message board can display a thumbnail of the static image, and the scaled message information is overlapped and displayed in the thumbnail; if the target image in the message body is a dynamic background, such as a GIF (graphic information f) diagram, a frame of image can be cut from the dynamic image to be used as a background image, the message record can present a thumbnail of the background image, and the zoomed message information is overlapped and displayed in the thumbnail; or if the target image in the message body is a dynamic background, the message body can be dynamically displayed in the message board, namely, the message body is equivalent to the message of the screen in the message board to be zoomed and displayed. The scaling of each message record is suitable for the size of the message board in the interface so as to achieve a better visual effect.

In some embodiments, device information of the local smart device may be displayed at a designated location on the message board, such as in the lower left corner of the message board in fig. 6, which may include the brand, model, name, IP address, MAC address, etc. of the smart device.

In some embodiments, referring to fig. 6, an edit control may be disposed on the message board, and when the user clicks "edit", one, more or all of the message information may be selected, so as to complete operations such as batch deletion, batch reading, and the like.

In some embodiments, a user may register an account number of the message board application, where the account number may be logged in at a terminal device or may be logged in at an intelligent device, and when the account numbers logged in by the terminal device and the intelligent device are the same, a communication association is established between the terminal device and the intelligent device, and message information input by the terminal device may only be pushed to the associated intelligent device. The terminal device may dynamically maintain a device list, where device information of the intelligent device currently associated with the terminal device is recorded, where the device information may include a device name and a device class, so as to facilitate user identification of the device, and the device information may further include an IP address, a MAC address, and so on. When a user starts a message board application at the terminal equipment, if the equipment list at least comprises two intelligent equipment, an equipment list interface corresponding to the equipment list is displayed, so that the user selects one of the intelligent equipment to communicate and push message information.

In some embodiments, when the intelligent device receives new message information, a prompt message for prompting the user to view the new message is generally displayed, and the prompt message may be a prompt identifier, for example, a prompt identifier is displayed in the upper right corner of an icon applied to the message board in fig. 5, and the prompt identifier and the icon should have significant differentiation, so that the user can conveniently identify and view the message, and when the user sees that the prompt identifier appears on the icon, the intelligent device can know that the new message is received. The reminding mark can specifically display the quantity of the message information in an unread state in the current message board. The mode of prompting information is not limited to the prompting identification mode, and other realization modes such as prompting bullet frames can be adopted.

In some embodiments, the present application adds a message-blocking function to the message board application at the intelligent device end based on the existing message prompt, for example, in fig. 6, a switch control of the message-blocking function may be set on the message board, if the switch control of the message-blocking function is in a closed state, the message-blocking function is not started, and the message-blocking function is processed according to the prompt display logic of the common message; if the user opens the switch control of the screen-warming message function and starts the screen-warming message function, the message information input by the user at the terminal equipment is displayed on the screen of the intelligent equipment in a screen-warming message mode by default.

In some embodiments, the message on the screen is a special effect of fusing the matched subject on the message information input by the user, that is, the server side assembles the message information and the target image matched with the message information into a message body, and the intelligent device side performs display of the message on the screen after receiving the message body pushed by the server.

In some embodiments, when the message body is displayed, the display is controlled to establish a floating layer with certain transparency (such as translucency), the message body is embedded into the floating layer, and then the floating layer is displayed on the upper layer of the current UI interface in a full screen mode, so that the message information is displayed in the form of the super screen. In some embodiments, different display controls, such as a control for displaying a target image in a message body and a control for displaying message information in the message body, may be included in the established floating layer, so that different content classifications in the message body are embedded into corresponding display controls, and finally unified display of the message body by the floating layer is realized.

In some embodiments, the message on the screen may be accompanied by a special effect of the background of the screen loaded and displayed on the lower layer of the message, so that the ornamental and the significance of the message are improved. In some embodiments, the message on the screen can be synchronously loaded with a sound special effect, for example, the message information is "happy birthday of a congratulate mother", the target image in the message body can be a picture matched with the subject such as a birthday cake or a gift, and the target image can be a static image or a dynamic image, so that the assembled message body can be combined with a picture and a text, the display effect of the message information is improved, and the happy birthday song can be synchronously loaded and played when the message body is displayed, so that the message quality and the display effect are improved in three aspects of picture and text sound.

The description will be made from the viewpoint of UI interaction. Firstly, a terminal device side takes the terminal device as a smart phone as an example, a user can enter a message board application through a certain path, for example, an icon of the message board application can be found through a tool page, and the message board application can be started by clicking the icon. If the message board application does not log in the account, displaying an account login page, and finishing login by inputting the account and the password by the user. If the account number is logged in, automatically inquiring the associated intelligent devices, determining whether the number of the associated devices exceeds 1, if the number of the associated devices exceeds 1, displaying a device list interface shown in fig. 7, wherein in fig. 7, the device information of the associated devices logged in the same account number with the terminal is displayed in my device, and the device information comprises brands, categories, names and the like of the devices; the user name of the user initiating the sharing can be remarked in the "sharing to my device", namely, other users authorize and share the intelligent device to the local end user corresponding to the third party account number. The user selects one of the device lists as a target device, namely a message-leaving object, and after the user finishes clicking, the device list interface of FIG. 7 is automatically collected and jumps to a first message board interface corresponding to the target device selected by the user; if the number of the intelligent devices currently associated with the terminal is only 1, the user does not need to select, namely, the device list interface is not displayed, and the first message board interface corresponding to the intelligent device currently uniquely associated is directly displayed.

In some embodiments, fig. 8 shows a first message board interface in a terminal device, where the top of the interface notes device information of an intelligent device to which the current message board is correspondingly directed; the middle part of the first message board interface displays the history sending records of the message information of the home terminal under the current account, and if the number of the history sending records is more, the page can be turned by sliding up and down; the bottom of the first message board interface is provided with operation controls such as a voice control, a text input box, an expansion function control and the like. After clicking the voice control, the user can input and send the message information in the audio form according to the operation guide, such as pressing speaking and loosening sending; after the user clicks the text input box, the electronic keyboard is automatically popped up at the bottom of the interface, the user can input the message information in the text form by clicking the electronic keyboard, and then the message information is sent by clicking the sending button.

In some embodiments, after the user clicks the extended functionality control (i.e. the +) in fig. 8, the bottom of the interface automatically pops up more hidden message modes, which may also include a text message control, a video message control, a custom screen message control, and so on, as in the example of fig. 9. When a user clicks the text message, a picture can be selected from the local album to be used as message information; when a user clicks a video message, the user can enter a shooting preview interface, the user can switch a front camera/a rear camera in the shooting preview interface, the shooting button is pressed to record the video message, after the video recording is finished, the sending button is clicked to send the message information in the video form.

In some embodiments, the present application provides two types of screen-bar modes for generating message bodies, one is an AI screen-bar mode and the other is a custom screen-bar mode.

First, an AI (automatic input) screen mode is described, which is to automatically acquire a target image matched with message information by a server. When a user inputs second message information through any one of a voice control, a text input box, a text message control, a video message control and other information input controls, clicking a sending button after the first message board interface inputs the second message information, generating a third message request according to the second message information by the terminal equipment, and sending the third message request to the server; the server not only has strong information computing processing capability, but also stores a large amount of image resources, when a third message request sent by the terminal equipment is received, and no user-defined identification exists in the third message request, for example, the target image presenting the screen-warming effect can be automatically matched and obtained according to the keyword or the semantic of the second message information. If the second target image can be obtained (namely, the matching is successful), the second message information and the second target image are fused to form a second message body, and then a fourth message request is sent to the intelligent device, wherein the fourth message request comprises the second message body and a screen-warming identifier, and the screen-warming identifier is used for indicating that the intelligent device needs to display the second message body in a screen-warming message mode; after receiving the fourth message request, the intelligent device recognizes that the message request has the screen-warming identification, and gives out an adaptive message prompting mode according to the on-off state of the screen-warming message function. When the message leaving function of the screen is started, the second message body is displayed in a message leaving mode of the screen (namely, in the form of the floating layer); and if the message leaving function of the screen is not started, displaying prompt information for prompting the user to view the new message.

In some embodiments, the server side may specifically include an operation module, a semantic module, and a message pushing module. The operation module is mainly oriented to a server-side person, the server-side person views the received second message information, and the second target image can be manually matched according to the keywords, the semantics and the like of the second message information, for example, the second message information viewed by the server-side person is' wish old mother is happy in birthday of 50 years! The keywords which can be screened out are 'happy birthday' and '50', and the second target image which is manually matched is a birthday cake picture inserted with a digital 50 candle; and inputting the received second message information into a semantic module for AI semantic recognition, so as to automatically match and output a second target image. If any one of the operation module and the semantic module outputs a matched second target image, the matched second target image can be assembled with second message information to obtain an effective second message body; if the operation module and the semantic module are both matched with the second target image, the priority of the manual matching is higher, namely the image matched by the operation module is used as the second target image, because the manual thinking and voice analysis capability is higher than that of the semantic module, the matching degree of the second target image matched by the manual is higher with the second message information, such as the message I of the second message information' wish to aged mother is happy in birthday of 50 years! The keyword captured by the semantic module may only be "happy birthday", and then the second target image matched is a common birthday cake without a candle identifying birthday. The message pushing module is used for sending message requests to the intelligent device, including a second message request, a fourth message request and a fifth message request.

In some embodiments, after the server receives the third message request, the second message may not have significant key information, such as "123", or the second message may have ambiguity or unclear semantic expression, and neither the manual nor the AI can screen the matched second target image from the image resource of the server, that is, the output of the operating module and the semantic module is null, the matching of the second target image fails, so that a valid second message body cannot be obtained, and the second message information cannot display a superbar message, and the server generates a fifth message request according to the second message information, and adds a non-superbar screen identifier to the fifth message request, where the non-superbar screen identifier is used to instruct the intelligent device to perform only a normal message mode, that is, display a prompt message for prompting the user to view a new message, and not perform the superbar screen mode, no matter whether the intelligent device enables the superbar screen message function. After the server receives the fifth message request, the server identifies the non-screen-rejection identification, and can directly execute the common message mode without detecting the switch state of the screen-rejection message function.

Secondly, a user-defined screen-over mode is described, and the user-defined screen-over mode does not need a server to match a target image according to message information, but supports a terminal message user to select the target image in a user-defined mode. In some embodiments, after clicking the custom screen-warming message control in the first message board interface of fig. 9, the user may select the first target image through two custom modes, where the first is that the terminal device invokes the operation module interface to obtain a screen-warming topic list preset by the operator at the server, and then the terminal device displays the screen-warming topic list interface as shown in fig. 10. The screen-based theme list interface comprises different theme images, and a user selects one of the screen-based theme list interface as a target image, namely, the target image is customized according to the screen-based theme pushed by the server.

In the second embodiment of the self-defining target image, the user may also select one of the images stored locally in the terminal as the target image, for example, the user clicks a local image control set in the interface to enter the album image preview interface, the album image preview interface may display thumbnails of all the images stored in the local album, and after clicking one of the thumbnails, the user self-defines the selected local target image. In the application, the target image selected by the user in the two modes is named as a first target image, and after clicking to confirm the first target image, the user can jump to the second message board interface shown in fig. 11.

In some embodiments, fig. 11 provides an example of a second message board interface, where the interface includes an information input box, a first target image selected by user in a self-defining manner is superimposed on a background of the information input box, after the user clicks the information input box, an electronic keyboard is popped up at a lower portion of the interface, so that first message information in a text form input by the user is gradually embedded into the first target image, the user can check a preview effect of a first message body in fig. 11, and then click a send button, and the terminal device generates a first message request according to the first message information and sends the first message request to the server, where the first message request includes a self-defining identifier, and the self-defining identifier is used for indicating that the server does not need to automatically match the target image, but directly assembles the first target image selected by user with the first message information to generate the first message body; after receiving the first message request, the server identifies that the message has a self-defined identifier, if the message also identifies that the message carries the identifier ID of the theme, and indicates that the first target image is selected from the screen-king theme list, the server can directly call the first target image corresponding to the identifier ID of the theme and assemble the first message body with the first message information; if the first target image is selected locally by the user from the terminal, the first message request sent by the terminal device to the server can carry information such as the local first target image or the URL thereof, so that the server can directly receive the data of the first target image after receiving the first message request, or can acquire the resources of the first target image according to the information, thereby assembling the first message body with the first message information.

Then the server sends a second message request to the intelligent device, wherein the second message request comprises a first message body and an over screen identifier; after receiving the second message request, the intelligent device recognizes that the message request has the screen-warming identification, and gives out an adaptive message prompting mode according to the on-off state of the screen-warming message function. When the message leaving function of the screen is started, the first message body is displayed in a message leaving mode of the screen (namely, in the form of the floating layer); and if the message leaving function of the screen is not started, displaying prompt information for prompting the user to view the new message.

In some embodiments, a theme change control is further provided in the interface of fig. 11, and if the user is not satisfied with the preview effect of the first message body, and may click on the theme change control, the terminal device returns to the screen-super theme list interface shown in fig. 10, and the user reselects the first target image until the user finally reaches the satisfied effect, and clicks on the send button. The second message board interface is not limited to inputting first message information in text form, for example, a voice input control, a video recording control, a picture inserting control and the like can be further set to input first message information in other forms in a custom screen.

In some embodiments, the list of the screen-up subjects is sent to the terminal device by the server after receiving a message notification that the user selected the custom screen-up message control, each topic in the list of touchscreen topics is associated with a representation/sound presented to the user, along with a corresponding identification ID. Wherein the image can be displayed to the user through the display and the sound can be played to the user through the speaker.

In some embodiments, the list of the topics on the screen may be cached in the terminal device in advance, and the user may download or automatically preset the message board application program in the memory of the terminal device, where each topic in the list of topics on the screen corresponds to the portrait/sound presented to the user, and the corresponding ID is mapped to the ID of the topic in the list and the ID of the topic stored in the server.

In some embodiments, the generated message request includes, in addition to the message information, an identification ID of a theme selected by the user from the list of the tyred topics, and the server may search and call at least one of a target portrait, a sound, and a video of the corresponding theme according to the identification ID carried in the message request.

In some embodiments, the list of the subject on the touch screen may be a file stored in the terminal device, the generated message request includes a file selected by the user in addition to the message, and the server may reassemble the message body according to the received file and the message.

In some embodiments, the generated message request includes, in addition to the message information, the topic information, where the topic information may be an ID corresponding to the topic, or may be a topic file, or information such as URL of the topic file.

In some embodiments, the image may be picture information, or may be a continuous frame file composed of multiple frames of pictures, such as a video, GIF file, etc.

In some embodiments, because the user has already pre-selected the first target image in the custom screen-over mode, that is, the server does not need to perform manual and/or AI matching, before the terminal device sends the first message request, the custom identifier is added to the first message request. After receiving the first message request, the server recognizes that the user-defined identifier is provided, and the server does not need to manually and/or AI (advanced technology interface) match the target image according to the first message information, but directly assembles the first message information and the first target image selected by the user in the screen-based theme list interface into a first message body, and adds the screen-based identifier to the first message body; or setting the value of the flag bit in the pre-set screen-warming identification field in the second message request to be 1, wherein the value of 1 represents the screen-warming identification, the value of 0 represents the non-screen-warming identification, and then sending the first message body to the intelligent device, so that after the intelligent device receives the first message body, accessing the screen-warming identification field, and recognizing that the value of the flag bit is 1, namely recognizing that the screen-warming identification exists. The fourth message request may be set to the screen identifier, and the fifth message request may be set to the non-screen identifier, which will not be described herein.

In the foregoing embodiment, the second message request and the fourth message request sent by the server to the intelligent device include the screen-in-process identifier, and the fifth message request sent by the server to the intelligent device includes the non-screen-in-process identifier, so that the intelligent device end selects the corresponding message mode according to the identifier indication carried in the message request sent by the server and the switch state for identifying the screen-in-process message function. Because the first message body or the second message body is basically a form of message information, the intelligent equipment end can identify whether the received message information is a common message or a message body by setting the screen identification/the non-screen identification.

In some embodiments, the server side may synchronously acquire the on-off state of the smart device end screen-warming message function, and the server side may synchronously update the on-off state recorded by the local side according to the operation of the user on the smart device to turn on or off the screen-warming message function.

In some embodiments, before sending the second message request or the fourth message request to the intelligent device, the server queries the on-off state of the screen-warming message function of the intelligent device, and if the intelligent device is queried that the screen-warming message function is started currently, the screen-warming identifier is normally set in the second message request or the fourth message request; if the server inquires that the intelligent device does not enable the screen-warming message function currently, even if the screen-warming identification is set in the second message request or the fourth message request, the intelligent device end can not execute the screen-warming message at all when recognizing the screen-warming identification, so that the server end can directly set the non-screen-warming identification in the second message request or the fourth message request under the condition, after the intelligent device receives the second message request or the fourth message request, the intelligent device end does not need to further recognize the on-off state of the screen-warming message function of the intelligent device, but directly execute the common message mode, and the intelligent device end user can see the effect of the inserted first/second message body in the local message board although the user can not see the message displayed by the screen-warming effect.

In some embodiments, after receiving the first message request or the third message request sent by the terminal device, the server may query the on-off state of the smart device end screen-warming message function, if it is queried that the smart device has already started the screen-warming message function currently, the first message body or the second message body is assembled normally, and the screen-warming identifier is set normally in the second message request or the fourth message request.

In some embodiments, after receiving a first message request sent by a terminal device, if the server inquires that the intelligent device does not enable the screen-warming message function currently, the server does not call a first target image selected by a user in a self-defined manner, cancels an assembly flow of a first message body, directly generates a second message request according to first message information, sets a non-screen-warming identifier in the second message request, namely, the server terminal adaptively and automatically switches to a common message mode according to the state that the intelligent device terminal does not enable the screen-warming message function; after the intelligent equipment receives the second message request, the identified non-screen-blocking identifier does not need to identify the on-off state of the screen-blocking message function, but prompts the first message information in a common message-blocking mode, and under the condition that the intelligent equipment end user looks up the first message information in the local message board and does not need to block the message in the form of the first message body.

In some embodiments, after receiving the third message request sent by the terminal device, if the server inquires that the intelligent device does not enable the screen-warming message function currently, the server does not execute a process of manually and/or AI matching the second target image, further cancels a process of assembling the second message body, directly generates a fifth message request according to the second message information, sets a non-screen-warming identifier in the fifth message request, namely, the server terminal adaptively and automatically switches to a common message-leaving mode according to the state that the intelligent device terminal does not enable the screen-warming message function; after the intelligent equipment receives the fifth message request, the identified non-screen-blocking identifier does not need to identify the on-off state of the screen-blocking message function, but prompts the second message in a common message-blocking mode, and under the condition that the intelligent equipment end user looks up the second message in the local message board and does not need to block the message in the second message body.

In some embodiments, after receiving the second message request (custom screen-bar) or the fourth message request, the smart device recognizes that the smart device has a screen-bar identifier, and detects that the screen-bar message function is enabled, displays a message body (the message body is a first message body or a second message body in the application) in a screen-bar message mode, inserts the message body into the highest order bit of the local message board, and notes the sending time, the message person and the unread state of the message body. At this time, as shown in fig. 12, the message body is embedded into the uppermost floating layer for full screen display, when the user in the home scene passes through the intelligent device, the user can easily see the message on the screen, if the user performs a return operation, the message on the screen is automatically withdrawn, the state information of the corresponding message body in the local message board is changed to be read, as shown in fig. 13, after the message on the screen is withdrawn, the updated interface of the message board on the device side is displayed, and the message body on the message board on the screen is inserted into the left head of the message board and is in the read state.

In some embodiments, after receiving the fifth message request, the intelligent device recognizes that the intelligent device has a non-screen-blocking identifier, and then, without detecting the on-off state of the self-screen-blocking message function, directly displays a prompt message for prompting the user to check a new message according to a common message mode, inserts the second message into the highest order bit of the local message board, and notes the sending time, the message person and the unread state of the second message. After the user opens the local message board of the intelligent device based on the prompt information and clicks to view the newly received and unread second message information, the state information of the second message information is changed into the read state information.

In some embodiments, the message body obtained by the server in the AI screen-overlong mode or the custom screen-overlong mode is not only required to be sent to the intelligent equipment end, but also required to be simultaneously sent to the terminal equipment, so that the input end and the receiving end of the message keep the message synchronous, and the sending record of the message information under the current account of the terminal equipment is updated. After the server assembles and generates the message body, the message body is sent to the terminal equipment; after the terminal device receives the message body sent by the server, as shown in fig. 14, the message body is inserted into the first message board interface according to the sending time (i.e. the time of receiving the clicking operation on the sending control) sequence of the terminal to display, and in fig. 14, the sending record is displayed longitudinally, then the newly received message body is inserted into the last position of the first message board interface, and the sending time is displayed above the message body.

In some embodiments, after receiving the third message request, the server side sends a matching failure message to the terminal device if the second target image is not matched; and if the terminal equipment receives the matching failure information sent by the server, the terminal equipment acquires that the second message information input by the local end cannot be displayed in the form of a second message, inserts the second message information input by the user into the first message board interface according to the sending time sequence for display, and displays the corresponding sending time above the message information.

In some embodiments, after receiving the first message request or the third message request, if the intelligent device is queried that the message function of the screen is not started, the server does not execute processing logic for assembling the message body, and all the server sends message indicating information of the screen which is not started to the terminal device according to a conventional common message mode; the terminal equipment receives the message indicating information of which the super screen is not started, controls the display to display corresponding prompt information so as to prompt the intelligent equipment at the opposite end of the message sender to start the super screen message function, and simultaneously inserts the message information input by the user (the message information is the first message information or the second message information) into the first message board interface according to the sequence of the sending time to display, and displays the corresponding sending time above the message information.

In some embodiments, when the status information of each message record in the message board of the intelligent device side changes, the intelligent device synchronizes the status information to the server, the server can send the status information to the terminal device again, and the terminal device controls the display to display the received status information, so that a message person can know whether the message information received in the intelligent device at the opposite side is read or not.

The above UI is exemplified by a display device, and the UIs of other types of intelligent devices embodied on message board applications and message on a screen are basically similar to the display device, and are not listed here. The UI interface provided in this application is merely exemplary, and is specific to actual application and design.

In some embodiments, fig. 15 shows a message display method executed by a terminal device side, where an execution subject of the method is a controller in the terminal device, and the method includes the following program steps:

step S101, receiving operation of starting a message board application, and controlling a display to display a first message board interface. The first message board interface may refer to fig. 8 and 9, which include a custom screen message control.

Step S102, clicking operation of a custom screen-fired message control in the first message board interface is received, and a screen-fired theme list interface is controlled to be displayed by a display. A schematic diagram of the tabbed thematic list interface may refer to fig. 10.

Step S103, receiving the selection operation of the first target image in the screen-fired theme list interface, and controlling a display to display a second message board interface. The second message board interface may be schematically shown in fig. 11, which includes an information input box on which the first target image is superimposed.

Step S104, receiving first message information input by a user in an information input box of a second message board interface, generating and sending a first message request comprising a user-defined identifier to a server according to the first message information.

The first message request comprises a self-defined identifier, so that after the server receives the first message request, the self-defined identifier is identified, a first target image customized by a user is directly called, first message information and the first target image are assembled into a first message body, and a second message request is sent to the intelligent device, wherein the second message request comprises the first message body and a screen-in-screen identifier, and the screen-in-screen identifier is used for indicating the intelligent terminal to display the message body in a screen-in-screen message mode; after receiving the second message request, the intelligent device displays the first message body in a floating layer mode on the upper layer of the current interface when recognizing that the second message request has the screen-warming message function and the second message request has the screen-warming mark, or the intelligent device recognizes that the intelligent device does not have the screen-warming message function, and displays prompt information for prompting the user to view a new message. The user-defined mode of acquiring the first target image from the local storage of the terminal differs from the logic of fig. 15 only in the selection way of the first target image and the mode of calling the first target image by the server, and other contents are basically the same, and the adaptability refers to the logic of fig. 15, so that the description is omitted.

In some embodiments, fig. 16 shows a message display method executed by a server, where an execution subject of the method is a controller in the server, and the method includes the following program steps:

step S201, a message request sent by a terminal device is received.

The message request comprises message information received by the terminal equipment, and the terminal equipment is further used for adding a self-defined identifier to the message request if the message request is generated after a user selects a first target image from a screen-super theme list interface, otherwise, not adding the self-defined identifier. The type of the message request in step S201 may be the first message request or the third message request, which depends on whether the terminal side uses the custom screen to leave a message, but the server cannot actually sense the processing logic executed by the terminal side, so the server determines the type of the message request mainly by whether the message request carries the custom identifier, and thus executes corresponding logic according to the type of the request to determine whether to automatically match the target image.

Step S202, judging whether the custom identification is recognized. If the custom identifier is identified, step S203 is executed, and otherwise, steps S204 to S207 are executed.

Step S203, the first target image and the message information are assembled into a first message body, and a second message request comprising the first message body and the screen identification is sent to the intelligent device.

And the second message request is used for enabling the intelligent equipment to automatically display the first message body in the floating layer form on the upper layer of the current interface if the local end starts the message function of the screen when the screen identification is identified. Of course, if the intelligent device end does not enable the message leaving function of the screen, even if the intelligent device end has the screen identification, the first message body cannot be displayed in the screen leaving mode, and then the intelligent device end is switched to the common message leaving mode.

Step S204, automatically matching the second target image according to the message information.

Step S205, judging whether the second target image is matched; if the second target image is matched, step S206 is performed, otherwise step S207 is performed.

Step S206, the second target image and the message information are assembled into a second message body, and a fourth message request comprising the second message body and the screen-in-screen identification is sent to the intelligent device.

And the fourth message request is used for enabling the intelligent equipment to automatically display a second message body in a floating layer form on the upper layer of the current interface if the local end starts the message function of the screen when the screen identification is identified. If the intelligent equipment end does not enable the message leaving function of the screen, even if the intelligent equipment end has the screen identification, the second message body cannot be displayed in the message leaving mode of the screen, and the intelligent equipment end is switched to the common message leaving mode.

Step S207, a fifth message request comprising the message information and the non-super screen identification is sent to the intelligent equipment.

The fifth message request is used for enabling the intelligent device to not need to inquire whether the home terminal starts the screen-warming message function or not after the intelligent device recognizes the non-screen-warming identification, namely, no matter whether the screen-warming message function is in an on or off state, the screen-warming message is not executed, but a common message mode is executed, and prompt information for prompting a user to check a new message is displayed.

In some embodiments, fig. 17 shows a message display method executed by the smart device side, where an execution subject of the method is a controller in the smart device, and the method includes the following program steps:

step S301, a message request sent by a server is received.

The type of the message request in step S301 may be the second message request, the fourth message request or the fifth message request, which depends on whether the terminal side uses a custom screen message, and whether the server side matches the second target image when the terminal side does not use a custom screen message. The intelligent equipment terminal cannot actually sense the processing logic executed by the terminal side and the server side, so that the intelligent equipment mainly determines whether to execute the message-leaving mode or the common message-leaving mode by combining the on-off state of the message-leaving function of the intelligent equipment terminal with whether the received message-leaving request carries the message-leaving identifier or not.

Step S302, judging whether the screen-warming identification is recognized in the message request. If the screen identification is identified, executing step S303; otherwise, if no screen identifier is recognized or if a non-screen identifier is recognized, step S305 is performed.

Step S303, detecting whether a message leaving function of the screen is started; if the message leaving function is enabled, the message leaving mode of the step S304 is executed, and if the message leaving function is not enabled, the step S305 is executed.

Step S304, the display is controlled to automatically display the message body in the message request in a floating layer form at the upper layer of the current interface. The message body in step S304 is classified as the first message body or the second message body, but the intelligent device side does not need to perceive and identify the message body, and only needs to display the message body in a screen-warming message mode when the screen-warming identification is identified and the screen-warming message function is started.

Step S305, displaying a prompt message for prompting the user to view the new message.

When the intelligent device does not recognize the screen-over identification (or recognizes the non-screen-over identification) from the message request, or recognizes the screen-over identification but does not enable the screen-over message function, the intelligent device executes the common message mode, displays the prompt information, prompts the user to receive a new message, and facilitates the user to check the message information.

In some embodiments, referring to the description of the UI interaction and fig. 18, three-terminal interaction logic corresponding to the AI screen-warming mode is provided, where the three interaction terminals are a terminal device, a server and an intelligent device, respectively, and the intelligent device terminal has enabled the screen-warming message function under the logic:

step (A1), terminal equipment end: responding to the operation of starting the message board application, inquiring the number of the associated devices, and judging whether the number of the associated devices exceeds 1; if there are only 1, performing step (A2); if more than 1, step (A3) is performed. The step (A2) and the step (A3) are to display a first message board interface according to the number of associated devices;

step (A2), terminal equipment end: displaying a first message board interface corresponding to the uniquely associated intelligent device;

step (A3), terminal equipment end: a display device list interface for displaying a first message board interface corresponding to a target device in the device list in response to receiving a selection operation of the target device;

step (A4), terminal equipment end: receiving second message information input by a user in the first message board interface through the information input control, generating a third message request according to the second message information, and sending the third message request to the server; when the second message information is in a non-text format, a server resource uploading interface is called, a message format can be spliced by acquiring a resource ID and URL information of the message, so that a third message request is obtained, the server interface is called to send the third message request to the server, and the spliced message format can ensure that the intelligent equipment of the opposite terminal can acquire the resource of the second message information, so that members of the opposite terminal can view the content of the second message information;

Step (A5), server side: after receiving a third message request sent by the terminal equipment, automatically acquiring a second target image matched with the second message information according to the second message information (for example, by adopting a matching mode combining manual matching and keyword/semantic matching), and judging whether the matched second target image is acquired or not; if the second target image is matched, executing branch logic one; if the second target image is not matched, executing branch logic II;

branch logic one, including steps (A6) through (a 10):

step (A6), server side: assembling the second message information and the second target image into a second message body, and sending a fourth message request to the intelligent device, wherein the fourth message request comprises the second message body and an identifier of a screen, and synchronously sending the second message body to the terminal device;

step (A7), terminal equipment end: receiving a second message body sent by the server, and inserting the second message body into the first message board interface according to the sending time sequence for display;

step (A8), intelligent equipment end: after receiving the fourth message request, identifying the screen-warming identification, and detecting whether the screen-warming message function is started; if the intelligent device has enabled the message function of the screen, executing the step (A9); otherwise, if the intelligent equipment does not enable the screen-warming message function, executing the step (A10);

Step (A9), intelligent equipment end: displaying a second message body in a floating layer mode on the upper layer of the current interface, inserting the second message body into the highest sequence position of the local message board, and remarking the sending time, the message person and the unread state of the second message body;

step (A10), intelligent equipment end: and displaying prompt information for prompting the user to check the new message, inserting the second message body into the highest sequence position of the local message board, and remarking the sending time, the message person and the unread state of the second message body.

Branch logic two, including steps (a 11) to (a 13):

step (A11), server side: sending matching failure information to terminal equipment, generating a fifth message request according to the second message information, and sending the fifth message request to intelligent equipment, wherein the fifth message request comprises a non-super screen identifier;

step (A12), terminal equipment end: receiving matching failure information sent by a server, and inserting second message information into a first message board interface according to a sending time sequence for display;

step (A13), intelligent equipment end: after receiving the fifth message request, identifying a non-super screen identifier, displaying prompt information for prompting a user to check a new message, inserting second message information into the highest sequence bit of the local message board, and remarking the sending time, the message person and the unread state of the second message body.

In some embodiments, referring to the description of the UI interaction and fig. 19, three-terminal interaction logic corresponding to the custom screen-warming mode is provided, where three interaction terminals are a terminal device, a server and an intelligent device, respectively, and under the logic, the intelligent device terminal has enabled the screen-warming message function:

step (B1), terminal equipment end: responding to the operation of starting the message board application, inquiring the number of the associated devices, and judging whether the number of the associated devices exceeds 1; if there are only 1, performing step (B2); if more than 1, step (B3) is performed. The step (B2) and the step (B3) are to display a first message board interface according to the number of associated devices;

step (B2), terminal equipment end: displaying a first message board interface corresponding to the uniquely associated intelligent device;

step (B3), terminal equipment end: a display device list interface for displaying a first message board interface corresponding to a target device in the device list in response to receiving a selection operation of the target device;

step (B4), terminal equipment end: in response to receiving clicking operation of a custom screen-warming message control in a first message board interface, calling an operation module interface to acquire a screen-warming theme list preset by an operator, so as to display a screen-warming theme list interface;

Step (B5), terminal equipment end: responding to the selection operation of the first target image in the main subject list interface of the screen, displaying a second message board interface, wherein the second message board interface comprises an information input box overlapped with the first target image;

step (B6), terminal equipment end: receiving first message information input by a user in an information input box, generating a first message request according to the first message information, wherein the first message request comprises a self-defined identifier, and sending the first message request to a server; when the first message information is in a non-text format, a server resource uploading interface is called, a resource ID and URL information of a message can be obtained to splice a message format, so that a first message request is obtained, the server interface is called to send the first message request to a server, and the spliced message format can ensure that intelligent equipment of an opposite terminal can obtain the resource of the first message information, so that members of the opposite terminal can view the content of the first message information;

step (B7), the server side: after receiving a first message request sent by a terminal device, identifying a self-defined identifier, calling a first target image, assembling first message information and the first target image into a first message body, and sending a second message request to an intelligent device, wherein the second message request comprises the first message body and an identifier of a screen, and synchronously sending the first message body to the terminal device;

Step (B8), terminal equipment end: receiving a first message body sent by a server, and inserting the first message body into a first message board interface according to the sending time sequence for display;

step (B9), the intelligent equipment end: after receiving the second message request, identifying a screen-warming identifier, and detecting whether a screen-warming message function is started; if the intelligent device has enabled the message function of the screen, executing the step (B10); otherwise, if the intelligent equipment does not enable the screen-warming message function, executing the step (B11);

step (B10), the intelligent equipment end: displaying a first message body in a floating layer form on the upper layer of the current interface, inserting the first message body into the highest sequence position of the local message board, and remarking the sending time, the message person and the unread state of the first message body;

step (B11), the intelligent equipment end: and displaying prompt information for prompting the user to check the new message, inserting the first message body into the highest sequence position of the local message board, and remarking the sending time, the message person and the unread state of the first message body.

For the AI screen-warming mode and the user-defined screen-warming mode, when the intelligent equipment displays the message body in the screen-warming message mode, the intelligent equipment responds to receiving the return operation executed by the user, exits the screen-warming message, and changes the state information of the corresponding message body in the local message board into read state, so that the reading state of the message body in the message board is updated in time.

According to the technical scheme, the cross-equipment interactive message from the terminal equipment to the intelligent equipment is realized, the interactive three ends comprise the terminal equipment, the server and the intelligent equipment, the message processing logic of the common message is executed if the intelligent equipment does not enable the message processing function of the message of the screen by adding the message processing function of the screen by the screen on the basis of the conventional message board application at present; if the intelligent device has enabled the screen-over-screen message function, the user can select to execute the AI screen-over-screen mode or the user-defined screen-over-screen mode, the user inputs message information (first message information or second message information) in the terminal device, the server identifies whether the server end is required to match the target image according to whether the message request sent by the terminal device has a user-defined mark, if the message request has the user-defined mark, the matching is not required, and the first target image selected by the user-defined caller and the first message information are directly assembled into a first message body; and if the user-defined identification is not available, the second target image is matched manually and/or through AI, and the matched second target image and the second message information are assembled into a second message body. And when the message body generates a message request, a super screen identifier needs to be added, if the second target image is not matched, a non-super screen identifier needs to be added in a fifth message request generated according to the second message information, and after receiving the message request sent by the server, the intelligent device executes processing logic of a corresponding message mode according to the identifier carried in the message request and the on-off state of the self super screen message function.

According to the method, the message body is assembled by the message information and the target image (AI) in a matching or self-defining mode, so that the assembled message body can be combined with a graphic document, the message quality and the display effect are improved, the message is more striking, the message information is improved in view of appreciation and significance, the user operates the message at the terminal equipment end, the message display of the intelligent equipment in the home scene is realized through communication interaction among the equipment, the message information is not limited to be input and output at the local end of the intelligent equipment, the application function of the message board is improved and improved, the message mode is expanded, more diversified message modes are provided for the user, and the practical application experience of the user is improved.

It will be apparent to those skilled in the art that the techniques of embodiments of the present invention may be implemented in software plus a necessary general purpose hardware platform. In a specific implementation, the present invention also provides a computer storage medium, where the program may be stored. When the computer storage medium is located in any one of the terminal device, the server, and the smart device, the program may include program steps related to a message display method that the controller of any one of the three devices is configured to execute when the program is executed. The computer storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), or the like.

In this application, the single-ended devices and the message display method executed by the configuration of the single-ended devices are listed in the UI interaction and interaction logic, and the same similar parts of the embodiments are referred to each other, so that the relevant contents are not repeated.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A terminal device, comprising:

the communicator is used for being in communication connection with the server;

a controller configured to perform:

2. The terminal device of claim 1, wherein the first message board interface further comprises an information input control, and wherein after displaying the first message board interface, the controller is further configured to perform:

receiving second message information input by a user through the information input control;

and generating and sending a third message request to the server according to the second message information, wherein the third message request is used for enabling the server to automatically match a second target image according to the second message information when no user-defined identification exists in the third message request, assembling the second message information and the second target image into a second message body, and sending a fourth message request to the intelligent device, the fourth message request comprises the second message body and the screen identification, and the fourth message request is used for enabling the intelligent device to automatically display the second message body on the upper layer of the current interface in a floating layer mode after the screen identification is recognized.

3. The terminal device of claim 1, wherein the first message board interface further comprises an information input control, and wherein after displaying the first message board interface, the controller is further configured to:

and generating and sending a third message request to the server according to the second message information, wherein the third message request is used for enabling the server to automatically acquire a second target image matched with the second message information when no self-defined mark is found in the third message request, assembling the second message information and the second target image into a second message body after the second target image is acquired, and sending a fourth message request to the intelligent device, the fourth message request comprises the second message body and a super screen mark, and the fourth message request is used for enabling the intelligent device to automatically display the second message body in a floating layer mode on the upper layer of the current interface after the super screen mark is identified, or generating and sending a fifth message request to the intelligent device according to the second message information when the second target image is not acquired, wherein the fifth message request comprises a non-super screen mark, and the fifth message request is used for enabling the intelligent device to display prompt information for prompting a user to newly leave a message after the non-super screen mark is identified.

4. A terminal device according to any of claims 1-3, characterized in that the controller is further configured to perform:

receiving an operation of starting a message board application;

when only one intelligent device is associated with the terminal device, directly controlling a display to display a first message board interface corresponding to the uniquely associated intelligent device; when the account numbers of the terminal equipment and the intelligent equipment login message board application are the same, the terminal equipment is associated with the intelligent equipment;

or when more than one intelligent device is associated with the terminal device, controlling a display to display a device list interface, wherein a device list displayed by the device list interface at least comprises two intelligent device controls associated with the terminal device; and the intelligent equipment control is used for controlling the display to display a first message board interface corresponding to the target equipment control when receiving the selection operation of the target equipment control in the equipment list.

5. A terminal device, comprising:

the communicator is used for being in communication connection with the server;

a controller configured to perform:

6. A server, comprising:

a controller configured to perform:

when the user-defined identification is identified, a first target image and message information are assembled into a first message body, and a second message request comprising the first message body and a screen-in-screen identification is sent to the intelligent equipment, wherein the second message request is used for enabling the intelligent equipment to automatically display the first message body in a floating layer mode on the upper layer of a current interface after the screen-in-screen identification is identified; when the user-defined identification is not identified, automatically matching a second target image according to the message information, assembling the second target image and the message information into a second message body, and sending a fourth message request comprising the second message body and the screen identification to the intelligent device, wherein the fourth message request is used for enabling the intelligent device to automatically display the second message body in a floating layer mode on the upper layer of the current interface after the screen identification is identified.

7. The server of claim 6, wherein the controller is further configured to perform:

and after the custom identifier is not identified, when the second target image is not matched according to the message information, a fifth message request comprising the message information and the non-super screen identifier is sent to the intelligent device, wherein the fifth message request is used for enabling the intelligent device to display prompt information for prompting a user to view a new message after the non-super screen identifier is identified.

8. An intelligent device, comprising:

the communicator is used for being in communication connection with the server;

a controller configured to perform:

receiving a message request sent by a server;

9. A message display method in a terminal device, comprising:

10. The message display method in the intelligent equipment is characterized by comprising the following steps of:

receiving a message request sent by a server;