CN114706549A

CN114706549A - Display method, intelligent terminal and storage medium

Info

Publication number: CN114706549A
Application number: CN202210411813.4A
Authority: CN
Inventors: 唐莉莉; 王力博; 陈宇
Original assignee: Shenzhen Transsion Holdings Co Ltd
Current assignee: Shenzhen Transsion Holdings Co Ltd
Priority date: 2022-04-19
Filing date: 2022-04-19
Publication date: 2022-07-05

Abstract

The application discloses a display method, an intelligent terminal and a storage medium, wherein the method comprises the following steps: responding to screen projection operation, and acquiring first display information for displaying a first interface; and sending the first display information to the display equipment so that the display equipment outputs a second interface in at least one target area according to the first display information. By adopting the method provided by the application, the display equipment outputs the second interface in at least one target area according to the display information which is sent by the screen projection equipment and used for displaying the first interface, so that the screen projection use requirement of a user is met, the operation flexibility is improved, the display resources are utilized more reasonably, and the user experience is improved.

Description

Display method, intelligent terminal and storage medium

Technical Field

The application relates to the technical field of display, in particular to a display method, an intelligent terminal and a storage medium.

Background

Along with the popularization of the intelligent terminal, the functions of the intelligent terminal are more and more, and the screen projection function included in the intelligent terminal gradually draws attention of people. The screen projection function means that the intelligent terminal serving as the screen projection device can project an image picture onto the intelligent terminal serving as the display device, so that the image picture displayed by the screen projection device can be viewed from the display device.

In the course of conceiving and implementing the present application, the inventors found that at least the following problems existed: because the display sizes of the intelligent terminals of the screen projection equipment and the display equipment are different, when the image picture of the screen projection equipment is projected to the display equipment to be displayed, the image picture after equal-scale scaling is usually displayed in the central area of the display equipment, and the content is not displayed in the peripheral area or the two side areas of the displayed image picture, so that the phenomenon of black retention occurs, the display resources are wasted, the operability is poor, and the user experience is not good.

The foregoing description is provided for general background information and is not admitted to be prior art.

Disclosure of Invention

In view of the above technical problems, the present application provides a method, an intelligent terminal and a storage medium, which can improve the display resource utilization rate of a display area of a display device, improve the flexibility of operation, and better meet the demand of a user for screen projection use, thereby improving the user experience.

In a first aspect, the present application provides a display method, which is applicable to a screen projection device, and the method includes:

responding to screen projection operation, and acquiring first display information for displaying a first interface;

and sending the first display information to the display equipment so that the display equipment outputs a second interface in at least one target area according to the first display information.

Optionally, at least one of:

a first area is different from at least one target area in display size, wherein the first area comprises an area for displaying the first interface in the screen projection equipment;

the first display information includes display size information of at least one of the target areas.

Optionally, the first interface comprises a desktop interface;

the acquiring first display information for displaying a first interface includes:

acquiring desktop elements in a desktop interface, and determining or generating the first display information according to the desktop elements so that the display equipment generates the second interface according to the first display information; or,

and determining or generating the second interface according to the desktop elements of the desktop interface, and determining the first display information according to the second interface.

Optionally, the second interface comprises at least two applications;

the method further comprises the following steps:

the first display information does not include the second interface;

receiving a first starting instruction sent by the display equipment, and determining a first application according to an application identifier in the first starting instruction; or,

the first display information comprises the second interface;

and receiving the first starting instruction, and determining the first application according to the coordinate information in the first starting instruction.

Optionally, the method further comprises:

receiving a first starting instruction aiming at a first application sent by the display equipment, or responding to a first starting operation aiming at the first application;

when the first application meets a preset condition, determining first size information according to the first starting instruction or the first starting operation;

acquiring a second interface of the first application corresponding to the first size information, and determining the first display information according to the second interface; or acquiring target interface information of the first application corresponding to the first size information, and determining or generating the first display information according to the target interface information.

Optionally, determining or generating the first display information according to the target interface information includes: and acquiring or generating the second interface according to the target interface information and the first size information, and determining the first display information according to the interface information of the second interface.

Optionally, the method further comprises:

receiving a posture adjustment instruction sent by the display equipment, or responding to posture adjustment operation aiming at the first interface;

and updating the first size information according to the posture adjustment instruction or the posture adjustment operation, and determining or generating new first display information according to the updated first size information.

Optionally, the method further comprises:

when the first application does not meet the preset condition, determining or generating the second interface according to the original interface information and the first size information of the first application, and determining the first display information according to the second interface; or,

and determining the first display information according to the original interface information and the first size information, so that the display equipment performs preset processing on the original interface information according to the first size information to determine or generate the second interface.

Optionally, the determining or generating the second interface according to the first application and the first size information includes: and performing preset processing on the first application according to the first size information to generate a second interface corresponding to the first application.

Optionally, the preset process includes a scale-up process, or a padding process.

Alternatively, the first start instruction may include the first size information, or the first size information may be determined according to a type of the first start instruction.

Optionally, the first preset condition is that the identifier of the first application is matched with an identifier library, or the first preset condition is that the first application has interface information of multiple sizes.

Optionally, the at least one target area includes a first target area and a second target area, and a second interface corresponding to the first application is displayed in the first target area;

the method further comprises the following steps:

receiving a second starting instruction aiming at a second application sent by the display equipment, or responding to a second starting operation aiming at the second application;

and sending second display information corresponding to the second application to the display device, so that the display device displays a third interface in the second target area according to the second display information.

Optionally, the method further comprises:

and receiving a zooming instruction sent by the display equipment, acquiring third display information according to second size information in the zooming instruction, and sending the third display information to the display equipment.

Optionally, the third display information includes a fourth interface, and the fourth interface includes a result obtained by adjusting the second interface according to the second size information; or the third display information includes interface information of second size information corresponding to the second interface.

In a second aspect, the present application provides a display method, applicable to a display device, the method including:

receiving first display information sent by screen projection equipment, wherein the first display information is used for displaying a first interface in a first area of the screen projection equipment;

and outputting a second interface in at least one target area according to the first display information.

Optionally, the first display information includes first size information;

the outputting a second interface in at least one target area according to the first display information includes:

and determining or generating the second interface according to the first size information and the interface information of the first interface, and outputting the second interface in the at least one target area.

Optionally, the method further comprises:

responding to attitude adjustment operation, and sending the attitude adjustment instruction to the screen projection equipment;

and receiving new first display information sent by the screen projection equipment, and displaying according to the new first display information or the new first display information and the updated size information.

Optionally, the method further comprises:

receiving a first starting operation aiming at a first application at the second interface, and sending application information of the first application to the screen projection equipment, wherein optionally, the application information comprises an application identifier and/or coordinate information.

Optionally, when the first display information includes the second interface, the application information may include coordinate information; the application information may include an application identification when the first display information does not include the second interface.

the method further comprises the following steps:

receiving a second starting operation aiming at a second application, and sending a second starting instruction aiming at the second application to the screen projection equipment;

and receiving second display information aiming at the second application, and displaying a third interface in the second target area according to the second display information.

Optionally, the method further comprises:

receiving zooming operation aiming at the second interface, and sending second size information corresponding to the zooming operation to the screen projection equipment;

and receiving third display information which is sent by the screen projection equipment and corresponds to the second size information, and displaying according to the third display information.

In a third aspect, the present application provides a display method, which is applicable to a screen projection display system, where the screen projection display system includes a screen projection device and a display device, and the method includes:

optionally, the screen projection device responds to screen projection display operation and sends first display information for displaying a first interface to the display device;

and the display equipment outputs a second interface in at least one target area according to the first display information.

Optionally, the screen projection device displays a first application, and the display device displays an application icon including the first application according to the first display information sent by the screen projection device;

the method further comprises the following steps:

and the display equipment responds to the starting operation aiming at the application icon on the second interface and sends a closing instruction aiming at the first application to the screen projection equipment so as to enable the screen projection equipment to stop displaying the first application.

Optionally, the screen projection device displays the first application in a first area, and after the display device sends the close instruction to the screen projection device, the display device displays the first application in a first target area, where the first target area is different from the first area in display size, and the first target area is an area in the at least one target area.

Optionally, the display device displays the first application in the first target area;

the method further comprises the following steps:

the screen projection equipment responds to the starting operation of the application icon aiming at the first application and sends a closing instruction aiming at the first application to the display equipment so as to enable the display equipment to stop displaying the first application.

Optionally, after receiving a response that the display device closes the first application, the screen projection device displays the first application in a first area, and the display size of the first area is different from that of the first target area.

In a fourth aspect, the present application further provides a screen projection device, including:

the display control device comprises an acquisition unit, a display unit and a display unit, wherein the acquisition unit is used for responding to screen projection operation and acquiring first display information for displaying a first interface;

and the sending unit is used for sending the first display information to the display equipment so that the display equipment outputs a second interface in at least one target area according to the first display information.

In addition, in this aspect, reference may be made to the related matters of the first aspect, and further details of other alternative embodiments of the screen projection device are not described here.

In a fifth aspect, the present application further provides a display device, including:

the screen projection device comprises a receiving unit, a display unit and a display unit, wherein the receiving unit is used for receiving first display information sent by screen projection equipment, and the first display information is used for displaying a first interface in a first area of the screen projection equipment;

and the display unit is used for outputting a second interface in at least one target area according to the first display information.

In addition, in this aspect, other alternative embodiments of the display device can refer to the related contents of the second aspect, and are not described in detail here.

In a sixth aspect, the present application further provides an intelligent terminal, including: the display device comprises a memory and a processor, wherein the memory stores a display program, and the display program realizes the steps of any one of the display methods when being executed by the processor.

In a seventh aspect, the present application further provides a computer-readable storage medium, where a computer program is stored, and the computer program, when executed by a processor, implements the steps of any of the display methods described above.

As described above, the display method of the present application, which is applicable to a screen projection apparatus, includes the steps of: responding to screen projection operation, and acquiring first display information for displaying a first interface; and sending the first display information to the display equipment so that the display equipment outputs a second interface in at least one target area according to the first display information. Through the technical scheme, the screen projection method and the screen projection device can realize that the picture displayed by the display device is different from the picture projected by the screen projection device when the screen is projected by the screen projection device, thereby solving the problem that the picture of the display image projected by the display device can be kept black when the width-to-height ratio of the screen projection device and the display device is different, better displaying the projected interface, improving the flexibility of operation, more meeting the requirement of the user for screen projection use, and improving the user experience.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required to be used in the description of the embodiments will be briefly described below, and it is obvious for those skilled in the art to obtain other drawings without inventive step.

Fig. 1 is a schematic diagram of a hardware structure of an intelligent terminal implementing various embodiments of the present application;

fig. 2 is a communication network system architecture diagram according to an embodiment of the present application;

fig. 3 is a flowchart illustrating a display method according to the first embodiment;

fig. 4a is an interface diagram for establishing connection according to the display method shown in the first embodiment;

fig. 4b is an interface diagram of another connection establishment according to the display method shown in the first embodiment;

FIG. 4c is a diagram showing a switching animation of the display method according to the first embodiment;

fig. 4d is an interface diagram of projecting the first application in the display method shown according to the first embodiment;

fig. 4e is another interface diagram of projecting the first application in the display method shown in the first embodiment;

FIG. 4f is a timing diagram illustrating a display method according to the first embodiment;

fig. 5 is a flowchart illustrating a display method according to a second embodiment;

fig. 6a is an interface diagram of application split screen of the display method shown according to the second embodiment;

fig. 6b is another interface diagram of application split screen of the display method shown according to the second embodiment;

fig. 6c is a timing diagram of application split screen of the display method shown according to the second embodiment;

fig. 7a is an interface diagram of a posture change of the display method shown according to the second embodiment;

fig. 7b is another interface diagram of the posture change of the display method shown according to the second embodiment;

fig. 8 is a flowchart illustrating a display method according to a third embodiment;

fig. 9a is a schematic structural diagram of a display device according to an embodiment of the present application;

fig. 9b is a schematic structural diagram of a display device according to an embodiment of the present application.

The implementation, functional features and advantages of the object of the present application will be further explained with reference to the embodiments, and with reference to the accompanying drawings. Specific embodiments of the present application have been shown by way of example in the drawings and will be described in more detail below. These drawings and written description are not intended to limit the scope of the inventive concepts in any manner, but rather to illustrate the inventive concepts to those skilled in the art by reference to specific embodiments.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, the recitation of an element by the phrase "comprising an … …" does not exclude the presence of additional like elements in the process, method, article, or apparatus that comprises the element, and optionally, identically named components, features, and elements in different embodiments of the present application may have different meanings, as may be determined by their interpretation in the embodiment or by their further context within the embodiment.

It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. Alternatively, the first information may also be referred to as second information, and similarly, the second information may also be referred to as first information, without departing from the scope herein. The word "if," as used herein, may be interpreted as "at … …" or "when … …" or "in response to a determination," depending on the context. Also, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes" and/or "including," when used in this specification, specify the presence of stated features, steps, operations, elements, components, items, species, and/or groups, but do not preclude the presence, or addition of one or more other features, steps, operations, elements, components, species, and/or groups thereof. The terms "or," "and/or," "including at least one of the following," and the like, as used herein, are to be construed as inclusive or mean any one or any combination. Optionally, "includes at least one of: A. b, C "means" any of the following: a; b; c; a and B; a and C; b and C; a and B and C ", again for example," A, B or C "or" A, B and/or C "means" any of the following: a; b; c; a and B; a and C; b and C; a and B and C'. An exception to this definition will occur only when a combination of elements, functions, steps or operations are inherently mutually exclusive in some way.

It should be understood that, although the steps in the flowcharts in the embodiments of the present application are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least some of the steps in the figures may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, in different orders, and may be performed alternately or at least partially with respect to other steps or sub-steps of other steps.

The words "if", as used herein, may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrases "if determined" or "if detected (a stated condition or event)" may be interpreted as "when determined" or "in response to a determination" or "when detected (a stated condition or event)" or "in response to a detection (a stated condition or event)", depending on the context.

It should be noted that step numbers such as S301 and S302 are used herein for the purpose of more clearly and briefly describing the corresponding contents, and do not constitute a substantial limitation on the sequence, and those skilled in the art may perform S302 first and then S301 in specific implementation, but these should be within the scope of the present application.

It should be understood that the specific embodiments described herein are merely illustrative of and not restrictive on the broad application.

In the following description, suffixes such as "module", "component", or "unit" used to indicate elements are used only for facilitating the description of the present application, and have no particular meaning in themselves. Thus, "module", "component" or "unit" may be used mixedly.

The screen projection device or the display device in the application can be an intelligent terminal, and the intelligent terminal can be implemented in various forms. Alternatively, the smart terminal described in the present application may include smart terminals such as a mobile phone, a tablet computer, a notebook computer, a palm top computer, a Personal Digital Assistant (PDA), a Portable Media Player (PMP), a navigation device, a wearable device, a smart band, a pedometer, and the like, and fixed terminals such as a Digital TV, a desktop computer, and the like.

While the following description will be given by way of example of a smart terminal, those skilled in the art will appreciate that the configuration according to the embodiments of the present application can be applied to a fixed type terminal in addition to elements particularly used for mobile purposes.

Referring to fig. 1, which is a schematic diagram of a hardware structure of an intelligent terminal for implementing various embodiments of the present application, the intelligent terminal 100 may include: RF (Radio Frequency) unit 101, WiFi module 102, audio output unit 103, a/V (audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111. Those skilled in the art will appreciate that the intelligent terminal architecture shown in fig. 1 does not constitute a limitation of the intelligent terminal, and that the intelligent terminal may include more or fewer components than shown, or some components may be combined, or a different arrangement of components.

The following specifically describes each component of the intelligent terminal with reference to fig. 1:

the radio frequency unit 101 may be configured to receive and transmit signals during information transmission and reception or during a call, and specifically, receive downlink information of a base station and then process the downlink information to the processor 110; in addition, the uplink data is transmitted to the base station. Typically, radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. Alternatively, the radio frequency unit 101 may also communicate with a network and other devices through wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communications), GPRS (General Packet Radio Service), CDMA2000(Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division duplex-Long Term Evolution), TDD-LTE (Time Division duplex-Long Term Evolution, Time Division Long Term Evolution), 5G, and so on.

WiFi belongs to short-distance wireless transmission technology, and the intelligent terminal can help a user to receive and send e-mails, browse webpages, access streaming media and the like through the WiFi module 102, and provides wireless broadband internet access for the user. Although fig. 1 shows the WiFi module 102, it is understood that it does not belong to the essential constitution of the smart terminal, and may be omitted entirely as needed within the scope not changing the essence of the invention.

The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output as sound when the smart terminal 100 is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the smart terminal 100 (alternatively, a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, and the like.

The a/V input unit 104 is used to receive audio or video signals. The a/V input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, the Graphics processor 1041 Processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphic processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 may receive sounds (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, or the like, and may be capable of processing such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.

The smart terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor, the ambient light sensor may adjust the brightness of the display panel 1061 according to the brightness of ambient light, and the proximity sensor may turn off the display panel 1061 and/or the backlight when the smart terminal 100 moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on the mobile phone, further description is omitted here.

The display unit 106 is used to display information input by a user or information provided to the user. The Display unit 106 may include a Display panel 1061, and the Display panel 1061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the intelligent terminal. Alternatively, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, may collect a touch operation performed by a user on or near the touch panel 1071 (e.g., an operation performed by the user on or near the touch panel 1071 using a finger, a stylus, or any other suitable object or accessory), and drive a corresponding connection device according to a predetermined program. The touch panel 1071 may include two parts of a touch detection device and a touch controller. Optionally, the touch detection device detects a touch orientation of a user, detects a signal caused by a touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and can receive and execute commands sent by the processor 110. Alternatively, the touch panel 1071 may be implemented in various types, such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. Optionally, other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like, and are not limited thereto.

Alternatively, the touch panel 1071 may cover the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although the touch panel 1071 and the display panel 1061 are shown in fig. 1 as two separate components to implement the input and output functions of the smart terminal, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the smart terminal, and is not limited herein.

The interface unit 108 serves as an interface through which at least one external device is connected to the smart terminal 100. Alternatively, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (optionally, data information, power, etc.) from an external device and transmit the received input to one or more elements within the smart terminal 100 or may be used to transmit data between the smart terminal 100 and the external device.

The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a program storage area and a data storage area, and optionally, the program storage area may store an operating system, an application program (such as a sound playing function, an image playing function, and the like) required by at least one function, and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Optionally, the memory 109 may include high speed random access memory, and may also include non-volatile memory, optionally at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 110 is a control center of the intelligent terminal, connects various parts of the entire intelligent terminal using various interfaces and lines, and performs various functions of the intelligent terminal and processes data by operating or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the intelligent terminal. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor, optionally the application processor primarily handles operating systems, user interfaces, application programs, etc., and the modem processor primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The intelligent terminal 100 may further include a power supply 111 (such as a battery) for supplying power to various components, and preferably, the power supply 111 may be logically connected to the processor 110 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.

Although not shown in fig. 1, the smart terminal 100 may further include a bluetooth module or the like, which is not described herein.

In order to facilitate understanding of the embodiments of the present application, a communication network system on which the intelligent terminal of the present application is based is described below.

Referring to fig. 2, fig. 2 is an architecture diagram of a communication Network system according to an embodiment of the present disclosure, where the communication Network system is an LTE system of a universal mobile telecommunications technology, and the LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203, and an IP service 204 of an operator, which are in communication connection in sequence.

Optionally, the UE201 may be the intelligent terminal 100, which is not described herein again.

The E-UTRAN202 includes eNodeB2021 and other eNodeBs 2022, among others. Optionally, the eNodeB2021 may be connected with other enodebs 2022 through a backhaul (optionally an X2 interface), the eNodeB2021 is connected to the EPC203, and the eNodeB2021 may provide the UE201 access to the EPC 203.

The EPC203 may include an MME (Mobility Management Entity) 2031, an HSS (Home Subscriber Server) 2032, other MMEs 2033, an SGW (Serving gateway) 2034, a PGW (PDN gateway) 2035, and a PCRF (Policy and Charging Rules Function) 2036, and the like. Optionally, the MME2031 is a control node that handles signaling between the UE201 and the EPC203, providing bearer and connection management. HSS2032 is used to provide some registers to manage functions such as home location register (not shown) and holds some user-specific information about service characteristics, data rates, etc. All user data may be sent through SGW2034, PGW2035 may provide IP address assignment for UE201 and other functions, and PCRF2036 is a policy and charging control policy decision point for traffic data flow and IP bearer resources, which selects and provides available policy and charging control decisions for a policy and charging enforcement function (not shown).

The IP services 204 may include the internet, intranets, IMS (IP Multimedia Subsystem), or other IP services, among others.

Although the LTE system is described as an example, it should be understood by those skilled in the art that the present application is not limited to the LTE system, but may also be applied to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, and future new network systems (e.g. 5G), and the like.

Based on the above intelligent terminal hardware structure and communication network system, various embodiments of the present application are provided.

It should be noted that the same or similar parts between the various embodiments in this application may be referred to each other. In the embodiments and the implementation methods/implementation methods in the embodiments in the present application, unless otherwise specified or conflicting in logic, terms and/or descriptions between different embodiments and between various implementation methods/implementation methods in various embodiments have consistency and can be mutually cited, and technical features in different embodiments and various implementation methods/implementation methods in various embodiments can be combined to form new embodiments, implementation methods, or implementation methods according to the inherent logic relationships thereof. The above-described embodiments of the present application do not limit the scope of the present application.

First embodiment

The display method, the intelligent terminal and the storage medium provided by the embodiment of the application are further described in detail below. Referring to fig. 3, fig. 3 is a flowchart illustrating a display method according to a first embodiment. The display method shown in fig. 3 includes steps S301 to S303. The display method is realized by the interaction of the screen projection device 30 and the display device 31. The screen projection device 30 and the display device 31 in the display method of the embodiment of the present application may be executed by the intelligent terminal shown in fig. 1, or may be executed by a chip in the intelligent terminal, and the intelligent terminal may be applied to the communication network system shown in fig. 2. Optionally, the display method of this embodiment may also be executed by a server or a server cluster corresponding to the screen projection device 30 or the display device 31. The method shown in fig. 3 is implemented by taking an intelligent terminal as an example, and the display method disclosed in this embodiment includes the following steps:

step S301, the screen projection equipment responds to the screen projection operation and acquires first display information for displaying a first interface.

In the embodiment of the application, the intelligent terminal comprises more and more functions, one of the screen projection functions is one of the screen projection functions, and the screen projection function means that the intelligent terminal serving as the screen projection device can project an image picture onto the intelligent terminal serving as the display device to be displayed, so that the image picture in the screen projection device can be viewed from the display device. For different intelligent terminals, the aspect ratios of the display sizes may be different, for the screen projection device and the display device, if the aspect ratios of the display sizes are different, the projected image picture cannot be scaled in equal proportion, and optionally, when the display device displays the image picture projected by the screen projection device, the image picture projected by the screen projection device may be stretched, which may cause the displayed image picture to be deformed, thereby affecting the viewing of the user. Optionally, when the display device displays the image picture projected by the screen projection device, the display device only performs scaling according to the display size of the width or the height, and uses black filling in the area where the image picture is not displayed, that is, a phenomenon of black remaining occurs, which also affects the viewing of the user, wastes display resources, and has poor operability and affects user experience.

Alternatively, the screen projection apparatus may be understood as an apparatus for projecting an image picture, and the display apparatus may be understood as an apparatus for displaying an image picture projected by the screen projection apparatus. The projection is an operation in which the projection device transmits display data to the display device and the display device displays the display data. The user may trigger the screen-casting display operation through the screen-casting display control, and optionally, the screen-casting display operation may be triggered by the user through the screen-casting display control in the pull-down notification bar, may also be triggered by the user through the screen-casting display control in a certain Application (Application), and may also be triggered by setting a screen-casting display function triggered in the operation, which is not limited in this Application. The screen projection device may acquire first display information for displaying the first interface in response to a screen projection operation. Optionally, the first interface may be a desktop interface, and the first interface may also be an interface of an application. Optionally, taking the first interface as a desktop interface as an example, the desktop interface may be an interface displayed after the device is turned on, taking the screen projection device as a mobile phone as an example, and the desktop interface of the screen projection device may be an interface including elements of wallpaper, time, weather, application icons, and the like of the application. Optionally, taking the first interface as an interface of a certain application as an example, the first interface may be an interface for running the application, and the first interface includes an element in the application.

Optionally, the screen projection device may display a first interface in the first area, and the display device outputs a second interface in the at least one target area after receiving the first display information sent by the screen projection device, where the display sizes of the first area and the at least one target area may be different or the same. Optionally, the display size of the first area may be larger than the display size of the at least one target area, and the display size of the first area may also be smaller than the display size of the at least one target area, which is not limited in this application. Therefore, different screen projection modes can be used in different use scenes, so that the user can watch the screen more conveniently, the user can operate the screen more conveniently, and the user experience can be improved. Optionally, the first display information may include display size information of each target area, and when the screen projection device sends the first display information to the display device, the display device may display the second interface in one or more target areas according to the first display information and the display size information included in the first display information.

Optionally, the first display information may include information of the second interface, and the display device may directly display according to the first display information after receiving the first display information. Optionally, the first display information may include target interface information corresponding to the second interface, and after receiving the first display information, the display device may generate or determine the second interface according to the target interface information corresponding to the second interface and display the second interface, where the target interface information may be information that the display device may generate or determine the second interface. Optionally, the first display information may include original interface information and size information (e.g., first size information) corresponding to the first interface, and after receiving the first display information, the display device may determine or generate a second interface, for example, a second interface of the first size information, according to the original interface information and the first size information, and output the second interface in at least one target area, for example, a target area of the first size information displays the second interface. Optionally, the size information may be preset size information, that is, default size information, or size information selected or determined by a user, which is not limited in this application.

Optionally, taking the example that the first interface includes a desktop interface, the screen projection device may send, to the display device, first display information for displaying the first interface after establishing connection with the display device, and then the display device displays a projected image picture, that is, the second interface, according to the first display information. Optionally, the screen projection device may obtain a desktop element of a desktop interface (i.e., a first interface) displayed by the screen projection device, determine or generate the first display information according to the desktop element, and send the first display information to the display device, and after receiving the first display information, the display device may determine or generate a second interface according to the first display information (e.g., the desktop element), and display the generated second interface (e.g., the desktop interface) in a target area.

Optionally, taking the example that the first interface includes a desktop interface, the screen projection device may obtain a desktop element in the desktop interface (i.e., the first interface) displayed by the screen projection device, and determine or generate the second interface according to the desktop element. Optionally, the screen projection device may generate the second interface in a simulated manner, determine, according to the generated second interface, that the first display information is sent to the display device, and after receiving the first display information, the display device may display the second interface in a target area. Optionally, the desktop elements may include elements such as wallpaper, time, weather, application icons, and the like in the first desktop interface. Optionally, since the first interface is a desktop interface of the screen projection device, the second interface generated according to the desktop element is also a desktop interface. Optionally, the second interface generated by the display device and the second interface generated by the screen projection device may be different interfaces, but both provide a function of a desktop interface and optionally provide a function of displaying an application icon.

Optionally, in addition to displaying the desktop interface, an interface of a certain application may also be displayed, and taking the interface of the first application as an example, when the screen projection device receives a first start instruction for the first application sent by the display device, or when responding to a first start operation for the first application, it is determined whether the first application satisfies a preset condition. Optionally, the first start instruction may be an application icon of the first application, which is acted on a desktop interface displayed by the display device by a user, for example, if the display device is a computer, the first start instruction may be a start instruction for clicking the icon of the first application displayed on the desktop interface by using a mouse, and then the display device sends the first start instruction to the screen projection device. Optionally, the first starting operation may be a starting operation of the user on the first application in the screen projection device. Optionally, when it is determined that the first application satisfies the preset condition, first size information is determined according to a first start instruction or a first start operation, where the first size information is a display size of a target area, which is intended to be projected into a display device in the display device and displays the second interface, the first size information may be a default display size or a display size selected or determined by a user, and the first size information may be information indicating, for the screen projection device, a display size of the target area of the display device. The screen projection equipment can acquire a second interface of the first application corresponding to the first size information, and determine first display information according to the second interface.

Optionally, the screen projection device may also obtain target interface information of the first application corresponding to the first size information, where the target interface information may be information that the display device may generate or determine the second interface, and then determine or generate the first display information according to the target interface information, so that the display device may display according to the first display information. It should be noted that, one mode is that the screen projection device may directly generate the first display information according to the second interface projected to the display device for display, and another mode is that the screen projection device generates the first display information according to the target interface information of the first application that the display device can display the second interface, and the first display information is not directly information of the second interface, which are different.

Alternatively, for the first application, the first application may be developed, at the time of development, as an application capable of adapting to devices of different display sizes, that is, an application capable of adapting to devices of different resolutions. Optionally, when it is determined that the first application can be adapted to the display size indicated by the first size information (or the display resolution corresponding to the first size information), the screen projection device may determine that the first application satisfies a preset condition, so as to obtain a second interface of the first application corresponding to the first size information, and determine the first display information according to the second interface. Optionally, the screen projection device may obtain target interface information of the first application corresponding to the first size information, and determine or generate the first display information according to the target interface information, and optionally, the screen projection device may obtain or generate a second interface according to the target interface information and the first size information, and determine the first display information according to the interface information of the second interface. The screen projection equipment further can send the first display information to the display equipment, and the display equipment can display the interface of the first application in the target area according to the first display information.

Optionally, when it is determined that the target application cannot be adapted to the display size (or the display resolution corresponding to the first size information) indicated by the first size information, that is, when it is determined that the first application does not satisfy the preset condition, the screen projection device may determine or generate the second interface according to the original interface information of the first application and the first size information, and determine the first display information according to the interface information of the second interface. Optionally, the screen projection device may determine first display information according to the original interface information and the first size information, and after the first display information is sent to the display device, the display device may perform preset processing on the original interface information according to the first size information to determine or generate a second interface and display the second interface. Alternatively, the elements of the first interface displayed by the second interface and the screen projection device may be the same, i.e. the second interface displayed on the display device may be obtained by scaling (adjusting the resolution) of the first interface. The original interface information of the first application may be original information of an interface of the first application, and the information processed by the screen projection device according to the original interface information is not the original interface information. Alternatively, since the first application does not satisfy the preset condition, the first size information may be a display size of a target area of the second interface displayed by the display device, and the aspect ratio of the first size information to the display size of the interface (first interface) of the first application displayed by the screen projection device may be the same, i.e., equal to the scale.

Optionally, when the aspect ratio of the first size information to the display size of the interface (first interface) of the first application displayed by the screen projection device is different, the screen projection device determines the first display information according to the original interface information and the first size information, where the first size information is used to instruct the display device to display the display size of the target area of the second interface. After the display device receives the first display information determined by the screen projection device, the display device may perform preset processing on the original interface information according to the first size information in the first display information to determine or generate a second interface, for example, perform scaling (resolution adjustment) on the interface portion of the first application, for example, perform scaling (equal-scale) increase processing. The display device may further perform preset processing on an area other than the interface after the scaling (resolution adjustment) in the target area of the display size indicated by the first size information to obtain the interface in the target area, that is, the second interface. Optionally, the preset processing may include a solid color filling processing, for example, the solid color filling processing, and may also be other filling processing manners, which is not limited in this application.

Optionally, the screen projection device may detect whether the first application is capable of adapting to the display size indicated by the first size information (or the display resolution corresponding to the first size information) when the first application is installed. Optionally, the first application has interface information of at least one size, if so, adaptation is determined, and the screen projection device may add the first application to a start white list, otherwise, add the first application to a start black list. Optionally, in addition to whether the first application is adapted to the display size indicated by the first size information (or the display resolution corresponding to the first size information), the preset condition may also be whether the first application is an application in a startup white list. Optionally, the white list may also be a preset identifier library, and the first application is matched with the application in the identifier library, so that after the screen projection device and the display device establish a communication connection, whether the display size indicated by the first size information (or the display resolution corresponding to the first size information) can be adapted can be quickly determined. Optionally, the first display information may be generated and stored in advance by the screen projection device, that is, the target interface information of the second interface or the first application may be generated and stored in advance by the screen projection device, and when it is determined that the first application meets the preset condition, the first display information is directly acquired in advance, so that the screen projection display can be performed more quickly. Optionally, the first display information may also be generated in real time by the screen projection device, that is, the first display information may be generated by the screen projection device when it is determined that the first application satisfies the preset condition, and the second interface or the target interface information of the first application may be generated by the screen projection device when it is determined that the first application satisfies the preset condition, which is not limited in this application.

Optionally, as can be seen from the foregoing, the first display information determined or generated by the screen projection device may include a second interface determined or generated by the screen projection device according to the desktop element, where the second interface is different from the display size of the first interface displayed by the screen projection device, or may be a second interface generated according to the original interface information of the first application and the first size information, and the second interface may be the same as the display size of the first interface displayed by the screen projection device. If the interface currently displayed by the screen projection device is referred to as a first display interface (first display), the second interface may be a second display interface (e.g., a second display) generated by the screen projection device in a background simulation, that is, the second interface may be understood as a second interface simulated in a display that is not currently displayed. It can be understood that, for the same application (e.g., a first application and a desktop application), only one interface can be displayed in the foreground in the screen projection device, the interface displayed in the foreground is a first display, and another second interface can be generated in a background simulation manner, that is, the second interface generated in the background simulation manner is a second display, and then the first display information is determined according to the second interface generated in the second display and sent to the display device. Optionally, one application can only correspond to one display, that is, one display interface, and it can be understood that one application can only display one application interface, and cannot run an application to simultaneously display two different interfaces. Optionally, for the screen projection device, there is only one first display, but a plurality of second displays may be included, that is, the background may run a plurality of applications, generating a second interface for the plurality of applications.

And S302, the screen projection equipment sends the first display information to the display equipment.

Optionally, the screen projection device may establish a wired or wireless communication connection with the display device, and send the first display information to the display device in a direct or indirect manner, optionally, the first display information may be connected through a Universal Serial Bus (USB), or a wireless connection may be established through a wireless local area network.

And step S303, the display device outputs a second interface in at least one target area according to the first display information.

Optionally, the target area is an interface area where the display device displays a screen of the screen projection device, the target area may be one or multiple, and the size of each target area may be the same or different and may be determined specifically according to a use scene and an application. Optionally, after the screen projection device establishes a communication connection with the display device, a desktop interface may be displayed, that is, the first interface may be a desktop interface, and after the desktop interface is displayed, the first interface may be an interface of an application (for example, a first application) installed on the screen projection device. Optionally, the first display information may carry indication information for indicating a display size of the target area, for example, the first size information.

Optionally, taking an example that the first interface includes a desktop interface, the display device may receive first display information, where the first display information is determined or generated according to a desktop element of the first interface (that is, the desktop interface) acquired by the screen projection device, and then the display device may generate a desktop interface (a second interface) according to the desktop element included in the first display information, and display the generated second interface, where the second interface generated by the display device may be different from the second interface displayed by the screen projection device. Optionally, in this approach, the desktop interface (second interface) displayed by the display device is generated by the display device. The desktop interface generated by the display device according to the desktop element may be a desktop interface simulated in a display device running desktop launcher (launcher). Alternatively, desktop elements may include elements such as wallpaper, time, weather, application icons, and the like. The display device may run a desktop launcher (launcher) to simulate a desktop interface including wallpaper, time, weather, application icons. Optionally, for the wallpaper or the application icon, if the wallpaper or the application icon is preset by the system, the same or similar wallpaper or application icon as the desktop interface included in the first interface may be displayed in the desktop interface (the second interface), and if the wallpaper or application icon is not preset by the system, the desktop element may not be displayed in the desktop interface (the second interface). Thus, the desktop interface (second interface) may be different from the desktop interface comprised by the first interface.

Optionally, taking an example that the first interface includes a desktop interface, the display device may receive first display information, where the first display information is determined according to a second interface determined or generated by the screen projection device, and the second interface is a desktop interface determined or generated by the screen projection device according to the desktop element and used for the display device to display. In the method, the desktop interface displayed by the display device is generated by the screen projection device, and the display device only displays the first display information according to the received first display information. The screen projection device may determine or generate a second interface (a desktop interface for display by the display device) in a non-first display interface, that is, a second display interface, according to a desktop element in the first desktop interface, and then the screen projection device sends first display information determined according to the second interface (the desktop interface for display by the display device) to the display device, and the display device may display the second interface in a first target area, where the first target area is an area in at least one target area. It should be noted that, since the screen projection device generates the second interface in the second display, the second interface is in the background of the screen projection device, and only the operation of simulating the generation of the interface is not displayed by the screen projection device but displayed by the display device.

Optionally, before the screen projection device acquires the desktop element in the desktop interface included in the first interface, the screen projection device may further send display information of the first interface (i.e., the desktop interface displayed by the screen projection device) to the display device. That is, after the display device establishes a communication connection with the screen projection device, before displaying the second interface including the desktop interface, the display device may receive the display information of the first interface sent by the screen projection device and display the first interface. Optionally, after the display device displays the first interface, the display device may display the switching animation, and further display a second interface (desktop interface) when the first display information is received. Optionally, the display size of the first area is different from that of the target area, and the display size of the target area may be twice the display size of the first area, or may be other display sizes, which is not limited in this application. Optionally, taking the display size of the target area twice the display size of the first area as an example, the switching animation may be an unfolding animation similar to a folding screen performed from the first interface, so as to obtain the second interface, and the switching animation may be an unfolding animation similar to a scroll performed to the left and right or to the upper and lower sides from the first interface, so as to obtain the second interface. Optionally, the second interface may also be displayed after the animation is switched, which is not limited in this application.

Optionally, taking the first interface as an interface of the first application as an example, the display device may receive first display information, where the first display information is information determined by the screen projection device according to a second interface corresponding to first size information acquired when the first application is run when it is determined that the first application satisfies a preset condition, and optionally, the display device may display the second interface in a target area of a display size (a display resolution corresponding to the first size information) indicated by the first size information according to receiving the first display information. Because the first application is an application installed in the screen projection device and can only run in the screen projection device after screen projection display, the screen projection device simulates a second interface in a non-first display interface (non-first display), and sends first display information determined according to the second interface to the display device for display.

Optionally, when the screen projection device determines that the first application does not satisfy the preset condition, a second interface may be determined or generated according to the original interface information and the first size information of the first application, that is, a second interface of the first size information is simulated in a non-first display interface (non-first display), and the first display information determined according to the second interface is sent to the display device, where the display size of the second interface may be equal to that of the first interface (the interface where the screen projection device displays the first application), that is, the aspect ratio is the same. The display device may display the second interface (the interface of the first application) after receiving the first display information. Optionally, the screen projection device may further determine first display information according to the original interface information and the first size information of the first application, and send the determined first display information to the display device, and the display device may perform preset processing on the original interface information according to the first size information, so as to determine or generate the second interface. The display size indicated by the first size information may not be in equal proportion (the aspect ratio is different) to the display size of the interface of the first application, if the second interface is directly displayed in the target area of the first size information, the target area cannot be completely filled, and if an empty space exists, the display device may perform preset processing on the empty area, thereby determining or generating the second interface, and displaying the second interface in the target area. Optionally, the preset filling process may be color filling, optionally white filling or black filling, of the left-out area.

Optionally, the display device may receive, at a displayed desktop interface (second interface), a first start instruction of a user for a first application, and when first display information for displaying the desktop interface does not include the second interface, that is, the desktop interface is a second interface generated by the display device according to desktop elements in the first display information, the user may input the first start instruction for the first application through the desktop interface displayed by the display device, and the screen projection device may not know a specific interface, included elements, and optionally positions of one or more application icons of the second interface (desktop interface) generated by the display device, and may not know which application is specifically started, and at this time, the display device may include an application identifier of the first application in the first start instruction to the display device, and the display palette determines the first application according to the application identifier, and the screen projection device can run the first application and project an interface of the first application to the display device. Optionally, hardware such as a keyboard and a mouse of the display device or other manners receive the starting operation for the first application on the second interface (the desktop interface), which is not limited in this application.

Optionally, the display device may receive, at a displayed desktop interface (a second interface), a first start instruction of a user for the first application, where the first display information for displaying the desktop interface includes the second interface, that is, the desktop interface is the second interface determined or generated by the screen projection device according to a desktop element of the desktop interface included in the first interface. If the user clicks an application icon of a first application in the desktop interface (second interface) through a mouse, the display device may include application information of the first application in a first start instruction and transmit the first start instruction to the screen projection device, the application information may be coordinate information of the user mouse acting on the desktop interface (second interface), this is because, the desktop interface is determined or generated for the screen-casting device, the display device does not know the application icons included in the desktop interface, i.e., the display device does not know which application the user has launched, after the display device sends the coordinate information as application information to the screen projection device, the screen projection equipment determines that the first application is started according to the position of at least one application icon in the generated desktop interface and the received coordinate information, and the screen projection device can run the first application and project an interface of the first application to the display device.

Referring to fig. 4a to 4b, fig. 4a and 4b are interface diagrams for establishing a connection according to the display method shown in the first embodiment. The application is described more vividly, taking a screen projection device as a mobile phone and a display device as a Personal Computer (Personal Computer) as an example for drawing and explaining. As shown in fig. 4a, in the screen projection device, the screen projection device and at least one device capable of establishing a communication connection, such as the device 1, the device 2, the device 3, and the device 4 shown in fig. 4a, may be displayed in the smart interconnection center module with one screen. Optionally, the screen projection device may be implemented in one or more manners such as bluetooth, a wireless network communication technology WiFi, USB, an Android Debug Bridge (ADB), and a local area network, which is not limited in this application. Optionally, the screen projection device discovers a connectable display device in the vicinity of the screen projection device through bluetooth broadcast, presents an intelligent interconnection center on the screen projection device, and after a user selects the display device (e.g., device 1), the screen projection device requests multi-screen collaboration, that is, the screen projection device initiates a request for establishing communication to the display device, and the display device may display prompt information for establishing communication connection, for example, "xx mobile phone requests multi-screen collaboration, is allowed? ". Optionally, the user may confirm that the display device and the screen projection device establish a communication connection through a keyboard and/or a mouse of the PC, that is, trigger the yes control, and at this time, the screen projection device establishes a communication connection with the display device.

As shown in fig. 4b, after the screen projection device and the display device are communicatively connected, the negative-one-screen smart interconnection center of the screen projection device may display an interface that establishes a communication connection with the display device, as shown in fig. 4b, and a desktop interface (i.e., a desktop interface included in a first interface) of the screen projection device may be shown in a lower left corner of fig. 4b, where the first interface includes time, weather, and application icons. The screen projection equipment can send the first display information determined according to the desktop elements to the display equipment, and the display equipment can determine or generate a second interface according to the desktop elements and display the second interface in a target area. Optionally, the screen projection device may determine or generate a second interface (a desktop interface displayed by the display device) according to the desktop element, and send the first display information determined according to the second interface to the display device, and the display device may display the second interface in the target area. Alternatively, fig. 4b is only an example of the second interface (the desktop interface displayed by the display device), and the second interface is not limited. Alternatively, if the user clicks the display device (device 1) again at the smart internet center, the communication connection between the screen projection device and the display device may be disconnected.

Referring to fig. 4c, fig. 4c is a schematic diagram of a switching animation of the display method according to the first embodiment, and as shown in fig. 4c, fig. 4c only shows examples of two switching animations, and may further include other switching animations, which is not limited in this application. As shown in fig. 4c, the upper side is similar to the animation with the folded screen opened, the display device first receives the display information of the first interface sent by the screen projection device, displays the first interface, and displays the second interface similar to the animation with the book opened. As shown in the lower side of fig. 4c, the display device may receive the display information of the first interface sent by the screen projection device and display the first interface, and may display the second interface like the animation in which the scroll is simultaneously unfolded left to right. The animation shown in fig. 4c is only an example, and no limitation is made on the switching animation, and in an actual application scenario, the switching animation and the like may also be determined according to the wallpaper.

Referring to fig. 4d and 4e, fig. 4d and 4e are interface diagrams of projecting a first application in a display method according to a first embodiment. As shown in fig. 4d, if the screen projection device receives a first start instruction for a first application sent by the display device, or responds to a first start operation for the first application, when it is determined that the first application meets a preset condition, the first size information is determined according to the first start instruction or the first start operation, and a second interface of the first application corresponding to the first size information is obtained in a non-first display interface (non-first display), that is, a second display, as shown in the lower left corner of fig. 4 d. Or, the screen projection device may obtain target interface information of the first application corresponding to the first size information, and the display device may display the second interface according to the target interface information after receiving the first display information determined according to the target interface information. After receiving the first display information determined according to the second interface, the display device may display the second interface in the target area, as shown in 401 in fig. 4 d.

Optionally, if the screen projection device determines that the first application does not satisfy the preset condition, a second interface is determined or generated in a non-first display interface (non-first display) according to the original interface information of the first application and the first size information, as shown in a lower right corner of fig. 4 d. Optionally, the second interface generated by the simulation running of the first application is not displayed on the screen projection device. The screen projection equipment can determine first display information according to the generated second interface and send the first display information to the display equipment. The display device displays a second interface according to the received first display information, and at this time, a display size of the second interface may be in equal proportion to that of the first interface (the display size of the first application displayed by the screen projection device), as shown in 403 in fig. 4e, and optionally, 402 in fig. 4e is a desktop interface displayed by the display device. Optionally, when it is determined that the first application does not satisfy the preset condition, the screen projection device determines first display information according to the original interface information and the first size information of the first application, and after receiving the first display information, the display device may perform preset processing on the original interface information according to the first size to determine or generate a second interface. Optionally, the original interface information may be information of an original interface of the first application, and the display device may stretch or scale the interface of the first application according to the original interface information, and display the interface of the first application after stretching or scaling in a target area corresponding to the first size information. If the display size of the interface of the first application is not in equal proportion to the display size of the target area, an empty area exists, and the display device can perform filling processing on the empty area. Optionally, a color filling process may be performed, as shown in a lower part 404 of fig. 4e, in this case, in the target area 404, the displayed second interface includes an interface of the first application after stretching or scaling in the central area, and areas on both sides are subjected to a white filling process.

Referring to fig. 4f, fig. 4f is a timing diagram illustrating a display method according to a first embodiment. As shown in fig. 4f, first, the screen projection device establishes a communication connection with the display device, and in one case, the screen projection device determines or generates a second interface: the screen projection equipment determines or generates a second interface according to the desktop elements, and then projects and sends first display information determined according to the second interface to the display equipment, and the display equipment can display the second interface in the target area according to the first display information. In another case, the screen projection device does not determine or generate the second interface, the screen projection device acquires the desktop element, the screen projection device determines or generates the first display information according to the desktop element and sends the first display information to the display device, and the display device determines or generates the second interface according to the received first display information and displays the generated second interface in the target .

In the method described in fig. 3, the screen projection device acquires first display information for displaying the first interface in response to a screen projection operation, and sends the first display information to the display device, so that the display device outputs and displays the second interface in at least one target area according to the first display information. Therefore, based on the method described in fig. 3, the utilization rate of the display resources in the display area of the display device can be improved, the flexibility of operation can be improved, the requirement of the user for screen projection use can be met better, the flexibility of screen projection operation can be improved, the display resources can be utilized more reasonably, and therefore the user experience can be improved.

Second embodiment

Referring to fig. 5, fig. 5 is another flow chart illustrating a display method according to a second embodiment. The processing method shown in fig. 5 includes steps S501 to S504. The display method is realized by the interaction of the screen projection device 50 and the display device 51. The screen projection device 50 and the display device 51 in the display method of the embodiment may be executed by the intelligent terminal shown in fig. 1, or may be executed by a chip in the intelligent terminal, and the intelligent terminal may be applied to the communication network system shown in fig. 2. Optionally, the display method of this embodiment may also be executed by a server or a server cluster corresponding to the screen projection device 30 or the display device 31. The method shown in fig. 5 is implemented by taking an intelligent terminal as an example, and the display method disclosed in this embodiment includes the following steps:

step S501, the display device receives a second starting operation aiming at a second application, and sends a second starting instruction aiming at the second application to the screen projection device.

Optionally, after the screen projection device establishes a communication connection with the display device, at least one control may be displayed in the at least one target area, and the at least one control may be displayed in a menu bar or a navigation bar. Optionally, the menu bar may include controls for creating a new target area, fixing the target area at the forefront, minimizing the target area, maximizing the target area, closing the target area, and the navigation bar may include back, back to desktop, and historical task controls. Optionally, for a desktop interface included in the second interface displayed by the display device, a display size (resolution) of the second interface is different from a display size (resolution) of a desktop interface included in the first interface displayed by the screen projection device, an interface memory displayed by the second interface may be similar, and included elements are also similar to the first interface, for example, all include wallpaper, add, time, application icons, and the like. Optionally, the user may operate the second interface through a keyboard and a mouse of the display device or through other input devices to trigger corresponding instructions, and then the display device may send the instructions to the screen projection device, the screen projection device responds to the instructions input by the user and sends the display information to the display device, and the display device displays other interfaces included in the second interface, for example, interfaces of applications.

Alternatively, the user may operate on the second interface (desktop interface) through the input device of the display device in a manner consistent with the screen projection device. Optionally, the user may turn pages left and right to view all the application icons through a mouse, or the user may click an application icon through the mouse to open one application, and the user may exit to the desktop when displaying an application interface, or return to an application interface on a previous layer when the application includes multiple layers of interfaces. Optionally, the new target area control included in the menu bar may be an interface for displaying another application in another target area, and optionally, may be a display scene for split application, where split application refers to that two applications are simultaneously used in a display area of the smart terminal, and for the display device, two applications may be used through two target areas, respectively. The control at the foremost end of the fixed target area can be used for fixing a certain target area on the uppermost layer all the time, and a user can operate an interface in the target area at any time; the minimized target area control temporarily hides the target area and does not display the target area on the desktop of the display equipment; the maximized target area control can enlarge the target area until the target area is displayed in a full screen mode; optionally, if the user closes all the target areas through the display device, the display device sends a disconnection instruction to the screen projection device, where the disconnection instruction is used to disconnect the communication connection between the display device and the screen projection device. Optionally, the navigation bar includes a return control for returning to the previous interface. Optionally, returning to the desktop control may be to exit a certain application and display the desktop interface (second interface), or may be to minimize a target area for displaying a certain application and display the desktop interface (second interface). Alternatively, the historical task control can be used to view thumbnails of target areas of various applications displayed on the display device desktop.

Optionally, for example, after the display device displays the desktop interface and displays the interface of the first application in the first target area, the user may input an application split-screen instruction through the screen projection device, that is, click the new target area control, and then click one of the application icons (for example, an application icon of the second application) displayed on the desktop interface, and the display device receives an application start operation of the application icon clicked by the user. In accordance with the first start instruction, the display device may send a second start instruction for the second application to the screen projection device, where the second start instruction may include application information. Optionally, the application information is an application identifier of the second application, or coordinate information.

Step S502, the screen projection device receives a second starting instruction aiming at the second application sent by the display device, or responds to a second starting operation aiming at the second application.

Optionally, the screen projection device may receive a second start instruction for the second application sent by the display device. The screen projection device may also receive a second launch operation for a second application from the screen projection device. Optionally, here, the second start operation for the second application is a start operation for the display device not to display the second application interface in the first target area, that is, the second start operation is an operation including split screen display and screen projection, which is different from the first start operation for the first application.

Optionally, after receiving the second start instruction or the second start operation, the screen projection device may simulate to run the second application, simulate an interface (a third interface) of the second application in a non-first display interface (non-first display), that is, the second display, optionally, determine whether the second application meets a preset condition, obtain the third interface of the second application corresponding to the first size information if the second application meets the preset condition, and determine the second display information according to the third interface, as the same as the operation of the first application. Or the screen projection equipment acquires target interface information of the second application corresponding to the first size information under the condition that the second application meets the preset condition, and determines or generates second display information according to the second application target interface information. Optionally, a third interface is obtained or generated according to the target interface information of the second application and the first size information, and second display information is determined according to the interface information of the third interface. The third interface is an interface projected to the display device for display in the second target area.

Optionally, the screen projection device may generate a third interface according to the original interface information of the second application and the first size information when it is determined that the second application does not satisfy the preset condition, and determine second display information according to the third interface; optionally, the screen projection device determines second display information according to the original interface information of the second application and the first size information, so that the display device can perform preset processing on the original interface information according to the first size information to generate a third interface. Optionally, the screen projection device may perform preset processing on the first application according to the first size information to generate a third interface of the second application. The preset process may include an equal-scale-up or down process, and a filling process.

And S503, the screen projection equipment sends second display information corresponding to the second application to the display equipment.

Optionally, for a specific implementation of step S503, reference may be made to the description of step S302 in the foregoing embodiment, which is not described herein again. Optionally, in step S503, the screen projection device sends second display information corresponding to the second application to the display device.

And step S504, the display device displays a third interface in the second target area according to the second display information.

Similarly, the display device receives the second display information and displays the third interface in a second target area, and the second target area is not overlapped with the first target area, namely the display device displays the desktop interface or the interface of the first application is not overlapped, so that the effects of operating two applications in one display area and displaying the interfaces of the two applications in the similar screen projection device are achieved, namely the purpose of displaying the applications in a split screen mode is achieved.

Referring to fig. 6a together, fig. 6a is an interface diagram of application split screen of the display method according to the second embodiment, as shown in fig. 6a, a menu bar is arranged at the upper left corner of the target area at the left side. Optionally, shown as the 61-65 controls for the left target area, on the lower side of the target area is a navigation bar, shown as 65 for the left target area. Optionally, the menu bar includes a new target area control 61, a maximum target area 62, a minimum target area 63, a fixed target area at the front end 64, and a close target area control 65. The left triangle in the navigation bar 66 may be the back control, the middle circle may be the back to desktop control, and the right square may be the historical task control. Optionally, the control shown in fig. 6a is only an example, and other controls may also be included, which is not limited in this application. After the user clicks on the new target area control 61, the application icon of the second application may be clicked. As shown in the mouse of fig. 6a, if the desktop interface is a desktop interface generated by the display device, the display device may determine an application identifier of the second application, and send a second start instruction carrying the application identifier of the second application to the screen projection device, and if the desktop interface is the desktop interface generated by the screen projection device, the display device may include currently clicked coordinate information in the second start instruction to the screen projection device, and determine the second application by the screen projection device. Optionally, the second start instruction may further include first size information, where the first size information may be size information selected by a user or default size information, and the screen projection device may determine the first size information according to the second start instruction, and then the screen projection device may acquire or generate a third interface simulating running of the second application, or the screen projection device may acquire target interface information of the third interface, and determine, according to the third interface or the target interface information of the third interface, that the second display information is sent to the display device. Optionally, the screen projection device may further generate a third interface according to the original interface information of the second application and the first size information, and determine the first display information according to the third interface, or the screen projection device may determine the second display information according to the original interface information of the second application and the first size information. Alternatively, when the second application satisfies the preset condition, it may be as shown on the left side of fig. 6a, or when the second application cannot satisfy the preset condition, it may be as shown on the right side of fig. 6 a.

Referring to fig. 6b, fig. 6b is another interface diagram of the application split screen of the display method according to the second embodiment, as shown in fig. 6b, if the second application satisfies the preset condition, a third interface as shown on the upper side of fig. 6b may be used, that is, the first application is displayed in the first target area, and the second application is displayed in the second target area. If the second application does not satisfy the preset condition, a third interface may be displayed in the second target area as shown in the lower side of fig. 6 b. Optionally, the second target area may be overlaid on the target area of the displayed desktop interface, that is, may be partially charged with other target areas, and the user may display the target area of the displayed desktop interface at the forefront by triggering back to the desktop control or triggering the fixed target area at the forefront control.

Referring to fig. 6c, fig. 6c is a timing diagram illustrating an application split screen of the display method according to the second embodiment. As shown in fig. 6c, if the screen projecting device receives a second start instruction for the second application or receives a second start operation for the second application, in one case, the screen projecting device determines new display information, determines or generates a third interface of the second application, determines second display information according to the third interface, and sends the second display information to the display device. In another case, the screen projection device does not determine new display information, determines or generates a second interface of the first application, and sends the first display information determined according to the second interface to the display device. Optionally, the screen projecting device determines new display information when receiving a start instruction for any application or a start operation for any application, and whether the screen projecting device determines the new display information in fig. 6c means that if the start instruction or the start operation is only for one application, the screen projecting device determines that the first display information is sent to the display device. And after the display device receives the first display information and displays the second interface of the first application according to the first display information, the screen projection device receives a starting instruction or starting operation for another application again, at the moment, the two conditions are divided into two conditions, one condition is that screen division is not needed or similar to the first application, and the display device still displays the interface of the application in the first target area according to the display information determined by the application. And the other is that the screen needs to be split, the display information (second display information) needs to be determined again, and the display device displays the interface of the application in the second target area. Although the screen projection devices need to determine new display information, for the screen projection devices, the first situation is that the first display information of a new application is generated after the first display information is deleted, only one first display information is determined or generated at the same time, and the second situation is that two pieces of display information, namely the first display information and the second display information, are determined or generated at the same time. For the display device, in the first case, if the screen projection device determines or generates only one piece of display information at the same time, the display device displays an application interface in the first target area, and only needs to cover the original screen in the original target area (the first target area), and in the second case, the display device needs to display another application interface in the second target area.

Optionally, as shown in fig. 6a, each target area in the display interface of the display device includes at least one control, where one control is a maximize target area control 62. After the user clicks the maximized target area control 62 displaying the first target area of the first interface through an input device (e.g., keyboard, mouse), the display device sends a zoom instruction to the screen projection device, where the zoom instruction may include second size information, the second size information may include display size information of the display device, and the screen projection device, in response to the zoom instruction, may obtain third display information according to the second size information and send the third display information to the display device. Optionally, the zoom instruction may further indicate which second interface is specifically zoomed, the third display information may include a fourth interface, the fourth interface includes a result obtained by adjusting the second interface according to the second size information, optionally, the fourth interface may be obtained by scaling the second interface in the same proportion, or may be stretched to some extent, so that the fourth interface can be matched with the second size information, that is, the display device may display the fourth interface in a full screen. Optionally, the third display information may also include interface information of second size information corresponding to the second interface, and after the third display information is sent to the display device, the display device may directly perform full-screen display according to the interface information of the second size information corresponding to the second interface.

Optionally, the posture of the screen projection device may include a horizontal screen state and a vertical screen state, and the first posture and the second posture may be the horizontal screen state and the vertical screen state of the screen projection device, respectively, or may be other postures of the screen projection device, which is not limited in this application. The application explains that the switching between the first posture and the second posture is the switching between the horizontal screen state and the vertical screen state as an example: if the first interface displayed by the screen projection device in the screen projection mode is in the first posture, the screen projection device is obtained to be changed from the first posture to the second posture through an acceleration sensor of the screen projection device, and optionally, when the screen projection device detects that the screen projection device is changed from the vertical screen state to the horizontal screen state, the screen projection device receives posture adjustment operation aiming at the first interface. Optionally, the gesture adjustment instruction may be triggered by the user through the display device, that is, the target region may further include a gesture adjustment control, and by triggering the gesture adjustment control, the display device may send the gesture adjustment instruction to the screen projection device. Optionally, the display device may perform posture adjustment on the interface in a certain target area, or may perform posture adjustment on the interfaces in all target areas, which is not limited in this application, and the posture adjustment instruction may indicate the interface in a certain target area.

Optionally, the interface displayed in the display device may change with a change in the posture of the screen projecting device, that is, the screen projecting device may update the first size information according to the posture adjustment instruction or the posture adjustment operation, determine or generate new first display information according to the updated first size information, where the first display information may be determined according to a new second interface corresponding to the updated new first size information, or may be determined according to new target interface information of the first application corresponding to the new first size information, which is not limited in this application. Optionally, no matter the new second interface or the new target interface information, the second interface (the second interface corresponding to the new first size information) in the second posture generated by the simulation acquired by the screen projection device in the non-first display interface (first display), that is, the second display, and the new first display information is determined. The display device may display in the target area according to the new first display information or the new first display information and the updated size information after receiving the new first display information.

Referring to fig. 7a and 7b together, fig. 7a and 7b are interface diagrams illustrating a posture change of the display method according to the second embodiment. As shown in fig. 7a, the original screen projection device is in a vertical screen posture (first posture), the display device displays an interface on the right side in fig. 7a, the screen projection device changes from the vertical screen posture (first posture) to a horizontal screen posture (second posture), that is, the screen projection device responds to a posture adjustment operation for the first interface, the screen projection device simulates to update first size information in a non-first display interface (first display), and determines or generates new first display information according to the updated first size information, where the new first display information may be interface information including the first interface after the posture adjustment. And then the screen projection equipment sends the new first display information to the display equipment, and the display equipment displays the first interface after the posture adjustment in the target area, as shown in the left side of fig. 7 a. Alternatively, the updated first size information may be obtained by rotating the first interface by 90 degrees counterclockwise, or may be obtained by adjusting the width and height of the first interface, respectively, as shown by the dashed target area in the display device of fig. 7 a. Alternatively, as shown in fig. 7b, when the screen projecting device detects that the posture of the screen projecting device is changed from the vertical screen posture (first posture) to the horizontal screen posture (second posture) (or receives a posture adjustment instruction sent by the display device), an interface of the horizontal screen posture may be simulated in the second display, the first size information may be updated, new display information may be determined or generated according to the updated first size information, and the new display information may be sent to the display device and displayed by the display device, as shown in a dotted target area in the display device of fig. 7 b.

In the method described in fig. 5, the display device receives a second start operation for the second application, sends a second start instruction to the screen projection device, and the screen projection device receives the second start instruction for the second application, optionally, sends second display information corresponding to the second application to the display device in response to the second start operation for the second application, and displays a third interface in the second target area according to the second display information. Optionally, based on the method described in fig. 5, the screen projection device may send the second display information corresponding to the second application to the display device, so that the display device displays the second interface of the first application in the first target area, and displays the third interface of the second application in the second target area, thereby implementing the split-screen display application, reasonably utilizing the display resources of the large-screen display area of the display device, having stronger operability, and better meeting the operation and viewing requirements of the user, thereby improving the user experience.

Third embodiment

Referring to fig. 8, fig. 8 is a flowchart illustrating a display method according to a third embodiment, and the processing method illustrated in fig. 8 includes steps S801 to S802. The display method is realized by the interaction of a screen projection device 80 and a display device 81 of a screen projection system. The screen projection device 80 and the display device 81 in the display method of the embodiment may be executed by the intelligent terminal shown in fig. 1, or may be executed by a chip in the intelligent terminal, and the intelligent terminal may be applied to the communication network system shown in fig. 2. Optionally, the display method of this embodiment may also be executed by a server or a server cluster corresponding to the screen projection device 30 or the display device 31. The method shown in fig. 8 is executed by taking an intelligent terminal as an example, and the display method disclosed in this embodiment includes the following steps:

step S801, the screen projection device responds to the screen projection display operation and sends first display information for displaying the first interface to the display device.

Optionally, the specific implementation of step S801 may refer to the description of step S301 in the above embodiment, and is not described herein again.

Step S802, the display device outputs a second interface in at least one target area according to the first display information.

Optionally, in a screen projection system including a screen projection device and a display device, both the screen projection device and the display device may receive a start operation for a first application, and a user may start the first application through the screen projection device and then project the first application on the display device for display. Optionally, after receiving a start operation for the first application, the display device sends a first start instruction including application information to the screen projection device, so that the screen projection device starts the first application and projects the first application for display on the display device. Optionally, after receiving the first start instruction, the screen projection device determines whether the first application meets a preset condition, and determines first size information according to the first start instruction or a first start operation when it is determined that the first application meets the preset condition, where a display size indicated by the first size information may be a display size different from a display size of the first application displayed in the screen projection device, the first application is an application installed in the screen projection device, the screen projection device provides support for the display device for interface information, and the display device only performs display. The first display information sent by the screen projection device to the display device may be determined by the screen projection device acquiring a second interface corresponding to first size information generated by non-first display (second display) simulation, or by acquiring target interface information of a first application corresponding to the first size information, and the target interface information may be determined or generated according to the target interface information, where the target interface information may also be generated by the screen projection device by second display simulation.

Optionally, the screen projection device performs simulation generation in the second display, the second interface or the target interface information is not displayed in the foreground of the screen projection device, and if the first application running in the background is displayed in the foreground of the screen projection device, an interface corresponding to the size information of the first area needs to be re-acquired or generated, and then the interface corresponding to the size information of the first area needs to be displayed in the foreground of the screen projection device according to the acquired or generated interface. Optionally, if the screen projection device displays the first application in the foreground, that is, the screen projection device displays the first application, the display device displays an application icon including the first application according to the first display information sent by the screen projection device, and the user may input a first start operation acting on the application icon of the first application through the display device. The display device may send a first start instruction including application information of the first application to the screen projection device, and because the screen projection device displays the first application on the foreground, the screen projection device needs to generate a second interface corresponding to the first size information or target interface information of the first application in a simulation manner in the second display, and the screen projection device cannot generate an interface of the first application in the first display (i.e., the display corresponding to the foreground application), so that the display device may send a close instruction for the first application to the screen projection device, and the screen projection device stops displaying the first application. It should be noted that, the closing instruction is not to close the first application, but to destroy an interface of the first application in the first display of the screen projection device, and simulate and determine or generate target interface information of the second interface or the first application in the second display, so as to determine the first display information. Optionally, after the screen projection device stops displaying the first application, the display device may display the first application in a first target area, where the display size of the first target area is different from that of the first area, the first area is an area where the screen projection device displays the first application, the first target area is an area where the display device displays a second interface of the first application, and the first target area is an area in at least one target area.

Optionally, if the first application does not satisfy the preset condition, performing preset processing on the first application according to the original interface information and the first size information of the first application, so as to generate a second interface corresponding to the first application, where the second interface may be obtained after performing scaling (increasing or decreasing) processing on the interface of the first application. Optionally, only the scaling processing is performed without the screen projection device simulating and generating an interface in the second display, only the first display information determined according to the interface obtained by scaling according to the same scale is sent to the display device, and the display device may display the interface obtained by scaling according to the same scale according to the first display information, so that the first application may be synchronously displayed with the screen projection device.

Optionally, the display device displays the first application in a first target area, the first application meets a preset condition, the display size of the first target area is different from that of the display area of the first area, and an interface of the first application displayed in the first target area by the display device is provided in the background of the screen projection device, for example, the second display may be generated and stored in a background simulation mode. If the user triggers a first starting operation for the first application in the screen projection device at this time, the screen projection device destroys the second interface of the first application, which is generated in a simulation manner in the second display, in the same manner, that is, sends a closing instruction for the first application to the display device, and the display device stops displaying the first application. Optionally, after receiving a response that the display device closes the first application, the screen projection device may display the first application in a first area, where the first area is different from the first target area in display size, so that a user may use a function provided by the first application through the screen projection device. Optionally, the closing instruction does not cause the display device to close the first application, because the display device does not run the first application, the first application runs in the screen projection device, and the display device only displays the first application, where the closing instruction is used to instruct the display device to stop displaying the first application.

Optionally, if the first application does not meet the preset condition, the interface of the first application displayed by the display device in the first target area may be obtained by performing preset processing according to the first interface, where the preset processing may be scaling in the same scale, and the screen projection device projects the screen projection device into the display device to display, and the screen projection device may project the interface of the first application generated in the first display onto the display device to display, and may also continue to display the interface of the first application in the first area, so that the screen projection device may display the first application synchronously with the display device.

In the method described in fig. 8, the screen projection device sends first display information for displaying the first interface to the display device in response to the screen projection display operation, and the display device outputs the second interface in the at least one target area according to the first display information. Therefore, based on the method described in fig. 8, the display device and the screen projection device may respectively display the first application, and may also display in synchronization with the screen projection device, that is, the user may use the application in the screen projection device independently through the display device or the screen projection device, and may also display in synchronization, which better meets the requirements of the user for screen projection display, is more convenient for the user to use in different screen projection use scenes, also improves flexibility and operability of screen projection display, and improves user experience.

Fourth embodiment

Based on the above embodiments, the above embodiments provide a screen projection device and a display device corresponding to the above embodiments. Referring to fig. 9a, fig. 9a is a schematic structural diagram of a screen projection apparatus 90 according to an embodiment of the present disclosure. The screen projecting apparatus 90 may be applied to the screen projecting device described above, and the screen projecting apparatus 90 includes an acquisition unit 901, a transmission unit 902, a reception unit 903, a determination unit 904, an update unit 905, and a generation unit 906. Optionally:

an obtaining unit 901 configured to obtain first display information for displaying a first interface in response to a screen projection operation;

a sending unit 902, configured to send the first display information to the display device, so that the display device outputs a second interface in at least one target area according to the first display information.

Optionally, at least one of:

the first display information includes display size information of at least one of the target regions.

Optionally, the first interface comprises a desktop interface;

the obtaining unit 901 is configured to obtain first display information for displaying a first interface, and specifically configured to:

Optionally, the second interface comprises at least two applications;

the method further comprises the following steps:

the first display information does not include the second interface;

a receiving unit 903, configured to receive a first start instruction sent by the display device, and determine a first application according to an application identifier in the first start instruction; or,

the first display information comprises the second interface;

the receiving unit 903 is further configured to receive the first start instruction, and determine the first application according to coordinate information in the first start instruction.

Optionally, the receiving unit 903 is further configured to receive a first start instruction for a first application sent by the display device, or respond to a first start operation for the first application;

a determining unit 904, configured to determine first size information according to the first start instruction or the first start operation when the first application meets a preset condition;

the obtaining unit 901 is further configured to obtain a second interface of the first application corresponding to the first size information, and determine the first display information according to the second interface; or acquiring target interface information of the first application corresponding to the first size information, and determining or generating the first display information according to the target interface information.

Optionally, the receiving unit 903 is further configured to receive a gesture adjustment instruction sent by the display device, or respond to a gesture adjustment operation for the first interface;

the updating unit 905 is configured to update the first size information according to the posture adjustment instruction or posture adjustment operation, and determine or generate new first display information according to the updated first size information.

Optionally, the obtaining unit 901 is configured to determine or generate the first display information according to the target interface information, and specifically configured to: and acquiring or generating the second interface according to the target interface information and the first size information, and determining the first display information according to the interface information of the second interface.

Optionally, the screen projecting device 90 further includes:

a generating unit 906, configured to determine or generate the second interface according to original interface information and first size information of the first application when the first application does not satisfy the preset condition, and determine the first display information according to the second interface; or,

the determining unit 904 is further configured to determine the first display information according to the original interface information and the first size information, so that the display device performs preset processing on the original interface information according to the first size information to determine or generate the second interface.

the receiving unit 903 is further configured to receive a second start instruction for a second application sent by the display device, or respond to a second start operation for the second application;

the sending unit 902 is configured to send second display information corresponding to the second application to the display device, so that the display device displays a third interface in the second target area according to the second display information.

Optionally, the receiving unit 903 is further configured to receive a zoom instruction sent by the display device, obtain third display information according to second size information in the zoom instruction, and send the third display information to the display device.

It should be noted that, the operations performed by the units of the apparatus shown in fig. 9a can be referred to in the relevant content of the method embodiment. And will not be described in detail herein. The respective units may be implemented in hardware, software or a combination of hardware and software.

Based on the above embodiments, the above embodiments provide a display device corresponding to the above embodiments. Referring to fig. 9b, fig. 9b is a schematic structural diagram of a display device 90 according to an embodiment of the present disclosure. The display device 90 can be applied to the above-described display apparatus, and the display device 90 includes a receiving unit 901, an output unit 902, and a transmitting unit 903. Optionally:

a receiving unit 901, configured to receive first display information sent by a screen projection device, where the first display information is used to display a first interface in a first area of the screen projection device;

an output unit 902, configured to output a second interface in at least one target area according to the first display information.

Optionally, the first display information includes first size information;

the output unit 902 is configured to output a second interface in at least one target area according to the first display information, and specifically is configured to:

Optionally, the display device 90 further comprises:

a sending unit 903, configured to send the gesture adjustment instruction to the screen projection device in response to a gesture adjustment operation;

the receiving unit 901 is further configured to receive new first display information sent by the screen projection device, and display the new first display information or the new first display information and the updated size information according to the new first display information.

Optionally, the receiving unit 901 is further configured to receive a first start operation for a first application on the second interface, and send application information of the first application to the screen projection device, where the application information optionally includes an application identifier and/or coordinate information.

the receiving unit 901 is further configured to receive a second start operation for a second application, and send a second start instruction for the second application to the screen projection device;

Optionally, the receiving unit 901 is further configured to receive a zoom operation for the second interface, and send second size information corresponding to the zoom operation to the screen projection device;

It should be noted that, the operations performed by the units of the apparatus shown in fig. 9b can be referred to in the relevant content of the method embodiment. And will not be described in detail herein. The respective units may be implemented in hardware, software or a combination of hardware and software.

The embodiment of the present application further provides a display system, which includes a screen projection device and a display device, where the screen projection device is the screen projection apparatus in the above embodiment, and the display device is the display apparatus in the above embodiment.

The embodiment of the present application further provides an intelligent terminal, where the intelligent terminal includes a memory and a processor, the memory stores a display program, and the display program, when executed by the processor, implements the steps of the display method in any of the above embodiments.

The embodiment of the present application further provides a computer-readable storage medium, where the storage medium stores a display program, and the display program, when executed by a processor, implements the steps of the display method in any of the above embodiments.

In the embodiments of the intelligent terminal and the computer-readable storage medium provided in the present application, all technical features of any one of the above display method embodiments may be included, and the expanding and explaining contents of the specification are basically the same as those of the above method embodiments, and are not described herein again.

Embodiments of the present application also provide a computer program product, which includes computer program code, when the computer program code runs on a computer, the computer is caused to execute the method in the above various possible embodiments.

Embodiments of the present application further provide a chip, which includes a memory and a processor, where the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that a device in which the chip is installed executes the method in the above various possible embodiments.

It is to be understood that the foregoing scenarios are only examples, and do not constitute a limitation on application scenarios of the technical solutions provided in the embodiments of the present application, and the technical solutions of the present application may also be applied to other scenarios. Alternatively, as can be known by those skilled in the art, with the evolution of the system architecture and the appearance of new service scenarios, the technical solution provided in the embodiment of the present application is also applicable to similar technical problems.

The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.

The steps in the method of the embodiment of the application can be sequentially adjusted, combined and deleted according to actual needs.

The units in the device in the embodiment of the application can be merged, divided and deleted according to actual needs.

In the present application, the same or similar term concepts, technical solutions and/or application scenario descriptions will be generally described only in detail at the first occurrence, and when the description is repeated later, the detailed description will not be repeated in general for brevity, and when understanding the technical solutions and the like of the present application, reference may be made to the related detailed description before the description for the same or similar term concepts, technical solutions and/or application scenario descriptions and the like which are not described in detail later.

In the present application, each embodiment is described with emphasis, and reference may be made to the description of other embodiments for parts that are not described or illustrated in any embodiment.

The technical features of the technical solution of the present application may be arbitrarily combined, and for brevity of description, all possible combinations of the technical features in the embodiments are not described, however, as long as there is no contradiction between the combinations of the technical features, the scope of the present application should be considered as being described in the present application.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, a controlled terminal, or a network device) to execute the method of each embodiment of the present application.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The procedures or functions according to the embodiments of the present application are all or partially generated when the computer program instructions are loaded and executed on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored on a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (e.g., coaxial cable, fiber optic, digital subscriber line) or wirelessly (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, memory Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

The above description is only a preferred embodiment of the present application, and not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings of the present application, or which are directly or indirectly applied to other related technical fields, are included in the scope of the present application.

Claims

1. A display method is applied to a screen projection device, and comprises the following steps:

2. The method of claim 1, comprising at least one of:

the first display information comprises display size information of at least one target area;

the first interface comprises a desktop interface;

the second interface includes at least two applications.

3. The method of claim 2, comprising at least one of:

the acquiring first display information for displaying a first interface includes: acquiring desktop elements in a desktop interface, and determining or generating the first display information according to the desktop elements so that the display device generates the second interface according to the first display information, or determining or generating the second interface according to the desktop elements of the desktop interface and determining the first display information according to the second interface;

the first display information does not include the second interface, receives a first starting instruction sent by the display device, and determines a first application according to an application identifier in the first starting instruction, or the first display information includes the second interface, receives the first starting instruction, and determines the first application according to coordinate information in the first starting instruction.

4. The method according to any one of claims 1 to 3, characterized in that the method further comprises at least one of:

receiving a first starting instruction for a first application sent by the display device, or responding to a first starting operation for the first application, when the first application meets a preset condition, determining first size information according to the first starting instruction or the first starting operation, acquiring a second interface of the first application corresponding to the first size information, determining first display information according to the second interface, or acquiring target interface information of the first application corresponding to the first size information, and determining or generating the first display information according to the target interface information;

receiving a gesture adjustment instruction sent by the display device, or responding to gesture adjustment operation aiming at the first interface,

and updating the first size information according to the posture adjustment instruction or posture adjustment operation, and determining or generating new first display information according to the updated first size information.

5. The method of claim 4, further comprising:

when the first application does not meet the preset condition, determining or generating the second interface according to original interface information and first size information of the first application, and determining the first display information according to the second interface; or,

6. The method according to any one of claims 1 to 3, characterized in that the method further comprises at least one of:

the at least one target area comprises a first target area and a second target area, and a second interface corresponding to the first application is displayed in the first target area;

receiving a second starting instruction aiming at a second application sent by the display equipment, or responding to a second starting operation aiming at the second application, and sending second display information corresponding to the second application to the display equipment so that the display equipment displays a third interface in the second target area according to the second display information;

7. A display method is applied to a display device, and the method comprises the following steps:

8. The method of claim 7, comprising at least one of:

the outputting a second interface in at least one target area according to the first display information includes: determining or generating the second interface according to the first size information and the interface information of the first interface, and outputting the second interface in the at least one target area;

responding to the gesture adjustment operation, sending the gesture adjustment instruction to the screen projection equipment, receiving new first display information sent by the screen projection equipment, and displaying according to the new first display information or the new first display information and the updated size information;

receiving a first starting operation aiming at a first application at the second interface, and sending application information of the first application to the screen projection equipment;

receiving a second starting operation aiming at a second application, sending a second starting instruction aiming at the second application to the screen projection equipment, receiving second display information aiming at the second application, and displaying a third interface in a second target area according to the second display information;

and receiving zooming operation aiming at the second interface, sending second size information corresponding to the zooming operation to the screen projection equipment, receiving third display information corresponding to the second size information sent by the screen projection equipment, and displaying according to the third display information.

9. An intelligent terminal, characterized in that, intelligent terminal includes: memory, processor, wherein the memory has stored thereon a display program which when executed by the processor implements the steps of the display method according to any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that a computer program is stored on the storage medium, which computer program, when being executed by a processor, carries out the steps of the display method according to any one of claims 1 to 8.