CN113268212A

CN113268212A - Screen projection method and device, storage medium and electronic equipment

Info

Publication number: CN113268212A
Application number: CN202110539648.6A
Authority: CN
Inventors: 吴庆
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2021-05-18
Filing date: 2021-05-18
Publication date: 2021-08-17

Abstract

The embodiment of the application discloses a screen projection method, a screen projection device, a storage medium and electronic equipment, wherein the method comprises the following steps: acquiring at least two service services to be screen-projected and screen-projecting display equipment corresponding to each service respectively, and determining a display content container corresponding to each screen-projecting display equipment; and loading and displaying the interface display window corresponding to each business service from a local display content container to the display content container corresponding to the screen projection display equipment, and sending the interface display image in the display content container to the screen projection display equipment for display. By adopting the embodiment of the application, the multi-device screen projection display can be realized.

Description

Screen projection method and device, storage medium and electronic equipment

Technical Field

The present application relates to the field of computer technologies, and in particular, to a screen projection method and apparatus, a storage medium, and an electronic device.

Background

With the development of communication technology, a screen projection technology is widely applied, in which screen projection refers to projecting screen projection content to be projected on one device onto another device for display, screen projection is also called multi-screen interaction, for example, a video on a mobile phone is projected onto an intelligent television for playing, so that a user can browse the video on the mobile phone on the intelligent television. And if the application picture on the mobile phone is projected to the conference tablet for display.

Disclosure of Invention

The embodiment of the application provides a screen projection method, a screen projection device, a storage medium and electronic equipment, and the technical scheme is as follows:

in a first aspect, an embodiment of the present application provides a screen projection method, where the method includes:

acquiring at least two business services to be screen-projected and screen-projecting display equipment corresponding to each business service;

determining a display content container corresponding to each screen projection display device;

and loading and displaying the interface display window corresponding to each business service from a local display content container to the display content container corresponding to the screen projection display equipment, and sending the interface display image in the display content container to the screen projection display equipment for display.

In a second aspect, an embodiment of the present application provides a screen projection device, including:

the screen projection acquisition module is used for acquiring at least two business services to be projected and screen projection display equipment corresponding to each business service;

the container determining module is used for determining a display content container corresponding to each screen projection display device;

and the screen projection display module is used for loading and displaying the interface display window corresponding to each business service from a local display content container to the display content container corresponding to the screen projection display equipment, and sending the interface display image in the display content container to the screen projection display equipment for display.

In a third aspect, embodiments of the present application provide a computer storage medium storing a plurality of instructions adapted to be loaded by a processor and to perform the above-mentioned method steps.

In a fourth aspect, an embodiment of the present application provides an electronic device, which may include: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the above-mentioned method steps.

The beneficial effects brought by the technical scheme provided by some embodiments of the application at least comprise:

in one or more embodiments of the application, an electronic device obtains at least two service services to be screen-projected and screen-projection display devices corresponding to the service services, then determines a display content container corresponding to each screen-projection display device, loads and displays an interface display image in the display content container to the display content container corresponding to the screen-projection display device from a local display content container through an interface display window corresponding to each service, and sends the interface display image in the display content container to the screen-projection display device for display. The screen projection display of the screen projection display devices can be not limited to the influence of local screen display of the electronic equipment, screen projection display contents between the screen projection display devices can be independent from each other and do not interfere with each other, the screen projection display of the screen projection devices is realized to display different contents, the intelligence of the screen projection devices is improved, and the screen projection display contents can realize diversified display of multiple devices.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic flowchart of a screen projection method provided in an embodiment of the present application;

fig. 2 is a scene schematic diagram related to a screen projection method provided in an embodiment of the present application;

FIG. 3 is a schematic flow chart of another screen projection method provided by the embodiments of the present application;

FIG. 4 is a schematic diagram of an operational scenario provided by an embodiment of the present application;

FIG. 5 is a schematic flow chart of another screen projection method provided by the embodiments of the present application;

fig. 6 is a schematic architecture diagram of a screen projection system provided in an embodiment of the present application;

fig. 7 is a schematic structural diagram of a screen projection device provided in an embodiment of the present application;

fig. 8 is a schematic structural diagram of a projection screen display module according to an embodiment of the present application;

fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

FIG. 10 is a schematic structural diagram of an operating system and a user space provided in an embodiment of the present application;

FIG. 11 is an architectural diagram of the android operating system of FIG. 9;

FIG. 12 is an architecture diagram of the IOS operating system of FIG. 9.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

In the description of the present application, it is to be understood that the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. In the description of the present application, it is noted that, unless explicitly stated or limited otherwise, "including" and "having" and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus. The specific meaning of the above terms in the present application can be understood in a specific case by those of ordinary skill in the art. Further, in the description of the present application, "a plurality" means two or more unless otherwise specified. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.

The present application will be described in detail with reference to specific examples.

In one embodiment, as shown in fig. 1, a screen projection method is proposed, which can be implemented by means of a computer program and can be run on a screen projection device based on the von neumann architecture. The computer program may be integrated into the application or may run as a separate tool-like application. The screen projection device can be a terminal device, including but not limited to: personal computers, tablet computers, handheld devices, in-vehicle devices, wearable devices, computing devices or other processing devices connected to a wireless modem, and the like. The terminal devices in different networks may be called different names, for example: user equipment, access terminal, subscriber unit, subscriber station, mobile station, remote terminal, mobile device, user terminal, wireless communication device, user agent or user equipment, cellular telephone, cordless telephone, terminal equipment in a 5G network or future evolution network, and the like.

Specifically, the screen projection method comprises the following steps:

s101: at least two business services to be screen-projected and screen-projecting display equipment corresponding to each business service are obtained.

The screen projection display device can be understood as a screen projection receiving end for receiving and displaying screen projection contents emitted by the execution main body, and the screen projection display device, that is, an electronic device for displaying the screen projection contents, can be a display device such as a liquid crystal display, an electronic ink screen, a projector, and the like,

the execution main body for executing the screen projecting method can belong to a screen projecting transmitting end, the screen projecting transmitting end is electronic equipment used for sending screen projecting contents to screen projecting display equipment for displaying, and can be electronic equipment such as a computer, a mobile phone and a tablet personal computer, wherein communication connection is established between the electronic equipment and the screen projecting display equipment, when the electronic equipment and the screen projecting display equipment are in communication connection, the electronic equipment sends the screen projecting contents to the screen projecting display equipment, and the screen projecting display equipment displays the screen projecting contents.

The service can be understood as a screen projection display service determined by a user based on screen projection requirements in a screen projection display scene, and the service has various types including but not limited to an application screen projection display service for application screen projection, a resource screen projection display service for multimedia resources (such as pictures, videos and audios), a same-screen projection display service for a current screen display interface of an electronic device (that is, the electronic device and the screen projection display device display the same interface content), a shortcut function screen projection display service for application shortcut function screen projection, and the like.

Specifically, in the application, the electronic device may detect a current human-machine operation of a user, and when a selection operation corresponding to a service to be screen-projected is monitored, for example, a selection operation initiated by a service such as an application, a multimedia resource, and a shortcut function of the application to be screen-projected is triggered, the selection operation is performed for the service that the user desires to perform screen-projection display on the screen-projection display device, and the selection operation is usually triggered, because the user can share screen-projection data corresponding to the service at the local end of the electronic device on different multi-screen-projection display devices in a multi-screen interaction scene, a screen-projection receiving end of a subsequent specific screen-projection display of the selection operation, that is, a specific screen-projection display device, needs to be determined at this time;

furthermore, the electronic device may respond to the selection operation, and the electronic device may display a plurality of screen-casting reference screen casting devices capable of performing screen casting display, so that the user may select a desired screen casting display device for the selected service.

In the whole process, a user can select at least two service services, the selection time sequence can be that the user selects one service and the screen projection display equipment corresponding to each service in sequence, or the user selects at least two service services simultaneously and then selects the screen projection display equipment which is expected to be projected and displayed for each service. In the application, the screen projection method can realize simultaneous display of multiple screen projection devices for more than two screen projection business services selected by a user, that is, each screen projection display device can independently display a desired screen projection business service based on an execution main body electronic device serving as a data display source, for example, display of a business service-instant application 1 and even related operation for the instant application 1 are realized on the screen projection display device 1, and for example, display of a business service-video resource 2 and even related operation for the video resource 2 are realized on the screen projection display device 2 at the same time. The method can avoid the problem that in the related technology, when a plurality of projection screen display devices are used for displaying, only the interface display content which is the same as the local screen of the electronic device can be displayed.

In a specific implementation scenario, the electronic device may respectively respond to service selection operations corresponding to at least two service services to be screen-selected, the service selection operations may not be limited to drag operations, move operations, double-click operations, and other types of operations for the service services, after the electronic device identifies the service selection operations for the service services, the electronic device may display a device screen-casting icon, which is currently established or can establish a communication connection and is used for a screen-casting display device in a multi-screen interaction scenario, and the device screen-casting icon is used for performing screen-casting display of the service services on the screen-casting display device corresponding to a current user representation device screen-casting icon.

That is, the electronic device may respectively respond to service selection operations corresponding to at least two service services to be screen-projected, and then display screen-projection icons corresponding to at least two screen-projection display devices;

the electronic equipment can determine screen projection display equipment corresponding to each business service respectively based on the operation position information corresponding to the service selection operation and each equipment screen projection icon.

Schematically, as shown in fig. 2, fig. 2 is a scene schematic diagram related to a screen projection method, where icons corresponding to a plurality of application programs are arranged on an application desktop of the electronic device shown in fig. 2, and it is assumed that a business service that a user needs to project a screen at this time is the aforementioned application screen projection display service for application screen projection, that is, the user may select an application on the application desktop, and then determine a screen projection display device corresponding to the application to perform screen projection display. In addition, if the application is projected to the screen projection display device, the screen projection display device can be supported to operate the application.

In a specific implementation, the electronic device may generally have a touch screen, and the touch screen may be a touch screen capable of implementing a single touch function, for example: capacitive touch screen, electromagnetic touch screen, can also be the touch-sensitive screen that can realize capacitive sensing, electromagnetic induction and infrared induction simultaneously. When a user touches an application 14 icon shown in fig. 2 on a touch screen on the electronic device through a finger, a capacitance parameter of a touch position changes, and the touch frame determines the touch position of the finger on the terminal touch screen according to the change of the capacitance; or when a finger contacts the touch frame, the infrared receiving end which blocks infrared receives an infrared signal, the touch frame determines a touch position of the finger according to the blocked infrared signal, the electronic device can detect a selection operation input by a user for a business service- "application 14" by identifying a code corresponding to a logic control instruction corresponding to the touch position, and the electronic device displays device screen-casting icons corresponding to at least two screen-casting display devices, such as device 1, device 2, device n, in fig. 2 when the electronic device is triggered in response to the selection operation. Then, the screen projection display device desired to be projected by the user for the business service is determined based on operation position information corresponding to the subsequent selected operation, where the operation position information may include a movement track corresponding to the selected operation, a movement position in the operation process, and the like.

Further, the selecting operation may include a first sub-operation for the business service and a second sub-operation for the screen projection display device corresponding to the business service, where the first sub-operation is used to select the business service desired to be screen projected, and the second sub-operation user selects the screen projection display device desired to be screen projected for the business service.

In practical implementation, the electronic device displays device screen projection icons corresponding to at least two screen projection display devices in response to a first sub-operation for a business service ("application 14" icon) input on the current screen interface as shown in fig. 2; the electronic equipment responds to a second sub-operation continuously input on the basis of the first sub-operation, and obtains operation position information of the second sub-operation, wherein the operation position information can be a moving position. For example, the second sub-operation may be dragging the ("app 14" icon) to a screen projection display device desired by the user for the business service, as shown in fig. 2, and the screen projection display device shown for the ("app 14" icon) may be device 1.

In the whole process, a user can select at least two applications of the business service, such as the applications shown in fig. 2, and the selection timing sequence can be that the user sequentially selects one application and screen projection display equipment corresponding to each application, such as to select the application 14, then selects the equipment 1 desired to be projected by the application 14, continues to select the application 13 and then selects the equipment 2 desired to be projected by the application 13;

or the user may select at least two service services at the same time, such as the application shown in fig. 2, and then select the screen projection display device desired to be displayed for each service. Such as re-selecting to select application 14 and application 13 device 1 and device 2 for which screen shots are desired for application 14 and application 13, respectively; the specific implementation process can be used for developing business logic based on the implementation environment, and the selection operation process can be realized based on the business logic.

S102: and determining a display content container corresponding to each screen projection display device.

The display content container is used for managing equipment screen display in the application, taking an electronic device as an example, executing the main body electronic device to display on a local screen can be performed based on the local display content container, in order to realize a multi-device screen projection scene, and realize that the multi-device can display image frames corresponding to different business services based on the electronic device, in the implementation, an individual display content container can be established based on a screen projection display device which is connected or can be in communication connection, and screen projection display aiming at the business services expected by a user is realized based on the display content container which is respectively corresponding to each screen projection display device. The business service may be an application screen projection display service for application screen projection, a resource screen projection display service for multimedia resources (such as pictures, videos and audios), an on-screen projection display service for a current screen display interface of the electronic device, and the like according to some embodiments.

In a feasible implementation manner, if the electronic device has established a screen-casting communication connection with a currently selected screen-casting display device, after the connection is established, the electronic device may then create a display content container for the screen-casting display device, where the display content container is used at the local end of the electronic device to load display content (such as applications, application shortcut functions, and multimedia resources) of a service and render a display layer, and then, in the display content container, the current interface image frame (the current interface image frame is interface display content on the display device substantially corresponding to the display content container, and not necessarily interface image frame corresponding to a local screen of the electronic device) is completed, that is, data of the current interface image frame in the display content container is sent to the screen-casting display device to display the display content. Further, when a display content container corresponding to the screen projection display device is established, a mapping relationship between the screen projection display device and the display content container may be stored, and in some embodiments, the mapping relationship between the screen projection display device and the display content container may be established by a device identifier corresponding to the screen projection display device.

Therefore, when an actual screen projection display scene is involved, if a business service expected by a user needs to be subjected to screen projection display, a display content container corresponding to the screen projection display equipment can be determined based on the mapping relation.

S103: and loading and displaying the interface display window corresponding to each business service from a local display content container to the display content container corresponding to the screen projection display equipment, and sending the interface display image in the display content container to the screen projection display equipment for display.

In some embodiments, the electronic device may establish a screen-casting communication connection with the currently selected screen-casting display device, and may trigger establishment of screen-casting communication connections with a desired number (the number of screen-casting devices corresponding to the business service) of screen-casting display devices after performing step S101, and then create a display content container for the screen-casting display devices. Illustratively, in a screen projection initiating process, an electronic device may create a screen projection communication connection with a screen projection display device based on a screen projection communication protocol (e.g., a wifi display protocol) of the screen projection display device, an operating system of the electronic device may simultaneously create a system window management service (e.g., a WMS service) for a display content container of the screen projection display device, where, taking an android system as an example, the display content container may be characterized by DisplayContent, the DisplayContent container may be understood as a container class for describing physical display screen characteristics for an operating system of the electronic device, each DisplayContent may represent a device display screen, and the DisplayContent may generally include device screen information, and a display window created by a business service activity corresponding to a specified business service may be finally presented on the screen display device corresponding to the "display content container" based on the display content container.

In some embodiments, the display content container may be used to carry or accommodate business interaction logic for a business service (e.g., application, multimedia resource), such as human-machine interaction operations for the business service on a projection screen display device.

In a specific implementation, an Activity manager (e.g., activiyrecord) included in an operating system of the electronic device is used for performing Activity management on the business service, and based on the Activity manager, a mapping relationship is established between a service Activity (e.g., Activity) corresponding to the business service and a corresponding display content container, for example, the service Activity is bound to the corresponding display content container. In practical application, since the whole screen projection process results from interaction of a user on a home screen of the electronic device, when a business service determined by the user on the electronic device is usually displayed locally, the business service is associated with a local display container of the electronic device, and the local display container can accommodate a device service other than the business service and other functional business services to load and display each frame of local interface frame image of the electronic device thereon, which can be understood as that the interface frame image on one logical screen is overlapped by the display of the interface display windows of all functional services (which can include the business service) included in the display container relative to the interface frame image. When a user determines at least two business services on the electronic device, in a feasible implementation manner, the electronic device may obtain interface display windows corresponding to the business services based on a local display container, and the electronic device only needs to load and display the interface display windows corresponding to the business services from the local display content container to the display content container corresponding to the screen projection display device, so that the electronic device sends interface display images in the display content container to the screen projection display device for display, that is, the electronic device sends each frame of interface display image (frame) to the screen projection display device for display based on screen image refresh frequency in the display content container, that is, based on screen image refresh frequency in the display content container, the electronic device sends each frame of interface display image (frame) to the screen projection display device for display.

In the embodiment of the application, the electronic device obtains at least two business services to be screen-projected and screen-projecting display devices corresponding to the business services respectively, then determines display content containers corresponding to the screen-projecting display devices, loads and displays interface display windows corresponding to the business services from local display content containers to the display content containers corresponding to the screen-projecting display devices respectively, and sends interface display images in the display content containers to the screen-projecting display devices for display. The screen projection display of the screen projection display devices can be not limited to the influence of local screen display of the electronic equipment, screen projection display contents between the screen projection display devices can be independent from each other and do not interfere with each other, the screen projection display of the screen projection devices is realized to display different contents, the intelligence of the screen projection devices is improved, and the screen projection display contents can realize diversified display of multiple devices. And in the screen projection interaction process, the corresponding equipment icon can be displayed only by responding to the selected operation, so that the screen can be projected quickly, and the screen projection operation is simpler and quicker.

Referring to fig. 3, fig. 3 is a schematic flowchart of another embodiment of a screen projection method according to the present application. Specifically, the method comprises the following steps:

s201: and determining to establish screen projection connection with at least two screen projection display devices, and respectively creating a display content container aiming at each screen projection display device.

According to some embodiments, the screen-projection connection may be understood as a communication connection for a screen-projection display based on a communication network, such as a commonly used wireless screen-projection connection.

The wireless screen projection connection reflects the corresponding relation between the electronic equipment for wireless screen projection and the screen projection display equipment. Specifically, the electronic device may directly establish a wireless screen-projecting connection with a screen-projecting display device accessing the same wireless local area network, or establish a wireless screen-projecting connection with a screen-projecting display device connected to a network relay server through the network relay server.

Furthermore, when the electronic equipment and the screen projection display equipment are accessed to the same wireless local area network, the electronic equipment can directly establish wireless screen projection connection with the screen projection display equipment; or, a screen projection room is created based on the network relay server, the electronic device and the screen projection display device are respectively added into the room according to respective device identifiers or screen projection device identifiers, so that wireless screen projection connection is established, and at the moment, the terminal and the screen projection device are not limited to be accessed into the same wireless local area network.

In some embodiments, there may be multiple screen projection display devices that establish a screen projection connection with the local electronic device. When the screen projection device is multiple in number, the screen projection device can be one-to-many screen projection, such as a multi-party teleconference scene.

In a specific embodiment, a screen-casting application or a non-screen-casting application integrated with screen-casting codes can be installed on the electronic device. The electronic equipment can establish wireless screen projection connection with the screen projection display equipment according to a user instruction after running the screen projection application or the non-screen projection application integrated with the screen projection code. The screen projection application is an application program special for screen projection, and the non-screen projection application integrated with screen projection codes is an application program which is not special for screen projection but has a screen projection function, such as a WeChat application and the like. The electronic equipment can install or uninstall the screen projection application or the non-screen projection application integrated with the screen projection code in a customized manner according to the user instruction.

According to some embodiments, after determining to establish a screen-projection connection with at least two screen-projection display devices, the display content container can be created for each of the screen-projection display devices, in practical implementation, the operating system of the electronic device can simultaneously control a system window management service (e.g., a windowmanager service, WMS service) to create the display content container for the screen-projection display device, taking an android system as an example, the display content container can be characterized by DisplayContent, which can be understood as a container class used for an electronic device operating system to describe characteristics of a physical display screen, each DisplayContent can represent a device display screen, which can generally contain device screen information, the display window which can be used for the designated business service and is created corresponding to the business service activity is finally presented on the screen projection display equipment corresponding to the display content container based on the display content container.

S202: acquiring at least two business services to be screen-projected and screen-projecting display equipment corresponding to each business service;

specifically, refer to step S101, which is not described herein again.

S203: determining a display content container corresponding to each screen projection display device;

specifically, refer to step S102, which is not described herein again.

S204: and determining target service activities corresponding to the business services in all service activities related to the local display content container.

The local display content container is used for locally displaying a local interface image generated based on the service activity rendering;

in some embodiments, the display content container may be used to carry or accommodate business interaction logic for all service activities (e.g., applications, application shortcut functions, multimedia resources), such as human-machine interaction operations for business services locally on the electronic device.

Further, an Activity manager (e.g., activiyrecord) included in the operating system of the electronic device is configured to perform Activity management on all functional services, and based on the Activity manager, a mapping relationship is established between service activities (e.g., Activity) corresponding to all functional services and the local display content container, for example, all the functional services (e.g., application services, application shortcut functional services, multimedia resource services, etc.) are bound to corresponding service activities. When a business service determined by a user on an electronic device is displayed locally, the business service is associated with a local display container of the electronic device, and the local display container can accommodate the business service and other device services except for other functional business services, and each frame of local interface frame image of the electronic device is loaded and displayed on the local display container, which can be understood as the superposition of the interface frame image on a frame of logical screen by the display of the interface display window of all functional services (which can contain the business services) contained in the display container relative to the interface frame image. And the activities corresponding to all the current functional services local to the electronic equipment can be understood as service activities.

In a specific implementation, the electronic device may obtain target service activities respectively corresponding to the service services based on all service activities included in the local display container. As shown in fig. 2, an application service activity corresponding to "application 14" is provided. After determining the target service activities, the electronic device may load and display the interface display window corresponding to each target service activity to the display content container corresponding to the screen projection display device.

S205: establishing a window mapping relation between each target service activity and the display content container according to the screen projection mapping relation between each service and the screen projection display equipment;

the screen projection mapping relationship can be established when a user inputs human-computer interaction operations such as selection operations and the like aiming at the business service to be projected, and the electronic equipment can determine the operation information corresponding to the human-computer interaction operations only by monitoring the operation information in the process. As shown in fig. 4, fig. 4 is a schematic view of an operation scenario related to the present application, where resource icons corresponding to a plurality of multimedia resources (one type of service) are arranged on a local screen interface of the electronic device shown in fig. 4, and it is assumed that a service that a user needs to screen is the aforementioned resource screen-projecting display service for projecting a screen of a multimedia resource, that is, the user may input a human-computer interaction operation on the local screen interface to select a service-multimedia resource that is desired to be projected, and then determine a screen-projecting display device corresponding to the "service-multimedia resource" to perform screen-projecting display. In the whole process, the electronic device can determine the screen projection mapping relationship between each business service and the screen projection display device by detecting human-computer interaction operation input by a user, and as shown in fig. 4, can determine the screen projection mapping relationship between the business service-screen projection content 5 and the device 1, and the screen projection mapping relationship between the business service-screen projection content 4 and the device 2.

Further, the screen-casting mapping relationship may be understood as an instruction or a basis for the electronic device to perform screen casting of the business service to the corresponding screen-casting display device, and the electronic device may perform a next step of establishing a window mapping relationship between each target service activity and the display content container based on the screen-casting mapping relationship, where the window mapping relationship is used to logically map the target service activity corresponding to each business service and the display content container corresponding to each screen-casting display device, so that the subsequent loading of each target service activity by the electronic device may be performed in a corresponding independent display content container, and in some implementation scenarios, the electronic device does not need to rely on the local display content container of the electronic device. It can be understood that when the foreground of the local display content container operates to serve the service, the content displayed locally by the screen projection display device and the electronic device is similar; furthermore, if the foreground of the local display content container operates without serving the service, the content displayed locally by the screen projection display device and the electronic device is different, so that the screen projection display devices can independently display the screen projection requirements of the user and the electronic device in a multi-device screen projection scene, and the screen projection requirements of the user and the electronic device are not mutually influenced. For example, the electronic device may associate all service activities corresponding to the display content container corresponding to the screen projection display device and the local display content container based on the user requirement, so that the screen projection display device and the electronic device may implement display synchronization.

S206: and loading and displaying an interface display window corresponding to the business service to the display content container based on the window mapping relation.

According to some embodiments, in a specific implementation, an Activity manager (e.g., Activity record) included in an operating system of the electronic device is configured to perform Activity management on the business service, and based on the Activity manager, a mapping relationship is established between a service Activity (e.g., Activity) corresponding to the business service and a corresponding display content container, for example, the service Activity is bound to the corresponding display content container. In practical application, the service displays a substantial display of the content on the device screen, where the substantial display of the content is an interface display window corresponding to the service, and if the service is an application service, the substantial display of the content on the device screen is an application window, or if the service is a video service, the substantial display of the content on the device screen is a video window, and so on. According to the window mapping relation established in the application, the electronic equipment realizes screen projection display of each service based on the window mapping relation, and the interface display window of the service in service operation is loaded and displayed to the corresponding display content container of the screen projection display equipment.

In one particular implementation scenario, the first and second sets of sensors,

1: the electronic device can obtain a layer stack corresponding to an interface display window of the business service, wherein the layer stack comprises at least one display layer.

Furthermore, the interface display window of each service is substantially based on loading and rendering of each layer to be displayed in the layer frame, and generally, each service corresponds to a layer stack, and the layer stack is used for bearing the interface display window of the service, so as to complete normal loading and displaying of the interface display window of the service. And loading each display layer in each layer stack, and forming a final interface display window by the superposition display of each display layer after the loading is finished.

The display layers may be, for example, films containing text or graphics elements, which are stacked in sequence one on top of the other to form the final effect of the interface display window. When the interface display window is rendered and displayed, the element to be displayed on the display interface can be accurately positioned through the display layer, corresponding texts, pictures, tables, plug-ins and the like can be added into the layer, and the layer can be nested in the layer.

In practical application, the number of display layers in the layer stack may be one or more, and usually, in the process of displaying on the interface display window surface, the interface display window is finally formed by overlapping a plurality of display layers.

2: the electronic device may load and display the layer stack to the display content container. In specific implementation, the layer stack corresponding to the interface display window of the business service may be logically bound to the display content container of the screen projection display device desired to be projected, and then the subsequent electronic device may automatically load and display the layer stack into the display content container.

Further, when the layer stacks bound by the local display content container of the electronic device and the display content container of the screen projection display device are the same, the display contents of the local display content container and the display content container of the screen projection display device are synchronously displayed. When the layer stacks bound by the local display content container of the electronic device and the display content container of the screen projection display device are different, the display contents of the local display content container and the display content container are independent and not necessarily the same.

Whether the layer stacks associated with the business services bound by the local display content container of the electronic equipment and the display content container of the screen projection display equipment are consistent or not is determined by human-computer operation input by a user based on an actual application environment.

S207: and sending the interface display image in the display content container to the screen projection display equipment for display.

According to some embodiments, the electronic device may obtain, based on the local display container, interface display images of interface display windows corresponding to the respective business services, and the electronic device only needs to load and display the interface display windows corresponding to the respective business services from the local display content container to the display content container corresponding to the screen projection display device, so that the electronic device sends the interface display images in the display content container to the screen projection display device for display, that is, the electronic device sends each frame of interface display image (frame) to the screen projection display device for display based on the screen image refresh frequency in the display content container, that is, based on the screen projection communication connection with the screen projection display device, based on the screen image refresh frequency in the display content container.

Referring to fig. 5, fig. 5 is a schematic flowchart illustrating another embodiment of a screen projection method according to the present application. Specifically, the method comprises the following steps:

s301: acquiring at least two business services to be screen-projected and screen-projecting display equipment corresponding to each business service;

specifically, refer to step s101, which is not described herein again.

S302: determining a display content container corresponding to each screen projection display device;

refer to step s102 specifically, and will not be described herein again.

S303: and loading the interface display window corresponding to each business service from a local display content container to the display content container corresponding to the screen projection display equipment, and determining that the interface display window of the business service has a safety privacy element.

In practical application, in a process of loading and displaying an interface display window corresponding to a business service, generally, an electronic device starts to load the interface display window corresponding to each business service from a local display content container to the display content container corresponding to the screen projection display device in advance, and the electronic device may determine whether the interface display window of the business service has a security privacy element at a loading start stage. So as to timely perform safe privacy processing on the interface display window related to the safe privacy, and avoid the disclosure of the safe privacy. In practical application, it is generally necessary to avoid disclosure of security privacy elements such as password input and personal information, and to perform occlusion processing on the corresponding security privacy elements.

Based on the above, in the application, in the stage of loading the interface display window in the display content container, the security privacy detection of the interface display window is synchronously executed, if the interface display window does not contain security privacy elements, the interface display window is normally loaded in the display content container, and then the interface display window is sent to the screen projection display device for display based on the target interface image in the display content container; if the interface display window has the security privacy element, the interface display window related to the security privacy can be subjected to security privacy processing to avoid disclosure of the security privacy.

In practical application, in the layer-by-layer rendering and loading process of an interface display window, security privacy detection may be performed on display elements of a current interface image, so as to determine whether a layer currently being rendered or to be rendered relates to security privacy.

For example, the electronic device may adopt a character recognition method based on Optical Character Recognition (OCR) for the current interface image, acquire information related to the current interface image, and perform key character recognition on the information, thereby determining that the information relates to key characters, i.e., security privacy elements marked in advance;

for example, the electronic device may perform image recognition on the current interface image, thereby determining a target image region related to user privacy in the current interface image, and using the target image region as an occlusion region, where the method of performing image recognition on the current interface image may be to input the current interface image into a pre-trained image recognition model, and output security privacy elements in the interface, where the image recognition model may be implemented based on one or more of LR (Logistic Regression), SVM (Support Vector Machine), decision tree, naive bayes classifier, CNN (Convolutional Neural Network), RNN (recursive Neural Network), etc., to obtain a large amount of image sample data in advance, train the initial image recognition model based on the image sample data to which the security privacy elements have been labeled, and obtaining the trained image recognition model.

In a possible implementation scenario, the detection of the current interface image may be from fine grain to layer dimension, that is, by performing security privacy detection on all display layers when the current interface image is loaded.

Further, when the security privacy element is empty, it indicates that the security privacy element does not exist in the interface display window of the business service,

s304: and carrying out layer shielding processing on the safety privacy elements based on the display content container, and sending a target interface image in the display content container to the screen projection display equipment for display, wherein the target interface image does not contain the safety privacy elements.

Wherein, the security privacy element includes but is not limited to the fitting of one or more of the contents of business secret documents and videos, identity authentication information, bank accounts, mails, address book contacts, personal pictures, personal accounts, password login contents, personal health information, chat information and the like. The private content may also include user-customized content. The method includes the steps that privacy content detection is conducted on all display layers of a current interface image (namely, a loaded interface display window), namely, a layer containing the security privacy is determined, and generally, the layer containing the privacy content can be called a security layer, namely, a first display layer, namely, a layer related to user privacy security. Such as a display layer corresponding to a user bank password input box, display content corresponding to a user personal account display column, a display layer corresponding to user personal information related in a video, and the like.

Specifically, the electronic device may determine, based on the detection of the security privacy element, a first display layer corresponding to a current interface image (that is, a loaded interface display window) and then perform layer shielding processing on the first display layer to send a target interface image in the display content container to the screen projection display device for display, where the target interface image may be an image that is shielded and does not include the security privacy element.

In one particular implementation scenario:

1. the electronic equipment can acquire a layer stack forming the interface display window and a container identifier corresponding to the display content container;

specifically, in the shielding processing of the first display layer related to the security privacy element, the shielding layer may be correspondingly identified in specific implementation by means of a container identifier corresponding to the display content container, so that when a screen projection display scene is loaded by the screen projection display device, the layer with the identifier is not rendered.

According to some embodiments, the layer stack includes at least one display layer, the number of the display layers in the layer stack may be one or more, and usually, in the process of displaying the interface display window surface, the interface display window is finally formed by overlapping a plurality of display layers.

The container identifier is used for uniquely representing a display content container corresponding to the screen projection display device, and the container identifier can be represented in the form of a string of character strings, names, codes, characters and the like.

2. Determining a first display layer corresponding to the security privacy element in the layer stack, and setting the container identifier in the layer container attribute corresponding to the target display layer;

specifically, the electronic device may determine, based on the detection of the security privacy element, a first display layer corresponding to the current interface image (that is, the loaded interface display window) accordingly, for example, determine whether the current interface image contains the security privacy element by using means such as an image recognition technique and a character recognition technique, and determine, in the case of existence of the current interface image, a layer where the security privacy element is located, where the layer is the first display layer.

The layer container attribute is a newly-added attribute field in the layer attribute that the layer corresponds in this application, in the correlation technique, the layer attribute that the layer corresponds does not contain the characteristic to the layer display container, in this application, through after obtaining the container sign, set up newly-added layer container attribute in the layer attribute that the layer corresponds based on the pertinence of safe privacy dimension, be applied to the scene that screen display equipment throws the screen and shows and relate to safe privacy, whether interface display window based on business service relates to safe privacy, can set up layer container attribute value to pertinence, so that follow-up accessible when loading in the display layer container reads layer container attribute, confirm whether load the current picture layer that corresponds. Therefore, the layer shielding processing of the safety privacy elements is realized.

3. Loading a second display layer in the layer stack in the display content container based on the container identifier to obtain a target interface image, and sending the target interface image to the screen projection display equipment for display;

and the second display layer is a layer in the layer stack except the first display layer.

In a specific implementation scenario, if a security privacy element exists in an interface display window of a service, a layer container attribute is set in advance for a layer attribute corresponding to a display layer where the security privacy element is located, and a value of the layer container attribute is set as a container identifier through an acquired container identifier of a display content container. Conversely, in a possible implementation manner, the layer container attribute may not be set for the second display layer; or, the layer container attribute is set for the second display layer, and the value of the layer container attribute can be randomly set only by the fact that the value of the layer container attribute is inconsistent with the container identifier.

Further, in the process of loading and displaying each layer in the layer stack of the interface display window, if the layer container attribute of the first display layer is matched with the container identifier, and if the layer container attribute is consistent with the container identifier, the current first display layer is not loaded, and the second display layer is normally loaded and displayed.

S305: and when the local display content container is associated with the picture display of the display content container, loading and displaying an original interface image corresponding to the layer stack based on the container identifier, wherein the original interface image contains the security privacy element.

When the business service corresponding to the display content container is the same-screen projection display service (aiming at the current screen display interface of the electronic equipment), determining that the local display content container is associated with the picture display of the display content container; or the like, or, alternatively,

when the local display content container exists (service operated by the foreground of the electronic equipment), the foreground operation service comprises a business service corresponding to the display content container, determining that the local display content container is associated with the screen display of the display content container;

at this time, since the interface display window corresponding to the service includes the security privacy element, in order to realize normal display on the local screen of the electronic device, the electronic device may load and display the original interface image corresponding to the layer stack based on the container identifier, and in a specific implementation, the electronic device may determine the local container identifier of the locally displayed content container; and then detecting the layer container attribute of each layer in a layer stack corresponding to a local display container, and normally loading and displaying the display layers of which the layer container attribute values are not local container identifiers, namely loading and displaying the original interface images corresponding to the layer stack when the layer container attributes of all the display layers corresponding to the layer stack are different from the local container identifiers. In some implementations, when the electronic device is directed to a locally displayed content container, each layer in the stack of layers for each locally displayed content container can be set to a value that is different from the local container identification. In practical application, the electronic device can realize loading and displaying of the original interface image corresponding to the layer stack based on the container identifier. Therefore, the requirement of different user display on different logic screens (screens of local electronic equipment and projection screen display equipment) is met by setting the layer container attributes through the container identifiers, namely, images related to safety privacy can be normally displayed on the local terminal, and the projection screen display equipment in a projection screen display scene is not displayed.

In a possible implementation manner, the electronic device sets a layer container attribute in a first display layer containing a security privacy element corresponding to a certain interface display window, where a value of the layer container attribute may be set to be inconsistent with a container identifier of a current display content container; the electronic equipment sets layer container attributes in a second display layer which is corresponding to the interface display window and contains the security privacy elements, and at the moment, the values of the layer container attributes can be set to be consistent with the container identifiers of the current display content containers; in the actual application stage, the first display layer with the layer container attribute inconsistent with the container identifier is not loaded, and the second display layer with the layer container attribute consistent with the container identifier is normally loaded and displayed.

In the embodiment of the application, the electronic device obtains at least two business services to be screen-projected and screen-projecting display devices corresponding to the business services respectively, then determines display content containers corresponding to the screen-projecting display devices, loads and displays interface display windows corresponding to the business services from local display content containers to the display content containers corresponding to the screen-projecting display devices respectively, and sends interface display images in the display content containers to the screen-projecting display devices for display. The screen projection display of the screen projection display devices can be not limited to the influence of local screen display of the electronic equipment, screen projection display contents between the screen projection display devices can be independent from each other and do not interfere with each other, the screen projection display of the screen projection devices is realized to display different contents, the intelligence of the screen projection devices is improved, and the screen projection display contents can realize diversified display of multiple devices. And in the screen projection interaction process, the corresponding equipment icon can be displayed only by responding to the selected operation, so that the screen can be projected quickly, and the screen projection operation is simpler and quicker. And the layer container attribute is set in the layer based on the container identifier, so that privacy shielding processing of an interface display window can be realized, privacy disclosure in the screen projection process is avoided, normal display of interface privacy elements at the local end can be realized, screen projection scenes are more widely covered, and screen projection privacy requirements of different devices are met.

Fig. 6 is a schematic diagram of a screen projection system according to an embodiment of the present application. As shown in fig. 6, the screen projection system 10 includes an electronic device 100 and a screen projection display device cluster, where the screen projection display device cluster may include a plurality of screen projection display devices, as shown in fig. 1, specifically including a screen projection display device 1, a screen projection display device 2, …, and a screen projection display device n, where n is an integer greater than 0;

each of the electronic device 100 and the screen projection display devices in the screen projection display device cluster may be an electronic device with a communication function, and the electronic device includes but is not limited to: wearable devices, handheld devices, personal computers, tablet computers, in-vehicle devices, smart phones, computing devices or other processing devices connected to a wireless modem, and the like. Electronic devices in different networks may be called different names, such as: user equipment, access terminal, subscriber unit, subscriber station, mobile station, remote terminal, mobile device, user terminal, wireless communication device, user agent or user equipment, cellular telephone, cordless telephone, Personal Digital Assistant (PDA), device in a 5G network or future evolution network, and the like.

The electronic device 100 and each screen projection display device in the screen projection display device cluster perform interactive communication through a network, for example, a screen projection connection is established based on the network, the network may be a wireless network or a wired network, the wireless network includes but is not limited to a cellular network, a wireless local area network, an infrared network or a bluetooth network, and the wired network includes but is not limited to an ethernet, a Universal Serial Bus (USB) or a controller area network.

In addition, the embodiment of the remote diagnosis system provided in the above embodiments and the remote diagnosis method in some embodiments belong to the same concept, and details of implementation processes thereof are referred to in the embodiment of the method, and are not described herein again.

The screen projection device provided by the embodiment of the present application will be described in detail below with reference to fig. 7. It should be noted that the screen projection apparatus shown in fig. 7 is used for executing the method of the embodiment shown in fig. 1 to fig. 6 of the present application, and for convenience of description, only the portion related to the embodiment of the present application is shown, and details of the specific technology are not disclosed, please refer to the embodiment shown in fig. 1 to fig. 6 of the present application.

Please refer to fig. 7, which shows a schematic structural diagram of a projection device according to an embodiment of the present application. The screen projection device 1 may be implemented as all or a part of a user terminal by software, hardware or a combination of both. According to some embodiments, the screen projection device 1 includes a screen projection acquisition module 11, a container determination module 12, and a screen projection display module 13, and is specifically configured to:

the screen projection acquisition module 11 is configured to acquire at least two service services to be projected and screen projection display devices corresponding to the service services respectively;

a container determining module 12, configured to determine a display content container corresponding to each of the screen projection display devices;

and the screen projection display module 13 is configured to load and display the interface display window corresponding to each service from a local display content container to the display content container corresponding to the screen projection display device, and send an interface display image in the display content container to the screen projection display device for display.

Optionally, the apparatus 1 is specifically configured to:

and determining to establish screen projection connection with at least two screen projection display devices, and respectively creating a display content container aiming at each screen projection display device.

Optionally, as shown in fig. 8, the screen projection display module 13 includes:

an activity determining unit 131, configured to determine, among all service activities associated with a local display content container, a target service activity corresponding to each of the service services; the local display content container is used for locally displaying a local interface image generated based on the service activity rendering;

a loading display unit 132, configured to load and display the interface display window corresponding to each target service activity to the display content container corresponding to the screen projection display device.

Optionally, the loading display unit 132 is specifically configured to:

establishing a window mapping relation between each target service activity and the display content container according to the screen projection mapping relation between each service and the screen projection display equipment;

and loading and displaying an interface display window corresponding to the business service to the display content container based on the window mapping relation.

The optional loading display unit 132 is specifically configured to:

acquiring a layer stack corresponding to an interface display window of the business service, wherein the layer stack comprises at least one display layer;

and loading and displaying the layer stack to the display content container.

Optionally, the apparatus 1 is specifically configured to:

determining that a security privacy element exists in an interface display window of the business service;

and carrying out layer shielding processing on the safety privacy elements based on the display content container, and sending a target interface image in the display content container to the screen projection display equipment for display, wherein the target interface image does not contain the safety privacy elements.

Optionally, the apparatus 1 is specifically configured to:

acquiring a layer stack forming the interface display window and a container identifier corresponding to the display content container;

determining a first display layer corresponding to the security privacy element in the layer stack, and setting the container identifier in the layer container attribute corresponding to the target display layer;

loading a second display layer in the layer stack in the display content container based on the container identifier to obtain a target interface image, and sending the target interface image to the screen projection display equipment for display;

Optionally, the apparatus 1 is specifically configured to:

and when the local display content container is associated with the picture display of the display content container, loading and displaying an original interface image corresponding to the layer stack based on the container identifier, wherein the original interface image contains the security privacy element.

Optionally, the apparatus 1 is specifically configured to:

determining a local container identification for the local display content container;

and when the layer container attributes of all display layers corresponding to the layer stack are different from the local container identifiers, loading and displaying the original interface image corresponding to the layer stack.

Optionally, the apparatus 1 is specifically configured to:

respectively responding to service selection operations corresponding to at least two service services to be screen-projected, and displaying equipment screen-projecting icons corresponding to at least two screen-projecting display equipment;

and determining screen projection display equipment corresponding to each business service respectively based on the operation position information corresponding to the service selection operation and each equipment screen projection icon.

It should be noted that, when the screen projection apparatus provided in the foregoing embodiment executes the screen projection method, only the division of the functional modules is illustrated, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the above described functions. In addition, the embodiments of the screen projection device and the screen projection method provided by the above embodiments belong to the same concept, and details of implementation processes are found in the embodiments of the methods, which are not described herein again.

The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.

An embodiment of the present application further provides a computer storage medium, where the computer storage medium may store a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the screen projection method according to the embodiment shown in fig. 1 to 6, and a specific execution process may refer to specific descriptions of the embodiment shown in fig. 1 to 6, which is not described herein again.

The present application further provides a computer program product, where at least one instruction is stored in the computer program product, and the at least one instruction is loaded by the processor and executes the screen projection method according to the embodiment shown in fig. 1 to 6, where a specific execution process may refer to specific descriptions of the embodiment shown in fig. 1 to 6, and is not described herein again.

Referring to fig. 9, a block diagram of an electronic device according to an exemplary embodiment of the present application is shown. The electronic device in the present application may comprise one or more of the following components: a processor 110, a memory 120, an input device 130, an output device 140, and a bus 150. The processor 110, memory 120, input device 130, and output device 140 may be connected by a bus 150.

Processor 110 may include one or more processing cores. The processor 110 connects various parts within the overall electronic device using various interfaces and lines, and performs various functions of the electronic device 100 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 120 and calling data stored in the memory 120. Alternatively, the processor 110 may be implemented in hardware using at least one of Digital Signal Processing (DSP), field-programmable gate Array (FPGA), and Programmable Logic Array (PLA). The processor 110 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 110, but may be implemented by a communication chip.

The Memory 120 may include a Random Access Memory (RAM) or a read-only Memory (ROM). Optionally, the memory 120 includes a non-transitory computer-readable medium. The memory 120 may be used to store instructions, programs, code sets, or instruction sets. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like, and the operating system may be an Android (Android) system, including a system based on Android system depth development, an IOS system developed by apple, including a system based on IOS system depth development, or other systems. The data storage area may also store data created by the electronic device during use, such as phone books, audio and video data, chat log data, and the like.

Referring to fig. 10, the memory 120 may be divided into an operating system space, where an operating system is run, and a user space, where native and third-party applications are run. In order to ensure that different third-party application programs can achieve a better operation effect, the operating system allocates corresponding system resources for the different third-party application programs. However, the requirements of different application scenarios in the same third-party application program on system resources are different, for example, in a local resource loading scenario, the third-party application program has a higher requirement on the disk reading speed; in the animation rendering scene, the third-party application program has a high requirement on the performance of the GPU. The operating system and the third-party application program are independent from each other, and the operating system cannot sense the current application scene of the third-party application program in time, so that the operating system cannot perform targeted system resource adaptation according to the specific application scene of the third-party application program.

In order to enable the operating system to distinguish a specific application scenario of the third-party application program, data communication between the third-party application program and the operating system needs to be opened, so that the operating system can acquire current scenario information of the third-party application program at any time, and further perform targeted system resource adaptation based on the current scenario.

Taking an operating system as an Android system as an example, programs and data stored in the memory 120 are as shown in fig. 11, and a Linux kernel layer 320, a system runtime library layer 340, an application framework layer 360, and an application layer 380 may be stored in the memory 120, where the Linux kernel layer 320, the system runtime library layer 340, and the application framework layer 360 belong to an operating system space, and the application layer 380 belongs to a user space. The Linux kernel layer 320 provides underlying drivers for various hardware of the electronic device, such as a display driver, an audio driver, a camera driver, a bluetooth driver, a Wi-Fi driver, power management, and the like. The system runtime library layer 340 provides a main feature support for the Android system through some C/C + + libraries. For example, the SQLite library provides support for a database, the OpenGL/ES library provides support for 3D drawing, the Webkit library provides support for a browser kernel, and the like. Also provided in the system runtime library layer 340 is an Android runtime library (Android runtime), which mainly provides some core libraries that can allow developers to write Android applications using the Java language. The application framework layer 360 provides various APIs that may be used in building an application, and developers may build their own applications by using these APIs, such as activity management, window management, view management, notification management, content provider, package management, session management, resource management, and location management. At least one application program runs in the application layer 380, and the application programs may be native application programs carried by the operating system, such as a contact program, a short message program, a clock program, a camera application, and the like; or a third-party application developed by a third-party developer, such as a game application, an instant messaging program, a photo beautification program, and the like.

Taking an operating system as an IOS system as an example, programs and data stored in the memory 120 are shown in fig. 12, and the IOS system includes: a Core operating system Layer 420(Core OS Layer), a Core Services Layer 440(Core Services Layer), a Media Layer 460(Media Layer), and a touchable Layer 480(Cocoa Touch Layer). The kernel operating system layer 420 includes an operating system kernel, drivers, and underlying program frameworks that provide functionality closer to hardware for use by program frameworks located in the core services layer 440. The core services layer 440 provides system services and/or program frameworks, such as a Foundation framework, an account framework, an advertisement framework, a data storage framework, a network connection framework, a geographic location framework, a motion framework, and so forth, as required by the application. The media layer 460 provides audiovisual related interfaces for applications, such as graphics image related interfaces, audio technology related interfaces, video technology related interfaces, audio video transmission technology wireless playback (AirPlay) interfaces, and the like. Touchable layer 480 provides various common interface-related frameworks for application development, and touchable layer 480 is responsible for user touch interaction operations on the electronic device. Such as a local notification service, a remote push service, an advertising framework, a game tool framework, a messaging User Interface (UI) framework, a User Interface UIKit framework, a map framework, and so forth.

In the framework illustrated in FIG. 12, the framework associated with most applications includes, but is not limited to: a base framework in the core services layer 440 and a UIKit framework in the touchable layer 480. The base framework provides many basic object classes and data types, provides the most basic system services for all applications, and is UI independent. While the class provided by the UIKit framework is a basic library of UI classes for creating touch-based user interfaces, iOS applications can provide UIs based on the UIKit framework, so it provides an infrastructure for applications for building user interfaces, drawing, processing and user interaction events, responding to gestures, and the like.

The Android system can be referred to as a mode and a principle for realizing data communication between the third-party application program and the operating system in the IOS system, and details are not repeated herein.

The input device 130 is used for receiving input instructions or data, and the input device 130 includes, but is not limited to, a keyboard, a mouse, a camera, a microphone, or a touch device. The output device 140 is used for outputting instructions or data, and the output device 140 includes, but is not limited to, a display device, a speaker, and the like. In one example, the input device 130 and the output device 140 may be combined, and the input device 130 and the output device 140 are touch display screens for receiving touch operations of a user on or near the touch display screens by using any suitable object such as a finger, a touch pen, and the like, and displaying user interfaces of various applications. Touch displays are typically provided on the front panel of an electronic device. The touch display screen may be designed as a full-face screen, a curved screen, or a profiled screen. The touch display screen can also be designed to be a combination of a full-face screen and a curved-face screen, and a combination of a special-shaped screen and a curved-face screen, which is not limited in the embodiment of the present application.

In addition, those skilled in the art will appreciate that the configurations of the electronic devices illustrated in the above-described figures do not constitute limitations on the electronic devices, which may include more or fewer components than illustrated, or some components may be combined, or a different arrangement of components. For example, the electronic device further includes a radio frequency circuit, an input unit, a sensor, an audio circuit, a wireless fidelity (WiFi) module, a power supply, a bluetooth module, and other components, which are not described herein again.

In the embodiment of the present application, the main body of execution of each step may be the electronic device described above. Optionally, the execution subject of each step is an operating system of the electronic device. The operating system may be an android system, an IOS system, or another operating system, which is not limited in this embodiment of the present application.

The electronic device of the embodiment of the application can also be provided with a display device, and the display device can be various devices capable of realizing a display function, for example: a cathode ray tube display (CR), a light-emitting diode display (LED), an electronic ink panel, a Liquid Crystal Display (LCD), a Plasma Display Panel (PDP), and the like. A user may utilize a display device on the electronic device 101 to view information such as displayed text, images, video, and the like. The electronic device may be a smartphone, a tablet computer, a gaming device, an AR (Augmented Reality) device, an automobile, a data storage device, an audio playback device, a video playback device, a notebook, a desktop computing device, a wearable device such as an electronic watch, an electronic glasses, an electronic helmet, an electronic bracelet, an electronic necklace, an electronic garment, or the like.

In the electronic device shown in fig. 9, where the electronic device may be a terminal, the processor 110 may be configured to call the network optimization application stored in the memory 120, and specifically perform the following operations:

In one embodiment, the processor 1001, when executing the screen projection method, further performs the following operations:

In an embodiment, when the processor 1001 loads and displays the interface display window corresponding to each service from the local display content container to the display content container corresponding to the screen projection display device, the following operations are specifically performed:

determining target service activities corresponding to the business services in all service activities related to the local display content container; the local display content container is used for locally displaying a local interface image generated based on the service activity rendering;

and respectively loading and displaying the interface display window corresponding to each target service activity to the display content container corresponding to the screen projection display equipment.

In an embodiment, when the processor 1001 executes the loading and displaying of the interface display window corresponding to each target service activity to the display content container corresponding to the screen projection display device, specifically execute the following operations:

In an embodiment, when the processor 1001 loads and displays the interface display window corresponding to the business service to the display content container, the following operations are specifically performed:

and loading and displaying the layer stack to the display content container.

In one embodiment, the processor 1001, when executing the screen projection method, further performs the following steps:

In an embodiment, when the processor 1001 executes the layer shielding processing on the security privacy element based on the display content container, and sends a target interface image in the display content container to the screen projection display device for display, specifically execute the following operations:

In one embodiment, the processor 1001, in executing the screen projection method, further performs the following steps:

In an embodiment, when the processor 1001 executes the loading and displaying of the original interface image corresponding to the layer stack based on the container identifier, specifically execute the following operations:

In an embodiment, the processor 1001, when executing the screen projection display device that acquires at least two service services to be screen projected and corresponds to each of the service services, further includes:

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a read-only memory or a random access memory.

The above disclosure is only for the purpose of illustrating the preferred embodiments of the present application and is not to be construed as limiting the scope of the present application, so that the present application is not limited thereto, and all equivalent variations and modifications can be made to the present application.

Claims

1. A method of screen projection, the method comprising:

2. The method of claim 1, further comprising:

3. The method of claim 1, wherein the loading and displaying the interface display window corresponding to each business service from a local display content container to the display content container corresponding to the screen projection display device respectively comprises:

4. The method of claim 3, wherein the loading and displaying the interface display window corresponding to each target service activity to the display content container corresponding to the screen projection display device respectively comprises:

5. The method according to claim 3, wherein the loading and displaying the interface display window corresponding to the business service to the display content container comprises:

and loading and displaying the layer stack to the display content container.

6. The method of claim 1, further comprising:

7. The method of claim 6, wherein the conducting layer shielding processing on the security privacy element based on the display content container, and sending a target interface image in the display content container to the screen-projection display device for display comprises:

8. The method of claim 6, further comprising:

9. The method according to claim 8, wherein the loading and displaying an original interface image corresponding to the layer stack based on the container identifier comprises:

10. The method according to claim 1, wherein the acquiring at least two service services to be screen-projected and screen-projection display devices corresponding to the service services respectively further comprises:

11. A computer storage medium, characterized in that it stores a plurality of instructions adapted to be loaded by a processor and to perform the method steps according to any of claims 1 to 10.

12. An electronic device, comprising: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the method steps of any of claims 1 to 10.