CN114911442A - Screen projection method, screen projection device, terminal, equipment, computer medium and program product - Google Patents

Screen projection method, screen projection device, terminal, equipment, computer medium and program product Download PDF

Info

Publication number
CN114911442A
CN114911442A CN202210457912.6A CN202210457912A CN114911442A CN 114911442 A CN114911442 A CN 114911442A CN 202210457912 A CN202210457912 A CN 202210457912A CN 114911442 A CN114911442 A CN 114911442A
Authority
CN
China
Prior art keywords
screen projection
screen
content
application
editing area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210457912.6A
Other languages
Chinese (zh)
Inventor
李飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202210457912.6A priority Critical patent/CN114911442A/en
Publication of CN114911442A publication Critical patent/CN114911442A/en
Priority to PCT/CN2022/143911 priority patent/WO2023207200A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Transforming Electric Information Into Light Information (AREA)

Abstract

The application discloses a screen projection method, a screen projection device, a terminal, equipment, a computer medium and a program product, and belongs to the technical field of screen projection. The method comprises the following steps: responding to a first area editing operation in a screen projection state, and determining a first screen projection editing area; determining first object content corresponding to a first object as first screen projection content under the condition that the first screen projection editing area contains the first object; and transmitting the first screen projection content to the screen projection equipment so that the screen projection equipment displays the first screen projection content. The user is allowed to edit the screen projection editing area at the terminal, and the privacy information or unnecessary display information in the user interface can be manually avoided in the process of editing the screen projection editing area by the user, so that the screen projection display of the unnecessary privacy information can be avoided while the normal screen projection display is realized, and the safety of the terminal information is further improved.

Description

Screen projection method, device, terminal, equipment, computer medium and program product
Technical Field
The embodiment of the application relates to the technical field of screen projection, in particular to a screen projection method, a screen projection device, a terminal, equipment, a computer medium and a program product.
Background
With the development of terminal technology, the terminal has more interactive functions with other terminals, for example, a screen projection function, that is, a picture displayed by the terminal is displayed in other terminals in real time through a specific screen projection technology.
In the related art, when a user wants to screen the display content of the mobile phone to the computer, the screen-projecting function can be started in both the mobile phone and the computer, and the real-time picture displayed by the terminal can be screen-projected and displayed to the computer after the computer is selected as the screen-projecting device in the mobile phone.
Obviously, in the related art, in a screen projection state, all real-time display contents of the mobile phone terminal can be projected to the computer terminal, and unnecessary privacy information may be leaked in the screen projection process.
Disclosure of Invention
The embodiment of the application provides a screen projection method, a screen projection device, a terminal, equipment, a computer medium and a program product. The technical scheme is as follows:
in one aspect, an embodiment of the present application provides a screen projection method, where the method is executed by a terminal, and the method includes:
responding to a first area editing operation in a screen projection state, and determining a first screen projection editing area;
determining first object content corresponding to a first object as first screen projection content under the condition that the first screen projection editing area contains the first object;
transmitting the first screen projection content to a screen projection device so that the screen projection device displays the first screen projection content.
In another aspect, an embodiment of the present application provides a screen projection method, where the method is performed by a screen projection device, and the method includes:
receiving first screen projection content sent by a terminal in a screen projection state, wherein the first screen projection content is determined based on first object content corresponding to a first object contained in a first screen projection editing area of the terminal, and the first screen projection editing area is determined based on first area editing operation in the screen projection state of the terminal;
and displaying the first screen projection content.
In another aspect, an embodiment of the present application provides a screen projection apparatus, where the apparatus is executed by a terminal, and the apparatus includes:
the editing module is used for responding to a first area editing operation in a screen projection state and determining a first screen projection editing area;
the determining module is used for determining first object content corresponding to a first object as first screen projection content under the condition that the first screen projection editing area contains the first object;
and the sending module transmits the first screen projection content to screen projection equipment so that the screen projection equipment can display the first screen projection content.
In another aspect, an embodiment of the present application provides a screen projection apparatus, where the apparatus is executed by a screen projection device, and the apparatus includes:
the terminal comprises a receiving module, a display module and a display module, wherein the receiving module is used for receiving first screen projection content sent by a terminal in a screen projection state, the first screen projection content is determined based on first object content corresponding to a first object contained in a first screen projection editing area of the terminal, and the first screen projection editing area is determined based on first area editing operation in the screen projection state of the terminal;
and the display module is used for displaying the first screen projection content.
In another aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, where the memory stores at least one program, and the at least one program is loaded and executed by the processor to implement the screen projection method according to the above aspect.
In another aspect, an embodiment of the present application provides a computer-readable storage medium, in which at least one program code is stored, and the program code is loaded and executed by a processor to implement the screen projection method according to the above aspect.
In another aspect, embodiments of the present application provide a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. The computer instructions are read by a processor of the computer device from a computer-readable storage medium, and the computer instructions are executed by the processor to cause the computer device to execute the screen projection method provided in the various alternative implementations of the above aspects.
The technical scheme provided by the embodiment of the application can bring the following beneficial effects:
in a screen projection state, a user can edit a screen projection editing area in a terminal, and under the condition that the screen projection editing area contains an object, object content corresponding to the object can be determined as screen projection content to be provided for screen projection equipment to perform screen projection display; on one hand, a user is allowed to edit the screen-casting editing area at the terminal, and the user can manually avoid privacy information or unnecessary display information in a user interface in the process of editing the screen-casting editing area, so that the screen-casting display of the unnecessary privacy information can be avoided while the normal screen-casting display is realized, and the safety of terminal information is improved; on the other hand, when only the object is included in the screen projection editing area, the object content corresponding to the object can be projected into the screen projection device, the object content does not need to be framed and selected through the screen projection editing area, and the screen projection efficiency of the screen projection content framed and selected through the screen projection editing area can be improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 illustrates a schematic diagram of an implementation environment of an exemplary embodiment of the present application;
FIG. 2 illustrates a flow chart of a screen projection method provided by an exemplary embodiment of the present application;
FIG. 3 illustrates a screen projection process diagram shown in an exemplary embodiment of the present application;
FIG. 4 illustrates a flow chart of a screen projection method provided by another exemplary embodiment of the present application;
FIG. 5 is a diagram illustrating a screen-casting process corresponding to a scene including a target application icon in a screen-casting editing area;
FIG. 6 is a diagram illustrating a screen-casting process corresponding to a scene including a target file in a screen-casting editing area;
FIG. 7 is a diagram illustrating a screen-casting process corresponding to a scene including a target file in a screen-casting editing area;
FIG. 8 illustrates a flow chart of a screen projection method provided by another exemplary embodiment of the present application;
FIG. 9 is a diagram illustrating a process for adding an object in a drop-on editing area by a drag operation in accordance with an exemplary embodiment of the present application;
FIG. 10 illustrates a flow chart of a screen projection method provided by another exemplary embodiment of the present application;
fig. 11 illustrates a process of adding new projected content by adding a new projected editing region according to an exemplary embodiment of the present application;
FIG. 12 illustrates a complete flow chart of a screen projection process shown in an exemplary embodiment of the present application;
FIG. 13 illustrates a flow chart of a screen projection method provided by an exemplary embodiment of the present application;
FIG. 14 is a block diagram of a screen projection device according to an embodiment of the present application;
FIG. 15 is a block diagram of a projection device according to another embodiment of the present application;
fig. 16 shows a block diagram of a computer device according to an exemplary embodiment of the present application.
Detailed Description
To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
Referring to fig. 1, a schematic diagram of an implementation environment of an exemplary embodiment of the present application is shown, where the implementation environment includes a terminal 110 and a screen projection device 120.
The terminal 110 is a device having a screen projecting function. The terminal 110 may be an electronic device such as a desktop computer, a mobile phone, a smart watch, a tablet computer, an e-book reader, and the like.
In this embodiment, when the terminal 110 has a screen projection requirement, the screen projection function may be turned on, the screen projection device 120 is selected, and then screen projection data corresponding to the screen projection content is transmitted to the screen projection device 120. Optionally, in the screen projection process of this embodiment, the terminal only takes the object located in the screen projection editing area and the object content corresponding to the object as the screen projection content; and the screen-projected editing area can be edited.
The screen projection device 120 is a device having a screen projection function. The screen projection device 120 may be an electronic device such as a smart television, a projector, a desktop computer, and a tablet computer.
In this embodiment of the application, after the screen projection device 120 receives the screen projection data transmitted by the first terminal 110, the corresponding screen projection content may be displayed based on the screen projection data; optionally, when the screen-projecting object is newly added in the screen-projecting editing area by the terminal 110, the screen-projecting device 120 may simultaneously display the original screen-projecting content and the screen-projecting content corresponding to the newly added screen-projecting object.
Referring to fig. 2, a flowchart of a screen projection method provided in an exemplary embodiment of the present application is shown, where the method is applied to the terminal 110 shown in fig. 1 as an example, and the method includes:
step 201, in response to a first area editing operation in a screen projection state, determining a first screen projection editing area.
Different from the related art, in a screen projection state, a terminal transmits all displayed real-time pictures to screen projection equipment, so that unnecessary privacy information is possibly leaked.
In a possible implementation manner, when the terminal is in a screen projection state, a user is allowed to edit a screen projection region in a current user interface, the corresponding terminal receives a first region editing operation in the screen projection state, and a first screen projection editing region indicated by the region editing operation is determined based on the first region editing operation, so that the current user interface can be divided into a screen projection editing region and a non-screen projection region through the first screen projection editing region.
Optionally, the first area editing operation may be to draw any closed graph in the current user interface, where an area surrounded by the closed graph is the first screen projection editing area, and the closed graph may be a triangle, a circle, an ellipse, a rectangle, or the like, and the closed graph is not limited in the embodiment of the present application; or, the first area editing operation may also be to draw any line in the current user interface, where the any line divides the current user interface into two areas, and further designate any area as the first screen projection editing area, where the any line may be a straight line, a curved line, or the like, and the embodiment of the present application does not limit the any line.
Optionally, in order to avoid an influence on other trigger controls in the original user interface when performing the region editing operation, in a possible implementation manner, a screen-projecting region selection control is provided in the screen-projecting state, a user can enter the region editing state by triggering the screen-projecting region selection control, and in the region editing state, the other trigger controls are in a non-triggerable state, so that the other controls are prevented from being touched by mistake in the editing process of the screen-projecting editing region. Optionally, after the area editing operation is completed, the area editing state may also be exited, and the user may correspondingly trigger other trigger controls outside the screen-projection editing area to perform other terminal operations normally.
As shown in fig. 3, a screen projection process diagram according to an exemplary embodiment of the present application is shown. In a screen projection state, a screen projection region selection control 302 is displayed in the user interface 301, and a user can trigger the screen projection editing region to be drawn in the user interface 301 by selecting the screen projection region selection control 302; when the terminal receives the region editing operation, a first screen-casting editing region 303 indicated by the region editing operation is displayed in the user interface 301.
Step 202, under the condition that the first screen-casting editing area contains the first object, determining the first object content corresponding to the first object as the first screen-casting content.
In a possible implementation manner, when the user generally selects to select a content frame to be projected into the first screen projection editing area during the (first) area editing operation, correspondingly, when the terminal determines that the first screen projection editing area includes the first object, the first object and the first object content corresponding to the first object are determined as the first screen projection content.
Optionally, in other possible embodiments, the first object is not originally located in the first screen-casting editing area, the first object may be dragged into the first screen-casting editing area through a dragging operation, and the process of including the first object in the first screen-casting editing area may be: when a first screen-casting editing area is displayed in a user interface, at the moment, the first screen-casting editing area does not contain a first object, the user drags the first object to the first screen-casting editing area, the corresponding terminal receives dragging operation of the first object, and when the dragging operation is stopped, the first object is located in the first screen-casting editing area, and then the first object is determined to be contained in the first screen-casting editing area.
Optionally, the first screen-casting editing area may also be dragged to include the first object, and the process of correspondingly making the first screen-casting editing area include the first object may be: the method includes the steps that under the condition that a first screen-casting editing area is displayed in a user interface, at the moment, a first object is not included in the first screen-casting editing area, a user drags the first screen-casting editing area to enable the first screen-casting editing area to include the first object, a corresponding terminal receives dragging operation of the first screen-casting editing area, and whether the first object is included in the first screen-casting editing area when the dragging operation is stopped is determined.
In order to further improve the efficiency of selecting the screen-shot content through the screen-shot editing area for screen-shooting, when the screen-shot editing area contains the first object, the first object contained in the screen-shot editing area can be displayed in a screen-shot mode, and the first object content corresponding to the first object can also be displayed in a screen-shot mode, and the first object content is not completely contained in the first screen-shot editing area. Illustratively, taking the first object as the application icon a of the application program a as an example, when the first screen projection editing area includes the application icon a, the application icon a may be displayed as screen projection content, and when the application program a corresponding to the application icon a is started and displays the application interface, even if the first screen projection editing area cannot include the application interface, the application interface may still be displayed as screen projection content.
As shown in fig. 3, a calendar application icon 304 is displayed in the first screen-casting editing area 303, and a calendar application corresponding to the calendar application icon 304 is determined as the first screen-casting content.
Optionally, when the first screen projection editing area includes two or more first objects, the first object contents corresponding to the first objects are all used as the first screen projection contents, so that the screen projection device can simultaneously display the first object contents corresponding to the plurality of first objects.
Optionally, the first object may be any object displayed in the current user interface, and may be an application icon, a tool icon, a picture, a document, a table, a floating window, and the like.
And step 203, transmitting the first screen projection content to the screen projection equipment so that the screen projection equipment can display the first screen projection content.
In a possible implementation manner, after the terminal determines the first screen projection content, the first screen projection content may be transmitted to the screen projection device, so that the screen projection device displays the first screen projection content after receiving the first screen projection content.
As shown in fig. 3, when the screen-cast content is determined, the terminal may transmit the screen-cast content to the screen-cast device so that the screen-cast device displays a calendar application icon 304 in the device interface 305. Optionally, after the user starts the calendar application program, a corresponding calendar application interface corresponding to the calendar application program may be displayed in the device interface 305.
To sum up, in the embodiment of the present application, in the screen-projecting state, a user may edit a screen-projecting editing area in a terminal, and in the case that an object is included in the screen-projecting editing area, object content corresponding to the object may be determined as screen-projecting content, so as to be provided to a screen-projecting device for screen-projecting display; on one hand, a user is allowed to edit the screen-casting editing area at the terminal, and the user can manually avoid privacy information or unnecessary display information in a user interface in the process of editing the screen-casting editing area, so that the screen-casting display of the unnecessary privacy information can be avoided while the normal screen-casting display is realized, and the safety of terminal information is improved; on the other hand, when only the object is included in the screen projection editing area, the object content corresponding to the object can be projected into the screen projection device, the object content does not need to be framed and selected through the screen projection area, and the screen projection efficiency of screen projection through the screen projection editing area for framing and selecting the screen projection content can be improved.
In the screen projection process, not only the objects contained in the screen projection editing area are projected to the screen projection device, but also the corresponding object contents can be displayed as the screen projection contents, that is, the first object contents can be the objects themselves or specific object contents, and the selection of different first object contents is determined according to the screen projection state of the current object, for example, a user drags the application icon to the screen projection editing area, and opens the application interface of the application program corresponding to the application icon, which indicates that the user needs to display the application interface in the screen projection device in a screen projection manner, and the screen projection state at this time indicates that the application interface needs to be determined as the screen projection contents.
Referring to fig. 4, a flowchart of a screen projection method provided in another exemplary embodiment of the present application is shown, where the method is applied to the terminal 110 shown in fig. 1 as an example, and the method includes:
step 401, determining a first screen projection editing area in response to a first area editing operation in a screen projection state.
In a possible implementation manner, after the terminal receives a first area editing operation in a screen projection state, a first screen projection editing area can be determined according to the first area editing operation, and then the first screen projection editing area is displayed in the user interface.
Optionally, in order to avoid an influence of the subsequent first screen projection editing region on normal use of the current user interface, when the first screen projection editing region is displayed in the user interface, a layer may be newly added on an upper layer of the user interface, and the first screen projection editing region is displayed on the newly added layer, so that the first screen projection editing region is displayed on the upper layer of the user interface.
Optionally, in order to distinguish the first screen-projection editing area from the non-screen-projection area in the current user interface, the first screen-projection editing area may be displayed in a semi-transparent or fully-transparent manner, or a special line type, such as a dotted line, a bold solid line, or the like, may be used to set an area outline of the first screen-projection editing area.
Step 402, under the condition that the first object is contained in the first screen projection editing area, determining the screen projection state of the first object, wherein the screen projection state is determined by the running state of the first object.
In a possible implementation manner, when the first object is included in the first screen projection editing area, the first object itself may be directly determined as the first screen projection content for screen projection display, or the object content corresponding to the first object may be screen projection displayed as the first screen projection content.
In order to determine the object content (first screen projection content) of the first object transmitted to the screen projection device, in one possible implementation, the current screen projection state of the first object may be determined according to the running state of the first object, and then the first object content required to be subjected to screen projection is determined; for example, when the first object is an application icon, the screen-projecting content of the first object may be the application icon, or may be an application interface of an application program corresponding to the application icon, and how to specifically determine whether the screen-projecting application icon or the application interface is the screen-projecting application icon or the application interface needs to be determined based on the running state of the first object, when the application program indicated by the application icon is in a closed state, the screen-projecting application icon may only be needed, and if the application program indicated by the application icon is in an open state, an application interface may be displayed, and the screen-projecting application interface may be needed.
Step 403, determining first object contents corresponding to the first object based on the screen projection states, wherein different screen projection states correspond to different first object contents.
In a possible implementation manner, the first object content corresponding to the first object may be determined according to the screen projection state corresponding to the first object, and then different first object contents may be displayed as screen projection contents in a screen projection manner.
In this embodiment, the first object is taken as an application icon, a file, and a floating window to respectively illustrate the content of the first object (first screen projection content) corresponding to the first object in different screen projection states.
Aiming at a scene with a first object as a target application icon, when the first screen projection editing area contains the target application icon, the target application icon can be displayed in a screen projection mode, and an application interface of an application program corresponding to the target application icon can also be displayed in a screen projection mode; the specific content displayed by screen projection depends on the application running state of the application corresponding to the target application icon, for example, when the application is in an application closing state, the user does not have the screen projection requirement of the application interface, and only the target application icon can be displayed by screen projection; when the application is in the application starting state, the screen projection requirement of the application interface is met, and the application interface can be displayed in a screen projection mode; the corresponding step 402 may be replaced with step 402A and step 403 may include step 403A and step 403B.
Step 402A, determining the application running state of the first application corresponding to the target application icon as the screen projection state under the condition that the first screen projection editing area contains the target application icon.
In a possible implementation manner, when the first screen projection editing area contains the target application icon, the application running state of the first application corresponding to the target application icon can be determined as the screen projection state; then, the screen projection state corresponding to the corresponding target application icon includes: the method comprises the steps of obtaining an application opening state and an application closing state, wherein the application opening state represents that a first application corresponding to a target application icon is a screen projection focus object; and the application closing state indicates that the first application corresponding to the target application icon is not the screen-projection focus object.
In step 403A, when the application running state of the first application is the application open state, the first application interface corresponding to the first application is determined as the first object content.
In a possible implementation manner, when the application running state of the first application is the application starting state, the first application interface corresponding to the first application can be determined as first object content for screen projection display.
Optionally, when the application running state of the first application is the application opening state, the first application may be in a foreground running state or a background running state, and when the first application is in the foreground running state, the first application interface is an application interface currently displayed by the first application; when the first application is in the background running state, the first application interface is switched to the application interface displayed before the background running. Therefore, when the first application is in the application opening state, even if the first application is switched to the background operation, the screen projection device can correspondingly display the corresponding first application interface.
In order to implement that the application interface of the application corresponding to the application icon can be displayed on the screen projection device in a screen projection manner under the condition that the screen projection editing area contains the application icon, in a possible implementation manner, under the condition that the first screen projection editing area contains the target application icon, a screen projection mark can be added to the first application corresponding to the target application icon, so that whether the application interface is displayed in a screen projection manner or not can be determined according to the screen projection mark in the following process.
Optionally, when the terminal displays the first application interface and determines that the first application equipment screen projection mark corresponding to the first application interface is present, determining the first application interface corresponding to the first application interface as the first object content, and further displaying the first application interface screen projection in the screen projection equipment; whether the application interface is required to be displayed in a screen projection mode can be distinguished based on the screen projection mark, the first application interface is not required to be displayed in the first screen projection editing area, and only the application icon of the application corresponding to the application interface is required to be included in the first screen projection editing area.
In step 403B, when the application running state of the first application is the application closing state, determining a target application icon corresponding to the first application as the first object content.
In a possible implementation manner, when the first screen projection editing area includes a target application icon corresponding to a first application and the user does not open the first application corresponding to the target application icon, the terminal does not display the first application interface of the first application, which indicates that the user does not have a requirement for screen projection of the first application interface temporarily, and only the target application icon located in the first screen projection editing area may be used as screen projection content.
As shown in fig. 5, it is a schematic diagram of a screen-casting process corresponding to a scene containing a target application icon in a screen-casting editing area. When the first screen-casting editing area 501 contains the album application icon 502 and the album application corresponding to the album application icon 502 is not opened, the album application icon 502 is displayed in the screen casting interface 503 corresponding to the screen casting device; optionally, when the user triggers the album application icon 502 to open the album application, the terminal displays an album interface 504 corresponding to the album application, and the screen casting interface 503 corresponding to the screen casting device displays the album interface 504.
When the screen-casting editing area contains the target application icon, the first application corresponding to the target application icon may be an instant messaging application, and the instant messaging application may receive an unread message during screen casting, in order to avoid that the unread message is automatically and synchronously displayed in real time in the screen casting device during screen casting, in one possible implementation manner, when the first application has the unread message and receives the viewing operation of the user on the unread message, the user manually allows the unread message to be synchronously projected on the screen, the message viewing interface corresponding to the unread message is correspondingly determined as the first screen casting content, and the unread message is displayed in the screen casting device.
Optionally, when the unread message exists in the first application and the viewing operation for the unread message is not received, which indicates that the user does not have a requirement for screen projection to display the unread message, the message viewing interface corresponding to the unread message is stopped from being determined as the first screen projection content, and the unread message is not displayed in the screen projection device, so that the problem of leakage of the user privacy information in the screen projection display process of the first application is avoided.
For a first object, which is a target file scene, a screen projection state of the target file may be affected by an open state and a closed state of the target file, for example, when the target file is in the open state, a target file content corresponding to the target file is displayed on a corresponding screen projection; if the target file is in a closed state, displaying a target file icon corresponding to the target file corresponding to the projection screen; the corresponding step 402 may be replaced with step 402B and step 403 may include step 403C and step 403D.
Step 402B, determining the file use state of the target file as the screen projection state under the condition that the first screen projection editing area contains the target file.
In a possible implementation manner, when the first screen projection editing area contains the target file, the file use state corresponding to the target file can be determined as the screen projection state; then the screen projection state corresponding to the corresponding target file includes: the method comprises the steps of a file closing state and a file opening state, wherein the file opening state indicates that a target file is a screen projection focus object; and the file closed state indicates that the target file is not a screen focus object.
Alternatively, the target file may be a target picture, a target document, a target form, a target folder, or the like.
For the situation that the first screen-casting editing area contains the target file, the target file located in the application interface corresponding to the second application is dragged to the first screen-casting editing area manually by a user, and then the first screen-casting editing area contains the target file; or when the second application-corresponding application interface contains the target file, the user selects the target file through the first screen-casting editing area frame when performing area editing operation.
In step 403C, when the file use status of the target file is the file open status, the target file content corresponding to the target file is determined as the first object content.
In a possible embodiment, when the file use state of the target file is the file open state, the target file content corresponding to the target file is determined as the first target content for screen-casting display.
In an exemplary example, if the target file included in the screen-casting editing area is a "schedule", when the user opens the "schedule", the table content corresponding to the "schedule" is determined as the screen-casting content.
In step 403D, when the file use status of the target file is the file close status, the target file icon corresponding to the target file is determined as the first object content.
In a possible embodiment, when the file use state of the target file is the file closed state, the target file icon corresponding to the target file is determined as the first target content (the first screen projection content) to display the screen projection.
In an exemplary example, if the target file included in the screen-casting editing area is "schedule", when the user does not open the "schedule", only the "schedule" icon included in the screen-casting editing area is determined as the screen-casting content.
As shown in fig. 6, it is a schematic diagram of a corresponding screen-casting process in a scene containing a target file in a screen-casting editing area; when the application interface 601 includes the target file 602, if the user has a need to display the target file 602 by screen-casting, the target file 602 can be directly dragged to the screen-casting editing area 603 along the direction indicated by the arrow; when the user does not open the target file 602, a file icon corresponding to the target file 602 is displayed in a screen projection interface 604 corresponding to the screen projection device; when a user opens the target file 602, file content 605 corresponding to the target file 602 is displayed in a user interface, and the file content 605 is also displayed in a screen projection interface 604 corresponding to the screen projection device; it can be seen that although the target file 602 belongs to the application interface 601, no relevant content related to the application interface 601 is displayed in the whole screen projection process.
Aiming at a scene that a first object is a target floating window, when the target floating window does not display an application interface, the target floating window can be displayed in the form of a floating window icon, the floating window icon is correspondingly used as screen projection content, when the target floating window displays the application interface, the application interface is used as screen projection display content, and the first object is a target application icon; the corresponding step 402 may be replaced with step 402C, and step 403 may include step 403E and step 403F.
And step 402C, determining the floating window display state of the target floating window as the screen projection state under the condition that the first screen projection editing area contains the target floating window.
In a possible implementation manner, in the case that the first screen-projection editing area contains the target floating window, the floating window display state of the target floating window can be determined as the screen-projection state; then, the screen projection state corresponding to the corresponding target floating window includes: the method comprises the steps of displaying an application interface, wherein the application interface is not displayed and is displayed, and the target floating window is a screen-projecting focus object; and the undisplayed application interface indicates that the target floating window is not the screen focus object.
And step 403E, under the condition that the floating window display state indicates that the second application interface is displayed in the target floating window, determining the second application interface as the first object content.
In a possible embodiment, when the floating window display state indicates that a second application interface is displayed in the target floating window, the second application interface is determined as the first object content for screen projection display.
And step 403F, under the condition that the floating window display state indicates that the second application interface is not displayed in the target floating window, determining a target floating window icon corresponding to the target floating window as the first object content.
In a possible embodiment, when the floating window display state indicates that the second application interface is not displayed in the target floating window, the target floating window icon corresponding to the target floating window is determined as the first object content (first screen projection content) for screen projection display.
As shown in fig. 7, it is a schematic diagram of a screen-casting process corresponding to a scene containing a target file in a screen-casting editing area. The first screen projection editing area 701 comprises a target floating window 702, and when an application interface is not displayed in the target floating window, only a floating window icon corresponding to the target floating window 702 is displayed in a screen projection interface 703 corresponding to the corresponding screen projection equipment; when the video chat interface 704 is displayed in the target floating window, the video chat interface 704 is correspondingly displayed in the screen-projecting interface 703 corresponding to the screen-projecting device.
In step 404, the first object content is determined as the first screen shot content.
In a possible implementation manner, after the terminal determines first object content to be subjected to screen projection display according to a screen projection state of the first object, the terminal further generates first screen projection content based on the first object content to transmit to the screen projection equipment for screen projection display.
Step 405, transmitting the first screen projection content to the screen projection device so that the screen projection device can display the first screen projection content.
The implementation manner of step 405 may refer to the above embodiments, which are not described herein.
In a possible application scenario, when a user does not need to continue to screen-project and display a first object content corresponding to a first object, the first object may be moved out of a first screen-projecting editing area, and a corresponding terminal receives a move-out operation of the first object in the first screen-projecting editing area, and then a screen-projection stopping instruction may be sent to a screen-projecting device, so that the screen-projecting device stops displaying the first screen-projecting content including the first object content based on the screen-projection stopping instruction.
Optionally, when the terminal is in the screen projection state, the user may normally operate the object outside the (first) screen projection editing region in the terminal, and the object may not be displayed in the screen projection device. That is, the screen projection device only displays the object content corresponding to the object in the (first) screen projection editing area, taking the first correspondence as the application icon as an example, the screen projection device only displays the activity of the application corresponding to the application icon in the screen projection editing area, and even if the application is switched to the background operation, the screen projection device also displays the application interface of the application; the screen projection editing area is equivalent to a small electronic fence, only the application and the activities in the fence can be displayed on the screen projection equipment, and the application which is positioned outside the fence and is not surrounded by the closed area, namely the application without the screen projection mark is added, so that the screen projection equipment cannot display even if the screen is displayed on a terminal screen at the moment.
Optionally, because the screen-casting content displayed by the screen-casting device only has a direct relationship with the first object in the screen-casting editing area, but does not have a direct relationship with the real-time display screen of the terminal user interface, when the application program corresponding to the first object is switched to run in the background, the first object content corresponding to the first object is continuously determined as the first screen-casting content, that is, the first object content corresponding to the first object is kept displayed in the screen-casting device.
In this embodiment, the screen-projecting state of the first object in the first screen-projecting editing area is determined to determine the first screen-projecting content displayed in the screen-projecting device, so that the user can manually determine the screen-projecting content in real time without affecting the user to continue using other applications in the non-screen-projecting editing area; in addition, when the screen is projected to display the application interface, the whole application interface does not need to be enclosed in a screen projection editing area, and only the application icon corresponding to the application interface is dragged to the screen projection editing area, so that the efficiency of displaying the application interface by projecting the screen is improved; in addition, for the application which is on screen projection display, if unread messages are received, the unread messages cannot be automatically on screen projection display, screen projection display is carried out when the user manually checks the unread messages, and privacy information can be prevented from being leaked while an application interface is displayed on screen projection display.
In other possible implementations, the screen-projecting editing area may include two or more objects, that is, on the premise that the screen-projecting editing area includes the first object, if a user needs to add screen-projecting content to the screen-projecting device, a second object may be added to the screen-projecting editing area in the terminal correspondingly, so that the screen-projecting device simultaneously projects and displays object contents corresponding to the first object and the second object, respectively.
Referring to fig. 8, a flowchart of a screen projection method provided in another exemplary embodiment of the present application is shown, where the method is applied to the terminal 110 shown in fig. 1 as an example, and the method includes:
step 801, responding to a first area editing operation in a screen projection state, and determining a first screen projection editing area.
Step 802, in the case that the first screen projection editing area includes the first object, determining the first object content corresponding to the first object as the first screen projection content.
And step 803, transmitting the first screen projection content to the screen projection device so that the screen projection device can display the first screen projection content.
The embodiments of steps 801 to 803 may refer to the above embodiments, which are not described herein.
Step 804, receiving a drag operation on the second object.
In a possible implementation manner, the second object can be newly added in the first screen projection editing area by dragging the second object to the first screen projection editing area, so that the purpose that the screen projection equipment simultaneously projects and displays the contents of the first object and the second object corresponding object is achieved.
Optionally, in order to avoid an influence on other objects in the current user interface in the process of dragging the second object, the screen-casting area editing state may be re-entered, and then, in the screen-casting area editing state, the dragging operation on the second object is executed, and the corresponding terminal receives the dragging operation on the second object.
In step 805, a target position where the second object is located when the dragging operation is stopped is determined.
In a possible implementation manner, after the terminal receives the dragging operation on the second object and when the dragging operation is stopped, the target position where the second object is located is determined, and whether to add the second object in the first screen-casting editing area is determined based on the target position and the position of the first screen-casting editing area.
Step 806, under the condition that the target position is located in the first screen-casting editing area, determining second object content corresponding to the second object as second screen-casting content.
In a possible implementation manner, when the target position is located in the first screen-projection editing area, it is determined that a second object is newly added in the first screen-projection editing area, and second object content corresponding to the second object may be determined as second screen-projection content, so as to perform a subsequent screen-projection display process.
Optionally, if the target position is not located in the first screen-projection editing area, adding the second object in the first screen-projection editing area fails, and the dragging operation is required to be executed again by the user corresponding to the invalid dragging operation.
It should be noted that, the second object is dragged to the first screen-casting editing area in the screen-casting state, the dragging operation is only temporarily used for screen casting, after the screen casting is finished, the second object is still displayed at the position before the second object is not dragged, and the dragging operation does not affect the original display position of the second object.
In step 807, the second screen projection content is transmitted to the screen projection device, so that the screen projection device displays the second screen projection content while displaying the first screen projection content.
In a possible implementation manner, under the condition that the first screen projection editing area already contains the first object and the corresponding screen projection device already displays the first screen projection content corresponding to the first object, after the user adds the second object in the first screen projection editing area through dragging operation, the terminal correspondingly determines the second object content corresponding to the second object as the second screen projection content and transmits the second object content to the screen projection device, and at this time, the screen projection device can simultaneously display the first screen projection content and the second screen projection content, so that screen projection contents from different objects can be simultaneously displayed.
Fig. 9 is a schematic diagram illustrating a process of adding an object to a screen-shot editing area through a drag operation according to an exemplary embodiment of the present application. A first screen projection editing area 902 is displayed in the user interface 901, and the first screen projection editing area contains a first object 903; a first object 903 is displayed in a screen projection interface 905 corresponding to the screen projection equipment; when a new second object 904 needs to be added, the second object 904 can be dragged in the direction indicated by the arrow to the first screen-casting editing area 902, so that the first screen-casting editing area 902 includes the first object 903 and the second object 904, and the first object 903 and the second object 904 are simultaneously displayed in the screen-casting interface 905 corresponding to the screen-casting device.
In this embodiment, by dragging the second object to the existing screen projection editing area (the first screen projection editing area), and by adding an object in the first screen projection editing area (the existing screen projection editing area), newly adding screen projection content in the screen projection device can be realized; and the newly added screen projection content does not influence the display of the original screen projection content, and the common display of the screen projection content corresponding to a plurality of objects can be realized.
In other possible scenarios, if the distance between the first screen projection editing area and the second object is long, for example, the first screen projection editing area is located on the first screen of the terminal desktop, the second object is located on the third screen of the terminal desktop, the second object needs to be dragged to the first screen from the third screen and then to the first screen-throwing editing area by dragging the second object to the first screen-throwing editing area, and multiple dragging operations are needed, which is complicated, so as to reduce the operation cost of adding the second object in the screen-throwing editing area, in one possible implementation, the second screen-shot editing region may be redrawn, such that the second screen-shot editing region contains the second object, the terminal can automatically fuse the first screen projection editing area and the second screen projection editing area, and further achieve the purpose that the newly added second object corresponds to the second screen projection content.
In an exemplary example, on the basis of fig. 8, as shown in fig. 10, steps 804 to 807 may be replaced with steps 1001 to 1003.
Step 1001, in response to a second area editing operation in the screen projection state, determining a second screen projection editing area.
In order to improve the operation efficiency of the newly added second object corresponding to the second screen projection content, in a possible implementation manner, the corresponding terminal receives the second area editing operation in the screen projection state by newly adding the second screen projection editing area to include the second object, and determines the second screen projection editing area based on the second area editing operation.
Step 1002, fusing the first screen projection editing area and the second screen projection editing area to generate a third screen projection editing area under the condition that the second screen projection editing area contains the second object, and determining second object content corresponding to the second object as second screen projection content.
Optionally, for a process of implementing that the second screen projection editing area includes the second object, the user may draw the second screen projection editing area around the second object, the corresponding terminal receives the second area editing operation, and displays the second screen projection editing area generated based on the second area editing operation, where the second screen projection editing area includes the second object; or the user may draw any second screen projection editing area (the second screen projection editing area may not include the second object) in the user interface on which the second object is displayed, and then drag the second object to the second screen projection editing area.
In a possible implementation manner, when the second screen projection editing area contains the second object, the terminal automatically fuses the first screen projection editing area and the second screen projection editing area to generate a third screen projection editing area, wherein the third screen projection editing area can contain the first object and the second object; and when the third screen projection editing area is generated, second object content corresponding to the second object can be determined as second screen projection content.
And step 1003, transmitting the second screen projection content to the screen projection equipment so that the screen projection equipment displays the second screen projection content while displaying the first screen projection content.
In a possible implementation manner, after the terminal fuses the first screen projection editing area and the second screen projection editing area to generate a third screen projection editing area including the first object and the second object, the terminal correspondingly determines second object content corresponding to the second object as second screen projection content and transmits the second screen projection content to the screen projection device, and then the screen projection device displays the first screen projection content and the second screen projection content at the same time, so that screen projection contents from different objects can be displayed at the same time.
As shown in fig. 11, a process of adding a new screen shot content by adding a new screen shot editing area according to an exemplary embodiment of the present application is shown. A first screen projection editing area 1102 is displayed in the user interface 1101, and the first screen projection editing area 1102 contains a first object 1103, so that the first object 1103 is displayed in a screen projection interface 1104 corresponding to the screen projection device; when a user adds a second object 1105 newly, a second screen projection editing area 1106 can be drawn to include the second object 1105, the terminal automatically fuses the first screen projection editing area 1102 and the second screen projection editing area 1106 to obtain a third screen projection editing area 1107, the third screen projection editing area 1107 includes a first object 1103 and a second object 1105, and a screen projection interface 1104 corresponding to a screen projection device simultaneously displays the first object 1103 and the second object 1105.
For the two provided modes of adding the second screen projection content, the user can select the second screen projection content at will according to needs, and if the second object is closer to the first screen projection editing area, for example, the second object and the first screen projection editing area are located in the same user interface, the mode of dragging the second object to add the second screen projection content can be adopted; if the second object is far away from the first screen projection editing area, for example, the second object and the first screen projection editing area are located on different user interfaces, a mode of adding a new screen projection editing area to include the second object and further adding second screen projection content may be adopted.
In this embodiment, the second screen projection editing area including the second object may be redrawn, and the first screen projection editing area and the second screen projection editing area are fused, so that the fused screen projection editing area may include the first object and the second object at the same time, and the purpose of displaying the second screen projection content corresponding to the newly added second object in the screen projection device is further achieved. Meanwhile, by adding the screen-throwing editing area, the operation cost of newly adding objects in the screen-throwing editing area through dragging operation under the condition that the distance between the second object and the first screen-throwing editing area is far can be avoided, and the operation efficiency of newly adding screen-throwing contents is further improved.
Referring now to fig. 12, therein is shown a complete flow chart of a screen projection process in accordance with an exemplary embodiment of the present application.
Step 1201, the user selects screen projection.
Step 1202, the terminal enters a screen projection state and waits for a user to select a screen projection editing area.
At step 1203, the user draws a closed area around application a whose screen needs to be projected to contain application a.
Wherein, the closed area is the screen-shot editing area.
Step 1204, screen-casting the application in the closed area and the content displayed by the application to the screen-casting device
Step 1205, whether application B is adjacent to application a.
In step 1206, a closed area is drawn at the location of application B to contain application B.
Step 1207, fusing the closed areas of the application A and the application B and projecting the screen to display the application A, the application B and the corresponding application content.
And step 1208, dragging the application B into the closed area corresponding to the application A.
Step 1209, the screen projection displays the application A, the application B and the corresponding application content.
And step 1210, ending screen projection and exiting the screen projection state.
In the above embodiment, the terminal is used as the execution subject to describe the screen projection process, and in the embodiment, the screen projection device is mainly used as the execution subject to describe the process of how the screen projection device displays each screen projection content.
Referring to fig. 13, a flowchart of a screen projection method provided in an exemplary embodiment of the present application is shown, where the embodiment of the present application takes the method as an example applied to the screen projection device 120 shown in fig. 1, and the method includes:
step 1301, receiving first screen projection content sent by the terminal in the screen projection state, wherein the first screen projection content is determined based on first object content corresponding to a first object contained in a first screen projection editing area of the terminal, and the first screen projection editing area is determined based on first area editing operation in the screen projection state of the terminal.
In a possible implementation manner, when both the terminal and the screen projecting device are in the screen projecting state, a user draws a first screen projecting editing area in the terminal through a first area editing operation in the terminal, determines first object content corresponding to a first object as first screen projecting content under the condition that the first screen projecting editing area contains the first object, transmits the first object content to the screen projecting device, and the corresponding screen projecting device receives the first screen projecting content sent by the terminal.
Step 1302, displaying the first screen projection content.
In a possible implementation manner, the screen projection device may receive a first screen projection content sent by the terminal in the screen projection state, and display the first screen projection content according to the first screen projection content.
The determination process of the first screen projection content may refer to the screen projection method at the terminal side in the above embodiments, which is not described herein again.
In other possible scenes, when a user needs to newly add screen-projecting content, the screen-projecting device receives a screen-projecting content adding request and second screen-projecting content sent by the terminal, the screen-projecting device can simultaneously display the first screen-projecting content and the second screen-projecting content, and the display of the first screen-projecting content is not influenced while the second screen-projecting content is displayed.
The screen-casting content adding request may be triggered when a second object is newly added in the first screen-casting editing area, and corresponds to a process of adding the second object in the first screen-casting editing area through a dragging operation in the above embodiment; or triggered by adding a second screen-projecting editing area, corresponding to the process of adding a second object corresponding to the second screen-projecting content by adding the second screen-projecting editing area. For a specific process of adding the second object corresponding to the second screen projection content, reference may be made to the foregoing embodiment, which is not described herein again.
Optionally, when the first screen projection content and the second screen projection content are displayed simultaneously, the screen projection device may display the first screen projection content and the second screen projection content in different regions, or may display the first screen projection content and the second screen projection content in different windows, so as to distinguish the screen projection contents corresponding to different objects.
According to the mode of displaying each screen projection content in a partitioned manner, the screen projection equipment can divide the display area into a first display area and a second display area, so that the first screen projection content is displayed in the first display area, and the second screen projection content is displayed in the second display area.
Optionally, the areas of the first display area and the second display area may be the same or different, for example, may be determined according to the display size of the screen projection content to be displayed.
For the way of displaying the first screen-projecting content and the second screen-projecting content in the split windows, the screen-projecting device may generate a first display window and a second display window, display the first screen-projecting content in the first display window, and display the second screen-projecting content in the second display window.
Optionally, the window sizes of the first display window and the second display window may be the same or different, for example, the window sizes may also be determined according to the amount of the screen-casting content that needs to be displayed.
In summary, in the embodiment, in the screen-projecting state, the user may edit the screen-projecting editing area in the terminal, and in the case that the screen-projecting editing area includes the object, the object content corresponding to the object may be determined as the screen-projecting content, so as to be provided to the screen-projecting device for screen-projecting display; on one hand, a user is allowed to edit the screen-casting editing area at the terminal, and the user can manually avoid privacy information or unnecessary display information in a user interface in the process of editing the screen-casting editing area, so that the screen-casting display of the unnecessary privacy information can be avoided while the normal screen-casting display is realized, and the safety of terminal information is improved; on the other hand, when only the object is included in the screen projection editing area, the object content corresponding to the object can be projected into the screen projection equipment, the object content does not need to be framed and selected through the screen projection editing area, and the screen projection efficiency of screen projection through the screen projection editing area; in addition, when the screen projection equipment displays the newly-added screen projection content, the newly-added screen projection content and the original screen projection content can be displayed simultaneously, so that the display of the original screen projection content cannot be influenced when the newly-added screen projection content is displayed.
The following are embodiments of the apparatus of the present application that may be used to perform embodiments of the method of the present application. For details which are not disclosed in the embodiments of the apparatus of the present application, reference is made to the embodiments of the method of the present application.
Referring to fig. 14, a block diagram of a screen projection device according to an embodiment of the present application is shown. The device has the function executed by the terminal side in the embodiment of the method, and the function can be realized by hardware or by hardware executing corresponding software. As shown in fig. 14, the apparatus may include:
an editing module 1401, which includes a first screen-projection editing area determined in response to a first area editing operation in a screen-projection state;
a determining module 1402, configured to determine, when a first object is included in the first screen-casting editing area, first object content corresponding to the first object as first screen-casting content;
a sending module 1403, which includes transmitting the first screen projection content to a screen projection device, so that the screen projection device displays the first screen projection content.
Optionally, the determining module 1402 is further configured to:
determining a screen projection state of the first object under the condition that the first object is contained in the first screen projection editing area, wherein the screen projection state is determined by the running state of the first object;
determining the first object content corresponding to the first object based on the screen projection state, wherein different screen projection states correspond to different first object contents;
determining the first object content as the first screen shot content.
Optionally, the first object is a target application icon;
the determining module 1402 is further configured to:
determining the application running state of a first application corresponding to the target application icon as the screen projection state under the condition that the target application icon is included in the first screen projection editing area;
the determining module 1402 is further configured to:
determining a first application interface corresponding to the first application as the first object content under the condition that the application running state of the first application is an application opening state;
and determining the target application icon corresponding to the first application as the first object content when the application running state of the first application is an application closing state.
Optionally, the apparatus further comprises:
the adding module is used for adding a screen projection mark to the first application corresponding to the target application icon under the condition that the first screen projection editing area contains the target application icon;
the determining module 1402 is further configured to:
and under the condition that the first application interface is displayed and the first application corresponding to the first application interface is determined to be provided with the screen projection mark, determining the first application interface corresponding to the first application as the first object content.
Optionally, the apparatus further comprises:
the determining module 1402 is further configured to determine, in response to that the first application has an unread message and a viewing operation for the unread message is received, a message viewing interface corresponding to the unread message as the first screen projection content;
the determining module 1402 is further configured to, in response to that the first application has the unread message and no viewing operation for the unread message is received, stop determining the message viewing interface corresponding to the unread message as the first screen projection content.
Optionally, the first object is a target file, and the target file is dragged to the first screen-casting editing area by an application interface of a second application;
the determining module 1402 is further configured to:
determining the file use state of the target file as the screen projection state under the condition that the first screen projection editing area contains the target file;
the determining module 1402 is further configured to:
determining the target file content corresponding to the target file as the first object content under the condition that the file using state of the target file is a file opening state;
and under the condition that the file use state of the target file is a file closing state, determining a target file icon corresponding to the target file as the first object content.
Optionally, the first object is a target floating window;
the determining module 1402 is further configured to:
determining the floating window display state of the target floating window as the screen projection state under the condition that the first screen projection editing area contains the target floating window;
the determining module 1402 is further configured to:
determining a second application interface as the first object content under the condition that the floating window display state indicates that the second application interface is displayed in the target floating window;
and under the condition that the floating window display state indicates that the second application interface is not displayed in the target floating window, determining a target floating window icon corresponding to the target floating window as the first object content.
Optionally, the editing module 1401 is further configured to:
responding to the first area editing operation in the screen projection state, and displaying the first screen projection editing area on the upper layer of a user interface based on the first area editing operation.
Optionally, the apparatus further comprises:
the receiving module is used for receiving the dragging operation of the second object;
the determining module 1402 is further configured to determine a target position where the second object is located when the dragging operation is stopped;
the determining module 1402 is further configured to determine, when the target position is located in the first screen-projection editing area, second object content corresponding to the second object as second screen-projection content;
the sending module 1403 is further configured to transmit the second screen projection content to the screen projection device, so that the screen projection device displays the second screen projection content while displaying the first screen projection content.
Optionally, the apparatus further comprises:
the editing module 1401 is further configured to determine a second screen projection editing area in response to a second area editing operation in the screen projection state;
the generating module is used for fusing the first screen projection editing area and the second screen projection editing area to generate a third screen projection editing area under the condition that the second screen projection editing area contains a second object, and determining second object content corresponding to the second object as second screen projection content;
the sending module 1403 is further configured to transmit the second screen projection content to the screen projection device, so that the screen projection device displays the second screen projection content while displaying the first screen projection content.
Optionally, the apparatus further comprises:
the sending module 1403 is further configured to send a screen projection stopping instruction to the screen projection device in response to a move-out operation on the first object in the first screen projection editing area, so that the screen projection device stops displaying the first screen projection content based on the screen projection stopping instruction.
Optionally, the apparatus further comprises:
the determining module 1402 is further configured to continue to determine the first object content corresponding to the first object as the first screen-casting content when the application program corresponding to the first object is switched to run in the background.
To sum up, in the embodiment of the present application, in the screen-projecting state, a user may edit a screen-projecting editing area in a terminal, and in the case that an object is included in the screen-projecting editing area, object content corresponding to the object may be determined as screen-projecting content, so as to be provided to a screen-projecting device for screen-projecting display; on one hand, a user is allowed to edit the screen-casting editing area at the terminal, and the user can manually avoid privacy information or unnecessary display information in a user interface in the process of editing the screen-casting editing area, so that the screen-casting display of the unnecessary privacy information can be avoided while the normal screen-casting display is realized, and the safety of terminal information is improved; on the other hand, when only the object is included in the screen projection editing area, the object content corresponding to the object can be projected into the screen projection device, the object content does not need to be framed and selected through the screen projection editing area, and the screen projection efficiency of the screen projection content framed and selected through the screen projection editing area can be improved.
Referring to fig. 15, a block diagram of a screen projection device according to another embodiment of the present application is shown. The device has the function of realizing the execution of the screen projection equipment side in the method embodiment, and the function can be realized by hardware or by hardware executing corresponding software. As shown in fig. 15, the apparatus may include:
the receiving module 1501 is configured to receive a first screen projection content sent by a terminal in a screen projection state, where the first screen projection content is determined based on a first object content corresponding to a first object included in a first screen projection editing area of the terminal, and the first screen projection editing area is determined by a first area editing operation in the screen projection state of the terminal;
a display module 1502 is configured to display the first screen projection content.
Optionally, the apparatus further comprises:
the receiving module 1501 is further configured to receive, in response to a screen-casting content addition request, a second screen-casting content sent by the terminal, where the screen-casting content addition request is triggered by newly adding a second object in the first screen-casting editing region, or the screen-casting content addition request is triggered by newly adding a second screen-casting editing region, and the second screen-casting content is second object content corresponding to the second object;
the display module 1502 is further configured to display the first screen projection content and the second screen projection content.
Optionally, the display module 1502 is further configured to:
dividing a display area into a first display area and a second display area; displaying the first screen-shot content in the first display area and the second screen-shot content in the second display area;
or the like, or, alternatively,
generating a first display window and a second display window; displaying the first screen-projected content in the first display window, and displaying the second screen-projected content in the second display window.
In summary, in the embodiment, in the screen-projecting state, a user may edit the screen-projecting editing area in the terminal, and in the case that the screen-projecting editing area includes an object, the object content corresponding to the object may be determined as the screen-projecting content, so as to be provided to the screen-projecting device for screen-projecting display; on one hand, a user is allowed to edit the screen-casting editing area at the terminal, and the user can manually avoid privacy information or unnecessary display information in a user interface in the process of editing the screen-casting editing area, so that the screen-casting display of the unnecessary privacy information can be avoided while the normal screen-casting display is realized, and the safety of terminal information is improved; on the other hand, when only the object is included in the screen-casting editing area, the object content corresponding to the object can be cast into the screen-casting device, the object content does not need to be framed and selected through the screen-casting editing area, and the screen-casting efficiency of the screen-casting content framed and selected through the screen-casting editing area can be improved; in addition, when the screen projection equipment displays the newly-added screen projection content, the newly-added screen projection content and the original screen projection content can be displayed simultaneously, so that the display of the original screen projection content cannot be influenced when the newly-added screen projection content is displayed.
It should be noted that: in the above embodiment, when the device implements the functions thereof, only the division of the functional modules is illustrated, and in practical applications, the functions may be distributed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to implement all or part of the functions described above. In addition, the apparatus and method embodiments provided by the above embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments for details, which are not described herein again.
Referring to fig. 16, a block diagram of an electronic device 1600 according to an exemplary embodiment of the disclosure is shown. The electronic device 1600 may be the terminal or the screen projection device in the above embodiments. The electronic device 1600 in the present application may include one or more of the following components: memory 1620, processor 1610, and display 1630.
Processor 1610 may include one or more processing cores. The processor 1610, using various interfaces and circuitry, connects various components throughout the computer device 1600, performs various functions of the computer device 1600 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 1620, and invoking data stored in the memory 1620. Alternatively, the processor 1610 may be implemented in hardware using at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). Processor 1610 may integrate one or a combination of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing the content required to be displayed by the display screen 1630; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 1610, but may be implemented by a communication chip.
The Memory 1620 may include a Random Access Memory (RAM) and a Read-Only Memory (Read-Only Memory). Optionally, the memory 1620 comprises a non-transitory computer-readable storage medium. The memory 1620 may be used to store instructions, programs, code sets, or instruction sets. The memory 1620 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, and the like), instructions for implementing the above method embodiments, and the like, and the operating system may be an Android (Android) system (including a system based on Android system depth development), an IOS system developed by apple inc (including a system based on IOS system depth development), or other systems. The data storage area may also store data created during use by computer device 1600 (e.g., phone books, audio-visual data, chat log data), etc.
The display 1630 may be a capacitive touch display for receiving touch operations by a user on or near the user using any suitable object, such as a finger, stylus, etc., and displaying a user interface for various applications. A touch display screen is typically provided on the front panel of the computer device 1600. The touch display screen may be designed as a full-face screen, a curved screen, or a profiled screen. The touch display screen can also be designed to be a combination of a full-face screen and a curved-face screen, and a combination of a special-shaped screen and a curved-face screen, which is not limited in the embodiment of the present application.
In addition, those skilled in the art will appreciate that the configuration of the electronic device 1600 illustrated in the above-described figures does not constitute a limitation of the electronic device 1600, and that the electronic device may include more or fewer components than illustrated, or combine certain components, or arrange different components. For example, the computer device 1600 further includes a radio frequency circuit, a shooting component, a sensor, an audio circuit, a Wireless Fidelity (WiFi) component, a power supply, a bluetooth component, and other components, which are not described herein again.
The present application further provides a computer-readable storage medium having at least one instruction, at least one program, a set of codes, or a set of instructions stored therein, which is loaded and executed by a processor to implement the screen projection method provided by any of the above exemplary embodiments.
Embodiments of the present application provide a computer program product comprising computer instructions stored in a computer readable storage medium. The processor of the printing device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to execute the screen projection method provided in the above-mentioned alternative implementation.
It should be understood that reference herein to "a plurality" means two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. In addition, the step numbers described herein only show an exemplary possible execution sequence among the steps, and in some other embodiments, the steps may also be executed out of the numbering sequence, for example, two steps with different numbers are executed simultaneously, or two steps with different numbers are executed in a reverse order to the illustrated sequence, which is not limited in this application.
The above description is only exemplary of the present application and should not be taken as limiting, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims (20)

1. A screen projection method, which is executed by a terminal, comprises the following steps:
responding to a first area editing operation in a screen projection state, and determining a first screen projection editing area;
determining first object content corresponding to a first object as first screen projection content under the condition that the first screen projection editing area contains the first object;
transmitting the first screen projection content to a screen projection device so that the screen projection device displays the first screen projection content.
2. The method according to claim 1, wherein in a case that a first object is included in the first screen-shot editing area, determining first object content corresponding to the first object as first screen-shot content comprises:
determining a screen projection state of the first object under the condition that the first object is contained in the first screen projection editing area, wherein the screen projection state is determined by the running state of the first object;
determining the first object content corresponding to the first object based on the screen projection state, wherein different screen projection states correspond to different first object contents;
determining the first object content as the first screen shot content.
3. The method of claim 2, wherein the first object is a target application icon;
the determining a screen projection state of the first object in a case where the first object is included in the first screen projection editing area includes:
determining the application running state of a first application corresponding to the target application icon as the screen projection state under the condition that the target application icon is included in the first screen projection editing area;
the determining the first object content corresponding to the first object based on the screen projection state comprises:
determining a first application interface corresponding to the first application as the first object content under the condition that the application running state of the first application is an application opening state;
and determining the target application icon corresponding to the first application as the first object content when the application running state of the first application is an application closing state.
4. The method of claim 3, further comprising:
adding a screen projection mark for the first application corresponding to the target application icon under the condition that the first screen projection editing area contains the target application icon;
the determining a first application interface corresponding to the first application as the first object content includes:
and under the condition that the first application interface is displayed and the first application corresponding to the first application interface is determined to be provided with the screen projection mark, determining the first application interface corresponding to the first application as the first object content.
5. The method of claim 3, further comprising:
in response to the first application that an unread message exists and a viewing operation for the unread message is received, determining a message viewing interface corresponding to the unread message as the first screen projection content;
in response to the first application having the unread message and not receiving a viewing operation for the unread message, stopping determining the message viewing interface corresponding to the unread message as the first screen projection content.
6. The method of claim 2, wherein the first object is a target file, and the target file is dragged into the first screen-shot editing area by an application interface of a second application;
the determining a screen projection state of the first object in a case where the first object is included in the first screen projection editing area includes:
determining the file use state of the target file as the screen projection state under the condition that the first screen projection editing area contains the target file;
the determining the first object content corresponding to the first object based on the screen projection state comprises:
determining the content of a target file corresponding to the target file as the content of the first object under the condition that the file using state of the target file is a file opening state;
and under the condition that the file use state of the target file is a file closing state, determining a target file icon corresponding to the target file as the first object content.
7. The method of claim 2, wherein the first object is a target floating window;
the determining a screen projection state of the first object in a case where the first object is included in the first screen projection editing area includes:
determining the floating window display state of the target floating window as the screen projection state under the condition that the first screen projection editing area contains the target floating window;
the determining the first object content corresponding to the first object based on the screen projection state comprises:
determining a second application interface as the first object content under the condition that the floating window display state indicates that the second application interface is displayed in the target floating window;
and under the condition that the floating window display state indicates that the second application interface is not displayed in the target floating window, determining a target floating window icon corresponding to the target floating window as the first object content.
8. The method of any one of claims 1 to 7, wherein the determining the first screen-shot editing region in response to the first region editing operation in the screen-shot state comprises:
responding to the first area editing operation in the screen projection state, and displaying the first screen projection editing area on the upper layer of a user interface based on the first area editing operation.
9. The method of any of claims 1 to 7, further comprising:
receiving a drag operation on a second object;
determining a target position of the second object when the dragging operation is stopped;
determining second object content corresponding to the second object as second screen projection content under the condition that the target position is located in the first screen projection editing area;
and transmitting the second screen projection content to the screen projection equipment so that the screen projection equipment displays the second screen projection content while displaying the first screen projection content.
10. The method of any of claims 1 to 7, further comprising:
responding to a second area editing operation in the screen projection state, and determining a second screen projection editing area;
fusing the first screen projection editing area and the second screen projection editing area to generate a third screen projection editing area under the condition that the second screen projection editing area contains a second object, and determining second object content corresponding to the second object as second screen projection content;
and transmitting the second screen projection content to the screen projection equipment so that the screen projection equipment displays the second screen projection content while displaying the first screen projection content.
11. The method of any of claims 1 to 7, further comprising:
and responding to the moving-out operation of the first object in the first screen projection editing area, and sending a screen projection stopping instruction to the screen projection equipment, so that the screen projection equipment stops displaying the first screen projection content based on the screen projection stopping instruction.
12. The method of any of claims 1 to 7, further comprising:
under the condition that the application program corresponding to the first object is switched to be operated in the background, the first object content corresponding to the first object is continuously determined as the first screen projection content.
13. A method of screen projection, the method being performed by a screen projection device, the method comprising:
receiving first screen projection content sent by a terminal in a screen projection state, wherein the first screen projection content is determined based on first object content corresponding to a first object contained in a first screen projection editing area of the terminal, and the first screen projection editing area is determined based on first area editing operation in the screen projection state of the terminal;
and displaying the first screen projection content.
14. The method of claim 13, further comprising:
responding to a screen-casting content newly-adding request, and receiving second screen-casting content sent by the terminal, wherein the screen-casting content newly-adding request is triggered by newly adding a second object in the first screen-casting editing area, or the screen-casting content newly-adding request is triggered by newly adding a second screen-casting editing area, and the second screen-casting content is second object content corresponding to the second object;
and displaying the first screen projection content and the second screen projection content.
15. The method of claim 14, wherein the displaying the first and second projected content comprises:
dividing a display area into a first display area and a second display area; displaying the first screen-shot content in the first display area and the second screen-shot content in the second display area;
or the like, or, alternatively,
generating a first display window and a second display window; displaying the first screen-projected content in the first display window, and displaying the second screen-projected content in the second display window.
16. A screen projection apparatus, wherein the apparatus is executed by a terminal, the apparatus comprising:
the editing module is used for responding to a first area editing operation in a screen projection state and determining a first screen projection editing area;
the determining module is used for determining first object content corresponding to a first object as first screen-casting content under the condition that the first screen-casting editing area contains the first object;
and the sending module transmits the first screen projection content to screen projection equipment so that the screen projection equipment can display the first screen projection content.
17. A screen projection apparatus, wherein the apparatus is executed by a screen projection device, the apparatus comprising:
the terminal comprises a receiving module, a display module and a display module, wherein the receiving module is used for receiving first screen projection content sent by a terminal in a screen projection state, the first screen projection content is determined based on first object content corresponding to a first object contained in a first screen projection editing area of the terminal, and the first screen projection editing area is determined based on first area editing operation in the screen projection state of the terminal;
and the display module is used for displaying the first screen projection content.
18. An electronic device, comprising a processor and a memory, wherein the memory stores at least one program, and the at least one program is loaded and executed by the processor to implement the screen projection method according to any one of claims 1 to 12, or to implement the screen projection method according to any one of claims 13 to 15.
19. A computer-readable storage medium, wherein at least one program code is stored in the computer-readable storage medium, and the program code is loaded and executed by a processor to implement the screen projection method according to any one of claims 1 to 12, or to implement the screen projection method according to any one of claims 13 to 15.
20. A computer program product comprising computer instructions stored in a computer readable storage medium, which are read by a processor and executed to implement the screen projection method of any one of claims 1 to 12 or to implement the screen projection method of any one of claims 13 to 15.
CN202210457912.6A 2022-04-27 2022-04-27 Screen projection method, screen projection device, terminal, equipment, computer medium and program product Pending CN114911442A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202210457912.6A CN114911442A (en) 2022-04-27 2022-04-27 Screen projection method, screen projection device, terminal, equipment, computer medium and program product
PCT/CN2022/143911 WO2023207200A1 (en) 2022-04-27 2022-12-30 Screen projection method and apparatus, terminal, device, computer medium and program product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210457912.6A CN114911442A (en) 2022-04-27 2022-04-27 Screen projection method, screen projection device, terminal, equipment, computer medium and program product

Publications (1)

Publication Number Publication Date
CN114911442A true CN114911442A (en) 2022-08-16

Family

ID=82764753

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210457912.6A Pending CN114911442A (en) 2022-04-27 2022-04-27 Screen projection method, screen projection device, terminal, equipment, computer medium and program product

Country Status (2)

Country Link
CN (1) CN114911442A (en)
WO (1) WO2023207200A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116074569A (en) * 2022-12-29 2023-05-05 深圳创维-Rgb电子有限公司 Mirror image screen projection method and device, electronic equipment and storage medium
WO2023207200A1 (en) * 2022-04-27 2023-11-02 Oppo广东移动通信有限公司 Screen projection method and apparatus, terminal, device, computer medium and program product

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106095237A (en) * 2016-06-08 2016-11-09 联想(北京)有限公司 Information processing method and electronic equipment
CN108958684A (en) * 2018-06-22 2018-12-07 维沃移动通信有限公司 Throw screen method and mobile terminal
CN109992231A (en) * 2019-03-28 2019-07-09 维沃移动通信有限公司 Throw screen method and terminal
CN110221798A (en) * 2019-05-29 2019-09-10 华为技术有限公司 A kind of throwing screen method, system and relevant apparatus
CN111432070A (en) * 2020-03-17 2020-07-17 北京百度网讯科技有限公司 Application screen projection control method, device, equipment and medium
CN112416200A (en) * 2020-11-26 2021-02-26 维沃移动通信有限公司 Display method, display device, electronic equipment and readable storage medium
CN113329240A (en) * 2021-05-10 2021-08-31 西安万像电子科技有限公司 Screen projection method and device
CN113542825A (en) * 2020-04-20 2021-10-22 华为技术有限公司 Screen projection display method, system, terminal device and storage medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111880757A (en) * 2020-06-30 2020-11-03 北京小米移动软件有限公司 Screen projection method, screen projection device and storage medium
CN114911442A (en) * 2022-04-27 2022-08-16 Oppo广东移动通信有限公司 Screen projection method, screen projection device, terminal, equipment, computer medium and program product

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106095237A (en) * 2016-06-08 2016-11-09 联想(北京)有限公司 Information processing method and electronic equipment
CN108958684A (en) * 2018-06-22 2018-12-07 维沃移动通信有限公司 Throw screen method and mobile terminal
CN109992231A (en) * 2019-03-28 2019-07-09 维沃移动通信有限公司 Throw screen method and terminal
CN110221798A (en) * 2019-05-29 2019-09-10 华为技术有限公司 A kind of throwing screen method, system and relevant apparatus
CN111432070A (en) * 2020-03-17 2020-07-17 北京百度网讯科技有限公司 Application screen projection control method, device, equipment and medium
CN113542825A (en) * 2020-04-20 2021-10-22 华为技术有限公司 Screen projection display method, system, terminal device and storage medium
CN112416200A (en) * 2020-11-26 2021-02-26 维沃移动通信有限公司 Display method, display device, electronic equipment and readable storage medium
CN113329240A (en) * 2021-05-10 2021-08-31 西安万像电子科技有限公司 Screen projection method and device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023207200A1 (en) * 2022-04-27 2023-11-02 Oppo广东移动通信有限公司 Screen projection method and apparatus, terminal, device, computer medium and program product
CN116074569A (en) * 2022-12-29 2023-05-05 深圳创维-Rgb电子有限公司 Mirror image screen projection method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
WO2023207200A1 (en) 2023-11-02

Similar Documents

Publication Publication Date Title
US11868586B2 (en) Floating window user interface display method and apparatus, device, and storage medium
US11347389B2 (en) File processing method, terminal, and storage medium
EP3451641B1 (en) Mobile communication device with separate display areas and rearrangemet of icons in the edges areas.
WO2019174546A1 (en) User interface display method and device, apparatus, and storage medium
US10705671B2 (en) Information sharing method, terminal, and storage medium
US20230289049A1 (en) Method and system for displaying virtual prop in real environment image, and storage medium
CN111597000B (en) Small window management method and terminal
CN114911442A (en) Screen projection method, screen projection device, terminal, equipment, computer medium and program product
EP4002107A1 (en) Data binding method, apparatus, and device of mini program, and storage medium
US10593018B2 (en) Picture processing method and apparatus, and storage medium
CN105190486A (en) Display apparatus and user interface screen providing method thereof
CN103747362A (en) Method and device for cutting out video clip
KR20160120343A (en) Cross-platform rendering engine
CN110187952B (en) Method, device, terminal and storage medium for storing content
KR20140040875A (en) Cartoon providing system, cartoon providing device and cartoon providing method
WO2022222672A1 (en) Multi-content parallel display method and apparatus, terminal, medium, and program product
WO2024114571A1 (en) Information display method and apparatus, electronic device, and storage medium
US11928383B2 (en) Screen projection control method, storage medium and communication apparatus
EP4220368A1 (en) Multimedia data processing method and apparatus, and device, computer-readable storage medium and computer program product
CN115460448A (en) Media resource editing method and device, electronic equipment and storage medium
CN113687750B (en) Screenshot processing method and device
CN111447402A (en) Menu display control method, device and equipment
CN114691000B (en) Multi-screen linkage method, device, equipment and storage medium
CN111211965B (en) Chat window protection method and device, storage medium and terminal
WO2024051247A1 (en) Application sharing method and system, electronic device, and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination