CN112261466A - Screen projection method and device, electronic equipment and storage medium - Google Patents

Screen projection method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN112261466A
CN112261466A CN202010833253.2A CN202010833253A CN112261466A CN 112261466 A CN112261466 A CN 112261466A CN 202010833253 A CN202010833253 A CN 202010833253A CN 112261466 A CN112261466 A CN 112261466A
Authority
CN
China
Prior art keywords
interface
screen projection
displayed
screen
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010833253.2A
Other languages
Chinese (zh)
Inventor
周健
邓杰
陈东霞
章磊
史海洋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Original Assignee
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jingdong Century Trading Co Ltd, Beijing Jingdong Shangke Information Technology Co Ltd filed Critical Beijing Jingdong Century Trading Co Ltd
Priority to CN202010833253.2A priority Critical patent/CN112261466A/en
Publication of CN112261466A publication Critical patent/CN112261466A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43637—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The technical scheme of the application provides a screen projection method, which comprises the following steps: splicing a first interface displayed by the first equipment and a hidden second interface to obtain a screen projection interface; and sending the screen projection interface to second equipment. According to the method, the second interfaces which are not displayed in the first equipment are spliced into the screen projection interface, the screen projection interface comprises more interface information, and more different interfaces can be displayed instead of the first interface which is displayed independently. When the screen projection interface is used for screen projection display, more screen projection information is provided for a user, the user can obtain more information through the screen projection interface, and the use experience of the user is improved.

Description

Screen projection method and device, electronic equipment and storage medium
Technical Field
The embodiment of the invention relates to the technical field of information processing, in particular to a screen projection method, a screen projection system, electronic equipment and a storage medium.
Background
With the development of screen projection technology, the use of screen projection brings great convenience to users. The screen projection is understood to be that the displayed content of the mobile device a can include various media information and various operation pictures displayed in the device a by displaying the displayed content of the mobile device a on the screen of the other device B.
For example, the content displayed on the screen of the device such as a mobile phone or a tablet is projected onto a device having a larger screen such as a computer, a television, or a projector in the same local area network, and the content displayed on the screen of the mobile phone or the tablet is displayed on the screen of the device such as the computer, the television, or the projector.
Disclosure of Invention
The embodiment of the invention provides a screen projection method, a screen projection system, electronic equipment and a storage medium.
A first aspect of the embodiments of the present disclosure provides a screen projection method, including: splicing a first interface displayed by the first equipment and a hidden second interface to obtain a screen projection interface; and sending the screen projection interface to second equipment.
In one embodiment, the method further comprises: determining a first layer displayed in a plurality of stacked display layers as the first interface, and determining a second layer shielded by the first layer in the plurality of display layers as the second interface.
In one embodiment, the second interface has a content association with the first interface.
In one embodiment, the first interface is: a primary interface of the first device foreground application; the second interface is: the interface connected with the inlet displayed on the main interface; alternatively, the second interface is: and displaying an interactive page of the content on the main interface.
In one embodiment, the inlet comprises: a link address; and/or, a jump control.
In one embodiment, the interactive page includes: displaying a comment page of comment information of the displayed content on the main interface; displaying a bullet screen page of bullet screen information of the display content on the main interface; and/or displaying a detailed page for displaying the detailed content of the subject matter on the main interface.
In one embodiment, the first interface is: the first device foreground applies the displayed interface; the second interface is: and setting an application interface in the first equipment background application.
In one embodiment, the setting application includes: an instant messaging application; or, a mail application.
In one embodiment, the method further comprises: acquiring splicing parameters; wherein the splicing parameters at least comprise at least one of: the number of the second interfaces, the position parameters of the first interface in the screen projection interface and the arrangement mode of the second interfaces; the splicing of the first interface displayed by the first device and the hidden second interface to obtain the screen projection interface comprises the following steps: and splicing the first interface displayed by the first equipment and the hidden second interface according to the splicing parameters to obtain a screen projection interface.
In one embodiment, the obtaining the splicing parameter includes: and determining the splicing parameters according to the display size of the second equipment.
In one embodiment, the second interface is a plurality; the splicing of the first interface displayed by the first device and the hidden second interface to obtain the screen projection interface comprises the following steps: the first interface is arranged in the center, and the plurality of second interfaces are arranged around the first interface to form the spliced screen projection interface.
In one embodiment, the splicing a first interface displayed by a first device and a hidden second interface to obtain a screen projection interface includes: and when detecting that the content of any interface in the first interface and the second interface is updated, splicing the updated first interface displayed by the first device and the hidden second interface to obtain the screen projection interface.
In one embodiment, the method further comprises: receiving a control signal returned by the second equipment; responding according to the display content of the first interface or the second interface acted by the control signal; and updating the interface content of the first interface or the second interface acted by the control signal according to the response result.
In one embodiment, the control signal comprises: first position information of an input operation detected by the second device; the responding according to the display content of the first interface or the second interface acted by the control signal comprises the following steps: converting the first position information into second position information according to a ratio between a first area of the screen projection interface and a second area of the screen projection interface displayed by the second equipment; and determining a control on the first interface or the second interface aimed at by the input operation according to the second position information.
In one embodiment, the updating the interface content of the first interface or the second interface acted by the control signal according to the response result comprises: and updating the first interface or the second interface aimed at by the input operation according to the content of the control.
A second aspect of the embodiments of the present disclosure provides a screen projection method, including: receiving a screen projection interface sent by first equipment, wherein the screen projection interface is as follows: the first interface displayed by the first equipment and the hidden second interface are spliced to form the interface; and displaying the screen projection interface comprising the first interface and the second interface in an enlarged mode.
In one embodiment, the method further comprises: receiving an input operation of a control device acting on a display interface of the second device; the display interface is formed by the second equipment displaying the screen projection interface; and sending a control signal to the first equipment according to the input operation, wherein the control signal is used for triggering the first equipment to respond to the input operation.
In an embodiment, the control signal carries first location information of the display interface acted by the input operation, where the first location information is used for the first device to determine that the input operation acts on the first interface or the second interface.
In one embodiment, the method further comprises: and determining whether the screen projection interface is displayed in a full screen mode or not according to the ratio of the number of pixels in the first direction to the number of pixels in the second direction of the screen projection interface, wherein the second direction is perpendicular to the first direction.
In one embodiment, the determining whether to display the screen projection interface in a full screen mode according to a pixel number ratio of a first direction to a second direction of the screen projection interface, wherein the second direction is perpendicular to the first direction, includes: and when the pixel number ratio is equal to the pixel number ratio of the second device in the first direction and the second direction, displaying the screen projection interface in a full screen mode.
In one embodiment, the determining whether to display the screen projection interface in a full screen mode according to a pixel number ratio of a first direction to a second direction of the screen projection interface, wherein the second direction is perpendicular to the first direction, includes: when the pixel number ratio is not equal to the pixel number ratio of the second device in the first direction and the second direction, determining an amplification factor according to the pixel number ratio of the screen projection interface in the target direction to the pixel number ratio of the second device in the first direction; the target direction is a direction with more pixels in a first direction and a second direction in the screen projection interface; amplifying the screen projection interface according to the amplification factor; and determining the screen projecting interface after the screen is displayed and amplified in the middle.
In one embodiment, the method further comprises: and sending the display size of the second device to the first device, wherein the display size is used for the first device to determine splicing parameters for splicing the first interface and the second interface.
A third aspect of the embodiments of the present disclosure provides a screen projection apparatus, including:
the splicing module is used for splicing a first interface displayed by the first equipment and a hidden second interface to obtain a screen projection interface;
and the screen projection module is used for sending the screen projection interface to the second equipment.
A fourth aspect of the embodiments of the present disclosure provides a screen projection apparatus, including:
the receiving module is used for receiving a screen projection interface sent by first equipment, wherein the screen projection interface is as follows: the first interface displayed by the first equipment and the hidden second interface are spliced to form the interface;
and the display module is used for magnifying and displaying the screen projection interface comprising the first interface and the second interface.
A fifth aspect of an embodiment of the present disclosure provides an electronic device, including:
a processor;
a memory storing program instructions that, when executed by the processor, cause the electronic device to perform any of the methods described above.
A sixth aspect of the embodiments of the present disclosure provides a storage medium storing a program that, when executed by a processor, performs any one of the methods described above.
The first device in the technical scheme of the embodiment of the disclosure includes a displayed first interface and a second interface which is not displayed, that is, the second interface is a hidden interface. And splicing the first interface displayed by the first equipment and the hidden second interface to obtain a screen projection interface, wherein the screen projection interface comprises the second interface besides the first interface. And sending the screen projection interface comprising the first interface and the second interface to the second equipment, and further displaying the screen projection interface comprising the first interface and the second interface through the second equipment.
According to the method, the second interfaces which are not displayed in the first equipment are spliced into the screen projection interface, the screen projection interface comprises more interface information, and more different interfaces can be displayed instead of the first interface which is displayed independently. When the screen projection interface is used for screen projection display, more screen projection information is provided for a user, the user can obtain more information through the screen projection interface, and the use experience of the user is improved.
When the screen projection interface obtained by splicing the first interface and the second interface is displayed by the second device, the second interface is added in the screen projection interface, so that the second device needs to display the second interface in an unused display area except the first interface when displaying. Therefore, the utilization rate of the display screen of the second device is increased, and the visual experience effect is better when the user views the screen projection interface of the first device through the second device.
Drawings
Fig. 1 is a schematic view of a screen projection mode provided in an embodiment of the present disclosure;
FIG. 2 is a schematic view of another screen projection mode provided by the embodiment of the present disclosure;
fig. 3 is a schematic flow chart of another screen projection method provided in the embodiment of the present disclosure;
fig. 4 is a schematic view illustrating a display effect of a screen projection interface according to an embodiment of the disclosure;
fig. 5 is a schematic structural diagram of a screen projection interface obtained by splicing a first interface and a second interface according to an embodiment of the present disclosure;
fig. 6 is a schematic view of another display effect of splicing the first interface and the second interface to obtain a screen projection interface according to the embodiment of the present disclosure;
fig. 7 is a schematic flowchart of another screen projection method based on fig. 3 according to an embodiment of the present disclosure;
fig. 8 is a schematic flow chart illustrating a response according to the display content of the first interface or the second interface acted by the control signal according to the embodiment of the disclosure;
fig. 9 is a schematic diagram of interaction between a first device and a second device provided in an embodiment of the present disclosure;
fig. 10 is a schematic diagram of another interaction between a first device and a second device provided in the embodiments of the present disclosure;
fig. 11 is a schematic flowchart of a screen projection method according to an embodiment of the present disclosure;
fig. 12 is a schematic flowchart of a screen projection method according to fig. 11 according to an embodiment of the present disclosure;
fig. 13 is a schematic structural diagram of a screen projection device according to an embodiment of the present disclosure;
fig. 14 is a schematic structural diagram of another screen projection device provided in the embodiment of the present disclosure.
Detailed Description
The technical solution of the present invention is further described in detail with reference to the drawings and the specific embodiments of the specification.
According to the screen projection technology, the content displayed on the screen of the device with the screen projection function can be projected to other devices with the display function for display. For example, conference content, multimedia files, games, movies, or videos may be delivered to a screen of another device for presentation, which may provide a better user experience and convenience for the user. It should be noted that the screen projection device and the display device may be connected to the same lan, the same wlan, or a network connection across lans through the internet.
Referring to fig. 1, an embodiment of the present disclosure provides a screen projection manner, in which when a screen is projected, content displayed by a device with a smaller screen and a screen projection function is projected to a device with a larger screen for displaying. The display is carried out through equipment with a larger screen, and more convenience is provided for interaction, entertainment or watching of a user. For example, the display interface of the mobile phone is projected to a computer or a television for display, the display interface of the computer is projected to the television or a projector for display, and the like, so that a user can view the interface displayed by the screen projection device through a larger device of the display screen, and the use experience of the user can be improved.
For example, a description will be given taking an example in which a mobile phone is used as a screen projection device, a television is used as a display device, and an interface displayed on a screen of the mobile phone is projected onto the television and displayed. When a user watches videos through a mobile phone or uses live broadcast software to carry out live broadcast and the like, a display interface of the mobile phone can be projected to a television to be displayed, and the videos or live broadcast contents are watched through the television.
However, the interface currently displayed by the mobile phone, such as the interface for playing the video or the interface for live broadcasting, is projected to the television for display, the television display is the interface for playing the video or the interface for live broadcasting currently displayed by the mobile phone, and other interfaces cannot be displayed. In addition, because the interface displayed by the mobile phone is sometimes displayed on a vertical screen (for example, during live broadcasting), and the resolution of the display screen of the mobile phone and the resolution of the television may not be the same, the display screen of the television cannot be completely utilized after the interface displayed by the mobile phone is projected onto the television as a screen projection interface. The display screen of the television has a residual display area after displaying the interface projected by the mobile phone, and the residual display area does not display any interface.
Referring to fig. 2, after the mobile phone display interface is projected to the television for displaying, the mobile phone display interface is displayed in the middle of the television display screen, and the display areas on both sides of the television display screen do not display any interface, that is, the display areas on both sides of the television display screen are unused areas. Moreover, after the display interface of the mobile phone is projected on the television, the display interface of the mobile phone cannot be interactively operated through the television, and information interaction in the display interface, such as starting, pausing, leaving a message or other operations, needs to be completed through the mobile phone.
Therefore, the screen projection effect is not very good for the user, which results in poor user experience.
Referring to fig. 3, an embodiment of the present disclosure provides a screen projection method, which includes the following steps:
s100, splicing a first interface displayed by first equipment and a hidden second interface to obtain a screen projection interface;
and step S200, sending the screen projection interface to the second equipment.
The first device in this embodiment is a device that provides screen projection information, and the screen projection information is projected to another device for further display, and the like. The display area of the first equipment is smaller than that of the second equipment, and the second equipment with the larger display area can be used for displaying after the screen is projected, so that the visual experience effect is improved. The first device in this embodiment may be a device with a small display screen, such as a mobile phone, a tablet, or a computer, and the second device may be a device with a large display screen, such as a television or a projector.
In this step, the display interface of the first device may be projected to another device as the screen projection information to be displayed. When the first device displays, the interface currently displayed by the display screen is displayed, other interfaces are not displayed, and the other interfaces are hidden interfaces. When the interface displayed by the first device is projected, the currently displayed interface of the first device is projected, and the interface displayed by the first device is also displayed after the screen is projected.
The first interface in this step is an interface currently displayed by the first device.
For example, the interface currently displayed by the first device is a live interface, and the live interface can be used as the first interface displayed by the first device. The first device divides the display screen into two parts in a split screen mode, and the displayed pages are an interface for watching videos and a page for reading articles, or two pages for watching different videos are displayed. In this case, two pages divided into two are also taken as the first interface. Because the first device may include a plurality of interfaces, the interfaces may not be all displayed during displaying, and a corresponding interface is displayed according to a service requirement or a user requirement, where the displayed interface is the first interface. In addition to the displayed interface, other interfaces that are not displayed are included, and these interfaces that are not displayed serve as hidden interfaces in this embodiment, and the hidden interface is determined as the second interface. The hidden interface may include a plurality of interfaces, so the number of the second interfaces may be a plurality, and the number of the second interfaces is not limited, and may be one or more. According to business requirements or user using requirements, a first interface displayed in the first equipment and a hidden second interface are determined, and then the first interface displayed by the first equipment and the hidden second interface are spliced to obtain a screen projection interface.
In one embodiment, the method further comprises:
detecting a user operation;
and determining one or more second interfaces according to the user operation.
In another embodiment, the method further comprises:
determining a stacking relation between a first interface displayed in the first device and the rest interfaces shielded by the first interface;
and selecting one or more interfaces from the rest interfaces as the second interface according to the stacking relation.
For example, the selecting one or more of the remaining interfaces as the second interface includes at least one of:
and selecting one or more remaining interfaces closest to the first interface as the second interface according to the stacking relation.
For example, there are multiple hidden second interfaces in the first device, and according to the use requirement of the user, an a interface of a foreground application needs to be displayed on the first interface, and then two second interfaces are determined. The display interface of the background application 1 can be determined to be one second interface, and the display interface of the background application 2 can be determined to be another second interface, so that the display interfaces of two different background applications are determined to be the second interfaces. And then, splicing the two determined second interfaces with the first interface displayed by the foreground application to obtain a screen projection interface.
The second interface is a display interface of different background applications, and the first interface is an interface displayed by the foreground application, so that the three interfaces are display interfaces of three different applications. After the screen projection display is carried out, the display interfaces of the three applications can be displayed simultaneously, and a user can see the interface of the application needing to be seen simultaneously.
For another example, the first device has a plurality of hidden second interfaces, and according to the user requirement, an a interface of the foreground application needs to be displayed on the first interface, and two interfaces having content association with the a interface displayed by the foreground application also need to be displayed. And determining the interface which has content relevance with the currently displayed interface in the foreground application as a second interface.
In this case, a second interface, which has content relevance with the first interface, can be simultaneously displayed in the screen-projection interface, and more content related to the first interface is provided.
After the screen projection interface is obtained, the screen projection interface is sent to the second equipment, and the second equipment can display the screen projection interface, so that the screen projection effect that the content displayed by the first equipment is transferred to the second equipment for display is achieved.
According to the technical scheme of the embodiment, the hidden second interface and the displayed first interface are spliced to obtain the screen projection interface for screen projection. In this way, the screen projection interface comprises a second interface except the displayed first interface, namely more interfaces, and after the screen projection display is carried out, more interfaces can be displayed. The mode increases the display content of the screen projection interface, further increases the display content of the display screen of the second equipment, improves the utilization rate and the display effect of the display screen of the second equipment, provides more interface information for a user, and improves the use experience of the user.
In another embodiment, the first device displays information through the display layer and includes a plurality of stacked display layers. In displaying, a plurality of display layers can be stacked and displayed according to actual use requirements. In this embodiment, a first layer displayed in a plurality of stacked display layers is determined as a first interface, and a second layer blocked by the first layer in one or more display layers is determined as a second interface. Determining a displayed layer in the stacked display layers according to an actual service requirement or a user use requirement, wherein the displayed layer is a first layer, and the displayed first layer is determined as a first interface.
After the first device displays the first layer, the first layer blocks other display layers in the stacked display layers, the other display layers are referred to as second layers, and the blocked second layer is determined as a second interface.
In another embodiment, the second interface and the first interface are interfaces with content relevance. The content displayed in the second interface and the content displayed in the first interface are related content, and the content displayed in the second interface can be obtained according to the content displayed in the first interface.
Further, the first interface is a main interface of the first device foreground application, and the second interface is an interface connected with an inlet displayed on the main interface. When the first interface displayed by the first device is a main interface of the foreground application of the first device, the first interface also comprises associated content associated with the display content of the main interface, and the main interface is a currently displayed interface. These associated contents are not displayed in the first interface, but are displayed in the form of entries corresponding to the associated contents set in the first interface.
And displaying the set entries corresponding to the associated contents in the first interface, wherein the contents associated with the entries can be displayed through the entries. The entry can be a link address and/or a jump control, and the like, the link address or the jump control is associated with a corresponding content display interface, and the first interface and the second interface are associated through the link address and/or the jump control, and the like.
The second interface is an interface of the associated content associated with the entries displayed through the entries, the entries are associated with the second interface in a link manner, and the interface linked with the entry can be jumped to through the entry displayed on the first interface, namely the interface linked with the entry can be jumped to through the entry.
For example, the first device is a mobile phone, and the live broadcast is performed through a live broadcast application program in the mobile phone. During live broadcasting, an interface displayed in the mobile phone is a live broadcasting interface, namely, a first interface displayed by the mobile phone is a live broadcasting main interface which is mainly played, and in addition, other link addresses and/or entries such as a jump control are added on two sides or the top or the bottom of the live broadcasting main interface.
Taking the anchor live broadcast video application as an example, when an anchor is live broadcast on a certain live broadcast platform, the main interface of the live broadcast platform is an interface for the anchor to live broadcast and introduce goods, and a link address or a jump control of the goods is also arranged at the bottom of the main interface. The detailed information of the goods or the goods can be checked or purchased and the like through the link address or the skip control, an interface for displaying the detailed information of the goods or an interface for purchasing the goods is a second interface, and the second interface is not displayed in a display screen of the mobile phone when the anchor carries out live introduction of the goods.
Or a link address or a jump control of the anchor store is arranged at the bottom of the main interface, the goods and the like in the anchor store can be checked through the link address or the jump control, and the interface for displaying the goods in the anchor store is the second interface.
After the first interface and the second interface are spliced to obtain the screen-casting interface, not only can a main interface of the anchor live broadcast with goods be input into the screen, but also a second interface of a shop displaying the goods introduced by the anchor or the anchor can be input into the screen, namely the second interface which is not displayed when the main interface is displayed by the mobile phone is input into the screen. Therefore, more interfaces in the mobile phone are projected to second equipment such as a television, the second equipment can display more interfaces, the first interface displayed by the mobile phone is not displayed independently, the second interface hidden by the mobile phone can also be displayed, and the use experience of a user is improved.
It should be noted that the first interface herein does not only include the first interface during live broadcasting, but also may be any interface that can be displayed by the first device, which is not limited herein, and the second interface is also not limited.
For another example, the first device is a tablet computer, the first interface displayed by the tablet computer is an interface for reading an article, and when the article is read, a user can perform operations such as annotating and querying content in the article according to reading requirements. And taking the interface for displaying the endorsements and the related interface for inquiring the content in the article as a second interface, wherein the second interface is associated with the first interface through a link address or a jump control.
The jump control includes, but is not limited to, at least one of:
page turning controls, such as a previous page control, a next page control, and a return control;
and the determining control of the prompt information triggers the first electronic equipment to jump to a prompt page related to the prompt information.
After the first interface and the second interface are spliced, the interface capable of speaking the read article, the interface capable of annotating the article and the interface capable of inquiring related content are simultaneously displayed on a second device such as a computer or a television, so that the use experience of a user is improved.
In another embodiment, the second interface may also be an interactive page showing content on the main interface. The interactive page comprises a comment page for displaying comment information of the content displayed on the main interface, a bullet screen page for displaying bullet screen information of the content displayed on the main interface, and/or a detailed page for displaying detailed content of the subject matter displayed on the main interface.
After the bullet screen page is determined as the second interface, the bullet screen page is separated from the main interface, and the bullet screen page is not displayed on the main interface, so that the bullet screen does not shield the display of the content in the main interface, the first interface can be better watched, and the display effect of the first interface and the watching effect of a user are improved. In addition, the bullet screen page is displayed as a second interface, the bullet screen can be amplified, and the display effect after the bullet screen is amplified is better.
For the comment page, there are many comment information in general, and the comment information is generally invisible or very small, and after the comment page is used as a second interface, the comment information can be displayed separately on the second interface. The interface can display more comment information and can also amplify the comment information, so that the display effect of the comment information is improved, and the comment information can be conveniently watched by a user.
For the detailed page of the subject matter, usually the detailed page is not displayed or the display area is small. When the detailed page is displayed as the second interface, the detailed page can be displayed on a separate interface, and the display effect is also improved.
Similarly, taking the example that the anchor carries out live broadcast and cargo carrying through a live broadcast platform in the mobile phone as an example, an interface for the anchor to carry out cargo explanation is a main interface, and is also a main interface of the live broadcast platform, namely a first interface displayed by the mobile phone. In the main interface, when the displayed and introduced goods are played, the goods are commented by the audience, and comment information of the comment can be displayed through a comment page. And bullet screen information related to the goods can be displayed through a bullet screen page. There is also information on the main interface showing the details of the subject matter, which can be displayed through the detailed page of the subject matter. The detailed pages of the comment page, the bullet screen page or the subject matter can be displayed not on the main interface but on other interfaces shielded by the main interface, so that the viewing effect of the main interface is improved, and meanwhile, the viewing effect of related contents in the pages is also improved. These pages are determined here as the second interface through which they are displayed.
After the first interface and the second interface are spliced, a live main interface displayed by the first device can be projected, and meanwhile detailed pages of comment pages, bullet screen pages and/or subject matters related to the display content in the main interface can be projected. The second device can simultaneously display the screen projection interfaces, and the user can simultaneously see the screen projection interfaces.
In another embodiment, the first interface may also be an interface on which the first device foreground application is displayed, and the second interface is an interface on which an application is set in the first device background application. In this embodiment, the first interface and the second interface are interfaces in different applications in the first device, the first interface currently displayed by the first device is an interface on which a foreground application is displayed, and the second interface is an interface hidden in a background application in the first device. The background setting application is not limited in number, and the interface of the background setting application is also not limited in number.
For example, the background setting application in the first device may include an instant messaging application, a mail application, and the like. And splicing the interface of the foreground application displayed on the first interface, the interface of the instant messaging application in the background application and the interface of the mail application to obtain a screen projection interface. When the screen projection interface is projected, the first interface, the instant messaging application and the email application can be projected and displayed on the second device at the same time.
The user can simultaneously see the first interface displayed by the mobile phone, the instant messaging interface which is not displayed by the mobile phone and the mail interface. The information displayed in the instant messaging interface and the information displayed in the mail interface can be seen while the first interface is seen, so that the probability that the user misses or omits important information is reduced, great convenience is brought to the user, and the use experience of the user is improved.
Referring to fig. 4, a schematic diagram of another displayed interface of the foreground application of the first device according to another embodiment is provided, where the second interface is an interface of a set application in the background application of the first device and is displayed after screen projection.
Referring to a first interface displayed by the mobile phone in the figure, the first interface is an interface of live clothes, referring to a display interface displayed by a computer of a screen projection interface obtained after splicing in the figure, and the contents displayed by the screen projection interface and the display interface are the same. The screen projection interface comprises a first interface displayed by a mobile phone and also comprises two second interfaces, namely a video interface and a fruit shopping interface. The first interface displayed by the mobile phone is the interface displayed by the foreground application of the mobile phone, and the second interface is the interface of the background setting application in the mobile phone. In this embodiment, the mobile phone background setting application is a video playing application and a shopping application, the interface displaying the movie list is set as the interface of the video playing application, and the interface displaying the fruit list is set as the interface of the shopping application.
And splicing a first interface displayed by the application of the mobile phone foreground and two interfaces displayed by the set application of the mobile phone background to obtain a screen projection interface.
In another embodiment, step S100, splicing the first interface displayed by the first device and the hidden second interface to obtain a screen projection interface, where before, the method may further include:
and acquiring splicing parameters which are reference information of the first interface displayed by the first equipment and the hidden second interface to be spliced according to the splicing parameters. Wherein, the splicing parameter at least comprises at least one of the following parameters:
the number of the second interfaces, the position parameters of the first interface in the screen projection interface and the arrangement mode of the second interfaces. Since the interface displayed by the first device is used as the first interface, the number of the first interfaces is fixed, that is, one interface, and therefore, when the first interface and the second interface are spliced, the number of the second interfaces needs to be referred to. The number of the second interfaces can affect the splicing of the screen projection interfaces, and the first interfaces and the second interfaces can be spliced according to the number of the second interfaces.
The first interface and the second interface can be spliced according to the position parameters of the first interface in the screen projection interface, the position of the first interface in the screen projection interface is different, and the screen projection interfaces obtained through splicing are also different.
The first interface and the second interface can be spliced according to the arrangement mode of the second interface, and the screen projection interfaces obtained by splicing are different due to the difference of the arrangement mode of the second interface.
And splicing the first interface and the second interface according to the number of the second interfaces, the position parameters of the first interface in the screen projection interface and two or three of the arrangement modes of the second interfaces to obtain the screen projection interface.
Due to the difference of the splicing parameters, screen projection interfaces obtained by splicing the first interface and the second interface are different, and the display effects of the second equipment are different after the different screen projection interfaces project screens to the second equipment. Therefore, in order to better splice the first interface and the second interface and further better display the obtained screen projection interface on the second device, the splicing parameters can be obtained first.
The obtaining of the splicing parameter may be performed according to the display size of the second device, that is, the splicing parameter determined according to the display size of the second device. The screen projection interface obtained by splicing the first interface and the second interface through the splicing parameter can be better displayed on the second equipment. For example, the screen projection interface is displayed on the display screen of the second device in a full screen mode.
The splicing parameter can also be a preset splicing parameter, the preset splicing parameter can be directly obtained, and the splicing parameter does not need to be determined according to the display size of the second device under the condition.
In addition, since the alternative splicing parameters of the televisions with different sizes can be already determined, the alternative splicing parameters can be directly selected when the display size of the second device is acquired.
The display size of the second device can be obtained by the first device receiving from the second device, receiving from the man-machine interaction interface by the first device, obtaining by image recognition through obtaining an image of the second device, and the like.
In another embodiment, in step S100, splicing the first interface displayed by the first device and the hidden second interface to obtain the screen projection interface, the method may further include: when the second interface is a plurality of interfaces, the first interface is arranged in the center, and the plurality of second interfaces are arranged around the first interface to form a spliced screen projection interface.
Referring to fig. 5, a splicing schematic diagram of the screen projection interface is obtained by splicing the first interface displayed by the first device and the hidden second interface. The figure is illustrated with two second interfaces as an example, the second interfaces include an interface a and an interface C, and the first interface is an interface B. The first device is also a mobile phone, the interface displayed by the mobile phone is interface B, that is, the first interface is interface B, and the hidden second interface is interface a and interface C. Interface A and interface C can be interfaces with content relevance with interface B, and can be interfaces displayed by foreground application of the mobile phone, and interfaces of background setting application are interfaces of interface A and interface C.
Taking interface B as the interface displayed by the foreground application of the mobile phone, and interface a and interface C as the interfaces of the background setting application as an example, the description will be given. The method comprises the steps of setting an interface B in the middle, setting an interface A and an interface C on two sides of the interface B, obtaining data of the interface A, the interface B and the interface C, splicing the data of the three interfaces according to the arrangement positions of the interfaces to obtain spliced screen projection data, sending the screen projection data to second equipment for displaying, wherein the obtained screen projection interface is the screen projection interface with the interface B in the middle and the interface A and the interface C on two sides of the interface B.
Since the first device displays the first interface, which indicates that the content in the first interface is the content that the user wants to obtain, the first interface is displayed in the center, and the user can focus on viewing the first interface. While viewing the first interface, second interfaces on both sides of the first interface may be viewed.
In addition, because the display screen pixel of the first equipment is different from that of the second equipment, the first interface is displayed in the middle, and the display effect of the first interface can be improved.
Referring to fig. 6, a schematic diagram of another effect obtained by splicing the first interface displayed by the first device and the hidden second interface and displayed after the screen projection interface is obtained is shown.
Referring to the mobile phone side, in this embodiment, the first interface is an interface displayed by the mobile phone, the interface is a video playing interface, the number of the second interfaces is 5, and the 5 second interfaces are interfaces having content relevance with the first interface, that is, the video playing interface. The first interface is a displayed first layer, the layers of the 5 second interfaces are layers shielded by the first layer, that is, the mobile phone displays the first interface, the 5 second interfaces are interfaces shielded by the first interface, and the mobile phone does not display the 5 second interfaces. And the 5 second interfaces are associated with the first interface in a content manner through link addresses or jump controls and the like.
And splicing the five second interfaces and the first interface to obtain a screen projection interface, wherein the screen projection interface can refer to the television side. In this embodiment, when the first interface is a video playing interface, and when one of the second interfaces is a subtitle interface, the subtitle interface may be displayed in the first interface, that is, displayed as the first interface. And splicing the remaining 4 second interfaces with the first interface to obtain a screen projection interface, wherein the screen projection interface comprises a first interface, a second interface 1, a second interface 2, a second interface 3 and a second interface 4. The arrangement mode and the position relationship of the different second interfaces can be preset, and can also be determined according to splicing parameters, and are not limited here.
In another embodiment, in step S100, splicing the first interface displayed by the first device and the hidden second interface to obtain the screen projection interface, the method may further include:
and when detecting that the content of any interface in the first interface and the second interface is updated, splicing the updated first interface displayed by the first device and the hidden second interface to obtain a screen projection interface. The first interface displayed by the first device may be updated, the hidden second interface of the spliced screen projection interface may be updated, and when the first interface is updated, or the second interface is updated, or the first interface and the second interface are updated simultaneously, the screen projection interface is also updated.
When the content of the first interface and/or the second interface is detected to be updated, the updated first interface displayed by the first device and the hidden second interface are spliced to obtain an updated screen projection interface, so that the updated screen projection interface is sent to the second device to be displayed. Therefore, the updated first interface and/or the second interface can be projected to the second device for displaying, and the condition that the projected interface cannot be updated in time due to the fact that the projected interface is spliced by the first interface and/or the second interface which is not updated when the first interface displayed by the mobile phone and/or the hidden second interface is updated is prevented.
Referring to fig. 7, in another embodiment, after step S200, the method further includes:
and step S300, receiving a control signal returned by the second device.
In this embodiment, the second device may interact with the first device, and control the first interface and the second interface in the first device by controlling the screen projection to the display interface in the second device through the second device. Namely, the second device can control the screen projection interface to be projected to the display interface displayed by the second device, and the interface in the first device is further controlled by controlling the display interface to complete interaction.
The second device may have a control device, the control device may control the content in the displayed display interface, and the control device may perform corresponding control operation on the screen projection interface, where the control operation is an operation for controlling the display content in the display interface, such as start and pause of video playing, input and transmission of communication information in an instant messaging application, up and down movement of the display content in the display interface, and the like.
And after the second equipment controls the display interface, returning a control signal to the first equipment, receiving the control signal by the first equipment, and further processing the contents in the first interface and the second interface in the screen projection interface according to the control signal.
And step S400, responding according to the display content of the first interface or the second interface acted by the control signal.
And after receiving a control signal returned by the second device, responding according to an interface acted by the control signal, wherein the control signal may act on a first interface in the screen projection interfaces or may act on a second interface in the screen projection interfaces. When the control signal acts on the first interface in the screen projection interface, the control signal is explained to control the first interface in the screen projection interface, and corresponding processing needs to be performed on the first interface in the screen projection interface. When the control signal acts on the second interface of the screen projection interfaces, it is described that the control signal controls the second interface of the screen projection interfaces and needs to perform corresponding processing on the second interface of the screen projection interfaces.
And step S500, updating the interface content of the first interface or the second interface acted by the control signal according to the response result.
And when the control signal acts on a second interface of the screen projection interfaces, updating the second interface of the screen projection interfaces.
When the control signal acts on the second interface, the first device updates the second interface in the background, and the foreground application of the first device maintains the display of the first interface, namely the first device continues to display the first interface. Therefore, when the first device updates the second interface in the background, the second interface can be updated in the background without switching to the second interface or displaying the second interface. The first interface is displayed on the first device, and the first interface and the second interface do not need to be switched repeatedly, so that the use experience of a user is improved.
Through the process, the display interface is controlled through the second equipment, and then the interface content of the first interface or the second interface corresponding to the screen projection interface in the first equipment is controlled. The content displayed by the first interface or the second interface in the screen projection interface in the first equipment can be controlled without the operation of the first equipment, so that the interaction between the first equipment and the second equipment is realized, and the use experience of a user is better.
In another embodiment, the control signal returned by the second device received in step S300 may include first position information of the input operation detected by the second device. When the second device controls the content in the screen projection interface, the second device needs to perform input operation, and the input control signal is applied to the content in the screen projection interface after the input operation is performed. Because the screen projection interface in the second device includes the first interface and the second interface, and the second interfaces may be multiple, when the first interface or the second interface displayed by the second device is controlled, it needs to be determined whether the input operation is an input operation performed on the first interface or an input operation performed on the second interface according to the first position information of the input operation, and if the input operation is performed on the second interface, it needs to be determined which second interface is to be subjected to the input operation, and the like.
The input operation can be input through the control device, after the control device performs the input operation, the second device can detect the position information of the input operation, and the input operation is performed on which interface, namely, which interface is correspondingly controlled, so that the interface on which the input operation is input can be detected, and further, which interface is controlled when the input operation is a control signal can be detected.
Referring to fig. 8, step S400, responding according to the display content of the first interface or the second interface acted by the control signal, may further include:
step S401, converting the first position information into second position information according to a ratio between a first area of the screen projection interface and a second area of the screen projection interface displayed by the second device. Since the area size of the screen projection interface obtained by splicing the first device is different from the area size of the screen projection interface displayed by the second device, after the interface in the screen projection interface is controlled by the second device, the position of the corresponding input operation in the display area of the screen projection displayed by the second device needs to be converted into the position of the input operation in the screen projection interface.
The conversion can be performed according to a ratio relation between a first area of the screen projection interface and a second area of the screen projection interface displayed by the second device, the first position information is converted into second position information, and the second position information is the position of the input operation in the screen projection interface.
The first location information may be: the method comprises the steps that a second device detects a first coordinate of operation, the first coordinate is a coordinate of a screen projection interface displayed by the second device, the first device carries out coordinate conversion after receiving the coordinate to obtain second position information, and the second position information is a coordinate on the screen projection interface cached by the first device, so that the interface and display content of the operation action are determined.
The method for performing coordinate transformation may be to perform corresponding reduction according to a ratio between a first area of the screen projection interface and a second area of the screen projection interface displayed by the second device, so as to obtain second position information.
Step S402, determining a control on the first interface or the second interface aimed by the input operation according to the second position information.
After the second position information is obtained, determining a first interface or a second interface of the second position information in the screen projection interface according to the second position information, and further determining a control on the first interface or the second interface so as to control the first interface or the second interface.
Specifically, the first interface or the second interface targeted by the input operation may be updated according to the content of the control.
Referring to fig. 9, a schematic diagram of interaction between a first device and a second device according to another embodiment is provided. In the figure, the first device is a mobile phone, the second device is a television, a screen projection interface obtained by splicing a first interface displayed by the mobile phone and a hidden second interface is obtained, a display interface projected and displayed on the television by the screen projection interface is a display interface of the television in the figure, and the display contents in the screen projection interface and the display interface of the television are the same.
The content displayed in the display interface of the television is controlled through the control equipment of the television, the content displayed in the display interface is controlled according to the input operation of the control equipment, and the content in the first interface or the content in the second interface in the mobile phone is further controlled. In this embodiment, the control device of the television is a remote controller of the television, but may also be other control devices having the same function, for example, when the second device is a computer, the control device may also be a mouse or a keyboard.
The interaction process of the first device and the second device is realized through the interaction between the remote controller and the television (the remote controller interaction shown in the figure) and the interaction between the television and the mobile phone (the interaction synchronization shown in the figure). The first interface displayed by the mobile phone and the plurality of hidden second interfaces are projected to the television to be displayed, and multi-dimensional screen projection is achieved.
Referring to fig. 10 (please refer to fig. 6 at the same time), a schematic diagram of interaction between a first device and a second device according to another embodiment is provided. The first device in this embodiment is also a mobile phone, the second device is also a television, the content in the display interface of the television is controlled by the remote controller of the television, and the first interface, the second interface 1, the second interface 2, the second interface 3, or the second interface 4 is controlled according to the input operation of the remote controller. And then the television returns a control signal for controlling the first interface, the second interface 1, the second interface 2, the second interface 3 or the second interface 4 to the mobile phone, the mobile phone receives the control signal of the remote controller and controls the first interface or the second interface in the mobile phone according to the control signal, so that the interaction between the mobile phone and the television is realized.
Referring to fig. 11, in another embodiment, another screen projection method is also provided, which is performed by the second device. The screen projection method comprises the following steps:
step S600, receiving a screen projection interface sent by the first device, wherein the screen projection interface is formed by splicing a first interface displayed by the first device and a hidden second interface. The method comprises the steps that after a first interface displayed by first equipment is spliced with a hidden second interface, screen projection interfaces are obtained by the first equipment, then the screen projection interfaces are sent to second equipment, and the second equipment receives the screen projection interfaces.
And S700, enlarging and displaying a screen projection interface comprising a first interface and a second interface. And after receiving a screen projection interface sent by the first equipment, displaying the screen projection interface. Since the screen projection interface of the first device is projected to the second device for displaying in order to obtain a better use experience, the display screen of the second device is generally larger than that of the first device, and the screen projection interface of the second device needs to be enlarged and displayed. Specifically, two sides of the screen projection interface can be magnified in an equal ratio, that is, the magnification factors such as the long side and the short side are magnified, so that the content in the screen projection interface can be kept from being stretched or compressed.
Referring to fig. 12, in another embodiment, the screen projection method further includes:
step S800, receiving an input operation of the control device, wherein the input operation acts on a display interface of the second device, and the display interface is formed by a screen projection interface displayed by the second device.
And determining the platform interface displayed in the second equipment as a display interface, and performing interactive operation after displaying the screen projection interface sent by the first equipment.
And performing input operation on the display interface through the control equipment of the second equipment, and further controlling the content in the display interface.
And step S900, sending a control signal to the first device according to the input operation, wherein the control signal is used for triggering the first device to respond to the input operation.
After the control device of the second device performs the input operation, the second device may send a control signal corresponding to the input operation to the first device according to the input operation, and may trigger a response of the first device to the input operation according to the control signal, so as to control the relevant interface in the first device.
Further, the control signal may also carry first position information of the input operation acting on the display interface, where the first position information is used for the first device to determine that the input operation acts on the first interface or the second interface.
According to the input operation of the control device on the display interface of the second device, the position of the display interface acted on by the input operation can be determined. The control signal carrying the first position information of the input operation acting on the display interface is sent to the first device, so that the first device can determine the position of the input operation in the first device according to the first position, and further determine whether the input operation acts on the first interface or the second interface of the first device.
In another embodiment, the screen projection method may further include:
and determining whether the screen projection interface is displayed in a full screen mode or not according to the ratio of the number of pixels in the first direction to the number of pixels in the second direction of the screen projection interface, wherein the second direction is perpendicular to the first direction. The screen projection interface comprises a first interface and a second interface, and the screen projection interface is formed by splicing the first interface and the second interface, so that the number of pixels of the obtained screen projection interface in the horizontal direction and/or the vertical direction is uncertain. The first direction may be a horizontal direction, and the second direction may be a vertical direction; the first direction may be a vertical direction, and the second direction may be a horizontal direction.
And determining whether the screen projection interface can be displayed in a full screen mode according to the pixel number ratio of the pixel number in the first direction to the pixel number in the second direction of the screen projection interface. Specifically, whether the screen projection interface is displayed in a full screen mode is determined according to a pixel number ratio of the number of pixels in the first direction to the number of pixels in the second direction of the screen projection interface and a pixel number ratio of the number of pixels of the second device in the first direction to the number of pixels in the second direction.
And when the pixel number ratio of the pixel number of the first direction to the pixel number of the second direction of the screen projection interface is equal to the pixel number ratio of the second device in the first direction and the second direction, displaying the screen projection interface in a full screen mode. When the number ratio of the two pixels is the same, the screen projection interface can be directly amplified and displayed, and the screen projection interface can be displayed in a full screen mode.
When the ratio of the number of pixels in the first direction to the number of pixels in the second direction of the screen projection interface is not equal to the ratio of the number of pixels in the first direction to the number of pixels in the second direction of the second device, the magnification factor is determined according to the ratio of the number of pixels in the target direction of the screen projection interface to the number of pixels in the first direction of the second device. The target direction is a direction with more pixels in the first direction and the second direction in the screen projection interface. In this case, the screen projection interface cannot be displayed in full screen, and the enlargement factor needs to be determined based on the ratio of the number of pixels included in the direction in which the number of pixels in the screen projection interface is greater to the number of pixels of the second device in the first direction. And then, amplifying the screen projection interface according to the amplification factor, and determining the screen projection interface after the screen projection interface is displayed in the middle. By the method, the display effect of the second equipment display screen projection interface can be improved, and the visual experience of a user is improved.
The amplification factor is determined according to the number of pixels contained in the direction with more pixels in the screen projection interface and the number ratio of the pixels of the second device in the first direction, so that the content in the screen projection interface can be completely displayed after the amplification of the individual amplification factor. If the amplification factor needs to be determined according to the number of pixels contained in the direction with the smaller number of pixels in the screen projection interface and the number ratio of pixels of the second device in the first direction, after amplification is performed, the content in the direction with the larger number of pixels in the screen projection interface exceeds the display interface, and therefore the quality of the content displayed on the display interface is caused to be problematic.
In another embodiment, the screen projection method further comprises:
and sending the display size of the second device to the first device, wherein the display size is used for the first device to determine splicing parameters for splicing the first interface and the second interface. After the display size of the second device is sent to the first device, splicing parameters can be provided for the first device when the first interface and the second interface are spliced, so that a screen projection interface obtained by splicing the first interface and the second interface can be better displayed on the first device.
Referring to fig. 13, in another embodiment, there is also provided a screen projection apparatus including:
and the splicing module is used for splicing the first interface displayed by the first equipment and the hidden second interface to obtain a screen projection interface.
And the screen projection module is used for sending the screen projection interface to the second equipment. Other block diagrams are not shown.
Should throw the screen device and still include:
the interface determining module a is configured to determine a first layer displayed in the stacked multiple display layers as a first interface, and determine a second layer blocked by the first layer in the multiple display layers as a second interface.
The second interface and the first interface have content relevance.
The first interface is: a primary interface of a first device foreground application.
The second interface is: an interface to which an entry displayed on the main interface is connected, the entry comprising: a link address; and/or, a jump control.
Alternatively, the second interface is: and displaying an interactive page of the content on the main interface. The interactive page includes: the method comprises the steps of displaying a comment page of comment information of the displayed content on a main interface, displaying a bullet screen page of bullet screen information of the displayed content on the main interface, and/or displaying a detailed page of detailed content of the displayed subject matter on the main interface.
The interface determining module B is configured to determine a first interface and a second interface, where the first interface may further be: the first device foreground applies the displayed interface; the second interface is: and setting an application interface in the first equipment background application. Setting the application includes: an instant messaging application or, alternatively, a mail application.
Should throw the screen device and still include:
the splicing parameter acquisition module is used for acquiring splicing parameters; wherein, the splicing parameter at least comprises at least one of the following parameters: the number of the second interfaces, the position parameters of the first interface in the screen projection interface and the arrangement mode of the second interfaces.
Splicing a first interface displayed by the first device and a hidden second interface to obtain a screen projection interface, comprising:
and splicing the first interface displayed by the first equipment and the hidden second interface according to the splicing parameters to obtain a screen projection interface.
And the splicing parameter acquisition module is specifically used for determining splicing parameters according to the display size of the second equipment.
And the splicing module is specifically used for centrally arranging the first interface when a plurality of second interfaces are provided, and arranging the plurality of second interfaces around the first interface to form the spliced screen projection interface.
And the splicing module is further specifically configured to splice the updated first interface displayed by the first device and the hidden second interface to obtain the screen-projecting interface when detecting that the content of any interface of the first interface and the second interface is updated.
Should throw the screen device and still include:
and the control signal receiving module is used for receiving the control signal returned by the second equipment.
And the response module is used for responding according to the display content of the first interface or the second interface acted by the control signal. The control signals include: and the first position information of the input operation detected by the second equipment is converted into second position information according to the ratio of the first area of the screen projection interface to the second area of the screen projection interface displayed by the second equipment. And determining a control on the first interface or the second interface aimed at by the input operation according to the second position information.
And the updating module is used for updating the interface content of the first interface or the second interface acted by the control signal according to the response result. And updating the first interface or the second interface aimed by the input operation according to the content of the control.
Referring to fig. 14, in another embodiment, there is also provided a screen projection apparatus including:
the first receiving module is used for receiving a screen projection interface sent by first equipment, wherein the screen projection interface is as follows: the first interface displayed by the first device and the hidden second interface are spliced.
And the display module is used for magnifying and displaying the screen projection interface comprising the first interface and the second interface. Other block diagrams are not shown.
Should throw the screen device and still include:
the second receiving module is used for receiving input operation of the control equipment, wherein the input operation acts on a display interface of the second equipment; the display interface is formed by the second equipment displaying the screen projection interface.
And the control signal sending module is used for sending a control signal to the first equipment according to the input operation, wherein the control signal is used for triggering the first equipment to respond to the input operation. The control signal carries first position information of an input operation acting on a display interface, wherein the first position information is used for the first equipment to determine that the input operation acts on the first interface or the second interface.
Should throw the screen device and still include:
and the pixel number ratio determining module is used for determining whether the screen projection interface is displayed in a full screen mode or not according to the pixel number ratio of the first direction to the second direction of the screen projection interface, wherein the second direction is vertical to the first direction.
And when the pixel number ratio is equal to the pixel number ratio of the second device in the first direction and the second direction, displaying the screen projection interface in a full screen mode.
When the pixel number ratio is not equal to the pixel number ratio of the second device in the first direction and the second direction, determining an amplification factor according to the pixel number ratio of the screen projection interface in the target direction to the pixel number ratio of the second device in the first direction; the target direction is a direction with more pixels in a first direction and a second direction in the screen projection interface; amplifying the screen projection interface according to the amplification factor; and determining a screen projection interface after the display is centered and amplified.
Should throw the screen device and still include:
and the display size sending module is used for sending the display size of the second device to the first device, wherein the display size is used for the first device to determine splicing parameters for splicing the first interface and the second interface.
The technical scheme of this application still provides an electronic equipment, includes:
a processor;
a memory storing program instructions that, when executed by the processor, cause the electronic device to perform the method of any of the embodiments described above.
The technical solution of the present application further provides a storage medium storing a program, and when the program is executed by a processor, the method in any one of the embodiments described above is performed. The storage medium comprises a non-transitory storage medium.
In another embodiment, another method of screen projection is also provided.
The mobile phone small video or the mobile phone live broadcast is a popular mobile internet application platform at present, and the time for watching the mobile phone live broadcast or the small video is longer and longer. Because the screen of the mobile phone is too small, the experience of watching for a long time is poor, the mobile phone is projected into a television or a computer screen to watch, and the watching comfort level can be increased. However, the current mobile phone live broadcast rooms and small videos are all vertical screen interfaces, and after the mobile phone live broadcast rooms and small videos are put on a television, a display of the television cannot be completely utilized. And still need to accomplish on the cell-phone when carrying out the interaction, watching experience and interactive experience are not ideal.
The mobile phone television live broadcast, the small video or the shopping live broadcast are widely applied, and how to improve the watching experience of mobile phone interfaces such as the mobile phone live broadcast on the television or the computer is more and more important.
The disclosed embodiment of the invention provides a multi-dimensional screen projection display and interaction scheme, when a mobile phone is used for live broadcasting or watching a small video and various screen projection requirements exist, the content of a mobile phone screen is projected onto a television or a computer, and the content of different superposed display layers (overlays) in a live broadcasting room, such as audience interaction, a watching display, goods details of a main broadcast with goods, a main broadcast shop and interfaces of other contents recommended by nearby live broadcasting rooms or platforms, can be projected onto the television or the computer.
The scheme requires that the mobile phone application supports a novel layer rendering framework to realize screen rendering of the mobile phone application. The framework supports independent rendering and independent delivery of multiple display layers of a mobile phone application. When the screen is projected, the contents of different display layers can be conveniently and independently organized, and can be combined and presented on a television screen according to different modes as required, so that the large-screen watching experience of a user is improved.
The scheme also supports a control device, such as a remote controller, to perform input operation on the content in different areas in the television display interface and then perform control. And the television returns the control signal of the input operation to the mobile phone, and the mobile phone controls the first interface and the second interface according to the received control signal.
Specifically, the first interface and the second interface may be preset in the foreground application, and the first interface and the second interface may be switched as needed. And then splicing the first interface and the second interface to obtain a screen projection interface. For example, a new composite picture object may be created in a device video memory (usually shared with a memory), video memory data of different interfaces may be spliced to obtain spliced screen projection data, and the interface participating in splicing may be displayed through the screen projection data. Namely, the data of the first interface and the data of the second interface are spliced to obtain the data of the screen projection interface. Refer to fig. 5.
After the screen projection interface is obtained, the multi-screen projection process can be completed by transmitting the screen projection interface to display equipment such as a television in a projection interface, Bluetooth, wifi and other modes.
According to the scheme, the content displayed on the screen by the mobile phone application can be decomposed into the multiple display layers, and the multiple display layers are reorganized and spliced and projected to the television. The second device may display the screen projection interface according to pixel information of the screen projection interface and pixel information of a display screen of the second device. When the multi-dimensional mobile phone content is projected to a large television screen, the content in different areas can be re-rendered to adapt to television pictures, and the content is matched with other content (video or other dimension projection content), and even multiple display and organization modes can be provided, such as parallel, three-dimensional, multi-grid, left-right switching, front-back switching and the like.
After the mobile phone is projected to the screen, interaction is not needed through the mobile phone, but the mobile phone can interact with the television through the television remote controller, actual interaction is synchronized to the mobile phone side, and therefore complete interaction experience is achieved.
On one hand, redundant pictures on a television or a computer screen are fully utilized, on the other hand, the watching experience of a user is also increased, and more importantly, the user can also interact with the contents of a screen projection interface of the mobile phone through a television remote controller or a computer mouse, such as appreciation, praise, information distribution, small shop browsing, shopping or simultaneously looking up other live broadcast or small video contents and the like, so that the watching experience and the interactive experience of the user to the television through screen projection of the mobile phone are greatly improved.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all the functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may be separately used as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
In some cases, any two of the above technical features may be combined into a new method solution without conflict.
In some cases, any two of the above technical features may be combined into a new device solution without conflict.
Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: various media capable of storing program codes, such as a removable Memory device, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, and an optical disk.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.

Claims (26)

1. A screen projection method, comprising:
splicing a first interface displayed by the first equipment and a hidden second interface to obtain a screen projection interface;
and sending the screen projection interface to second equipment.
2. The method of claim 1, further comprising:
determining a first layer displayed in a plurality of stacked display layers as the first interface, and determining a second layer shielded by the first layer in the plurality of display layers as the second interface.
3. The method of claim 1 or 2, wherein the second interface has a content association with the first interface.
4. The method of claim 3,
the first interface is: a primary interface of the first device foreground application;
the second interface is: the interface connected with the inlet displayed on the main interface; alternatively, the second interface is: and displaying an interactive page of the content on the main interface.
5. The method of claim 4, wherein the inlet comprises:
a link address; and/or the presence of a gas in the gas,
and (6) jumping the control.
6. The method of claim 4, wherein the interactive page comprises:
displaying a comment page of comment information of the displayed content on the main interface;
displaying a bullet screen page of bullet screen information of the display content on the main interface; and/or the presence of a gas in the gas,
and displaying a detailed page for showing the detailed content of the subject matter on the main interface.
7. The method of claim 1, wherein the first interface is: the first device foreground applies the displayed interface; the second interface is: and setting an application interface in the first equipment background application.
8. The method of claim 7, wherein the setting up the application comprises:
an instant messaging application;
alternatively, the first and second electrodes may be,
a mail application.
9. The method of claim 1, further comprising:
acquiring splicing parameters; wherein the splicing parameters at least comprise at least one of: the number of the second interfaces, the position parameters of the first interface in the screen projection interface and the arrangement mode of the second interfaces;
the splicing of the first interface displayed by the first device and the hidden second interface to obtain the screen projection interface comprises the following steps:
and splicing the first interface displayed by the first equipment and the hidden second interface according to the splicing parameters to obtain a screen projection interface.
10. The method of claim 9, wherein the obtaining the splicing parameter comprises:
and determining the splicing parameters according to the display size of the second equipment.
11. The method of claim 1, wherein the second interface is plural;
the splicing of the first interface displayed by the first device and the hidden second interface to obtain the screen projection interface comprises the following steps:
the first interface is arranged in the center, and the plurality of second interfaces are arranged around the first interface to form the spliced screen projection interface.
12. The method of claim 1, wherein the splicing the first interface displayed by the first device and the hidden second interface to obtain the screen-projection interface comprises:
and when detecting that the content of any interface in the first interface and the second interface is updated, splicing the updated first interface displayed by the first device and the hidden second interface to obtain the screen projection interface.
13. The method of claim 1, further comprising:
receiving a control signal returned by the second equipment;
responding according to the display content of the first interface or the second interface acted by the control signal;
and updating the interface content of the first interface or the second interface acted by the control signal according to the response result.
14. The method of claim 13,
the control signal includes: first position information of an input operation detected by the second device;
the responding according to the display content of the first interface or the second interface acted by the control signal comprises the following steps:
converting the first position information into second position information according to a ratio between a first area of the screen projection interface and a second area of the screen projection interface displayed by the second equipment;
and determining a control on the first interface or the second interface aimed at by the input operation according to the second position information.
15. The method of claim 14, wherein updating the interface content of the first interface or the second interface acted on by the control signal according to the result of the response comprises:
and updating the first interface or the second interface aimed at by the input operation according to the content of the control.
16. A screen projection method, comprising:
receiving a screen projection interface sent by first equipment, wherein the screen projection interface is as follows: the first interface displayed by the first equipment and the hidden second interface are spliced to form the interface;
and displaying the screen projection interface comprising the first interface and the second interface in an enlarged mode.
17. The method of claim 16, further comprising:
receiving an input operation of a control device acting on a display interface of the second device; the display interface is formed by the second equipment displaying the screen projection interface;
and sending a control signal to the first equipment according to the input operation, wherein the control signal is used for triggering the first equipment to respond to the input operation.
18. The method according to claim 17, wherein the control signal carries first position information of the input operation acting on the display interface, and wherein the first position information is used for the first device to determine that the input operation acts on the first interface or the second interface.
19. The method of claim 16, further comprising:
and determining whether the screen projection interface is displayed in a full screen mode or not according to the ratio of the number of pixels in the first direction to the number of pixels in the second direction of the screen projection interface, wherein the second direction is perpendicular to the first direction.
20. The method of claim 19, wherein the determining whether to display the screen-casting interface in a full screen according to a ratio of a number of pixels in a first direction to a number of pixels in a second direction of the screen-casting interface, wherein the second direction is perpendicular to the first direction comprises:
and when the pixel number ratio is equal to the pixel number ratio of the second device in the first direction and the second direction, displaying the screen projection interface in a full screen mode.
21. The method of claim 19, wherein the determining whether to display the screen-casting interface in a full screen according to a ratio of a number of pixels in a first direction to a number of pixels in a second direction of the screen-casting interface, wherein the second direction is perpendicular to the first direction comprises:
when the pixel number ratio is not equal to the pixel number ratio of the second device in the first direction and the second direction, determining an amplification factor according to the pixel number ratio of the screen projection interface in the target direction to the pixel number ratio of the second device in the first direction; the target direction is a direction with more pixels in a first direction and a second direction in the screen projection interface;
amplifying the screen projection interface according to the amplification factor;
and determining the screen projecting interface after the screen is displayed and amplified in the middle.
22. The method of claim 16, further comprising:
and sending the display size of the second device to the first device, wherein the display size is used for the first device to determine splicing parameters for splicing the first interface and the second interface.
23. A screen projection apparatus, comprising:
the splicing module is used for splicing a first interface displayed by the first equipment and a hidden second interface to obtain a screen projection interface;
and the screen projection module is used for sending the screen projection interface to the second equipment.
24. A screen projection apparatus, comprising:
the receiving module is used for receiving a screen projection interface sent by first equipment, wherein the screen projection interface is as follows: the first interface displayed by the first equipment and the hidden second interface are spliced to form the interface;
and the display module is used for magnifying and displaying the screen projection interface comprising the first interface and the second interface.
25. An electronic device, comprising:
a processor;
a memory storing program instructions that, when executed by the processor, cause the electronic device to perform the method of any of claims 1-15 or 16-22.
26. A storage medium storing a program which, when executed by a processor, performs the method of any one of claims 1 to 15 or 16 to 22.
CN202010833253.2A 2020-08-18 2020-08-18 Screen projection method and device, electronic equipment and storage medium Pending CN112261466A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010833253.2A CN112261466A (en) 2020-08-18 2020-08-18 Screen projection method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010833253.2A CN112261466A (en) 2020-08-18 2020-08-18 Screen projection method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN112261466A true CN112261466A (en) 2021-01-22

Family

ID=74224701

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010833253.2A Pending CN112261466A (en) 2020-08-18 2020-08-18 Screen projection method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN112261466A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114915825A (en) * 2021-02-08 2022-08-16 上海哔哩哔哩科技有限公司 Message display method and device
WO2022206762A1 (en) * 2021-03-31 2022-10-06 华为技术有限公司 Display method, electronic device and system
WO2023109559A1 (en) * 2021-12-13 2023-06-22 华为技术有限公司 Display method and electronic device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130232437A1 (en) * 2012-03-04 2013-09-05 Lg Electronics Inc. Portable device and control method thereof
CN110515576A (en) * 2019-07-08 2019-11-29 华为技术有限公司 Display control method and device
CN110908627A (en) * 2019-10-31 2020-03-24 维沃移动通信有限公司 Screen projection method and first electronic device
CN111327769A (en) * 2020-02-25 2020-06-23 北京小米移动软件有限公司 Multi-screen interaction method and device and storage medium
CN111432070A (en) * 2020-03-17 2020-07-17 北京百度网讯科技有限公司 Application screen projection control method, device, equipment and medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130232437A1 (en) * 2012-03-04 2013-09-05 Lg Electronics Inc. Portable device and control method thereof
CN110515576A (en) * 2019-07-08 2019-11-29 华为技术有限公司 Display control method and device
CN110908627A (en) * 2019-10-31 2020-03-24 维沃移动通信有限公司 Screen projection method and first electronic device
CN111327769A (en) * 2020-02-25 2020-06-23 北京小米移动软件有限公司 Multi-screen interaction method and device and storage medium
CN111432070A (en) * 2020-03-17 2020-07-17 北京百度网讯科技有限公司 Application screen projection control method, device, equipment and medium

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114915825A (en) * 2021-02-08 2022-08-16 上海哔哩哔哩科技有限公司 Message display method and device
WO2022206762A1 (en) * 2021-03-31 2022-10-06 华为技术有限公司 Display method, electronic device and system
WO2023109559A1 (en) * 2021-12-13 2023-06-22 华为技术有限公司 Display method and electronic device

Similar Documents

Publication Publication Date Title
CN112261466A (en) Screen projection method and device, electronic equipment and storage medium
US10469891B2 (en) Playing multimedia content on multiple devices
US8255825B2 (en) Content aware adaptive display
CN107113477B (en) Moving image playback method, apparatus, and computer-readable storage medium
US8736658B2 (en) Image-based video conference control method, terminal, and system
JP5732129B2 (en) Zoom display navigation
WO2019027202A1 (en) Synchronizing holographic displays and 3d objects with physical video panels
CN107040808B (en) Method and device for processing popup picture in video playing
CN109754298B (en) Interface information providing method and device and electronic equipment
CN113840154A (en) Live broadcast interaction method and system based on virtual gift and computer equipment
CN109754275B (en) Data object information providing method and device and electronic equipment
CN101652990A (en) Mpeg-based user interface device and method of controlling function using the same
US20100201713A1 (en) Image display apparatus and method thereof
US11928381B2 (en) Display device and operating method thereof
JP2021530922A (en) Change the operation of the playback device Change the replacement media content playback in response to the detection of the remote control signal
WO2011018888A1 (en) Display control device and display control method
US20220229540A1 (en) Display Control Device And Display Control Method
CN105208453A (en) Method and device for displaying interaction feedback information of television interaction system
KR20110010012A (en) Method for displaying user interface using image blending
KR20150090314A (en) Advertising method using smart display having division area changing module
US20210224525A1 (en) Hybrid display system with multiple types of display devices
KR20180039939A (en) Display apparatus and method for generating capture image
US20100088602A1 (en) Multi-Application Control
KR20150044861A (en) Smart display
CN116233526A (en) Display equipment and signal source list display method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination