CN112181343A - Display method, display device, electronic apparatus, and storage medium - Google Patents

Display method, display device, electronic apparatus, and storage medium Download PDF

Info

Publication number
CN112181343A
CN112181343A CN202011104854.6A CN202011104854A CN112181343A CN 112181343 A CN112181343 A CN 112181343A CN 202011104854 A CN202011104854 A CN 202011104854A CN 112181343 A CN112181343 A CN 112181343A
Authority
CN
China
Prior art keywords
source device
displayed
content
relative position
target display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011104854.6A
Other languages
Chinese (zh)
Other versions
CN112181343B (en
Inventor
杨俊拯
钟卫东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202011104854.6A priority Critical patent/CN112181343B/en
Publication of CN112181343A publication Critical patent/CN112181343A/en
Priority to PCT/CN2021/112258 priority patent/WO2022078039A1/en
Application granted granted Critical
Publication of CN112181343B publication Critical patent/CN112181343B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application discloses a display method, a display device, electronic equipment and a storage medium, and relates to the technical field of electronic equipment. The method is applied to the target display device, and comprises the following steps: the method comprises the steps of obtaining a first relative position relation between first source equipment and target display equipment and a second relative position relation between second source equipment and the target display equipment, determining a display layout based on the first relative position relation and the second relative position relation, obtaining first content to be displayed related to the first source equipment and second content to be displayed related to the second source equipment, and displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the display layout. According to the method and the device, the display layout is determined according to the relative position relation between the target display device and the source device, and the content to be displayed associated with the source device is displayed based on the display layout, so that the content to be displayed is displayed at the position where the target display device is matched with the source device, and the use experience of a user is improved.

Description

Display method, display device, electronic apparatus, and storage medium
Technical Field
The present application relates to the field of electronic device technologies, and in particular, to a display method and apparatus, an electronic device, and a storage medium.
Background
At present, the screen projection function is widely applied to electronic equipment. For example, a user may project a display interface in a source device (e.g., a mobile phone) to a target display device (e.g., a television) for display, so that the user can view display content in the source device on the target display device conveniently. In addition, with the development of screen projection technology, in a screen projection application scene, display contents in a plurality of source devices can be projected to the same target display device for display. However, when the target display device displays the display content projected by the plurality of source devices, the display is disordered, which not only affects the display effect, but also reduces the user experience.
Disclosure of Invention
In view of the above problems, the present application provides a display method, an apparatus, an electronic device, and a storage medium to solve the above problems.
In a first aspect, an embodiment of the present application provides a display method, which is applied to a target display device, and the method includes: acquiring a first relative position relation between first source equipment and target display equipment and a second relative position relation between second source equipment and the target display equipment, wherein the target display equipment is in communication connection with the first source equipment and the second source equipment respectively; determining a display layout based on the first relative positional relationship and the second relative positional relationship; acquiring first content to be displayed associated with first source equipment and second content to be displayed associated with second source equipment; and displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the display layout.
In a second aspect, an embodiment of the present application provides a display apparatus, which is applied to a target display device, and the apparatus includes: the system comprises a relative position relation acquisition module, a first position relation acquisition module and a second position relation acquisition module, wherein the relative position relation acquisition module is used for acquiring a first relative position relation between a first source device and a target display device and a second relative position relation between a second source device and the target display device, and the target display device is respectively in communication connection with the first source device and the second source device; a display layout determining module for determining a display layout based on the first relative positional relationship and the second relative positional relationship; the device comprises a to-be-displayed content acquisition module, a display module and a display module, wherein the to-be-displayed content acquisition module is used for acquiring a first to-be-displayed content associated with a first source device and a second to-be-displayed content associated with a second source device; and the content to be displayed display module is used for displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the display layout.
In a third aspect, an embodiment of the present application provides an electronic device, which includes a memory and a processor, the memory is coupled to the processor, the memory stores instructions, and the processor executes the above method when the instructions are executed by the processor.
In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which a program code is stored, and the program code can be called by a processor to execute the method.
The display method, the display apparatus, the electronic device, and the storage medium provided in the embodiments of the present application determine a display layout based on a first relative positional relationship between a first source device and a target display device and a second relative positional relationship between a second source device and the target display device, obtain a first content to be displayed associated with the first source device and a second content to be displayed associated with the second source device, and display the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed, and the display layout, so as to determine the display layout according to the relative positional relationship between the target display device and the source device, and display the content to be displayed associated with the source device based on the display layout, so that the content to be displayed is displayed at a position where the target display device and the source device are adapted, the use experience of the user is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a schematic diagram illustrating an application environment of a display method provided by an embodiment of the present application;
FIG. 2 is a flow chart illustrating a display method according to an embodiment of the present application;
FIG. 3 is a schematic diagram illustrating an application environment of a first display method provided by an embodiment of the present application;
FIG. 4 is a schematic diagram illustrating an application environment of a second display method provided by an embodiment of the present application;
FIG. 5 is a schematic diagram illustrating an application environment of a third display method provided by an embodiment of the present application;
FIG. 6 is a flow chart illustrating a display method according to another embodiment of the present application;
FIG. 7 is a flow chart illustrating a display method according to still another embodiment of the present application;
FIG. 8 is a flow chart illustrating a display method according to another embodiment of the present application;
fig. 9 is a schematic application environment diagram illustrating a fourth display method provided in the embodiment of the present application;
FIG. 10 is a flow chart illustrating a display method according to yet another embodiment of the present application;
fig. 11 is a schematic application environment diagram illustrating a fifth display method provided in the embodiment of the present application;
fig. 12 is a schematic application environment diagram illustrating a sixth display method provided in an embodiment of the present application;
FIG. 13 is a flow chart illustrating a display method provided by yet another embodiment of the present application;
fig. 14 is a schematic application environment diagram illustrating a seventh display method provided in the embodiment of the present application;
FIG. 15 is a flow chart illustrating a display method according to yet another embodiment of the present application;
fig. 16 is a schematic application environment diagram illustrating an eighth display method provided in the embodiment of the present application;
fig. 17 is a schematic application environment diagram illustrating a ninth display method provided in the embodiment of the present application;
FIG. 18 is a flow chart illustrating a display method provided by yet another embodiment of the present application;
FIG. 19 is a schematic diagram illustrating an angle of a source device relative to a target display device according to an embodiment of the present application;
FIG. 20 is a flow chart illustrating a display method provided by yet another embodiment of the present application;
FIG. 21 is a schematic diagram illustrating an angle of a first source device relative to a target display device according to an embodiment of the present application;
fig. 22 shows a flowchart of step S920 of the display method shown in fig. 20 of the present application;
FIG. 23 is a schematic diagram illustrating an angle of a second source device with respect to a target display device according to an embodiment of the present application;
fig. 24 shows a flowchart of step S950 of the display method shown in fig. 20 of the present application;
FIG. 25 is a flow chart illustrating a display method provided by yet another embodiment of the present application;
fig. 26 is a block diagram illustrating a display device according to an embodiment of the present application;
fig. 27 is a block diagram of an electronic device according to an embodiment of the present application, configured to execute a display method according to an embodiment of the present application;
fig. 28 illustrates a storage unit for storing or carrying program codes for implementing a display method according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
When the target display device displays the display content projected by the plurality of source devices, a situation that the display position of the display content on the target display device is inconsistent with the actual position of the source device may occur, for example, the display content projected by the source device positioned on the left side of the target display device is displayed on the right side of the target display device, the display content projected by the source device positioned on the right side of the target display device is displayed on the left side of the target display device, and the like.
In view of the above problems, the inventor finds and provides a display method, a display apparatus, an electronic device, and a storage medium provided in the embodiments of the present application through long-term research, and determines a display layout according to a relative positional relationship between a target display device and a source device, and displays a content to be displayed associated with the source device based on the display layout, so that the content to be displayed is displayed at a position where the target display device and the source device are adapted to each other, thereby improving user experience. Specific display methods are described in detail in the following examples.
The following description is directed to an application environment applicable to the display method provided in the embodiments of the present application.
Referring to fig. 1, fig. 1 is a schematic diagram illustrating an application environment applicable to a display method provided by an embodiment of the present application. As shown in fig. 1, the application scenario may include a target display device 100 and a plurality of source devices 200. The target display device 100 may be a smart television as shown in fig. 1, and of course, the target display device 100 may also be other devices having a display function, for example, a desktop computer, a notebook computer, and the like, which is not limited herein. The source device 200 may be a smart phone, a tablet computer, a smart watch, a computer, or the like. In this application scenario, the source device 200 may act as a content providing device to project display content to the target display device 100 for display. Of course, the source device 200 may also transmit audio content to the target display device 100 for playback.
In some embodiments, the target display device 100 and the source device 200 may communicate to accomplish data interaction. The target display device 100 and the source device 200 may communicate with each other through a Local Area Network (LAN) or a Wide Area Network (WAN). For example, the target display apparatus 100 and the source apparatus 200 may be connected to one router at the same time, and the target display apparatus 100 and the source apparatus 200 may communicate through a local area network provided by the router; for another example, the target display device 100 and the source device 200 may communicate with a cloud, and implement data interaction between the two through the cloud; for another example, the target display device 100 and the source device 200 may also establish an end-to-end network connection (i.e., a P2P network connection) through a communication manner such as bluetooth, Zigbee, WebRTC, and the like, and perform communication through the established network connection. Of course, the communication manner between the target display apparatus 100 and the source apparatus 200 may not be limited.
In some scenarios, the target display device 100 may be a large-screen device (e.g., a smart television shown in fig. 1), and a user may project display content on a small-screen device such as a smart phone, a tablet computer, and a smart watch to the large-screen device for displaying, so as to improve experience of the user when viewing the display content. In addition, the target display device 100 may receive the content projected by the plurality of source devices 200 at the same time, and display the content projected by the plurality of source devices 200, so that the content projected by the plurality of source devices 200 may be projected to the target display device 100 for display, a user may view the content projected by the plurality of source devices 200 at the same time, and user experience is greatly improved.
In some embodiments, the target display device 100 may perform a display layout (for example, a layout position, a size of a display area, and the like) on the display content input by the plurality of source devices according to the received display content of the plurality of source devices 100, and then render the display content input by the plurality of source devices based on the display layout and display the rendered display content on the display screen.
Referring to fig. 2, fig. 2 is a schematic flow chart illustrating a display method according to an embodiment of the present application. The display method is used for determining the display layout according to the relative position relation between the target display equipment and the source equipment, and displaying the content to be displayed associated with the source equipment based on the display layout, so that the content to be displayed is displayed at the position where the target display equipment is matched with the source equipment, and the use experience of a user is improved. In a specific embodiment, the display method is applied to the display device 500 shown in fig. 26 and the electronic apparatus 100 (fig. 27) provided with the display device 500. The following will describe a specific flow of the present embodiment by taking the target display device as an example, and it is understood that the target display device applied in the present embodiment may be a mobile terminal, a television, a desktop computer, a tablet computer, a projection device, and the like, which is not limited herein. As will be described in detail with respect to the flow shown in fig. 2, the display method may specifically include the following steps:
step S110: the method comprises the steps of obtaining a first relative position relation between first source equipment and target display equipment and a second relative position relation between second source equipment and the target display equipment, wherein the target display equipment is in communication connection with the first source equipment and the second source equipment respectively.
In this embodiment, the first relative positional relationship may be used to represent a relative distance and a relative angle between the first source device and the target display device, and the second relative positional relationship may be used to represent a relative distance and a relative angle between the second source device and the target display device.
In some embodiments, the first source device may be located right in front of the target display device, may be located left in front of the target display device, may be located right in front of the target display device, may be located above and below the target display device, and the like, and the second source device may be located right in front of the target display device, may be located left in front of the target display device, may be located right in front of the target display device, may be located above and above the target display device, may be located below and above the target display device, and the like, without limitation.
As a first way, the target display device may include a first Ultra Wide Band (UWB), the first source device may include a second UWB sensor, and the second source device may include a third UWB sensor, so that a first relative positional relationship between the first source device and the target display device may be obtained through the first and second UWB sensors, and a second relative positional relationship between the second source device and the target display device may be obtained through the first and third UWB sensors.
As a second way, the target display device may include an image capturing device, and a first relative positional relationship between the first source device and the target display device and a second relative positional relationship between the second source device and the target display device may be obtained through the image capturing device.
Step S120: determining a display layout based on the first relative positional relationship and the second relative positional relationship.
In some embodiments, the display layout determined based on the first relative positional relationship and the second relative positional relationship may include: the display position of the first content to be displayed associated with the first source device on the target display device, the display position of the second content to be displayed associated with the second source device on the target display device, the size of the display area of the first content to be displayed associated with the first source device on the target display device, the size of the display area of the second content to be displayed associated with the second source device on the target display device, and the like, and the display parameters of the first content to be displayed associated with the first source device on the target display device, the display parameters of the second content to be displayed associated with the second source device on the target display device, and the like are not limited herein.
In this embodiment, after acquiring the first relative positional relationship between the first source device and the target display device and the second relative positional relationship between the second source device and the target display device, the display layout may be determined based on the first relative positional relationship and the second relative positional relationship. By way of one approach, when the first relative positional relationship characterizes that the first source device is positioned in front left of the target display device and the second relative positional relationship characterizes that the second source device is positioned in front right of the target display device, then the display layout determined based on the first relative positional relationship and the second relative positional relationship may include: the first content to be displayed associated with the first source device is located in the left area of the target display device at the display position of the target display device, the second content to be displayed associated with the second source device is located in the right area of the target display device at the display position of the target display content, and the like, which are not limited herein.
Step S130: first content to be displayed associated with a first source device and second content to be displayed associated with a second source device are obtained.
In this embodiment, the target display device may acquire a first content to be displayed associated with the first source device and a second content to be displayed associated with the second source device. As one mode, the target display device may obtain content to be displayed, which is sent by the first source device in a wired or wireless manner, and use the content to be displayed as first content to be displayed associated with the first source device, and in addition, the target display device may obtain content to be displayed, which is sent by the second source device in a wired or wireless manner, and use the content to be displayed as second content to be displayed associated with the second source device.
In some embodiments, the first content to be displayed may be static content, such as a static picture, or dynamic content, such as a dynamic video, and the second content to be displayed may be static content, such as a static picture, or dynamic content, such as a dynamic video.
In some embodiments, the first content to be displayed may include: video, music, documents, games, etc., the second content to be displayed may include: video, music, documents, games, etc., without limitation thereto.
Step S140: and displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the display layout.
In this embodiment, after the first content to be displayed associated with the first source device, the second content to be displayed associated with the second source device, and the display layout are acquired, the first content to be displayed and the second content to be displayed may be displayed based on the first content to be displayed, the second content to be displayed, and the display layout.
In some implementations, the relative position of the first content to be displayed and the second content to be displayed when displayed is the same as the relative position of the first source device and the second source device. For example, when the relative positions of the first source device and the second source device are: the first source device is located to the left of the second source device, and the first content to be displayed is located to the left of the second content to be displayed. For another example, when the relative positions of the first source device and the second source device are: the first source device is located on the right side of the second source device, and the relative distance between the first source device and the second source device is a first distance, then the first content to be displayed is located on the right side of the second content to be displayed, and the relative distance between the first content to be displayed and the second content to be displayed is a distance obtained after the first distance is scaled according to a specified scale, that is, when the relative distance between the first source device and the second source device is farther, the relative distance between the first content to be displayed and the second content to be displayed is also farther, and when the relative distance between the first source device and the second source device is closer, the relative distance between the first content to be displayed and the second content to be displayed is also closer.
Referring to fig. 3, fig. 3 is a schematic view illustrating an application scenario of a first display method according to an embodiment of the present application. As shown in fig. 3, when the first source device 210 is located at the left side of the target display device 100 and the second source device 220 is located at the right side of the target display device 100, the first content to be displayed "a" associated with the first source device 210 may be displayed at the left area of the target display device 100 and the second content to be displayed "B" associated with the second source device 220 may be displayed at the right area of the target display device 100.
Referring to fig. 4, fig. 4 is a schematic view illustrating an application scenario of a second display method according to an embodiment of the present application. As shown in fig. 4, when the first source device 210 is located at the right side of the target display device 100 and the second source device 220 is located at the left side of the target display device 100, the first content to be displayed "a" associated with the first source device 210 may be displayed at the right region of the target display device 100 and the second content to be displayed "B" associated with the second source device 220 may be displayed at the left region of the target display device 100.
Referring to fig. 5, fig. 5 is a schematic view illustrating an application scenario of a third display method according to an embodiment of the present application. As shown in fig. 5, when the first source device 210 is located at the right side of the target display device 100 and the second source device 220 is located at the right side of the target display device, if the first source device 210 is located at the left side of the second source device 200, the first content to be displayed "a" associated with the first source device 210 may be displayed at the left area of the target display device 100 and the second content to be displayed "B" associated with the second source device 220 may be displayed at the right area of the target display device 100.
In the display method provided in an embodiment of the present application, a display layout is determined based on a first relative positional relationship between a first source device and a target display device and a second relative positional relationship between a second source device and the target display device, a first content to be displayed associated with the first source device and a second content to be displayed associated with the second source device are obtained, the first content to be displayed and the second content to be displayed are displayed based on the first content to be displayed, the second content to be displayed and the display layout, thereby determining a display layout according to the relative positional relationship between the target display device and the source device, and displaying the content to be displayed associated with the source device based on the display layout, therefore, the content to be displayed is displayed at the position where the target display equipment is matched with the source equipment, and the use experience of a user is improved.
Referring to fig. 6, fig. 6 is a schematic flow chart illustrating a display method according to another embodiment of the present application. The method is applied to the target display device, and will be described in detail with respect to the flow shown in fig. 6, and the display method may specifically include the following steps:
step S210: the method comprises the steps of obtaining a first relative position relation between first source equipment and target display equipment and a second relative position relation between second source equipment and the target display equipment, wherein the target display equipment is in communication connection with the first source equipment and the second source equipment respectively.
Step S220: determining a display layout based on the first relative positional relationship and the second relative positional relationship.
Step S230: first content to be displayed associated with a first source device and second content to be displayed associated with a second source device are obtained.
Step S240: and displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the display layout.
For detailed descriptions of steps S510 to S540, refer to steps S110 to S140, which are not described herein again.
Step S250: and when the relative position relationship between the first source equipment and the target display equipment is changed, acquiring a third relative position relationship between the first source equipment and the target display equipment.
In this embodiment, in the process of displaying a first content to be displayed associated with a first source device and a second content to be displayed associated with a second source device, a target display device may continue to monitor a relative position relationship between the first source device and the target display device to determine whether the relative position relationship between the first source device and the target display device changes, where when a monitoring result indicates that the relative position relationship between the first source device and the target display device changes, a third relative position relationship between the first source device and the target display device may be obtained.
In some embodiments, the relative position relationship between the first source device and the target display device may be monitored in real time, the relative position relationship between the first source device and the target display device may be monitored at preset time intervals, the relative position relationship between the first source device and the target display device may be monitored at specified time, the relative position relationship between the first source device and the target display device may be monitored according to other preset rules, and the like, which is not limited herein.
In some embodiments, when it is monitored that the relative distance between the first source device and the target display device changes, it may be determined that the relative positional relationship between the first source device and the target display device changes; when the relative angle between the first source device and the target display device is monitored to be changed, the change of the relative position relationship between the first source device and the target display device can be determined; when the relative distance or the relative angle between the first source device and the target display device is monitored to be changed, it can be determined that the relative position relationship between the first source device and the target display device is changed.
In some embodiments, when it is monitored that the relative distance between the first source device and the target display device changes, it may be determined whether the changed distance between the first source device and the target display device exceeds a first distance, where when the determination result indicates that the changed distance between the first source device and the target display device exceeds the first distance, it may be determined that the relative positional relationship between the first source device and the target display device changes; when it is monitored that the relative angle between the first source device and the target display device changes, whether the changed angle between the first source device and the target display device exceeds a first angle or not can be judged, wherein when the judgment result represents that the changed angle between the first source device and the target display device exceeds the first angle, it can be determined that the relative position relationship between the first source device and the target display device changes.
Step S260: determining the first current display layout based on the third relative positional relationship and the second relative positional relationship.
In this embodiment, after the third relative positional relationship between the first source device and the target display device and the second relative positional relationship between the second source device and the target display device are obtained, the first current display layout may be determined based on the third relative positional relationship and the second relative positional relationship.
In some implementations, the first current display layout determined based on the third relative positional relationship and the second relative positional relationship may include: the display position of the first content to be displayed associated with the first source device on the target display device, the display position of the second content to be displayed associated with the second source device on the target display device, the size of the display area of the first content to be displayed associated with the first source device on the target display device, the size of the display area of the second content to be displayed associated with the second source device on the target display device, and the like, and the display parameters of the first content to be displayed associated with the first source device on the target display device, the display parameters of the second content to be displayed associated with the second source device on the target display device, and the like are not limited herein.
Step S270: and displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the first current display layout.
In this embodiment, since the target display device has already acquired the first content to be displayed associated with the first source device and the second content to be displayed associated with the second source device, after acquiring the first current display layout, the first content to be displayed and the second content to be displayed may be displayed based on the first content to be displayed, the second content to be displayed, and the first current display layout.
Compared with the display method shown in fig. 2, in the display method provided in another embodiment of the present application, when the relative position relationship between the first source device and the target display device changes, the display layout is determined again based on the changed relative position relationship, and the content to be displayed is displayed, so as to improve the real-time performance of displaying the content to be displayed on the position where the target display device and the source device are adapted to each other, and improve the user experience.
Referring to fig. 7, fig. 7 is a schematic flow chart illustrating a display method according to still another embodiment of the present application. The method is applied to the target display device, and will be described in detail with respect to the flow shown in fig. 7, and the display method may specifically include the following steps:
step S310: the method comprises the steps of obtaining a first relative position relation between first source equipment and target display equipment and a second relative position relation between second source equipment and the target display equipment, wherein the target display equipment is in communication connection with the first source equipment and the second source equipment respectively.
Step S320: determining a display layout based on the first relative positional relationship and the second relative positional relationship.
Step S330: first content to be displayed associated with a first source device and second content to be displayed associated with a second source device are obtained.
Step S340: and displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the display layout.
For detailed description of steps S310 to S340, please refer to steps S110 to S140, which are not described herein again.
Step S350: and when the relative position relationship between the second source device and the target display device changes, acquiring a fourth relative position relationship between the second source device and the target display device.
In this embodiment, in the process of displaying a first content to be displayed associated with a first source device and a second content to be displayed associated with a second source device, a target display device may continue to monitor a relative position relationship between the second source device and the target display device to determine whether the relative position relationship between the second source device and the target display device changes, where when a monitoring result indicates that the relative position relationship between the second source device and the target display device changes, a fourth relative position relationship between the second source device and the target display device may be obtained.
In some embodiments, the relative position relationship between the second source device and the target display device may be monitored in real time, the relative position relationship between the second source device and the target display device may be monitored at preset time intervals, the relative position relationship between the second source device and the target display device may be monitored at specified time, the relative position relationship between the second source device and the target display device may be monitored according to other preset rules, and the like, which is not limited herein.
In some embodiments, when it is monitored that the relative distance between the second source device and the target display device changes, it may be determined that the relative positional relationship between the second source device and the target display device changes; when the relative angle between the second source device and the target display device is monitored to be changed, the change of the relative position relationship between the second source device and the target display device can be determined; when it is monitored that both the relative distance or the relative angle between the second source device and the target display device changes, it can be determined that the relative positional relationship between the second source device and the target display device changes.
In some embodiments, when it is monitored that the relative distance between the second source device and the target display device changes, it may be determined whether the changed distance between the second source device and the target display device exceeds a second distance, where when the determination result indicates that the changed distance between the second source device and the target display device exceeds the second distance, it may be determined that the relative positional relationship between the second source device and the target display device changes, where the second distance may be equal to or not equal to the first distance; when it is monitored that the relative angle between the second source device and the target display device changes, whether the changed angle between the second source device and the target display device exceeds a second angle can be judged, wherein when the judgment result represents that the changed angle between the second source device and the target display device exceeds the second angle, it can be determined that the relative position relationship between the second source device and the target display device changes, wherein the second angle can be equal to the first angle or not.
Step S360: determining a second current display layout based on the first relative positional relationship and the fourth relative positional relationship.
In this embodiment, after the first relative positional relationship between the first source device and the target display device and the fourth relative positional relationship between the second source device and the target display device are obtained, the second current display layout may be determined based on the fourth relative positional relationship and the second relative positional relationship.
In some embodiments, the determining the second current display layout based on the first relative positional relationship and the fourth relative positional relationship may include: the display position of the first content to be displayed associated with the first source device on the target display device, the display position of the second content to be displayed associated with the second source device on the target display device, the size of the display area of the first content to be displayed associated with the first source device on the target display device, the size of the display area of the second content to be displayed associated with the second source device on the target display device, and the like, and the display parameters of the first content to be displayed associated with the first source device on the target display device, the display parameters of the second content to be displayed associated with the second source device on the target display device, and the like are not limited herein.
Step S370: and displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the second current display layout.
In this embodiment, since the target display device has already acquired the first content to be displayed associated with the first source device and the second content to be displayed associated with the second source device, after acquiring the second current display layout, the first content to be displayed and the second content to be displayed may be displayed based on the first content to be displayed, the second content to be displayed, and the second current display layout.
Compared with the display method shown in fig. 2, in the display method provided in another embodiment of the present application, when the relative position relationship between the second source device and the target display device changes, the display layout is determined again based on the changed relative position relationship, and the content to be displayed is displayed, so as to improve the real-time performance of displaying the content to be displayed at the position where the target display device and the source device are adapted to each other, and improve the user experience.
Referring to fig. 8, fig. 8 is a schematic flow chart illustrating a display method according to another embodiment of the present application. The method is applied to the target display device, and will be described in detail with respect to the flow shown in fig. 8, and the display method may specifically include the following steps:
step S410: the method comprises the steps of obtaining a first relative position relation between first source equipment and target display equipment and a second relative position relation between second source equipment and the target display equipment, wherein the target display equipment is in communication connection with the first source equipment and the second source equipment respectively.
Step S420: determining a display layout based on the first relative positional relationship and the second relative positional relationship.
Step S430: first content to be displayed associated with a first source device and second content to be displayed associated with a second source device are obtained.
Step S440: and displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the display layout.
For the detailed description of steps S410 to S440, refer to steps S110 to S140, which are not described herein again.
Step S450: when the relative position relationship between the first source device and the target display device and the relative position relationship between the second source device and the target display device are changed, a third relative position relationship between the first source device and the target display device and a fourth relative position relationship between the second source device and the target display device are obtained.
In the present embodiment, the target display device, in displaying the first content to be displayed associated with the first source device and the second content to be displayed associated with the second source device, the relative positional relationship of the first source device to the target display device and the relative positional relationship of the second source device to the target display device may continue to be monitored, to determine whether the relative positional relationship of the first source device and the target display device has changed and whether the relative positional relationship of the second source device and the target display device has changed, wherein, when the monitoring result indicates that the relative position relationship between the first source device and the target display device changes and the relative position relationship between the second source device and the target display device changes, a third relative positional relationship of the first source device and the target display device and a fourth relative positional relationship of the second source device and the target display device may be obtained.
For example, when a first source device is held by a first user and a second source device is held by a second user, then, when the first user and the second user exchange the held source devices, the relative positional relationship between the first source device and the target display device changes, and the relative positional relationship between the second source device and the target display device changes; when the first user and the second user exchange positions, the relative position relationship between the first source device and the target display device changes, and the relative position relationship between the second source device and the target display device changes; when the target display device is newly accessed to the third source device, the relative position relationship between the first source device and the target display device changes, and the relative position relationship between the second source device and the target display device changes; when the first source device or the second source device exits, the relative positional relationship between the first source device and the target display device changes, and the relative positional relationship between the second source device and the target display device changes, and the like, which is not limited herein.
Step S460: a third current display layout is determined based on the third relative positional relationship and the fourth relative positional relationship.
In this embodiment, after the third relative positional relationship between the first source device and the target display device and the fourth relative positional relationship between the second source device and the target display device are obtained, the third current display layout may be determined based on the third relative positional relationship and the fourth relative positional relationship.
Step S470: and displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the third current display layout.
In this embodiment, since the target display device has already acquired the first content to be displayed associated with the first source device and the second content to be displayed associated with the second source device, after acquiring the third current display layout, the first content to be displayed and the second content to be displayed may be displayed based on the first content to be displayed, the second content to be displayed, and the third current display layout.
Referring to fig. 9, fig. 9 is a schematic view illustrating an application scenario of a fourth display method according to an embodiment of the present application. As shown in fig. 9, when the target display apparatus 100 newly accesses the third source apparatus 230, the first relative positional relationship of the first source apparatus 210 and the target display apparatus 100 changes, and the second relative positional relationship of the second source apparatus 220 and the target display apparatus 100 changes. When the first source device 210 is located at the left side of the target display device 100, the third source device 230 is located at the front of the target display device, and the second source device 220 is located at the right side of the target display device 100, the first content to be displayed "a" associated with the first source device 210 may be displayed at the left region of the target display device 100, the second content to be displayed "B" associated with the second source device 220 may be displayed at the right region of the target display device 100, and the third content to be displayed "C" associated with the third source device 230 may be displayed at the middle region of the target display device 100.
Compared with the display method shown in fig. 2, in the display method provided in another embodiment of the present application, when the relative position relationships between the first source device and the target display device and between the second source device and the target display device are both changed, the display layout is re-determined based on the changed relative position relationships, and the content to be displayed is displayed, so that the real-time performance of displaying the content to be displayed in the position where the target display device and the source device are adapted to each other is improved, and the use experience of the user is improved.
Referring to fig. 10, fig. 10 is a schematic flow chart illustrating a display method according to still another embodiment of the present application. The method is applied to the target display device, and will be described in detail with respect to the flow shown in fig. 10, and the display method may specifically include the following steps:
step S510: the method comprises the steps of obtaining a first relative position relation between first source equipment and target display equipment and a second relative position relation between second source equipment and the target display equipment, wherein the target display equipment is in communication connection with the first source equipment and the second source equipment respectively.
For detailed description of step S510, please refer to step S110, which is not described herein again.
Step S520: the method comprises the steps of obtaining a first display state of a first source device and a second display state of a second source device, wherein the first display state comprises a first horizontal screen display state and a first vertical screen display state, and the second display state comprises a second horizontal screen display state and a second vertical screen display state.
In some implementations, the first source device can correspond to a first display state, where the first display state can include a first landscape display state and a first portrait display state. The second source device may correspond to a second display state, wherein the second display state may include a second landscape display state and a second portrait display state.
In some embodiments, the target display device may obtain a first display state of the first source device and a second display state of the second source device, that is, the target display device may obtain that the first source device is in a first horizontal screen display state or a first vertical screen display state, and obtain that the second source device is in a second screen display state or a second vertical screen display state. As one mode, the first source device may determine that it is in the first landscape display state or the first portrait display state by using JavaScript, and specifically, the first source device generally supports the window orientation parameter, and then the first source device may determine that it is in the first landscape display state by the window orientation parameter, and send the first display state to the target display device. As one mode, the second source device may determine that it is in the second landscape display state or the second portrait display state by using JavaScript, and specifically, the second source device generally supports the window orientation parameter, and then the second source device may determine that it is in the second display state by the window orientation parameter, and send the second display state to the target display device.
Step S530: and determining the display layout based on the first relative position relationship, the second relative position relationship, the first display state and the second display state.
In some embodiments, after obtaining the first display state of the first source device and the second display state of the second source device, the display layout may be determined based on the first relative positional relationship, the second relative positional relationship, the first display state, and the second display state. In some embodiments, based on the display layout, a display state of a first to-be-displayed content associated with the first source device when displayed is the same as the first display state, and a display state of a second to-be-displayed content associated with the second source device when displayed is the same as the second display state, for example, when the first display state is the first landscape display state, the first to-be-displayed content associated with the first source device is displayed in the landscape screen on the target display device, and when the second display state is the second portrait display state, the second to-be-displayed content associated with the second source device is displayed in the portrait screen on the target display device.
As one mode, when the first relative positional relationship indicates that the first source device is located in front of the target display device on the left side, the second relative positional relationship indicates that the second source device is located in front of the target display device on the right side, the first display state indicates that the first source device is in the first landscape display state, and the second display state indicates that the second source device is in the second landscape display state, the display layout determined based on the first relative positional relationship, the second relative positional relationship, the first display state, and the second display state may include: the first content to be displayed associated with the first source device is displayed in the left area of the target display device in the landscape display state, and the second content to be displayed associated with the second source device is displayed in the right area of the target display device in the landscape display state, which is not limited herein.
Step S540: first content to be displayed associated with a first source device and second content to be displayed associated with a second source device are obtained.
Step S550: and displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the display layout.
For detailed description of steps S540 to S550, refer to steps S130 to S140, which are not described herein again.
Referring to fig. 11, fig. 11 is a schematic view illustrating an application scenario of a fifth display method according to an embodiment of the present application. As shown in fig. 11, when the first source device 210 is located at the left side of the target display device 100, the first display state of the first source device 210 is the first landscape display state, the second source device 220 is located at the right side of the target display device 100, and the second display state of the second source device 220 is the second portrait display state, the first content to be displayed "a" associated with the first source device 210 may be displayed horizontally on the left area of the target display device 100, and the second content to be displayed "B" associated with the second source device 220 may be displayed vertically on the right area of the target display device 100.
Referring to fig. 12, fig. 12 is a schematic view illustrating an application scenario of a sixth display method according to an embodiment of the present application. As shown in fig. 12, when the first source device 210 is located at the left side of the target display device 100, the first display state of the first source device 210 is the first vertical screen display state, the second source device 220 is located at the right side of the target display device 100, and the second display state of the second source device 220 is the second horizontal screen display state, the first content to be displayed "a" associated with the first source device 210 may be displayed vertically in the left area of the target display device 100, and the second content to be displayed "B" associated with the second source device 220 may be displayed horizontally in the right area of the target display device 100.
Compared with the display method shown in fig. 2, the display method provided in another embodiment of the present application further obtains a first display state of the first source device and a second display state of the second source device, and determines a display layout and displays the content to be displayed based on the first relative position relationship, the second relative position relationship, the first display state, and the second display state, so as to improve the display effect of the content to be displayed on the target display device.
Referring to fig. 13, fig. 13 is a schematic flow chart illustrating a display method according to yet another embodiment of the present application. The method is applied to the target display device, and will be described in detail with respect to the flow shown in fig. 13, and the display method may specifically include the following steps:
step S610: the method comprises the steps of obtaining a first relative position relation between first source equipment and target display equipment and a second relative position relation between second source equipment and the target display equipment, wherein the target display equipment is in communication connection with the first source equipment and the second source equipment respectively.
For detailed description of step S610, please refer to step S110, which is not described herein again.
Step S620: first size information of a displayable area of a first source device and second size information of a displayable area of a second source device are acquired.
In some embodiments, the displayable region of the first source device may correspond to first size information, wherein the first size information may include "length", "width", "aspect ratio", "area", and the like of the displayable region of the first source device. The displayable region of the second source device may correspond to second size information, wherein the second size information may include "length", "width", "aspect ratio", "area" of the displayable region of the second source device.
In some embodiments, the target display device may acquire first size information of the displayable region of the first source device and second size information of the second source device, that is, the target display device may acquire size information of "length", "width", "aspect ratio", "area" and the like of the displayable region of the first source device and acquire size information of "length", "width", "aspect ratio", "area" and the like of the displayable region of the second source device. As a manner, the first source device may obtain, using JavaScript, first size information of a displayable area of the first source device, and send the first size information to the target display device, and the second source device may obtain, using JavaScript, second size information of the displayable area of the second source device, and send the second size information to the target display device, which is not limited herein.
Step S630: and determining the display layout based on the first relative position relation, the second relative position relation, the first size information and the second size information.
In some embodiments, after acquiring the first size information of the first source device and the second size information of the second source device, the display layout may be determined based on the first relative positional relationship, the second relative positional relationship, the first size information, and the second size information. In some embodiments, based on the display layout, size information of a first content to be displayed associated with the first source device when displayed is matched with the first size information, and size information of a second content to be displayed associated with the second source device when displayed is matched with the second size information, so as to improve similarity between the size information of the content to be displayed when displayed and size information of a displayable area of the source device, and improve a display effect.
In some embodiments, the first size information includes a first aspect ratio, the second size information includes a second aspect ratio, the first aspect ratio of the first content to be displayed is the same as the first aspect ratio when displayed, and the second aspect ratio of the second content to be displayed is the same as the second aspect ratio when displayed. For example, if the first aspect ratio is 2:1, the aspect ratio of the first content to be displayed when displayed is 2:1, and if the second aspect ratio is 1.5:1, the aspect ratio of the second content to be displayed when displayed is 1.5: 1.
As one way, when the first relative positional relationship indicates that the first source device is located at the left front of the target display device, the second relative positional relationship indicates that the second source device is located at the right front of the target display device, the first aspect ratio is 2:1, and the second aspect ratio is 1.5:1, the display layout determined based on the first relative positional relationship, the second relative positional relationship, the first size information, and the second size information may include: the first content to be displayed associated with the first source device is displayed in the left area of the target display device with an aspect ratio of 2:1, and the second content to be displayed associated with the second source device is displayed in the right area of the target display device with an aspect ratio of 1.5:1, which is not limited herein.
Step S640: first content to be displayed associated with a first source device and second content to be displayed associated with a second source device are obtained.
Step S650: and displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the display layout.
For detailed description of steps S640 to S650, please refer to steps S130 to S140, which are not described herein again.
Referring to fig. 14, fig. 14 is a schematic view illustrating an application scenario of a seventh display method according to an embodiment of the present application. As shown in fig. 14, when the first source device 210 is located at the left side of the target display device 100, the aspect ratio of the first source device is 2:1, and the second source device 220 is located at the right side of the target display device 100, and the aspect ratio of the second source device is 1.5:1, then the first content to be displayed "a" associated with the first source device 210 may be displayed at the left region of the target display device 100, and the aspect ratio corresponding to the first content to be displayed "a" is 2:1, the second content to be displayed "B" associated with the second source device 220 may be displayed at the right region of the target display device 100, and the aspect ratio corresponding to the second content to be displayed "B" is 1.5: 1.
In a display method provided in another embodiment of the present application, compared to the display method shown in fig. 2, in this embodiment, first size information of the first source device and second size information of the second source device are further obtained, and a display layout is determined and content to be displayed is displayed based on the first relative position relationship, the second relative position relationship, the first size information, and the second size information, so as to improve a display effect of the content to be displayed on the target display device.
Referring to fig. 15, fig. 15 is a schematic flow chart illustrating a display method according to still another embodiment of the present application. The method is applied to the target display device, and will be described in detail with respect to the flow shown in fig. 15, and the display method may specifically include the following steps:
step S710: the method comprises the steps of obtaining a first relative position relation between first source equipment and target display equipment and a second relative position relation between second source equipment and the target display equipment, wherein the target display equipment is in communication connection with the first source equipment and the second source equipment respectively.
Step S720: determining a display layout based on the first relative positional relationship and the second relative positional relationship.
Step S730: first content to be displayed associated with a first source device and second content to be displayed associated with a second source device are obtained.
Step S740: and displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the display layout.
For the detailed description of steps S710 to S740, refer to steps S110 to S140, which are not described herein again.
Step S750: a first audio output device is determined from the plurality of audio output devices based on the first relative positional relationship, and a second audio output device is determined from the plurality of audio output devices based on the second relative positional relationship.
As a first way, the plurality of audio output devices may all be devices built in the target display apparatus, for example, the plurality of audio output devices may be speakers, or the like built in the target display apparatus. As a second mode, the plurality of audio output devices may be all devices that are externally disposed on the target display device and are connected to the target display device (bluetooth connection, wired connection, WiFi connection, etc.), for example, the plurality of audio output devices may be earphones, speakers, etc., that are externally disposed on the display device. As a third way, the plurality of audio output apparatuses may simultaneously include a device built in the target display device and a device externally mounted to the target display device and connected to the target display device, for example, the plurality of audio output apparatuses may simultaneously include a speaker built in the target display device, a speaker, and an earphone, a sound, etc. externally mounted to the display device.
In some embodiments, after obtaining the first relative positional relationship between the first source device and the target display device and the second relative positional relationship between the second source device and the target display device, a first audio output apparatus corresponding to the first source device may be determined from the plurality of audio output apparatuses based on the first relative positional relationship, for outputting the first audio to be played associated with the first source device, and a second audio output apparatus corresponding to the second source device may be determined from the plurality of audio output apparatuses based on the second relative positional relationship, for outputting the second audio to be played associated with the second source device. As one way, when the first relative positional relationship indicates that the first source device is located at the front left of the target display device and the second relative positional relationship indicates that the second source device is located at the front right of the target display device, the audio output apparatus located at the left side of the target display device may be selected from the plurality of audio output apparatuses as the first audio output apparatus and the audio output apparatus located at the right side of the target display device may be selected from the plurality of audio output apparatuses as the second audio output apparatus.
In some implementations, the relative positions of the first audio output arrangement and the second audio output arrangement are the same as the relative positions of the first source device and the second source device. For example, when the relative positions of the first source device and the second source device are: the first source device is positioned on the left side of the second source device, and the first audio output device is positioned on the left side of the second audio output device; when the relative positions of the first source device and the second source device are: the first source device is located to the right of the second source device, and the first audio output apparatus is located to the right of the second audio output apparatus.
Referring to fig. 16, fig. 16 is a schematic view illustrating an application scenario of an eighth display method according to an embodiment of the present application. As shown in fig. 16, when the first source device 210 is located at the left side of the target display apparatus 100 and the second source device 220 is located at the right side of the target display apparatus 100, the first content to be displayed "a" associated with the first source device 210 may be displayed at the left region of the target display apparatus 100, and an audio output device located at the left side of the target display apparatus may be selected as the first audio output device 300, the second content to be displayed "B" associated with the second source device 220 may be displayed at the right region of the target display apparatus 100, and an audio output device located at the right side of the target display apparatus may be selected as the second audio output device 400.
Referring to fig. 17, fig. 17 is a schematic view illustrating an application scenario of a ninth display method according to an embodiment of the present application. As shown in fig. 17, when the first source device 210 is located at the right side of the target display apparatus 100 and the second source device 220 is located at the left side of the target display apparatus 100, the first content to be displayed "a" associated with the first source device 210 may be displayed at the right region of the target display apparatus 100, and an audio output device located at the right side of the target display apparatus may be selected as the first audio output device 300, the second content to be displayed "B" associated with the second source device 220 may be displayed at the left region of the target display apparatus 100, and an audio output device located at the left side of the target display apparatus may be selected as the second audio output device 400.
Step S760: the method comprises the steps of obtaining a first audio to be played related to a first source device and a second audio to be played related to a second source device.
In this embodiment, the target display device may obtain a first audio to be played associated with the first source device and a second audio to be played associated with the second source device. As one mode, the target display device may obtain an audio to be played, which is sent by the first source device in a wired or wireless manner, and use the audio to be played as a first audio to be played, which is associated with the first source device, and in addition, the target display device may obtain an audio to be played, which is sent by the second source device in a wired or wireless manner, and use the audio to be played as a second audio to be played, which is associated with the second source device.
In some embodiments, the first audio to be played may be an audio corresponding to a music playing application, and may also be an audio corresponding to a video playing application, where when the first audio to be played is the audio corresponding to the music playing application, the target display device may separately obtain the first audio to be played, and when the first audio to be played is the audio corresponding to the video playing application, the target display device may simultaneously obtain the first content to be displayed and the first audio to be played, which are associated with each other. The second audio to be played may be audio corresponding to a music playing application or audio corresponding to a video playing application, where when the second audio to be played is audio corresponding to the music playing application, the target display device may separately obtain the second audio to be played, and when the second audio to be played is audio corresponding to the video playing application, the target display device may simultaneously obtain associated second content to be displayed and the second audio to be played.
Step S770: and outputting the first audio to be played through the first audio output device, and outputting the second audio to be played through the second audio output device.
In this embodiment, after acquiring a first audio to be played associated with a first source device and a first audio output device corresponding to the first source device, the first audio to be played may be output through the first audio output device, and after acquiring a second audio to be played associated with a second source device and a second audio output device corresponding to the second source device, the second audio to be played may be output through the second audio output device.
In a display method provided by yet another embodiment of the present application, compared to the display method shown in fig. 2, the present embodiment further determines a first audio output device from the multiple audio output devices based on the first relative positional relationship to output a first audio to be played associated with the first source device, and determines a second audio output device from the multiple audio output devices based on the second relative positional relationship to output a second audio to be played associated with the second source device, so that the audio to be played is output through the audio output device adapted to the position of the source device, thereby improving the user experience.
Referring to fig. 18, fig. 18 is a schematic flow chart illustrating a display method according to yet another embodiment of the present application. The method is applied to the target display device, where the target display device includes a first ultra-wideband sensor, the first source device includes a second ultra-wideband sensor, and the second source device includes a third ultra-wideband sensor, and as will be described in detail with reference to the flowchart shown in fig. 18, the display method may specifically include the following steps:
step S810: and acquiring first relative position information through the first ultra-wideband sensor and the second ultra-wideband sensor.
In some embodiments, the target display device includes a first ultra-wideband sensor, the first source device includes a second ultra-wideband sensor, and the first relative position information may be acquired through the first ultra-wideband sensor and the second ultra-wideband sensor, wherein the first relative position information includes angle information and distance information. As one mode, the target display device may sense a second ultra-wideband sensor of the first source device at intervals through the first ultra-wideband sensor, and acquire the first relative position information according to a sensing result.
Step S820: and acquiring a first relative position relation between the target display device and the first source device based on the first relative position information.
In this embodiment, after the target display device acquires the first relative position information, the first relative position relationship between the target display device and the first source device may be acquired based on the first relative position information. As one mode, after the target display device acquires the first relative position information through the first ultra-wideband sensor, the first relative position information may be calculated to acquire a first relative position relationship between the target display device and the first source device, for example, after the target display device acquires the first relative position information through the first ultra-wideband sensor, the target display device may establish a coordinate system with the target display device, and perform normalization calculation processing on the first source device to be within a range of 0 to 180 of the coordinate system established with the target display device based on the first relative position information to acquire the first relative position relationship between the target display device and the first source device.
Step S830: and acquiring second relative position information through the first ultra-wideband sensor and the third ultra-wideband sensor.
In some embodiments, the target display device includes a first ultra-wideband sensor, the second source device includes a third ultra-wideband sensor, and second relative position information may be obtained through the first ultra-wideband sensor and the third ultra-wideband sensor, wherein the second relative position information includes angle information and distance information. As one mode, the target display device may sense a third ultra-wideband sensor of the second source device at intervals through the first ultra-wideband sensor, and acquire the second relative position information according to a sensing result. As one way, after the target display device acquires the second relative position information through the first ultra-wideband sensor, the target display device may establish a coordinate system with the target display device, and perform normalization calculation processing on the first source device to be within a range of 0 to 180 of the coordinate system established with the target display device based on the second relative position information.
Referring to fig. 19, fig. 19 is a schematic view illustrating an angle of a source device relative to a target display device according to an embodiment of the present application. As shown in fig. 19, when the first source device 210 is located at the left side of the target display device 100 and the second source device 220 is located at the right side of the target display device 100, a coordinate system may be established with the target display device 100 to normalize the first source device 210 and the second source device 220 to a range of 0-180 with the target display device 100 as an origin.
Step S840: and acquiring a second relative position relation between the target display device and the second source device based on the second relative position information.
In this embodiment, after the target display device acquires the second relative position information, the second relative position relationship between the target display device and the second source device may be acquired based on the second relative position information. As one mode, after the target display device obtains the second relative position information through the first ultra-wideband sensor, the second relative position information may be calculated to obtain a second relative position relationship between the target display device and the second source device.
Step S850: determining a display layout based on the first relative positional relationship and the second relative positional relationship.
Step S860: first content to be displayed associated with a first source device and second content to be displayed associated with a second source device are obtained.
Step S870: and displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the display layout.
For the detailed description of steps S850 to S870, please refer to steps S120 to S140, which are not described herein again.
In a display method provided in yet another embodiment of the present application, compared to the display method shown in fig. 2, in this embodiment, first relative position information is further obtained through a first ultra-wideband sensor built in the target display device and a second ultra-wideband sensor built in the first source device, a first relative position relationship between the target display device and the first source device is obtained based on the first relative position information, second relative position information is obtained through the first ultra-wideband sensor built in the target display device and a third ultra-wideband sensor built in the second source device, and a second relative position relationship between the target display device and the second source device is obtained based on the second relative position information, so that accuracy of the determined relative position relationship between the target display device and the source device is improved under the condition that the ultra-wideband sensor is built in the target display device.
Referring to fig. 20, fig. 20 is a schematic flow chart illustrating a display method according to yet another embodiment of the present application. The method is applied to the target display device, where the target display device includes a first ultra-wideband sensor, the first source device includes a fourth ultra-wideband sensor, and the following will describe in detail with respect to the flow shown in fig. 20, and the display method may specifically include the following steps:
step S910: and receiving third relative position information sent by the first source equipment, wherein the third relative position information is obtained through a fourth ultra-wideband sensor and a fifth ultra-wideband sensor, and the fifth ultra-wideband sensor is associated with the target display equipment in position.
In some embodiments, the target display device does not include a first ultra-wideband sensor, and a fifth ultra-wideband sensor is hung outside the target display device. As one mode, the fifth ultra-wideband sensor may be disposed at a position at a specified distance in a specified direction of the target display device, for example, the fifth ultra-wideband sensor may be disposed at a position at a first distance from the target display device on the left side of the target display device, and the fifth ultra-wideband sensor may be disposed at a position at a second distance from the target display device on the right side of the target display device, and the like, which is not limited herein.
In this embodiment, a fifth ultra-wideband sensor is hung outside the target display device, and the first source device includes a fourth ultra-wideband sensor, so that third relative position information can be obtained through the fourth ultra-wideband sensor and the fifth ultra-wideband sensor, where the third relative position information includes angle information and distance information. In some embodiments, the first source device may sense a fifth ultra-wideband sensor at intervals through a fourth ultra-wideband sensor, obtain third relative position information according to the sensing result, and transmit the third relative position information to the target display device. As one mode, the information sending apparatus on the first source device may obtain the third relative position information obtained by the fourth sensor, and transmit the third relative position information to the information receiving module on the target display device.
Step S920: and converting the coordinate system of the third relative position information to obtain fourth relative position information of the fifth ultra-wideband sensor and the fourth ultra-wideband sensor.
In some embodiments, since the third relative position information is obtained by the first source device sensing the fifth ultra-wideband sensor at intervals of time through the fourth ultra-wideband sensor and according to the sensing result, the third relative position information is obtained by using the first source device as a coordinate system, after the third relative position information is obtained by the target display device, coordinate system conversion may be performed on the third relative position information to obtain fourth relative position information of the fifth ultra-wideband sensor and the fourth ultra-wideband sensor, wherein based on the coordinate system conversion, the obtained fourth relative position information is relative position information using the target display device as a coordinate system.
Referring to fig. 21, fig. 21 is a schematic view illustrating an angle of a first source device relative to a target display device according to an embodiment of the present application. As shown in fig. 21, if the first source device 210 is located on the left side of the target display device 100, a coordinate system established by using the first source device 210 as an origin may be transformed to obtain a coordinate system established by using the target display device 100 as an origin.
Referring to fig. 22, fig. 22 is a flowchart illustrating step S920 of the display method illustrated in fig. 20 according to the present application. As will be described in detail with respect to the flow shown in fig. 22, the method may specifically include the following steps:
step S921: and acquiring the current set angle of the first source equipment.
The fourth relative position information of the fifth ultra-wide sensor and the fourth sensor obtained can be influenced by different setting angles of the first source device, so that in this embodiment, a preset standard angle can be set as a reference by default, and corresponding adjustment is performed by using the reference, wherein an angle set in the vertical forward direction of the first source device can be used as the preset standard angle. As one manner, the current setting angle of the first source device may be obtained, where the current setting angle of the first source device may be obtained through an acceleration sensor, the current setting angle of the first source device may be obtained through a gyroscope, and the like, which are not limited herein.
Step S922: and obtaining the current offset angle of the first source equipment based on the current set angle and the preset standard angle of the first source equipment.
In some embodiments, the target display device may preset and store a preset standard angle, where the preset standard angle is used as a criterion for determining a current setting angle of the first source device, and therefore, in this embodiment, after the current setting angle of the first source device is obtained, the current setting angle of the first source device and the preset standard angle may be calculated to obtain a current offset angle of the first source device.
Step S923: and converting a coordinate system of the third relative position information based on the current offset angle of the first source device to obtain fourth relative position information of the fifth ultra-wideband sensor and the fourth ultra-wideband sensor.
In some embodiments, after obtaining the current offset angle of the first source device, coordinate system conversion may be performed on the third relative position information based on the current offset angle of the first source device, so as to obtain fourth relative position information of the fifth ultra-wideband sensor and the fourth ultra-wideband sensor, so as to improve accuracy of the obtained fourth relative position information.
Step S930: and acquiring a first relative position relation between the first source device and the target display device based on the position association between the fifth ultra-wideband sensor and the target display device and the fourth relative position information.
In some embodiments, the target display device may previously acquire and store a position association between the fifth ultra-wideband sensor and the target display device, and therefore, when acquiring the fourth relative position information, since the fourth relative position information is used to represent the relative position information between the first source device and the fifth ultra-wideband sensor, the target display device may acquire the first relative position relationship between the first source device and the target display device based on the position association between the fifth ultra-wideband sensor and the target display device and the fourth relative position information.
As one manner, the target display device may calculate fourth relative position information and a position association of the fifth ultra-wideband sensor and the target display device to obtain a first relative position relationship between the first source device and the target display device, for example, the target display device may calculate the fourth relative position information and the position association of the fifth ultra-wideband sensor and the target display device to obtain first current position information, may establish a coordinate system with the target display device, and perform normalization calculation on the first source device based on the first current position information to be within a range of 0 to 180 of the coordinate system established with the target display device to obtain the first relative position relationship between the target display device and the first source device.
Step S940: and receiving fifth relative position information sent by the second source equipment, wherein the fifth relative position information is obtained through a sixth ultra-wideband sensor and a fifth ultra-wideband sensor.
In this embodiment, a fifth ultra-wideband sensor is hung outside the target display device, and the second source device includes a sixth ultra-wideband sensor, so that fifth relative position information can be obtained through the sixth ultra-wideband sensor and the fifth ultra-wideband sensor, where the fifth relative position information includes angle information and distance information. In some embodiments, the second source device may sense a fifth ultra-wideband sensor at intervals through the sixth ultra-wideband sensor, acquire fifth relative position information according to the sensing result, and transmit the fifth relative position information to the target display device. As one way, the information sending apparatus on the second source device may obtain the fifth relative position information acquired by the sixth sensor and transmit the fifth relative position information to the information receiving module on the target display device.
Step S950: and converting the coordinate system of the fifth relative position information to obtain sixth relative position information of the fifth ultra-wideband sensor and the sixth ultra-wideband sensor.
In some embodiments, since the fifth relative position information is obtained by the second source device sensing the fifth ultra-wideband sensor at intervals of time by the sixth ultra-wideband sensor and according to the sensing result, the fifth relative position information is obtained by using the second source device as a coordinate system, after the fifth relative position information is obtained by the target display device, coordinate system conversion may be performed on the fifth relative position information to obtain sixth relative position information of the sixth ultra-wideband sensor and the fourth ultra-wideband sensor, wherein based on the coordinate system conversion, the obtained sixth relative position information is relative position information by using the target display device as a coordinate system.
Referring to fig. 23, fig. 23 is a schematic view illustrating an angle of a second source device relative to a target display device according to an embodiment of the present application. As shown in fig. 23, the second source device 220 is located at the right side of the target display device 100, and then a coordinate system established by taking the second source device 220 as an origin may be subjected to coordinate system conversion to obtain a coordinate system established by taking the target display device 100 as an origin.
Referring to fig. 24, fig. 24 is a flowchart illustrating step S950 of the display method illustrated in fig. 20 according to the present application. As will be described in detail with respect to the flow shown in fig. 24, the method may specifically include the following steps:
step S951: and acquiring the current set angle of the second source equipment.
The second source device may be configured to acquire a fourth relative position information of the fourth ultra-wide sensor and a fourth relative position information of the fourth sensor, and the fourth ultra-wide sensor and the fourth sensor may be configured to acquire a fourth relative position information of the fourth ultra-wide sensor and the fourth ultra-wide sensor. As one manner, the current setting angle of the second source device may be obtained, where the current setting angle of the second source device may be obtained through an acceleration sensor, the current setting angle of the second source device may be obtained through a gyroscope, and the like, which are not limited herein.
Step S952: and obtaining the current offset angle of the second source equipment based on the current set angle and the preset standard angle of the second source equipment.
In some embodiments, the target display device may preset and store a preset standard angle, where the preset standard angle is used as a criterion for determining a current setting angle of the second source device, and therefore, in this embodiment, after obtaining the current setting angle of the second source device, the current setting angle of the second source device and the preset standard angle may be calculated to obtain a current offset angle of the second source device.
Step S953: and converting a coordinate system of the fifth relative position information based on the current offset angle of the second source device to obtain sixth relative position information of the fifth ultra-wideband sensor and the sixth ultra-wideband sensor.
In some embodiments, after obtaining the current offset angle of the second source device, the coordinate system of the fifth relative position information may be converted based on the current offset angle of the second source device, and sixth relative position information of the fifth ultra-wideband sensor and the sixth ultra-wideband sensor may be obtained, so as to improve accuracy of the obtained sixth relative position information.
Step S960: and acquiring a second relative position relation between the second source device and the target display device based on the position association of the fifth ultra-wideband sensor and the target display device and the sixth relative position information.
In some embodiments, the target display device may previously acquire and store the position association of the fifth ultra-wideband sensor and the target display device, and therefore, when acquiring the sixth relative position information, since the sixth relative position information is used to represent the relative position information between the second source device and the fifth ultra-wideband sensor, the target display device may acquire the first relative position relationship between the first source device and the target display device based on the position association of the fifth ultra-wideband sensor and the target display device and the sixth relative position information.
As one way, the target display device may calculate sixth relative position information and a position association of a fifth ultra-wideband sensor and the target display device to obtain a first relative position relationship between the first source device and the target display device, for example, the target display device may calculate the sixth relative position information and the position association of the fifth ultra-wideband sensor and the target display device to obtain second current position information, may establish a coordinate system with the target display device, and process a normalization calculation of the second source device to be within a range of 0 to 180 of the coordinate system established with the target display device based on the second current position information to obtain a second relative position relationship between the target display device and the second source device.
Step S970: determining a display layout based on the first relative positional relationship and the second relative positional relationship.
Step S980: first content to be displayed associated with a first source device and second content to be displayed associated with a second source device are obtained.
Step S990: and displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the display layout.
For detailed description of step S970 to step S980, please refer to step S120 to step S140, which is not described herein again.
Compared with the display method shown in fig. 2, in the display method provided in yet another embodiment of the present application, third relative position information is obtained through a fifth ultra-wideband sensor external to the target display device and a fourth ultra-wideband sensor internal to the first source device, the first relative position relationship between the target display device and the first source device is obtained based on the first relative position information, sixth relative position information is obtained through the fifth ultra-wideband sensor external to the target display device and a sixth ultra-wideband sensor internal to the second source device, and the second relative position relationship between the target display device and the second source device is obtained based on the sixth relative position information, so that the accuracy of the determined relative position relationship between the target display device and the source device is improved under the condition that the ultra-wideband sensor is external to the target display device.
Referring to fig. 25, fig. 25 is a schematic flow chart illustrating a display method according to yet another embodiment of the present application. The method is applied to the target display device, wherein the target display device is provided with an image acquisition device, and as will be described in detail with respect to the flow shown in fig. 25, the display method may specifically include the following steps:
step S1010: and acquiring the image information of the first source equipment and the image information of the second source equipment by the image acquisition device.
In this embodiment, the target display apparatus is provided with an image acquisition device, for example, the target display apparatus may have a built-in camera or an external camera, and the like, which is not limited herein.
In some embodiments, the target display device may acquire image information of the first source device and image information of the second source device through the image acquisition apparatus.
In some embodiments, when the first user holds the first source device and the second user holds the second source device, the target display device may acquire, through the image acquisition apparatus, image information of the first user as image information of the first source device, and acquire, through the image acquisition apparatus, image information of the second user as image information of the second source device. For example, the target display apparatus may detect a human face through the image capture device to capture image information of the first user and image information of the second user.
Step S1020: based on the image information of the first source device and the image information of the second source device, a first relative position relationship between the first source device and the target display device and a second relative position relationship between the second source device and the target display device are obtained.
In some embodiments, after acquiring the image information of the first source device, first relative position information of the first source device and the target display device may be acquired based on the image information of the first source device. The shooting direction and the shooting angle of the image acquisition device of the target display equipment are fixed, so that the first relative position relation between the first source equipment and the target display equipment can be acquired according to the acquired image information of the first source equipment.
In some embodiments, after acquiring the image information of the second source device, second relative position information of the second source device and the target display device may be acquired based on the image information of the second source device. The shooting direction and the shooting angle of the image acquisition device of the target display equipment are fixed, so that the second relative position relation between the second source equipment and the target display equipment can be acquired according to the acquired image information of the second source equipment.
Step S1030: determining a display layout based on the first relative positional relationship and the second relative positional relationship.
Step S1040: first content to be displayed associated with a first source device and second content to be displayed associated with a second source device are obtained.
Step S1050: and displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the display layout.
For detailed description of steps S1030 to S1050, please refer to steps S120 to S140, which are not described herein again.
In the display method provided in yet another embodiment of the present application, compared to the display method shown in fig. 2, in this embodiment, the image acquisition device of the target display device is further used to acquire the image information of the first source device and the image information of the second source device, and obtain the first relative positional relationship between the first source device and the target display device based on the image information of the first source device, and obtain the second relative positional relationship between the second source device and the target display device based on the image information of the second source device, so that the accuracy of the determined relative positional relationship between the target display device and the source device is improved when the target display device is provided with the image acquisition device.
Referring to fig. 26, fig. 26 is a block diagram illustrating a display device according to an embodiment of the present disclosure. The display apparatus 500 is applied to the target display device, and will be explained with reference to the block diagram shown in fig. 26, the display apparatus 500 includes: a relative position relationship obtaining module 510, a display layout determining module 520, a to-be-displayed content obtaining module 530, and a to-be-displayed content displaying module 540, wherein:
a relative position relationship obtaining module 510, configured to obtain a first relative position relationship between a first source device and a target display device, and a second relative position relationship between a second source device and the target display device, where the target display device is in communication connection with the first source device and the second source device, respectively.
Further, the target display device includes a first ultra-wideband sensor, the first source device includes a second ultra-wideband sensor, the second source device includes a third ultra-wideband sensor, and the relative position relationship obtaining module 510 includes: a first relative position information obtaining submodule, a first relative position relation obtaining submodule, a second relative position information obtaining submodule and a second relative position relation obtaining submodule, wherein:
and the first relative position information acquisition submodule is used for acquiring the first relative position information through the first ultra-wideband sensor and the second ultra-wideband sensor.
And the first relative position relation acquisition submodule is used for acquiring a first relative position relation between the target display device and the first source device based on the first relative position information.
And the second relative position information acquisition submodule is used for acquiring second relative position information through the first ultra-wideband sensor and the third ultra-wideband sensor.
And the second relative position relation obtaining submodule is used for obtaining a second relative position relation between the target display device and the second source device based on the second relative position information.
Further, the target display device includes a first ultra-wideband sensor, the first source device includes a fourth ultra-wideband sensor, the second source device includes a sixth ultra-wideband sensor, and the relative position relationship obtaining module 510 includes: a third relative position information receiving submodule, a fourth relative position information obtaining submodule, a third relative position relationship obtaining submodule, a fifth relative position information receiving submodule, a sixth relative position information obtaining submodule, and a fourth relative position relationship obtaining submodule, wherein:
and the third relative position information receiving submodule is used for receiving third relative position information sent by the first source equipment, wherein the third relative position information is obtained through a fourth ultra-wideband sensor and a fifth ultra-wideband sensor, and the fifth ultra-wideband sensor is in position correlation with the target display equipment.
And the fourth relative position information obtaining submodule is used for converting the coordinate system of the third relative position information to obtain fourth relative position information of the fifth ultra-wideband sensor and the fourth ultra-wideband sensor.
Further, the fourth relative position information obtaining sub-module includes: a first current setting angle obtaining unit, a first current offset angle obtaining unit, and a fourth relative position information obtaining unit, wherein:
and the first current setting angle acquisition unit is used for acquiring the current setting angle of the first source equipment.
A first current offset angle obtaining unit, configured to obtain a current offset angle of the first source device based on the current setting angle of the first source device and a preset standard angle.
And the fourth relative position information acquisition unit is used for converting a coordinate system of the third relative position information based on the current offset angle of the first source equipment to acquire fourth relative position information of the fifth ultra-wideband sensor and the fourth ultra-wideband sensor.
And the third relative position relation obtaining submodule is used for obtaining the first relative position relation between the first source equipment and the target display equipment based on the position association between the fifth ultra-wideband sensor and the target display equipment and the fourth relative position information.
And the fifth relative position information receiving submodule is used for receiving fifth relative position information sent by the second source equipment, wherein the fifth relative position information is obtained through the sixth ultra-wideband sensor and the fifth ultra-wideband sensor.
And the sixth relative position information obtaining submodule is used for carrying out coordinate system conversion on the fifth relative position information to obtain sixth relative position information of the fifth ultra-wideband sensor and the sixth ultra-wideband sensor.
Further, the sixth relative position information obtaining sub-module includes: a second current setting angle obtaining unit, a second current offset angle obtaining unit, and a fourth relative position information obtaining unit, wherein:
and the second current setting angle acquisition unit is used for acquiring the current setting angle of the second source equipment.
And the second current offset angle obtaining unit is used for obtaining the current offset angle of the second source equipment based on the current set angle and the preset standard angle of the second source equipment.
And a fourth relative position information obtaining unit configured to perform coordinate system conversion on the fifth relative position information based on the current offset angle of the second source device, and obtain sixth relative position information of the fifth ultra-wideband sensor and the sixth ultra-wideband sensor.
And the fourth relative position relation acquisition submodule is used for acquiring a second relative position relation between the second source equipment and the target display equipment based on the position association between the fifth ultra-wideband sensor and the target display equipment and the sixth relative position information.
Further, the target display device is provided with an image capturing device, and the relative relationship obtaining module 510 includes: the image information acquisition submodule and the fifth relative position relation acquisition submodule, wherein:
and the image information acquisition submodule is used for acquiring the image information of the first source equipment and the image information of the second source equipment through the image acquisition device.
And the fifth relative position relation obtaining submodule is used for obtaining a first relative position relation between the first source equipment and the target display equipment and a second relative position relation between the second source equipment and the target display equipment based on the image information of the first source equipment and the image information of the second source equipment.
A display layout determining module 520, configured to determine a display layout based on the first relative position relationship and the second relative position relationship.
Further, the display layout determination module 520 includes: a display state acquisition submodule and a first display layout determination submodule, wherein:
the display state obtaining sub-module is used for obtaining a first display state of the first source equipment and a second display state of the second source equipment, wherein the first display state comprises a first horizontal screen display state and a first vertical screen display state, and the second display state comprises a second horizontal screen display state and a second vertical screen display state.
And the first display layout determining submodule is used for determining the display layout based on the first relative position relation, the second relative position relation, the first display state and the second display state.
Further, the display layout determination module 520 includes: a size information acquisition sub-module and a second display layout determination sub-module, wherein:
and the size information acquisition submodule is used for acquiring first size information of a displayable area of the first source device and second size information of a displayable area of the second source device.
And the second display layout determining submodule is used for determining the display layout based on the first relative position relation, the second relative position relation, the first size information and the second size information.
A to-be-displayed content obtaining module 530, configured to obtain a first to-be-displayed content associated with a first source device and a second to-be-displayed content associated with a second source device.
And a content to be displayed displaying module 540, configured to display the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed, and the display layout.
Further, the display device 500 further includes: the display device comprises a first relative position relation acquisition module, a first current display layout determination module and a first to-be-displayed content display module, wherein:
the first relative position relation obtaining module is configured to obtain a third relative position relation between the first source device and the target display device when the relative position relation between the first source device and the target display device changes.
And the first current display layout determining module is used for determining the first current display layout based on the third relative position relation and the second relative position relation.
And the first content to be displayed display module is used for displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the first current display layout.
Further, the display device 500 further includes: a second relative position relationship obtaining module, a second current display layout determining module and a second content to be displayed displaying module, wherein:
and the second relative position relation obtaining module is used for obtaining a fourth relative position relation between the second source device and the target display device when the relative position relation between the second source device and the target display device changes.
And the second current display layout determining module is used for determining a second current display layout based on the first relative position relation and the fourth relative position relation.
And the second content to be displayed display module is used for displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the second current display layout.
Further, the display device 500 further includes: a third relative position relationship obtaining module, a third current display layout determining module and a third content display module to be displayed, wherein:
and the third relative position relation obtaining module is used for obtaining a third relative position relation between the first source device and the target display device and a fourth relative position relation between the second source device and the target display device when the relative position relation between the first source device and the target display device and the relative position relation between the second source device and the target display device are changed.
And a third current display layout determining module, configured to determine a third current display layout based on the third relative position relationship and the fourth relative position relationship.
And the third content to be displayed display module is used for displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the third current display layout.
Further, the display device 500 further includes: audio output device confirms module, treats broadcast audio acquisition module and treats broadcast audio playback module, wherein:
and the audio output device determining module is used for determining a first audio output device from the plurality of audio output devices based on the first relative position relation and determining a second audio output device from the plurality of audio output devices based on the second relative position relation.
And the audio to be played acquisition module is used for acquiring a first audio to be played associated with the first source equipment and a second audio to be played associated with the second source equipment.
And the audio playing module to be played is used for outputting a first audio to be played through the first audio output device and outputting a second audio to be played through the second audio output device.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and modules may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, the coupling between the modules may be electrical, mechanical or other type of coupling.
In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.
Referring to fig. 27, a block diagram of an electronic device 100 (target display device 100) according to an embodiment of the present disclosure is shown. The electronic device 100 may be a smart phone, a tablet computer, an electronic book, or other electronic devices capable of running an application. The electronic device 100 in the present application may include one or more of the following components: a processor 110, a memory 120, a display 130, and one or more applications, wherein the one or more applications may be stored in the memory 120 and configured to be executed by the one or more processors 110, the one or more programs configured to perform the methods as described in the aforementioned method embodiments.
Processor 110 may include one or more processing cores, among other things. The processor 110 connects various parts within the overall electronic device 100 using various interfaces and lines, and performs various functions of the electronic device 100 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 120 and calling data stored in the memory 120. Alternatively, the processor 110 may be implemented in hardware using at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 110 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing the content to be displayed; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 110, but may be implemented by a communication chip.
The Memory 120 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). The memory 120 may be used to store instructions, programs, code sets, or instruction sets. The memory 120 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The data storage area may also store data created by the electronic device 100 during use (e.g., phone book, audio-video data, chat log data), and the like.
The Display 130 is used for displaying information input by a user, information provided to the user, and various graphical user interfaces of the electronic device 100, which may be formed by graphics, text, icons, numbers, video, and any combination thereof, and in one example, the Display 130 may be a Liquid Crystal Display (LCD) or an Organic Light-Emitting Diode (OLED), which is not limited herein.
Referring to fig. 28, a block diagram of a computer-readable storage medium according to an embodiment of the present application is shown. The computer readable medium 600 has stored therein a program code that can be called by a processor to execute the method described in the above method embodiments.
The computer-readable storage medium 600 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Alternatively, the computer-readable storage medium 600 includes a non-volatile computer-readable storage medium. The computer readable storage medium 600 has storage space for program code 610 for performing any of the method steps of the method described above. The program code can be read from or written to one or more computer program products. The program code 610 may be compressed, for example, in a suitable form.
In summary, the display method, the display apparatus, the electronic device, and the storage medium determine the display layout based on the first relative positional relationship and the second relative positional relationship between the first source device and the target display device by obtaining the first relative positional relationship between the first source device and the target display device and the second relative positional relationship between the second source device and the target display device, obtain the first content to be displayed associated with the first source device and the second content to be displayed associated with the second source device, display the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed, and the display layout, thereby determining a display layout according to the relative positional relationship between the target display device and the source device, and displaying the content to be displayed associated with the source device based on the display layout, therefore, the content to be displayed is displayed at the position where the target display equipment is matched with the source equipment, and the use experience of a user is improved.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims (21)

1. A display method is applied to a target display device, and is characterized by comprising the following steps:
acquiring a first relative position relationship between a first source device and the target display device and a second relative position relationship between a second source device and the target display device, wherein the target display device is in communication connection with the first source device and the second source device respectively;
determining a display layout based on the first relative positional relationship and the second relative positional relationship;
acquiring first content to be displayed associated with the first source equipment and second content to be displayed associated with the second source equipment;
displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the display layout.
2. The method of claim 1, wherein the relative position of the first content to be displayed and the second content to be displayed when displayed is the same as the relative position of the first source device and the second source device.
3. The method according to claim 1, further comprising, after said displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the display layout:
when the relative position relationship between the first source device and the target display device changes, acquiring a third relative position relationship between the first source device and the target display device;
determining a first current display layout based on the third relative positional relationship and the second relative positional relationship;
and displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the first current display layout.
4. The method according to claim 1, further comprising, after said displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the display layout:
when the relative position relationship between the second source device and the target display device changes, acquiring a fourth relative position relationship between the second source device and the target display device;
determining a second current display layout based on the first relative positional relationship and the fourth relative positional relationship;
and displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the second current display layout.
5. The method according to claim 1, further comprising, after said displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the display layout:
when the relative position relationship between the first source device and the target display device and the relative position relationship between the second source device and the target display device are changed, acquiring a third relative position relationship between the first source device and the target display device and a fourth relative position relationship between the second source device and the target display device;
determining a third current display layout based on the third relative positional relationship and the fourth relative positional relationship;
and displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the third current display layout.
6. The method of claim 1, wherein determining a display layout based on the first relative positional relationship and the second relative positional relationship comprises:
acquiring a first display state of the first source device and a second display state of the second source device, wherein the first display state comprises a first horizontal screen display state and a first vertical screen display state, and the second display state comprises a second horizontal screen display state and a second vertical screen display state;
determining the display layout based on the first relative positional relationship, the second relative positional relationship, the first display state, and the second display state.
7. The method according to claim 6, wherein a display state of the first content to be displayed when displayed is the same as the first display state, and a display state of the second content to be displayed when displayed is the same as the second display state.
8. The method of claim 1, wherein determining a display layout based on the first relative positional relationship and the second relative positional relationship comprises:
acquiring first size information of a displayable area of the first source device and second size information of a displayable area of the second source device;
determining the display layout based on the first relative positional relationship, the second relative positional relationship, the first size information, and the second size information.
9. The method according to claim 8, wherein the first size information includes a first aspect ratio, wherein the second size information includes a second aspect ratio, wherein the first aspect ratio of the first content to be displayed is the same as the first aspect ratio, and wherein the second aspect ratio of the second content to be displayed is the same as the second aspect ratio.
10. The method of claim 1, further comprising:
determining a first audio output device from a plurality of audio output devices based on the first relative positional relationship and determining a second audio output device from the plurality of audio output devices based on the second relative positional relationship;
acquiring a first audio to be played associated with the first source device and a second audio to be played associated with the second source device;
and outputting the first audio to be played through the first audio output device, and outputting the second audio to be played through the second audio output device.
11. The method of claim 10, wherein the relative position of the first audio output device and the second audio output device is the same as the relative position of the first source apparatus and the second source apparatus.
12. The method of any one of claims 1-11, wherein the target display device comprises a first ultra-wideband sensor, wherein the first source device comprises a second ultra-wideband sensor, and wherein the obtaining a first relative positional relationship of the first source device to the target display device comprises:
acquiring first relative position information through the first ultra-wideband sensor and the second ultra-wideband sensor;
and acquiring a first relative position relation between the target display device and the first source device based on the first relative position information.
13. The method of claim 12, wherein the second source device comprises a third ultra-wideband sensor, and wherein the obtaining a second relative positional relationship of the second source device to the target display device comprises:
acquiring second relative position information through the first ultra-wideband sensor and the third ultra-wideband sensor;
and acquiring a second relative position relation between the target display device and the second source device based on the second relative position information.
14. The method of any one of claims 1-11, wherein the first source device comprises a fourth ultra-wideband sensor, and wherein the obtaining a first relative positional relationship of the first source device to the target display device comprises:
receiving third relative position information sent by the first source device, wherein the third relative position information is obtained through a fourth ultra-wideband sensor and a fifth ultra-wideband sensor, and the fifth ultra-wideband sensor has position association with the target display device;
converting the coordinate system of the third relative position information to obtain fourth relative position information of the fifth ultra-wideband sensor and the fourth ultra-wideband sensor;
and acquiring a first relative position relation between the first source device and the target display device based on the position association between the fifth ultra-wideband sensor and the target display device and the fourth relative position information.
15. The method of claim 14, wherein the coordinate system converting the third relative position information to obtain fourth relative position information of the fifth and fourth ultra-wideband sensors comprises:
acquiring a current set angle of the first source device;
obtaining a current offset angle of the first source device based on the current set angle and a preset standard angle of the first source device;
and converting a coordinate system of the third relative position information based on the current offset angle of the first source device to obtain fourth relative position information of the fifth ultra-wideband sensor and the fourth ultra-wideband sensor.
16. The method of claim 14, wherein the second source device comprises a sixth ultra-wideband sensor, and wherein the obtaining a second relative positional relationship of the second source device to the target display device comprises:
receiving fifth relative position information sent by the second source device, wherein the fifth relative position information is obtained through the sixth ultra-wideband sensor and the fifth ultra-wideband sensor;
converting a coordinate system of the fifth relative position information to obtain sixth relative position information of the fifth ultra-wideband sensor and the sixth ultra-wideband sensor;
and acquiring a second relative position relation between the second source device and the target display device based on the position association between the fifth ultra-wideband sensor and the target display device and the sixth relative position information.
17. The method of claim 16, wherein the coordinate system converting the fifth relative position information to obtain sixth relative position information of the fifth and sixth ultra-wideband sensors comprises:
acquiring a current set angle of the second source device;
obtaining a current offset angle of the second source device based on the current set angle and a preset standard angle of the second source device;
and converting a coordinate system of the fifth relative position information based on the current offset angle of the second source device to obtain sixth relative position information of the fifth ultra-wideband sensor and the sixth ultra-wideband sensor.
18. The method according to any one of claims 1 to 11, wherein the target display device is provided with an image acquisition apparatus, and the acquiring a first relative positional relationship of a first source device and the target display device and a second relative positional relationship of a second source device and the target display device comprises:
acquiring image information of the first source equipment and image information of the second source equipment through the image acquisition device;
and acquiring a first relative position relationship between the first source device and the target display device and a second relative position relationship between the second source device and the target display device based on the image information of the first source device and the image information of the second source device.
19. A display device applied to a target display device, the device comprising:
a relative position relation obtaining module, configured to obtain a first relative position relation between a first source device and the target display device and a second relative position relation between a second source device and the target display device, where the target display device is in communication connection with the first source device and the second source device, respectively;
a display layout determining module, configured to determine a display layout based on the first relative positional relationship and the second relative positional relationship;
a to-be-displayed content obtaining module, configured to obtain a first to-be-displayed content associated with the first source device and a second to-be-displayed content associated with the second source device;
and the content to be displayed display module is used for displaying the first content to be displayed and the second content to be displayed based on the first content to be displayed, the second content to be displayed and the display layout.
20. An electronic device comprising a memory and a processor, the memory coupled to the processor, the memory storing instructions that, when executed by the processor, the processor performs the method of any of claims 1-18.
21. A computer-readable storage medium having program code stored therein, the program code being invoked by a processor to perform the method of any one of claims 1 to 18.
CN202011104854.6A 2020-10-15 2020-10-15 Display method, display device, electronic equipment and storage medium Active CN112181343B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202011104854.6A CN112181343B (en) 2020-10-15 2020-10-15 Display method, display device, electronic equipment and storage medium
PCT/CN2021/112258 WO2022078039A1 (en) 2020-10-15 2021-08-12 Display method and apparatus, electronic device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011104854.6A CN112181343B (en) 2020-10-15 2020-10-15 Display method, display device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN112181343A true CN112181343A (en) 2021-01-05
CN112181343B CN112181343B (en) 2023-05-02

Family

ID=73950408

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011104854.6A Active CN112181343B (en) 2020-10-15 2020-10-15 Display method, display device, electronic equipment and storage medium

Country Status (2)

Country Link
CN (1) CN112181343B (en)
WO (1) WO2022078039A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113110903A (en) * 2021-03-24 2021-07-13 联想(北京)有限公司 Content display method and device
WO2022078039A1 (en) * 2020-10-15 2022-04-21 Oppo广东移动通信有限公司 Display method and apparatus, electronic device and storage medium
WO2022170949A1 (en) * 2021-02-10 2022-08-18 华为技术有限公司 Detection method and apparatus for relative positions between devices
US20230134243A1 (en) * 2021-10-29 2023-05-04 Citrix Systems, Inc. Dynamic Use Of Secondary Devices During a Virtual Session

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101149673A (en) * 2006-09-18 2008-03-26 联想(北京)有限公司 Multiple-display system and method for automatically identifying and adjusting relative position of multiple displays
US20110014947A1 (en) * 2008-12-29 2011-01-20 Hui-Hu Liang System and Method for Transferring the Operation of an Image Device to an External Apparatus
CN103049235A (en) * 2012-12-04 2013-04-17 深圳市爱渡飞科技有限公司 Method, terminal and system for synchronously displaying multiple-screen images
JP2017117020A (en) * 2015-12-21 2017-06-29 株式会社リコー Display device, display system, and method
CN108055558A (en) * 2017-12-27 2018-05-18 浙江大华技术股份有限公司 A kind of on-screen display system and method
CN109508162A (en) * 2018-10-12 2019-03-22 福建星网视易信息系统有限公司 A kind of throwing screen display methods, system and storage medium
CN111131866A (en) * 2019-11-25 2020-05-08 华为技术有限公司 Screen-projecting audio and video playing method and electronic equipment

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103856809A (en) * 2012-12-03 2014-06-11 中国移动通信集团公司 Method, system and terminal equipment for multipoint at the same screen
US9992441B2 (en) * 2015-01-05 2018-06-05 Lattice Semiconductor Corporation Displaying multiple videos on sink device using display information of source device
US10536739B2 (en) * 2017-01-04 2020-01-14 Samsung Electronics Co., Ltd. Display apparatus and control method thereof
CN109783181B (en) * 2019-01-31 2019-12-20 掌阅科技股份有限公司 Screen adaptive display method, electronic device and computer storage medium
CN112181342B (en) * 2020-10-15 2023-08-18 Oppo广东移动通信有限公司 Display method, display device, electronic equipment and storage medium
CN112181343B (en) * 2020-10-15 2023-05-02 Oppo广东移动通信有限公司 Display method, display device, electronic equipment and storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101149673A (en) * 2006-09-18 2008-03-26 联想(北京)有限公司 Multiple-display system and method for automatically identifying and adjusting relative position of multiple displays
US20110014947A1 (en) * 2008-12-29 2011-01-20 Hui-Hu Liang System and Method for Transferring the Operation of an Image Device to an External Apparatus
CN103049235A (en) * 2012-12-04 2013-04-17 深圳市爱渡飞科技有限公司 Method, terminal and system for synchronously displaying multiple-screen images
JP2017117020A (en) * 2015-12-21 2017-06-29 株式会社リコー Display device, display system, and method
CN108055558A (en) * 2017-12-27 2018-05-18 浙江大华技术股份有限公司 A kind of on-screen display system and method
CN109508162A (en) * 2018-10-12 2019-03-22 福建星网视易信息系统有限公司 A kind of throwing screen display methods, system and storage medium
CN111131866A (en) * 2019-11-25 2020-05-08 华为技术有限公司 Screen-projecting audio and video playing method and electronic equipment

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022078039A1 (en) * 2020-10-15 2022-04-21 Oppo广东移动通信有限公司 Display method and apparatus, electronic device and storage medium
WO2022170949A1 (en) * 2021-02-10 2022-08-18 华为技术有限公司 Detection method and apparatus for relative positions between devices
CN113110903A (en) * 2021-03-24 2021-07-13 联想(北京)有限公司 Content display method and device
US20230134243A1 (en) * 2021-10-29 2023-05-04 Citrix Systems, Inc. Dynamic Use Of Secondary Devices During a Virtual Session

Also Published As

Publication number Publication date
WO2022078039A1 (en) 2022-04-21
CN112181343B (en) 2023-05-02

Similar Documents

Publication Publication Date Title
CN112181343B (en) Display method, display device, electronic equipment and storage medium
US10255481B2 (en) Display device and operating method thereof with adjustments display
CN111372126B (en) Video playing method, device and storage medium
CN112181342B (en) Display method, display device, electronic equipment and storage medium
CN112398855B (en) Method and device for transferring application contents across devices and electronic device
US20150230067A1 (en) System for and method of transmitting communication information
WO2020253295A1 (en) Control method and apparatus, and terminal device
US20220394192A1 (en) Video processing method, terminal device and storage medium
KR20200136753A (en) Electronic device, method, and computer readable medium for providing screen sharing service through external electronic device
KR20140029740A (en) Method and apparatus for transferring files during video telephony in electronic device
WO2023078030A9 (en) Terminal screen capture method and apparatus, storage medium, and electronic device
KR20220038176A (en) Parameters for overlay processing for immersive teleconferencing and telepresence for remote endpoints
WO2020010977A1 (en) Method and apparatus for rendering virtual channel in multi-world virtual scenario
US20220413787A1 (en) Screenshot display method and apparatus, and terminal device
US11115725B2 (en) User placement of closed captioning
TW202133190A (en) The invention relates to a display method of pathological section images electronic equipment and storage medium
US11310441B2 (en) Electronic device for generating a background image for a display apparatus and operation method thereof
WO2023142266A1 (en) Remote interaction method, remote interaction device and computer storage medium
US11232796B2 (en) Voice activity detection using audio and visual analysis
CN113301444B (en) Video processing method and device, electronic equipment and storage medium
WO2021073204A1 (en) Object display method and apparatus, electronic device, and computer readable storage medium
WO2020233167A1 (en) Method, apparatus and device for image capture, and medium
US9826278B2 (en) Electronic device and method for providing broadcast program
US9900551B2 (en) Communication terminal and information processing apparatus
CN110896567A (en) Data transmission method and device based on WIFI

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant