CN115729502A - Response method of screen projection terminal and display terminal, electronic device and storage medium - Google Patents
Response method of screen projection terminal and display terminal, electronic device and storage medium Download PDFInfo
- Publication number
- CN115729502A CN115729502A CN202210320929.7A CN202210320929A CN115729502A CN 115729502 A CN115729502 A CN 115729502A CN 202210320929 A CN202210320929 A CN 202210320929A CN 115729502 A CN115729502 A CN 115729502A
- Authority
- CN
- China
- Prior art keywords
- screen
- display
- screen projection
- application
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 115
- 230000004044 response Effects 0.000 title claims abstract description 88
- 238000005266 casting Methods 0.000 claims description 35
- 238000004891 communication Methods 0.000 claims description 20
- 230000005540 biological transmission Effects 0.000 claims description 18
- 230000001960 triggered effect Effects 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 12
- 238000012790 confirmation Methods 0.000 claims description 8
- 238000005520 cutting process Methods 0.000 claims description 8
- 238000000638 solvent extraction Methods 0.000 claims description 8
- 239000004973 liquid crystal related substance Substances 0.000 claims description 3
- 230000006870 function Effects 0.000 description 33
- 230000008569 process Effects 0.000 description 18
- 238000012545 processing Methods 0.000 description 14
- 238000001514 detection method Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 11
- 230000008859 change Effects 0.000 description 6
- 230000000007 visual effect Effects 0.000 description 4
- 239000002699 waste material Substances 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 238000013475 authorization Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 230000014509 gene expression Effects 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 230000004913 activation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 239000011248 coating agent Substances 0.000 description 1
- 238000000576 coating method Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
Images
Abstract
The embodiment of the application provides a screen projection end and display end response method, electronic equipment and a storage medium. In some embodiments, the response method of the screen projection end includes: drawing a screen interface of a virtual screen created by the screen projection application according to the interface information of the application module; determining screen projection data according to a screen interface of the virtual screen; and transmitting the screen projection data to the display end so as to display the screen projection data through at least one display screen of the display end. The screen projection method and the screen projection device can achieve screen projection of the screen projection end and the screen projection of the display end.
Description
Technical Field
The present disclosure relates to the field of communications technologies, and in particular, to a method for responding to a screen projection end and a display end, an electronic device, and a storage medium.
Background
With the development of automobile technology, more and more functions are provided for automobiles. Such as navigation functions, video playback functions, etc. With the increase of automobile functions, the requirements on the processing capacity, the storage capacity and the like of an automobile central control unit are higher and higher, and the automobile cost is also higher and higher.
Disclosure of Invention
Embodiments of the present application provide a screen-projection end and display end response method, an electronic device, and a storage medium, which can at least partially solve the above-mentioned problems in the prior art.
In a first aspect, an embodiment of the present application provides a response method for a screen projection end, where the screen projection end is installed with a screen projection application, and the screen projection application is provided with a plurality of application modules; the method comprises the following steps: drawing a screen interface of a virtual screen created by the screen projection application according to the interface information of the application module; determining screen projection data according to a screen interface of the virtual screen; and transmitting the screen projection data to the display end so as to display the screen projection data through at least one display screen of the display end.
In a second aspect, an embodiment of the present application provides a response method of a display terminal, including: receiving screen projection data transmitted by a screen projection end interconnected with a display end, wherein the screen projection data are determined according to a screen interface of a virtual screen created by a screen projection application of the screen projection end, and the screen interface of the virtual screen is drawn according to interface information of an application module in the screen projection application; and displaying the screen projection data through at least one display screen of the display terminal.
In a third aspect, an embodiment of the present application provides an electronic device, including: at least one processor; the communication unit is in communication connection with at least one processor and is used for data transmission under the control of the processor; and a memory communicatively coupled to the at least one processor; the electronic device comprises a memory, at least one processor and at least one screen projection terminal, wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the response method of the screen projection terminal mentioned in the above embodiment; alternatively, the response method of the display side as mentioned in the above embodiment is performed, and the electronic device is the display side.
In a fourth aspect, the embodiments of the present application provide a computer-readable storage medium storing a computer program, which when executed by a processor, implements the response method mentioned in the above embodiments.
According to one embodiment of the application, the application to be screen-thrown is arranged in the screen-throwing application in the form of the application module, so that the screen-throwing application has the authority of acquiring the related data of the application module, the authority does not need to be requested to the application to be screen-thrown, and the probability of screen-throwing failure caused by the fact that the data acquisition authority of the application to be screen-thrown does not have the authority is reduced. In addition, the screen projection end projects the virtual screen drawn based on the interface information of the application module to the display end, and the display end can display the response result of the application modules to the user operation, so that the display end can provide the service of the application modules for the user under the condition that the application modules are not installed, the requirements on the processing capacity of the display end and the like are reduced, and the hardware cost of the display end is reduced.
Drawings
Other features, objects and advantages of the present application will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, which proceeds with reference to the accompanying drawings. Wherein:
fig. 1 is a schematic frame diagram of a screen projection system composed of a screen projection end and a display end according to an embodiment of the present application;
FIG. 2 is a block diagram of a screen projection end provided by an embodiment of the present application;
FIG. 3 is a block diagram of a display terminal, such as a vehicle, provided in an embodiment of the present application;
FIG. 4 is a schematic view of a display interface of at least one display screen of a display terminal provided by an embodiment of the application;
FIG. 5 is a schematic view of a display interface of at least one display screen of a display terminal provided by an embodiment of the application;
FIG. 6 is a flow chart of a response method of a screen projection end provided according to an embodiment of the application;
fig. 7 is a schematic flowchart of a response method of a display end according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the application.
Detailed Description
For a better understanding of the present application, various aspects of the present application will be described in more detail with reference to the accompanying drawings. It should be understood that the detailed description is merely illustrative of exemplary embodiments of the present application and does not limit the scope of the present application in any way. Like reference numerals refer to like elements throughout the specification. The expression "and/or" includes any and all combinations of one or more of the associated listed items.
It should be noted that in this specification the expressions first, second, third etc. are only used to distinguish one feature from another, and do not indicate any limitation of features, in particular any order of precedence. For example, a first projection end discussed in this application may also be referred to as a second projection end, and vice versa, without departing from the teachings of this application.
It will be further understood that terms such as "comprising," "including," "having," "including," and/or "containing" are used in this specification to specify the presence of stated features, elements, and/or components, but do not preclude the presence or addition of one or more other features, elements, components, and/or groups thereof. Furthermore, when a statement such as "at least one of" appears after a list of listed features, it modifies that entire list of features rather than merely individual elements of the list. Furthermore, the use of "may" mean "one or more embodiments of the application" when describing embodiments of the application. Also, the term "exemplary" is intended to refer to an example or illustration.
Unless otherwise defined, all terms (including engineering and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
It should be noted that, in the present application, the embodiments and features of the embodiments may be combined with each other without conflict. In addition, unless explicitly defined or contradicted by context, the specific steps included in the methods described herein are not necessarily limited to the order described, but can be performed in any order or in parallel. The present application will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
Further, in this application, when "connected" is used, it can mean either direct contact or indirect contact between the respective components, unless there is an explicit other limitation or one that can be inferred from the context.
The embodiment of the application provides a screen projecting system which comprises a screen projecting end and a display end, wherein the screen projecting end is in communication connection with the display end so as to present data of the screen projecting end on the display end.
As an example, the screen projection terminal 11 may be a mobile terminal, and the display terminal 12 may be a vehicle provided with a display screen. The mobile terminal may be a smart phone (e.g., a mobile phone), a personal computer, a tablet computer, a laptop computer, a wearable device (e.g., a smart band, etc.), an ultrabook, etc., which is not limited in this application. The vehicle may be an automobile, a tram, a train, a ship, an airplane, a helicopter, a vehicle in an amusement park, construction equipment, etc., and the embodiment of the present application is not particularly limited.
The following description exemplifies a screen projection system, a screen projection end response method, a display end response method, and the like provided in the embodiments of the present application, taking a screen projection end as a mobile terminal and a display end as a vehicle. It should be understood that the screen projection end and the display end can be other electronic devices without departing from the teachings of the present application, and the manner of implementing the screen projection can refer to the relevant description of the present application.
Fig. 1 is a schematic diagram of a screen projection system including a screen projection terminal and a display terminal according to an embodiment of the present application, and fig. 2 is a block diagram of a screen projection terminal 11 provided in an embodiment of the present application.
As shown in fig. 1, the screen projection end and the display end are connected in communication. As shown in fig. 2, the screen projecting terminal 11 includes a body 111 and a display screen 112, a processor (not shown) and a memory (not shown) connected to the display screen 112 are installed in the body 111, and instructions related to the response method of the screen projecting terminal 11 mentioned in this embodiment are stored in the memory, so that the processor executes the instructions to implement the response method of the screen projecting terminal 11 mentioned in this embodiment. The screen projection end 11 is installed with a screen projection application 1121 and other third party applications 1122. Icons for the screen projection application 1121 and other third party applications 1122 may be displayed via the display screen 112 for use by the user. The screen projection application 1121 may be configured to transmit screen projection data of the screen projection terminal 11 to the display terminal 12.
As an example, a plurality of application modules (not shown) are provided in the screen projection application, each application module may be an independently running applet, and a plurality of application modules may also interact with each other, which is not limited in this application.
It should be understood that fig. 2 is only an illustration, and the number of the third-party applications 1122 installed on the screen projection end 11, the number of the application modules of the screen projection application 1121, and the arrangement of the application modules and the third-party applications 1122 may be adjusted as needed.
Illustratively, the screen projection application 1121 may be used to create a virtual screen. The virtual screen may also be referred to as a virtual display screen with respect to the real display screen 112 of the projection end 11. The virtual screen can be created through software programming and is used for bearing the content of an operation interface in the running process of the application module, and the operation interface of the application module is displayed on the virtual screen, which is equivalent to a background for displaying and coding the application module.
For example, each application module in the screen projection application 1121 may have some functions suitable for the display side. For example, the display end 12 is a vehicle, and the application modules may include: navigation modules, video modules, and the like.
By way of example, the third party application may include chat software, entertainment software, learning software, and the like, which is not limited in this application.
Fig. 3 is a block diagram of the display terminal 12, which is provided in the embodiment of the present application and takes a vehicle as an example. One or more display screens 121 may be mounted within the display end 12. As shown in fig. 3, the display screen 121 of the display end 12 may include: a center control display 1211 positioned in a main driving view angle, a passenger driving display 1212 positioned in a passenger driving view angle, a main driving rear pillow screen 1213 installed on the rear side of the main driving seat back, and a passenger driving rear pillow screen 1214 installed on the rear side of the passenger driving seat back. The display screen 121 may be formed by coating a material having a display function (e.g., a flexible display screen), and may also be a liquid crystal display screen, an LED display screen, or the like, which is not limited in this application. A projected application (not shown) may be installed on the display end 12. The screen-thrown application can control the display terminal 12 to establish a communication connection with the screen-thrown terminal 11 under the condition of obtaining the user authorization, and has an application program adapted to the screen-thrown application 1121. The fact that the screen-projected application has an application program adapted to the screen-projected application 1121 may mean that the screen-projected application has any one of the following functions:
1. the screen-projected application can process and display the screen-projected data transmitted by the screen-projected application 1121 according to a preset data processing method such as decryption, decompression and the like corresponding to the processing method such as encryption, compression and the like of the screen-projected data in the screen-projected application 1121.
2. The screen-projected application may obtain information of an application module installed in the screen-projected application 1121, and may obtain information of the third-party application 1122 installed in the screen-projected terminal 11 through the screen-projected application 1121 if authorization is obtained.
It should be understood that the number and location of the display screens 121 in fig. 3 may be adjusted as desired without departing from the teachings of the present application, which is not limited by the present application.
As an option, after the screen projection application is started, initializing a display interface on a virtual screen created based on a central control display screen of the display terminal, so that the display interface displays a main operation interface of the screen projection application. In the case that the screen-casting application is authorized, information (such as names and icons) of application modules installed in the screen-casting application and information (such as names and icons) of third-party applications can be displayed in the main operation interface. And the screen projection application transmits the drawn virtual screen to the screen projected application of the display end, so that the central control display screen of the display end displays a main operation interface of the screen projection application. For example, fig. 4 is a schematic display interface diagram of at least one display screen 121 (e.g., a central control display screen) of the display terminal provided in the embodiment of the present application. The application module 1 and the application module 2 can be, for example, a navigation module and a video module, and chat software, game software, and the like are third-party applications. In order to facilitate the user to know the differentiated applications (i.e., the application module and the third-party application), the display positions of the icons of the respective applications may be adjusted, so that the icons of the application modules are displayed in the same area of the operation interface (e.g., the left area of the operation interface), and the icons of the third-party applications are displayed in the same area of the operation interface (e.g., the right area of the operation interface). It should be understood that fig. 4 is only an exemplary illustration, and the type, number, etc. of the third-party applications actually installed on the screen projection end can be set as required.
It should be understood that the main operating interface may also be drawn by the projected screen application without departing from the teachings of the present application. In an example, the screen projection application transmits the information of the application module and the information of the third-party application to the screen projected application, and the screen projected application draws a main operation interface on the central control display screen based on the information. This is not limited by the present application.
As an example, the display terminal displays, through at least one display screen of the display terminal, an identifier of an application module in a screen-casting application of the screen-casting terminal interconnected with the display terminal, and an identifier of a third-party application having a screen-casting permission on the screen-casting terminal, and acquires and transmits user operation information of the at least one display screen of the display terminal to the screen-casting terminal. And the screen projection end acquires the user operation information and determines screen projection data according to the user operation information. And the display terminal acquires the screen projection data determined by the screen projection terminal and displays the screen projection data through at least one display screen of the display terminal. By the mode, the user can operate the application module in the screen projection application of the screen projection end and the third-party application of the screen projection end through the display end, and further the display end has the functions of the application module and the third-party application under the condition that the application module and the third-party application are not installed, so that the requirements on the processing capacity and the like of the display end can be reduced, and the hardware cost of the display end is reduced.
It should be understood that, without departing from the teachings of the present application, the user may also directly operate the application module of the screen projection application and the third-party application at the screen projection end, that is, the screen projection end obtains the user operation information through the input device such as the display screen of the screen projection end, and the present application does not limit the source of the user operation information.
In some embodiments of the present application, the manner of processing the user operation information at the screen projection end may be: the screen projection end firstly determines the application of user operation according to the user operation information, if the user operation information indicates that the application of user operation is the screen projection application, the screen projection application determines an application module of user operation according to a display screen (the display screen of the screen projection end or the display screen of the display end) for acquiring the user operation information, and transmits the user operation information to the determined application module, and the application module processes the user operation information by combining with own processing logic. If the user operation information indicates that the application operated by the user is a third-party application, the screen projection end can transmit the user operation information to the third-party application, and the third-party application combines with the processing logic of the third-party application to process the user operation information.
In some embodiments of the present application, the function programs of the screen projection application and the third-party application may be installed at the screen projection end, and may also be installed at the cloud end. The screen projection end stores an address of a cloud end capable of achieving functions of screen projection application and third-party application, and can be connected with a server of the cloud end through the address.
As an example, a program for implementing the function of each application module may be installed on the screen projection side, for example, the data of the screen projection application includes the program for implementing the function of each application module. The program for implementing the function of each application module may also be installed in the cloud (i.e., a remote server or a server group thereof), for example, the data of the screen projection application includes an address of the cloud that can implement the function of each application module, and the screen projection application may request a relevant service from the cloud based on address information of the cloud when the function of any application module needs to be called.
For example, a screen projection end acquires user operation information; determining an application module triggered by a user according to the user operation information; and calling the server of the application module to respond to the user operation information through the determined communication interface of the application module. And the screen projection end receives the feedback data of the server and determines the interface information of the application module according to the feedback data of the server.
In some embodiments of the present application, on the main operation interface shown in fig. 4, after the screen-projected application detects that the application module 1 is triggered by the user, the screen-projected application transmits the user operation information indicating that the application module 1 is triggered to the screen-projected application at the screen-projecting end. And starting the application module 1 by the screen projection application at the screen projection end, and drawing an operation interface of the application module 1 on a virtual screen created based on the central control display screen. The screen projection end transmits the screen interface of the virtual screen to the display end, and the display end can display the operation interface of the application module 1 and provide the service related to the application module 1 for the user.
Alternatively, fig. 5 is a schematic display interface diagram of at least one display screen of the display terminal provided in the embodiment of the present application. As shown in fig. 5, at least one display screen 121 displays screen projection data through a first display area 121-1, and displays information of an application module that is not started and/or information of a third-party application through a second display area 121-2, so that a user can start a new application screen projection based on a screen projection of a certain application.
As an example, the manner in which the screen-casting application draws the operation interface of the application module on the virtual screen includes: and drawing a first area of the virtual screen according to the operation interface of the application module, and drawing a second area of the virtual screen according to the information of the application module and/or the information of the third party application. After the screen projection application transmits the screen projection data determined according to the screen interface of the virtual screen to the screen projected application, the screen projected application presents an interface as shown in fig. 5 on at least one display screen 121 based on the screen projection data.
As another example, after the screen projection application draws a virtual screen according to the operation interface of the application module and transmits screen projection data determined according to the screen interface of the virtual screen to the screen projection application, the screen projection application displays the screen projection data in the first display area 121-1 of the at least one display screen 121, and displays the icon of the application module and/or the icon of the third party application in the second display area 121-2 according to the information of the application module and/or the information of the third party application, thereby presenting the interface shown in fig. 5.
The following is an exemplary description of the start condition of the screen-projecting application at the screen-projecting end.
In some embodiments of the application, after the screen projection end detects the screen projection instruction, the screen projection application is started, and the triggering mode of the screen projection instruction includes, but is not limited to, mode one, mode two, and mode three.
In one mode
In some embodiments of the present application, a user may launch a screen-cast application at a screen-cast end. And the screen projection end responds to the screen detection data of the screen projection end to indicate that the triggered application icon is the icon of the screen projection application, and triggers a screen projection instruction so as to start the screen projection application.
Mode two
In some embodiments of the application, the screen-projecting command is automatically triggered when the screen-projecting end is close to the display end. And the screen projection end triggers a screen projection instruction in response to the detection of the screen projection request, wherein the triggering condition of the screen projection request at least comprises that the screen projection end is close to the display end. The screen projecting application is automatically started after the screen projecting end is close to the display end, screen projecting operation is carried out, the flow of the screen projecting operation triggered by a user is simplified, the complexity of the screen projecting operation is reduced, and user experience is improved.
In some embodiments of the present application, the screen-projecting request may be sent to the screen-projecting terminal by the display terminal after determining that the screen-projecting terminal is close to the display terminal. Illustratively, the display end detects the distance between the screen projection end and the display end, and judges whether the screen projection end is close to the display end according to the distance. And the display terminal responds to the fact that the screen projecting terminal is close to the display terminal, and sends a screen projecting request to the screen projecting terminal.
As an example, a distance detection module can be installed on the display end, and the distance detection module senses the distance between the screen projection end and the display end. And the display end responds that the distance between the screen projection end and the display end is smaller than a preset distance threshold value, or the distance between the screen projection end and the display end indicates that the movement trend of the screen projection end is close to the display end, and then the screen projection end is judged to be close to the display end.
Illustratively, the distance detection module may be an Ultra Wide Band (UWB) module. Specifically, one or more UWB modules are respectively installed on the display end and the screen projection end (hereinafter, the UWB module at the display end is referred to as a UWB anchor, and the UWB module at the screen projection end is referred to as a UWB tag). The UWB anchor may acquire its distance from the UWB tag if the UWB tag enters its sensing range. The display end can judge whether the screen projection end is close to the display end according to the distance value induced by the UWB anchor point. Because the precision of the UWB module is higher, the distance value measured by the UWB module is more accurate, and the accuracy of the response method is improved.
It should be understood that the distance between the screen projection end and the display end can be determined by analyzing the distance between the screen projection end and the vehicle in the image captured by the image capturing device without departing from the teachings of the present application, and the present application is not limited thereto.
It should be understood that, without departing from the teachings of the present application, the distance between the screen projecting end and the display end may also be measured by the screen projecting end, and in the case that the distance between the screen projecting end and the display end is determined to indicate that the screen projecting end is close to the display end, the screen projecting request is triggered to start the automatic screen projecting, which is not limited in the present application.
Mode III
In some embodiments of the application, the screen projection instruction is automatically triggered when the screen projection end is close to the display end and the state of the screen projection end meets the requirement. And after detecting the screen projection request, the screen projection end acquires the state information of the screen projection end, wherein the trigger condition of the screen projection request at least comprises that the screen projection end is close to the display end. And the screen projection end determines whether to trigger a screen projection instruction according to whether the state information of the screen projection end meets the screen projection requirement. And the screen projection end responds to the detected screen projection instruction and transmits screen projection data to the display end. It is worth mentioning that the screen projecting end detects the state of the screen projecting end after receiving the screen projecting request, and then starts the screen projecting application after determining that the state of the screen projecting end meets the screen projecting requirement, so that the conditions that the screen projecting data does not have screen projecting significance, the screen projecting operation influences the normal use of the screen projecting end and the like due to the state of the screen projecting end can be reduced.
It should be noted that, the triggering manner of the screen-projection request in the third manner may refer to the related description of the second manner, and is not described herein again. The following describes an exemplary manner for determining whether the screen projection end meets the screen projection condition.
In some embodiments of the present application, the state information of the screen projection terminal may include at least one of battery state information of the screen projection terminal and usage state information of the screen projection terminal. The usage state information includes at least one of: the method comprises the steps of screen state information of a screen projection end, audio channel state information of the screen projection end, screen image information of the screen projection end and feature information of a currently running application of the screen projection end. The following is an exemplary description of the various status information and their corresponding screen projection requirements.
1. Exemplary description of Battery State information
In some embodiments of the present application, the status information of the screen projection end includes battery status information, and the screen projection requirement at least includes a battery status requirement. Wherein the battery status requirements may include: the battery state information of the screen projection end indicates that the electric quantity of the screen projection end is larger than a preset electric quantity threshold value; or the battery state information of the screen projection end indicates that the battery of the screen projection end is in a charging state. After the screen projection end opens the screen projection, the power consumption of the screen projection end is increased. If the electric quantity of the screen projection end is insufficient, the use of other functions of the screen projection end can be influenced. The battery state information of the screen projection end is judged before the screen projection, so that the influence of the screen projection operation on other functions of the screen projection end can be reduced.
Illustratively, the charge threshold may be a fixed value, such as any value between 50% and 90%, or may be a dynamic value. For example, the screen projection end dynamically adjusts the electric quantity threshold value according to the electric consumption of the screen projection application, and if the electric consumption of the screen projection application is large, the electric quantity threshold value is large, the electric consumption of the screen projection application is small, and the electric quantity threshold value is small, so that the screen projection end can flexibly determine whether to trigger the screen projection operation in combination with the electric consumption condition of the screen projection application.
It should be understood that the battery status requirement setting may be adjusted by one skilled in the art for other purposes, and the present application is not limited thereto.
2. Exemplary description of Screen State information
In some embodiments of the present application, the state information of the screen projection end includes screen state information, and the screen projection requirement at least includes a screen state requirement. The screen status requirements may include: and the screen state information indicates that the screen projection end is bright. In other words, the screen projection end does not trigger automatic screen projection under the condition that the screen projection end is in the screen-off state. In some cases, even if the screen projection end opens the screen projection, the acquired screen projection data has little or no viewing significance to the user, that is, the screen projection data has no screen projection significance. For example, the screen projection end projects the screen by means of screen recording, but the screen projection end is not in a screen-off state currently, the screen projection data recorded by the screen projection end may be a screen-locking interface, and the screen-locking interface has a small viewing meaning for a user. The screen projection end automatically projects the screen after determining that the screen projection end is bright by detecting the screen state information of the screen projection end, so that the resource waste caused by triggering screen projection operation under the condition that the screen projection end does not need to project the screen can be reduced.
It should be understood that the screen status requirements may be adjusted by one skilled in the art for other purposes, and the present application is not limited thereto.
3. Exemplary illustration of Audio channel State information
In some embodiments of the present application, the state information of the screen projection end includes audio channel state information, and the screen projection requirement at least includes an audio state requirement.
As one example, the audio status requirements may include: the audio channel state information indicates that the screen projection end is not in a call state. In other words, if the screen-throwing end is talking, the screen-throwing end does not trigger the automatic screen-throwing instruction. When the screen projection end is in a call state, screen projection data of the screen projection end comprise an operation interface of a call application, and privacy information may exist in the interface. The screen projection end determines whether an audio input channel and an audio output channel of the screen projection end are simultaneously opened or not by detecting the state information of the audio channel, and judges whether the screen projection end is in a conversation state or not so as to reduce the problems of privacy disclosure and the like.
As another example, the audio status requirements may also include: the audio state information indicates that the screen projection end has audio output, namely the screen projection end can trigger automatic screen projection under the condition of playing audio. Generally, when the functions of video watching, navigation and the like of the screen projection end are used, the screen projection end can open an audio output channel to be opened. Therefore, the screen projection end can detect the state information of the audio channel and determine whether the applications which are required to be projected exist in the running applications of the screen projection end. Under the condition that the screen projection end has the application which possibly needs to project the screen, the automatic screen projection is triggered again, and resource waste caused by starting the screen projection under the condition that no screen projection requirement exists can be reduced.
It should be understood that the audio status requirements may be set as desired without departing from the teachings of the present application, which is not limited in this application.
4. Exemplary description of Screen image information
In some embodiments of the application, the state information of the screen projection end comprises screen image information, and the screen projection requirement comprises a screen display requirement. Illustratively, the screen display requirements include: and the screen image information indicates that the application currently running at the screen projection end has the screen projection requirement. The currently running application can comprise an application running in the foreground of the screen projection end. When the screen projection end is close to the display end, if the application running on the screen projection end is an application with small interface information change and the user mainly obtains information through hearing, such as conversation, song listening and the like, the difference between the screen projection end projecting the screen to the display end so as to provide service for the user through the display end and the screen projection end continuously used for providing service for the user is not large. In this case, the screen projection end may not automatically trigger the screen projection, and after the user determines that the screen projection is needed, the user selects the manual screen projection operation, so as to reduce the power consumption and the computing resource consumption caused by the screen projection operation.
In some embodiments of the application, the screen projection end obtains a plurality of screen capture images of a display screen of the screen projection end according to a preset screen capture rule to serve as screen image information, and judges whether the screen image information meets the screen display requirement or not according to the similarity between the plurality of screen images and a preset requirement judgment rule. The manner in which the screen-projecting end acquires the screen capture image is exemplarily described below. The similarity between the two screen images can be determined according to the change of the value of the image parameter of the pixel point corresponding to the two screen images. The image parameter of the pixel point may be, for example, an RGB value of the pixel point, and the like, which is not limited herein.
As one example, the screen-projection end may periodically intercept the screen-shot image. For example, the screen projection end is at t 1 At time instant, a first cut-screen image is captured at t 1 (m) capturing a second screenshot image at time t 1 And (3) intercepting a third screen-cut image at +2m moment (8230) \ 8230f, and stopping until the rootAnd determining whether the currently running application has a screen projection requirement according to a requirement judgment rule, and finishing screen capture. Wherein the predetermined screen capture interval m may be set to 1s, 0.5s, etc.
As another example, the screen projection end may periodically intercept the screen capture image. Exemplarily, the screen projection end intercepts M screen capture images according to a preset screen capture interval, wherein M is larger than 1; and dynamically adjusting the screen capture interval according to the similarity between the M screen capture images.
For ease of understanding, M =2 is exemplified below. The screen projection end intercepts a first screen capture image, and intercepts a second screen capture image after a preset screen capture interval; updating the screen capture interval according to the similarity of the first screen capture image and the second screen capture image and a preset interval adjustment rule, and capturing a third screen capture image according to the updated screen capture interval; and taking the second screen capture image as the first screen capture image, taking the third screen capture image as the second screen capture image, continuing to execute the step of updating the screen capture interval until judging whether the currently running application has the screen projection requirement or not, and ending screen capture.
It should be understood that M may also be an integer greater than 2, the screen projection end calculates the similarity between two continuously captured screenshot images, and adjusts the screenshot interval according to the calculated multiple similarities and a preset interval adjustment rule, which is not limited in this application.
Alternatively, the interval adjustment rule indicates that: if the similarity between the M screen capturing images is larger than a first threshold value, the screen capturing interval is increased, and if the similarity between the M screen capturing images is determined to be smaller than or equal to the first threshold value, the screen capturing interval is decreased. The screen-shooting end dynamically adjusts the screen-shooting interval according to the similarity of two continuously-shot screen images, the screen-shooting interval can be adjusted under the condition that the similarity is greatly increased, resource loss caused by screen-shooting operation is reduced, the screen-shooting interval is shortened under the condition that the similarity is small, and the accuracy of a judgment result is improved.
For example, M =2, the requirement determining rule indicates that if the similarity of two continuously captured screen capture images is smaller than the similarity threshold, it is determined that the currently running application has a screen projection requirement. The screen projection end is at t 1 Time is interceptedA cut-screen image at t 1 Capturing a second screenshot image at a time of + m (a predetermined screenshot interval), calculating the similarity between the first screenshot image and the second screenshot image, updating the judgment times in response to the fact that the similarity between the first screenshot image and the second screenshot image is greater than or equal to a similarity threshold value and the similarity between the first screenshot image and the second screenshot image is greater than a first threshold value, and updating the judgment times at t 1 +m+l 1 A third screen cut image is cut at a moment, and t is added 1 The screenshot at time + m is taken as the first screenshot, t 1 +m+l 1 And taking the screen capture image at the moment as a second screen capture image, calculating the similarity between the first screen capture image and the second screen capture image again, and judging that the currently running application has the screen projection requirement in response to the fact that the similarity between the first screen capture image and the second screen capture image is smaller than the similarity threshold. Wherein l 1 > m, the first threshold may be greater than the similarity threshold.
It should be understood that the manner in which the screenshot images are captured may be adjusted as desired without departing from the teachings of the present application, which is not limited in this application.
The manner of capturing the screen shot image is exemplarily described above, and the requirement determination rule mentioned in the embodiment of the present application is exemplarily described below.
As one example, the demand determination rule may indicate: and determining that the currently running application has a screen projection requirement in response to at least one of the similarity of any two screen capturing images in the N screen capturing images being smaller than a similarity threshold, and determining that the currently running application does not have the screen projection requirement in response to the similarity of any two screen capturing images in the N screen capturing images being larger than or equal to the similarity threshold. N may be greater than or equal to M, or may be less than M, which is not limited in this application.
For ease of understanding, the following example illustrates N equal to 3. And when the screen projection end responds that the similarity between the first screenshot image and the second screenshot image is larger than or equal to the similarity threshold, the similarity between the second screenshot image and the third screenshot image is determined. And the screen projection end responds that the similarity between the second screen capture image and the third screen capture image is smaller than the similarity threshold, then the currently running application is judged to have the screen projection requirement, and the similarity between the first screen capture image and the third screen capture image is determined in response that the similarity between the second screen capture image and the third screen capture image is larger than or equal to the similarity threshold. And the screen projection end responds that the similarity between the first screen cut image and the third screen cut image is smaller than the similarity threshold value, then the currently running application is judged to have the screen projection requirement, and the currently running application is judged not to have the screen projection requirement in response to the similarity between the first screen cut image and the third screen cut image being larger than or equal to the similarity threshold value.
As another example, the demand determination rule may indicate: the method comprises the steps of obtaining the similarity of two continuously intercepted screenshot images in a plurality of screenshot images, determining that a currently running application has a screen projection requirement in response to the fact that at least one of the similarity of the two continuously intercepted screenshot images is smaller than a similarity threshold, and determining that the currently running application does not have the screen projection requirement in response to the fact that the similarity of the two continuously intercepted screenshot images is larger than or equal to the similarity threshold.
It should be appreciated that the similarity threshold may be set empirically or based on similarity calculations for screen shots taken by listening to songs and the like without departing from the teachings of the present application, and the present application is not limited in this regard.
It should be understood that the requirement determination rules may be adjusted as needed without departing from the teachings of the present application, which is not limited in this respect.
5. Exemplary description of feature information of currently running application
In some embodiments of the present application, the state information of the screen-projecting end includes feature information of a currently running application, and the screen-projecting requirement includes a screen-projecting application requirement. The screen-casting application requirements include: the feature information of the currently running application indicates that the currently running application has a screen-casting requirement.
For example, the feature information of the currently running application includes a name of the currently running application, and the screen projection terminal determines whether the currently running application has a screen projection requirement according to the name of the currently running application. The screen projection end judges whether the currently running application needs to be projected or not according to the name of the application, so that the screen projection end can determine whether to project the screen or not based on the characteristics of the currently running application, and unnecessary resource loss is reduced.
For example, a first data table is stored in the screen-projecting end, and the first data table includes a preset application name having a screen-projecting requirement. The screen-casting end may obtain a name of a currently running application through, for example, a TopActivity tool, determine that the currently running application has a screen-casting requirement in response to a successful matching between the name of the currently running application and the first data table (that is, the name of the currently running application exists in the first data table), and determine that the currently running application does not have the screen-casting requirement in response to a failed matching between the name of the currently running application and the first data table (that is, the name of the currently running application does not exist in the first data table).
As another example, a second data table and a third data table are stored in the screen projection terminal, the second data table stores a corresponding relationship between an application name and an application type, and the third data table includes a preset application type having a screen projection requirement. The screen projection end obtains the name of the currently running application through a TopActive tool, and determines the application type corresponding to the name of the currently running application according to a first data table; and judging that the currently running application has a screen projection requirement in response to the fact that the determined application type is successfully matched with the third data table, and judging that the currently running application does not have the screen projection requirement in response to the fact that the determined application type is failed to be matched with the third data table.
It should be appreciated that whether the currently running application has a screen projection requirement may also be determined in other ways without departing from the teachings of the present application, and the present application is not limited in this respect.
While various pieces of status information are illustrated above, it should be understood that, in some embodiments, the screen-projecting end may determine whether to automatically trigger the screen-projecting instruction according to one piece of status information or multiple pieces of status information. For example, in some embodiments of the present application, the status information of the screen projection end includes at least two different types of status information (first status information and second status information). The state information of the screen projection end comprises first state information and second state information; determining whether to trigger a screen projection instruction according to whether the state information meets the screen projection requirement comprises: and in response to the first state information meeting the first state requirement in the screen projection requirements, determining whether to trigger a screen projection instruction according to whether the second state information meets the second state requirement in the screen projection requirements. The screen projection end sequentially judges whether to trigger automatic screen projection according to the state information, so that whether the screen projection end has the screen projection requirement or not can be considered from multiple dimensions, and the accuracy of the screen projection requirement judgment result is improved.
As one example, the first status information includes battery status information of the screen projection terminal, and the second status information includes usage status information of the screen projection terminal. The screen projection requirements may include a battery status requirement, and a use status requirement corresponding to the use status information (e.g., at least one of a screen status requirement, an audio status requirement, a screen display requirement, and a screen projection application requirement). In the example, when the screen projection end meets the requirement of the battery state, that is, when the screen projection does not affect other functions of the screen projection end, the screen projection end is combined with the use state of the screen projection end to determine whether to project the screen, so that the waste of computing resources caused by subsequent judgment when the battery at the screen projection end does not meet the requirement of the battery state can be reduced.
As another example, the first state information includes screen state information of the screen projection end, and the second state information includes at least one of audio channel state information of the screen projection end, screen image information of the screen projection end, and feature information of a currently running application of the screen projection end. The screen projection requirements can include a screen status requirement and at least one of an audio status requirement, a screen display requirement, and a screen projection application requirement. In the example, the screen projection end determines whether to project the screen according to whether the application started by the screen projection end has the screen projection requirement or not under the condition that the screen is bright, so that the screen projection effectiveness can be improved.
As still another example, the first state information includes audio channel state information of the screen projection side, and the second state information includes at least one of screen image information of the screen projection side and feature information of a currently running application of the screen projection side. The screen projection requirements may include an audio status requirement and at least one of a screen display requirement and a screen projection application requirement. In the example, the screen projection end determines whether to project the screen or not by combining whether the currently running application of the screen projection has the screen projection requirement or not under the condition of protecting the conversation privacy, so that the safety and the effectiveness of the screen projection can be improved.
It should be understood that, for convenience of understanding, in the embodiment of the present application, the screen-casting end starts the screen-casting application after detecting the screen-casting instruction, so as to execute the response method of the screen-casting end mentioned in the present application as an example, in other embodiments, the screen-casting end may also automatically start the screen-casting application after the screen-casting end is started up, and after detecting the screen-casting instruction, the screen-casting data is transmitted, and the start condition of the screen-casting application is not limited in the present application.
As an option, the screen projection end determines that the state information meets the requirement, and the user starts the screen projection after confirming the screen projection. Exemplarily, the screen projection end responds to the condition information meeting the screen projection requirement and feeds back screen projection confirmation information; and triggering a screen-throwing instruction in response to the detection of the screen-throwing confirmation instruction fed back based on the screen-throwing confirmation information. In other words, the screen projection end feeds back the screen projection confirmation information in a manner of pop-up window or the like under the condition that the state information of the screen projection end is determined to meet the screen projection requirement. And after the screen projection end detects that the user triggers a screen projection confirmation instruction, triggering a screen projection instruction so as to start subsequent screen projection operation. The screen projection is started under the condition that the user confirms the screen projection, so that the safety of user information is improved on the premise of simplifying the screen projection operation.
In some embodiments of the present application, the screen projection end is a mobile terminal, and the display end is a vehicle. And triggering a screen projection instruction when the mobile terminal determines that the state information of the mobile terminal meets the screen projection requirement and the mobile terminal is not in the driving position. The user does not trigger the screen projection operation when driving the vehicle, so that the influence of the screen projection operation on the vehicle running can be reduced, and the driving safety is improved.
It should be understood that, without departing from the teachings of the present application, the screen projection end may also directly trigger the screen projection instruction after determining that the state information of the screen projection end meets the screen projection requirement, which is not limited in the present application.
The start-up conditions of the screen-projected application on the screen-projecting side are exemplarily described above, and the start-up conditions of the screen-projected application on the display side are exemplarily described below.
In some embodiments of the application, the display end starts the screen-projected application in response to detecting that the screen detection data of the display screen for displaying the screen-projected application indicates that the application icon in the triggered area is the icon of the screen-projected application.
Optionally, after the screen-projected application is started, the display terminal sends a screen-projection request to the screen-projection terminal so as to trigger the screen-projection operation. The user can directly start the screen-projected application at the display end and trigger the screen-projecting operation, so that the real-time requirements of the user on screen projection can be met.
In other embodiments of the present application, the display end starts the screen-projected application in response to detecting that the screen-projecting end is close to the display end. Under the condition that the screen projection end is close to the display end, the screen-projected shadow is automatically opened, the screen projection is started, the screen projection operation is simplified, and the user experience is improved.
In other embodiments of the present application, the display end sends a screen projection request to the screen projection end in response to detecting that the screen projection end is close to the display end, so that the screen projection end determines whether to trigger a screen projection instruction according to whether the state information meets the screen projection requirement in response to detecting the screen projection request, and transmits screen projection data to the display end after triggering the screen projection instruction. After a connection request (such as a first connection request or a second connection request mentioned below) sent by the screen projection 1 is received, the screen-projected application is started, and a data link for transmitting screen-projected data is established with the screen projection end. The display end receives the screen projection data and displays the screen projection data through at least one display screen of the display end. And after the screen projection end determines that the screen projection requirement exists, the screen projected application is started, so that the resource consumption caused by running the screen projected application can be reduced.
It should be understood that other activation conditions may also be set for the projected application without departing from the teachings of the present application, and the present application is not limited in this regard.
The above describes the starting conditions of the screen-projecting application and the screen-projected application, and the following describes an exemplary manner of establishing a data link for transmitting screen-projecting data between the screen-projecting end and the display end.
Example 1
In some embodiments of the application, after the screen projection end detects the screen projection instruction, one connection mode is selected from the first connection mode and the second connection mode according to the network device information of the screen projection end and the network device information of the display end, and a data link for transmitting screen projection data is established according to the selected connection mode.
As an example, the first connection manner indicates: the display terminal and the screen projection terminal establish a data link through the first internet. The second connection mode indicates: and the display end and the screen projection end establish a data link through the second internet. The screen projection end responds to the network equipment information of the screen projection end and the network equipment information of the display end to indicate that the network condition of the screen projection end is superior to that of the display end, and a first connection mode is selected; and selecting the second connection mode in response to the fact that the network equipment information of the screen projection end and the network equipment information of the display end indicate that the network condition of the display end is better than the network condition of the screen projection end. The network device information may include indication information of whether the network device is used for establishing the data link, network speed information of the network device, network traffic upper limit information of the network device, and the like.
Taking the screen projection end as a mobile terminal, taking the display end as a vehicle as an example, the network device of the screen projection end is a hot spot of the mobile terminal, and the network device of the display end is a wifi device of the vehicle. Before establishing a data link for transmitting screen projection data, a UWB connection can be established between the mobile terminal and the vehicle through the respective UWB modules for data transmission. The screen projection end and the display end establish wifi connection through a hot spot of the mobile terminal or a wifi device of the vehicle, so that screen projection data can be transmitted more quickly. If the selected connection mode is the first connection mode, the mobile terminal starts a hot spot of the mobile terminal after detecting a screen projection instruction. The mobile terminal initiates a first connection request to the vehicle according to the UWB connection, wherein the first connection request comprises the related information of the hotspot (such as the hotspot name and the hotspot password). After the vehicle receives the first connection request, the vehicle automatically connects the hot spot of the mobile terminal according to the relevant information of the hot spot, and establishes a data link for transmitting screen projection data with the mobile connection. And if the selected connection mode is the second connection mode, the mobile terminal sends a second connection request for requesting the relevant information of the wifi device of the vehicle to the vehicle after detecting the screen-throwing instruction. And after receiving the second connection request, the vehicle feeds back the relevant information (the name and the password of the wifi device) of the wifi device to the mobile terminal. The mobile terminal is automatically connected with the wifi device according to the related information of the wifi device, and establishes a data link for transmitting screen projection data with the vehicle.
It is worth mentioning that the screen projection end can select a connection mode more fitting the current scene according to the network equipment information of the screen projection end and the display end, and establish a data link for transmitting the screen projection data, so that the data transmission of the screen projection end and the display end is more guaranteed.
As another example, the user may set priorities for the first connection method and the second connection method, and the screen projection terminal may select one connection method from the first connection method and the second connection method according to the priority of the first connection method, the priority of the second connection method, the network device information of the screen projection terminal, and the network device information of the display terminal. Exemplarily, the screen projection end determines whether the device corresponding to the connection mode with the higher priority has a network device capable of providing a data link for transmitting the screen projection data according to the network device information of the device (the screen projection end or the display end) corresponding to the connection mode with the higher priority; if yes, selecting a connection mode with higher priority, and if not, selecting a connection mode with lower priority.
For example, the screen projection end is a mobile terminal, and the display end is a vehicle. The priority of the second connection mode is higher than that of the first connection mode. The mobile terminal determines whether the vehicle is provided with a wifi device or not according to the network equipment information of the vehicle; if yes, sending a second connection request for requesting relevant information of a wifi device of the vehicle through UWB connection, and establishing a data link according to the relevant information of the wifi device; if not, the hotspot is opened, and a first connection request containing the name and the password of the hotspot of the mobile terminal is sent to the vehicle through the UWB connection, so that the vehicle and the mobile terminal establish a data link.
It is worth mentioning that the user can set the connection mode selected preferentially according to the network configuration conditions of the screen projection end and the display end, so that the screen projection process is more personalized.
Example 2
In some embodiments of the application, after detecting the screen projection instruction, the screen projection terminal sends a second connection request requesting information related to the network device to the display terminal through the UWB connection, and receives a feedback result of the display terminal to the second connection request through the UWB connection. And the screen projection end responds to the feedback result of the second connection request to indicate that the display end is provided with network equipment capable of providing a data link for transmitting screen projection data, and the display end is connected according to the name and the password of the network equipment of the display end in the feedback result of the second connection request to form the data link for transmitting the screen projection data. The screen projection end responds to a feedback result of the second connection request to indicate that the display end does not have network equipment capable of providing a data link for transmitting screen projection data, the screen projection end starts a hotspot and sends a first connection request comprising a name and a password of the hotspot to the display end, so that the display end establishes connection with the screen projection end through the name and the password of the hotspot to form the data link for transmitting the screen projection data.
It is worth mentioning that the screen projection end preferentially uses the network device of the display end to form a data link, so that the traffic cost of the screen projection end can be reduced.
It should be understood that, without departing from the teachings of the present application, the screen projection end and the display end may also interact with various data through network connections such as USB connection, bluetooth connection, 2G/3G/4G/5G, etc., besides wifi connection and UWB connection, and the connection manner of the screen projection end and the display end is not limited in the present application.
The connection mode between the screen projection terminal and the display terminal is exemplarily described above. The screen projection mode of the screen projection end responding to the application module or the third-party application is exemplarily described below.
In some embodiments of the application, a screen projection end acquires user operation information, performs screen projection on an application module in response to the user operation information, and acquires screen projection data of the application module in a first screen projection mode specified by a screen projection application; or responding to the user operation information to indicate that the third-party application is subjected to screen projection, and acquiring screen projection data of the third-party application in a second screen projection mode designated by the screen projection terminal. The screen projection end transmits the screen projection data to the display end so as to display the screen projection data through at least one display screen of the display end.
It is worth mentioning that the screen projection end can project the application module and the third-party application in the screen projection application to the display end through different screen projection modes, so that the user can obtain the information of the screen projection end through the display end.
As an example, the first screen-casting manner indicates that: and drawing a screen interface of the virtual screen created by the screen projection application according to the interface information of the application module through the screen projection application, and determining screen projection data according to the screen interface of the virtual screen. The content related to the first screen projection mode can refer to the following description about the response method of the screen projection end, and is not described in detail here.
It is worth mentioning that the operation interface of the application module is projected to the display end through the virtual screen, so that the screen projection end can project the screen under the condition of screen extinguishing, and the screen projection effect is improved.
As an example, the second screen-projection manner indicates: and drawing a screen interface of the display screen of the screen projection end according to the interface information of the third-party application, and recording the display screen of the screen projection end to obtain screen projection data.
It is worth mentioning that the operation interface of the third-party application is displayed on the display screen of the screen projection end, and screen projection data is obtained in a screen recording mode, so that the third-party application can be subjected to screen projection.
As another example, the second screen-casting manner indicates that: acquiring a virtual screen created by the screen projection application through an operating system of the screen projection end, and drawing a screen interface of the virtual screen according to interface information of the third-party application; and determining screen projection data according to the screen interface of the virtual screen through the screen projection application.
It is worth mentioning that the virtual screen is created through the screen projection application, and the virtual screen is drawn by the screen projection end according to the interface information of the third party application, so that the screen projection end can project the third party application under the condition of screen extinguishing, and the screen projection effect is improved.
It is understood that the first and second modes of projection may be other modes of projection without departing from the teachings of the present application, and the present application is not limited in this respect.
In some embodiments of the present application, the screen projection terminal transmits the screen projection data to the display terminal through the screen projection application. In other words, the screen projection data of the third party application and the screen projection data of the application module are transmitted to the display end through the screen projection application.
It should be understood that the transmission of the projected data can be adjusted as desired without departing from the teachings of the present application, and the present application is not limited thereto.
The following describes a response method of a screen projection end provided by an embodiment of the present application when the screen projection end adopts a first screen projection mode.
Fig. 6 is a flowchart illustrating a response method 200 of a screen-casting terminal according to an embodiment of the present application, and referring to fig. 6, the response method 200 of the screen-casting terminal may include the following steps:
and S21, drawing a screen interface of the virtual screen created by the screen projection application according to the interface information of the application module.
And S22, determining screen projection data according to the screen interface of the virtual screen.
And S23, transmitting the screen projection data to the display end so as to display the screen projection data through at least one display screen of the display end.
According to the embodiment of the application, the application to be screen-projected is arranged in the screen-projecting application in the form of the application module, so that the screen-projecting application has the authority for acquiring the related data of the application module, the authority does not need to be requested to the application to be screen-projected, and the probability of screen-projection failure caused by the fact that the data acquisition authority of the application to be screen-projected does not have the authority is reduced. In addition, the screen projection end projects the virtual screen drawn based on the interface information of the application module to the display end, and the display end can display the response result of the application modules to the user operation, so that the display end can provide the service of the application modules for the user under the condition that the application modules are not installed, the requirements on the processing capacity of the display end and the like are reduced, and the hardware cost of the display end is reduced.
The following provides an exemplary description of the steps of the response method 200 of the screen-projection end according to the embodiment of the present application.
Step S21
In some embodiments of the present application, the manner of creating the virtual screen by the screen-casting application at the screen-casting end may include: acquiring size information of a display screen of a display end; and according to the size information of the display screen of the display end, a virtual screen is created by calling a virtual screen creation interface of the screen projection end. The size of the created virtual screen is matched with the size of the display screen of the display end, namely the size of the virtual screen is equal to or slightly smaller than the size of the display screen of the display end. After the virtual screen is created, the screen-casting application may draw the virtual screen in the following manner: and displaying and coding the application module according to the interface information of the application module.
In some embodiments of the present application, the manner of drawing the screen interface of the virtual screen by the screen projection end includes: the screen projection end determines a virtual screen corresponding to the application module; and drawing a screen interface of the virtual screen corresponding to the application module according to the interface information of the application module. Since the screen projection end may be created with a plurality of virtual screens, before an operation interface of the application module is drawn, the virtual screen corresponding to the application module needs to be determined.
In some embodiments of the present application, the manner of determining the virtual screen corresponding to the application module includes, but is not limited to, manner one and manner two.
In one mode
In some embodiments of the present application, the screen projecting end may use a pre-designated virtual screen as a virtual screen corresponding to the application module. Because the corresponding relation between the virtual screen and the display screen of the display end is fixed, the operation interface of the application module is displayed on the pre-designated display screen of the display end. The operation interface of the application module is displayed through the preassigned display screen of the display end, so that a user can conveniently acquire the information of each application module from the same display screen of the display end and switch the information to other display screens according to needs.
Mode two
In some embodiments of the present application, the mode of determining the virtual screen corresponding to the application module by the screen projection end may include: determining candidate virtual screens of the application module; and in response to the candidate virtual screen is drawn with interface information of other application modules except the application module, and the other application modules and the application module meet the first constraint relation, creating a new virtual screen as a virtual screen corresponding to the application module.
For ease of understanding, the manner in which candidate virtual screens are determined is exemplified below.
In some embodiments of the present application, the manner of determining the candidate virtual screen includes, but is not limited to, manner 1, manner 2, and manner 3.
Mode 1
In some embodiments of the application, the screen projection end determines the candidate virtual screen of the application module according to the application type of the application module, the corresponding relationship between the application type and the display screen of the display end, and the corresponding relationship between the display screen of the display end and the virtual screen. For example, after the screen projection end determines an application module to be displayed, the application type of the application module is determined according to the corresponding relationship between the application module and the application type, then the display screen corresponding to the application type to which the application module belongs is determined according to the corresponding relationship between the application type and the display screen of the display end, and then whether a virtual screen is created for the determined display screen is judged according to the corresponding relationship between the display screen of the display end and the virtual screen. And if the determination result is yes, taking the virtual screen corresponding to the determined display screen as a candidate virtual screen, if the determination result is not yes, creating a new virtual screen, taking the new virtual screen as the candidate virtual screen, and updating the corresponding relation between the display screen of the display end and the virtual screen.
It is worth mentioning that the display screen for displaying the operation interface of the application module is determined according to the application type of the application module, and the operation interface of the application module can be displayed on the display screen more suitable for displaying the display end of the application module by combining the characteristics of each application type, so that the viewing experience of a user is improved.
As an example, the correspondence between the application module and the application type, the correspondence between the application type and the display screen of the display terminal, and the correspondence between the display screen of the display terminal and the virtual screen may be stored in a tabular form at the screen projection terminal.
It should be understood that the correspondence relationship may be stored in other forms at the screen projection end without departing from the teachings of the present application, and the storage form of the correspondence relationship is not limited by the present application.
It should be understood that the same application type may correspond to a plurality of display screens of the display end, and the display screen of the same display end may correspond to a plurality of virtual screens, which is not limited in this application.
It should be understood that when a plurality of virtual screens are determined, the plurality of determined virtual screens may be regarded as candidate virtual screens.
Mode 2
In some embodiments of the application, the screen projection end determines a candidate virtual screen of the application module according to the identification information of the application module, the corresponding relationship between the application module and the display screen of the display end, and the corresponding relationship between the display screen of the display end and the virtual screen. For example, after the screen projection end determines the application module to be displayed, the display screen of the display end corresponding to the application module is determined according to the corresponding relationship between the application module and the display screen of the display end. And the screen projection end judges whether the virtual screen corresponding to the determined display screen exists or not according to the corresponding relation between the display screen of the display end and the virtual screen, if so, the virtual screen corresponding to the determined display screen is used as a candidate virtual screen, if not, a new virtual screen is created, the new virtual screen is used as the candidate virtual screen, and the corresponding relation between the display screen of the display end and the virtual screen is updated.
It is worth mentioning that the operation interface of each application module is displayed on a display screen more suitable for displaying the display end of the application module by combining the characteristics of the application module, so that the viewing experience of a user is improved.
And the screen projection end takes the pre-designated virtual screen as a candidate virtual screen for determining the application module. For example, the screen projection end can use the virtual screen corresponding to the central control display screen as a candidate virtual screen, so that each application module is displayed on the central control display screen after being started, and a driver can conveniently acquire information of each application module and switch the information to other display screens according to needs.
It should be understood that candidate display screens for an application module may be determined in other ways without departing from the teachings of the present application, which is not limited by the present application.
The manner of determining the virtual screen of the application module candidate is exemplified above, and the manner of determining the virtual screen of the application module based on the virtual screen of the application module candidate is exemplified below.
In some embodiments of the application, in response to that the candidate virtual screen has drawn interface information of other application modules except the application module, and the other application modules and the application module satisfy the first constraint relationship, a new virtual screen is created as a virtual screen corresponding to the application module, and a display screen of a display end corresponding to the new virtual screen is the same as a display screen of a display end corresponding to the candidate virtual screen. For example, after determining the candidate virtual screens of the application modules, the screen projection terminal determines whether there is an idle virtual screen in the candidate virtual screens, that is, whether there is at least one candidate virtual screen on which interface information of any application module is not drawn. If the screen projection end determines that idle virtual screens exist, one idle virtual screen can be selected as the virtual screen of the application module at will. If the screen projection end determines that no idle virtual screen exists, namely all candidate virtual screens are drawn with interface information of other application modules, a candidate set is obtained based on the candidate virtual screens, and whether an application module and an application module corresponding to the virtual screen meet a first constraint relation or not is judged aiming at each virtual screen in the candidate set; if the screen interface meets the requirements, the virtual screen is removed from the candidate set, and the display screen of the display end continues to display the screen interface of the virtual screen; if the virtual screen is determined not to be satisfied, the virtual screen is reserved. After the operation is performed on all the virtual screens in the candidate set, the screen projection end judges whether the remaining virtual screens exist in the candidate set, if yes, one virtual screen can be selected from the remaining virtual screens in the candidate set as the virtual screen corresponding to the application module, or the virtual screen corresponding to the application module with the lowest priority can be selected as the virtual screen of the application module according to the priority of the application module corresponding to the remaining virtual screens, and the screen interface of the selected virtual screen is not displayed on the display screen of the display end any more. And if the screen projection end determines that the candidate set is an empty set, a new virtual screen is created to serve as the virtual screen corresponding to the application module. By the mode, the number of the virtual screens displayed at the same time can be controlled on the basis that the display screen of one display end simultaneously displays a plurality of virtual screens, and the influence on the watching of a user due to the fact that the number of the virtual screens displayed at the same time is too large is avoided.
It should be noted that the first constraint relationship may be set as needed. The first constraint relationship is exemplarily described below.
As one example, the first constraint relationship includes: the other application modules and the application module are of the same application type. In other words, when the application module is the same as the application type of the other application modules corresponding to the candidate virtual screen, a new virtual screen is created for the application module. For example, when the user opens the application module 3 of the chat type when the operation interface of the application module 1 of the chat type is displayed on the display screen of the display end, a new virtual screen is created for the application module 3, and the contents of the two virtual screens are displayed on the same display screen of the display end in a split screen manner.
It should be understood that, without departing from the teachings of the present application, and in the case that the application types of the other application modules are different from the application types of the application modules, the screen projection end may directly determine that the two modules do not satisfy the first constraint relationship, and may also set other conditions for further determination, which is not limited in the present application.
As another example, the first constraint relationship includes: the other application modules or application modules belong to a pre-specified application type. The pre-specified application type may include a navigation type and/or a call type. In other words, if one of the other application modules and the application module belongs to the navigation module or the call type, the screen projection end determines that the other application modules and the application module satisfy the first constraint relationship.
As another example, the first constraint relationship includes a plurality of constraints, and when any one of the constraints is satisfied, the screen projection end determines that the other application modules and the application module satisfy the first constraint relationship. For example, the first constraint relationship includes constraint 1 and constraint 2, where constraint 1 is that the application types of other application modules and application modules are the same, and constraint 2 is that other application modules or application modules belong to a pre-specified application type. If the application types of the other application modules and the application modules meet the following conditions, the screen projection end judges that the other application modules and the application modules meet a first constraint relation:
case 1: the application types of other application modules are the same as the application types of the application modules;
case 2: the other application modules and the application module are of different application types but one of the other application modules and the application module belongs to a pre-specified application type.
It should be understood that the first constraint relationship may be set as desired without departing from the teachings of the present application, which is not limited in this application.
It should be understood that the virtual screen corresponding to the application module may be determined in other ways without departing from the teachings of the present application. For example, the screen projection end provides the above three modes, i.e., mode 1, mode 2, and mode 3, for the user, and the user can select the mode of determining the virtual screen corresponding to the application module as needed. The method for determining the virtual screen corresponding to the application module is not limited in the application.
Step S22
In some embodiments of the present application, the screen projection terminal determines the screen projection data according to the number of screen interfaces of the virtual screen that can be presented on the display screen. For example, if the display screen of the display end can present a screen interface of a virtual screen, the screen projection end can use the entire screen interface of the virtual screen as screen projection data. If the display screen of the display end can present screen interfaces of a plurality of virtual screens, the screen projection end determines the screen projection data mode to include: determining a display screen of a display end corresponding to the virtual screen, and acquiring the number of screens of the virtual screen corresponding to the determined display screen of the display end; if the number of the screens is equal to 1, the screen projection end can take the whole screen interface of the virtual screen as screen data. If the number of the screens is larger than 1, the screen projection end determines the size information of the interface to be projected, which is extracted from the screen interface of the virtual screen, according to the obtained number of the screens and a predefined cutting rule, extracts the interface to be projected from the screen interface of the virtual screen according to the determined size information, and then determines screen projection data according to the interface to be projected. Wherein the predefined clipping rule may indicate: and the corresponding relation between the number of the screens and the size of the interface to be projected of each virtual screen.
It should be understood that the cutting rules may be set as desired without departing from the teachings of the present application. As one example, in the case of multiple virtual screen split displays, the clipping rule may indicate: the vertical size of the interface to be projected of the virtual screen is equal to or slightly smaller than the vertical size of the display screen of the display end, and the horizontal size of the interface to be projected of the virtual screen is equal to or slightly smaller than the quotient of the horizontal size of the display screen of the display end divided by the number of the screens, so that the plurality of virtual screens are transversely split and displayed on the display screen of the display end. The cropping rules may also indicate: the horizontal size of the interface to be projected of the virtual screen is equal to or slightly smaller than the horizontal size of the display screen at the display end, and the vertical size of the interface to be projected of the virtual screen is equal to or slightly smaller than the quotient of the vertical size of the display screen at the display end divided by the number of the screens, so that the virtual screens are displayed on the display screen at the display end in a vertically split screen mode. The cropping rules may also indicate: if the number of the screens can be divided by N, determining the longitudinal size of the interface to be projected of the virtual screen according to the longitudinal size of the display screen of the display end and the quotient of the number of the screens and N, and determining the transverse size of the interface to be projected of the virtual screen according to the transverse size of the display screen of the display end and N; if the number of the screens cannot be divided by N, calculating a value of [ number of screens/N ] +1, determining the longitudinal size of the interface to be projected of the virtual screen according to the longitudinal size of the display screen of the display end and the calculated value, and determining the transverse size of the interface to be projected of the virtual screen according to the transverse size of the display screen of the display end and N so as to display the plurality of virtual screens on the display screen of the display end in a split screen mode. Wherein N may be an integer greater than or equal to 2. As another example, where one of the virtual screens is displayed full screen and the other virtual screens are displayed by picture-in-picture, the cropping rules may indicate: and determining the size information of the interface to be projected of the virtual screen according to the set size information of the display window of the picture-in-picture. The present application is not limited to cutting rules.
For convenience of understanding, a process of determining screen projection data is exemplarily described by taking an example that a screen projection end is created with a virtual screen 1, a virtual screen 2 and a virtual screen 3, the virtual screen 1 and the virtual screen 2 correspond to a central control display screen of a display end, the virtual screen 3 corresponds to a co-driver display screen of the display end, and a cropping rule indicates horizontal split screen display. For the virtual screen 1 and the virtual screen 2, after the screen projection end determines that the number of screens corresponding to the central control display screen of the display end is greater than 1, according to the cutting rule, determining that the size information of the interface to be projected extracted by the virtual screen 1 and the virtual screen 2 is as follows: the transverse size is equal to the transverse size/2 of the central control display screen, and the longitudinal size of the interface to be projected extracted by the virtual screen 1 and the virtual screen 2 is equal to the longitudinal size of the central control display screen; and the screen projection end extracts the screen to be projected which accords with the determined size information from the virtual screen 1 and the virtual screen 2 respectively, wherein the center of the extracted area can be the center of an interested area determined according to the interested area determination rule of the application module corresponding to the virtual screen 1 and the virtual screen 2. For the virtual screen 3, after the screen projection end determines that the number of the screens corresponding to the co-driver display screen of the display end is equal to 1, extracting the whole screen interface of the virtual screen 3 as a screen interface to be projected. And the screen projection end takes the interface to be projected extracted from the virtual screen 1, the virtual screen 2 and the virtual screen 3 as screen data in the screen projection data.
It should be understood that the region of interest determination rules of different application modules may be set according to the function of each application module without departing from the teachings of the present application, for example, if the function of an application module is a navigation function (i.e., a navigation module), the region of interest determination rules thereof may indicate: the region of interest in the map is a circular region which takes the current position of the user as the center and takes a preset distance value as the radius; if the function of the application module is a video playing function (i.e. a video module), the region-of-interest determination rule thereof may indicate: the interested region is a rectangular region with the geometric center of the video playing interface or the center of the region where any human face is located as the center and the preset size as the side length. The present application does not limit the region of interest determination rule.
It is worth mentioning that, under the condition that one display screen corresponds to a plurality of virtual screens, the screen interface to be projected is obtained in a cutting mode, but the display ratio of the display interface of the application module is not adjusted to obtain the screen interface to be projected, so that the obtained screen interface to be projected is clearer, the change of the picture ratio is smaller under the condition that one display screen corresponds to one virtual screen, the visual influence on a user is smaller, and the viewing experience of the user is improved.
It should be understood that the screen projection data may also be determined in other ways without departing from the teachings of the present application, which is not limited in this application.
Step S23
In some embodiments of the present application, the screen projection terminal may adjust the manner of determining the screen projection data and the manner of data transmission according to the number of display screens of the display terminal.
As an example, if the number of the display screens of the display terminal is 1, the manner of determining, by the screen projection terminal, the screen projection data according to the screen interface of the virtual screen may include: and determining screen data according to the screen interface of the virtual screen, and taking the screen data as screen projection data. If the number of the display screens of the display end is 2, the method for determining the screen projection data by the screen projection end according to the screen interface of the virtual screen may include: the screen projection end determines screen data according to the screen interface of the virtual screen, and the screen data and the corresponding relation between the virtual screen and the display screen of the display end are used as the screen projection data, so that the display end determines the display screen for displaying the screen interface of each virtual screen, and multi-path screen projection is achieved.
As another example, the display side and the screen projection side may establish a plurality of data links (i.e., interconnection channels) for transmitting screen projection data. And the screen projection end determines screen projection data according to the screen interface of the virtual screen, and determines the data link corresponding to each virtual screen according to the corresponding relation between the virtual screen and the display screen of the display end and the corresponding relation between the display screen of the display end and the data link. And the screen projection end transmits the screen projection data determined based on each virtual screen to the display end through the data link corresponding to the virtual screen. The display end displays the screen projection data received by each data link through the display screen corresponding to each data link, and multi-path screen projection is achieved.
In some embodiments of the application, the screen projection end can acquire and transmit the screen projection data to the display end after determining that the screen is to be projected, and can also set a prerequisite for the transmission of the screen projection data, and acquire and transmit the screen projection data to the display end again under the condition that the prerequisite is met.
Use and throw the screen end as mobile terminal, the display end is the vehicle, and the prerequisite includes: the mobile terminal enters the vehicle as an example. After entering the vehicle, the mobile terminal acquires and transmits the screen projection data to the vehicle, so that the problems of network resource waste and the like caused by the fact that the mobile terminal transmits the screen projection data under the condition that a user cannot watch the screen projection data are solved.
It should be understood that other prerequisites can also be set without departing from the teachings of the present application, which are not limited by the present application.
The above describes an example of a response mode of the screen-projecting end in a case where the user operation information indicates screen projection of the application, and the following describes an example of a response process of the screen-projecting end in a case where the user operation information indicates screen switching.
In some embodiments of the application, the screen projection terminal performs screen switching in response to the user operation information, and changes a corresponding relationship between a screen interface which is indicated by the user operation information and needs to be switched and a display screen of the display terminal, so as to update the screen projection data. The screen projection end changes the corresponding relation between the screen interface and the display screen of the display end on the basis of the user operation information, so that the screen changing operation under the condition of multiple screens of the display end is realized, a user can select the screen for displaying the operation interface of each application module or the operation interface of the third-party application as required, and the user experience is improved.
In some embodiments of the present application, the screen interfaces to be switched include a screen interface of a display screen of the screen projection end and a screen interface of a virtual screen. And the screen projection end responds to the user operation information indication to switch screens, and changes the corresponding relation (first corresponding relation for short) between the screen interface of the display screen of the screen projection end and the screen interface of the virtual screen and the display screen of the display end. The manner of changing the first corresponding relationship may be: and the screen projection end carries the identification information of the display screen of the display end in the screen projection data corresponding to the virtual screen and carries the identification information of the display screen of the display end in the screen projection data corresponding to the display screen of the screen projection end according to the changed first corresponding relation.
In some embodiments of the application, the screen interfaces to be switched are all screen interfaces of a virtual screen, the screen projection end performs screen switching in response to the user operation information indication, and the corresponding relation between the screen interface to be switched indicated by the user operation information and the display screen of the display end is changed. The method for changing the corresponding relationship between the screen interface of the virtual screen and the display screen of the display end includes, but is not limited to, a first method and a second method.
In one mode
In some embodiments of the present application, the application module in the screen projection application may include a virtual screen management module. The virtual screen management module is used for creating a virtual screen, managing a corresponding relationship (hereinafter referred to as a second corresponding relationship) between other currently running application modules and the virtual screen, managing a corresponding relationship (hereinafter referred to as a third corresponding relationship) between the virtual screen and a display screen of the display end, drawing an operation interface of each application module to the corresponding virtual screen, and the like. And changing the corresponding relation between the application module needing to switch the screen and the display screen of the display end through the virtual screen management module.
As an example, the process of the virtual screen management module changing the corresponding relationship between the screen interface to be switched and the display screen of the display end may include: and adjusting the second corresponding relation according to the user operation information so as to change the corresponding relation between the screen interface needing to be switched and the display screen of the display end. Since the second corresponding relationship is adjusted, the screen interface of each virtual screen will change, and the corresponding relationship between the screen interface and the display screen of the display end will also be adjusted.
As another example, the process of the virtual screen management module changing the corresponding relationship between the screen interface to be switched and the display screen of the display end may include: and adjusting the third corresponding relation according to the user operation information so as to change the corresponding relation between the screen interface needing to be switched and the display screen of the display end. Since the third corresponding relationship is adjusted, the identification information of the display screen of the display terminal carried in the screen projection data determined based on the virtual screen is adjusted, and the corresponding relationship between the screen interface and the display screen of the display terminal is also adjusted.
For ease of understanding, the second correspondence is indicated: the application module 1 corresponds to the virtual screen 3, the application module 2 corresponds to the virtual screen 4, and the third correspondence indicates: the example that the virtual screen 1 corresponds to a central control display screen, the virtual screen 2 corresponds to a copilot display screen, the virtual screen 3 corresponds to a main driving rear pillow screen, and the virtual screen 4 corresponds to a copilot rear pillow screen is exemplified. Before switching, the main driving rear pillow screen of the display end displays the operation interface of the application module 1, and the auxiliary driving rear pillow screen of the display end displays the operation interface of the application module 2. The user performs screen-cutting operations such as clicking a screen-cutting button, sliding two fingers to the right on the pillow screen after the main driving, and the like on the display end. After the display end detects the user operation information, the user operation information is transmitted to the screen projection end, the screen projection end transmits the user operation information to the screen projection application, and the screen projection application determines that the user operation information indicates that the main driving rear pillow screen and the auxiliary driving rear pillow screen are switched and then transmits the user operation information to the virtual screen management module. The virtual screen management module adjusts the first corresponding relationship, and in the adjusted first corresponding relationship, the application module 1 corresponds to the virtual screen 4, and the application module 2 corresponds to the virtual screen 3. Or the virtual screen management module adjusts the second corresponding relationship, and in the adjusted second corresponding relationship, the virtual screen 3 corresponds to the copilot rear headrest screen, and the virtual screen 4 corresponds to the main driving rear headrest screen. Through the operation, the screen switching of the main driving rear pillow screen and the auxiliary driving rear pillow screen can be realized. Similarly, the switching between other screens can also refer to the relevant description of the application.
Mode two
In some embodiments of the application, the screen projecting end draws a virtual screen through each application module, and adjusts the corresponding relationship between the screen interface to be switched and the display screen of the display end through the application module corresponding to the screen interface to be switched. Exemplarily, the screen interface to be switched is a screen interface of a first virtual screen, the first virtual screen corresponds to the first application module, and the first application module determines identification information of the virtual screen corresponding to the switched display screen; and updating the identification information of the virtual screen for drawing the operation interface of the application module into the determined identification information of the virtual screen.
For example, virtual screen 3 corresponds to the main driving rear bolster screen, virtual screen 4 corresponds to the copilot rear bolster screen, application module 1 corresponds to virtual screen 3, and application module 2 corresponds to virtual screen 4. Before switching, the main driving rear pillow screen of the display end displays the operation interface of the application module 1, and the auxiliary driving rear pillow screen of the display end displays the operation interface of the application module 2. After the screen projection application calculates user operation information according to the user operation information and indicates to switch the screen interface of the virtual screen 3 and the screen interface of the virtual screen 4, the identification information of the virtual screen 4 can be transmitted to the application module 1, and the identification information of the virtual screen 3 is transmitted to the application module 2. The application module 1 draws the own operation interface to the virtual screen 4, and the application module 2 draws the own operation interface to the virtual screen 3. By the operation, the screen switching of the main driving rear pillow screen and the copilot rear pillow screen can be realized. Similarly, the switching between other screens can also refer to the relevant description of the application.
It should be understood that the screen switching may be accomplished in other ways without departing from the teachings of the present application, and the present application is not limited in this regard.
After the exemplary description of the response method of the screen projection side is completed, the response method of the display side is exemplarily described below.
Fig. 7 is a flowchart illustrating a response method 300 of a display terminal according to an embodiment of the present application, and referring to fig. 7, the response method 300 of the display terminal may include the following steps:
and S31, receiving screen projection data transmitted by a screen projection end interconnected with the display end, wherein the screen projection data is determined according to a screen interface of a virtual screen created by screen projection application of the screen projection end. And drawing the screen interface of the virtual screen according to the interface information of the application module in the screen projection application.
And S32, displaying the screen projection data through at least one display screen of the display end.
According to the embodiment of the application, the application to be screen-projected is arranged in the screen-projecting application in the form of the application module, so that the screen-projecting application has the authority for acquiring the related data of the application module, the authority does not need to be requested to the application to be screen-projected, and the probability of screen-projection failure caused by the fact that the data acquisition authority of the application to be screen-projected does not have the authority is reduced. In addition, the screen projection end projects the virtual screen drawn based on the interface information of the application module to the display end, and the display end can display the response result of the application modules to the user operation, so that the display end can provide the service of the application modules for the user under the condition that the application modules are not installed, the requirements on the processing capacity of the display end and the like are reduced, and the hardware cost of the display end is reduced.
The following provides an exemplary explanation of the steps of the response method 300 of the display terminal according to the embodiment of the present application.
Step S31
In some embodiments of the present application, the screen-casting request may be initiated by the display terminal before the screen-casting terminal and the display terminal start the screen casting. In an example, the display terminal sends a screen projection request to the screen projection terminal after detecting that the screen projection terminal is close to the display terminal. After receiving the screen projecting request, the screen projecting end can trigger a screen projecting instruction, and can also determine whether to trigger the screen projecting instruction according to whether the self state information accords with the screen projecting request. And after the screen projection end triggers a screen projection instruction, screen projection data are transmitted to the display end. The process of determining whether to trigger the screen-projecting instruction by the screen-projecting end may refer to the related description of the response method 200 of the screen-projecting end, and is not described herein again.
In some embodiments of the application, after the screen projecting end triggers the screen projecting instruction, an interconnection channel (i.e., the above-mentioned data link for transmitting the screen projecting data) is established with the display end, and the screen projecting data is transmitted to the display end through the interconnection channel.
As one example, the screen projecting end includes a first screen projecting end and a second screen projecting end. The display end responds to the received interconnection request of the first screen projection end, an interconnection channel is established between the display end and the second screen projection end, and whether the first screen projection end and the display end are allowed to establish the interconnection channel for transmitting screen projection data of the first screen projection end is determined according to a preset multi-end interconnection rule. In other words, after the display terminal establishes an interconnection channel with the second screen projection terminal, if an interconnection request of the first screen projection terminal is received, whether the first screen projection terminal is allowed to access is judged according to a multi-terminal interconnection rule of the display terminal. If the judgment result indicates that the first screen projection end is allowed to be accessed, an interconnection channel can be directly established with the first screen projection end, and the interconnection channel can also be established with the first screen projection end after the permission information of the first screen projection end is determined to be qualified. And if the judgment result indicates that the first screen projection end is not allowed to be accessed, the interconnection channel is not established with the first screen projection end. Under the condition of being in accordance with the multi-terminal interconnection rule, the display terminal allows a plurality of screen projection terminals to be accessed, and the utilization rate of the display terminal is improved.
It should be appreciated that the request for interconnection may be the connection request (first connection request or second connection request) mentioned above without departing from the teachings of the present application. For example, after receiving the connection request, the display terminal determines whether to allow the display terminal and the screen projection terminal to establish an interconnection channel according to a multi-terminal interconnection rule, and if the determination result is that the interconnection channel is allowed, the interconnection channel is established through the first interconnection network or the second interconnection network. The interconnection request can also be a request different from the above-mentioned connection request, and after receiving the interconnection request, the display terminal judges whether to establish an interconnection channel with the screen projection terminal according to the multi-terminal interconnection rule. This is not limited by the present application.
For ease of understanding, the multi-terminal interconnection rule is exemplified below.
As an example, a multi-terminal interconnect rule indicates: and allowing the first screen projection end to access in response to the fact that the priority of the first screen projection end is higher than that of the second screen projection end. In other words, the display side determines whether to allow access to a new screen projection side based on the priority of each screen projection side.
It should be understood that, without departing from the teachings of the present application, if the priority of the first screen projection end is lower than or equal to the priority of the second screen projection end, the display end may send the authentication information to the second screen projection end, and determine whether to allow the first screen projection end to access according to the feedback data of the second screen projection end, and the display end may also directly refuse the first screen projection end to access. This is not limited by the present application.
It should be noted that after the priority is set for each screen projection end, the display end can judge whether to allow a new screen projection end to access or not based on the priority of the screen projection end after an interconnection channel is created with one screen projection end, so that the screen projection process is more intelligent.
As another example, the multi-terminal interconnect rule indicates that: and sending authentication information to the second screen projection end, and determining whether the first screen projection end is allowed to access or not according to feedback data of the second screen projection end based on the authentication information. In other words, the display terminal follows the principle that the screen projection terminal which is accessed first has the use decision right of the display terminal, and after receiving the interconnection request of the new screen projection terminal, the accessed screen projection terminal is consulted whether the new screen projection terminal is allowed to be accessed.
It should be understood that, without departing from the teachings of the present application, the display terminal may selectively disconnect from the second screen projecting terminal after determining that the first screen projecting terminal is allowed to access, and may also continue to maintain the connection with the second screen projecting terminal, which is not limited herein.
In some embodiments of the present application, after the display end and the screen projection end establish the interconnection channel, the screen projection data is received by the screen projected application of the display end. For example, the screen projection application at the screen projection end and the screen projected application at the display end can mutually transmit data. It should be understood that data transmission can be directly performed between the screen projecting application at the screen projecting end and the screen projected application at the display end, and data transmission can also be performed through other devices, for example, the screen projecting application at the screen projecting end transmits screen projecting data to the cloud end device of the screen projecting service, and the cloud end device transmits the screen projecting data to the screen projected application at the display end. This is not limited by the present application.
Step S32
In some embodiments of the present application, after the screen projection end accesses the display end, the display end selects a display screen for displaying the screen projection data for the screen projection end, and displays the screen projection data of the screen projection end through the selected display screen.
The following describes an exemplary manner in which the display terminal selects the display screen corresponding to the screen projection terminal.
In a first mode
In some embodiments of the present application, the display side allows access by one of the screen projection sides. The method for the display terminal to select the display screen for displaying the screen projection data of the screen projection terminal may include: the display terminal takes the appointed display screen as the display screen corresponding to the screen projection terminal, or the display terminal takes the display screen closest to the screen projection terminal as the display screen corresponding to the screen projection terminal; and displaying the screen projection data of the screen projection end through a display screen corresponding to the screen projection end.
It should be understood that, without departing from the teachings of the present application, the display end may set an assigned display screen, all the screen-projecting ends correspond to the assigned display screen, the display end may also set the assigned display screens respectively for different screen-projecting ends, and after the screen-projecting ends are accessed, the assigned display screens corresponding to the screen-projecting ends are determined based on the identification information of the screen-projecting ends. This is not limited by the present application.
Mode two
In some embodiments of the present application, the display side allows access to multiple screen projection sides. The method for the display terminal to select the display screen for displaying the screen projection data of the screen projection terminal may include: and the display end determines candidate display screens corresponding to the screen projection end, and selects a display screen for displaying screen projection data from the candidate display screens according to the occupation condition of the candidate display screens.
As an example, the candidate display screen corresponding to the screen projecting end may be a designated display screen, or may be a display screen determined according to the position information of the screen projecting end, for example, the display screen of the display end closest to each screen projecting end may be used as the candidate display screen corresponding to the screen projecting end according to the principle of proximity.
For example, the screen projection end is a mobile terminal, the display end is a vehicle, and the position information of the screen projection end is a seating position of the mobile terminal. The seating position of the mobile terminal can be determined by the UWB module of the mobile terminal and the UWB module of the vehicle by utilizing the UWB positioning technology. The sitting position of the mobile terminal can also be identified by the human face of the image in the vehicle through the camera in the vehicle, and the sitting position of the mobile terminal corresponding to each user is determined according to the corresponding relation between the user and the mobile terminal. The sitting position of the mobile terminal can also be detected by a camera outside the vehicle in the process that the user enters the vehicle, the door opened by the user and the entering sequence of the user are detected, and the sitting position of the mobile terminal corresponding to the user is judged according to the door opened by the user, the entering sequence of the user and the corresponding relation between the user and the mobile terminal.
It should be understood that the display side may also determine the candidate display screens of the screen projection side based on other rules without departing from the teachings of the present application, and the present application does not limit the manner of determining the candidate display screens.
After the exemplary description of the manner of determining the candidate display screens is completed, the following exemplary description is given of a manner in which the display terminal selects a display screen for displaying screen projection data from the candidate display screens according to the occupation situation of the candidate display screens.
In some embodiments of the present application, the manner in which the display terminal selects the display screen corresponding to the screen projecting terminal from the candidate display screens may include: and the display end responds to the display screens with unoccupied candidates, and selects the display screen corresponding to the screen projection end from the unoccupied candidates.
For example, if the number of the unoccupied candidate display screens is 1, the display terminal takes the unoccupied display screens as the display screens corresponding to the screen projecting terminal, and if the number of the unoccupied candidate display screens is greater than 1, the display terminal may randomly select one unoccupied candidate display screen as the display screen corresponding to the screen projecting terminal, or select the candidate display screen with the highest priority from the unoccupied candidate display screens. The priority of each candidate display screen can be determined according to the distance between the candidate display screen and the screen projection end, and can also be set by the user, which is not limited by the application.
In some embodiments of the present application, the selecting, by the display terminal, the display screen corresponding to the screen projection terminal from the candidate display screens may include: the display end responds to the situation that the candidate display screens are occupied, and feeds back an occupation request which indicates that the candidate display screens are occupied; and in response to detecting the occupation permission instruction, taking the candidate display screen as the selected display screen. In other words, if the candidate display screen of the screen projection end is occupied, the screen projection end is allowed to use the candidate display screen after the occupation permission is obtained.
As an example, the manner of the display side feeding back the occupation request may be: the display end displays relevant information of the occupation request through the candidate display screen, for example, login user information of the screen projection end, summary information of screen projection data and the like, and determines whether the user triggers an occupation permission instruction or not according to user operation information detected by the candidate display screen. The method for the display end to feed back the occupation request may also be as follows: and the display end sends the occupation request to the occupation end of the candidate display screen. The occupation end displays relevant information of the occupation request, and determines whether to send an occupation permission instruction to the display end according to the detected user operation information.
It should be understood that the display terminal may also feed back the occupation request in other ways without departing from the teachings of the present application, and the present application is not limited thereto.
As an example, if the number of the candidate display screens is equal to 1, the display end feeds back an occupation request for the candidate display screens. If the number of the candidate display screens is greater than 1, the display end can feed back an occupation request for each candidate display screen, if an occupation permission instruction of one candidate display screen is received, the candidate display screen is used as the selected display screen, and if occupation permission instructions of a plurality of candidate display screens are received, the display screen corresponding to the screen projection end can be projected according to the priority of the candidate display screens, or the display screen corresponding to the screen projection end can be randomly selected.
It should be understood that, without departing from the teachings of the present application, if the number of the candidate display screens is greater than 1, the display terminal may also feed back the occupation request in other manners, for example, the occupation requests may be fed back in sequence according to the priority of each candidate display screen, if an occupation permission instruction is detected, the current candidate display screen is taken as the selected display screen, and if an occupation rejection instruction is detected, the occupation request is fed back according to the next candidate display screen.
It should be understood that, without departing from the teachings of the present application, if the occupancy request feedback for the candidate display screen feedback is an occupancy rejection instruction, the display terminal may feed back screen projection failure information and the like to the screen projection terminal, and may also take other measures, which are not limited in this application.
In some embodiments of the present application, the manner in which the display terminal selects the display screen corresponding to the screen projecting terminal from the candidate display screens may include: and the display end responds to the situation that the candidate display screens are all occupied, the priority of the screen projection end is higher than that of the occupation end of the candidate display screens, and the candidate display screens are used as the selected display screens. In other words, if the candidate display screen is occupied, but the priority of the screen projection end is higher than that of the occupation end, the screen projection end can occupy the candidate display screen.
It should be understood that, as those skilled in the art can understand, the above-mentioned manner of determining the display screen corresponding to the screen projection end may be performed in any step after determining that the screen projection end is close to the display end and before displaying the screen projection data, and the implementation sequence of each step may be set as required. For example, the screen projection end determines screen projection data through a virtual screen created by the screen projection application, the display end can determine the display screen corresponding to the screen projection end through the above example after determining the screen projection triggering instruction, and sends the size information of the display screen corresponding to the screen projection end, and the screen projection application of the screen projection end creates the virtual screen according to the size information of the display screen corresponding to the screen projection end. For another example, the screen projection end acquires screen projection data through other modes such as screen recording, the display end can determine the display screen corresponding to the screen projection end through the steps after receiving the screen projection data, and the received screen projection data is displayed through the display screen corresponding to the screen projection end. The application does not limit the time for executing the screen-projecting command for triggering the screen-projecting end of the display screen corresponding to the determined screen-projecting end.
The manner in which the display screen of the display terminal is scheduled for different screen projection terminals is exemplified above. The following illustrates an example of a manner of scheduling a display screen of a display terminal for different screen projection data.
In some embodiments of the present application, the manner that the display end displays the screen projection data through the at least one display screen may include: and in response to the fact that the display screens of the display end, which correspond to the plurality of screen projection data obtained based on different virtual screens, are all first display screens, controlling the first display screens to display at least one screen projection data in the plurality of screen projection data according to a preset scheduling strategy.
For ease of understanding, the scheduling policy is exemplified below.
Embodiment 1 of scheduling policy
In some embodiments of the present application, the display end supports split-screen display, and the scheduling policy indicates: and displaying the screen projection data of a plurality of different virtual screens corresponding to the first display screen on the first display screen in a split screen display mode.
As an example, the virtual screen 1 of the screen projection end and the virtual screen 2 of the screen projection end both correspond to the first display screen of the display end, and the screen projection data 1 obtained based on the virtual screen 1 of the screen projection end and the screen projection data 2 obtained based on the virtual screen 2 of the screen projection end both indicate that the first display screen of the display end is used for displaying. In the embodiment 1 based on the scheduling policy, the display end displays the screen projection data 1 and the screen projection data 2 in a split manner through the first display screen.
In some embodiments of the present application, the scheduling policy further indicates: and determining the display positions of the plurality of screen projection data on the first display screen according to a preset division rule. For example, if the first display screen of the display end corresponds to a plurality of screen projection data, the display end may first divide the first display screen of the display end into a plurality of display areas according to the number of screen projection data corresponding to the first display screen, and number the display areas on the display screen according to a rule from top to bottom and from left to right (for example, the number is 1, 2; \ 8230;, \ 823030). And the display terminal determines a display area for displaying each screen projection data according to a preset division rule.
For ease of understanding, the partitioning rule is exemplarily described below.
As an example, the partitioning rule indicates: and determining the display positions of the plurality of screen projection data on the first display screen according to the priorities of the application modules corresponding to the plurality of screen projection data. In an example, the display terminal allocates a display area with a smaller number to the screen projection data corresponding to the application module with a higher priority according to the priority of the application module corresponding to the plurality of screen projection data. And the display end displays each screen projection data through the display area distributed for each screen projection data. The display end can display the application module with higher use frequency or higher attention degree in the process of using the display end by the user in the display area which is more convenient for the user to watch, so that the user can more conveniently use the function of the application module.
As another example, the partitioning rule indicates: and determining the display positions of the plurality of screen projection data on the first display screen according to the application types of the application modules corresponding to the plurality of screen projection data. In an example, the display terminal allocates a display area with a smaller number to the screen projection data corresponding to the application type with a higher priority according to the priority of the application type to which the application module corresponding to the plurality of screen projection data belongs. If the screen projection data with the same application type exist, display areas can be randomly distributed for the screen projection data with the same application type, and the display areas can also be distributed for the screen projection data according to the priority of the corresponding application module. And the display end displays each screen projection data through the display area distributed for each screen projection data. The display end can display the application module which belongs to the application type with higher use frequency or higher attention in the process that the user uses the display end in the display area which is more convenient for the user to watch, so that the user can use the function of the application module more conveniently.
As yet another example, the partitioning rule indicates: and determining the display positions of the plurality of screen projection data on the first display screen according to the starting sequence of the application modules corresponding to the plurality of screen projection data. For example, the display terminal allocates a display area with a smaller number to the screen projection data corresponding to the application module with the previous starting sequence according to the starting sequence of the application modules corresponding to the plurality of screen projection data, or allocates a display area with a larger number to the screen projection data corresponding to the application module with the previous starting sequence. And the display end displays each screen projection data through the display area distributed for each screen projection data. The display end can display the latest started application module in a display area which is more convenient for a user to watch, so that the user can use the function of the application module more conveniently.
It should be understood that the partitioning rules may be adjusted as needed without departing from the teachings of the present application, which is not limited in this application.
Embodiment 2 of scheduling policy
In some embodiments of the present application, the scheduling policy indicates: displaying first screen projection data in the plurality of screen projection data on a first display screen; and displaying other screen projection data except the first screen projection data in the plurality of screen projection data in a picture-in-picture mode.
As one example, the first screen projection data may be screen projection data having the highest priority among the plurality of screen projection data. The priority of the plurality of screen projection data can be determined according to the starting sequence of the application modules corresponding to the plurality of screen projection data, or the priority of the plurality of screen projection data can be determined according to the starting sequence of the application modules corresponding to the plurality of screen projection data. This is not limited by the present application.
As an example, when other screen projection data is displayed in a pip mode, referring to the division rule similar to the above mentioned, pop up pip display windows for displaying other screen projection data in different display areas of the first display screen at the same time, or pop up pip display windows for displaying other screen projection data in the same display area (for example, a central area of the first display screen) at a certain time interval in sequence, which is not limited in this application.
Illustratively, the screen projection data 1 obtained based on the virtual screen 1 at the screen projection end, the screen projection data 2 obtained based on the virtual screen 2 at the screen projection end, and the screen projection data 3 obtained based on the virtual screen 3 at the screen projection end all indicate that the display is performed through the first display screen at the display end. The priority of the screen projection data 1 is highest, the display end displays the screen projection data 1 through a first display screen, and displays the screen projection data 1 and the screen projection data 2 through picture-in-picture.
Example 3 scheduling policy
In some embodiments of the present application, the scheduling information indicates: feeding back summary information of a plurality of screen projection data to a user; acquiring user selection information, and determining screen projection data selected by a user according to the user selection information; and displaying the screen projection data selected by the user on the first display screen.
As an example, the summary information of the screen shot data includes at least one of: an identifier of an application module corresponding to the screen projection data (e.g., a name or an icon of the application module); and obtaining at least one frame of image to be projected based on the projection data.
It should be understood that summary information of the projected data may also include other information without departing from the teachings of the present application, and the present application is not limited thereto.
Illustratively, the screen projection data 1 obtained based on the virtual screen 1 at the screen projection end, the screen projection data 2 obtained based on the virtual screen 2 at the screen projection end, and the screen projection data 3 obtained based on the virtual screen 3 at the screen projection end all indicate that the display is performed through the first display screen at the display end. The display side may display summary information of the screen projection data 1, summary information of the screen projection data 2, and summary information of the screen projection data 3 in the form of, for example, a list. If the user needs to watch the screen projection data 1, clicking an area for displaying the summary information of the screen projection data 1 through the first display screen, and displaying the screen projection data 1 on the first display screen after the display end detects that the area triggered by the user is the area for displaying the summary information of the screen projection data 1.
It should be understood that the scheduling policy may also be set based on other rules without departing from the teachings of the present application, which is not limited by the present application.
In some embodiments of the present application, the display terminal may display the screen projection data after receiving the screen projection data, or may display the screen projection data after receiving the screen projection data and satisfying the display condition.
For example, the screen projection end is a mobile terminal, and the display end is a vehicle. The vehicle passing distance detection module detects whether the mobile terminal is close to the vehicle at a first frequency. After the mobile terminal is detected to be close to the vehicle, the vehicle triggers a screen projection request, and whether the mobile terminal enters the vehicle is detected through the distance detection module at a second frequency, wherein the second frequency is greater than the first frequency. And after the vehicle detects that the mobile terminal enters the vehicle, displaying screen projection data transmitted by the mobile terminal. Before the mobile terminal approaches the vehicle, the vehicle detects the distance between the mobile terminal and the vehicle at a lower frequency to judge whether the mobile terminal approaches the vehicle, so that the power consumption of a distance detection module of the vehicle can be reduced. After the mobile terminal is determined to be close to the vehicle, the vehicle detects the distance between the mobile terminal and the vehicle at a higher frequency to judge whether the mobile terminal enters the vehicle or not, so that the vehicle can provide screen projection data for a user in a more timely manner.
In some embodiments of the application, the display terminal acquires and transmits user operation information to the screen projection terminal, so that the screen projection terminal responds to user operation, and a user can control the screen projection terminal through a display screen of the display terminal. The response mode of the screen projection end to the user operation information may refer to the related description in the response method 200 of the screen projection end, and is not described herein again.
For example, if all the display screens of the display terminal are touch screens, the manner for the display terminal to obtain the user operation information may include: acquiring detection data of a display area which is transmitted by at least one display screen of a display end and indicates user operation; and determining user operation information according to the identification information and the detection data of at least one display screen of the display terminal. In other words, the user operation information determined by the display end carries identification information of the display screen, so that the screen projection end determines the display screen actually operated by the user, and further determines the application module actually operated by the user according to the corresponding relationship between the display screen of the display end and the currently-running application module.
In some embodiments of the present application, the display screen of the display end includes at least a first display screen and a second display screen, and the screen projection data of the screen projection end is displayed through at least the first display screen. The display end responds to the information sharing request detected by the first display screen and feeds back the information sharing request, and the information sharing request indicates that screen projection data of the screen projection end are shared to the second display screen; and responding to the received sharing confirmation instruction, and displaying screen projection data of the screen projection end through the first display screen and the second display screen. In other words, when the display end displays the screen projection data of the screen projection end through the first display screen, if the user needs to share the screen projection data with other display screens (referred to as target display screens for short) of the display end, the information sharing request can be triggered by clicking the sharing button of the first display screen or by a command sliding gesture. The display end can feed back the information sharing request in a popup window mode through the target display screen, and if the target display screen detects a sharing confirmation instruction, the display end can display screen projection data of the screen projection end through the first display screen and the second display screen.
It is worth mentioning that the user can initiate information sharing through the display terminal, and can share the screen projection data to other users, so that the other users can watch the screen projection data without moving the position of the other users, and the user experience is improved.
In some embodiments of the present application, the display screen of the display end at least includes a first display screen and a second display screen, the screen projection data includes first screen projection data and second screen projection data, the first screen projection data is displayed through the first display screen, and the second screen projection data is displayed through the second display screen. The display end responds to a screen switching instruction for indicating the switching between the first display screen and the second display screen, and controls the second display screen to display first screen projection data and controls the first display screen to display second screen projection data.
As one example, different sources of screen shot data are transmitted over different transmission links. And the display end determines a display screen for displaying each screen projection data according to the stored corresponding relation between the display screen and the transmission link, and adjusts the corresponding relation between the display screen and the transmission link after detecting the switching instruction, so that the first display screen corresponds to a second transmission link for transmitting second screen projection data, and the second display screen corresponds to a first transmission link for transmitting the first screen projection data. When the display end performs screen projection based on the adjusted corresponding relation between the display screen and the transmission link, the second display screen can display the first screen projection data, and the first display screen can display the second screen projection data.
It should be understood that the screen cut effect may also be achieved in other ways without departing from the teachings of the present application, and the present application is not limited thereto.
For convenience of understanding, the screen projection end is taken as a mobile terminal, the display end is taken as a vehicle for example, and a screen projection process between the mobile terminal and the vehicle is exemplarily described in combination with user operation.
The mobile terminal and the vehicle can carry out data transmission through USB connection or wifi connection, and screen projection data of the mobile terminal are transmitted to the vehicle. After the screen-casting application is started, the central control display screen of the vehicle can firstly show the operation interface shown in fig. 4, so that the user can select the application needing to be triggered.
User operation 1: the user clicks an icon of the application module 1 (e.g. navigation module) on the central display. And the central control display screen detects the first operation information and sends the first operation information to the mobile terminal. The mobile terminal receives the first operation information, analyzes that the first operation information indicates to open the application module 1 based on the position of the area where the central control Display screen detects the touch signal, draws an operation interface of the application module 1 on a virtual screen 1 (visual Display) created based on the central control Display screen, and transmits screen projection data 1 determined according to the virtual screen 1 to a vehicle through an interconnection channel between the screen projection application and the screen projection application. The vehicle displays a screen interface of the virtual screen 1, namely an operation interface of the application module 1, in a first display area of the central control display screen according to the received screen projection data 1, and displays information of the application module in the screen projection application and information of a third party application in a second display area of the central control display screen.
User operation 2: the user performs a screen switching operation between the center control display screen and the copilot display screen (for example, performs a three-finger sliding operation on the center control display screen, clicks a switching button, and the like). After the central control display screen detects the second operation information, the response mode at least includes the following two types:
response mode one
The mobile terminal determines a coordinate point touched by a finger of a user and a moving distance of the finger of the user according to the position of the area of the touch signal in the user operation information detected by the central control display screen; if the touched coordinate point and the movement distance indicate that the user performs the screen switching operation, the corresponding relationship between the screen interface of the application module 1 and the display screen of the vehicle is changed through the screen switching mode, so that the screen projection data 1 is displayed through the co-driver display screen, that is, the co-driver display screen displays the operation interface of the application module 1, and the central control display screen continues to display the operation interface shown in fig. 4. For the specific switching manner, reference may be made to the related description above, and details are not repeated here.
Response mode two
When the vehicle detects that the user clicks the switching button, the switching instruction is triggered, and the screen switching operation is carried out through the response mode of the display end to the switching instruction.
User operation 3: the user clicks an icon of the application module 2 (e.g., video module) on the center control display screen. And the central control display screen detects the third operation information and sends the third operation information to the mobile terminal. The mobile terminal receives the third operation information, analyzes that the third operation information indicates to open the application module 2 based on the position of the area where the central control Display screen detects the touch signal, draws an operation interface of the application module 2 on a virtual screen 1 (visual Display) created based on the central control Display screen, and transmits screen projection data 2 determined according to the virtual screen 1 to the vehicle through an interconnection channel between the screen projection application and the screen projection application. The vehicle displays a screen interface of the virtual screen 2, namely an operation interface of the application module 2, in a first display area of the central control display screen according to the received screen projection data 2, and displays information of the application module in the screen projection application and information of the third party application in a second display area of the central control display screen. It should be understood that if other functions besides navigation and video are required, the functions can be realized by compiling the application module with the functions in the screen projection application.
The user operation 4: the user performs screen switching operation on the central control display screen and the copilot display screen, the vehicle and the mobile terminal perform switching between the central control display screen and the copilot display screen through similar response to the user operation 2, so that the first display area of the central control display screen displays the operation interface of the application module 1, the second display area of the central control display screen displays information of the application module in screen projection application and information of a third party application, and the copilot display screen displays the operation interface of the application module 2.
User operation 5: and clicking the third-party application 1 in a second display area of the central control display screen by the user, and appointing to display the third-party application 1 through the main driving rear pillow screen. And the central control display screen detects the third operation information and sends the third operation information to the mobile terminal. And the mobile terminal receives the third operation information, and analyzes that the third operation information indicates to open the third-party application 1 based on the position of the area where the touch signal is detected by the central control display screen. The screen projection end obtains screen projection data 3 of the third-party application 1 in a second screen projection mode, and sends the screen projection data 1, the screen projection data 2 and the screen projection data 3 to the vehicle, so that the vehicle can display the screen projection data 1 through the central control display screen, display the screen projection data 2 through the copilot display screen, and display the screen projection data 3 through the rear pillow screen of the main driver.
According to the above content, the multi-channel screen projection is realized on the basis of realizing the screen projection of the mobile terminal, and different screen projection data can be transmitted through different transmission links, so that the multi-screen interaction is realized.
The steps of the above methods are divided for clarity, and the implementation may be combined into one step or split some steps, and the steps are divided into multiple steps, so long as the same logical relationship is included, which are within the scope of the present patent; it is within the scope of the patent to add insignificant modifications to the algorithms or processes or to introduce insignificant design changes to the core design without changing the algorithms or processes.
An embodiment of the present application further provides an electronic device, including: at least one processor; the communication unit is in communication connection with at least one processor and is used for carrying out data transmission under the control of the processor; and a memory communicatively coupled to the at least one processor; the electronic device is a screen projection terminal, and the electronic device is a screen projection terminal; alternatively, the response method of the display side mentioned in the above embodiments can be performed, and the electronic device is the display side.
In some embodiments of the present application, the display end is a smart cockpit.
In some embodiments of the present application, the display end is a vehicle.
An embodiment of the present application also provides a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements a response method of a screen projection terminal or a response method of a display terminal.
Fig. 8 shows a schematic block diagram of an electronic device 400 that may be a screen-side or display-side of an embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.
As shown in fig. 8, the electronic device 400 includes a computing unit 401 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM) 402 or a computer program loaded from a storage unit 408 into a Random Access Memory (RAM) 403. In the RAM 403, various programs and data required for the operation of the electronic device 400 can also be stored. The computing unit 401, ROM 402, and RAM 403 are connected to each other via a bus 404. An input/output (I/O) interface 405 is also connected to bus 404.
A number of components in the electronic device 400 are connected to the I/O interface 405, including: an input unit 406, such as a touch screen, a microphone, or the like; an output unit 407 such as various types of displays, speakers, and the like; a storage unit 408, such as a magnetic disk, optical disk, or the like; and a communication unit 409 such as a network card, modem, wireless communication transceiver, etc. The communication unit 409 allows the electronic device 400 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for implementing the methods of the present application may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this application, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device for displaying information to a user, for example, a CRT (cathode ray tube) or LCD (liquid crystal display) monitor; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user may provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the Internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
The above description is only an embodiment of the present application and an illustration of the technical principles applied. It will be appreciated by a person skilled in the art that the scope of protection covered by the present application is not limited to the embodiments with a specific combination of the features described above, but also covers other embodiments with any combination of the features described above or their equivalents without departing from the technical idea. For example, the above features may be replaced with (but not limited to) features having similar functions disclosed in the present application.
Claims (23)
1. A response method of a screen projection end is characterized in that the screen projection end is provided with a screen projection application, and a plurality of application modules are arranged in the screen projection application; the method comprises the following steps:
drawing a screen interface of a virtual screen created by the screen projection application according to the interface information of the application module;
determining screen projection data according to the screen interface of the virtual screen; and
and transmitting the screen projection data to a display end so as to display the screen projection data through at least one display screen of the display end.
2. The method of claim 1, wherein drawing a screen interface of a virtual screen created by the screen-casting application according to the interface information of the application module comprises:
determining a virtual screen corresponding to the application module;
and drawing a screen interface of the virtual screen corresponding to the application module according to the interface information of the application module.
3. The method of claim 2, wherein determining the virtual screen corresponding to the application module comprises:
determining a virtual screen of the application module candidate; and
and in response to that the candidate virtual screen is drawn with interface information of other application modules except the application module, and the other application modules and the application module meet a first constraint relation, creating a new virtual screen as a virtual screen corresponding to the application module, wherein a display screen of the display end corresponding to the new virtual screen is the same as a display screen of the display end corresponding to the candidate virtual screen.
4. The method of claim 3, wherein determining the screen projection data from the screen interface of the virtual screen comprises:
determining a display screen of a display end corresponding to the virtual screen;
acquiring the number of the determined screens of the virtual screen corresponding to the display screen of the display end; and
in response to the fact that the number of the obtained screens of the virtual screen is larger than 1, determining size information of an interface to be projected, which is extracted from a screen interface of the virtual screen, according to the number of the screens and a predefined cutting rule; extracting the interface to be projected from the screen interface of the virtual screen according to the determined size information; and determining the screen projection data according to the interface to be projected.
5. The method of claim 3, wherein the first constraint relationship comprises one of:
the application types of the other application modules are the same as the application types of the application modules;
the other application module or the application module belongs to a pre-specified application type.
6. The method of claim 3, wherein determining candidate virtual screens for the application module comprises:
determining candidate virtual screens of the application module according to the application type of the application module, the corresponding relation between the application type and the display screen of the display end, and the corresponding relation between the display screen of the display end and the virtual screens; alternatively, the first and second electrodes may be,
determining candidate virtual screens of the application module according to the identification information of the application module, the corresponding relation between the application module and the display screen of the display end and the corresponding relation between the display screen of the display end and the virtual screens; alternatively, the first and second liquid crystal display panels may be,
and taking a pre-designated virtual screen as a candidate virtual screen for determining the application module.
7. The method of claim 2, wherein determining the virtual screen to which the application module corresponds comprises:
and taking a pre-designated virtual screen as a virtual screen corresponding to the application module.
8. The method of claim 1, wherein the method further comprises:
acquiring user operation information;
determining an application module triggered by a user according to the user operation information;
calling a server of the application module to respond to the user operation information through the determined communication interface of the application module; and
and receiving feedback data of the server, and determining interface information of the application module according to the feedback data of the server.
9. The method of claim 1, wherein the method further comprises:
acquiring user operation information; and
and responding to the user operation information indication to switch the screen, and changing the corresponding relation between the screen interface which is indicated by the user operation information and needs to be switched and the display screen of the display terminal.
10. A response method of a display terminal, comprising:
receiving screen projection data transmitted by a screen projection end interconnected with the display end, wherein the screen projection data are determined according to a screen interface of a virtual screen created by a screen projection application of the screen projection end, and the screen interface of the virtual screen is drawn according to interface information of an application module in the screen projection application; and
and displaying the screen projection data through at least one display screen of the display end.
11. The method of claim 10, wherein displaying the screen projection data comprises:
in response to the fact that the display screens of the display end, which correspond to the plurality of screen projection data obtained based on different virtual screens, are all first display screens, the first display screens are controlled to display at least one screen projection data in the plurality of screen projection data according to a preset scheduling strategy.
12. The method of claim 11, wherein the scheduling policy indicates:
and displaying the plurality of screen projection data on the first display screen in a split screen display mode.
13. The method of claim 12, wherein the scheduling policy further indicates:
and determining the display positions of the plurality of screen projection data on the first display screen according to a preset division rule.
14. The method of claim 13, wherein the partitioning rule indicates:
and determining the display positions of the plurality of screen projection data on the first display screen according to the priorities of the application modules corresponding to the plurality of screen projection data.
15. The method of claim 13, wherein the partitioning rule indicates:
and determining the display positions of the plurality of screen projection data on the first display screen according to the application types of the application modules corresponding to the plurality of screen projection data.
16. The method of claim 13, wherein the partitioning rule indicates:
and determining the display positions of the plurality of screen projection data on the first display screen according to the starting sequence of the application modules corresponding to the plurality of screen projection data.
17. The method of claim 11, wherein the scheduling policy indicates:
displaying a first screen projection data in the plurality of screen projection data on the first display screen; and
and displaying other screen projection data except the first screen projection data in the plurality of screen projection data in a picture-in-picture mode.
18. The method of claim 11, wherein the scheduling policy indicates:
feeding back summary information of the plurality of screen projection data to a user;
acquiring user selection information, and determining screen projection data selected by a user according to the user selection information; and
displaying the user-selected screen projection data on the first display screen.
19. The method of claim 10, wherein the screen projecting end comprises a first screen projecting end and a second screen projecting end; the method further comprises the following steps:
and in response to the receiving of the interconnection request of the first screen projection end, establishing an interconnection channel between the display end and the second screen projection end, and determining whether to allow the first screen projection end and the display end to establish the interconnection channel for transmitting the screen projection data of the first screen projection end according to a preset multi-end interconnection rule.
20. The method of claim 10, wherein the display screens of the display end comprise at least a first display screen and a second display screen, and the projection data of the projection end is displayed through at least the first display screen; the method further comprises the following steps:
responding to an information sharing request detected by the first display screen, and feeding back the information sharing request, wherein the information sharing request indicates that screen projection data of the screen projection end are shared to the second display screen; and
and responding to the received sharing confirmation instruction, and displaying the screen projection data of the screen projection end through the first display screen and the second display screen.
21. An electronic device, comprising:
at least one processor;
the communication unit is in communication connection with the at least one processor and is used for carrying out data transmission under the control of the processor; and
a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of responding at a screen projection end according to any one of claims 1 to 9, the electronic device being a screen projection end; or, the response method of the display terminal according to any one of claims 10 to 20 is performed, and the electronic device is the display terminal.
22. The electronic device of claim 21, wherein the display terminal is a smart car or vehicle.
23. A computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the screen-projection-side response method according to any one of claims 1 to 9 or the display-side response method according to any one of claims 10 to 20.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210320929.7A CN115729502B (en) | 2022-03-23 | 2022-03-23 | Screen-throwing end and display end response method, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210320929.7A CN115729502B (en) | 2022-03-23 | 2022-03-23 | Screen-throwing end and display end response method, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115729502A true CN115729502A (en) | 2023-03-03 |
| CN115729502B CN115729502B (en) | 2024-02-27 |
Family
ID=85292329
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210320929.7A Active CN115729502B (en) | 2022-03-23 | 2022-03-23 | Screen-throwing end and display end response method, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115729502B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116347145A (en) * | 2023-03-27 | 2023-06-27 | 广州南翼信息科技有限公司 | Multi-device screen sharing method, screen throwing device, display device and sharing system |
Citations (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2001052230A1 (en) * | 2000-01-10 | 2001-07-19 | Ic Tech, Inc. | Method and system for interacting with a display |
| EP2386939A2 (en) * | 2010-05-12 | 2011-11-16 | Lg Electronics Inc. | Mobile terminal and method of displaying 3D images thereon |
| KR20160026252A (en) * | 2014-08-29 | 2016-03-09 | 삼성전자주식회사 | Method for magnifying screen, electronic apparatus and storage medium |
| CN105389149A (en) * | 2015-11-03 | 2016-03-09 | 惠州Tcl移动通信有限公司 | Method and system for implementing multi-screen operation of smart device |
| CN107113352A (en) * | 2014-10-10 | 2017-08-29 | 三星电子株式会社 | The method and its electronic equipment of shared screen |
| US20170315769A1 (en) * | 2016-04-27 | 2017-11-02 | Blackfire Research Corporation | System and method for multiuser interaction with a media computing device with multiple virtual screens and personal area network capability |
| CN111078168A (en) * | 2019-11-13 | 2020-04-28 | 联想(北京)有限公司 | Information processing method, first electronic equipment and storage medium |
| CN111182346A (en) * | 2020-01-16 | 2020-05-19 | 武汉卡比特信息有限公司 | Combined split screen projection method of mobile terminal and computer terminal |
| CN111432070A (en) * | 2020-03-17 | 2020-07-17 | 北京百度网讯科技有限公司 | Application screen projection control method, device, equipment and medium |
| CN111597006A (en) * | 2020-05-19 | 2020-08-28 | Oppo广东移动通信有限公司 | Application split screen method and device, storage medium and electronic equipment |
| WO2020259015A1 (en) * | 2019-06-25 | 2020-12-30 | 维沃移动通信有限公司 | Screen mirroring method and mobile terminal |
| CN112269527A (en) * | 2020-11-16 | 2021-01-26 | Oppo广东移动通信有限公司 | Application interface generation method and related device |
| CN112383803A (en) * | 2020-11-16 | 2021-02-19 | Oppo广东移动通信有限公司 | Information processing method and related device |
| CN112394895A (en) * | 2020-11-16 | 2021-02-23 | Oppo广东移动通信有限公司 | Cross-equipment display method and device of picture and electronic equipment |
| CN112905289A (en) * | 2021-03-10 | 2021-06-04 | Oppo广东移动通信有限公司 | Application picture display method, device, terminal, screen projection system and medium |
| WO2021109926A1 (en) * | 2019-12-02 | 2021-06-10 | 维沃移动通信有限公司 | Application sharing method, electronic device and computer-readable storage medium |
| CN112995575A (en) * | 2021-05-13 | 2021-06-18 | 广州朗国电子科技有限公司 | Wireless screen projection transfer device, transfer control method and wireless screen projection system |
| CN113094012A (en) * | 2021-04-07 | 2021-07-09 | 苏州大智广告传媒有限公司 | Multi-screen interaction method, system and storage medium |
| CN113268212A (en) * | 2021-05-18 | 2021-08-17 | Oppo广东移动通信有限公司 | Screen projection method and device, storage medium and electronic equipment |
| CN113741840A (en) * | 2020-09-10 | 2021-12-03 | 华为技术有限公司 | Application interface display method under multi-window screen projection scene and electronic equipment |
| CN114071230A (en) * | 2021-09-26 | 2022-02-18 | 深圳市酷开网络科技股份有限公司 | Multi-terminal screen projection method, computer equipment and computer readable storage medium |
| CN114168235A (en) * | 2020-08-20 | 2022-03-11 | 华为技术有限公司 | Function switching entry determining method and electronic equipment |
-
2022
- 2022-03-23 CN CN202210320929.7A patent/CN115729502B/en active Active
Patent Citations (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2001052230A1 (en) * | 2000-01-10 | 2001-07-19 | Ic Tech, Inc. | Method and system for interacting with a display |
| EP2386939A2 (en) * | 2010-05-12 | 2011-11-16 | Lg Electronics Inc. | Mobile terminal and method of displaying 3D images thereon |
| KR20160026252A (en) * | 2014-08-29 | 2016-03-09 | 삼성전자주식회사 | Method for magnifying screen, electronic apparatus and storage medium |
| CN107113352A (en) * | 2014-10-10 | 2017-08-29 | 三星电子株式会社 | The method and its electronic equipment of shared screen |
| CN105389149A (en) * | 2015-11-03 | 2016-03-09 | 惠州Tcl移动通信有限公司 | Method and system for implementing multi-screen operation of smart device |
| US20170315769A1 (en) * | 2016-04-27 | 2017-11-02 | Blackfire Research Corporation | System and method for multiuser interaction with a media computing device with multiple virtual screens and personal area network capability |
| WO2020259015A1 (en) * | 2019-06-25 | 2020-12-30 | 维沃移动通信有限公司 | Screen mirroring method and mobile terminal |
| CN111078168A (en) * | 2019-11-13 | 2020-04-28 | 联想(北京)有限公司 | Information processing method, first electronic equipment and storage medium |
| WO2021109926A1 (en) * | 2019-12-02 | 2021-06-10 | 维沃移动通信有限公司 | Application sharing method, electronic device and computer-readable storage medium |
| CN111182346A (en) * | 2020-01-16 | 2020-05-19 | 武汉卡比特信息有限公司 | Combined split screen projection method of mobile terminal and computer terminal |
| CN111432070A (en) * | 2020-03-17 | 2020-07-17 | 北京百度网讯科技有限公司 | Application screen projection control method, device, equipment and medium |
| CN111597006A (en) * | 2020-05-19 | 2020-08-28 | Oppo广东移动通信有限公司 | Application split screen method and device, storage medium and electronic equipment |
| CN114168235A (en) * | 2020-08-20 | 2022-03-11 | 华为技术有限公司 | Function switching entry determining method and electronic equipment |
| CN113741840A (en) * | 2020-09-10 | 2021-12-03 | 华为技术有限公司 | Application interface display method under multi-window screen projection scene and electronic equipment |
| CN112394895A (en) * | 2020-11-16 | 2021-02-23 | Oppo广东移动通信有限公司 | Cross-equipment display method and device of picture and electronic equipment |
| CN112383803A (en) * | 2020-11-16 | 2021-02-19 | Oppo广东移动通信有限公司 | Information processing method and related device |
| CN112269527A (en) * | 2020-11-16 | 2021-01-26 | Oppo广东移动通信有限公司 | Application interface generation method and related device |
| CN112905289A (en) * | 2021-03-10 | 2021-06-04 | Oppo广东移动通信有限公司 | Application picture display method, device, terminal, screen projection system and medium |
| CN113094012A (en) * | 2021-04-07 | 2021-07-09 | 苏州大智广告传媒有限公司 | Multi-screen interaction method, system and storage medium |
| CN112995575A (en) * | 2021-05-13 | 2021-06-18 | 广州朗国电子科技有限公司 | Wireless screen projection transfer device, transfer control method and wireless screen projection system |
| CN113268212A (en) * | 2021-05-18 | 2021-08-17 | Oppo广东移动通信有限公司 | Screen projection method and device, storage medium and electronic equipment |
| CN114071230A (en) * | 2021-09-26 | 2022-02-18 | 深圳市酷开网络科技股份有限公司 | Multi-terminal screen projection method, computer equipment and computer readable storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116347145A (en) * | 2023-03-27 | 2023-06-27 | 广州南翼信息科技有限公司 | Multi-device screen sharing method, screen throwing device, display device and sharing system |
| CN116347145B (en) * | 2023-03-27 | 2023-10-31 | 广州南翼信息科技有限公司 | Multi-device screen sharing method, screen throwing device, display device and sharing system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115729502B (en) | 2024-02-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114006625B (en) | Split-screen display method and electronic equipment | |
| EP2723008B1 (en) | Mobile terminal, broadcasting terminal and controlling method thereof | |
| US10324767B2 (en) | Electronic device and method of providing battery information by electronic device | |
| CN108776599B (en) | Management method and device for preloaded application, storage medium and intelligent terminal | |
| EP2690547B1 (en) | Terminal and method of sharing a handwriting therein | |
| KR102642689B1 (en) | Electronic Apparatus and the Method for Controlling Traffic thereof | |
| CN109445577B (en) | Virtual room switching method and device, electronic equipment and storage medium | |
| US9826529B1 (en) | Adaptive wireless frequency band sharing | |
| US20190199795A1 (en) | Method and device for synchronizing backup data, storage medium, electronic device, and server | |
| CN112732535B (en) | Method for controlling time-limited use of application program and electronic equipment | |
| US20180239511A1 (en) | Mobile terminal and control method therefor | |
| KR102067059B1 (en) | Terminal and method for controlling the same | |
| CN115729502B (en) | Screen-throwing end and display end response method, electronic equipment and storage medium | |
| CN115729499A (en) | Response method of screen projection terminal and display terminal, electronic device and storage medium | |
| CN109831375B (en) | Method for transmitting and receiving instant messaging information, terminal and computer readable storage medium | |
| CN115729500A (en) | Screen projection method of screen projection terminal and display terminal, electronic equipment and storage medium | |
| US20160309485A1 (en) | Method and device for supporting communication of electronic device | |
| CN111459410B (en) | Memory space allocation method and device, electronic equipment and storage medium | |
| US20230216702A1 (en) | Processing method, device and storage medium | |
| CN114143280B (en) | Session display method and device, electronic equipment and storage medium | |
| CN115729501A (en) | Screen projection method, electronic device and storage medium | |
| CN113254092B (en) | Processing method, apparatus and storage medium | |
| EP3617860A1 (en) | Screen locking method and apparatus | |
| KR101726549B1 (en) | Touch control method for mobile real time simulation (rts) game | |
| CN117202133A (en) | Equipment control method, system, vehicle-mounted equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |