CN114884990A - Screen projection method and device based on virtual screen - Google Patents
Screen projection method and device based on virtual screen Download PDFInfo
- Publication number
- CN114884990A CN114884990A CN202210485434.XA CN202210485434A CN114884990A CN 114884990 A CN114884990 A CN 114884990A CN 202210485434 A CN202210485434 A CN 202210485434A CN 114884990 A CN114884990 A CN 114884990A
- Authority
- CN
- China
- Prior art keywords
- vehicle end
- application
- virtual
- data
- virtual layer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 60
- 230000008859 change Effects 0.000 claims description 7
- 238000005516 engineering process Methods 0.000 abstract description 3
- 238000004088 simulation Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 9
- 238000004891 communication Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000004590 computer program Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/146—Markers for unambiguous identification of a particular session, e.g. session cookie or URL-encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application provides a screen projection method and device based on a virtual screen. And then, receiving a data request sent by the vehicle end, and sending second data of the application second virtual layer corresponding to the identifier in the data request to the vehicle end so as to display the application information at the vehicle end. Therefore, the terminal simulates the identification and the information of the application supporting screen projection on the virtual screen interface and sends the simulation data to the vehicle end, so that the abundant application information in the terminal is rapidly displayed in the vehicle end through the virtual screen technology, and the capability of the information entertainment host machine at the vehicle end is improved.
Description
Technical Field
The application relates to the technical field of vehicles, in particular to a screen projection method and device based on a virtual screen.
Background
With the development of society, terminals have a higher and higher weight in the lives of people. The terminal has a large amount of user data and information about the usage habits of the user, for example, audio and video which the user likes are stored in the mobile phone.
How to expand the capability of an IHU (information Head Unit) at a vehicle end by using the advantages of a terminal becomes more and more important.
Disclosure of Invention
The application provides a screen projection method and screen projection equipment based on a virtual screen, so that the capability of an infotainment host at a vehicle end is improved.
In a first aspect, the present application provides a virtual screen-based screen projection method, where the method is used for a terminal, and includes:
after connection with a vehicle end is established, a first virtual layer corresponding to an application identifier supporting screen projection in the terminal and a second virtual layer corresponding to the application information are generated on a virtual screen interface;
sending first data corresponding to the first virtual layer to a vehicle end so as to display an identifier corresponding to the first virtual layer on the vehicle end;
and receiving a data request sent by the vehicle end, and sending second data of a second virtual layer of the application corresponding to the identifier in the data request to the vehicle end so as to display the information of the application at the vehicle end.
Optionally, the receiving a data request sent by the vehicle end, and sending second data of a second virtual layer of an application corresponding to an identifier in the data request to the vehicle end specifically includes:
and detecting the change of the second virtual layer of each application in the virtual screen interface, and after receiving a data request sent by the vehicle end, sending the change data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle end.
Optionally, the receiving a data request sent by the vehicle end, and sending second data of a second virtual layer of an application corresponding to an identifier in the data request to the vehicle end, so as to display information of the application at the vehicle end specifically includes:
receiving a video data request sent by the vehicle end, and sending video data of a video virtual layer of a video application corresponding to an identifier in the video data request to the vehicle end so as to display a video of the video application at the vehicle end;
or receiving an audio data request sent by the vehicle end, and sending the audio data of the audio virtual layer of the audio application corresponding to the identifier in the audio data request to the vehicle end so as to display the audio of the audio application at the vehicle end.
Optionally, the method further includes:
receiving a connection request sent by the vehicle end, and establishing connection with the vehicle end;
or sending a connection request to the vehicle end to establish connection with the vehicle end.
Optionally, the sending the second data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle end specifically includes:
acquiring a first coordinate of a display interface marked at the vehicle end in the data request;
acquiring a second coordinate corresponding to the first coordinate and an application corresponding to the second coordinate according to the corresponding relation between the first coordinate of the identifier and the second coordinate of the first virtual layer;
and sending the second data of the second virtual layer of the application corresponding to the second coordinate to the vehicle end.
Optionally, the sending the second data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle end specifically includes:
and acquiring a volume request in the data request, adjusting the volume of second data of a second virtual layer of the application corresponding to the identifier in the data request according to the volume request, and sending the adjusted second data to the vehicle end.
In a second aspect, the present application provides a virtual screen-based screen projection method, which is used at a vehicle end and includes:
after connection with a terminal is established, receiving first data corresponding to a first virtual layer sent by the terminal, and displaying an identifier corresponding to the first virtual layer, wherein the first virtual layer is a virtual layer corresponding to an identifier of an application supporting screen projection generated on a virtual screen interface by the terminal;
sending a data request to the terminal, receiving second data of a second virtual layer of the application corresponding to the identifier in the data request sent by the terminal, and displaying information of the application, wherein the second virtual layer is a virtual layer corresponding to the information of the application generated on the virtual screen interface by the terminal.
Optionally, the sending the data request to the terminal specifically includes:
responding to a touch screen operation, adding an identifier corresponding to the touch screen operation into a data request, and sending the data request to the terminal.
Optionally, adding the identifier corresponding to the touch screen operation to the data request specifically includes:
and adding a first coordinate, corresponding to the touch screen operation, marked on a display interface of the vehicle end to the data request.
In a third aspect, the present application provides a virtual screen-based screen projection device, including:
the generating module is used for generating a first virtual layer corresponding to an identifier of an application supporting screen projection in the terminal and a second virtual layer corresponding to the information of the application on a virtual screen interface after connection with a vehicle end is established;
the first sending module is used for sending first data corresponding to the first virtual layer to a vehicle end so as to display an identifier corresponding to the first virtual layer on the vehicle end;
the second sending module is used for receiving a data request sent by the vehicle end, sending second data of a second virtual layer of the application corresponding to the identifier in the data request to the vehicle end, and displaying information of the application on the vehicle end.
In a fourth aspect, the present application provides a virtual screen-based screen projection device, including:
the first display module is used for receiving first data corresponding to a first virtual layer sent by a terminal after connection with the terminal is established, and displaying an identifier corresponding to the first virtual layer, wherein the first virtual layer is a virtual layer corresponding to an identifier of an application supporting screen projection generated on a virtual screen interface by the terminal;
and the second display module is used for sending a data request to the terminal, receiving second data of a second virtual layer of the application corresponding to the identifier in the data request sent by the terminal, and displaying the information of the application, wherein the second virtual layer is a virtual layer corresponding to the information of the application generated on the virtual screen interface by the terminal.
In a fifth aspect, the present application provides an electronic device, comprising: a memory and a processor;
the memory is used for storing instructions; the processor is configured to invoke instructions in the memory to perform a virtual screen-based screen projection method in any one of the possible designs of the first aspect and the first aspect or a virtual screen-based screen projection method in any one of the possible designs of the second aspect and the second aspect.
In a sixth aspect, the present application provides a computer-readable storage medium having stored thereon computer instructions, which, when executed by at least one processor of an electronic device, cause the electronic device to perform a virtual screen-based screen projection method in any one of the possible designs of the first aspect and the first aspect, or a virtual screen-based screen projection method in any one of the possible designs of the second aspect and the second aspect.
In a seventh aspect, the present application provides a computer program product comprising computer instructions that, when executed by at least one processor of an electronic device, cause the electronic device to perform a virtual screen-based screen projection method in any one of the possible designs of the first aspect and the first aspect or a virtual screen-based screen projection method in any one of the possible designs of the second aspect and the second aspect.
According to the screen projection method based on the virtual screen, after the terminal is connected with the vehicle end, a first virtual layer corresponding to an application identifier supporting screen projection in the terminal and a second virtual layer corresponding to application information are generated on a virtual screen interface, and first data corresponding to the first virtual layer are sent to the vehicle end so that the identifier corresponding to the first virtual layer is displayed on the vehicle end. And then, receiving a data request sent by the vehicle end, and sending second data of the application second virtual layer corresponding to the identifier in the data request to the vehicle end so as to display the application information at the vehicle end. Therefore, the terminal simulates the identification and the information of the application supporting screen projection on the virtual screen interface and sends the simulation data to the vehicle end, so that the abundant application information in the terminal is rapidly displayed in the vehicle end through the virtual screen technology, and the capability of the information entertainment host machine at the vehicle end is improved.
Drawings
In order to more clearly illustrate the technical solutions in the present application or the prior art, the drawings needed for the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a scene schematic diagram of a screen projection method based on a virtual screen according to an embodiment of the present application;
fig. 2 is a flowchart of a virtual screen-based screen projection method according to an embodiment of the present application;
fig. 3 is a signaling interaction diagram of a screen projection method based on a virtual screen according to an embodiment of the present application;
FIG. 4 is a flowchart of another virtual screen-based screen projection method according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a virtual screen-based screen projection apparatus according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of another virtual-screen-based projection device according to an embodiment of the present application;
fig. 7 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.
Detailed Description
To make the purpose, technical solutions and advantages of the present application clearer, the technical solutions in the present application will be clearly and completely described below with reference to the drawings in the present application, and it is obvious that the described embodiments are some, but not all embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
With the development of society, terminals have a higher and higher weight in the lives of people. The terminal has a large amount of user data and information about the usage habits of the user, for example, audio and video which the user likes are stored in the mobile phone. How to expand the capability of the infotainment host computer at the vehicle end by using the advantages of the terminal becomes more and more important.
In order to solve the problems, the application provides a screen projection method based on a virtual screen, after a terminal establishes connection with a vehicle end, a first virtual layer corresponding to an identifier of an application supporting screen projection in the terminal and a second virtual layer corresponding to information of the application supporting screen projection are generated on a virtual screen interface, first data corresponding to the first virtual layer are sent to the vehicle end, and therefore the identifier corresponding to the first virtual layer is displayed on the vehicle end, namely the identifier of the application supporting screen projection is displayed. After the identifier of the application supporting screen projection is displayed at the vehicle end, the touch screen operation of the identifier can be responded, and a data request is sent to the terminal after the touch screen operation is received. The terminal sends the second data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle end, and the vehicle end can display the information of the application corresponding to the second virtual layer, so that rich information in the application is displayed, and the capability of the information entertainment host machine at the vehicle end is improved.
The technical solution of the present application will be described in detail below with specific examples. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments.
Fig. 1 shows a scene schematic diagram of a virtual screen-based screen projection method according to an embodiment of the present application. The terminal 101 establishes a connection with the vehicle terminal 102 after receiving a connection request from the vehicle terminal 102. Then, the terminal 101 generates a first virtual layer corresponding to the identifier of the application supporting screen projection in the terminal 101 and a second virtual layer corresponding to the information of the application on the virtual screen interface. After generating a first virtual layer corresponding to the identifier of the application, the terminal 101 sends first data corresponding to the first virtual layer to the vehicle end 102. After receiving the first data corresponding to the first virtual layer, the vehicle end 102 displays an identifier corresponding to the first virtual layer, and after receiving a touch screen operation on the identifier, the vehicle end 102 sends a data request to the terminal 101. After receiving the data request, the terminal 101 sends the second data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle end 102. After receiving the second data corresponding to the second virtual layer, the vehicle end 102 displays the information of the application.
Fig. 2 shows a flowchart of a virtual screen-based screen projection method according to an embodiment of the present application. On the basis of the embodiment shown in fig. 1, as shown in fig. 2, with a terminal as an execution subject, the method of this embodiment may include the following steps:
s101, after connection with a vehicle end is established, a first virtual layer corresponding to an application identifier supporting screen projection in a terminal and a second virtual layer corresponding to application information are generated on a virtual screen interface.
The terminal can receive a connection request of the vehicle end and establish connection with the vehicle end according to the connection request. The terminal can also send a connection request to the vehicle end, so that the vehicle end establishes connection with the terminal after receiving the connection request. For example, the terminal receives a connection request sent by the vehicle end through Bluetooth or wifi, or sends the connection request to the vehicle end through Bluetooth, wifi or a two-dimensional code scanning mode. Therefore, when the connection between the terminal and the vehicle end needs to be established, the connection request can be sent to the vehicle end through the terminal, and the connection can also be sent to the terminal through the vehicle end, so that the connection between the terminal and the vehicle end can be established quickly. The terminal is, for example, a mobile phone, a tablet computer, etc.
In specific application, after receiving a connection request from a vehicle end, the terminal can verify authentication information carried in the connection request, and establish a distributed network (socket) and connect the vehicle end in a wifi p2p manner after the verification is passed. The distributed network includes a plurality of transmission channels, such as video channels, audio channels, and the like. After receiving the connection request of the terminal, the vehicle terminal can verify the authentication information carried in the connection request, and establish connection with the terminal after the verification is passed, wherein the authentication information comprises a login name and a password.
The terminal comprises an application supporting screen projection and an application not supporting screen projection, the application supporting screen projection is such as a video application, an audio application and the like, and the application not supporting screen projection is such as a game application, an office application and the like. Information of applications supporting screen projection can be displayed on a vehicle end, and information of applications not supporting screen projection cannot be displayed on the vehicle end, so that the applications capable of supporting screen projection in the terminal need to be acquired. The terminal can use the PackageManagerService service of the query system to search all applications which can support screen projection. In some embodiments, after the terminal establishes the connection with the vehicle end, an application capable of supporting screen projection can be searched before the virtual screen interface is created, or the application capable of supporting screen projection can be searched after the virtual screen interface is created.
And generating a first virtual layer corresponding to the identifier of the application supporting screen projection in the terminal and a second virtual layer corresponding to the information of the application on the virtual screen interface. And simulating a layer of the identifier of the application supporting screen projection on the virtual screen interface to generate a first virtual layer, and also simulating a layer of the information of the application supporting screen projection to generate a second virtual layer. For example, the application is a video application, and layers of video images in the video application are simulated to generate a video virtual layer. For example, the application is an audio application, and layers of audio images in the audio application are simulated to generate an audio virtual layer.
S102, sending the first data corresponding to the first virtual layer to a vehicle end so as to display the identifier corresponding to the first virtual layer on the vehicle end.
The terminal generates a first virtual layer corresponding to the application identifier supporting screen projection on the virtual screen interface, and the identifier corresponding to the first virtual layer cannot be displayed on the terminal. The terminal displays identifiers of all applications, namely displays identifiers of applications supporting screen projection and identifiers of applications not supporting screen projection, and if the terminal can display identifiers corresponding to the first virtual layer, repeated identifiers can appear on the terminal, so that confusion is caused. Therefore, the first data corresponding to the first virtual layer generated on the virtual screen interface is sent to the vehicle end, so that the identifier corresponding to the first virtual layer is displayed at the vehicle end, namely the identifier of the application capable of supporting screen projection is displayed at the vehicle end.
S103, receiving a data request sent by the vehicle end, and sending second data of a second virtual layer of the application corresponding to the identifier in the data request to the vehicle end so as to display information corresponding to the application at the vehicle end.
The method comprises the steps that the identifier of the application capable of being projected on the screen is displayed on the vehicle end, and the touch screen operation of the identifier can be received, wherein the touch screen operation is the clicking operation of the identifier displayed on the vehicle end, and can be understood as the operation of acquiring the information of the application corresponding to the identifier. After receiving the touch screen operation on the identifier, the vehicle end can respond to the touch screen operation, send a data request to the vehicle end, and place the identifier corresponding to the touch screen operation in the data request.
After receiving a data request sent by a vehicle end, the terminal acquires an identifier in the data request and sends second data of a second virtual layer of an application corresponding to the identifier to the vehicle end. Because the application information comprises a plurality of layers, and the second virtual layer is a layer of information simulated on the virtual screen interface, the second data corresponding to the second virtual layer is sent to the vehicle end, and the application information corresponding to the second virtual layer can be displayed on the vehicle end, that is, the information of the application supporting screen projection is displayed on the vehicle end.
In some embodiments, the application capable of supporting screen projection may include a plurality of pieces of information, a second virtual layer corresponding to each piece of information may be continuously generated on the virtual screen interface, and each time a second virtual layer of one piece of information is generated on the virtual screen interface, the second virtual layer of the application on the virtual screen interface is increased by some, so that the second virtual layer of the application on the virtual screen interface may be changed, and the change of the second virtual layer may continuously increase the information displayed on the vehicle side, thereby improving the capability of the infotainment host and meeting the requirements of the user. The terminal can periodically detect the change of the second virtual layer of each application in the virtual interface, and after a data request sent by the vehicle end is received, the change data of the second virtual layer of the application corresponding to the identifier in the data request is sent to the vehicle end, so that more information can be displayed at the vehicle end, and the capability of the information entertainment host is improved.
As an implementation manner, the data request may include a video data request, and the vehicle end sends the video data request to the vehicle end after receiving the touch screen operation on the identifier of the video application. After receiving the video data request, the vehicle end acquires the identifier carried in the video data request, and sends the video data of the video virtual layer of the video application corresponding to the identifier to the vehicle end through a video channel in the distributed network. After receiving the video data corresponding to the video virtual layer, the vehicle end displays the video corresponding to the video virtual layer, namely displays the video in the video application.
As another implementation, the data request may include an audio data request, and the vehicle end sends the audio data request to the vehicle end after receiving the touch screen operation for the identifier of the audio application. After receiving the audio data request, the vehicle end acquires the identifier carried in the audio data request, and sends the audio data of the audio virtual layer of the audio application corresponding to the identifier to the vehicle end through an audio channel in the distributed network. After receiving the audio data corresponding to the audio virtual layer, the vehicle end displays the audio corresponding to the audio virtual layer, that is, displays the audio in the audio application, for example, plays music, songs, and the like in the audio application.
It should be noted that when the vehicle end displays information corresponding to the second virtual layer, that is, displays information in an application, the vehicle end cannot display the information of the application, and can display information of other applications, so as to avoid repeated display of the same information, and save resources.
The virtual screen interface cannot display the application identifier, the first virtual layer corresponding to the identifier can be generated, and as the identifiers of the applications supporting screen projection can be generated on the virtual screen interface, a coordinate system can be established on the virtual screen interface, and each first virtual layer is given a corresponding coordinate, so that the first virtual layers corresponding to the identifiers on the virtual screen interface can be distinguished. Meanwhile, a coordinate system can be established on a display interface of the vehicle end, the identifier of the application displayed on the display interface has corresponding coordinates, the coordinate system on the virtual screen interface corresponds to the coordinate system on the display interface of the vehicle end, and then the coordinates corresponding to the first virtual layer corresponding to a certain identifier on the virtual screen interface correspond to the coordinates of the identifier on the display interface.
Therefore, the corresponding relation between the first coordinate marked on the display interface of the vehicle end and the second coordinate of the first virtual layer corresponding to the mark on the virtual screen interface can be pre-established, namely the corresponding relation between the first coordinate marked and the second coordinate of the first virtual layer is established. Therefore, after the data request is received, the identifier carried in the data request and the first coordinate of the identifier on the display interface of the vehicle end can be obtained, and the second coordinate corresponding to the first coordinate is obtained according to the corresponding relation between the first coordinate of the identifier and the second coordinate of the first virtual layer. And acquiring the corresponding application according to the second coordinate, wherein the second coordinate is the coordinate of the first virtual layer on the virtual screen interface, and the first virtual layer is the virtual layer of the application identifier. Therefore, after the data request is received, a first coordinate of an identifier carried in the data request on a display interface of the vehicle end is obtained, a corresponding second coordinate is obtained according to the first coordinate, a first virtual layer corresponding to the second coordinate is obtained, and second data of an applied second virtual layer corresponding to the first virtual layer are sent to the vehicle end. Therefore, the information of which application needs to be acquired can be accurately known according to the identified coordinates in the data request, and the data corresponding to the second virtual layer of the application is sent to the vehicle end, so that the information of the application is displayed at the vehicle end.
In some embodiments, since the application may be a video application or an audio application, video in the video application and audio in the audio application have a requirement of volume. Therefore, after receiving a key request sent by a user, the vehicle end can respond to the key request, and carry a volume request corresponding to the key request in a data request sent to the terminal, wherein when the key request indicates to reduce the volume, the volume request indicates to reduce the volume, and when the key request indicates to increase the volume, the volume request indicates to increase the volume. The terminal acquires the volume request and the identifier in the data request after receiving the data request, and adjusts the volume of second data of the second virtual layer of the application corresponding to the identifier in the data request according to the volume request, wherein the volume of the second data is related to the volume of information of the application displayed at the vehicle end, for example, the greater the volume of the second data is, the greater the volume of the information of the application displayed at the vehicle end is. And then, the terminal sends the adjusted second data to the vehicle end, so that the vehicle end displays the applied information according to the adjusted second data, and the experience of the user is improved.
According to the screen projection method based on the virtual screen, the terminal simulates the identification and the information of the application supporting screen projection on the virtual screen interface, rich application information in the terminal is rapidly displayed in the vehicle end through the virtual screen technology, and the capability of the information entertainment host machine at the vehicle end is improved.
Fig. 3 shows a flowchart of a virtual screen-based screen projection method according to an embodiment of the present application. As shown in fig. 3, the method of the present embodiment may include the following steps:
s201, a connection request is sent by a vehicle end.
The vehicle terminal sends a connection request to the terminal in a Bluetooth mode, a wifi mode and the like, and the connection request is used for requesting to establish connection with the terminal.
S202, the terminal responds to the connection request and establishes connection with the vehicle end.
And after receiving the connection request sent by the vehicle end, the terminal responds to the connection request and establishes connection with the vehicle end.
S203, the terminal generates a first virtual layer corresponding to the identification of the application supporting screen projection in the terminal and a second virtual layer corresponding to the information of the application on the virtual screen interface.
After the terminal is connected with the vehicle end, a virtual screen interface is created, an identifier of an application which can support screen projection in the terminal is obtained, and a first virtual layer corresponding to the identifier of the application which supports screen projection and a second virtual layer corresponding to the identifier of the application which supports screen projection are generated on the virtual screen interface.
S204, the terminal sends the first data corresponding to the first virtual layer to a vehicle end.
After the terminal generates a first virtual layer supporting the identification of the screen-projected application, first data corresponding to the first virtual protrusion are sent to a vehicle end.
S205, displaying the identifier corresponding to the first virtual layer at the vehicle end.
After receiving the first data corresponding to the first virtual layer, the vehicle end displays the identifier corresponding to the first virtual layer on the display interface.
And S206, responding to the identified touch screen operation by the vehicle terminal, and sending a data request to the terminal.
After receiving the touch screen operation on the identification, the vehicle terminal responds to the touch screen operation on the identification, adds the identification corresponding to the touch screen operation to the data request, and sends the data request to the terminal.
And S207, the terminal sends the second data of the second virtual layer of the application corresponding to the identifier in the data request to a vehicle end.
And after receiving the data request, the terminal acquires the identifier in the data request and sends the second data of the second virtual layer of the application corresponding to the identifier to the vehicle end.
And S208, displaying the information of the application at the vehicle end.
And after the vehicle end receives second data corresponding to the second virtual layer, displaying application information corresponding to the second virtual layer.
According to the screen projecting method based on the virtual screen, the identification and the information of the application supporting screen projection simulated in the terminal are sent to the vehicle end through interaction between the terminal and the vehicle end, so that rich application information in the terminal is displayed in the vehicle end quickly, and the capability of an information entertainment host of the vehicle end is improved.
Fig. 4 shows a flowchart of a virtual screen-based screen projection method according to an embodiment of the present application. As shown in fig. 4, with the vehicle end as the execution subject, the method of this embodiment may include the following steps:
s301, after the connection with the terminal is established, receiving first data corresponding to a first virtual layer sent by the terminal, and displaying an identifier corresponding to the first virtual layer.
The vehicle terminal can receive the connection request sent by the terminal and establish connection with the terminal. After the connection between the vehicle end and the terminal is established, first data corresponding to a first virtual layer sent by the terminal is received, and the first virtual layer is a virtual layer corresponding to an application identifier which is generated on a virtual screen interface by the terminal and supports screen projection. And after the vehicle end receives the first data corresponding to the first virtual layer, displaying an identifier corresponding to the first virtual layer, namely displaying an identifier of the application supporting screen projection.
S302, sending a data request to the terminal, receiving second data of a second virtual layer of the application corresponding to the identifier in the data request sent by the terminal, and displaying information of the application.
The vehicle terminal can send a data request to the terminal to request to acquire the information of the application. After the vehicle end sends a data request to the terminal, the terminal sends second data of a second virtual layer of the application corresponding to the identifier in the data request to the vehicle end, and the second virtual layer is a virtual layer corresponding to the information of the application generated on the virtual screen interface by the terminal. And after the vehicle end receives second data corresponding to the second virtual layer, displaying application information corresponding to the second virtual layer.
In some embodiments, the vehicle terminal may respond to a touch screen operation of the user on the identifier, add the identifier corresponding to the touch screen operation to the data request, and then send the data request to the terminal. The terminal can obtain the identifier in the data request, and send the second data of the second virtual layer of the application corresponding to the identifier to the vehicle end, and the vehicle end displays the information of the application corresponding to the second virtual layer. Specifically, after receiving a touch screen operation of a user on an identifier, a vehicle end may add a first coordinate, which is identified by the touch screen operation, on a display interface of the vehicle end to a data request, and send the data request including the identified first coordinate to a terminal, the terminal obtains the identified first coordinate in the data request, obtains a second coordinate corresponding to the first coordinate according to a correspondence between the identified first coordinate and the second coordinate of the first virtual layer, and sends second data of a second virtual layer of an application corresponding to the first virtual layer to the vehicle end, and the vehicle end displays information of the application corresponding to the second virtual layer.
In some embodiments, the vehicle end may also respond to a volume request from the user, for example, in response to a click operation on a volume button, the click operation including increasing the volume or decreasing the volume. The vehicle terminal adds the volume request to the data request, sends the data request including the volume request to the terminal, and the terminal acquires the volume request and the identifier in the data request and adjusts the volume of the second data of the second virtual layer of the application corresponding to the identifier according to the volume request. And after receiving the adjusted second data, the vehicle terminal displays the application information corresponding to the identifier according to the volume of the adjusted second data, so as to meet the requirements of the user.
According to the screen projection method based on the virtual screen, the vehicle end receives first data of a first virtual layer corresponding to the identification of the application and second data of a second virtual layer corresponding to the information of the application, and displays the identification of the application corresponding to the first virtual layer and the information of the application corresponding to the second virtual layer, so that the identification and the information of the application supporting screen projection simulated in the terminal are displayed, and the capability of an information entertainment host of the vehicle end is improved.
Fig. 5 is a schematic structural diagram of a virtual-screen-based screen projection device according to an embodiment of the present application, and as shown in fig. 5, a virtual-screen-based screen projection device 10 according to this embodiment is used to implement operations corresponding to a terminal in any of the above method embodiments, where the virtual-screen-based screen projection device 10 according to this embodiment includes:
the generating module 11 is configured to generate, on a virtual screen interface, a first virtual layer corresponding to an identifier of an application supporting screen projection in a terminal and a second virtual layer corresponding to information of the application after connection is established with a vehicle end;
the first sending module 12 is configured to send first data corresponding to the first virtual layer to a vehicle end, so as to display an identifier corresponding to the first virtual layer at the vehicle end;
the second sending module 13 is configured to receive a data request sent by the vehicle end, and send second data of a second virtual layer of the application corresponding to the identifier in the data request to the vehicle end, so as to display information of the application at the vehicle end.
The virtual screen-based screen projection device 10 provided in the embodiment of the present application may implement the method embodiment when the terminal is taken as the execution main body, and for concrete implementation principles and technical effects, reference may be made to the method embodiment when the terminal is taken as the execution main body, which is not described herein again.
Fig. 6 is a schematic structural diagram of a virtual-screen-based screen projection device according to an embodiment of the present application, and as shown in fig. 6, a virtual-screen-based screen projection device 20 according to this embodiment is used to implement operations corresponding to a vehicle-side in any of the above method embodiments, where the virtual-screen-based screen projection device 20 according to this embodiment includes:
the first display module 21 is configured to receive first data corresponding to a first virtual protrusion sent by a terminal after establishing connection with the terminal, and display an identifier corresponding to a first virtual layer, where the first virtual layer is a virtual layer corresponding to an identifier of an application supporting screen projection generated on a virtual screen interface by the terminal;
the second display module 22 is configured to send a data request to the terminal, receive second data of a second virtual layer of the application corresponding to the identifier in the data request sent by the terminal, and display information of the application, where the second virtual layer is a virtual layer corresponding to the information of the application generated on the virtual screen interface by the terminal.
The virtual screen-based screen projection device 20 provided in the embodiment of the present application can implement the method embodiment using the vehicle-mounted terminal as the execution subject, and for concrete implementation principles and technical effects, reference may be made to the method embodiment using the vehicle-mounted terminal as the execution subject, which is not described herein again.
Fig. 7 shows a hardware structure diagram of an electronic device according to an embodiment of the present application. As shown in fig. 7, the electronic device 30 is configured to implement any one of the above method embodiments corresponding to the operation of the terminal or the operation of the vehicle end, where the electronic device 30 of this embodiment may include: memory 31, processor 32 and communication interface 33.
A memory 31 for storing computer instructions. The Memory 31 may include a Random Access Memory (RAM), a Non-Volatile Memory (NVM), at least one disk Memory, a usb disk, a removable hard disk, a read-only Memory, a magnetic disk or an optical disk.
And the processor 32 is configured to execute the computer instructions stored in the memory to implement the virtual screen-based screen projection method taking the terminal as an execution subject or the virtual screen-based screen projection method taking the vehicle-mounted terminal as an execution subject in the foregoing embodiments. The Processor 32 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present invention may be embodied directly in a hardware processor, or in a combination of the hardware and software modules within the processor.
Alternatively, the memory 31 may be separate or integrated with the processor 32.
A communication interface 33 may be connected to the processor 32. Processor 32 may control communication interface 33 to perform the functions of receiving and transmitting information signals.
The electronic device provided in this embodiment may be used to execute the above-mentioned screen projection method based on a virtual screen, and the implementation manner and the technical effect are similar, which are not described herein again.
The present application also provides a computer readable storage medium, in which computer instructions are stored, and when the computer instructions are executed by a processor, the computer instructions are used for implementing the methods provided by the above-mentioned various embodiments.
The present application also provides a computer program product comprising computer instructions stored in a computer readable storage medium. The computer instructions may be read by at least one processor of the device from a computer-readable storage medium, and execution of the computer instructions by the at least one processor causes the device to perform the methods provided by the various embodiments described above.
The embodiment of the present application further provides a chip, which includes a memory and a processor, where the memory is used to store computer instructions, and the processor is used to call and execute the computer instructions from the memory, so that a device in which the chip is installed executes the method described in the above various possible embodiments.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same. Although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: it is also possible to modify the solutions described in the previous embodiments or to substitute some or all of them with equivalents. And the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.
Claims (10)
1. A screen projection method based on a virtual screen is characterized in that the method is used for a terminal and comprises the following steps:
after connection with a vehicle end is established, a first virtual layer corresponding to an application identifier supporting screen projection in the terminal and a second virtual layer corresponding to the application information are generated on a virtual screen interface;
sending first data corresponding to the first virtual layer to a vehicle end so as to display an identifier corresponding to the first virtual layer on the vehicle end;
and receiving a data request sent by the vehicle end, and sending second data of a second virtual layer of the application corresponding to the identifier in the data request to the vehicle end so as to display the information of the application at the vehicle end.
2. The method according to claim 1, wherein the receiving a data request sent by the vehicle end and sending second data of a second virtual layer identifying a corresponding application in the data request to the vehicle end specifically includes:
and detecting the change of the second virtual layer of each application in the virtual screen interface, and after receiving a data request sent by the vehicle end, sending the change data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle end.
3. The method according to claim 2, wherein the receiving a data request sent by the vehicle end, sending second data of a second virtual layer identifying a corresponding application in the data request to the vehicle end, so as to display information of the application at the vehicle end specifically includes:
receiving a video data request sent by the vehicle end, and sending video data of a video virtual layer of a video application corresponding to an identifier in the video data request to the vehicle end so as to display a video of the video application at the vehicle end;
or receiving an audio data request sent by the vehicle end, and sending the audio data of the audio virtual layer of the audio application corresponding to the identifier in the audio data request to the vehicle end so as to display the audio of the audio application at the vehicle end.
4. The method according to any one of claims 1-3, further comprising:
receiving a connection request sent by the vehicle end, and establishing connection with the vehicle end;
or sending a connection request to the vehicle end to establish connection with the vehicle end.
5. The method according to claim 1, wherein the sending the second data of the second virtual layer identifying the corresponding application in the data request to the vehicle end specifically includes:
acquiring a first coordinate of a display interface marked at the vehicle end in the data request;
acquiring a second coordinate corresponding to the first coordinate and an application corresponding to the second coordinate according to the corresponding relation between the first coordinate of the identifier and the second coordinate of the first virtual layer;
and sending the second data of the second virtual layer of the application corresponding to the second coordinate to the vehicle end.
6. The method according to claim 1, wherein the sending second data of the second virtual layer identifying the corresponding application in the data request to the vehicle end specifically includes:
and acquiring a volume request in the data request, adjusting the volume of second data of a second virtual layer of the application corresponding to the identifier in the data request according to the volume request, and sending the adjusted second data to the vehicle end.
7. A screen projection method based on a virtual screen is characterized in that the method is used for a vehicle end and comprises the following steps:
after connection with a terminal is established, receiving first data corresponding to a first virtual layer sent by the terminal, and displaying an identifier corresponding to the first virtual layer, wherein the first virtual layer is a virtual layer corresponding to an identifier of an application supporting screen projection generated on a virtual screen interface by the terminal;
sending a data request to the terminal, receiving second data of a second virtual layer of the application corresponding to the identifier in the data request sent by the terminal, and displaying information of the application, wherein the second virtual layer is a virtual layer corresponding to the information of the application generated on the virtual screen interface by the terminal.
8. The method according to claim 7, wherein the sending the data request to the terminal specifically includes:
responding to a touch screen operation, adding an identifier corresponding to the touch screen operation into a data request, and sending the data request to the terminal.
9. The method according to claim 8, wherein the adding the identifier corresponding to the touch screen operation to the data request specifically includes:
and adding a first coordinate, corresponding to the touch screen operation, marked on a display interface of the vehicle end to the data request.
10. An electronic device, comprising: a processor, and a memory communicatively coupled to the processor;
the memory stores computer-executable instructions;
the processor executes computer-executable instructions stored in the memory to implement the virtual screen-based screen projection method of any one of claims 1-6 or the virtual screen-based screen projection method of any one of claims 7-9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210485434.XA CN114884990A (en) | 2022-05-06 | 2022-05-06 | Screen projection method and device based on virtual screen |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210485434.XA CN114884990A (en) | 2022-05-06 | 2022-05-06 | Screen projection method and device based on virtual screen |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114884990A true CN114884990A (en) | 2022-08-09 |
Family
ID=82673369
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210485434.XA Pending CN114884990A (en) | 2022-05-06 | 2022-05-06 | Screen projection method and device based on virtual screen |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114884990A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116193176A (en) * | 2023-02-13 | 2023-05-30 | 阿波罗智联(北京)科技有限公司 | Screen projection method, device, equipment and storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105915978A (en) * | 2015-12-14 | 2016-08-31 | 乐视致新电子科技（天津）有限公司 | Vehicle-mounted display control method and device thereof |
| CN110688042A (en) * | 2019-09-29 | 2020-01-14 | 百度在线网络技术（北京）有限公司 | Interface display method and device |
| CN111432070A (en) * | 2020-03-17 | 2020-07-17 | 北京百度网讯科技有限公司 | Application screen projection control method, device, equipment and medium |
| CN111443884A (en) * | 2020-04-23 | 2020-07-24 | 华为技术有限公司 | Screen projection method and device and electronic equipment |
| CN112099705A (en) * | 2020-09-04 | 2020-12-18 | 维沃移动通信有限公司 | Screen projection method and device and electronic equipment |
| CN112202967A (en) * | 2020-09-01 | 2021-01-08 | 武汉卡比特信息有限公司 | Split screen display method based on mobile phone interconnection |
| CN114201128A (en) * | 2020-09-02 | 2022-03-18 | 华为技术有限公司 | Display method and device |
| CN114327175A (en) * | 2020-09-29 | 2022-04-12 | 荣耀终端有限公司 | Information sharing method and device |
| CN114363678A (en) * | 2020-09-29 | 2022-04-15 | 华为技术有限公司 | Screen projection method and equipment |
| CN114356258A (en) * | 2020-09-30 | 2022-04-15 | 华为技术有限公司 | Electronic device, screen projection method thereof and medium |
-
2022
- 2022-05-06 CN CN202210485434.XA patent/CN114884990A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105915978A (en) * | 2015-12-14 | 2016-08-31 | 乐视致新电子科技（天津）有限公司 | Vehicle-mounted display control method and device thereof |
| CN110688042A (en) * | 2019-09-29 | 2020-01-14 | 百度在线网络技术（北京）有限公司 | Interface display method and device |
| CN111432070A (en) * | 2020-03-17 | 2020-07-17 | 北京百度网讯科技有限公司 | Application screen projection control method, device, equipment and medium |
| CN111443884A (en) * | 2020-04-23 | 2020-07-24 | 华为技术有限公司 | Screen projection method and device and electronic equipment |
| CN112202967A (en) * | 2020-09-01 | 2021-01-08 | 武汉卡比特信息有限公司 | Split screen display method based on mobile phone interconnection |
| CN114201128A (en) * | 2020-09-02 | 2022-03-18 | 华为技术有限公司 | Display method and device |
| CN112099705A (en) * | 2020-09-04 | 2020-12-18 | 维沃移动通信有限公司 | Screen projection method and device and electronic equipment |
| CN114327175A (en) * | 2020-09-29 | 2022-04-12 | 荣耀终端有限公司 | Information sharing method and device |
| CN114363678A (en) * | 2020-09-29 | 2022-04-15 | 华为技术有限公司 | Screen projection method and equipment |
| CN114356258A (en) * | 2020-09-30 | 2022-04-15 | 华为技术有限公司 | Electronic device, screen projection method thereof and medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116193176A (en) * | 2023-02-13 | 2023-05-30 | 阿波罗智联(北京)科技有限公司 | Screen projection method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2020151599A1 (en) | Method and apparatus for publishing video synchronously, electronic device, and readable storage medium | |
| CN107329717B (en) | Processing method, display method and display system of screen display information | |
| CN110490808B (en) | Picture splicing method, device, terminal and storage medium | |
| CN108681474B (en) | Application preloading method and device, storage medium and terminal | |
| CN105630586A (en) | Information processing method and electronic device | |
| WO2015058623A1 (en) | Multimedia data sharing method and system, and electronic device | |
| CN111625381B (en) | Method, device, equipment and storage medium for reproducing running scene of application program | |
| CN113032766B (en) | Application authority management method and device | |
| CN112585981B (en) | Method for content playback with continuity and electronic device thereof | |
| CN110543502B (en) | Credit data processing method, device, equipment and storage medium based on block chain | |
| CN110581891A (en) | Game data processing method, device, equipment and storage medium based on block chain | |
| CN110278273B (en) | Multimedia file uploading method, device, terminal, server and storage medium | |
| CN114884990A (en) | Screen projection method and device based on virtual screen | |
| CN114816788A (en) | Equipment control method and device, electronic equipment and storage medium | |
| CN114222003A (en) | Service calling method, system, device, equipment and storage medium | |
| CN110532324B (en) | Block chain-based bulletin information display method, device, equipment and storage medium | |
| KR102263977B1 (en) | Methods, devices, and systems for performing information provision | |
| CN112230819B (en) | Information processing method, information processing apparatus, storage medium, and electronic device | |
| CN111726848B (en) | Equipment binding method, target starting device, fixed terminal and storage medium | |
| CN113642010B (en) | Method for acquiring data of extended storage device and mobile terminal | |
| CN111367592B (en) | Information processing method and device | |
| CN107509195B (en) | Data transmission method and device, terminal and readable storage medium | |
| CN104750453A (en) | Information processing method and electronic equipment | |
| CN114100117B (en) | Game loading method, game loading device, computer equipment and storage medium | |
| CN115981576B (en) | Method for sharing data, electronic device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |