JP7352589B2 - Method and apparatus, electronic device, computer readable storage medium and computer program for mirroring - Google Patents

Description

Embodiments of the present invention relate to the field of computer technology, and in particular to methods and apparatus for mirroring, electronic devices, computer-readable storage media, and computer programs.

As people's requirements for travel comfort become higher and higher, traditional front-mounted car electronics can no longer meet people's needs, so smart rearview mirrors gradually enter people's field of view, and people's It has gained recognition in the market by meeting the needs of people on the move, such as navigation, voice, telephone, chat, and drive recorders. Still, in the process of using smart rearview mirrors, it is inevitable that it will bring some inconvenience to users. For example, in the process of using a smart rearview mirror, the screen will always be bright in front of your eyes, which will invalidate the function of the original rearview mirror, which will also affect driving safety.

Embodiments of the invention propose a method and apparatus, an electronic device, a computer readable storage medium and a computer program product for mirroring.

In a first aspect, an embodiment of the present invention includes: generating sub-screen data based on mirroring content of a first display device; generating a virtual display based on the sub-screen data; and displaying the virtual display by transferring the virtual display to a second display device.

In some embodiments, generating sub-screen data based on the content to be mirrored on the first display device includes a page layout of the content to be mirrored based on a screen ratio of the second display device. and creating a virtual display object, generating a display window according to the interface after the page layout is fixed, and associating the display window with the virtual display object to create a subscreen. and obtaining data.

In some embodiments, generating a virtual display based on the sub-screen data includes obtaining a virtual display by rendering a data bearer based on the sub-screen data.

In some embodiments, a first application program is installed on the first display device, a second application program is installed on the second display device, and the first display device and the first display device have a second application program installed therein. The two display devices are communicatively connected via the first application program and the second application program.

In some embodiments, the first application program includes a mirroring service, and the mirroring content is from a mirroring application program integrated with a preset software development kit, and the mirroring content is from a mirroring application program that integrates a preset software development kit. Displaying the data by transmitting it to the second display device includes executing the software development kit to establish a connection channel between the mirroring waiting application program and the first application program; sending the virtual display to the first application program by invoking the mirroring service over a channel.

In some embodiments, displaying the virtual display by transferring the virtual display to the second display device includes encoding the virtual display and transmitting the encoded virtual display via the first application program. and displaying the data by transferring the data to the second application program.

In a second aspect, embodiments of the invention include: a first generation unit arranged to generate sub-screen data based on mirroring content of a first display device; , a second generating unit arranged to generate a virtual display, and a mirroring unit arranged to display the virtual display by transferring it to a second display device. .

In some embodiments, the first generation unit further determines a page layout of the content to be mirrored based on a screen ratio of the second display device, and creates a virtual display object to display the page. A display window is generated according to the interface after the layout is determined, and the display window is arranged to obtain sub-screen data by associating the display window with the virtual display object.

In some embodiments, the second generation unit is further arranged to obtain a virtual display by rendering data bearers based on the sub-screen data.

In some embodiments, a first application program is installed on the first display device, a second application program is installed on the second display device, and the first display device and the first display device have a second application program installed therein. The two display devices are communicatively connected via the first application program and the second application program.

In some embodiments, the first application program includes a mirroring service, the mirroring content is from a mirroring application program integrated with a preset software development kit, and the mirroring unit includes: , further executing the software development kit to establish a connection channel between the mirroring waiting application program and the first application program, and calling the mirroring service via the connection channel to create the virtual display. arranged to transmit to the first application program.

In some embodiments, the mirroring unit further encodes the virtual display and transfers the encoded virtual display to the second application program via the first application program. arranged for display.

In a third aspect, embodiments of the invention include one or more processors and a storage device having one or more programs stored thereon, the one or more programs being executed by the one or more processors. The present invention relates to an electronic device for causing the one or more processors described above to implement the method described in any embodiment of the first aspect.

In a fourth aspect, embodiments of the invention provide a computer-readable medium having a computer program stored thereon, the method comprising: a method as described in any embodiment of the first aspect, when the computer program is executed by a processor; The present invention relates to a computer-readable storage medium that realizes.

In a fourth aspect, embodiments of the invention relate to a computer program product that, when executed by a processor, implements the method described in any embodiment of the first aspect.

The method and apparatus for mirroring according to the above embodiments of the present invention first generate sub-screen data based on content to be mirrored on a first display device. Thereafter, a virtual display to be displayed on the second display device is generated based on the sub-screen data. Finally, the virtual display is displayed by transferring it to a second display device. In the method of this embodiment, screen expansion can be achieved by mirroring the content displayed on the first display device on the second display device.

In order to make other features, objects and advantages of the invention clearer, reference is made to the detailed description of non-limiting embodiments made with reference to the following drawings.

1 is an exemplary system architecture diagram to which an embodiment of the present invention may be applied; FIG. 1 is a flowchart of an embodiment of a method for mirroring according to the present invention. 1 is a schematic diagram illustrating an application scene of the method for mirroring according to the present invention; FIG. 3 is a flowchart of another embodiment of a method for mirroring according to the present invention; 1 is a schematic configuration diagram of an embodiment of a device for mirroring according to the present invention; FIG. 1 is a schematic configuration diagram of a computer system of an electronic device applied to realize an embodiment of the present invention.

Hereinafter, the present invention will be explained in more detail with reference to the drawings and examples. It will be understood that the specific embodiments described herein are for the purpose of illustrating the related invention only and are not intended to limit the invention. Note that, for ease of explanation, only the parts related to the related invention are shown in the drawings.

Note that the embodiments of the present invention and the features in the embodiments can be combined with each other if there is no contradiction. DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described in detail below along with examples with reference to the drawings.

FIG. 1 shows an exemplary system architecture 100 of an embodiment of a method for mirroring or an apparatus for mirroring, in which the present invention may be applied.

As shown in FIG. 1, system architecture 100 may include a first display device 101, 102, a network 103, and a second display device 104. Network 103 is used to provide a communication link medium between terminal equipment 101 , 102 , 103 and server 105 . Network 103 can include various connection types, such as wired, wireless communication links, or fiber optic cables, for example.

The first display device 101, 102 may be any electronic device with a display screen, such as a smart rearview mirror, a smartphone, a smart speaker, etc. Various application programs can be installed on the first display devices 101 and 102, and the first display devices 101 and 102 can display interfaces of the application programs. A user can operate the first display devices 101, 102 via the display screens or buttons of the first display devices 101, 102.

The second display device 104 may be any electronic device with a display screen, such as an in-vehicle terminal, a tablet, a laptop computer, a desktop computer, or the like. Various application programs can also be installed on the second display device 104.

The first display devices 101 and 102 and the second display device 104 may be connected via the network 103 or may be connected via a connection line. The first display devices 101 and 102 can display data on the second display device 104 by transmitting data to the second display device 104.

It should be noted that the method for mirroring according to embodiments of the present invention is generally performed by the first display device 101, 102, and correspondingly, the device for mirroring is generally carried out by the first display device 101, 102. It is placed in the devices 101 and 102.

It should be understood that the numbers of first display devices, networks, and second display devices in FIG. 1 are merely exemplary. Any number of first display devices, networks, and second display devices can be provided as needed.

Continuing to refer to FIG. 2, a flow 200 of one embodiment of a method for mirroring according to the present invention is shown. In this embodiment, a mirroring waiting application program may be installed on the first display device. The mirroring waiting application program may be a video playback application, a music playback application, an image viewing application, or the like. The method for mirroring in this embodiment includes the following steps.

In step 201, sub-screen data is generated based on content waiting to be mirrored on the first display device.

In this embodiment, an entity executing the method for mirroring (for example, the first display devices 101 and 102 shown in FIG. 1) can generate sub-screen data based on the content to be mirrored. The content waiting for mirroring may be display content of an application program installed on the first display device, and may include a display interface, a playback window, etc. of the application program. The sub-screen data may include the content waiting for mirroring, or may include content obtained by processing the content waiting for mirroring. The above processing may include, but is not limited to, adjusting resolution, adjusting display layout, and the like.

In some specific applications, the Presentation class may be utilized to generate sub-screen data when the first display device is an Android operating system. The Presentation class inherits Dialog, has an independent Window, and can display different contents on the auxiliary screen.

The execution entity can realize the generation of sub-screen data by integrating a previously developed SDK (Software Development Kit) into the mirroring waiting application program. By executing the above SDK, the display content of the application program waiting for mirroring can be set as the content waiting for mirroring, and sub-screen data can be generated.

At step 202, a virtual display is generated based on the subscreen data.

In this embodiment, the execution entity may generate the virtual display after generating the sub-screen data. The virtual display may be an independent window or an independent display interface. The virtual display may include sub-screen data and may include buttons or portals for user actions. A user can perform actions on the virtual display, such as turning it off or moving it, through these buttons or portals. Specifically, the execution entity may generate the virtual display by a component in the operating system installed on the first display device. The above components are bearers for processing data displayed on the screen. For the Android operating system, the above components are surface components.

In step 203, the virtual display is displayed by transferring it to a second display device.

In this embodiment, the execution entity can transfer the virtual display to a second display device. In this way, the virtual display can be displayed on the screen of the second display device. The execution entity may transfer the virtual display to the second display device using various communication methods, such as a data line connection method or a wireless connection method. When displaying said second display, the original display can be split into two parts, one used to display the content of said virtual display and the other used to display the content of the original display. I can understand that it is used for Alternatively, the virtual display can float on the original display of the second display device.

Continuing to refer to FIG. 3, FIG. 3 is a schematic diagram illustrating an application scene of the method for mirroring according to the present embodiment. In the application scene of FIG. 3, a smart rearview mirror 301 and a trip computer 302 are installed in a user's car, and a plurality of application programs can be installed on the smart rearview mirror 301 and trip computer 302. The smart rearview mirror 301 and the trip computer 302 both have a display and can display a display interface of an application program. If the display of the smart rearview mirror 301 is always on while the user is driving and displays an image of the front or rear of the vehicle, it may affect the user's driving safety. In this embodiment, steps 201-203 allow the content originally displayed on the smart rearview mirror 301 to be displayed on the display of the trip computer 302, and the display of the smart rearview mirror 301 to be turned off. In this way, the user can view the contents of the smart rearview mirror 301 on the display of the trip computer 302.

The method for mirroring according to the above embodiment of the present invention first generates sub-screen data based on the content to be mirrored on the first display device. Thereafter, a virtual display to be displayed on the second display device is generated based on the sub-screen data. Finally, the virtual display is displayed by transferring it to a second display device. In the method of this embodiment, screen expansion can be achieved by mirroring the content displayed on the first display device on the second display device.

Continuing to refer to FIG. 4, a flow 400 of another embodiment of a method for mirroring according to the present invention is shown. In this embodiment, a first application program is installed on the first display device, a second application program is installed on the second display device, and the first display device and the second display device are connected to each other. A communication connection is established via the first application program and the second application program. The first display device and the second display device can be connected via a USB data line, or can be directly connected via WiFi.

In this embodiment, a preset SDK is integrated into the mirroring waiting application program installed on the first display device, and the SDK is configured to establish a connection between the mirroring waiting application program and the first application program. used for. The first application program may include various services, and the mirroring waiting application program can connect the mirroring waiting application program and the first application by calling various services of the first application program via the connection. Dialogue between programs can be realized.

The first application program and the second application program may be smart connected applications adapted to different terminals, such as MirrorLink (registered trademark), CarPlay (registered trademark), CarLife (registered trademark), Android Auto, etc. . In some specific application scenes, the first application program may be a mobile phone version of CarLife, and the second application program may be a trip computer version of CarLife. Data may be transmitted between the mobile phone version of CarLife and the trip computer version of CarLife via the CarLife transmission protocol, and the data may include audio, video, and instructions. Telephone calls can also be made via the CarLife transmission protocol. The trip computer version of CarLife includes an HMI layer, a protocol layer and a hardware layer. Here, the HMI layer presents CarLife content to the driver, ultimately providing the user with a more convenient and rich driving experience. The protocol layer mainly includes functions such as acquisition of touch screen/physical key information, device discovery and authentication management in CarLife on the trip computer side and CarLife on the mobile phone side, data transmission, video decoding, audio playback and management. . In terms of hardware layer, CarLife on the trip computer side requires hardware support such as USB Host/Wifi, Bluetooth transmission, video decoding, audio playback, etc. Cooperating with the CarLife protocol, we will finally complete the CarLife compatibility function on the trip computer side.

As shown in FIG. 4, the method for mirroring in this embodiment may include the following steps.

In step 401, a page layout of content to be mirrored is determined based on the screen ratio of the second display device, and a virtual display object is created.

The execution entity can first obtain the screen ratio of the second display device. On the market, screen ratios can include 4:3, 5:4, 16:10, 16:9, and 21:9. For trip computers, most screen ratios are 16:9. In the case of smart rearview mirrors, the screen display ratio is almost 24:9. If the application waiting for mirroring is directly mirrored to the trip computer side on the display page of the smart rearview mirror, the effect of the page will be poor and the user experience will be affected. In this embodiment, the page layout of the display content of the application program waiting for mirroring is adjusted according to the screen ratio of the second display device. Specifically, the execution entity can obtain an appropriate ratio by taking a screenshot of the display content of the application program waiting for mirroring.

The execution entity may also create a virtual display object, which is used to capture video or images of the screen. In the object domain, classes and objects are the most basic building blocks of objects as a whole. A class is a collection of abstract concepts and represents a common product, and what is defined within a class are attributes and actions (methods). An object is a type of individual expression, representing an independent individual, and each object has its own attributes, which distinguish different objects. In this embodiment, a virtual display object can be created by a class corresponding to a virtual display.

In the case of the Android operating system, the execution entity can use the Presentation display control to display the content to be displayed on a designated screen. Specifically, the execution entity can create a virtual display object by calling the createVirtualDisplay( ) function of the DisplayManager class of the Presentation display control.

In step 402, a display window is generated according to the interface after the page layout is determined.

In this embodiment, after the page layout of the content to be mirrored is determined, the execution entity can generate a display window according to the interface after the page layout is determined. Specifically, the execution body can make the interface including the page layout the content of the display window, or process the interface and then make it the content of the display window. The above processing may include operations such as compression.

In the case of the Android operating system, the execution entity can generate sub-screens by the Activity application component. Here, Activity provides a screen for interaction. Each Activity gets a display window for drawing its user interface. This display window may fill the screen or be smaller than the screen and float on top of other windows.

At step 403, subscreen data is obtained by associating a display window with a virtual display object.

After obtaining the display window, the execution entity can obtain sub-screen data by associating the display window with a virtual display object. In this way, the execution entity can display videos and images on the screen in the display window. Specifically, the execution body can associate display windows with virtual display objects through the operating system's basic operating functions.

At step 404, a virtual display is obtained by rendering data bearers based on the sub-screen data.

After obtaining the sub-screen data, the execution entity can obtain the virtual display by rendering the data bearer. A data bearer can be understood as a component provided for the display of sub-screen data. When rendering, the execution entity can render the data bearer through the operating system's basic operating functions. Specifically, in the case of the Android operating system, an execution entity can obtain a virtual display by rendering sub-screen data onto a surface control.

In step 405, a software development kit is executed to establish a connection channel between the mirroring waiting application program and the first application program.

The execution entity can execute the software development kit to establish a connection channel between the mirroring waiting application program and the first application program. Specifically, in the case of the Android operating system, the execution entity can establish an AIDL connection between the mirroring waiting application program and the first application program. AIDL is one of the IPC (Inter-Process Communication) methods in Android, and AIDL is an abbreviation for Android Interface Definition Language, and AIDL can realize interaction between two application programs.

The execution entity can send the virtual display from the mirroring waiting application program to the first application program via the iBinder. iBinder is an interface for Android development. This interface is the basic interface for objects that can be remotely controlled. It is defined to provide the core of a high-performance lightweight remote call in providing in-process and out-of-process calls. This interface describes an abstract protocol for interacting with remote objects.

At step 406, the virtual display is sent to the first application program by invoking a mirroring service over the connection channel.

In this embodiment, the first application program includes a mirroring service. For an application program, the service runs in background operation and can be provided to calls to other application programs on the same device without using an interface. By calling service, interaction between application programs is realized. In this embodiment, interaction between the mirroring waiting application program and the first application program can be realized by calling the mirroring service via the connection channel. In this way, the first application program can send the virtual display to the first application program.

In some alternative embodiments of this example, the execution entity may encode the virtual display. Thereafter, the encoded virtual display is transferred to the second application program via the first application program. A second application program can receive and decode the encoded virtual display, and then display the virtual display on a second display device.

Regarding the video displayed by the first display device, the execution entity can obtain a video stream by compressing and encoding the video in H264.

The method for mirroring according to the above embodiment of the present invention includes transmitting the video in the smart rearview mirror to the trip computer side through carlife and displaying it on the trip computer side, thereby realizing screen expansion of the smart rearview mirror. I can do it. At the same time, each application program in the smart rearview mirror can adjust the page layout based on the screen ratio on the trip computer side to improve the user's viewing experience.

With further reference to FIG. 5, as an implementation of the method shown in the above figures, the present invention provides an embodiment of an apparatus for mirroring, which embodiment of the apparatus is adapted to implement the method shown in FIG. Corresponding to the example, the apparatus is specifically applicable to a first display device and a second display device that are communicatively connected, the first display device including a mirroring waiting application program.

As shown in FIG. 5, an apparatus 500 for mirroring according to the present embodiment includes a first generation unit 501, a second generation unit 502, and a mirroring unit 503.

The first generation unit 501 is arranged to generate sub-screen data based on the mirroring content of the first display device.

The second generation unit 502 is arranged to generate a virtual display based on the sub-screen data.

Mirroring unit 503 is arranged to display the virtual display by transferring it to a second display device.

In some alternative embodiments of the present example, the first generation unit 501 further determines the page layout of the content to be mirrored based on the screen ratio of the second display device, and generates the virtual display object. and arranged to obtain sub-screen data by generating a display window and associating the display window with a virtual display object according to the interface after the page layout is finalized.

In some alternative embodiments of the present example, the second generation unit 502 is further arranged to obtain the virtual display by rendering the data bearer based on the sub-screen data.

In some alternative embodiments of this example, the first display device has a first application program installed, the second display device has a second application program installed, and the first display device has a first application program installed therein. The device and the second display device are communicatively connected via the first application program and the second application program.

In some alternative embodiments of the present example, the first application program includes a mirroring service, and the mirroring content is from a mirroring application program with an integrated preset software development kit. , the mirroring unit 503 further executes a software development kit to establish a connection channel between the mirroring waiting application program and the first application program, and to create the virtual display by invoking the mirroring service via the connection channel. arranged to transmit to a first application program;

In some optional embodiments of the present example, the mirroring unit 503 further encodes the virtual display and transfers the encoded virtual display to the second application program via the first application program. This will arrange it for display.

It should be understood that the units 501 to 503 described in the apparatus 500 for mirroring each correspond to a step in the method described with reference to FIG. 2. Therefore, the operations and features described for the method for mirroring above apply equally to the apparatus 500 and the units included therein, and will not be described here.

Hereinafter, with reference to FIG. 6, a schematic configuration diagram of an electronic device (for example, the first electronic device shown in FIG. 1) 600 applied to realize the embodiment of the present disclosure is shown. Terminal devices in embodiments of the present disclosure include, but are not limited to, mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), and the like. The electronic device shown in FIG. 6 is merely an example and is not intended to limit the functionality and scope of use of embodiments of the present disclosure.

As shown in FIG. 6, the electronic device 600 performs various appropriate operations and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded into a random access memory (RAM) 603 from a storage unit 608. A processing device (eg, a central processing unit, a graphics processor, etc.) 601 can be included. The RAM 603 stores various programs and data necessary for operating the electronic device 600. Processing device 601, ROM 602, and RAM 603 are interconnected by bus 604. An input/output (I/O) interface 605 is also connected to bus 604.

Typically, the I/O interface 605 includes an input device 606 including, for example, a touch screen, a touch panel, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyro, etc., and an input device 606 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc. An output device 607, a storage device 608, and a communication device 609 are connected. Communication device 609 can allow electronic device 600 to wirelessly or wiredly communicate with other devices to exchange data. Although FIG. 6 depicts an electronic device 600 having various devices, it should be understood that it is not required to implement or include all illustrated devices. Alternatively, more or fewer devices may be implemented or included. Each block shown in FIG. 6 may represent one device, or may represent multiple devices as necessary.

In particular, according to embodiments of the present disclosure, the processes described with reference to the flowcharts above may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product that includes a computer program carried on a computer readable medium, the computer program including program code for performing the method illustrated in the flowcharts. In such illustrative examples, the computer program may be downloaded and installed from a network via communication device 609 , installed from storage device 608 , or installed from ROM 602 . When this computer program is executed by the processing device 601, it performs the above limited functions in the method of the embodiments of the present disclosure. It should be noted that a computer readable medium described in embodiments of the present disclosure may be a computer readable signal medium, a computer readable storage medium, or any combination of both. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of computer readable storage media include an electrical connection through one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read only memory (ROM), erasable programmable read only memory. (EPROM or flash memory), fiber optics, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any combination of the above. In embodiments of the present disclosure, a computer-readable storage medium can be any tangible medium that contains or stores a program that is used by or in combination with an instruction execution system, apparatus, or device. can be used. In embodiments of the present disclosure, a computer readable signal medium may include a data signal propagated in baseband or as part of a carrier wave carrying a computer readable program code. Such propagated data signals can take many different forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium that is used by or in combination with a command execution system, apparatus, or device. may send, propagate or transmit programs for the purpose of Program code contained in a computer-readable medium can be transmitted over any suitable medium, including, but not limited to, wire, fiber optic cable, RF (radio frequency), etc., or any suitable combination of the above. Not exclusively.

The computer readable medium may be included in the electronic device or may exist separately and not be integrated into the electronic device. The computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device executes a process based on the content to be mirrored on the first display device. , generate sub-screen data, generate a virtual display based on the sub-screen data, and display the virtual display by transferring it to a second display device.

Computer program code for performing operations of embodiments of the present disclosure may be written in one or more programming languages or combinations thereof, including Java(R), Smalltalk(R), Includes object-oriented programming languages such as C++, as well as traditional procedural programming languages such as the "C" language or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a single software package, partially on the user's computer and partially on a remote computer, or completely on a remote computer or computer. Can be executed on the server. When referring to a remote computer, the remote computer can be connected to the user's computer via any type of network, including a local area network (LAN) or wide area network (WAN), or can be connected to an external computer. can be connected (e.g., via the Internet using an Internet service provider).

The flowcharts and block diagrams in the figures illustrate possible architectures, functionality, and operation of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, segment of programming, or portion of code, and the module, segment of programming, or portion of code implements a predetermined logic function. Contains one or more executable instructions to do the following: It should also be noted that in some alternative embodiments, the functions shown in the blocks may occur out of the order shown in the figures. For example, two blocks shown in succession may actually be executed in parallel, or they may sometimes be executed in reverse order depending on the functionality thereof. Each block in the block diagrams and/or flowcharts, and combinations of blocks in the block diagrams and/or flowcharts, may be implemented by a system with dedicated hardware to perform particular functions or operations, or with dedicated hardware and a computer. It should also be noted that it may also be implemented by a combination of instructions.

A unit according to an embodiment of the present disclosure may be realized by software or hardware. The described unit may be installed in a processor, and may be described, for example, as "a processor including a first generation unit, a second generation unit, and a mirroring unit." Here, in some cases, the names of these units do not limit the units themselves, and for example, the first generation unit may be described as "a unit that generates sub-screen data."

The above description is merely an illustration of the preferred embodiments of the disclosure and the principles of the applied technology. If the scope of the invention according to the embodiments of the present disclosure is not limited to a technical solution obtained by combining the above technical features, and at the same time does not depart from the concept of the above invention, Those skilled in the art should understand that other technical solutions obtained by arbitrarily combining equivalent technical features are also included. For example, there may be a technical solution in which the above-mentioned features are interchanged with technical features having functions similar to (but not limited to) those disclosed in the embodiments of the present disclosure.
The scope of claims originally filed is as follows.
Claim 1:
Generating sub-screen data based on content waiting to be mirrored on the first display device;
generating a virtual display based on the sub-screen data;
displaying the virtual display by transferring the virtual display to a second display device;
Methods for mirroring, including:
Claim 2:
Generating sub-screen data based on content waiting to be mirrored on the first display device includes:
determining a page layout of the content to be mirrored and creating a virtual display object based on a screen ratio of the second display device;
Generating a display window according to the interface after the page layout is finalized;
obtaining subscreen data by associating the display window with the virtual display object;
2. The method of claim 1, comprising:
Claim 3:
Generating a virtual display based on the sub-screen data comprises:
The method of claim 1, comprising obtaining a virtual display by rendering a data bearer based on the sub-screen data.
Claim 4:
A first application program is installed on the first display device, a second application program is installed on the second display device, and the first display device and the second display device are connected to each other. 2. The method of claim 1, communicatively coupled via a first application program and the second application program.
Claim 5:
the first application program includes a mirroring service, the mirroring content is from a mirroring application program integrated with a preset software development kit;
Displaying the virtual display by transferring the virtual display to the second display device comprises:
executing the software development kit to establish a connection channel between the mirroring waiting application program and the first application program;
sending the virtual display to the first application program by invoking the mirroring service via the connection channel;
5. The method of claim 4, comprising:
Claim 6:
Displaying the virtual display by transferring the virtual display to the second display device comprises:
6. The method of claim 5, comprising encoding the virtual display and displaying the encoded virtual display by transferring the encoded virtual display to the second application program via the first application program.
Claim 7:
a first generation unit arranged to generate sub-screen data based on mirroring content of the first display device;
a second generation unit arranged to generate a virtual display based on the sub-screen data;
a mirroring unit arranged to display by transferring said virtual display to a second display device;
equipment for mirroring, including;
Claim 8:
The first generation unit further includes:
determining a page layout of the content to be mirrored and creating a virtual display object based on a screen ratio of the second display device;
Generate a display window according to the interface after the page layout is finalized,
obtaining subscreen data by associating the display window with the virtual display object;
8. The device according to claim 7, wherein the device is arranged as follows.
Claim 9:
The second generation unit further includes:
8. The apparatus according to claim 7, arranged to obtain a virtual display by rendering data bearers based on the sub-screen data.
Claim 10:
A first application program is installed on the first display device, a second application program is installed on the second display device, and the first display device and the second display device are connected to each other. 8. The apparatus of claim 7, communicatively coupled via a first application program and the second application program.
Claim 11:
the first application program includes a mirroring service, the mirroring content is from a mirroring application program integrated with a preset software development kit;
The mirroring unit further includes:
executing the software development kit to establish a connection channel between the mirroring waiting application program and the first application program;
sending the virtual display to the first application program by calling the mirroring service via the connection channel;
11. The apparatus of claim 10, wherein the apparatus is arranged as follows.
Claim 12:
The mirroring unit further includes:
12. The apparatus of claim 11, arranged to encode the virtual display and display the encoded virtual display by transferring the encoded virtual display to the second application program via the first application program. .
Claim 13:
one or more processors;
a storage device in which one or more programs are stored;
including;
An electronic device that causes the one or more processors to implement the method of any one of claims 1 to 6 when the one or more programs are executed by the one or more processors.
Claim 14:
A computer readable medium storing a computer program,
A computer readable medium implementing the method of any one of claims 1 to 6 when the computer program is executed by a processor.
Claim 15:
A computer program that, when executed by a processor, implements a method according to any one of claims 1 to 6.

Claims (11)

generating sub-screen data based on mirroring-waiting content of a smart rearview mirror, the sub-screen data including at least one of resolution adjustment and display layout processing for the mirroring-waiting content; contains content obtained by executing
generating a virtual display based on the sub-screen data;
displaying said virtual display by transferring it to the trip computer and turning off the display of the smart rearview mirror;
including;
the trip computer display is configured to have a first portion displaying content of the virtual display and a second portion displaying content of the trip computer original display;
Generating sub-screen data based on mirroring content of the smart rearview mirror includes:
Based on a screen ratio of the trip computer, determining a page layout of the content to be mirrored and creating a virtual display object by screenshotting the display content of the application program to be mirrored at a ratio suitable for the screen ratio; wherein the virtual display object is used to capture a video or image of a screen; and
Generating a display window according to the interface after the page layout is finalized;
Obtaining subscreen data by associating the display window with the virtual display object , and generating a virtual display based on the subscreen data, generating a data bearer based on the subscreen data. obtaining a virtual display by rendering; and
How to do smart rearview mirroring . A first application program is installed on the smart rearview mirror, a second application program is installed on the trip computer, and the smart rearview mirror and the trip computer are connected to the first application program and the second application program. The method of claim 1, communicatively coupled via an application program. the first application program includes a mirroring service, the mirroring content is from a mirroring application program integrated with a preset software development kit;
Displaying the virtual display by transmitting it to the trip computer comprises:
executing the software development kit to establish a connection channel between the mirroring waiting application program and the first application program;
and transmitting the virtual display to the first application program by invoking the mirroring service over the connection channel. Displaying the virtual display by transmitting it to the trip computer comprises:
4. The method of claim 3 , comprising encoding the virtual display and displaying the encoded virtual display by transferring the encoded virtual display to the second application program via the first application program. A system for mirroring a smart rearview mirror,
Equipped with a trip computer and smart rearview mirror.
The smart rearview mirror is
a first generation unit arranged to generate sub-screen data based on mirroring content of the smart rearview mirror, the sub-screen data including resolution adjustment and a first generation unit containing content obtained by performing at least one process in the display layout;
a second generation unit arranged to generate a virtual display based on the sub-screen data;
a mirroring unit arranged to display said virtual display by transmitting it to a trip computer;
including;
the trip computer display is configured to have a first portion displaying content of the virtual display and a second portion displaying content of the trip computer original display;
The first generation unit further includes:
determining a page layout of the content to be mirrored and creating a virtual display object by screenshotting the display content of the application program to be mirrored at a ratio suitable for the screen ratio based on the screen ratio of the trip computer; where the virtual display object is used to obtain a video or image of the screen;
Generate a display window according to the interface after the page layout is finalized,
sub-screen data is obtained by associating the display window with the virtual display object, wherein the second generating unit further generates a virtual display by rendering a data bearer based on the sub-screen data. arranged so as to obtain
A system for mirroring smart rearview mirrors . A first application program is installed on the smart rearview mirror, a second application program is installed on the trip computer, and the smart rearview mirror and the trip computer are connected to the first application program and the second application program. 6. The system of claim 5 , communicatively coupled via an application program. the first application program includes a mirroring service, the mirroring content is from a mirroring application program integrated with a preset software development kit;
The mirroring unit further includes:
executing the software development kit to establish a connection channel between the mirroring waiting application program and the first application program;
7. The system of claim 6 , arranged to send the virtual display to the first application program by invoking the mirroring service via the connection channel. The mirroring unit further includes:
8. The system of claim 7 , wherein the system is arranged to encode the virtual display and display the encoded virtual display by transferring the encoded virtual display to the second application program via the first application program. . one or more processors;
a storage device having one or more programs stored thereon;
An electronic device that causes the one or more processors to implement the method according to any one of claims 1 to 4 when the one or more programs are executed by the one or more processors. A computer readable medium storing a computer program,
A computer readable medium implementing the method of any one of claims 1 to 4 when the computer program is executed by a processor. 5. A computer program that, when executed by a processor, implements a method according to any one of claims 1 to 4 .