JP7266635B2 - Screen switching display method, device, smart rearview mirror and readable storage medium - Google Patents

Description

The present application relates to computer technology, and more particularly to the field of automotive Internet technology.

Current smart cars are generally equipped with smart rearview mirrors. The smart rearview mirror has an independent operating system that allows users to install application programs provided by third-party providers, such as software, games, navigation, etc., and display content provided by the application programs on the screen of the smart rearview mirror. .

In order to make it easier for the driver to see the content provided by the application program in the smart rearview mirror while driving, it may be necessary to display it on the screen of the smart rearview mirror itself, and the contents of the smart rearview mirror In some cases, it may be necessary to project the image onto another in-vehicle terminal, such as an in-vehicle infotainment screen, and display it on the screen of another in-vehicle terminal. It is necessary to switch and display the content provided by the application program in the smart rearview mirror on the screen of the smart rearview mirror and the screen of another in-vehicle terminal.

When the smart rearview mirror switches screens while a specific application program is running, the default interface is displayed on the switched screen, the display data of the application program is forcibly interrupted, and the display data is lost. Affect user experience.

Embodiments of the present application provide a screen switching display method, apparatus, smart rearview mirror and readable storage medium that ensure application program display consistency after screen switching.

According to a first aspect, an embodiment of the present application provides, during execution of a target application program, storing display data for a current screen of said target application program; determining a switched display state including a mirrored display state and a local display state; determining a target display style that matches the switched display state; and switching based on the target display style. and a step of displaying the display data on the displayed screen.

According to a second aspect, embodiments of the present application include the steps of obtaining data to be displayed for a target application program; obtaining a current display state including a mirroring display state and a local display state; determining a target display style that matches the display state of; and displaying the data to be displayed on a screen corresponding to the current display state based on the target display style. provide a way.

According to a third aspect, an embodiment of the present application provides, during execution of a target application program, a display data storage module for storing display data on a current screen of the target application program, and a screen switching signal. a display state determination module, responsive to monitoring, for determining a switched display state including a mirroring display state and a local display state; and for determining a target display style that matches the switched display state. A screen switching display device is provided, comprising: a target display style determination module; and a display data display module for displaying the display data on the switched screen based on the target display style.

According to a fourth aspect, embodiments of the present application provide a display data acquisition module for acquiring data to display of a target application program, and a current display state including a mirror display state and a local display state. a current display state acquisition module for obtaining; a target display style determination module for determining a target display style matching the current display state; and the data to be displayed based on the target display style. and a display module for displaying data to be displayed on a screen corresponding to a current display state.

According to a fifth aspect, embodiments of the present application provide a smart rearview mirror, said smart rearview mirror comprising at least one processor and memory communicatively coupled to said at least one processor, said The memory stores an instruction executable by the at least one processor, and the instruction causes the at least one processor to perform the screen switching display according to any one of the first aspect and the second aspect. executed by the at least one processor to enable the method to be performed.

According to a sixth aspect, embodiments of the present application provide a non-transitory computer-readable storage medium storing computer instructions, said computer instructions instructing said computer to perform the steps of the first aspect and the second aspect. It is used to execute the screen switching display method according to any one of the aspects.

According to a seventh aspect, embodiments of the present application provide a computer program product, wherein said computer instructions, when executed on a computer, cause said computer to perform any one of the first aspect and the second aspect. It is used to execute the screen switching display method described in the item.

The technology of the present application solves the technical problem that the display data of the application program is interrupted and lost after the screen is switched, and ensures the consistency of the data display of the application program after the screen is switched. , improve the user experience.

It should be noted that the content described in this section is not intended to limit key features or critical features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easier to understand with the following specification.

The drawings are for better understanding of the present technical solution and do not limit the present application.
4 is a schematic flow chart of a first screen switching display method according to an embodiment of the present application; 6 is a schematic flow chart of a second screen switching display method according to an embodiment of the present application; 10 is a schematic flow chart of a third screen switching display method according to an embodiment of the present application; FIG. 11 is a schematic flow chart of a fourth screen switching display method according to an embodiment of the present application; FIG. 1 is a screen display schematic diagram of a smart rearview mirror according to an embodiment of the present application; FIG. 1 is a schematic diagram of a screen display of an in-vehicle infotainment system according to an embodiment of the present application; FIG. FIG. 11 is a schematic flow chart of a fifth screen switching display method according to an embodiment of the present application; FIG. 4 is a flowchart of screen switching display according to an embodiment of the present application; 1 is a schematic configuration diagram of a screen switching display device according to an embodiment of the present application; FIG. FIG. 10 is a schematic configuration diagram of another screen switching display device according to an embodiment of the present application; 1 is a block diagram of a smart rearview mirror with a screen switching display method according to an embodiment of the present application; FIG.

Illustrative embodiments of the present application are described below with reference to the drawings, and various details of the embodiments of the present application are included for ease of understanding and should be considered as exemplary only. is. Accordingly, it should be understood by those skilled in the art that various changes and modifications can be made to the examples described herein without departing from the scope and spirit of the present application. Similarly, for the sake of clarity and brevity, the following description omits descriptions of well-known functions and constructions.

According to an embodiment of the present application, FIG. 1 is a schematic flow chart of a first screen switching display method according to an embodiment of the present application. This is applied when displaying content provided by an application program by switching between the screen of the smart rearview mirror and the screen of another in-vehicle terminal. Other in-vehicle terminals are terminals other than smart rearview mirrors among all in-vehicle terminals in smart cars, including but not limited to in-vehicle infotainment, fingerprint readers, identity recognition devices and driving behavior analysis devices, etc. Other in-vehicle terminals are required to have a screen and be able to communicate with a smart rearview mirror.

The method may be performed by a screen switching display device, which may be implemented in the form of software and/or hardware, and may be integrated into a smart rearview mirror.

As shown in FIG. 1, the screen switching display method according to the present embodiment may include the following steps.

S110: During the execution of the target application program, store the display data of the current screen of the target application program.

The target application program may be any application program installed in the smart rearview mirror, such as a voice assistant, audio-video or game application program. The current screen may be the screen of a smart rearview mirror or the screen of another in-vehicle terminal, such as an in-vehicle infotainment screen. Take the in-vehicle infotainment as an example, after the smart rearview mirror establishes the connection relationship with the in-vehicle infotainment, the display data of the target application program switches from the smart rearview mirror screen to the in-vehicle infotainment screen, at this time the current is the in-vehicle infotainment screen, the screen of the smart rearview mirror closes or displays the screen saver, after the smart rearview mirror disconnects the in-vehicle infotainment and the connection relationship, the display data of the target application program is displayed on the vehicle Switch from the infotainment screen to the smart rearview mirror screen, at this time the current screen is the smart rearview mirror screen, and the car infotainment screen closes or displays the screensaver.

When the smart rearview mirror runs the target application program, it stores the current screen display data of the target application program in real time. For example, after the user logs into the game application program, the display data is the login information, images, etc. in the game interface displayed on the current screen. Selectably, the smart rearview mirror may memorize all display data of the current screen during execution of the target application program, or only memorize the most recent display data of the current screen of the target application program. may cover historical data.

S120: Determining a switched display state, including a mirroring display state and a local display state, in response to monitoring the screen switching signal.

The user can switch screens by disconnecting or establishing a connection relationship between the smart rearview mirror and another in-vehicle terminal. Optionally, the in-vehicle infotainment can connect with the smart rearview mirror via USB (Universal Serial Bus) to realize data exchange. Based on this, the user can switch screens by plugging and unplugging the USB interface.

Taking the in-vehicle infotainment as an example, both the smart rearview mirror and the in-vehicle infotainment are installed with an application program for data transmission. Trigger the activation of the application program for transmission and prepare for data transmission. After the application program for data transmission in the smart rearview mirror is activated, it sends a screen switching signal from the smart rearview mirror to the in-vehicle infotainment. Correspondingly, when the USB connection between the smart rearview mirror and the in-vehicle infotainment is interrupted, it triggers the application program for data transmission to terminate. Before the application program for data transmission in the smart rearview mirror is terminated, a screen switching signal is sent from the in-vehicle infotainment to the smart rearview mirror.

Selectably, the smart rearview mirror determines the switched display state and the switched screen after receiving the screen switching signal, ie, in response to monitoring the screen switching signal. Note that the display state in this embodiment is the display state of the smart rearview mirror, and when a screen switching from the smart rearview mirror to the in-vehicle infotainment is received, that is, a notification of screen switching from the smart rearview mirror to the in-vehicle infotainment is received. is received, the smart rearview mirror switches to the mirroring display state, the switched screen is the in-vehicle infotainment, and the screen switching from the in-vehicle infotainment to the smart rearview mirror is monitored, that is, from the in-vehicle infotainment to the smart Upon receiving the screen switching notification to the rearview mirror, the smart rearview mirror is switched to the local display state, and the switched screen is the smart rearview mirror.

Note that this embodiment is applied when monitoring screen switching during execution of the target application program, and determines a target display style that matches the switched display state in order to avoid interruption of the application program. and the display data should be displayed on the switched screen based on the target display style. In contrast, when the target application program is not running, e.g., when the desktop is displayed or waiting, monitoring screen transitions means that there is no valid display data, so subsequent steps need not be performed. .

S130: Determine a target display style that matches the switched display state.

Based on the above description, the switched display state indicates which screen to display after being switched, and different screens have different resolutions, so as not to affect normal viewing. should determine a display style that adapts to the resolution. Of course, even if the two screens that are switched to each other have the same resolution, the display style can be determined based on parameters such as screen mounting position, display performance, and so on.

In this embodiment, the display state has a corresponding relationship with the display style. If the switched display state is the local display state and the switched screen is the smart rearview mirror screen, the target display style that matches the local display state should be the style that matches the smart rearview mirror screen. . If the switched display state is the mirroring display state and the switched screen is the screen of another in-vehicle device, the target display style that matches the mirroring display state should be the style that matches the screen of the other in-vehicle device. is. For convenience of description and distinction, the display style that matches the switched display state is called the target display style. Selectably, the target display style includes the format of display data (eg, text or images), page layout and trigger locations and effects on display data, and the like.

S140: Display the display data on the switched screen based on the target display style.

When the current screen is the screen of the in-vehicle infotainment and the switched screen is the screen of the smart rearview mirror, the smart rearview mirror renders and displays the stored display data on the local screen in the target display style. . If the current screen is the smart rearview mirror screen and the switched screen is the in-vehicle infotainment screen, the display data is displayed on the in-vehicle infotainment screen according to the target display style.

Embodiments of the present application provide a data source for switched screens by storing the display data of the current screen of the target application program while the target application program is running, and the display data of the target application program is Adapts to the screen to which the target display style has been switched by ensuring that it is not interrupted and displaying the display data based on the target display style that matches the switched display state, and adapts the display data to the screen to which it was switched. ensure that it is displayed clearly, completely and beautifully; Therefore, this embodiment solves the technical problem that the display data of the application program is interrupted and lost after the screen is switched, ensures the consistency of the data display of the application program after the screen is switched, Improve user experience and display clarity, completeness and aesthetics.

According to an embodiment of the present application, FIG. 2 is a schematic flow chart of a second screen switching display method according to an embodiment of the present application, and this embodiment is an optimization of the above embodiment.

Selectably, the action "determine a target display style that matches the switched display state" is changed to "if the switched display state does not match the current display style of the display data, then the switched display state Create a target display style that matches the display state" and provides a method for determining the target display style.

Selectably, the action "display the display data on the switched screen based on the target display style" is changed to "render the display data based on the target display style in the smart rearview mirror." , generate video data, and send the video data to the in-vehicle infotainment so that the in-vehicle infotainment displays the video data on a screen of the in-vehicle infotainment, based on the display style. Applies to in-vehicle infotainment that does not have the ability to display data by

As shown in FIG. 2, the screen switching display method according to the present embodiment may include the following steps.

S210: During the execution of the target application program, store the display data of the current screen of the target application program.

S220: Determining a switched display state, including a mirroring display state and a local display state, in response to monitoring the screen switching signal.

S230: Determine whether the switched display state matches the current display style of the display data, and if matched, that is, if the switched display state matches the current display style of the display data, go to S231. However, if there is no matching, that is, if the switched display state does not match the current display style of the display data, the process proceeds to S232.

S231: Display the display data on the switched screen based on the current display style. This action ends.

S232: Create a target display style that matches the switched display state. Furthermore, S233 is executed.

In one embodiment, the target display style is created based on the resolution of the switched screen. Moreover, after creating the target display style, destroy the current display style and the display interface on the current screen to free up the storage space. After the current screen display interface is discarded, the default interface is used instead. For example, if the default interface is the default menu interface, the display state of the screen of the smart rearview mirror switches from the local display state to the mirroring display state, and the mirroring display state does not match the current display style, the current display interface Discard and display the default menu interface, so that after the screen of the smart rearview mirror is switched, the display data will not be displayed further, avoiding the display data leakage, protecting the user's privacy, and allowing the user to To increase security by preventing others from manipulating display data on a current screen when using a switched screen.

In one application scenario, assuming that the local display state matches display style A, the mirroring display state matches display style B; In some cases, the switched display state is the mirroring display state, and the current display style is display style A, so matching is not possible. Discard the display interface of the smart rearview mirror and display the default menu interface. otherwise, the switched presentation state is the mirroring presentation state, the current presentation style is presentation style B, the switched presentation state matches the current presentation style, and the presentation style B is the target presentation style; Discard the display interface of the smart rearview mirror and display the default menu interface. In the other case, the display state that was switched is the local display state, and the current display style is display style B, so matching is not possible, and a display style A that matches the local display state is created, and the display style Discard the B and in-vehicle infotainment display interfaces and display the default menu interface. otherwise, the switched presentation state is the local presentation state, the current presentation style is presentation style A, the switched presentation state matches the current presentation style, and presentation style A is the target presentation style; Discard the in-vehicle infotainment display interface and display the default menu interface.

S233: Display the display data on the switched screen based on the target display style.

In an application scene, the other in-vehicle terminal is the in-vehicle infotainment, the current screen is the smart rearview mirror screen, and the switched screen is the in-vehicle infotainment screen. Based on this, the smart rearview mirror renders the display data based on the target display style to generate video data, and the in-vehicle infotainment displays the video data on an in-vehicle infotainment screen. and transmit the video data to the in-vehicle infotainment.

Specifically, the smart rearview mirror renders the display data based on the target display style on its auxiliary screen to generate video data, the auxiliary screen of the smart rearview mirror is invisible to the user, and the video In order to project data to multiple types of on-board terminals, the resolution of the auxiliary screen must be higher than that of all on-board terminals. The video data includes at least one video frame each corresponding to a current screen display page of the display data. For example, display data renders the display data based on the target display style to generate one video frame if there is only one display page in the current interface. The video data is then encoded and sent to the in-vehicle infotainment. In-vehicle infotainment is a style in which after receiving encoded video data, it is decoded to obtain video data, and the obtained video data is matched with the in-vehicle infotainment screen. Video data can be displayed directly on the in-vehicle infotainment screen without adjusting the style.

In this embodiment, the smart rearview mirror renders the display data to generate video data, which can be directly displayed by the in-vehicle infotainment, reducing the operation process of the in-vehicle infotainment, and the screen switching display. and is applied to in-vehicle infotainment that does not have the ability to display data based on display style.

In this embodiment, the screen is switched while the target application program is running, and if the switched display state does not match the current interface style of the display data, the old display style is no longer used and the switched display state is matched. Create and create a target display style to ensure the matching between the display style and the display state, so that the display data can be displayed clearly and completely on the switched screen, improving the user experience.

According to an embodiment of the present application, FIG. 3 is a schematic flow chart of a third screen switching display method according to an embodiment of the present application. In particular, dynamic proxies can be used to perform display state determination, target display style determination, and display actions.

As shown in FIG. 3, the screen switching display method according to the present embodiment may include the following steps.

S310: Store the display data of the current screen of the target application program during execution of the target application program.

S320: Determine the switched display state, including the mirrored display state and the local display state, by the dynamic proxy in response to monitoring the screen switching signal.

S330: Determine by the dynamic proxy a target presentation style that matches the switched presentation state.

S340: Displaying the display data on the switched screen by the dynamic proxy based on the target display style.

In the present embodiment, a reflection mechanism is used to dynamically create dynamic proxies when responding to monitoring screen switching signals. The dynamic proxy is used to proxy the current display object in the smart rearview mirror. The display object is used to display the display data on the corresponding screen according to the default display style (smart rearview mirror display style or other in-vehicle terminal display style). After the screen is switched, continue to display the data in the old display style, or use the old display style and go back to display the default interface. In this embodiment, when monitoring screen switching during execution of the target application program, the dynamic proxy executes the operations of S320 to S340 instead of the display object. Correspondingly, the actions that the dynamic proxy proxies are those of S320-S340.

In addition, in this embodiment, a dynamic proxy is created only for the target application program that may cause display interruption, and the dynamic proxy executes the above operation without affecting the current display object. For other application programs installed in the smart rearview mirror that have no possibility of display interruption, there is no need to create a dynamic proxy and can still be displayed normally through the current display object. For example, a map image of a city with display data in a map application program, and after the screen is switched, without making any style adjustments to the map image, to adapt to the switched screen. will automatically scale the map of the city proportionally. Thus, the present embodiment performs the operations described above by a dynamic proxy instead of the display object, and the code is easily implemented without revising the operation position of the display object. Also, it does not affect the normal display of other application programs.

According to an embodiment of the present application, FIG. 4a is a schematic flow chart of a fourth screen switching display method according to an embodiment of the present application, which is a further optimization of the above embodiment.

Selectably, the operation "determine a target display style that matches the switched display state" can be changed to "determine a display style candidate that matches the switched display state from pre-stored display styles, and If there are two or more display style candidates, obtain the resolution of the switched screen, and screen from the display style candidates for a target display style that adapts to the switched screen resolution. , to improve the efficiency of determining the target display style and further improve the display efficiency.

Selectable is the action "Store data displayed on the current screen of said target application program while the target application program is running" changed to "While the voice application program is running, on the current screen of the voice application program correspondingly subdivides the action "determine a target presentation style that matches said switched presentation state" into "a text format that matches said switched presentation state, and a text "Determine the trigger position and trigger effect of", limit the target application program to the voice application program, and subdivide the display style of the interactive text.

As shown in FIG. 4a, the screen switching display method according to the present embodiment may include the following steps.

S410: During execution of the voice application program, store the dialogue text on the current screen of the voice application program.

During execution of the voice application program, the user speaks to the voice application program, and after the voice application program recognizes the user's voice, response content is generated. The text corresponding to the user's voice and/or response content is called interactive text and is displayed on the current screen, so it can be seen that the interactive text is the display data on the current screen.

Selectably, during execution of the voice application program, the most recently generated set of interactive text between the user and the voice application program is stored in real time. Specifically, one node is used to store a set of dialogue text, and the new node is used in place of the old node, thereby leaving the newest node, i.e., storing the most recent set of dialogue text. ensure that

FIG. 4b is a screen display schematic diagram of a smart rearview mirror according to an embodiment of the present application. An interactive interface of a voice application program containing a set of interactive text is displayed on the screen. Specifically, the user speaks "Please display Zhang San's phone number" to the voice application program, the speech is displayed in text format on the current screen, and Zhang San's phone number is displayed. do. In addition, the node stores the text corresponding to the voice uttered by the user and the text corresponding to the response content, "Zhang San's phone number". After this, when the user makes another voice saying "Please display Li Si's phone number", in addition to the previously displayed data, the following dialog text "Display Li Si's phone number" is displayed. Please" and Li Si's phone number can be displayed. However, when memorizing, it is necessary to cover the historical dialogue text with the subsequent dialogue text, i.e., "Please display Li Si's phone number" and only remember Li Si's phone number, with less display data. The amount of storage is used, thereby reducing the data display amount for which the screen is switched, and improving the efficiency of screen switching.

S420: Determining a switched display state, including a mirroring display state and a local display state, in response to monitoring the screen switching signal.

S430: Determining the text format matching the switched display state, and the text trigger position and trigger effect.

The display data is interactive text whose display style includes text formatting and text trigger locations and trigger effects. The text format may be the font of the text, word spacing, line spacing, etc., the trigger position of the text may be the trigger position of actions such as selection, jumping and revision to the text, and the trigger effect may be Visual effects when performing actions such as selecting, jumping and revising text, such as highlighting, font enlargement, focus state, etc.

Selectably, the smart rearview mirror can pre-store at least one display style (ie, text format and text trigger position) that matches the switched display state. Each display style corresponds to a different resolution. After determining the switched display state, display style candidates that match the switched display state can be determined from pre-stored display styles. When there are two or more display style candidates, obtaining the resolution of the switched screen, and screening a display style adapted to the switched screen resolution from the display style candidates as a target display style. can be done. If there is only one display style candidate, the display style candidate is directly taken as the target display style.

Exemplarily, the smart rearview mirror pre-stores display style 1, display style 2, and display style 3 adapted to resolutions A×B, 2A×B, and A×2B, respectively, and the display styles are text format and text format. including the trigger position of Display style matches the local display state, and display style 2 and display style 3 match the mirror display state. The resolution of the smart rearview mirror is A×B, the resolution of the in-vehicle infotainment 1 is 2A×B, and the resolution of the in-vehicle infotainment 2 is A×2B. When the switched display state is the mirroring display state, it is determined that the display style candidates include display style 2 and display style 3, and further, when the switched screen is the screen of the in-vehicle infotainment 1, the display style is determined. 2 is the target display style, and if the switched screen is the screen of the in-vehicle infotainment 2, the display style 3 is the target display style.

S440: Display the interactive text on the switched screen according to the text format and the trigger position and trigger effect of the text.

In Fig. 4b, the screen resolution of the smart rearview mirror is A x B, and the current display style of the interactive text is font size No. 4, word spacing 0.3 points, single line spacing, select to text, jump and revise. and trigger effects matching font size, word spacing and line spacing. FIG. 4b shows the highlight triggering effect when performing a selection action on a phone number.

FIG. 4c is a schematic diagram of an in-vehicle infotainment screen display according to an embodiment of the present application. The screen resolution of the smart rearview mirror is 2A×B, the target display style of the dialogue text includes a font size of 15pt, a word spacing of 0.4 points, and a line spacing of 1.5 lines, and the trigger position is the display position of the dialogue text. , and the trigger effect should match the font size, word spacing, and line spacing of the target display style. FIG. 4c is the highlight trigger effect when performing a selection action on the text, the highlight range being wider and longer than in FIG. 4b.

In this embodiment, display styles are pre-stored, and a target display style adapted to the switched screen that matches the switched display state is screened from the pre-stored display styles, thereby creating or destroying the display style. It can improve the efficiency of determining the target display style, further improve the display efficiency, and improve the display fluency in the screen switching process.

The present embodiment applies to switching screens during execution of a voice application program, and by storing the interactive text on the current screen, provides a data source for the switched screen and displays the target application program. Voice application program interaction after screen switching by ensuring that data is not interrupted and displaying interaction data based on text formatting that matches the switched display state, and text trigger position and trigger effect Solve the technical problem of text being interrupted and lost, ensure the consistency of the dialogue text of the voice application program after the screen is switched, the user experience, and the clarity, completeness and beauty of the display improve.

According to an embodiment of the present application, FIG. 5 is a schematic flow chart of a fifth screen switching display method according to an embodiment of the present application. Used to display In one embodiment, if the screen switching was not monitored while the application program was running, or if the application program was not executed before or after the screen switching, after the screen was switched, the application program , instead of determining a target display style that matches the switched display state, it continues to display in a display style that does not match the switched screen, causing a display error. In order to solve this problem, the present embodiment provides a screen switching display method, and triggers the target display style determination operation and display operation by using the data to be displayed of the target application program as a trigger condition. It should be noted that this embodiment also applies if the screen has not been switched before, or if the matching target presentation style is determined after the screen has been switched, in which case the method according to this embodiment does not change the display style and final display interface. In other words, the execution body of the method according to this embodiment does not need to pay attention to the screen switching situation before acquiring the data to be displayed.

The method may be performed by a screen switching display device, which may be implemented in the form of software and/or hardware, and may be integrated into a smart rearview mirror of specific computing power. As shown in FIG. 5, the screen switching display method according to the present embodiment may include the following steps.

S510: Acquire the data to be displayed of the target application program.

The description of the target application program can refer to the above embodiments in detail and will not be repeated here.

During execution of the target application program, the smart rearview mirror can acquire in real time the data to be displayed of the target application program, that is, the generated or not displayed data. The data to be displayed is displayed on the current screen, such as a smart rearview mirror screen, or the screen of another in-vehicle terminal, such as an in-vehicle infotainment screen.

S520: Get the current display state, including the mirroring display state and the local display state.

After obtaining the data to be displayed of the target application program, determine the current display state of the current screen, and if the current screen is in the local display state, the data to be displayed cannot be displayed on the current screen. When the current screen is in the mirroring display state, it is indicated that the data to be displayed will be displayed on the screen of another in-vehicle terminal.

S530: Determine a target display style that matches the current display state.

S540: Based on the target display style, display the data to be displayed on the screen corresponding to the current display state.

The detailed description of "displaying the data to be displayed according to the target display style" in S530 and S540 can refer to the description of each embodiment above, and will not be repeated here.

In this embodiment, the data to be displayed and the current display state are acquired while the target application program is running, and the data to be displayed is displayed in the target display style that matches the current display state, thereby switching the screen. after the target display style is not determined in a timely manner, and subsequently use a non-matching display style, to avoid situations that cause display errors, and improve the user's experience, as well as the clarity, completeness and beauty of the display. to improve the user experience.

Alternatively, FIG. 6 is a flow chart of screen switching display according to an embodiment of the present application, and detailed explanations are provided for S530 and S540.

S601: Start.
S602: The smart rearview mirror determines whether the current display state is the mirroring display state. If it is in the mirroring display state, S603 is executed, and if it is not in the mirroring display state, S604 is executed.

S603: Determine whether the current display style matches the mirroring display state. If the current display style is in the mirroring display state, execute S605. If not, execute S606.

S604: Determine whether the current display style matches the local display state, and if so, execute S607; otherwise, execute S608.

S605: Display the data to be displayed on the in-vehicle infotainment screen based on the current display style. End this operation.

S606: Create a target display style that matches the mirroring display state and discard the current display style. Execute S609.

S607: Display the data to be displayed on the screen of the smart rearview mirror according to the current display style. End this operation.

S608: Create a target display style that matches the local display state and discard the current display style. Execute S610.

S609: Display the data to be displayed on the screen of the in-vehicle infotainment based on the target display style. End this action.

S610: Display the data to be displayed on the screen of the smart rearview mirror according to the target display style. End this operation.

In the following, the method according to the present embodiment will be described in detail, taking as an example the target application program being a voice application program and the other vehicle-mounted terminal being an in-vehicle infotainment.

The voice application program, after startup, obtains the data to be displayed by the voice application program, and indicates that the first batch of data to be displayed after the start of the voice application program can be displayed in a target display style that matches the current display state. ensuring that subsequent data to be displayed can also be displayed in the target display style, improving the user's experience and the clarity, integrity and aesthetics of the voice interface. Of course, the data to be displayed may be obtained while the target application program is running.

In one embodiment, in some cases, when the smart rearview mirror is in the local display state, the voice application program is executed and terminated so that the current display style matches the local display state. Next, the smart rearview mirror switches to the mirroring display state without changing the display style, launches the voice application program to obtain the data to be displayed, determines the target display style that matches the mirroring display state, The data to be displayed is displayed on an in-vehicle infotainment screen based on the target display style.

Otherwise, when the smart rearview mirror is in the mirroring display state, the voice application program is executed and terminated so that the current display style matches the mirroring display state. Then the smart rearview mirror switches to the local display state, the display style does not change, launches the voice application program to obtain the data to be displayed, determines the target display style that matches the local display state, The data to be displayed is displayed on the screen of the smart rearview mirror based on the target display style.

Otherwise, in response to monitoring the screen switching signal while the voice application program is running, the smart rearview mirror switches to the mirroring display state and determines a target display style that matches the mirroring display state. At this time, the data to be displayed of the voice application program is obtained, the mirroring display state matches the target display style, and the data to be displayed is displayed on the in-vehicle infotainment screen according to the target display style.

In another case, the smart rearview mirror switches to the local display state and determines a target display style that matches the local display state in response to monitoring the screen switch signal during execution of the voice application program. At this time, the data to be displayed of the voice application program is obtained, the local display state matches the target display style, and the data to be displayed is displayed on the screen of the smart rearview mirror according to the target display style.

According to an embodiment of the present application, FIG. 7 is a schematic configuration diagram of a screen switching display device according to an embodiment of the present application, which can implement a screen switching display method according to an embodiment of the present application. with functional modules and beneficial effects corresponding to As shown in FIG. 7, the device 700 includes a display data storage module 701 for storing the display data of the current screen of the target application program during execution of the target application program, and monitors the screen switching signal. a display state determination module 702 for determining a switched display state, including a mirroring display state and a local display state, and a target display style for determining a target display style matching the switched display state, in response to A determination module 703 and a display data display module 704 for displaying the display data on the switched screen based on the target display style.

Selectably, the target display style determination module 703 specifically creates a target display style that matches the switched display state if the switched display state does not match the current interface style of the display data. used for

Selectably, the target display style determination module 703 specifically determines a display style candidate that matches the switched display state from pre-stored display styles, and if there are two or more display style candidates. In some cases, it is used to obtain the switched screen resolution and screen the display style candidates for a target display style that adapts to the switched screen resolution.

Selectably, the display state determination module 702 is used by the dynamic proxy to determine a switched display state, specifically in response to monitoring a screen transition signal, and a target display style determination. Module 703 is specifically used by the dynamic proxy to determine a target display style that matches the switched display state, and display data display module 704 is specifically used to determine the target display style based on the target display style. , is used by the dynamic proxy to display the display data on the switched screen.

Selectably, the current screen is the screen of the smart rearview mirror, the switched screen is the screen of the in-vehicle infotainment, and the display data display module 704 displays in the smart rearview mirror according to the target display style. A video data generation unit for rendering the data to generate video data, and a video data generation unit for sending the video data to the in-vehicle infotainment so that the in-vehicle infotainment displays the video data on the screen of the in-vehicle infotainment. and a video data transmission unit.

Selectably, the display data storage module 701 is specifically used to store interactive text on the current screen of the voice application program during execution of the voice application program, and the target display style determination module 703 is specifically used to determine the text format that matches the switched display state, as well as the text's trigger position and trigger effect.

In an embodiment of the present application, the display data of the current screen of the target application program is stored during execution of the target application program to provide a data source for the switched screen, and the display data of the target application program is Adapts to the screen to which the target display style has been switched and presents the display data to the screen to which it has been switched by ensuring that it is not interrupted and displaying the display data based on the target display style that matches the switched display state to ensure the clarity, completeness and beauty of presentations. Therefore, this embodiment solves the technical problem that the display data of the application program is interrupted and lost after the screen is switched, ensures the consistency of the data display of the application program after the screen is switched, Improve user experience and display clarity, completeness and aesthetics.

According to the embodiment of the present application, FIG. 8 is a schematic configuration diagram of another screen switching display device according to the embodiment of the present application, which can implement the screen switching display method according to the embodiment of the present application, It comprises functional modules and beneficial effects corresponding to the execution method. As shown in FIG. 8, the device 800 includes a display data acquisition module 801 for acquiring the data to be displayed of the target application program, and the current display state including mirroring display state and local display state. a current display state acquisition module 802 for determining a target display style matching the current display state; a target display style determination module 803 for determining a target display style that matches the current display state; and a display data to be displayed module 804 for displaying the data to be displayed.

Optionally, the data to be displayed acquisition module 801 is specifically used to acquire data to be displayed of the voice application program in response to activation of the voice application program.

In this embodiment, by acquiring the data to be displayed and the current display state during execution of the target application program, the data to be displayed can be displayed in the target display style that matches the current display state. After the screen is switched, the target display style cannot be determined in a timely manner, and the non-matching display style is still used to avoid situations that cause display errors, so as to improve the user's experience, as well as the clarity, completeness and integrity of the display. Improve aesthetics and improve user experience.

According to embodiments of the present application, the present application further provides a smart rearview mirror and a readable storage medium.

As shown in FIG. 9, it is a block diagram of a smart rearview mirror with a screen switching display method according to an embodiment of the present application. Smart rearview mirrors are intended to represent various forms of digital computers such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. Smart rearview mirrors can also represent various forms of mobile devices such as personal digital assistants, mobile phones, smart phones, wearable devices, and other similar computing devices. The components, their connections and relationships, and their functions shown herein are merely examples and are not intended to limit the description and/or required implementation of the application herein.

As shown in FIG. 9, the smart rearview mirror comprises one or more processors 901, memory 902, and interfaces for connecting components, including high speed and low speed interfaces. Each component is interconnected by a different bus and can be mounted on a common motherboard or otherwise mounted as desired. The processor processes instructions to be executed by the smart rearview mirror, including instructions to display graphical information of the GUI in or on memory to an external input/output device (e.g., a display device coupled to the interface). . In other embodiments, multiple processors and/or multiple buses can be used along with multiple memories, if desired. Similarly, multiple smart rearview mirrors can be connected, each device providing some required operation (eg, as a server bank, a set of blade servers, or a multi-processor system). In FIG. 9, one processor 901 is taken as an example.

Memory 902 is a non-transitory computer-readable storage medium according to the present application. Here, the memory stores instructions executable by at least one processor so that the at least one processor can execute the screen switching display method according to the present application. A non-transitory computer-readable storage medium of the present application stores computer instructions for causing a computer to execute the screen switching display method of the present application.

The memory 902, as a non-transitory computer-readable storage medium, stores non-temporary software programs, non-transitory computer-executable programs, such as program instructions/modules corresponding to the screen switching display method according to the embodiments of the present application. It is configured to store possible programs and modules. The processor 901 performs the various functional applications and data processing of the server by executing non-transitory software programs, instructions and modules stored in the memory 902, i.e. the screen switching display of the above method embodiments. implement the method.

The memory 902 can include a program storage area and a data storage area, where the program storage area can store an operating system, application programs required for at least one function, and the data storage area can store , the data created by using the smart rearview mirror of the screen switching display method, etc. can be stored. Memory 902 may also include high-speed random access memory and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid-state storage device. is. In some embodiments, the memory 902 may optionally include memory provided remotely to the processor 901, and these remote memories are connected via a network to a smart rearview mirror for switching display methods. may be Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The screen switching display method smart rearview mirror may further include an input device 903 and an output device 904 . The processor 901, the memory 902, the input device 903 and the output device 904 can be connected via a bus or other manner, and the connection via a bus is taken as an example in FIG.

The input device 903 may receive input numeric or character information and generate key signal input related to user setting and function control of the smart rearview mirror of the screen switching display method, such as touch screen, keypad, Input devices such as mice, trackpads, touchpads, indicator sticks, one or more mouse keys, trackballs, joysticks, and the like. Output devices 904 may include display devices, supplemental lighting devices (eg, LEDs), haptic feedback devices (eg, vibramotors), and the like. The display device may include, but is not limited to, a liquid crystal display (LCD), a light emitting diode (LED) display, and a plasma display. In some embodiments, the display device can be a touch screen.

Various embodiments of the systems and techniques described herein may be digital electronic circuit systems, integrated circuit systems, application specific integrated circuits (ASICs), computer hardware, firmware, software, and/or combinations thereof. can be realized by These various embodiments can include being embodied in one or more computer programs that run on a programmable system that includes at least one programmable processor and/or Alternatively, the programmable processor may be an application-specific or general-purpose programmable processor that receives data and instructions from a storage system, at least one input device, and at least one output device; It can be transmitted to at least one input device and to the at least one output device.

These computer programs (also called programs, software, software applications, or code) contain machine instructions for programmable processors and are implemented in a high-level procedural and/or object-oriented programming language and/or assembly/machine language. can do. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, or device for providing machine instructions and/or data to a programmable processor. and/or a device (eg, magnetic disk, optical disk, memory, programmable logic device (PLD)) that includes a machine-readable medium for receiving machine instructions, which are machine-readable signals. The term "machine-readable signal" is any signal for providing machine instructions and/or data to a programmable processor.

To provide interaction with a user, the systems and techniques described herein can be implemented on a computer that includes a display device (e.g., CRT (cathode ray tube)) for displaying information to the user. ) or LCD (liquid crystal display) monitor), and a keyboard and pointing device (eg, a mouse or trackball) through which a user can provide input to the computer. Other types of devices may be used to provide interaction with the user. For example, the feedback provided to the user may be any form of sensing feedback (e.g., visual, auditory, or tactile feedback), any form (acoustic, audio, tactile, and , ) can receive input from the user.

The systems and techniques described herein may be computing systems that include back-end components (eg, data servers), or computing systems that include middleware components (eg, application servers), or computing systems that include front-end components. A system (e.g., a user computer having a graphical user interface or web browser, through which users interact with embodiments of the systems and techniques described herein), or such a backend component , middleware components, and front-end components. The components of the system may be interconnected by any form or medium of digital data communication (eg, a communication network). Examples of communication networks include local area networks (LAN), wide area networks (WAN), and the Internet.

The computer system can include a client side and a server. A client side and server are generally remote from each other and typically interact through a communication network. A client-server relationship is created by computer programs running on corresponding computers and having a client-server relationship to each other.

It should be appreciated that steps may be reordered, added, or deleted using the various forms of flow shown above. For example, each step described in this application may be performed in parallel, sequentially, or in a different order, but the technology disclosed in this application There is no limitation herein as long as the desired result of the scheme can be achieved.

The above specific embodiments do not limit the protection scope of this application. Those skilled in the art can make various modifications, combinations, subcombinations, and permutations depending on design requirements and other factors. Any modification, equivalent replacement, improvement, etc. made within the gist and principle of this application shall all fall within the protection scope of this application.

Claims (11)

A screen switching display method comprising:
storing display data for a current screen of the target application program during execution of the target application program;
determining a switched display state, including a mirrored display state and a local display state, in response to monitoring the screen switching signal;
determining a target display style that matches the switched display state;
displaying the display data on a switched screen based on the target display style ;
The mirroring display state refers to displaying on the switched screen, the local display state refers to displaying on the current screen,
storing display data for a current screen of the target application program during execution of the target application program;
during execution of a voice application program, storing interactive text at a current screen of said voice application program, said interactive text being text corresponding to user speech and/or response content;
Determining a target display style that matches the switched display state comprises:
determining a text format matching the switched display state, and a text trigger position and trigger effect ;
A screen switching display method characterized by: Determining a target display style that matches the switched display state comprises:
creating a target display style that matches the switched display state if the switched display state does not match a current display style of the display data;
2. The method of claim 1, wherein: Determining a target display style that matches the switched display state comprises:
determining a display style candidate that matches the switched display state from pre-stored display styles;
if there are two or more display style candidates, obtaining a resolution of the switched screen;
screening from the display style candidates for a target display style that adapts to the switched screen resolution;
2. The method of claim 1, wherein: Determining a switched display state in response to monitoring the screen switch signal comprises:
determining by the dynamic proxy a switched display state in response to monitoring the screen switch signal;
Determining a target display style that matches the switched display state comprises:
determining by the dynamic proxy a target display style that matches the switched display state;
displaying the display data on a switched screen based on the target display style;
displaying, by the dynamic proxy, the display data on a switched screen based on the target display style;
2. The method of claim 1, wherein: wherein the current screen is a smart rearview mirror screen and the switched screen is an in-vehicle infotainment screen;
displaying the display data on a switched screen based on the target display style;
rendering, in the smart rearview mirror, the display data based on the target display style to generate video data;
transmitting the video data to the in-vehicle infotainment such that the in-vehicle infotainment displays the video data on a screen of the in-vehicle infotainment;
2. The method of claim 1, wherein: A screen switching display method comprising:
obtaining data to be displayed in the target application program;
obtaining a current display state, including a mirrored display state and a local display state;
determining a target display style that matches the current display state;
displaying the data to be displayed on a screen corresponding to the current display state based on the target display style ;
The mirroring display state refers to displaying on the switched screen, the local display state refers to displaying on the current screen,
the target display style includes a text format matching the switched display state, and a text trigger position and trigger effect;
The step of obtaining data to be displayed of the target application program includes:
obtaining data to be displayed by the voice application program in response to activation of the voice application program, wherein the data to be displayed by the voice application program is interactive text on a current screen of the voice application program. wherein said interactive text is text corresponding to user speech and/or responsive content ;
A screen switching display method characterized by: A screen switching display device,
a display data storage module for storing display data for a current screen of the target application program during execution of the target application program;
a display state determination module for determining a switched display state including a mirroring display state and a local display state in response to monitoring a screen switching signal;
a target display style determination module for determining a target display style matching the switched display state;
a display data display module for displaying the display data on a switched screen based on the target display style ;
The mirroring display state refers to displaying on the switched screen, the local display state refers to displaying on the current screen,
The display data storage module further comprises:
during execution of a voice application program, storing interactive text on a current screen of said voice application program, said interactive text being text corresponding to user's voice and/or response content;
The target display style determination module includes:
determining a text format matching the switched display state, and a text trigger position and trigger effect ;
A screen switching display device characterized by: A screen switching display device,
the data to be displayed acquisition module is used to acquire the data to be displayed of the target application program;
A current display state acquisition module is used to acquire a current display state, including a mirroring display state and a local display state, wherein the mirroring display state refers to displaying on a switched screen, and the local display State refers to what is displayed on the current screen,
A target display style determination module is used to determine a target display style matching the current display state , the target display style being a text format matching the switched display state and a trigger position of the text. including trigger effects,
a display module for data to be displayed is used to display the data to be displayed on a screen corresponding to the current display state according to the target display style ;
Acquiring data to be displayed of the target application program includes:
retrieving data to be displayed by the voice application program in response to activation of the voice application program, wherein the data to be displayed by the voice application program is interactive text on a current screen of the voice application program. wherein said interactive text is text corresponding to user speech and/or responsive content ;
A screen switching display device characterized by: A smart rearview mirror,
at least one processor;
a memory communicatively coupled to the at least one processor;
The memory stores instructions executable by the at least one processor, and the instructions allow the at least one processor to perform the screen switching display method according to any one of claims 1 to 5 or 6 . executably executed by the at least one processor;
A smart rearview mirror characterized by: A non-transitory computer-readable storage medium for storing computer instructions,
The computer instructions are used to cause a computer to execute the screen switching display method according to any one of claims 1 to 5 or 6 ,
A non-transitory computer-readable storage medium characterized by: causing the computer to execute the screen switching display method according to any one of claims 1 to 5 or 6 when operating on the computer;
A computer program characterized by:

Images