CN115904295A - Multi-screen display control method, device, medium, system, chip and panel - Google Patents
Multi-screen display control method, device, medium, system, chip and panel Download PDFInfo
- Publication number
- CN115904295A CN115904295A CN202310153667.4A CN202310153667A CN115904295A CN 115904295 A CN115904295 A CN 115904295A CN 202310153667 A CN202310153667 A CN 202310153667A CN 115904295 A CN115904295 A CN 115904295A
- Authority
- CN
- China
- Prior art keywords
- display
- subsystem
- chip
- display screens
- screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Digital Computer Display Output (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The application discloses a multi-screen display control method, a multi-screen display control device, a multi-screen display control medium, a multi-screen display control system, a multi-screen display control chip and a multi-screen display control panel. In the method, one subsystem in the multi-core heterogeneous on-chip integrated system performs centralized control on display screens used by a plurality of subsystems so as to synchronously display the same resource on each display screen. Therefore, the same resource to be displayed does not need to be repeatedly acquired by each subsystem, and synchronous display is better performed on each subsystem in a mode of centralized control display by one subsystem.
Description
Technical Field
The present application relates to the field of System on Chip (SoC), and in particular, to a multi-screen display control method and apparatus, a computer readable storage medium, a multi-core heterogeneous SoC, a Chip, a semiconductor integrated panel, an electronic component, and a vehicle.
Background
At present, in a large-scale integrated system such as an intelligent cabin or an intelligent home system realized by an on-chip integrated system, a plurality of subsystems may need to be operated to respectively realize different targets. The subsystems are independent from each other and respectively control a display screen used by the system.
When the same resource needs to be displayed synchronously on the screen used by each subsystem (for example, in the starting process, the display screens of a plurality of subsystems need to play the same starting animation resource), each subsystem needs to acquire the starting animation resource, and because each subsystem is used independently, synchronous display is difficult to realize in the playing process.
Disclosure of Invention
The applicant creatively provides a multi-screen display control method, a multi-screen display control device, a computer readable storage medium, a multi-core heterogeneous on-chip integrated system, a chip, a semiconductor integrated panel, an electronic component and a vehicle.
According to a first aspect of the embodiments of the present application, a multi-screen display control method is provided, which is applied to a first subsystem of a multi-core heterogeneous on-chip integrated system, and includes: acquiring target resources to be displayed; controlling at least two display screens connected with the multi-core heterogeneous on-chip integrated system to synchronously display target resources on the at least two display screens; wherein the at least two display screens comprise display screens used by a second subsystem of the multi-core heterogeneous on-chip integrated system.
According to a second aspect of the embodiments of the present application, there is provided a multi-screen display control apparatus applied to a first subsystem of a multi-core heterogeneous on-chip integrated system, including: the target resource acquisition module is used for acquiring target resources to be displayed; the multi-screen synchronous display module is used for controlling at least two display screens connected with the multi-core heterogeneous on-chip integrated system so as to synchronously display target resources on the at least two display screens; wherein the at least two display screens comprise display screens used by a second subsystem of the multi-core heterogeneous on-chip integrated system.
According to a third aspect of embodiments of the present application, a computer-readable storage medium is provided, where computer instructions are stored, where the computer instructions are configured to cause a computer to execute any one of the above-mentioned multi-screen display control methods.
According to a fourth aspect of the embodiments of the present application, there is provided a multi-core heterogeneous integrated system on a chip, including: the hardware domain runs an independent operating system on mutually isolated hardware resources, and is used for executing the multi-screen display control method for sending the second data access request; the data storage device is arranged in a first hardware domain of the at least two hardware domains, and a data storage manager is deployed and used for executing the multi-screen display control method for uniformly processing data access requests from different hardware domains on the heterogeneous on-chip integrated system.
According to a fifth aspect of the embodiments of the present application, a chip is provided, where the multicore heterogeneous integrated system on a chip runs on the chip.
According to a sixth aspect of the embodiments of the present application, there is provided a semiconductor integrated panel provided with the above chip.
According to a seventh aspect of embodiments of the present application, there is provided an electronic component provided with the above-described semiconductor integrated panel.
According to an eighth aspect of embodiments of the present application, there is provided a vehicle provided with the electronic component described above.
The application provides a multi-screen display control method, a multi-core heterogeneous on-chip integrated system, a chip, a semiconductor integrated panel, an electronic component and a vehicle. Therefore, each subsystem does not need to repeatedly acquire the same resource to be displayed, and synchronous display can be better performed in each display screen in a mode of centralized control of display by one subsystem.
It is to be understood that the implementation of the present application does not need to achieve all the above advantages, but a specific technical solution may achieve a specific technical effect, and other embodiments of the present application may also achieve the above-mentioned advantages.
Drawings
The above and other objects, features and advantages of exemplary embodiments of the present application will become readily apparent from the following detailed description read in conjunction with the accompanying drawings. Several embodiments of the present application are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which:
in the drawings, the same or corresponding reference numerals indicate the same or corresponding parts.
Fig. 1 is a schematic architecture diagram of a multi-core heterogeneous on-chip integrated system used in implementing a multi-screen display control method according to an embodiment of the present application;
FIG. 2 is a flowchart illustrating a method for implementing a multi-screen display control method according to the embodiment shown in FIG. 1;
fig. 3 is a schematic diagram illustrating an architecture of a multi-core heterogeneous on-chip integrated system used in implementing a multi-screen display control method according to another embodiment of the present application;
FIG. 4 is a schematic diagram of a software architecture adopted by the multi-core heterogeneous on-chip integrated system to implement a multi-screen display control method according to the embodiment shown in FIG. 3;
FIG. 5 is a display frame diagram adopted by the multi-core heterogeneous on-chip integrated system implementing a multi-screen display control method according to the embodiment shown in FIG. 3;
FIG. 6 is a flowchart illustrating a multi-core heterogeneous on-chip integrated system implementing a multi-screen display control method according to the embodiment shown in FIG. 3;
FIG. 7 is a schematic structural diagram of a multi-screen display control apparatus according to an embodiment of the present application.
Detailed Description
In order to make the objects, features and advantages of the present application more obvious and understandable, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or to implicitly indicate the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "a plurality" means two or more unless specifically limited otherwise.
In the present application, the on-chip integrated system is a system running on a system-on-chip, and the system-on-chip includes components such as a computing unit (core), a memory, a power supply controller, a clock controller, an interrupt controller, etc., and can execute a set of complete system functions in cooperation with embedded software.
Generally, an integrated system on chip establishes a set of system functions focused on a certain target based on components on a system-on-chip, including: an Operating System (OS), and a series of applications running on top of the OS that focus on a certain target.
For a large-scale integrated system such as an intelligent cockpit system or an intelligent home system, a plurality of on-chip integrated systems may need to be operated to respectively achieve different targets.
For example, for an intelligent cabin system, it may be necessary to separately: on the first system level chip, a first on-chip integrated system for performing security detection and displaying dashboard data is constructed and operated; on the second system level chip, a second on-chip integrated system for operating various components (such as a vehicle window, a left rear-view mirror and a right rear-view mirror) and displaying a central control interface is constructed and operated; on the second system-on-chip, a third integrated system-on-chip for implementing entertainment functions, playing multimedia, running entertainment applications, etc. is constructed and run.
The integrated system on chip is connected with the corresponding display screens based on the respective system level chips respectively, and the respective display screens are independently controlled. For example, the first on-chip integrated system controls a dashboard screen connected to the first system-on-chip to display dashboard data; the second on-chip integrated system controls a central control screen connected on the second system level chip to display a central control interface, and if the second system level chip is also connected with a left rear-view mirror screen and a right rear-view mirror screen, the left rear-view mirror screen and the right rear-view mirror screen are also controlled to display corresponding information; the third on-chip integrated system controls an In-Vehicle information (IVI) display screen connected to the third system-level chip, plays multimedia, runs entertainment applications, and the like.
In the large-scale integrated system composed of the plurality of on-chip integrated systems, it is difficult to play the same target resource, such as the boot animation or the shutdown animation, synchronously. Firstly, each on-chip integrated system needs to download the target resource to a local memory; and then, the on-chip integrated systems respectively control the display screens to play. In this process, the integrated systems on the chips may be in a state where communication is impossible (for example, the system is not started before the system is started or the system is stopped after the system is shut down), so that it is difficult to perform synchronous playing, and therefore, a situation occurs in which the first integrated system on the chip may have already played the target resource, and the second integrated system on the chip has just downloaded the target resource, and the playing is not yet achieved.
In order to solve the above problem, the present application provides a multi-screen display control method, which is applied to a first subsystem in a multi-core heterogeneous on-chip integrated system.
The multi-core heterogeneous on-chip integrated system refers to a large-scale integrated system running on a super system-level chip. The super system-on-chip refers to a device including a plurality of computing units (multi-core), a plurality of allocable memory blocks, a plurality of power controllers, a plurality of clock controllers, a plurality of interrupt controllers, and the like. The components described above may be divided into multiple hardware domains, each containing specific system resources required by a particular system, such as one or more compute units (cores), clock controllers, interrupt controllers, and available memory space, among others. System resources in different hardware domains are isolated from each other. Based on each hardware domain, a separate operating system may be installed, building and running subsystems that achieve specific goals. Interaction and cooperation among the subsystems can be realized through inter-core communication.
Thus, the multi-core heterogeneous on-chip integrated system can realize all functions of a large-scale integrated system through a plurality of specific target subsystems running on a super system-level chip.
Fig. 1 illustrates a multi-core heterogeneous integrated system on a chip 10 on which a multi-screen display control method is implemented according to an embodiment of the present application.
As shown in fig. 1, the multi-core heterogeneous integrated system on a chip 10 runs on a super system-on-chip, which at least has N first type cores, M second type cores, and other components, and is connected to a plurality of display screens through a plurality of display interfaces: a first display screen 1011, a second display screen 1012, a third display screen 1021, and a fourth display screen 1022.
The multi-core heterogeneous integrated system on chip 10 builds and operates at least two subsystems based on the super system-level chip: a first subsystem 101 and a second subsystem 102. Wherein the first subsystem 101 displays the respective outputs using the first display screen 1011 and the second display screen 1012; the second subsystem 102 displays the corresponding output using the third display 1021 and the fourth display 1022.
To this end, the N first type cores of the super system-on-chip and other required components may be divided into a first hardware domain, and a first type Operating System (OS) may be installed based on the first hardware domain to form a first subsystem 101; the M second-type cores of the super system-on-chip and the corresponding hardware resources are divided into a second hardware domain, and a second-type OS is installed based on the second hardware domain to form a second subsystem 102.
The first subsystem 101 and the second subsystem 102 may interact and cooperate through inter-core communication. Inter-core communication may be through communication modules on the super system-on-chip, such as mailboxes (mailboxes) and shared memory, to send commands and exchange data.
For a plurality of display screens connected on the super system level chip, a display interface connected with each display screen can be divided into a certain hardware domain, a subsystem based on the hardware domain can generate display information, the display information is sent to the display screens through the display interfaces, and the corresponding display screens are directly controlled and used.
The subsystems based on the hardware domain can also acquire output information which is required to be displayed by other subsystems through inter-core communication, generate display information according to the output information which is required to be displayed by other subsystems, and send the display information to a display screen through a display interface. In other words, the subsystems in the multi-core heterogeneous on-chip integrated system can send instructions and output information to other subsystems through inter-core communication, and indirectly control and use a certain display screen through other subsystems.
Therefore, the display interface for connecting the display screen can be more flexibly distributed in the hardware domain.
For example, a display interface with a first display screen 1011 and a second display screen 1012 connected thereto may be divided into a first hardware domain, directly controlled and used by the first subsystem 101; the display interface to which the third display 1021 and the fourth display 1022 are connected is divided into a second hardware domain, which is directly controlled and used by the second subsystem 102.
Or the display interfaces connected with the display screens can be divided into a first hardware domain, and a display screen centralized management module is realized in the first subsystem 101, and each subsystem indirectly controls and uses the corresponding display screen through the display screen centralized management module. Specifically, the first subsystem 101 may indirectly control and use the first display screen 1011 or the second display screen 1012 through the display screen centralized management module; the second subsystem 102 may indirectly control and use the third display 1021 and the fourth display 1022 through the display centralized management module.
In addition, each subsystem in the multi-core heterogeneous on-chip integrated system can send instructions and output information to other subsystems through inter-core communication, and indirectly control and use a certain display screen through other subsystems, so that the possibility of centrally controlling a plurality of display screens used by each subsystem through a certain subsystem is created, and the multi-screen display control method provided by the application is realized.
Assuming that, in the implementation of the present application based on the multi-core heterogeneous integrated system on a chip 10 shown in fig. 1, the first subsystem 101 centrally controls a plurality of display screens used by each subsystem, the multi-screen display control method of the present application can be implemented by the flow shown in fig. 2. Referring to fig. 2, the method includes:
operation S210, acquiring a target resource to be displayed;
the target resource to be displayed may be a text, a picture, an animation, or the like.
Operation S220, controlling at least two display screens connected to the multi-core heterogeneous on-chip integrated system 10 to synchronously display the target resource on the at least two display screens;
wherein the at least two display screens comprise display screens used by the second subsystem 102 of the multi-core heterogeneous on-chip integrated system.
The at least two display screens connected to the multi-core heterogeneous on-chip integrated system 10 refer to at least two display screens connected through a display interface on a super system chip on which the multi-core heterogeneous on-chip integrated system 10 operates.
When the first subsystem 101 controls at least two display screens connected to the multi-core heterogeneous on-chip integrated system 10, corresponding operations may be executed according to a hardware domain where the display screens are located:
if the display interface to which the first display screen 1011 and the second display screen 1012 are connected is divided into a first hardware domain and the display interface to which the third display screen 1021 and the fourth display screen 1022 are connected is divided into a second hardware domain, the first subsystem 101 may directly control the first display screen 1011 and the second display screen 1012 and indirectly control the third display screen 1021 and the fourth display screen 1022 through inter-core communication with the second subsystem 102.
If the display interfaces connected to the display screens are all divided into a first hardware domain, and the display screens are centrally controlled by the display screen centralized management module in the first subsystem 101, the first subsystem 101 may directly control the first display screen 1011, the second display screen 1012, the third display screen 1021, and the fourth display screen 1022 through the centralized management module.
In the present application, display refers to a broad display, and includes not only display of static resources such as text and images, but also playback of dynamic resources such as animation and video, and projection of static resources or dynamic resources.
In the application, synchronous display mainly means that a plurality of display screens start to display at almost the same time and keep the display contents synchronous and consistent during display; in the application, the synchronous display does not include ending the display at the same time, and the plurality of display screens can end the display at different times according to needs.
Since the target resource is acquired by the first subsystem 101, the display screen used by each subsystem is controlled by the first subsystem 101. Therefore, the target resource only needs to be downloaded once and then can be simultaneously sent to the display screens used by the subsystems, and even under the condition that the third display screen 1021 and the fourth display screen 1022 are indirectly controlled by the second subsystem 102 through inter-core communication, the delay is very small and even is not easy to be detected by naked eyes, so that the synchronization of display in the display screens is easier to realize.
It should be noted that, in the embodiment of the present application, only the first subsystem 101 and the second subsystem 102 in the multi-core heterogeneous integrated-on-chip system 10 are shown in fig. 1, and in practical applications, the multi-core heterogeneous integrated-on-chip system may include more than two subsystems, and the first subsystem 101 may be used to control all display screens used by all subsystems in the multi-core heterogeneous integrated-on-chip system 10, or may be used to control only a part of display screens used by a part of subsystems of the multi-core heterogeneous integrated-on-chip system 10.
In addition, in other embodiments, the number of display screens used by each subsystem is not limited, and may be 0 or 1 or more, including the first subsystem for controlling the display screens used by the subsystems.
Fig. 3 to 6 show another embodiment of the present application. The embodiment realizes an intelligent cockpit system based on a multi-core heterogeneous on-chip integrated system.
As shown in fig. 3, the smart cabin system is provided with a plurality of display screens, for example, a left rear view mirror 3011, a right rear view mirror 3012, a streaming media (HUD) 3021, a dashboard 3022, an IVI main screen 3031, and an IVI sub-screen 3032.
A plurality of computing units are arranged in a super system-on-chip based on the intelligent cockpit system, X cores and other required components are divided into a first hardware domain, an operating system RTOS is installed based on the first hardware domain, and a left rear-view mirror application 3014 and a display screen centralized management module 3013 are deployed on the RTOS to form a left rear-view mirror subsystem 301 and a right rear-view mirror subsystem 301; dividing Y cores and other required components into a second hardware domain, installing an operating system Linux based on the second hardware domain, and deploying a streaming media application 3023 and a dashboard application 3024 on the Linux to form a dashboard subsystem 302; the Z cores and other required components are divided into a third hardware domain, an operating system Android is installed based on the third hardware domain, and a multimedia playing application 3033 is deployed on the Android to form an entertainment subsystem 303.
The display interfaces connected with the display screens in the intelligent cabin are divided into a first hardware domain, the left rearview mirror subsystem 301 and the right rearview mirror subsystem 301 are used as a first subsystem, and the display screens are managed and controlled by the display screen centralized management module 3013 in the left rearview mirror subsystem 301 and the right rearview mirror subsystem 301. Each subsystem can indirectly control and use the corresponding display screen through the display screen centralized management module 3013.
For example, the left and right rearview mirror applications 3014 in the left and right rearview mirror subsystems 301 indirectly control and use the left and right rearview mirrors 3011 and 3012 to output prompt information given in a specific scene through the display screen centralized management module 3013; the stream media application 3023 in the dashboard subsystem 302 indirectly controls and uses the stream media 3021 to project important driving information such as speed per hour, navigation, and the like onto a windshield in front of the driver through the display screen centralized management module 3013, so that the driver can see the important driving information such as speed per hour, navigation, and the like without lowering or turning his head as much as possible; the dashboard application 3024 in the dashboard subsystem 302 indirectly controls and uses the dashboard 3022 to display dashboard data such as fuel volume, speed per hour, tire pressure, etc. through the display screen centralized management module 3013; the multimedia playing application 3033 in the entertainment subsystem 303 indirectly controls and uses the main IVI screen 3031 and the auxiliary IVI screen 3032 to play multimedia through the display screen centralized management module 3013.
Fig. 4 shows a software architecture adopted by the left and right rearview mirror subsystems 301 to control the multiple display screens to synchronously display the same target resource (e.g., power-on animation or power-off animation) through the display screen centralized management module 3013.
As shown in fig. 4, the display screen centralized management module 3013 is configured to: acquiring a target resource; then, a Video Processing Unit (VPU) thread 30131 is started to decode the target resource, and an animation playback thread 30132 is started at the same time; the Video Processing Unit (VPU) thread 30131 sends the animation data obtained from the decoding target resource to the playback thread, and then the animation playback thread 30132 takes charge of the animation playback logic on each screen, and sends the animation data to each display screen: a left rear view mirror 3011, a right rear view mirror 3012, a streaming media (HUD) 3021, a dashboard 3022, an IVI main screen 3031, and an IVI sub screen 3032, etc., for synchronous display.
The left and right rearview mirror applications 3014 notify the display screen centralized management module 3013 through interprocess communication when the left rearview mirror 3011 and the right rearview mirror 3012 are needed to display information; then, the display centralized management module 3013 ends playing the target resource in the left rear view mirror 3011 and the right rear view mirror 3012 through the animation playing thread 30132.
When the streaming media application 3023 needs to use the streaming media 3021 projection information, the display screen centralized management module 3013 is notified through inter-core communication; then, the display screen centralized management module 3013 ends playing the target resource in the streaming media 3021 through the animation playback thread 30132.
When the dashboard 3024 needs to display dashboard data using the dashboard 3022, it notifies the display screen centralized management module 3013 through inter-core communication; then, the display centralized management module 3013 ends the playback target resource in the dashboard 3022 via the animation playback thread 30132.
When the multimedia playing application 3033 needs to play multimedia by using the IVI main screen 3031 and the IVI sub screen 3032, the display screen centralized management module 3013 is informed through inter-core communication; then, the display screen centralized management module 3013 ends playing the target resource in the IVI main screen 3031 and the IVI sub screen 3032 through the animation playing thread 30132.
Fig. 5 illustrates a display frame used in the display screen centralized management module 3013. Referring to fig. 5, each Display screen managed in the Display screen centralized management module 3013 corresponds to a Display Controller (DC) 501. The display controller 501 sets a plurality of display layers (layers): the display layer 1, the display layer 2, the display layer 3 and the display layer 4 are used for acquiring corresponding display data from a plurality of data sources. The display layer 1 is used for displaying a video or an image which needs to be subjected to color conversion; the display layer 2 is used for displaying an image without color conversion; the display layer 3 is for displaying display data output from the display processor DP 1; the display layer 4 is used to display the display data output from the display processor DP 2. Then, the display data (including the color of each pixel) of each display layer and the background color are subjected to pixel color combination processing (Alpha Blending) to obtain the display data to be finally displayed on the display screen, and the display data is sent to the display interface. After the display screen receives the display data through the display interface, the display data can be displayed on the display screen.
The display layer 1 and the display layer 2 may be controlled by the display screen centralized management module 3013, and are configured to display the target resource in each display screen synchronously.
The display processor DP1 and the display processor DP2 may use a dedicated communication channel or a general inter-core communication module to communicate with each subsystem (e.g., the dashboard subsystem 302 or the entertainment subsystem 303), obtain instructions and output information sent by each subsystem, perform corresponding processing according to the instructions and the output information, and output display data expected to be displayed by the corresponding subsystem. In this way, each subsystem can be caused to display the display data output by the corresponding application in the corresponding display screen through the display processor DP1 and the display processor DP 2.
Taking the display of the boot animation as an example, after booting, the display screen centralized management module 3013 may send display data of the boot animation to the display layer 1 of the display controller 501 of each display screen through the display layer 1, where each subsystem is not yet started at this time, and the display layer 3 or the display layer 4 does not have any display data. At this time, the display data after the pixel color combination processing is the display data of the boot animation. Therefore, the display screens can synchronously display the startup animation.
When the subsystem is started up, and the display screen centralized management module 3013 is notified through inter-core communication that the corresponding application is started, the display screen centralized management module 3013 may stop sending the boot animation data to the display layer 1 of the display controller 501 of the corresponding display screen, and the display screen may end playing the boot animation. Then, the display layer 3 and the display layer 4 of the display controller 501 receive the display data sent by the corresponding subsystem, and the display layer 1 and the display layer 2 do not have any display data any more, so that each display screen displays the display data of the corresponding application in the corresponding subsystem.
In the embodiment of the present application, since the configurations of the display screens are different (for example, the resolutions, the sizes, the aspect ratios, and the like are different), if the acquired target resource is directly sent to the display screens, problems such as mismatch with the display screens, image missing or distortion, and the like are likely to occur.
Therefore, in the embodiment of the application, the configuration information of each display screen may be stored in advance, the configuration information of each display screen is obtained before the animation playing thread 30132 sends the target resource to each display screen, and the target resource is customized according to the configuration information, so as to obtain the customized resource corresponding to each display screen. Therefore, the target resource can obtain better display effect in each display screen.
Fig. 6 shows a main flow of the left and right rearview mirror subsystems 301 of the first subsystem for centrally controlling the display target resources of the display screens through the display screen centralized management module 3013, including:
step S6010, pre-storing the target resource in the target data storage area.
In the embodiment of the present application, in order to adapt the display contents of different display screens, when packaging the target resource, the resolution is 5760 × 720, and a separate partition of a memory card, for example, a multimedia MMC (eMMC) card, is used as the target data storage area.
Step S6020, in the system start-up process, loads the target data storage area to the first subsystem.
Step S6030, the target resource to be displayed is acquired from the target data storage area.
Therefore, the target resource does not need to be downloaded, and the time for acquiring the target resource is greatly shortened.
In step S6040, the Video Processing Unit (VPU) thread 30131 is started to decode the target resource.
After the VPU decodes, a large buffer of data can be generated.
In step S6050, an animation playback thread 30132 is started.
In step S6060, the animation playback thread 30132 performs customization processing on the target resource according to the configuration information, and obtains a customized resource corresponding to each display screen.
Wherein, the customization processing refers to selecting display data (for example, pixel points) matched with the configuration information from the target resource; or converting the target resource according to the configuration information to obtain the resource matched with the configuration information.
For example, if the aspect ratios are different, the target resource is stretched or retracted to match the aspect ratio of the corresponding display screen, and the like; or by copying or deleting part of the display data to match the aspect ratio of the corresponding display screen.
In the embodiment of the present application, because the resolution is large enough, the display data decoded into the buffer can almost meet the display requirements of the display screens with various configurations, and therefore, the customized resources corresponding to each display screen are obtained mainly by selecting the display data corresponding to the configuration information from the buffer data.
Step S6070, the customized resource corresponding to each display screen is synchronously displayed on each display screen.
Step S6080, communicating with the second subsystem to obtain system state information of the second subsystem.
The system state information includes information indicating that the system has been started, the corresponding application has been started, the system has been stopped from running, the corresponding application has been stopped from running, and the like.
Step S6090, according to the system state information of the second subsystem, controls the display screen used by the second subsystem to end displaying the target resource.
Thus, the left and right rearview mirror subsystems 301 can control the display screens to synchronously display the same target resource through the display screen centralized management module 3013.
In the embodiment of the present application shown in fig. 3 to fig. 6, the display screens used by the subsystems are divided into the same hardware domain, and the display screens are controlled in a centralized manner by the display screen centralized management module 3013, so that synchronous display between the display screens can be realized more conveniently.
Display data from different data sources can be displayed on the same display screen through the display frames of multiple display layers used by the display controller 501 in the display screen centralized management module 3013, so that the utilization rate of the display screen is greatly improved, and switching between the same target resource and the output of each subsystem can be skillfully realized.
The display screen centralized management module 3013 further customizes the target resource according to the configuration information of each display screen, and enables the target resource to obtain a better display effect on each display screen.
In another embodiment of the present application, the target resource may also be an ultra-wide screen video, and the target resource needs to be split into a left screen sub-resource and a right screen sub-resource with different display contents, where the left screen sub-resource and the right screen sub-resource are respectively on two spliced display screens: and synchronously displaying on the left display screen and the right display screen. At this time, in the process that the first subsystem controls the plurality of display screens to display the target resource, the method further includes: acquiring a sub-resource corresponding to each display screen; and synchronously displaying the sub-resources corresponding to each display screen on each display screen of the at least two display screens.
Therefore, different sub-resources which are different in content and related to each other and are contained in the same target resource can be synchronously displayed in different display screens, so that a specific display effect is achieved.
For example, the left screen sub-resource is displayed in the left display screen, the right screen sub-resource is displayed in the right display screen, and the two spliced display screens of the left display screen and the right display screen can be used for split screen display of the ultra-wide screen video.
Further, an embodiment of the present application further provides a multi-screen display control apparatus, which is applied to a first subsystem of a multi-core heterogeneous on-chip integrated system, as shown in fig. 7, the apparatus 70 includes: a target resource obtaining module 701, configured to obtain a target resource to be displayed; a multi-screen synchronous display module 702, configured to control at least two display screens connected to the multi-core heterogeneous on-chip integrated system, so as to synchronously display a target resource on the at least two display screens; wherein the at least two display screens comprise display screens used by a second subsystem of the multi-core heterogeneous on-chip integrated system.
According to an embodiment of the present application, the apparatus 70 further comprises: the inter-core communication module is used for communicating with the second subsystem so as to acquire the system state information of the second subsystem; and the ending display module is used for controlling the display screen used by the second subsystem according to the system state information of the second subsystem so as to end the display of the target resource.
According to an embodiment of the present application, the apparatus 70 further comprises: the configuration information acquisition module is used for acquiring configuration information of each display screen in at least two display screens; the customization processing module is used for customizing the target resources according to the configuration information to obtain customized resources corresponding to each display screen; accordingly, the multi-screen synchronous display module 702 is further configured to synchronously display the customized resource corresponding to each display screen on each display screen of the at least two display screens.
According to an embodiment of the present application, the target resource includes at least two sub-resources with different display contents, and the apparatus 70 further includes: the sub-resource acquisition module is used for acquiring sub-resources corresponding to each display screen in at least two display screens; correspondingly, the multi-screen synchronous display module 702 is further configured to synchronously display the sub-resource corresponding to each display screen on each display screen of the at least two display screens.
According to an embodiment of the present application, the target resource is pre-stored in the target data storage area, and accordingly, the resource obtaining module 701 includes: the storage area loading submodule is used for loading the target data storage area to the first subsystem in the system starting process; and the target resource acquisition submodule is used for acquiring the target resource to be displayed from the target data storage area.
According to an embodiment of the present application, each of the at least two display screens includes at least two display layers, and correspondingly, the multi-screen synchronous display module 702 is further configured to control a first display layer of each of the at least two display screens connected to the multi-core heterogeneous on-chip integrated system, so as to synchronously display the target resource on the at least two display screens.
According to an embodiment of the present application, the at least two display screens include a display screen used by the first subsystem, and the apparatus 70 further comprises: and the subsystem output module is used for controlling a second display layer of the display screen used by the first subsystem so as to display the output of the first subsystem.
The embodiment of the present application further provides a computer-readable storage medium storing computer instructions, where the computer instructions are used to enable a computer to execute any one of the above multi-screen display control methods.
An embodiment of the present application further provides a multi-core heterogeneous on-chip integrated system, as shown in fig. 1, including a first subsystem 101 and a second subsystem 102, where the first subsystem is configured to execute any one of the above-mentioned multi-screen control methods to control at least two display screens connected to the multi-core heterogeneous on-chip integrated system; wherein the at least two display screens include the display screen used by the second subsystem 102.
According to an embodiment of the present application, the first subsystem 101 runs on a first hardware domain, and the second subsystem 102 runs on a second hardware domain; the hardware domain is used for distributing system resources of the multi-core heterogeneous on-chip integrated system to each subsystem, and the system resources in different hardware domains are isolated from each other. The system resources of the multi-core heterogeneous integrated system on chip include various components arranged on a super system-level chip on which the multi-core heterogeneous integrated system on chip operates, for example, components such as a plurality of computing units (multi-core), a plurality of allocable memory blocks, a plurality of power controllers, a plurality of clock controllers, a plurality of interrupt controllers, and the like.
According to one embodiment of the application, at least two display screens are located in a first hardware domain.
According to one embodiment of the application, at least two display screens are located in different hardware domains.
The embodiment of the present application further provides a chip, on which the above multi-core heterogeneous on-chip integrated system is operated, where the chip is also referred to as a super system-on-chip in the present application.
The embodiment of the application also provides a semiconductor integrated panel which is provided with the chip.
The embodiment of the application also provides an electronic component which is provided with the semiconductor integrated panel.
The embodiment of the application also provides a vehicle, and the vehicle is provided with the electronic component.
Here, it should be noted that: the above description on the data storage device of the embodiment, the above description on the embodiment of the multi-core heterogeneous on-chip integrated system, the above description on the embodiment of the computer storage medium, the above description on the embodiment of the chip, the above description on the embodiment of the semiconductor integrated panel, the above description on the embodiment of the electronic component, and the above description on the embodiment of the vehicle are similar to the description on the embodiment of the foregoing method, and have similar beneficial effects as the foregoing method embodiment, and therefore, no further description is given. For the descriptions of the data storage device in the embodiment of the present application, the above descriptions of the embodiments of the multi-core heterogeneous integrated system on chip, the above descriptions of the embodiments of the computer storage medium, the above descriptions of the embodiments of the chip, the above descriptions of the embodiments of the semiconductor integrated panel, the above descriptions of the embodiments of the electronic component, and the above descriptions of the embodiments of the vehicle, which have not been disclosed yet, please refer to the descriptions of the foregoing method embodiments of the present application for understanding, and therefore will not be described again for brevity.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a component of' 8230; \8230;" does not exclude the presence of another like element in a process, method, article, or apparatus that comprises the element.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of a unit is only one logical function division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another device, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units; can be located in one place or distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
Those of ordinary skill in the art will understand that: all or part of the steps for realizing the method embodiments can be completed by hardware related to program instructions, the program can be stored in a computer readable storage medium, and the program executes the steps comprising the method embodiments when executed; and the aforementioned storage medium includes: various media capable of storing program codes, such as a removable storage medium, a Read Only Memory (ROM), a magnetic disk, and an optical disk.
Alternatively, the integrated units described above in the present application may be stored in a computer-readable storage medium if they are implemented in the form of software functional modules and sold or used as independent products. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially implemented or portions thereof that contribute to the prior art may be embodied in the form of a software product stored in a storage medium, and including several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods of the embodiments of the present application. And the aforementioned storage medium includes: a removable storage medium, a ROM, a magnetic disk, an optical disk, or the like, which can store the program code.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (17)
1. A multi-screen display control method is applied to a first subsystem of a multi-core heterogeneous on-chip integrated system and comprises the following steps:
acquiring target resources to be displayed;
controlling at least two display screens connected with the multi-core heterogeneous on-chip integrated system to synchronously display the target resources on the at least two display screens;
wherein the at least two display screens include a display screen used by a second subsystem of the multi-core heterogeneous on-chip integrated system.
2. The method of claim 1, further comprising:
communicating with the second subsystem to acquire system state information of the second subsystem;
and controlling a display screen used by the second subsystem according to the system state information of the second subsystem so as to finish displaying the target resource.
3. The method of claim 1, further comprising:
acquiring configuration information of each display screen in the at least two display screens;
customizing the target resources according to the configuration information to obtain customized resources corresponding to each display screen;
accordingly, the synchronously displaying the target resource on the at least two display screens comprises:
and synchronously displaying the customized resources corresponding to each display screen on each display screen of the at least two display screens.
4. The method of claim 1, the target resource comprising at least two sub-resources that differ in display content,
the method further comprises the following steps:
acquiring a sub-resource corresponding to each display screen in the at least two display screens;
correspondingly, the synchronously displaying the target resource on the at least two display screens comprises:
and synchronously displaying the sub-resources corresponding to each display screen on each display screen of the at least two display screens.
5. The method of claim 1, the target resource being pre-stored in a target data storage area,
correspondingly, the obtaining of the target resource to be displayed includes:
loading the target data storage area to the first subsystem in a system starting process;
and acquiring the target resource to be displayed from the target data storage area.
6. The method of any of claims 1-5, each of the at least two display screens comprising at least two display layers,
correspondingly, the controlling at least two display screens connected to the multi-core heterogeneous on-chip integrated system to synchronously display the target resource on the at least two display screens includes:
and controlling a first display layer of each of at least two display screens connected with the multi-core heterogeneous on-chip integrated system to synchronously display the target resource on the at least two display screens.
7. The method of claim 6, the at least two display screens including a display screen used by the first subsystem, the method further comprising:
and controlling a second display layer of the display screen used by the first subsystem to display the output of the first subsystem.
8. A multi-screen display control device is applied to a first subsystem of a multi-core heterogeneous on-chip integrated system and comprises:
the target resource acquisition module is used for acquiring target resources to be displayed;
the multi-screen synchronous display module is used for controlling at least two display screens connected with the multi-core heterogeneous on-chip integrated system so as to synchronously display the target resources on the at least two display screens;
wherein the at least two display screens include a display screen used by a second subsystem of the multi-core heterogeneous on-chip integrated system.
9. A computer-readable storage medium having computer instructions stored thereon for causing a computer to perform the method of any one of claims 1-7.
10. A multi-core heterogeneous on-chip integrated system comprises a first subsystem and a second subsystem,
the first subsystem is used for executing the method of any one of claims 1 to 7 and controlling at least two display screens connected with the multi-core heterogeneous on-chip integrated system;
wherein the at least two display screens include a display screen used by the second subsystem.
11. The multi-core heterogeneous integrated-on-a-chip system of claim 10,
the first subsystem runs on a first hardware domain, and the second subsystem runs on a second hardware domain;
the hardware domain is used for distributing system resources of the multi-core heterogeneous on-chip integrated system to each subsystem, and the system resources in different hardware domains are isolated from each other.
12. The multi-core heterogeneous integrated-on-a-chip system of claim 11, the at least two display screens located in the first hardware domain.
13. The multi-core heterogeneous integrated-on-a-chip system of claim 11, the at least two display screens being located in different hardware domains.
14. A chip on which the multi-core heterogeneous on-chip integrated system of any one of claims 10-13 is run.
15. A semiconductor integrated panel provided with the chip of claim 14.
16. An electronic component provided with the semiconductor integrated panel claimed in claim 15.
17. A vehicle provided with the electronic component of claim 16.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310153667.4A CN115904295B (en) | 2023-02-21 | 2023-02-21 | Multi-screen display control method, device, medium, system, chip and panel |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310153667.4A CN115904295B (en) | 2023-02-21 | 2023-02-21 | Multi-screen display control method, device, medium, system, chip and panel |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115904295A true CN115904295A (en) | 2023-04-04 |
| CN115904295B CN115904295B (en) | 2023-05-26 |
Family
ID=85740928
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310153667.4A Active CN115904295B (en) | 2023-02-21 | 2023-02-21 | Multi-screen display control method, device, medium, system, chip and panel |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115904295B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101382861A (en) * | 2007-09-07 | 2009-03-11 | 英业达股份有限公司 | Mobile message display system and method thereof |
| CN101488332A (en) * | 2009-01-06 | 2009-07-22 | 东莞康特尔电子有限公司 | Screen display accelerated mixing system and method based on WinCE system |
| US20160328254A1 (en) * | 2014-01-06 | 2016-11-10 | Johnson Controls Technology Company | Vehicle with multiple user interface operating domains |
| CN106814666A (en) * | 2017-01-25 | 2017-06-09 | 浙江航芯科技有限公司 | The intelligent cockpit system of colour display |
| CN112579014A (en) * | 2019-09-27 | 2021-03-30 | 宝能汽车集团有限公司 | Multi-screen display method and system based on Hypervisor, vehicle and storage medium |
| CN114090496A (en) * | 2021-11-17 | 2022-02-25 | 南斗六星系统集成有限公司 | Single SOC multi-operation system device based on commercial vehicle cabin |
| CN114327930A (en) * | 2021-11-23 | 2022-04-12 | 北京智芯微电子科技有限公司 | System architecture for communication between heterogeneous multi-core and operation method of system architecture |
| CN114579072A (en) * | 2022-03-02 | 2022-06-03 | 南京芯驰半导体科技有限公司 | Display screen projection method and device across multiple operating systems |
| CN115357207A (en) * | 2022-10-18 | 2022-11-18 | 南京芯驰半导体科技有限公司 | Screen projection system and method based on heterogeneous SoC |
| CN115391061A (en) * | 2022-08-26 | 2022-11-25 | 南京芯驰半导体科技有限公司 | Device and method for operating application program across operating systems |
| CN115658160A (en) * | 2022-12-12 | 2023-01-31 | 南京芯驰半导体科技有限公司 | Multi-operating system upgrading method, device and system based on multi-core heterogeneous SOC |
-
2023
- 2023-02-21 CN CN202310153667.4A patent/CN115904295B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101382861A (en) * | 2007-09-07 | 2009-03-11 | 英业达股份有限公司 | Mobile message display system and method thereof |
| CN101488332A (en) * | 2009-01-06 | 2009-07-22 | 东莞康特尔电子有限公司 | Screen display accelerated mixing system and method based on WinCE system |
| US20160328254A1 (en) * | 2014-01-06 | 2016-11-10 | Johnson Controls Technology Company | Vehicle with multiple user interface operating domains |
| CN106814666A (en) * | 2017-01-25 | 2017-06-09 | 浙江航芯科技有限公司 | The intelligent cockpit system of colour display |
| CN112579014A (en) * | 2019-09-27 | 2021-03-30 | 宝能汽车集团有限公司 | Multi-screen display method and system based on Hypervisor, vehicle and storage medium |
| CN114090496A (en) * | 2021-11-17 | 2022-02-25 | 南斗六星系统集成有限公司 | Single SOC multi-operation system device based on commercial vehicle cabin |
| CN114327930A (en) * | 2021-11-23 | 2022-04-12 | 北京智芯微电子科技有限公司 | System architecture for communication between heterogeneous multi-core and operation method of system architecture |
| CN114579072A (en) * | 2022-03-02 | 2022-06-03 | 南京芯驰半导体科技有限公司 | Display screen projection method and device across multiple operating systems |
| CN115391061A (en) * | 2022-08-26 | 2022-11-25 | 南京芯驰半导体科技有限公司 | Device and method for operating application program across operating systems |
| CN115357207A (en) * | 2022-10-18 | 2022-11-18 | 南京芯驰半导体科技有限公司 | Screen projection system and method based on heterogeneous SoC |
| CN115658160A (en) * | 2022-12-12 | 2023-01-31 | 南京芯驰半导体科技有限公司 | Multi-operating system upgrading method, device and system based on multi-core heterogeneous SOC |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115904295B (en) | 2023-05-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2019072258A1 (en) | Method for controlling startup display picture of smart device, and smart device | |
| CN112644276B (en) | Screen display method, vehicle and computer storage medium | |
| CN111414205B (en) | Multi-screen linkage boot animation display system and implementation method | |
| KR101979138B1 (en) | Vehicle Mounting System | |
| US11842673B2 (en) | Control method and system for display switching, electronic device and storage medium | |
| JP7259571B2 (en) | VEHICLE CONTROL DEVICE, VEHICLE DISPLAY SYSTEM, AND VEHICLE DISPLAY CONTROL METHOD | |
| US10949226B2 (en) | Display method of multi-application based on Android system, and terminal device | |
| US10613874B2 (en) | Application execution apparatus and application execution method | |
| CN107888876B (en) | Vehicle-mounted information entertainment system and early image display method thereof | |
| CN111198666A (en) | Multi-screen starting animation linkage method based on Hypervisor and related equipment | |
| CN115904295B (en) | Multi-screen display control method, device, medium, system, chip and panel | |
| WO2023198190A1 (en) | Image display method and apparatus, and terminal device and storage medium | |
| CN107924317B (en) | Application program execution device and application program execution method | |
| CN109710352B (en) | Display method and device of boot animation | |
| US10417008B2 (en) | Application execution apparatus and application execution method | |
| CN111785229B (en) | Display method, device and system | |
| CN114942902A (en) | Display device and multiplexing method of memory module thereof | |
| US10705886B2 (en) | Synchronization of hardware units in data processing systems | |
| CN113703865B (en) | Cabin picture display method, control system, storage medium and control equipment | |
| CN115309466B (en) | Instrument system starting method and device and instrument equipment | |
| CN116176461B (en) | Display method, system, electronic equipment and storage medium of vehicle-mounted instrument interface | |
| CN110908624A (en) | Control method and system for screen abnormal display | |
| WO2024093546A1 (en) | Image display method and device for virtual machine | |
| CN113703865A (en) | Cabin picture display method, control system, storage medium and control equipment | |
| CN116028162A (en) | Mixed virtualization model based on hardware isolation, electronic equipment and vehicle cabin |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |