CN115756368A - Cross-platform display system, platform, vehicle and display method of human-computer interface - Google Patents

Abstract

The application relates to the technical field of automobile cabin display, in particular to a cross-platform display system, a platform, a vehicle and a display method of a human-computer interface, wherein the system comprises: the interface process module is deployed on one or more display platforms with any operating system, is used for displaying a human-computer interface in the display platform and performs human-computer interaction with a user; and the service logic module is deployed on any display platform, all the display platforms share the service logic module, and the service logic module is used for processing various signals at the bottom layer and events of the interface process module in each display platform to obtain a processing result, and controlling the interface process module corresponding to the display platform to update display data of the human-computer interface based on the processing result. Therefore, the problems that the same set of HMI software cannot support cross-platform deployment and the like in the related technology are solved.

Description

Cross-platform display system, platform, vehicle and display method of human-computer interface

Technical Field

The application relates to the technical field of automobile cabin display, in particular to a cross-platform display system, a cross-platform display platform, a cross-platform display vehicle and a cross-platform display method for a human-computer interface.

Background

HMI is an abbreviation for Human Machine Interface, also called Human Machine Interface. A human-machine interface (also called user interface or user interface) is a medium for interaction and information exchange between a system and a user, and it implements conversion between an internal form of information and a human-acceptable form.

At present, HMI (human machine interface) display in an automobile cabin tends to be integrated, and display contents of a vehicle machine and an instrument are fused with each other. Some automobiles even do not have a dashboard, but display dashboard information on a vehicle screen, while some automobiles project vehicle content to the dashboard for display. However, only the interaction between the vehicle machine and the instrument display screen is realized in the related art.

Disclosure of Invention

The application provides a cross-platform display system, a cross-platform display platform, a cross-platform display vehicle and a cross-platform display method for a human-computer interface, and aims to solve the problems that the same set of HMI software cannot support cross-platform deployment, cannot realize simultaneous display and update of multiple ends and the like in the related art.

An embodiment of a first aspect of the present application provides a cross-platform display system for a human-computer interface, including: the interface process module is deployed on one or more display platforms with any operating system, is used for displaying a human-computer interface in the display platform and performs human-computer interaction with a user; and the service logic module is deployed on any display platform, is shared by all the display platforms, and is used for processing various signals at the bottom layer and events of the interface process module in each display platform to obtain a processing result, and controlling the interface process module of the corresponding display platform to update the display data of the human-computer interface based on the processing result.

According to the technical means, the display platforms and the service logic can be completely separated, all the display platforms share the service logic module, the service logic module processes the bottom layer signals and the events of the middle interface process module of each display platform, the interface display module is driven to update the update of the display data of the human-computer interface based on the processing result, the same set of service logic can be realized, the update of the human-computer interfaces deployed at multiple ends is driven, and the reusability of the service logic module is improved.

Optionally, the interface process module includes: the interface rendering submodule is used for loading an interface definition file to obtain a plurality of interface elements, rendering the interface elements to obtain the human-computer interface and detecting an interaction event of the human-computer interface; the data source sub-module is bidirectionally bound with the interface rendering sub-module, display data are provided for the interface rendering sub-module, after the data source of the data source sub-module is updated, the display data of the human-computer interface are correspondingly updated by the interface rendering sub-module, and the interaction event is acquired; the data analysis submodule is used for receiving the target format data sent by the service logic module, analyzing the target format data according to the layer-by-layer organized format of the data source submodule to obtain an analysis result, and updating the data source of the data source submodule based on the analysis result; and the event processing submodule is used for monitoring the interaction event of the data source submodule, packaging the interaction event into the target format data and sending the target format data to the service logic module.

According to the technical means, the display modules of different operating systems can be bound to the specific data source, the update of each display platform is driven by the update of the data source, and the synchronous update of each display platform is realized.

Optionally, the interface definition file includes attributes and actions of all interface elements.

Optionally, the interface definition file is developed based on a cross-platform interface development tool.

Optionally, the interface elements include one or more of interface layout, event binding, data binding, state machine, and animation.

Optionally, the data source of the data source sub-module maintains data by using key value pairs.

Optionally, the service logic module includes: the data processing submodule is used for acquiring various signals at the bottom layer, carrying out corresponding processing according to the types of the signals to obtain processed data, and packaging the processed data into a protocol text in a target format; the event processing submodule is used for acquiring interaction events of human-computer interfaces in all the display platforms, processing and converting each interaction event, calling corresponding interfaces of the bottom layer, finishing control over various vehicle body parts and obtaining a control result; and the communication sub-module is used for carrying out cross-process communication or cross-platform communication with the interface process module, sending the protocol text or the control result to the interface process module, and updating the display data of the human-computer interface based on the protocol text or the control result.

According to the technical means, various bottom layer signals and interaction events of the human-computer interface can be acquired through the service logic module, the bottom layer signals and the interaction events of the human-computer interface are processed and the vehicle body components are controlled, and the control results or the protocol texts are used for communicating with the interface process module, so that the display data of the human-computer interface can be updated, data sources of different systems can be updated, and the purposes of updating a plurality of platform data and driving a plurality of platform interfaces to change through the same set of service logic are achieved.

Optionally, if the service logic module and the interface process module are deployed on the same display platform, a cross-process communication mode is adopted; and if the service logic module and the interface process module are deployed on different display platforms, adopting a cross-platform communication mode.

According to the technical means, different communication modes can be adopted according to whether the service logic module and the interface process module are deployed on the same display platform.

Optionally, the cross-platform display system is deployed in any operating system for development and verification during development.

According to the technical means, the cross-platform display system can be deployed in any operating system according to actual project requirements, so that cross-platform deployment is achieved.

An embodiment of a second aspect of the present application provides a display platform, including the cross-platform display system of the human-computer interface described in the foregoing embodiment, or an interface process module in the cross-platform display system of the human-computer interface described in the foregoing embodiment is deployed.

An embodiment of a third aspect of the present application provides a vehicle, comprising: one or more display platforms with any operating system, where each display platform is deployed with an interface process module in the cross-platform display system of the human-computer interface described in the above embodiment, and any one display platform in all the display platforms is deployed with a service logic module in the cross-platform display system of the human-computer interface described in the above embodiment, and all the display platforms share the service logic module.

An embodiment of a fourth aspect of the present application provides a cross-platform display method for a human-machine interface, where the method is applied to a cross-platform display system for a human-machine interface as described in the above embodiment, and includes the following steps: deploying an interface process module on one or more display platforms with any operating system to display a human-computer interface in the display platform and perform human-computer interaction with a user; deploying a service logic module on any display platform, processing various signals at the bottom layer and events of the interface process module in each display platform through the service logic module to obtain a processing result, and controlling the interface process module of the corresponding display platform to update display data of the human-computer interface based on the processing result, wherein all the display platforms share the service logic module.

Optionally, the controlling, based on the processing result, the interface process module of the corresponding display platform to update the display data of the human-computer interface includes: the interface process module acquires update data sent by the service logic module, wherein the update data comprises initial data when the interface process module is started and data generated based on external signal change; and the interface process module updates the data source of the interface process module according to the updating data and updates the display series of the human-computer interface based on the updated data source.

Optionally, the controlling, based on the processing result, the interface process module of the corresponding display platform to update the display data of the human-computer interface includes: the interface process module monitors various interaction events on the human-computer interface, packages the various interaction events into target format data and sends the target format data to the service logic module; the service logic module processes and converts each interactive event, calls a corresponding interface at the bottom layer, completes control on various vehicle body parts, obtains a control result, and sends the control result to the interface process module; and the interface process module updates the data source of the interface process module according to the control result, and updates the display series of the human-computer interface based on the updated data source.

Embodiments of the fifth aspect of the present application provide a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor, so as to implement the cross-platform display method for a human-computer interface according to the foregoing embodiments.

Therefore, the application has at least the following beneficial effects:

(1) According to the embodiment of the application, the display platforms can be completely separated from the service logic, all the display platforms share the service logic module, the service logic module processes the bottom layer signal and the events of the middle interface process module of each display platform, the interface display module is driven to update the update of the display data of the human-computer interface based on the processing result, the same set of service logic can be realized, the update of the human-computer interface deployed at multiple ends is driven, and the reusability of the service logic module is improved.

(2) According to the embodiment of the application, the display modules of different operating systems can be bound to a specific data source, and the update of each display platform is driven by the update of the data source.

(3) According to the embodiment of the application, various bottom layer signals and interaction events of the human-computer interface can be acquired through the service logic module, processed, and vehicle body parts are controlled, and communication is performed with the interface process module by using a control result or a protocol text, so that updating of display data of the human-computer interface is achieved, data sources of different systems can be updated, the purpose of updating a plurality of platform data through the same set of service logic, and the purpose of driving a plurality of platform interfaces to change is achieved.

(4) According to the embodiment of the application, different communication modes can be adopted according to whether the service logic module and the interface process module are deployed on the same display platform.

(5) According to the method and the device, the cross-platform display system can be deployed in any operating system according to actual project requirements, so that cross-platform deployment is achieved.

Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.

Drawings

The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

FIG. 1 is a block diagram illustrating a cross-platform display system of a human-machine interface according to an embodiment of the present disclosure;

FIG. 2 is a block diagram of a cross-platform display system of a human-machine interface provided in accordance with an embodiment of the present application;

FIG. 3 is a timing diagram for module initialization provided in accordance with an embodiment of the present application;

FIG. 4 is a flowchart of a cross-platform display method of a human-machine interface provided according to an embodiment of the present application;

FIG. 5 is a timing diagram illustrating data update according to an embodiment of the present application;

fig. 6 is a timing diagram of event processing provided according to an embodiment of the present application.

Detailed Description

Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary and intended to be used for explaining the present application and should not be construed as limiting the present application.

The interaction between the vehicle machine and the instrument is realized through the following scheme in the related technology:

(1) A system for vehicle-mounted machine and instrument interaction comprises an instrument processor, a vehicle-mounted machine processor and a data transmission line. According to the system, information on the vehicle machine can be reflected to the instrument end, so that interaction between the vehicle machine and the instrument is realized. The system solves the problem that vehicle information is projected to an instrument end, the transmission mode is video stream data, broadcasting and audio data, and the data volume is large.

(2) A system for enabling vehicle digital instrument and vehicle machine interaction, the system comprising: the system comprises an instrument processor, a vehicle processor and a data transmission line; utilize this system, in the use, can realize that the information that vehicle digital instrument shows and the information that the car machine shows are mutual, increase the interactivity between the two display screens, let the utilization ratio of display screen obtain improving, promoted user's use and experienced, further improved the practicality. The system solves the problem of interactivity between the vehicle machine and the instrument display screen, and transmitted vehicle-mounted multimedia information is also video stream information and/or other preset data format information.

However, the above system does not implement a set of HMI software that can be deployed across platforms according to actual project requirements.

The cross-platform display system, the platform, the vehicle and the display method of the human-computer interface according to the embodiment of the present application are described below with reference to the drawings. Aiming at the problems that HMI interface display in a cabin tends to be integrated at present, display contents of instruments of a car machine are fused with each other, but cross-platform deployment is not supported by the same set of HMI software, the application provides a cross-platform display system of a human-machine interface. Therefore, the problems that the same set of HMI software cannot support cross-platform deployment and the like in the related technology are solved.

Specifically, fig. 1 is a block diagram illustrating a cross-platform display system of a human-computer interface according to an embodiment of the present disclosure.

As shown in fig. 1, the cross-platform display system of the human-computer interface includes: an interface process module 100 and a business logic module 200.

In the embodiment of the application, the cross-platform display system is deployed in any operating system for development and verification during development.

Any operating system may include systems such as QNX, android, windows, and the like.

The interface process module 100 is deployed on one or more display platforms with any operating system, and is used for displaying a human-computer interface in the display platform and performing human-computer interaction with a user; the service logic module 200 is deployed on any display platform, and all the display platforms share the service logic module, and is configured to process various signals at the bottom layer and events of the interface process module in each display platform to obtain a processing result, and control the interface process module of the corresponding display platform to update display data of the human-computer interface based on the processing result.

The display platform can comprise a vehicle screen, an instrument screen, a handrail screen or a computer display screen and the like.

It can be understood that, in the embodiment of the present application, the interface process module is used for displaying a human-computer interface in the display platform and performing human-computer interaction with a user; the service logic module is responsible for processing all service logics, can be used for processing various signals at the bottom layer and events of the interface process module in the display platform to obtain a processing result, and controls the corresponding interface process module to update data in the human-computer interface by using the processing result.

In the embodiment of the present application, the interface process module 100 includes: the device comprises an interface rendering submodule, a data source submodule, a data analysis submodule and an event processing submodule.

The interface rendering submodule is used for loading an interface definition file to obtain a plurality of interface elements, rendering the interface elements to obtain a human-computer interface and detecting an interaction event of the human-computer interface; the data source submodule is in bidirectional binding with the interface rendering submodule and provides display data for the interface rendering submodule, and after the data source of the data source submodule is updated, the interface rendering submodule correspondingly updates the display data of the human-computer interface and acquires an interaction event; the data analysis submodule is used for receiving the target format data sent by the service logic module, analyzing the target format data according to the layer-by-layer organized format of the data source submodule to obtain an analysis result, and updating the data source of the data source submodule based on the analysis result; and the event processing submodule is used for monitoring the interaction event of the data source submodule, packaging the interaction event into target format data and sending the target format data to the service logic module.

The interface process module can be deployed on various systems such as QNX, android and Windows systems; the target format data may be json data.

It can be understood that, in the embodiment of the present application, the interface process module includes: the device comprises an interface rendering submodule, a data source submodule, a data analysis submodule and an event processing submodule.

The interface rendering submodule can load the interface definition file to obtain interface elements, render the interface elements to obtain a human-computer interface, and detect interaction events of the human-computer interface.

Wherein the interface elements include one or more of interface layout, event binding, data binding, state machine, and animation.

The interface definition file is obtained based on the development of a cross-platform interface development tool, namely a cross-platform UI development tool Kanzi, and comprises the properties and the actions of all interface elements, namely the properties and the actions of UI elements such as all interface layout, event binding, data binding, state machines, animations and the like.

It should be noted that, an interface (UI) module developed by using a Kanzi development tool, kanzi being a cross-platform UI development tool, may be rendered on multiple platforms by using the UI module developed by Kanzi. Exporting a unified UI definition file after development is finished: kzb, QNX, android and Windows platforms all have Kanzi UI rendering engines, and rendering engines corresponding to different systems can load the same kzb file to complete the drawing of UI and realize cross-platform rendering of the same set of UI.

The data source submodule defines all data required by the interface rendering submodule, the data source submodule and the interface rendering submodule are bound in a two-way mode, the same set of UI can be deployed on different system platforms, the interface rendering submodule can automatically refresh after the data source changes, and the data source can be informed after the interface rendering submodule generates an interaction event.

In the embodiment of the present application, the data source may be maintained in a key-value pair manner.

For example, light data caching: "led": { "turnleft":0 "," turnright ":1}; where "led" represents a key of the lighting data, its value is a data set, containing multiple key value pairs. { "turnleft":0, "turnright":1} represents all the light related data, and the inside of the data is also the nested structure of key value pairs, "turnleft":0 represents that the left turn light is off, and "turnright":1 represents that the right turn light is on. Each UI element within the Kanzi UI will bind to the data source, when the data state within the data source is "led": 0, the left turn light is automatically turned off. When the data state within the data source changes to "led": when the left turn light is turned on, 1.

The data analysis submodule is responsible for receiving target format data (json data) from the business logic, calling a relevant API (application program interface) to update a data source after the data is obtained in a universal analysis mode, and driving an interface to refresh. When the data source is updated, the format of the key acquired from the Json exactly corresponds to the layer-by-layer organization format of the data source module data, and each layer is separated by "", for example, { "key": led. Through the corresponding relation, the data analysis module can analyze the data in a unified mode and then update the data source without special processing for each key.

It should be noted that the update of the data source can be completed by using a lightweight data protocol, and data is exchanged between different systems through the lightweight data protocol, so that a set of service logic drives the update of different display systems.

The event processing submodule is responsible for monitoring and responding to events of the data source submodule, packaging the events into target format data and sending the target format data to the business logic process.

In the embodiment of the present application, the service logic module 200 includes: the device comprises a data processing sub-module, an event processing sub-module and a communication sub-module.

The data processing submodule is used for acquiring various signals at the bottom layer, carrying out corresponding processing according to the types of the signals to obtain processed data, and packaging the processed data into a protocol text in a target format; the event processing submodule is used for acquiring interaction events of human-computer interfaces in all the display platforms, processing and converting each interaction event, calling corresponding interfaces of the bottom layer, finishing control over various vehicle body parts and obtaining a control result; and the communication sub-module is used for carrying out cross-process communication or cross-platform communication with the interface process module, sending the protocol text or the control result to the interface process module, and updating the display data of the human-computer interface based on the protocol text or the control result.

It should be noted that the service logic module is responsible for processing all service logics, the module may be deployed in a QNX system, or in an Android or Windows system, and the like, and the service logic module includes sub-modules for data processing, event processing, communication, and the like.

The target format may be a json format.

It can be understood that the data processing sub-module is responsible for acquiring various signals of a bottom layer, then correspondingly processing the signals, and encapsulating the data into a json-format protocol text, wherein the json-format protocol decouples service logic and data, so that different system platforms can obtain consistent data; the event processing submodule is responsible for receiving interaction events from human-computer interfaces in all display platforms, then carrying out corresponding processing or conversion on each event, calling related interfaces at the bottom layer and finishing control on various vehicle body parts; the communication sub-module is responsible for completing cross-process communication or cross-platform communication with other systems, sending a protocol text or a control result to the interface process module, and further updating display data of the human-computer interface.

In the embodiment of the application, if the service logic module and the interface process module are deployed on the same display platform, a cross-process communication mode is adopted; if the service logic module and the interface process module are deployed on different display platforms, a cross-platform communication mode is adopted.

For example, if the instrument interface process sent to the QNX belongs to cross-process communication in the same display platform, data may be sent in a cross-process communication manner in the QNX system.

Specifically, the service logic module takes a turn signal service as an example, after obtaining a turn signal from the bottom layer, performs related processing, and then encapsulates the data into a json format protocol, [ { "key": led.turn "," type ": int", "value":0}, { "key": led.turn "," type ":1}, ]

Where "key" represents data that needs to be updated, "type" represents the type of data that needs to be updated, "value" represents a value that needs to be updated, and the above example represents that light-related data needs to be updated: 1) Turning off the left turn light; 2) The right turn light is turned on.

The cross-platform display system based on the human-computer interface described in the above embodiment is shown in fig. 2.

1. The UI (interface) process is responsible for presentation of the UI interface and interaction with the user. The system mainly comprises modules of Kanzi UI, dataSource, data analysis, event processing and the like. UI processes may be deployed in QNX, android, and Windows systems.

(1) Kanzi UI: the UI module developed by using the Kanzi development tool, wherein the Kanzi is a cross-platform UI development tool, and the UI module developed by using the Kanzi can be rendered on a plurality of platforms. Exporting a unified UI definition file after development is finished: kzb, QNX, android and Windows platforms all have Kanzi UI rendering engines, rendering engines corresponding to different systems can load the same kzb file to complete drawing of the UI, and cross-platform rendering of the same set of UI is realized.

(2) Data Source: the data source module defines all data required by the UI interface, the UI and the data source are bound in a bidirectional mode, and the UI can be automatically refreshed after the data source is changed; and after the interaction event occurs on the UI interface, the data source is informed. And the data source is maintained in a key value pair mode. The binding of the UI and the data is realized through the DataSource module, so that the same set of UI can be deployed on different system platforms.

(3) A data analysis module: the method is used for receiving json data from a business logic process, calling a relevant API (application program interface) to update a data source (data source) after the data is obtained in a general analysis mode, and driving the interface to be refreshed. When the data source is updated, the format of the key acquired from the Json exactly corresponds to the layer-by-layer organization format of the data source module data, and each layer is separated by "", for example, { "key": led. Through the corresponding relation, the data analysis module can analyze the data in a unified mode and then update the data source without special processing for each key.

(4) An event processing module: and the system is responsible for monitoring the event of the DataSource module, responding, packaging the event into json data and sending the json data to the business logic process.

2. The service logic process is responsible for processing all service logics, the module can be deployed in a QNX system or an Android or Windows system, and the service logic module comprises submodules for data processing, event processing, socket communication and the like.

(1) A data processing module: the method is used for acquiring various signals of a bottom layer, correspondingly processing the signals, packaging the data into a json format protocol text, transmitting the data to all UI processes through cross-platform communication, and decoupling service logic and data by the json format protocol so that different system platforms can obtain consistent data.

(2) An event processing module: the system is responsible for receiving events from all UI processes, then carrying out corresponding processing or conversion aiming at each event, and calling related interfaces at the bottom layer to complete the control of various body parts.

(3) Socket communication module: and the system is responsible for completing cross-platform communication with other systems. If the data are sent to the instrument UI process of the QNX, the data belong to cross-process communication in the same system, and the data can be sent in a cross-process communication mode in the QNX system.

(4) And if the business logic module and the UI process belong to cross-process communication in the same system, directly sending data in a cross-process communication mode in the system. If the communication belongs to cross-system communication, the transmission is carried out in a Socket mode.

In conclusion, if the same set of HMI software can support cross-platform deployment according to actual project requirements, the HMI software can be deployed on a vehicle machine and an instrument, even can be deployed and debugged on a windows system without depending on a hardware environment during debugging, development time is greatly shortened, and development efficiency and code reuse rate are improved; display modules deployed by a vehicle machine, an instrument or a windows computer and the like are all bound to a specific data source, a service logic module drives the change of data in the data source, and the change of the data drives the update of an interface display module, so that the same service logic can be realized, and the rendering of the interface display modules deployed at multiple ends is driven; different display systems all rely on the updating of data sources, the updating of the data sources can be completed by using a lightweight data protocol, data are exchanged between the different systems through the lightweight data protocol, the updating of a set of service logic driving different display systems is realized, the reusability of service logic modules is improved, the display contents of the vehicle machine and the instrument can be always kept consistent, and the possibility of errors is reduced.

It should be noted that before the implementation of the cross-platform display system of the human-machine interface, each module needs to be initialized, as shown in fig. 3, the method includes the following steps:

1. the Android UI process performs data binding, event binding and display of an initialization interface;

2. the QNX UI process performs data binding, event binding and display of an initialization interface;

3. the Windows UI process performs data binding, event binding and display of an initialization interface;

4. establishing communication Socket connection between the Android UI process and the service logic process;

5. establishing communication Socket connection between the QNX UI process and the service logic process;

6. and the Windows UI process and the business logic process establish communication Socket connection.

According to the cross-platform display system of the human-computer interface, provided by the embodiment of the application, the display platforms can be completely separated from the service logic, all the display platforms share the service logic module, the service logic module processes the bottom layer signal and the event of the middle interface process module of each display platform, the interface display module is driven to update the update of the human-computer interface display data based on the processing result, the same set of service logic can be realized, the update of the human-computer interface deployed at multiple ends is driven, and the reusability of the service logic module is improved; display modules of different operating systems can be bound to a specific data source, and the update of each display platform is driven by the update of the data source; various bottom layer signals and interaction events of the human-computer interface at the bottom layer can be acquired through the service logic module, processed and used for controlling the vehicle body part, and the control result or the protocol text is used for communicating with the interface process module, so that the updating of display data of the human-computer interface is realized, data sources of different systems can be updated, the purposes of updating a plurality of platform data through the same set of service logic and driving a plurality of platform interfaces to change are achieved; different communication modes can be adopted according to whether the service logic module and the interface process module are deployed on the same display platform or not; the cross-platform display system can be deployed in any operating system according to actual project requirements, so that cross-platform deployment is achieved.

The application also provides a display platform, which comprises the cross-platform display system of the human-computer interface of the embodiment or an interface process module in the cross-platform display system of the human-computer interface of the embodiment.

The present application provides a vehicle, comprising: one or more display platforms with any operating system, wherein each display platform is provided with an interface process module in the cross-platform display system of the human-computer interface in the above embodiment, any one display platform in all the display platforms is provided with a service logic module in the cross-platform display system of the human-computer interface in the above embodiment, and all the display platforms share the service logic module.

Next, a cross-platform display method of a human-machine interface according to an embodiment of the present application is described with reference to the drawings.

Fig. 4 is a flowchart of a cross-platform display method of a human-machine interface according to an embodiment of the present application.

As shown in fig. 4, the cross-platform display method of the human-computer interface is applied to the cross-platform display system of the human-computer interface of the above embodiment, and includes the following steps: .

In step S101, the interface process module is deployed on one or more display platforms having any operating system to display a human-computer interface in the display platform and perform human-computer interaction with a user.

The operating system may be a QNX, android, windows system, or the like.

It can be understood that, in the embodiment of the present application, the interface process module is deployed on a display platform with any operating system, and is used for displaying a human-computer interface in the display platform to implement human-computer interaction.

In step S102, a service logic module is deployed on any display platform, the service logic module processes various signals at the bottom layer and events of interface process modules in each display platform to obtain a processing result, and the interface process modules of the corresponding display platforms are controlled to update display data of the human-computer interface based on the processing result, wherein all the display platforms share the service logic module.

It can be understood that, in the embodiment of the present application, the service logic module is deployed on any display platform, all the display platforms share the service logic module, and the service logic module is configured to process various signals at the bottom layer and events of the interface process module, and can control the interface process module to update display data of the human-computer interface, thereby implementing the same set of service logic and driving rendering of the display modules deployed at multiple ends.

In this embodiment of the present application, controlling, based on the processing result, the interface process module corresponding to the display platform to update the display data of the human-computer interface includes: the method comprises the steps that an interface process module obtains updating data sent by a service logic module, wherein the updating data comprise initial data when the interface process module is started and data generated based on external signal change; and the interface process module updates the data source of the interface process module according to the updating data, and updates the display series of the human-computer interface based on the updated data source.

It can be understood that, in the embodiment of the present application, the interface process module may update the data source of the interface process module according to the update data sent by the service logic module, and update the display data of the human-computer interface according to the data source.

It should be noted that, in the embodiment of the present application, data and service logic are mapped through a specific data protocol, and a same set of service logic can update data sources of different systems through the specific protocol, so as to achieve the purpose that the same set of service logic updates multiple platform data and drives multiple platform interfaces to change.

Specifically, the step of updating data, as shown in fig. 5, includes:

1. after starting each UI process, initiating a request for acquiring initial data to a service process;

2. returning initial data by the service process;

3. after each UI process acquires data, updating a DataSource data source;

4. after the data source is changed, driving the UI to refresh;

5. after the external signal changes, notifying the business logic process;

6. the business logic process carries out corresponding signal processing and updates data;

7. the service logic process sends the data to the Android UI process through Socket in a json format;

8. the business logic process sends the data to the QNX UI process through Socket in a json format;

9. the business logic process sends the data to the Windows UI process through Socket in a json format;

10. after each UI process obtains data change, updating a DataSource data source;

11. and driving each UI process interface to be refreshed after the data source is changed.

In the embodiment of the application, the step of controlling the interface process module corresponding to the display platform to update the display data of the human-computer interface based on the processing result comprises the following steps: the interface process module monitors various interaction events on the human-computer interface, packages the various interaction events into target format data and sends the target format data to the service logic module; the service logic module processes and converts each interactive event, calls a corresponding interface at the bottom layer, completes control on various vehicle body parts, obtains a control result, and sends the control result to the interface process module; and the interface process module updates the data source of the interface process module according to the control result and updates the display data of the human-computer interface based on the updated data source.

The target format data may be json data.

It can be understood that, in the embodiment of the present application, after an event occurs on an interface, the event is encapsulated into target format data by the corresponding bound event processing module, and the target format data is sent to the service logic module, and the service logic module performs event processing and conversion, and sends a control result to the interface process module, and the interface process module refreshes each display module and updates display data by the steps described in the above embodiment again.

Specifically, the event processing steps, as shown in fig. 6, include:

1. each UI process circularly monitors various interaction events on the interface;

2. if an event occurs, the event is encapsulated into json data and sent to a business logic process;

3. the business logic process processes the event, and if the external module does not need to be notified, the data is directly processed and then sent to the UI process;

4. if the external module needs to be notified, calling a bottom layer interface to send a signal to the external module, processing data after a response signal is obtained, and then sending the data to the UI process;

5. after each UI process obtains data change, updating a DataSource data source;

6. and driving each UI process interface to be refreshed after the data source is changed.

The cross-platform display method of the human-computer interface is described by a specific embodiment, and comprises the following steps:

1. and developing HMI layer software by using a cross-platform UI development tool Kanzi, wherein only one set of software can be developed and can be deployed in QNX, android and Windows systems.

2. The Kanzi tool is used to complete the development of UI (interface) layout, event binding, data binding, state machine, animation and other modules, and then the kzb file is exported. The kzb file is a UI definition file, and the properties and actions of all UI elements such as UI layout, event binding, data binding, state machine, animation, etc. are defined in the kzb file through a specific protocol.

3. Reading kzb files by using a Kanzi rendering engine, respectively realizing the rendering of UI (user interface) in QNX (QNX), android and Windows systems, and finishing event binding and data binding.

4. Each element of the interface is bound to a data source (DataSource), the change of the data source directly drives the refreshing of the UI interface, and the aim of binding the UI and the data is achieved through the DataSource module, so that the same UI can achieve interactive consistency in different systems.

5. The service logic module is deployed in a single system, data is transmitted to other systems with HMI software deployed in a cross-platform communication mode, the exchanged data formats correspond to data defined in data sources one to one, and after different systems receive the data, the corresponding data sources are updated, and the change of a display interface is controlled. The data and the service logic are mapped through a specific data protocol, and the same set of service logic can update data sources of different systems through the specific protocol, so that the purposes of updating a plurality of platform data and driving a plurality of platform UI (user interface) to change through the same set of service logic are achieved.

6. And after the interface generates an event, sending the event to the service logic module in a cross-platform communication mode through the bound event response processing module, processing the event by the service logic module, and updating corresponding data. And after the data are updated, refreshing each display module through the step 5 again.

It should be noted that the explanation of the foregoing cross-platform display system embodiment of the human-computer interface is also applicable to the cross-platform display method of the human-computer interface of the embodiment, and details are not described here.

According to the cross-platform display method of the human-computer interface, only one set of human-computer interface can be developed, cross-system deployment is supported, and display on multiple screens such as a vehicle screen, an instrument screen, a handrail screen and a computer display screen is achieved; the service logic module can be reused, is independently deployed, and drives other platform HMI (human machine interface) display software to refresh by using light-weight data in a cross-platform communication mode; the development and debugging stage does not depend on a hardware environment, the windows system is directly deployed, the technical scheme and prototype verification are carried out, the dependence on the hardware environment is reduced, the display effect is irrelevant to equipment and the system, and the development cost is saved.

Embodiments of the present application further provide a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the cross-platform display method of a human-computer interface as above.

In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or N embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.

Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "N" means at least two, e.g., two, three, etc., unless specifically limited otherwise.

Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more N executable instructions for implementing steps of a custom logic function or process, and alternate implementations are included within the scope of the preferred embodiment of the present application in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present application.

It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the N steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. If implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a programmable gate array, a field programmable gate array, or the like.

It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.

Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.

Claims (15)

1. A cross-platform display system of a human-computer interface, comprising:

the interface process module is deployed on one or more display platforms with any operating system, is used for displaying a human-computer interface in the display platform and performs human-computer interaction with a user;

and the service logic module is deployed on any display platform, is shared by all the display platforms, and is used for processing various signals at the bottom layer and events of the interface process module in each display platform to obtain a processing result, and controlling the interface process module of the corresponding display platform to update the display data of the human-computer interface based on the processing result.

2. The system of claim 1, wherein the interface process module comprises:

the interface rendering submodule is used for loading an interface definition file to obtain a plurality of interface elements, rendering the interface elements to obtain the human-computer interface and detecting an interaction event of the human-computer interface;

the data source sub-module is bidirectionally bound with the interface rendering sub-module, display data are provided for the interface rendering sub-module, after the data source of the data source sub-module is updated, the display data of the human-computer interface are correspondingly updated by the interface rendering sub-module, and the interaction event is acquired;

the data analysis submodule is used for receiving the target format data sent by the service logic module, analyzing the target format data according to the layer-by-layer organized format of the data source submodule to obtain an analysis result, and updating the data source of the data source submodule based on the analysis result;

and the event processing submodule is used for monitoring the interaction event of the data source submodule, packaging the interaction event into the target format data and sending the target format data to the service logic module.

3. The system of claim 2, wherein the interface definition file includes attributes and actions for all interface elements.

4. The system of claim 2, wherein the interface definition file is developed based on a cross-platform interface development tool.

5. The system of any of claims 2-4, wherein the interface elements include one or more of interface layout, event binding, data binding, state machine, and animation.

6. The system of claim 2, wherein the data source of the data source submodule maintains data using key-value pairs.

7. The system of claim 1, wherein the business logic module comprises:

the data processing submodule is used for acquiring various signals at the bottom layer, carrying out corresponding processing according to the types of the signals to obtain processed data, and packaging the processed data into a protocol text in a target format;

the event processing submodule is used for acquiring interaction events of human-computer interfaces in all the display platforms, processing and converting each interaction event, calling corresponding interfaces of the bottom layer, finishing control over various vehicle body parts and obtaining a control result;

and the communication sub-module is used for carrying out cross-process communication or cross-platform communication with the interface process module, sending the protocol text or the control result to the interface process module, and updating the display data of the human-computer interface based on the protocol text or the control result.

8. The system according to claim 7, wherein if the service logic module and the interface process module are deployed on the same display platform, a cross-process communication mode is adopted; and if the service logic module and the interface process module are deployed on different display platforms, adopting a cross-platform communication mode.

9. The system of claim 1, wherein the cross-platform display system is deployed in any operating system for development and verification at development time.

10. A display platform, characterized in that it comprises a cross-platform display system of a human-machine interface according to any one of claims 1 to 9, or an interface process module in a cross-platform display system of a human-machine interface according to any one of claims 1 to 9.

11. A vehicle, characterized by comprising:

one or more display platforms having any operating system wherein,

an interface process module in the cross-platform display system of the human-computer interface according to any one of claims 1 to 9 is deployed on each display platform, a service logic module in the cross-platform display system of the human-computer interface according to any one of claims 1 to 9 is deployed on any one of all the display platforms, and all the display platforms share the service logic module.

12. A cross-platform display method of a human-computer interface, which is applied to the cross-platform display system of the human-computer interface according to any one of claims 1 to 9, wherein the method comprises the following steps:

deploying an interface process module on one or more display platforms with any operating system to display a human-computer interface in the display platform and perform human-computer interaction with a user;

deploying a service logic module on any display platform, processing various signals at the bottom layer and events of the interface process module in each display platform through the service logic module to obtain a processing result, and controlling the interface process module of the corresponding display platform to update display data of the human-computer interface based on the processing result, wherein all the display platforms share the service logic module.

13. The method according to claim 12, wherein the controlling the interface progress module of the corresponding display platform to update the display data of the human-machine interface based on the processing result comprises:

the interface process module acquires update data sent by the service logic module, wherein the update data comprises initial data when the interface process module is started and data generated based on external signal change;

and the interface process module updates the data source of the interface process module according to the updating data and updates the display data of the human-computer interface based on the updated data source.

14. The method according to claim 12, wherein the controlling the interface progress module of the corresponding display platform to update the display data of the human-computer interface based on the processing result comprises:

the interface process module monitors various interaction events on the human-computer interface, packages the various interaction events into target format data and sends the target format data to the service logic module;

the service logic module processes and converts each interactive event, calls a corresponding interface at the bottom layer, completes control on various vehicle body parts, obtains a control result, and sends the control result to the interface process module;

and the interface process module updates the data source of the interface process module according to the control result, and updates the display series of the human-computer interface based on the updated data source.

15. A computer-readable storage medium, on which a computer program is stored, the program being executable by a processor for implementing a cross-platform display method of a human-machine interface according to any one of claims 12 to 14.

Images