CN113296658A

CN113296658A - Multi-screen interaction control method and system and electronic equipment

Info

Publication number: CN113296658A
Application number: CN202010109323.XA
Authority: CN
Inventors: 周凯
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2020-02-22
Filing date: 2020-02-22
Publication date: 2021-08-24

Abstract

The multi-screen interaction control method comprises the following steps: acquiring a device identifier of a newly accessed screen according to a first callback message transmitted when a response screen is newly accessed; controlling a graphic engine to create a corresponding graphic engine instance according to the equipment identifier of the newly accessed screen; transmitting the identification of the graphic engine instance to the created main interactive service engine instance, so that the main interactive service engine instance derives a slave interactive service engine instance corresponding to the new access screen; and recording the master-slave relationship of the master interactive service engine instance and the slave interactive service engine instance. By adopting the scheme, the universality of the multi-screen interaction technology can be improved.

Description

Multi-screen interaction control method and system and electronic equipment

Technical Field

The embodiment of the specification relates to the technical field of multi-screen interaction, in particular to a multi-screen interaction control method, a multi-screen interaction control system and electronic equipment.

Background

At present, more and more automobiles realize multi-screen interaction, and the most obvious characteristic of multi-screen interaction is that the multi-screen interaction can integrate more functions and meet different riding requirements of main and auxiliary drivers, rear-row users and the like. The multi-screen interaction can be divided into local multi-screen interaction and remote multi-screen interaction, wherein the local multi-screen interaction refers to cooperative display and interaction control among a plurality of display screens in the same space, for example, cooperative display and interaction control among a vehicle-mounted center control display screen, an instrument panel display screen and a display screen in a backseat area; the remote multi-screen interaction means cooperative display and interactive control among a plurality of display screens located in different spaces, for example, the mobile terminal (mobile phone terminal), the computer terminal and the vehicle terminal can realize cooperative display and interactive control of the display screens at different terminals through an intercommunicated account system.

In order to adapt to the development trend of multi-screen interaction technology and meet the user requirements, travel applications (such as map navigation applications) supporting multi-screen interaction begin to appear. Due to the fact that the screen size and the resolution of the display screen are different, the interaction modes are different, and if each piece of display screen capable of interacting is added, targeted development is needed, the problem that function support is not timely occurs, and therefore the multi-screen interaction technology with high universality is provided and needs to be solved by technical personnel in the field.

Disclosure of Invention

In view of this, embodiments of the present specification provide a multi-screen interaction control method, a multi-screen interaction control system, and an electronic device, which have strong versatility.

An embodiment of the present specification provides a multi-screen interaction control method, including:

acquiring a device identifier of a newly accessed screen according to a first callback message transmitted when a response screen is newly accessed;

controlling a graphic engine to create a corresponding graphic engine instance according to the equipment identifier of the newly accessed screen;

transmitting the identification of the graphic engine instance to the created main interactive service engine instance, so that the main interactive service engine instance derives a slave interactive service engine instance corresponding to the new access screen;

recording the master-slave relationship between the master interactive service engine instance and the slave interactive service engine instance;

and controlling the graphic engine instance corresponding to the new access screen from the interactive service engine instance corresponding to the new access screen to output corresponding core service information, interactive service information and graphic elements to the new access screen by combining the core service data output by the core service engine, the interactive service data output by the interactive service engine and the graphic data output by the graphic engine.

Optionally, the method further comprises:

acquiring the equipment identifier of the disconnected screen according to a second callback message transmitted when the response screen is disconnected;

according to the device identification of the disconnected screen, canceling the master-slave relationship between the slave interactive service engine instance and the master interactive service engine instance corresponding to the disconnected screen;

destroying, by the master interactive service engine instance, a slave interactive service engine instance corresponding to the disconnected screen;

and destroying the graphic engine instance corresponding to the disconnected screen.

Optionally, the method further comprises: determining whether to deliver the message to all or part of the interaction service engine instances according to the type of the received message, including:

transmitting the received global message to a master interactive service engine instance and synchronizing to a slave interactive service engine instance, so that the master interactive service engine instance and the slave interactive service engine instance respectively perform corresponding processing based on the global message;

and transmitting the received non-global message to the corresponding interactive service engine instance, so that the corresponding interactive service engine instance performs corresponding processing based on the non-global message.

Optionally, the transmitting the received global message to a master interactive service engine instance and synchronizing to a slave interactive service engine instance, so that the master interactive service engine instance and the slave interactive service engine instance respectively perform corresponding processing based on the global message includes:

and respectively transmitting the core service updating information transmitted by the core service engine to the main interactive service engine instance and the auxiliary interactive service engine instance, so that the main interactive service engine instance and the auxiliary interactive service engine instance respectively control the corresponding graphic engine instance to update the corresponding graphic elements in the screen according to the core service updating information based on the received core service updating information.

Optionally, the transmitting the received non-global message to a corresponding interactive service engine instance, so that the corresponding interactive service engine instance performs corresponding processing based on the non-global message, includes:

acquiring a command for switching the screen view angle transmitted in response to the detection of the switching of the screen view angle;

and transmitting the instruction for switching the screen view angle to the corresponding interactive service engine instance, so that the corresponding interactive service engine instance controls the corresponding interactive service engine instance to output the corresponding graphic element according to the corresponding graphic engine instance parameter after the screen view angle is switched according to the instruction for switching the screen view angle.

Optionally, the transmitting the received non-global message to the corresponding interactive service engine instance, so that the corresponding service engine instance performs corresponding processing based on the non-global message, includes:

receiving an interactive service engine control instruction or a core service engine control instruction transmitted in response to an interactive control operation;

transmitting the interactive service engine control instruction or the core service engine control instruction to the main interactive service engine instance, and correspondingly transmitting the main interactive service engine instance to the interactive service engine or the core service engine;

and respectively transmitting the state information transmitted by the interactive service engine or the core service engine to the corresponding interactive service engine instances, and controlling the corresponding graphic engine instances by each interactive service engine instance to execute the processing operation corresponding to the interactive service control instruction or the core service engine control instruction.

Optionally, when the master interactive service engine instance derives a slave interactive service engine instance corresponding to the new access screen, the method further includes:

and the master interactive service engine instance sets the parameters of the slave interactive service engine instance.

Optionally, the graphics engine comprises: the map engine is suitable for controlling the corresponding map engine instance to output map elements based on the map data;

the core business engine comprises a positioning engine, and the positioning engine is suitable for comprehensively calculating the current coordinates of the user based on the measurement data from the positioning sensor and the acquired route planning data to obtain positioning data;

the interactive service engine comprises a navigation engine, and the navigation engine is suitable for outputting user navigation guide information according to the positioning data and the route planning data output by the positioning engine;

the interactive service engine example comprises a trip engine example, and the trip engine example is suitable for controlling the corresponding map engine example to output the corresponding map element and the user navigation guide information to a screen by combining the positioning data and the user navigation guide information.

An embodiment of the present specification further provides a multi-screen interaction control system, where the system includes:

the interactive interface is suitable for receiving a first callback message transmitted when a screen is newly accessed;

the central processing unit is suitable for acquiring the equipment identifier of a new access screen based on the first callback message, controlling a graphic engine to create a corresponding graphic engine instance and transmitting the graphic engine instance to a created main interactive service engine instance, so that the main interactive service engine instance derives a slave interactive service engine instance corresponding to the new access screen and records the master-slave relationship between the main interactive service engine instance and the slave interactive service engine instance;

and the slave interactive service engine instance corresponding to the new access screen is suitable for combining the core service data output by the core service engine, the interactive service data output by the interactive service engine and the graphic data output by the graphic engine, and controlling the graphic engine instance corresponding to the new access screen to output the corresponding core service information, interactive service information and graphic elements to the new access screen through the interactive interface of the new screen.

An embodiment of the present specification further provides another multi-screen interaction control system, where the system includes:

the central processing unit is suitable for creating a graphic engine, a core service engine, an interactive service engine, a message center and a user interactive interface when a service application program is started, and creating a corresponding main interactive service engine instance based on the interactive service engine when an instruction for starting the interactive service is acquired through the user interactive interface of the main screen; acquiring a device identifier of a newly accessed screen according to a first callback message transmitted when a response screen is newly accessed, controlling the graphic engine to create a corresponding graphic engine instance according to the device identifier of the newly accessed screen, and transmitting the identifier of the graphic engine instance to the main interactive service engine instance;

a core service engine adapted to output core service data;

an interactive service engine adapted to output interactive service data;

a graphics engine adapted to output graphics data;

the interactive service engine instances are in one-to-one correspondence with the screens and are suitable for combining the core service data output by the core service engine, the interactive service data output by the interactive service engine and the graphic data output by the graphic engine to control the graphic engine instances corresponding to the screens to output the corresponding core service information, the interactive service information and the graphic elements to the corresponding screens; the interactive service engine instance comprises a main interactive service engine instance and a slave interactive service engine instance, wherein the main interactive service engine instance is suitable for deriving a slave interactive service engine instance corresponding to a new access screen according to the received identification of the graphic engine instance corresponding to the new access screen;

the message center is suitable for communicating with the central processing unit, the core service engine, the interactive service engine and each interactive service engine instance in a message distribution and subscription mode, and recording the master-slave relationship between the master interactive service engine instance and the slave interactive service engine instance.

Optionally, the central processing unit is further adapted to obtain, according to a second callback message transmitted in response to the screen disconnection, an equipment identifier of the disconnected screen, and instruct the message center to cancel a master-slave relationship between a slave interaction service engine instance corresponding to the disconnected screen and the master interaction service engine instance, instruct the master interaction service engine instance to destroy the slave interaction service engine instance corresponding to the disconnected screen, and destroy the graphics engine instance corresponding to the disconnected screen;

and the message center is suitable for canceling the master-slave relationship between the slave interactive service engine instance and the master interactive service engine instance corresponding to the disconnected screen according to the equipment identifier of the disconnected screen.

Optionally, the message center is further adapted to determine whether to deliver the message to all or part of the interactive service engine instances according to the type of the received message, and includes: and transmitting the received global message to the master interactive service engine instance and synchronizing the received global message to the slave interactive service engine instance, so that the master interactive service engine instance and the slave interactive service engine instance respectively perform corresponding processing based on the global message, and transmitting the received non-global message to the corresponding interactive service engine instance, so that the corresponding interactive service engine instance performs corresponding processing based on the non-global message.

Optionally, the message center is adapted to transmit core service update information transmitted by the core service engine to the master interactive service engine instance and the slave interactive service engine instance, respectively, so that the master interactive service engine instance and the slave interactive service engine instance update corresponding graphic elements in the screen according to the core service update information.

Optionally, the central processing unit is adapted to obtain an instruction for switching a screen view, which is transmitted in response to detecting that the screen view is switched, and transmit the instruction to the message center;

the message center is also suitable for transmitting the instruction for switching the screen view angle to the corresponding interactive service engine instance, so that the corresponding interactive service engine instance controls the corresponding graphic engine instance to output graphic elements according to the graphic engine instance parameters after the screen view angle is switched according to the instruction for switching the screen view angle.

Optionally, the central processing unit is adapted to receive an interactive service engine control instruction or a core service engine control instruction transmitted in response to an interactive control operation and transmit the interactive service engine control instruction or the core service engine control instruction to the message center;

the message center is suitable for transmitting the interactive service engine control instruction or the core service engine control instruction to the main interactive service engine instance, and transmitting the interactive service engine control instruction or the core service engine control instruction to the corresponding slave interactive service engine or core service engine by the main interactive service engine instance; and respectively transmitting the state information transmitted by the interactive service engine or the core service engine to the corresponding interactive service engine instances, and controlling the corresponding graphic engine instances by each interactive service engine instance to execute the processing operation corresponding to the interactive service control instruction or the core service engine control instruction.

Optionally, the master interactive service engine instance also sets parameters of the slave interactive service engine instance when a slave interactive service engine instance corresponding to the new access screen is derived.

An embodiment of the present specification further provides an electronic device, including: the multi-screen interaction control system comprises a memory, a processor and an expansion interface, wherein the expansion interface is suitable for being coupled with an external screen, the memory stores computer instructions capable of being executed on the processor, and the processor is suitable for executing the multi-screen interaction control method of any one of the preceding embodiments when executing the computer instructions.

Optionally, the expansion interface includes at least one of:

a wired interface;

a wireless interface.

By adopting the multi-screen interaction control scheme of the embodiment of the specification, when a new screen is detected to be accessed, the corresponding graphic engine instance is generated, a slave interaction service engine instance can be automatically derived through the created master interaction service instance, and then the derived slave interaction service engine instance controls the graphic engine instance corresponding to the new accessed screen to output the corresponding core service information, interaction service information and graphic elements to the new screen, so that pages do not need to be developed independently for different display screens, and therefore, the multi-screen interaction control scheme has strong universality and reusability, is beneficial to realizing interaction among different types of screens, and can further improve the development efficiency.

Furthermore, the message center communicates with the central processing unit, the core service engine, the interactive service engine and each interactive service engine instance, message interaction is performed in a message distribution and subscription mode, and the message center records the master-slave relationship between the master interactive service engine instance and the slave interactive service engine instance, so that the coupling of message interaction can be reduced, the universality and reusability of a multi-screen interaction control scheme can be improved, and the development efficiency can be improved.

Further, based on the device identifier of the corresponding screen acquired when the screen is switched on or switched off, the corresponding map instance is created or destroyed, and the corresponding slave interaction service engine instance is correspondingly created or destroyed by the master interaction service engine, so that hot plug of the screen in the service execution process of the service application program can be realized, and the slave interaction service engine instance and the slave graphics engine instance are created and destroyed in the service execution process, without affecting the operation of the master interaction service engine instance and the master graphics engine instance, thereby reducing the complexity of multi-screen interaction and avoiding distractions of users.

Further, the message center determines whether to transmit the message to all the interactive service engines or a part of corresponding interactive service engine instances based on the type of the received message, on one hand, each screen can meet the general requirements of the operation of the application core service, and on the other hand, the message center can meet the individual requirements of the multi-screen interactive users according to different characteristics of each screen or different characteristics of corresponding users.

Further, by respectively transmitting the core service update information to the master interactive service engine instance and the slave interactive service engine instance, and respectively controlling the corresponding graphic engine instance to update the corresponding graphic elements in the screen according to the core service update information by the master interactive service engine instance and the slave interactive service engine instance based on the received core service update information, the synchronous update information among multiple screens can be realized, and the synchronization and consistency of the core service information among the screens can be realized.

Further, when an instruction for switching the screen view angle is acquired, the instruction for switching the screen view angle is transmitted to the corresponding interactive service engine instance, and the corresponding interactive service engine instance is controlled to output the corresponding graphic element according to the corresponding graphic engine instance parameter after the screen view angle is switched according to the instruction for switching the screen view angle, so that the user corresponding to each screen can set the personalized screen view angle, and the user experience is improved.

Further, the interactive service engine control instruction or the core service engine control instruction is only transferred to the main interactive service engine instance, which is correspondingly transferred to the interactive service engine or the core service engine, and the state information of the interactive service engine transmitted by the interactive service engine or the state information of the core service engine transmitted by the core service engine is respectively transmitted to each interactive service engine instance, the map engine instance corresponding to the interactive service engine control instruction or the core service engine control instruction is executed by each interactive service engine instance, that is, only the main interactive service engine instance can control the core service engine and the interactive service engine, control conflict or repeated issuing of control instructions of each interactive service engine instance can be avoided, and the consistency of service control of each screen is further improved.

Furthermore, when the master interactive service engine instance derives a slave interactive service engine instance corresponding to the new access screen, the parameter of the slave interactive service engine instance is set, so that a slave screen service operation graphical interface different from that of a master screen service operation can be realized, and the personalization of multi-screen interactive control is further improved.

Further, by adopting the multi-screen interaction control scheme of the embodiment of the present specification, through cooperation of the map engine, the positioning engine and the navigation engine of the multi-screen interaction control system or device, and creation of the master-slave relationship between the master travel engine instance and the slave travel engine instance, multi-screen interaction for navigation applications can be realized, and multi-screen navigation interaction requirements of different users on the same vehicle can be met.

Drawings

FIG. 1 is a schematic diagram illustrating a multi-screen interaction scene in an embodiment of the present specification;

FIG. 2 is a schematic structural diagram illustrating a multi-screen interaction control system in an embodiment of the present disclosure;

FIG. 3 is a schematic structural diagram illustrating another multi-screen interaction control system in an embodiment of the present specification;

FIG. 4 is a flowchart illustrating a multi-screen interaction control method in an embodiment of the present specification;

FIG. 5 is a flowchart illustrating another multi-screen interaction control method in an embodiment of the present specification;

FIG. 6 is a schematic structural diagram illustrating a multi-screen interaction control system applied to a map navigation scene in an embodiment of the present disclosure;

FIG. 7 is a flowchart illustrating a process of a multi-screen interactive control system applied to a map navigation scene when a screen is newly accessed according to an embodiment of the present disclosure;

FIG. 8 is a flowchart illustrating a process of a multi-screen interaction control system applied to a map navigation scene when a screen is disconnected in an embodiment of the present specification;

FIG. 9 is a schematic diagram illustrating a processing flow of a multi-screen interaction control system applied to a map navigation scene in an embodiment of the present specification when positioning information is updated;

FIG. 10 is a flowchart illustrating a processing procedure of a multi-screen interaction control device system applied to a map navigation scene when setting an individualized navigation view angle according to an embodiment of the present disclosure;

FIG. 11 is a flowchart illustrating a processing procedure of a multi-screen interaction control system applied to a map navigation scene when exiting navigation in an embodiment of the present specification;

fig. 12 is a schematic diagram illustrating a specific interactive scene processing of a multi-screen interactive control system applied to a map navigation scene in an embodiment of the present specification.

Fig. 13 is a schematic structural diagram illustrating another multi-screen interaction control system in an embodiment of the present specification.

Detailed Description

As described above, in the current multi-screen interaction scheme, due to the difference in screen size and resolution of the display screens, the interaction modes are different, and if each additional display screen capable of interacting is added, targeted development is required, and an application program (such as a map navigation application) needs to be adapted to different screens individually, so that the development efficiency is low.

Referring to the multi-screen interaction scenario diagram shown in fig. 1, the electronic device 1 is configured with a memory 11, a processor 12, and can selectively configure a display screen 13, and one or more expansion interfaces 14, through which one or more display screens, such as the display screen 2, the display screen 3, and the like, can be accessed, and the one or more expansion interfaces 14. Wherein the screen sizes and resolutions of the plurality of display screens, such as display screen 13, display screen 2 and display screen 3, may all be different.

In a specific implementation, the multi-screen interaction control system in the embodiment of the present disclosure may be installed on the memory 11 of the electronic device 1 and run on the processor 12, and the interaction control of the multi-screen interaction control system may be implemented through the display screen 13, the display screen 2, the display screen 3, and the like.

The electronic device may be a fixed electronic device or a mobile device, for example, a personal computer, a set-top box, or a vehicle-mounted device, and accordingly, the selectively configured display screen may be a computer display screen, a television screen, or a vehicle-mounted central control screen, and the external display screen may be a mobile phone terminal screen, a tablet computer screen, a projection screen, or a screen disposed inside a vehicle (for example, a screen disposed on the back of a seat, an inner wall of a window, or a screen suspended inside a vehicle). The screen of each Display screen may be a Liquid Crystal Display (LCD) screen, an Organic Light-Emitting Diode (OLED) screen, or the like, and the specific material, process, model, size, resolution, or the like of the screen is not limited.

The one or more expansion interfaces 14 may be wired interfaces or wireless interfaces, or some interfaces may be wired interfaces and some interfaces may be wireless interfaces, where the wired interfaces may be Universal Serial Bus (USB) interfaces, screen projection interfaces, and the like, and the wireless interfaces may be wireless internet access (WIFI) wireless screen projection interfaces, and the like.

In order to improve the versatility of multi-screen interaction, the multi-screen interaction control scheme of the embodiment of the present specification may be adopted, where when a new screen is detected to be accessed, a corresponding graphics engine instance may be generated, and a slave interaction business engine instance is derived through a created master interaction business instance, so that the derived slave interaction business engine instance controls the graphics engine instance corresponding to the new accessed screen to output corresponding core business information, interaction business information, and graphics elements to the new screen.

For those skilled in the art to better understand and realize the embodiments of the present specification, the following detailed description is given by way of specific embodiments and with reference to the accompanying drawings.

To facilitate understanding of technical concepts of the embodiments of the present specification, a structure of a multi-screen interactive control system in the embodiments of the present specification is first described. Referring to the structural schematic diagram of a multi-screen interaction control system shown in fig. 2, the multi-screen interaction control system 20 may include a central processing unit 21, a graphics engine 22, a core business engine 23, an interaction business engine 24, and an interaction interface 25. Wherein two or more interactive interfaces 25 may be provided, the interactive interfaces 25 may include a screen interface 251 and a user interactive interface 252 for interacting through the screen, and the user interactive interface 252 may include an input interface (not shown) and an output interface (not shown). In particular implementations, one of the interactive interfaces 25 can include a screen interface (e.g., screen interface 1) of a screen of an electronic device on which the multi-screen interaction system 20 operates, and a user interactive interface (e.g., user interactive interface 1) of a screen connected through the screen interface 1; the other interactive interfaces 25 can include a screen interface (e.g., screen interface 2) for connecting an external screen to the electronic device operated by the multi-screen interactive system, and a user interactive interface (e.g., user interactive interface 2) for performing interactive control via the screen interface connected to the external screen.

In a specific implementation, the central processing unit 21 may create the graphics engine 22, the core business engine 23, the interaction business engine 24 and the user interaction interface 252 when the business application is started.

Wherein the graphics engine 22 is adapted to output graphics data. The service application program divides the service engine into the core service engine 23 and the interactive service engine 24 according to the service logic, wherein the core service engine 23 executes the core service logic of the service application which is irrelevant to the interaction and is suitable for outputting the core service data; while the interactive service engine 24 executes service logic associated with the interactive service and adapted to output interactive service data.

In a specific implementation, the interactive service engine instances 26 correspond to screens one-to-one, and are adapted to combine the core service data output by the core service engine 23, the interactive service data output by the interactive service engine 24, and the graphic data output by the graphic engine 22 to control the graphic engine instances corresponding to the screens to output the corresponding core service information, interactive service information, and graphic elements to the corresponding screens. The interactive service engine instance 26 may include a master interactive service engine instance and a slave interactive service engine instance, wherein when the central processing unit 21 acquires an instruction for starting an interactive service through a user interactive interface (e.g., user interactive interface 1) of the home screen, it may create a corresponding master interactive service engine instance (e.g., interactive service engine instance 1) based on the interactive service engine 24 and a corresponding graphic engine instance (e.g., graphic engine instance 1) based on the graphic engine 22.

When a new screen is accessed, the multi-screen interaction control system in the embodiment of the present specification may derive a slave interaction service engine instance from the master interaction service engine instance for the new accessed screen. Referring to fig. 2, if a screen accesses the multi-screen interaction control system 20 through the screen interface 2, the central processing unit 21 may obtain an equipment identifier of a newly accessed screen according to a first callback message transmitted when responding to a new access of the screen, control the graphics engine 22 to create a corresponding graphics engine instance (e.g., the graphics engine instance 2) according to the equipment identifier of the newly accessed screen, and transmit the identifier of the graphics engine instance to the primary interaction service engine instance (e.g., the interaction service engine instance 1), where the primary interaction service engine instance is adapted to derive a secondary interaction service engine instance corresponding to the newly accessed screen according to the received identifier of the graphics engine instance corresponding to the newly accessed screen.

Wherein, the master interactive service engine instance may derive a slave interactive service engine instance corresponding to the new access screen by adopting the following manner: and creating a slave interactive service engine instance, and synchronizing the state information of the slave interactive service engine instance to the newly created slave interactive service engine instance.

In a specific implementation, the multi-screen interaction service system may further include a message center, such as the structural schematic diagram of another multi-screen interaction system shown in fig. 3, which is different from fig. 2 in that the multi-screen interaction control system 30 may further include a message center 27, where the message center 27 is adapted to communicate with the central processing unit 21, the core service engine 23, the interaction service engine 24, and each interaction service engine instance 26 in a message distribution subscription manner, and may record a master-slave relationship between the master interaction service engine instance and the slave interaction service engine instance. By adopting the embodiment, the message interaction is carried out in a message distribution and subscription mode, and the master-slave relationship between the master interaction service engine instance and the slave interaction service engine instance is recorded by the message center, so that the coupling of information interaction can be reduced, the universality and reusability of a multi-screen interaction control scheme can be further improved, and the development efficiency can be further improved.

It is understood that, in a specific implementation, the master-slave relationship between the master interaction service engine instance and the slave interaction service engine instance may also be recorded by the central processing unit 21 or other functional units.

The multi-screen interaction principle in the embodiment of the present specification is explained below through a specific interaction process of multi-screen interaction control.

Referring to the flowchart of a multi-screen interaction control method shown in fig. 4, specifically, the following steps may be adopted to perform multi-screen interaction:

s41, according to the first callback message transmitted when responding to the screen new access, the device identification of the new access screen is obtained.

In a specific implementation, when detecting that a screen is newly accessed, the operating system may transmit the first callback message to the multi-screen interaction control system through the interaction interface, and may transmit the device identifier of the newly accessed screen to the central processing unit through the first callback message. Referring to fig. 2, the operating system may pass a first callback message to the central processing unit 21 when the screen interface 2 detects that there is a new screen access.

And S42, controlling the graphic engine to create a corresponding graphic engine instance according to the equipment identifier of the new access screen.

With continued reference to fig. 2, the central processing unit 21 may control the graphics engine 22 to create a corresponding graphics engine instance, such as graphics engine instance 2, according to the device identifier of the new access screen.

S43, transmitting the identification of the graphic engine instance to the created main interactive service engine instance, so that the main interactive service engine instance derives a slave interactive service engine instance corresponding to the new access screen.

In a specific implementation, referring to fig. 2 and 3, the central processing unit 21 may directly transfer the identifier of the graphics engine instance (e.g., identifier of graphics engine instance 2) to the created master interaction service engine instance (e.g., interaction service engine instance 1) or to the created master interaction service engine instance (e.g., interaction service engine instance 1) via the message center 27, and the master interaction service engine instance (interaction service engine instance 1) may derive a slave interaction service engine instance (e.g., interaction service engine instance 2).

When the master interactive service engine instance derives a slave interactive service engine instance corresponding to the new access screen, as an optional embodiment, parameters of the slave interactive service engine instance may be set. By setting the parameters of the slave interaction service engine instance, a slave screen service operation graphical interface different from the master screen service operation can be realized, and the individuation of multi-screen interaction control is further improved.

S44, recording the master-slave relationship between the master interactive service engine instance and the slave interactive service engine instance.

In a specific implementation, referring to fig. 2 and fig. 3, the master-slave relationship between the master interactive service engine instance and the slave interactive service engine instances may be recorded by the central processing unit 21 or the message center 27, and if there are multiple access screens, the master-slave relationship between one master interactive service engine instance and multiple slave interactive service engine instances is recorded.

And S45, combining the core service data output by the core service engine, the interactive service data output by the interactive service engine and the graphic data output by the graphic engine, wherein the secondary interactive service engine instance corresponding to the new access screen controls the graphic engine instance corresponding to the new access screen to output the corresponding core service information, interactive service information and graphic elements to the new access screen.

With continued reference to fig. 2 and fig. 3, the core service data output by the core service engine 23, the interaction service data output by the interaction service engine 24, and the graphic data output by the graphic engine 22 may be combined with the core service data output by the interaction service engine instance 2 corresponding to the new access screen, and the graphic engine instance (e.g., the graphic engine instance 2) corresponding to the new access screen is controlled to output the corresponding core service information, interaction service information, and graphic elements to the new access screen for displaying on the display interface of the new access screen.

Accordingly, with the multi-screen interaction scheme of the embodiment of the present specification, when the accessed screen is disconnected, the interaction service engine instance and the map engine instance corresponding to the disconnected screen may be destroyed, and a flow of the specific multi-screen interaction control method may be opposite to a flow of the newly accessed screen. Referring to a flowchart of another multi-screen interaction control method in the embodiment of the present specification shown in fig. 5, when an accessed screen is disconnected, the following steps may be adopted to perform multi-screen interaction control:

and S51, acquiring the device identification of the disconnected screen according to the second callback message transmitted when the screen is disconnected.

In a specific implementation, when detecting that a screen is newly accessed, the operating system may transmit the second callback message to the multi-screen interaction control system through the interaction interface, and may transmit the device identifier of the disconnected screen to the central processing unit or the message center through the second callback message. Referring to fig. 2, the operating system may pass the second callback message to the central processing unit 21 or the message center 27 when the screen interface 2 detects disconnection of the external screen.

And S52, according to the device identifier of the disconnected screen, canceling the master-slave relationship between the slave interactive service engine instance and the master interactive service engine instance corresponding to the disconnected screen.

In a specific implementation, the central processing unit 21 or the message center 27 may cancel, according to the device identifier of the disconnected screen, a master-slave relationship between the slave interaction service engine instance corresponding to the disconnected screen and the master interaction service engine instance, for example, cancel the master-slave relationship between the interaction service engine instance 2 and the master interaction service engine instance 1.

And S53, destroying the slave interactive service engine instance corresponding to the disconnected screen by the master interactive service engine instance.

With continued reference to fig. 2 and fig. 3, after the central processing unit 21 or the message center 27 cancels the master-slave relationship between the interaction service engine instance 2 and the interaction service engine instance 1, the interaction service engine instance 1 may destroy the interaction service engine instance 2 corresponding to the disconnected screen.

And S54, destroying the graphic engine instance corresponding to the disconnected screen.

With continued reference to fig. 2 or 3, the central processing unit 21 may destroy the graphics engine instance 2 corresponding to the disconnected screen.

By adopting the above embodiment, the corresponding map instance is created or destroyed based on the device identifier of the corresponding screen acquired when the screen is switched on or off, and the corresponding slave interaction service engine instance is correspondingly created or destroyed by the master interaction service engine, so that hot plug of the screen in the service execution process of the service application program can be realized, and the slave interaction service engine instance and the slave graphics engine instance are created and destroyed in the service execution process, which does not affect the operation of the master interaction service engine instance and the master graphics engine instance, thereby reducing the complexity of multi-screen interaction and avoiding distractions of users. When the multi-screen interaction control system runs on the vehicle equipment, the hot plug of the screen is realized, and the user can be prevented from executing complex operation for multi-screen interaction, so that the user can be prevented from being distracted, and the driving safety is improved.

In a specific implementation process of the multi-screen interaction control system according to the embodiment of the present specification, whether to deliver a message to all interaction service engine instances or a part of the interaction service engine instances may be determined according to a type of the received message. Specifically, the received global message may be transmitted to a master interactive service engine instance and synchronized to a slave interactive service engine instance, so that the master interactive service engine instance and the slave interactive service engine instance perform corresponding processing based on the global message, respectively; and transmitting the received non-global message to the corresponding interactive service engine instance, so that the corresponding interactive service engine instance performs corresponding processing based on the non-global message. Referring to fig. 2 and 3, it can be specifically determined by the central processing unit 21 or the message center whether to deliver the message to all or part of the interaction service engine instances.

By adopting the embodiment, whether the message is transmitted to all the interactive service engines or part of the corresponding interactive service engine examples is determined based on the type of the received message, on one hand, each screen can meet the general requirement of the operation of the application core service, and on the other hand, the personalized requirement of the multi-screen interactive user can be met according to different characteristics of each screen or different characteristics of corresponding users.

For a better understanding and implementation by those skilled in the art, some examples are given below that may be delivered as global messages or non-global messages.

Example one: the core service update information transmitted by the core service engine may be respectively transmitted to the master interactive service engine instance and the slave interactive service engine instance, so that the master interactive service engine instance and the slave interactive service engine instance respectively control the corresponding graphic engine instance to update the corresponding graphic element in the screen according to the core service update information based on the received core service update information.

The core service engine update information transmitted by the core service engine is transmitted as the global message, so that the synchronous update information among multiple screens can be realized, and the synchronization and consistency of the core service information among the screens can be realized.

In some embodiments of the present description, information transmitted by the core service engine may be transmitted to all the interaction service engine instances as a global message, so as to implement synchronization of core service information of each screen.

Example two: acquiring a command for switching the screen view angle transmitted in response to the detection of the switching of the screen view angle; and transmitting the instruction for switching the screen view angle to the corresponding interactive service engine instance, so that the corresponding interactive service engine instance controls the corresponding interactive service engine instance to output the corresponding graphic element according to the corresponding graphic engine instance parameter after the screen view angle is switched according to the instruction for switching the screen view angle.

Besides the core service data based on the core service engine, the setting of the display interface including the user interaction interface can be used as personalized setting of each screen. For example, different users may have different requirements for screen views, and some users may have different requirements for screen views, so that when an instruction for switching screen views is obtained, the instruction for switching screen views is transmitted to corresponding interactive service engine instances, and the corresponding interactive service engine instances are controlled by the corresponding interactive service engine instances according to the instruction for switching screen views to output corresponding graphic elements according to corresponding graphic engine instance parameters after the views are switched, so that the user corresponding to each screen can set a personalized screen view, and user experience is improved.

Example three: receiving an interactive service engine control instruction or a core service engine control instruction transmitted in response to an interactive control operation; transmitting the interactive service engine control instruction or the core service engine control instruction to the main interactive service engine instance, and correspondingly transmitting the main interactive service engine instance to the interactive service engine or the core service engine; and respectively transmitting the state information transmitted by the interactive service engine or the core service engine to the corresponding interactive service engine instances, and controlling the corresponding graphic engine instances by each interactive service engine instance to execute the processing operation corresponding to the interactive service control instruction or the core service engine control instruction.

In some embodiments of the present description, the setting may be such that only the master interaction service engine instance can control the interaction service engine, or the control of the core service engine, e.g., for exit of the interaction service engine, can be done under control of the master interaction service engine instance. Thus, control instructions of the interaction service engine or core service engine may be passed as non-global messages only to the primary interaction service engine instance.

As another example, the interaction service engine can reset the interaction interface of the master screen without any impact on the accessed slave screens. For example, the interaction service engine may send a notification to the master interaction service engine instance to display a large map based on the detected geographical location information, and the master interaction service engine instance controls the master graphics engine to output a corresponding graphics engine instance, so that an enlarged view may be displayed on the interface of the master screen without any influence on the slave interaction service engine instance, and the view perspective and the view scale of the slave screen display remain unchanged. Here, the notification message sent by the interactive service engine is treated as a non-global message.

By passing the interaction service engine control instructions or core service engine control instructions only to the main interaction service engine instance, which is passed to the interaction service engine or core service engine accordingly, and the state information of the interactive service engine transmitted by the interactive service engine or the state information of the core service engine transmitted by the core service engine is respectively transmitted to each interactive service engine instance, the map engine instance corresponding to the interactive service engine control instruction or the core service engine control instruction is executed by each interactive service engine instance, that is, only the main interactive service engine instance can control the core service engine and the interactive service engine, control conflict or repeated issuing of control instructions of each interactive service engine instance can be avoided, and the consistency of service control of each screen is further improved.

The multi-screen interaction control scheme in the embodiment of the present description may be applied to a multi-screen interaction control system in multiple scenes, for example, may be applied to different types of service applications such as a map navigation application, a music playing application, and a video playing application. Different service applications can determine corresponding core service engines and interactive service engines according to self service characteristics and service logic.

For example, for music playing applications, a music playing engine may be used as a core service engine, an engine corresponding to other interactive services unrelated to music playing may be used as an interactive service engine, for example, a song list, a lyric display, and the like may be used as an interactive service, and the corresponding engine may be used as an interactive service engine.

For another example, for a video playing application, the video playing engine may be used as a core service engine, and an engine corresponding to other interactive services unrelated to video playing may be used as an interactive service engine, for example, a video-on-demand list is displayed.

For another example, for a map navigation application, the graphics engine may include a map engine adapted to control a corresponding map engine instance to output map elements based on map data; the core business engine may comprise a positioning engine adapted to calculate the current coordinates of the user based on the measurement data from the positioning sensor and the acquired route planning data, resulting in positioning data; the interactive service engine may include a navigation engine, and the navigation engine may output user navigation guide information according to the positioning data and the route planning data output by the positioning engine; accordingly, the interactive service engine instance may include a travel engine instance, and the travel engine instance may control the corresponding map engine instance to output the corresponding map element and the user navigation guidance information to the screen in combination with the positioning data and the user navigation guidance information.

For a better understanding and implementation by those skilled in the art, a detailed description is given below of a specific application of the map navigation application scenario.

Fig. 6 is a schematic structural diagram illustrating a multi-screen interaction control system applied to a map navigation scene in an embodiment of the present specification. Referring to fig. 6, the multi-screen interaction control system 60 may include a central processing unit 61, a map engine 62, a positioning engine 63, a navigation engine 64, an example trip engine 65, a message center 66, and an interaction interface 67, the interaction interface 67 including a screen interface 671 and a user interaction interface 672, wherein:

the central processing unit 61 is adapted to create the positioning engine 63, the navigation engine 64, the message center 66 and the user interaction interface 672-1 (i.e. user interaction interface 1) of the main screen corresponding to the main screen when the map navigation application is started, create a corresponding main travel engine instance 65-1 (i.e. travel engine instance 1) when an instruction for navigation start is obtained through the user interaction interface 672-1 of the main screen, create a corresponding map engine instance 1 in the corresponding user interaction interface 672-1 when a device identifier of a newly-accessed screen is obtained, and transfer the device identifier of the newly-accessed screen to the main travel engine instance 65-1;

a map engine 62 adapted to control a corresponding map engine instance to output map elements based on map data;

a positioning engine 63 adapted to calculate the current coordinates of the user based on the measurement data from the positioning sensor and the acquired route planning data to obtain positioning data;

a navigation engine 64 adapted to output user navigation guidance information based on the positioning data and route planning data output by the positioning engine 63;

an example trip engine 65 adapted to output the map and the navigation guidance information to a corresponding user interaction interface in combination with the positioning data, the navigation guidance information, and the user setting, including outputting the map information to a corresponding example map engine, and controlling the example map engine of a corresponding screen to output corresponding positioning data, navigation guidance information, and map elements to a corresponding screen; the travel engine instance 65 may include a master travel engine instance 65-1 and a slave travel engine instance 65-2, where the master travel engine instance 65-1 is adapted to derive a slave travel engine instance 65-2 when acquiring the device identifier of the newly accessed screen, specifically, a slave travel engine instance 65-2 may be created and state information of itself may be synchronized to the slave travel engine instance 65-2;

the user interaction interface 672, which corresponds to the screen one by one, may include an input interface (not shown) and an output interface (not shown), wherein the input interface is adapted to receive an operation instruction of a user; the output interface is suitable for outputting a map interface and navigation information, and the output interface can comprise a map engine instance, is suitable for outputting a map display interface based on map setting information output by the corresponding travel engine instance, and outputs the navigation information transmitted by the corresponding travel engine instance;

the message center 66 is respectively communicated with the central processing unit 61, the positioning engine 63, the navigation engine 64 and each trip engine instance 65, is suitable for interacting with the central processing unit 61, the positioning engine 63, the navigation engine 64 and each trip engine instance 65 in a message distribution and subscription mode, and is suitable for recording the master-slave relationship between the master trip engine instance 65-1 and the slave trip engine instance 65-2.

In a specific implementation, the multi-screen map navigation control apparatus may operate on the electronic device as an application program (APP), a client applet, or a browser. Referring to the multi-screen interaction scene schematic diagram shown in fig. 1, a screen 13 may be disposed on the electronic device 1, and an expansion interface 14 may also be disposed on the electronic device 1, where the expansion interface 14 is adapted to access the display screen 2 and the display screen 3. The electronic equipment can be vehicle equipment, handheld device, computer equipment, family data center, router, STB, projecting apparatus etc., and wherein, vehicle equipment can be for well accuse terminal, handheld device can be the cell-phone, and the display screen can be including well accuse display screen, panel board display screen, back seat display screen, the door window display screen that set up on the vehicle to and cell-phone display screen, computer display screen, TV display screen, projection screen etc.. The embodiments of the present disclosure do not limit the specific display screen, including the size, resolution, model, structure, material, etc. of the display screen.

It will be appreciated that figures 1 and 6 are merely illustrative and that in particular implementations there may be multiple display screens accessible simultaneously, and thus correspondingly there are multiple slave travel engines and slave screen user interaction interfaces, and correspondingly multiple map engine instances. It will be appreciated that there may also be situations where part of the user interaction interface has only an output interface and no input interface.

Referring to fig. 7, a processing flow diagram of a multi-screen interaction control system applied to a navigation scene when a screen is newly accessed is shown, and a processing flow of the multi-screen interaction control system in the embodiment of the present specification is described in detail through specific steps below.

S71, when the user connects a new screen to the mobile phone or the car device, the operating system detects a new screen access, and sends a callback message to the central processing unit in the multi-screen interaction control system, and recalls a device identifier (deviceId) of the new access screen to the central processing unit.

In a specific implementation, when a screen is newly connected to an electronic device running a multi-screen interaction control system (e.g., a map navigation application) according to an embodiment of the present disclosure, if the map navigation application is already started, a positioning engine, a navigation engine, a message center, a user interaction interface of a main screen corresponding to the main screen, and a main travel engine instance are correspondingly created.

In a specific implementation, if an external screen of the electronic device is accessed before the map navigation application is started, a map engine instance and a main travel engine instance corresponding to a main screen are created at first when the map navigation application is started. After the start is finished, the operating system can immediately detect the message that the external display screen is connected, and call back the device identification of the external accessed screen to the central processing unit.

And S72, the central processing unit creates a secondary screen map engine instance according to the equipment identifier (deviceId) of the newly accessed screen, acquires the engine identifier (engineId) of the map engine instance, and controls the map engine to output the map to the newly accessed screen from the secondary screen map engine instance.

And S73, feeding back a message that the map engine instance is successfully created from the screen map engine instance to the central processing unit.

S74, the central processing unit sends a message to the master travel engine instance indicating that the slave travel engine instance is created, wherein the message may contain the engine identifier of the slave screen map engine instance, and the engine identifier of the slave screen map engine instance is transferred to the master travel engine instance.

And S75, the master travel engine instance creates a slave travel engine instance corresponding to the newly accessed screen based on the indication of the central processing unit.

In a specific implementation, the master travel engine instance may create the slave travel engine instance by copying itself.

And S76, the master travel engine instance synchronizes the state of the master travel engine instance to the newly created slave travel engine instance.

In a specific implementation, the master travel engine instance may also set the created slave travel engine instance to be different from itself. Specifically, the master travel engine instance may set parameters of the slave travel engine instance when creating the slave travel engine instance. For example, the main screen corresponding to the main travel engine instance may display three routes, including a main route and two alternative routes, and the main travel engine instance may set the screen externally connected to the display screen to display only one main route.

And S77, the main travel engine example feeds back a message of successful creation of the slave travel engine to the central processing unit.

And S78, the master travel engine instance sends the master-slave relationship information of the master travel engine instance and the slave travel engine instance to the message center, and the message center records the master-slave relationship of the master travel engine instance and the slave travel engine instance.

In a specific implementation, a situation that a user pulls out an external display screen in a map navigation process may occur, and for this application scenario, the multi-screen interaction control system according to the embodiment of the present description may perform corresponding processing by using a process opposite to that when one screen is accessed.

Specifically, referring to fig. 6, the central processing unit 61 is adapted to obtain the device identifier of the disconnected screen according to the second callback message transmitted in response to the screen disconnection, and may transmit the screen disconnection message to the message center 66, instructing the message center to cancel the disconnected screen;

the message center 66 is further adapted to cancel the master-slave relationship between the slave trip engine instance 65-2 and the master trip engine instance 65-1 corresponding to the disconnected screen according to the device identifier of the disconnected screen;

the master travel engine instance 65-1 is further adapted to destroy the slave travel engine instance 65-2 corresponding to the disconnected screen when the message center 66 cancels the master-slave relationship between the slave travel engine instance 65-2 corresponding to the disconnected screen and the master travel engine instance 65-1;

the central processing unit 61 is further adapted to destroy the map engine instance (map engine instance 2) corresponding to the disconnected screen after the master travel engine instance 65-1 destroys the slave travel engine instance 65-2 corresponding to the disconnected screen.

The following describes a specific processing flow of the multi-screen map navigation control device when an external display screen is disconnected according to the embodiment of the present disclosure with reference to fig. 8.

And S81, when the operating system detects that the screen is disconnected, transmitting a second callback message to the central processing unit, and calling back the device identifier (deviceId) of the disconnected screen to the central processing unit.

And S82, the central processing unit sends a message for indicating to cancel the master-slave relationship corresponding to the disconnected screen to the message center, wherein the message comprises the equipment identification of the disconnected screen, and the message center cancels the master-slave relationship between the slave screen map engine instance and the master screen map engine instance corresponding to the disconnected screen.

S83, the central processing unit sends a message to the master travel engine instance instructing to destroy the slave travel engine instance.

And S84, the main travel engine instance destroys the slave travel engine instance based on the received message indicating that the slave travel engine instance is destroyed, and the slave travel engine instance corresponding to the disconnected screen is destroyed.

And S85, the main travel engine feeds back the information destroyed by the travel engine instance to the central processing unit.

And S86, the central processing unit destroys the slave screen map engine instance corresponding to the disconnected screen.

As can be seen from the above processing flows of screen access and screen disconnection, the multi-screen interaction control system according to the embodiment of the present disclosure can support hot plug of an external screen in a map navigation process, create and destroy a slave travel engine instance and a slave screen map instance in the navigation process, and do not affect the operation of a master travel engine instance and a master screen map instance, so that complexity of multi-screen map navigation interaction can be reduced, distraction of a user can be avoided, and driving safety can be improved.

Referring to fig. 6, in a specific implementation, the message center 66 is adapted to determine whether to deliver the message to all or synchronize only to part of the travel engine instances according to the type of the received message, and specifically, may deliver the received global message to the master travel engine instance and synchronize to all the slave travel engine instances, so that the master travel engine instance and all the slave travel engine instances perform corresponding processing based on the global message respectively; and transmitting the received non-global message to the corresponding trip engine instance, so that the corresponding trip engine instance performs corresponding processing based on the non-global message.

Taking an application scenario of positioning information update as an example, referring to fig. 6, the message center 66 is adapted to transfer the positioning update information transferred by the positioning engine 63 to a master travel engine instance 65-1 and a slave travel engine instance 65-2, respectively; the master travel engine instance 65-1 and the slave travel engine instance 65-2 respectively send information for resetting the screen coordinate center to the corresponding map engine instance 1 and map engine instance 2 based on the received positioning update information; and when the map engine instances 1 and 2 receive the message of resetting the screen coordinate center, updating the screen coordinate center corresponding to the map display interface.

In the embodiment of the present specification, positioning information, navigation information, and the like may be synchronized to a processing module corresponding to each display screen as a global message, where the processing module includes an example of a travel engine and a user interaction interface (an example of a map engine).

Referring to a schematic processing flow diagram of a multi-screen interaction control system applied to a map navigation scene during updating of positioning information shown in fig. 9, the following describes, through specific steps, a processing flow adopted by the multi-screen interaction control system according to an embodiment of the present specification during updating of positioning information:

s91, the positioning engine sends a message of GPS coordinate update to the message center.

S92, the message center sends a message of GPS coordinate update to the main travel engine instance.

S93, the main travel engine sets the screen center coordinates of the main screen map engine instance based on the received arrival GPS coordinate update message, and updates the map center point.

S94, the message center sends a message of GPS coordinate update to the travel engine instance.

And S95, the slave trip engine instance sets the screen center coordinates of the corresponding slave screen map engine instance based on the received arrival GPS coordinate updating message, and updates the map center point.

It should be noted that, in a specific implementation, the message center may synchronously execute steps S92 and S94, that is, synchronously transmit the GPS coordinate updating message to the master travel engine instance and the slave travel engine instance, so that each travel engine instance resets its corresponding map center point, and thus, the map is updated on each screen synchronously.

By adopting the multi-screen interaction control system of the embodiment of the specification, in some scenes, the message center can only transmit the message to the corresponding travel engine instance based on the type of the received message, rather than global synchronization, so that different requirements of users of each screen can be met, and personalized setting of each screen is realized.

In specific implementation, setting information related to a specific display mode or screen or personalized setting information which does not affect other users can be transmitted to the corresponding travel engine instance only by the message center, so that differentiated display of each screen can be realized, different screen characteristics can be adapted, and personalized requirements of users at different positions or users with different preferences can be met.

For example, with continued reference to fig. 6, the central processing unit 61 is adapted to transmit the instruction of switching the screen view angle transmitted by the input interface to the message center 66, and the message center 66 is adapted to transmit the instruction of switching the screen view angle to the corresponding trip engine instance 65 when receiving the instruction of switching the screen view angle transmitted by the central processing unit 61; the travel engine instance 65 is adapted to update the map engine instance parameter corresponding to the corresponding map engine instance to the switched screen view according to the instruction for switching the screen view.

For better understanding and implementation of the embodiments of the present specification, a processing flow of setting an individualized navigation view angle by the multi-screen map navigation control device according to the embodiments of the present specification will be described in detail with reference to a schematic processing flow diagram of the multi-screen map navigation control device according to the embodiments of the present specification when setting an individualized view angle, as shown in fig. 10, through specific steps:

s101, clicking a screen visual angle button displayed on an external screen displayed on a user interaction interface by a user.

In a specific implementation, the user interaction interface may include an input interface and an output interface, where the input interface may include a control button, an input panel, and the like presented on the input interface, and it may be understood that, in a specific implementation, the input interface may also be a voice input interface, a touch panel, and the like, and a corresponding voice trigger signal or trigger hardware for switching a screen view angle may be set based on a corresponding input form.

S102, the user interaction interface generates a command for switching the screen view angle of the access screen based on the operation of clicking the screen view angle button displayed on the external screen by the user and transmits the command to the central processing unit.

S103, the central processing unit transmits an instruction for switching the screen view angle of the access screen to the message center.

And S104, the message center transmits the instruction of switching the screen view angle of the access screen to the corresponding slave travel engine instance.

And S105, the slave trip engine instance sets corresponding map engine instance parameters corresponding to the switched screen view angle adopted by the slave screen map engine instance.

In a specific implementation, the corresponding map engine instance parameters may include one or more of a map center point (coordinate: longitude and latitude), a trolley position (coordinate: longitude and latitude), a trolley rotation angle, a trolley pitch angle, a map rotation angle, a map pitch angle, a map level, and the like, where the trolley guides an icon of a self-parking space presented on the map in the navigation process.

In the foregoing embodiment, the user clicks the screen view angle of the access screen, and it can be understood that, if a certain user clicks the screen view angle button displayed on the main screen, after receiving the screen view angle switching instruction transmitted by the central processing unit, the message center transmits the screen view angle switching instruction to the main trip engine instance, and accordingly, the main trip engine instance sets the map engine instance parameter corresponding to the screen view angle of the corresponding main screen that is switched.

As can be seen from the foregoing embodiment, when receiving the instruction for switching the screen view angle, which is transmitted by the central processing unit, the message center transmits the instruction for switching the screen view angle to the corresponding trip engine instance, and the trip engine instance updates the map engine instance parameter corresponding to the switched screen view angle according to the instruction for switching the screen view angle, so that the user corresponding to each screen can set the personalized navigation view angle.

In the embodiment of the present specification, to avoid control conflicts or repeated issuing of control instructions for each travel engine instance, the positioning engine and the navigation engine may be controlled only by the main travel engine instance. Specifically, with reference to fig. 6, the central processing unit 61 is adapted to transmit the navigation control command or the positioning control command transmitted by the input interface to the message center 66, the message center 66 is adapted to, upon receiving a navigation control command or a positioning control command delivered by the central processing unit 61, adapted to deliver navigation control instructions or positioning control instructions to the main travel engine instance 65-1, from the main travel engine instance 65-1 to the navigation engine 64 or the positioning engine 63 respectively, and the received state information of the navigation engine 64 transmitted by the navigation engine 64 or the state information of the positioning engine 63 transmitted by the positioning engine 63 is respectively transmitted to each trip engine instance, and each trip engine instance controls the corresponding map engine instance to execute the processing operation corresponding to the navigation control instruction or the positioning control instruction.

For example, in the multi-screen map control apparatus of the embodiment of the present specification, upon exiting the navigation, as shown in fig. 6, the central processing unit 61 is adapted to communicate the command to exit the navigation communicated by the input interface to the message center 66, the message center 66 is adapted to, upon receiving an instruction to exit the navigation communicated by the central processing unit 61, instructions for exiting the navigation are adapted to be passed to the main travel engine instance 65-1, from the main travel engine instance 65-1 to the navigation engine 64 accordingly, and the state information of the navigation engine 64 received from the navigation engine 64 is respectively transmitted to each travel engine instance (travel engine instance 65-2), and each travel engine instance (travel engine instances 65-1, 65-2) respectively controls the corresponding map engine instance to execute the processing operation of exiting navigation.

Specifically, the message center 66 is adapted to sequentially deliver the messages of exiting navigation and exiting navigation to each travel engine instance (travel engine instances 65-1, 65-2), which, upon receiving the message of exiting navigation, sends a prompt to display the exiting navigation to the corresponding map engine instance, and upon receiving the message of exiting navigation, instructs the corresponding map engine instance to clear the navigation elements on the map.

For a person skilled in the art to better understand and implement the embodiment of the present specification, a detailed description is given below, with reference to fig. 11, of a processing flow of a multi-screen interaction control system applied to a map navigation scene when exiting navigation, through specific steps:

s1101, the user clicks an exit navigation button of the user interaction interface.

And S1102-S1103, the user interaction interface generates a command for exiting the navigation based on an exit navigation button clicked by the user and transmits the command to the message center through the central processing unit.

And S1104, the message center continuously transmits the instruction of exiting navigation to the main travel engine instance.

S1105, the main travel engine example transmits the instruction of exiting navigation to the navigation engine.

S1106, after receiving the command to quit navigation, the navigation engine executes the operation to quit navigation and sends the state information of quitting navigation to the message center.

S1107, the message center delivers the state information of exiting navigation to the main travel engine instance.

S1108, the main travel engine instance instructs the corresponding main screen map engine instance to display that the navigation prompt is exiting.

S1109, the message center delivers the state information of exiting the navigation to the slave trip engine instance.

S1110, the slave trip engine instance indicates that the corresponding slave screen map engine instance displays exiting navigation prompt information.

In a specific implementation, after receiving the state information of exiting navigation fed back by the navigation engine, the message center may transmit the instruction information of exiting navigation to each travel engine instance at the same time, and each travel engine instance instructs the corresponding map engine instance to display the prompt information of exiting navigation.

S1111, after exiting the navigation, the navigation engine feeds back the indication information of exiting the navigation to the message center.

S1112, the message center transmits to the main travel engine instance the indication information that the navigation has been exited.

And S1113, controlling the corresponding main screen map engine example to clear the navigation elements on the map by the main trip engine example based on the received indication information of exiting the navigation.

S1114, the message center communicates to the travel engine instance indication that the navigation has exited.

And S1115, the slave trip engine instance instructs the corresponding slave screen map engine instance to clear the navigation elements on the map based on the received indication information that the navigation is quitted.

Likewise, step S1112 and step S1114 may be executed in synchronization.

For a person skilled in the art to better understand and implement the embodiment of the present specification, a detailed description is given below with reference to a specific interaction scenario of a multi-screen interaction control system applied to a map navigation scenario shown in fig. 12. In a specific implementation, as mentioned above, the user interaction interface may include an input interface and an output interface, wherein the input interface may include a Button (Button), a Panel (Panel), and the like, and the output interface may include a map engine instance, and may further include a label (label), and the like.

In this way, the positioning engine can update the GPS coordinates in real time and transmit the GPS coordinates to the message center, the message center can synchronously transmit the GPS coordinate updated messages to the master travel engine instance and the slave travel engine instance, and the master travel engine instance and the slave travel engine instance can send setting information for setting a map center point to the corresponding map engine instances, so that the map center point can be updated in real time by both the map engine instance of the master screen user interaction interface and the map engine instance of the slave screen user interaction interface, and the map keeps a forward rolling and unfolding state along with a travel path. In addition, the main travel instance and the secondary travel instance can also predict the arrival time based on the position of the corresponding trolley from the destination in the updated map engine instance, and can display the predicted arrival time through a label of the user interaction interface, wherein the label can be in a text form or a digital form.

When the user clicks a button for exiting the navigation on a user interaction interface of a certain screen, the instruction for exiting the navigation may be transmitted to the message center through the central processing center, and transmitted to the navigation engine by the message center, so that the navigation engine exits the navigation, and the state information in the process of exiting the navigation may be synchronized to each travel engine instance by the message center, and the specific processing flow may refer to the specific processing steps corresponding to fig. 11, which are not described herein again.

As mentioned above, the input interface may be a button control interface, a text input interface, a voice input interface, etc. to facilitate user interaction during driving.

Referring to the structural schematic diagram of the electronic device in the multi-screen interaction scene shown in fig. 1, the electronic device 1 may include: the memory 11, the processor 12, the expansion interface and the expansion interface 14, where the expansion interface 14 is adapted to be coupled to an external screen, a computer instruction that can be executed on the processor 12 is stored on the processor 11, and when the processor 12 executes the computer instruction, the multi-screen interaction control method according to any of the foregoing embodiments can be executed.

In a specific implementation, the electronic device 1 may include a plurality of expansion interfaces 14 at the same time.

In a specific implementation, the expansion interface 14 may be a wired interface, or may also be a wireless interface, or a part of the interfaces are wired interfaces, and a part of the interfaces are wireless interfaces, where the wired interfaces may be USB interfaces, screen projection interfaces, and the like, and the wireless interfaces may be WIFI wireless screen projection interfaces, and the like.

An embodiment of the present specification further provides another multi-screen interaction control system, and as shown in fig. 13, the multi-screen interaction control system 130 may include: interactive interface 131, central processing unit 132, wherein:

the interactive interface 131 is suitable for receiving a first callback message transmitted when a screen is newly accessed;

the central processing unit 132 is adapted to obtain a device identifier of a new access screen based on the first callback message, control the graphics engine to create a corresponding graphics engine instance, and transmit the graphics engine instance to the created master interactive service engine instance, so that the master interactive service engine instance derives a slave interactive service engine instance corresponding to the new access screen and records a master-slave relationship between the master interactive service engine instance and the slave interactive service engine instance;

In a specific implementation, the multi-screen interaction system may be further expanded, and a specific expansion manner may refer to the introduction of the multi-screen interaction control system, which is not described herein again.

Although the embodiments of the present invention are disclosed above, the present invention is not limited thereto. Various changes and modifications may be effected therein by one skilled in the art without departing from the spirit and scope of the invention as defined in the appended claims.

Claims

1. A multi-screen interaction control method comprises the following steps:

2. A multi-screen interaction control method according to claim 1, further comprising:

3. A multi-screen interaction control method according to claim 1 or 2, further comprising: determining whether to deliver the message to all or part of the interaction service engine instances according to the type of the received message, including:

4. A multi-screen interaction control method according to claim 3, wherein the transferring the received global message to a master interaction service engine instance and synchronizing to a slave interaction service engine instance, so that the master interaction service engine instance and the slave interaction service engine instance perform corresponding processing based on the global message respectively, includes:

5. A multi-screen interaction control method according to claim 3, wherein the transmitting the received non-global message to the corresponding interaction service engine instance, so that the corresponding interaction service engine instance performs corresponding processing based on the non-global message includes:

6. A multi-screen interaction control method according to claim 3, wherein the transmitting the received non-global message to the corresponding interaction service engine instance, so that the corresponding service engine instance performs corresponding processing based on the non-global message includes:

7. A multi-screen interaction control method as recited in claim 1, wherein, when the master interaction service engine instance derives a slave interaction service engine instance corresponding to the new access screen, further comprising:

8. A multi-screen interaction control method according to any one of claims 1, 2 or 4 to 7, wherein:

the graphic engine includes: the map engine is suitable for controlling the corresponding map engine instance to output map elements based on the map data;

9. A multi-screen interactive control system, comprising:

10. A multi-screen interactive control system, comprising:

a core service engine adapted to output core service data;

an interactive service engine adapted to output interactive service data;

a graphics engine adapted to output graphics data;

11. A multi-screen interactive control system according to claim 10, wherein: the central processing unit is further adapted to obtain an equipment identifier of a disconnected screen according to a second callback message transmitted in response to the screen disconnection, instruct the message center to cancel a master-slave relationship between a slave interactive service engine instance corresponding to the disconnected screen and the master interactive service engine instance, instruct the master interactive service engine instance to destroy the slave interactive service engine instance corresponding to the disconnected screen, and destroy a graphic engine instance corresponding to the disconnected screen;

12. A multi-screen interaction control system according to claim 10 or 11, wherein the message center, further adapted to determine whether to deliver a message to all or part of the interaction service engine instances based on the type of message received, comprises: and transmitting the received global message to the master interactive service engine instance and synchronizing the received global message to the slave interactive service engine instance, so that the master interactive service engine instance and the slave interactive service engine instance respectively perform corresponding processing based on the global message, and transmitting the received non-global message to the corresponding interactive service engine instance, so that the corresponding interactive service engine instance performs corresponding processing based on the non-global message.

13. A multi-screen interaction control system according to claim 12, wherein the message center is adapted to transfer core service update information transferred by the core service engine to the master interaction service engine instance and the slave interaction service engine instance, respectively, so that the master interaction service engine instance and the slave interaction service engine instance update corresponding graphical elements in the screen according to the core service update information.

14. A multi-screen interaction control system according to claim 12, wherein the central processing unit is adapted to obtain an instruction to switch the screen view angle, which is transmitted in response to detecting that the screen view angle is switched, and transmit the instruction to the message center;

15. A multi-screen interaction control system according to claim 12, wherein the central processing unit is adapted to receive and transmit to the message center an interaction service engine control instruction or a core service engine control instruction transmitted in response to an interaction control operation;

16. A multi-screen interaction control system as recited in claim 10, wherein the master interaction service engine instance also sets parameters of a slave interaction service engine instance corresponding to the new access screen when the slave interaction service engine instance is derived.

17. A multi-screen interaction control system according to any one of claims 10, 11, or 13 to 16, wherein the graphics engine includes: the map engine is suitable for controlling the corresponding map engine instance to output map elements based on the map data;

18. An electronic device, comprising: the multi-screen interaction control system comprises a memory, a processor and an expansion interface, wherein the expansion interface is suitable for being coupled with an external screen, the memory stores computer instructions capable of running on the processor, and the processor is suitable for executing the multi-screen interaction control method according to any one of claims 1 to 7 when running the computer instructions.

19. The electronic device of claim 18, wherein the expansion interface comprises at least one of:

a wired interface; a wireless interface.