CN116635825A - Display control method, display system, electronic device, and readable storage medium - Google Patents

Display control method, display system, electronic device, and readable storage medium Download PDF

Info

Publication number
CN116635825A
CN116635825A CN202280000225.XA CN202280000225A CN116635825A CN 116635825 A CN116635825 A CN 116635825A CN 202280000225 A CN202280000225 A CN 202280000225A CN 116635825 A CN116635825 A CN 116635825A
Authority
CN
China
Prior art keywords
display
operating system
information
application
communication
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202280000225.XA
Other languages
Chinese (zh)
Inventor
李英杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BOE Technology Group Co Ltd
Original Assignee
BOE Technology Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BOE Technology Group Co Ltd filed Critical BOE Technology Group Co Ltd
Publication of CN116635825A publication Critical patent/CN116635825A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/176Support for shared access to files; File sharing support
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Information Transfer Between Computers (AREA)
  • Computer And Data Communications (AREA)

Abstract

A display control method, a display system, an electronic device, and a readable storage medium, the display control method applied to the display system includes the steps of: the method comprises the steps that communication connection is established between a first device and a second device; the method comprises the steps that a first device sends application information of a first application program to a second device, wherein the first application program is an application program installed in a first operating system; and the second device displays a first identifier on a display interface of the second operating system according to the application information, wherein the first identifier is an identifier corresponding to the first application program.

Description

Display control method, display system, electronic device, and readable storage medium
Cross Reference to Related Applications
The present application claims priority to chinese patent application number 202111269094.9 filed in china at 2021, 10 and 29, the entire contents of which are incorporated herein by reference.
Technical Field
The embodiment of the disclosure relates to the technical field of computers, in particular to a display control method, a display system, electronic equipment and a readable storage medium.
Background
The electronic device needs to be operated based on an operating system, generally, when the electronic device is operated, only one operating system is in an operating state at the same time, and because part of application programs only support one operating system or have better optimizing effect on one operating system, users are more used to operating certain application programs by using a specific operating system.
Disclosure of Invention
In some aspects of the disclosure, a display control method is provided and applied to a display system, the display system comprises a first device and a second device, the first device is provided with a first operating system, the second device is provided with a second operating system, the second device comprises a display, and the second device can control the display to display a display interface of the second operating system;
the method comprises the following steps:
the first device and the second device establish communication connection;
the first device sends application information of a first application program to the second device, wherein the first application program is an application program installed in the first operating system;
and the second device displays a first identifier on a display interface of the second operating system according to the application information, wherein the first identifier is an identifier corresponding to the first application program.
In some embodiments, after the first device and the second device establish a communication connection, the method further comprises:
the second device sends a display request of the first application program to the first device;
the first device sending application information of the first application program to the second device, including:
And the first equipment sends the application information of the first application program to the second equipment according to the display request.
In some embodiments, the second device displays a first identifier on a display interface of the second operating system according to the application information, including:
the second device displays a menu identifier on a first interface of the second operating system;
and the second equipment displays a second interface comprising the first identifier when receiving an access request aiming at the menu identifier.
In some embodiments, the method further comprises:
the second device judges whether the second device establishes communication connection with the first device or not when receiving the first access request aiming at the menu identification,
and the second equipment establishes communication connection with the first equipment based on the initial access request under the condition that the second equipment does not establish communication connection with the first equipment.
In some embodiments, the first interface is a functional interface of handwriting software of the second operating system.
In some embodiments, the second device displays a first identifier on a display interface of the second operating system according to the application information, including:
And displaying at least one first identifier and at least one second identifier on a display interface of the second operating system, wherein the second identifier is an identifier corresponding to a second application program installed in the second operating system.
In some embodiments, after the second device displays the first identifier on the display interface of the second operating system according to the application information, the method further includes:
the second equipment receives an access request for a target application identifier in the first identifier;
the second device sends a starting request to the first device;
and the first equipment starts the target application program corresponding to the target application identifier according to the starting request.
In some embodiments, after the first device starts the target application according to the start request, the method further comprises:
the display of the second device is switched to display a display interface of the first operating system;
and the first equipment operates the target application program based on a first operating system, and displays an operation interface of the target application program on a display interface of the first operating system.
In some embodiments, after the first device starts the target application according to the start request, the method further comprises:
The second device generates an application window on a display interface of the second operating system, wherein the application window corresponds to at least part of the area of the display interface;
the first device runs the target application program and sends an application running interface of the target application program to the second device;
and the second equipment displays the application running interface on the application window.
In some embodiments, the second device, after generating the application window on the display interface of the second operating system, the method further comprises:
the second device receives a first operation input aiming at an area corresponding to the application window;
the second device converts the first operation input into a second operation input corresponding to the first device;
the second device sends the second operational input to the first device.
In some embodiments, the second device, after generating the application window on the display interface of the second operating system, the method further comprises:
the second device receives a first operation input aiming at an area corresponding to the application window;
the second device sending the first operational input to the first device;
The first device converts the first operation input into a second operation input corresponding to the first device.
In some embodiments, the first device has a first communication module and the second device has a second communication module, the first device and the second device establishing a connection of a first communication mode through the first communication module and the second communication module;
the first device and the second device establish a communication connection of a second communication mode based on a target communication network;
the data transmission speed of the second communication mode is greater than the data transmission speed of the first communication mode.
In some embodiments, before the first device sends the application information of the first application to the second device, the method further comprises:
in the case that the first device and the second device are connected through a first communication mode, the second device sends network access information to the first device through the first communication mode;
and the first equipment is accessed to the target communication network according to the network access information, wherein when the first equipment is accessed to the target communication network, the first equipment and the second equipment establish connection in a second communication mode based on the target communication network.
In some embodiments, before the first device accesses the target communication network according to the network access information, the method further comprises:
the first device detects whether a first application program in a target folder in the first device changes or not;
and the first equipment accesses the target communication network according to the network access information under the condition that the first application program in the target folder is changed.
In some embodiments, the second device includes a third communication module, the second device is communicatively connected to the target communication network through the third communication module, and the network access information includes access information of the target communication network.
In some embodiments, the second device includes a third communication module through which the target communication network is provided by the second device.
In some embodiments, the second device further includes a fourth communication module, where the fourth communication module includes a wireless communication module and/or a network interface, and the second device implements network connection through the wireless communication module and/or the network interface.
In some embodiments, the first communication mode is serial communication and the second communication mode is wireless local area network data communication.
In some embodiments, the first communication mode is serial communication and the second communication mode is bluetooth communication.
In some embodiments, the first communication mode is used to transmit one or more of network access information, file path information, and instruction execution results of the target communication network;
the second communication mode is for transmitting one or more of file data and multimedia data.
In some embodiments, the first device and the second device are connected through a local area network, and before the first device sends the application information of the first application program to the second device, the method further includes:
the second equipment sends broadcast information to a local area network;
the first device sends response information to the second device, wherein the response information is generated according to the broadcast information and carries the device information of the first device;
and the second equipment establishes communication connection with the first equipment according to the response information.
In some embodiments, the second device establishes a communication connection with the first device according to the response information, including:
the second device adds the first device to a device list according to the response information;
the second device obtains a selection instruction for the first device;
and the second equipment establishes communication connection with the first equipment according to the selection instruction.
In some embodiments, the display system further comprises a management server, and before the first device sends the application information of the first application program to the second device, the method further comprises:
the second device sends a connection request to the management server;
the management server sends device information of a first device to the second device according to the connection request, wherein the first device is registered in the management server in advance;
and the second equipment establishes communication connection with the first equipment according to the equipment information.
In some embodiments, the first device sending application information of a first application to the second device includes:
the first device acquires application information of a first application program in a target folder;
The first device sends the acquired application information to the second device;
the target folder is a folder with a preset path in the first device.
In some embodiments, the target folder is a desktop folder of the first device and/or a launch bar folder of the first device.
In some embodiments, before the first device obtains the application information of the first application program located in the target folder, the method further comprises:
the first device retrieves one or more of an application program of a preset program type, a file of a preset file type and an application program with a preset name in the target folder as the first application program.
In some embodiments, the first operating system is a Windows operating system and the second operating system is an android system.
In some embodiments, the method further comprises:
the second device sends a sharing request to the first device;
the second device receives sharing information returned by the first device according to the sharing request, wherein the sharing information comprises a folder path of a sharing folder and a sharing protocol, and the sharing folder is a folder in the first device;
The second device accesses the shared folder according to the shared protocol and the folder path.
In some embodiments, the method further comprises:
the second device generates a shared space;
the second device sends space information of the shared space to the first device, wherein the space information comprises a folder path and a sharing protocol of the shared space;
the first device sends a shared file to the second device based on the sharing protocol and the folder path.
In some aspects of the disclosure, a display control method is provided and applied to a first device in a display system, wherein the display system comprises the first device and a second device, the first device is provided with a first operating system, the second device is provided with a second operating system, the second device comprises a display, and the second device can control the display to display a display interface of the second operating system;
the method comprises the following steps:
establishing a communication connection with the second device;
and sending application information of a first application program to the second device so that the second device can display a first identifier on a display interface of the second operating system according to the application information, wherein the first identifier is an identifier corresponding to the first application program.
In some aspects of the disclosure, a display control method is provided and applied to a second device in a display system, wherein the display system comprises a first device and a second device, the first device is provided with a first operating system, the second device is provided with a second operating system, the second device comprises a display, and the second device can control the display to display a display interface of the second operating system;
the method comprises the following steps:
establishing a communication connection with the first device;
receiving application information of a first application program sent by the first device, wherein the first application program is an application program installed in the first operating system;
and displaying a first identifier on a display interface of the second operating system according to the application information, wherein the first identifier is an identifier corresponding to the first application program.
In some aspects of the disclosure, a display system is provided, the display system includes a first device and a second device, the first device is provided with a first operating system, the second device is provided with a second operating system, the first device and the second device are in communication connection, the second device includes a display, and the second device can control the display to display a display interface of the second operating system;
The first device and the second device are configured to:
establishing a communication connection between the first device and the second device;
the first device is configured to:
transmitting application information of a first application program to the second device, wherein the first application program is an application program installed in the first operating system;
the second device is further configured to:
and displaying a first identifier on a display interface of the second operating system according to the application information, wherein the first identifier is an identifier corresponding to the first application program.
In some embodiments, the second device is configured to:
sending a display request of the first application program to the first device;
the first device is configured to:
and sending the application information of the first application program to the second equipment according to the display request.
In some embodiments, the first device is an external computer module, the second device is an intelligent interaction tablet, the intelligent interaction tablet includes a communication interface, and the external computer module is in communication connection with the intelligent interaction tablet through the communication interface.
In some embodiments, the external computer module is an OPS module that includes an OPS interface.
In some embodiments, when the second device displays the first identifier on the display interface of the second operating system according to the application information, the second device is specifically configured to:
displaying a menu identifier on a first interface of the second operating system;
and when an access request for the menu identifier is received, displaying a second interface comprising the first identifier.
In some embodiments, the second device is configured to:
when the first access request for the menu identification is received, judging whether the second equipment establishes communication connection with the first equipment,
and establishing a communication connection with the first device based on the initial access request under the condition that the communication connection with the first device is not established.
In some embodiments, the first interface is a functional interface of handwriting software of the second operating system.
In some embodiments, when the second device displays the first identifier on the display interface of the second operating system according to the application information, the second device is specifically configured to:
and displaying at least one first identifier and at least one second identifier on a display interface of the second operating system, wherein the second identifier is an identifier corresponding to a second application program installed in the second operating system.
In some embodiments, the second device is further configured to:
receiving an access request for a target application identifier in the first identifier;
sending a start request to the first device;
the first device is further configured to:
and starting the target application program corresponding to the target application identifier according to the starting request.
In some embodiments, the second device is further configured to:
the second device is configured to:
the display is switched to display the display interface of the first operating system;
the first device is configured to:
and operating the target application program based on a first operating system, and displaying an operating interface of the target application program on a display interface of the first operating system.
In some embodiments, the second device is further configured to:
generating an application window on a display interface of the second operating system, wherein the application window corresponds to at least part of the area of the display interface;
the first device is further configured to:
running the target application program and sending an application running interface of the target application program to the second device;
the second device is further configured to:
and displaying the application running interface on the application window.
In some embodiments, the second device is further configured to:
receiving a first operation input aiming at an area corresponding to the application window;
converting the first operation input into a second operation input corresponding to the first device;
the second operational input is sent to the first device.
In some embodiments, the second device is further configured to:
receiving a first operation input aiming at an area corresponding to the application window;
transmitting the first operation input to the first device;
the first operation input is converted into a second operation input corresponding to the first device.
In some embodiments, the first device has a first communication module and the second device has a second communication module, the first device and the second device establishing a connection of a first communication mode through the first communication module and the second communication module;
the first device and the second device establish a communication connection of a second communication mode based on a target communication network;
the data transmission speed of the second communication mode is greater than the data transmission speed of the first communication mode.
In some embodiments, the second device is further configured to:
Transmitting network access information to the first device through a first communication mode when the first device and the second device are connected through the first communication mode;
the first device is configured to:
and accessing a target communication network according to the network access information, wherein when the first equipment is accessed to the target communication network, the first equipment and the second equipment establish connection of a second communication mode based on the target communication network.
In some embodiments, the first device is configured to:
detecting whether a first application program in a target folder in the first device changes or not;
and accessing the target communication network according to the network access information under the condition that the first application program in the target folder is changed.
In some embodiments, the second device includes a third communication module, the second device is communicatively connected to the target communication network through the third communication module, and the network access information includes access information of the target communication network.
In some embodiments, the second device includes a third communication module through which the target communication network is provided by the second device.
In some embodiments, the second device further includes a fourth communication module, where the fourth communication module includes a wireless communication module and/or a network interface, and the second device implements network connection through the wireless communication module and/or the network interface.
In some embodiments, the first communication mode is serial communication and the second communication mode is wireless local area network data communication.
In some embodiments, the first communication mode is serial communication and the second communication mode is bluetooth communication.
In some embodiments, the first communication mode is used to transmit one or more of network access information, file path information, and instruction execution results of the target communication network;
the second communication mode is for transmitting one or more of file data and multimedia data.
In some embodiments, the first device and the second device are connected by a local area network;
the second device is further configured to:
transmitting broadcast information to a local area network;
the first device is further configured to:
transmitting response information to the second device, wherein the response information is generated according to the broadcast information, and the response information carries the device information of the first device;
The second device is further configured to:
and establishing communication connection with the first equipment according to the response information.
In some embodiments, when the second device establishes a communication connection with the first device according to the response information, the second device is specifically configured to:
adding the first equipment to an equipment list according to the response information;
acquiring a selection instruction for the first equipment;
and establishing communication connection with the first equipment according to the selection instruction.
In some embodiments, the display system further comprises a management server;
the second device is further configured to:
sending a connection request to the management server;
the management server is configured to:
transmitting device information of a first device to the second device according to the connection request, wherein the first device is registered in the management server in advance;
the second device is further configured to:
and establishing communication connection with the first equipment according to the equipment information.
In some embodiments, when sending the application information of the first application program to the second device, the first device is specifically configured to:
acquiring application information of a first application program in a target folder;
Sending the acquired application information to the second device;
the target folder is a folder with a preset path in the first device.
In some embodiments, the target folder is a desktop folder of the first device and/or a launch bar folder of the first device.
In some embodiments, the first device is configured to:
and retrieving one or more of an application program of a preset program type, a file of a preset file type and an application program with a preset name in the target folder as the first application program.
In some embodiments, the first operating system is a Windows operating system and the second operating system is an android system.
In some embodiments, the second device is further configured to:
sending a sharing request to the first device;
receiving sharing information returned by the first device according to the sharing request, wherein the sharing information comprises a folder path of a sharing folder and a sharing protocol, and the sharing folder is a folder in the first device;
and accessing the shared folder according to the shared protocol and the folder path.
In some embodiments, the second device is further configured to:
generating a shared space;
transmitting space information of the shared space to the first device, wherein the space information comprises a folder path and a sharing protocol of the shared space;
the first device is further configured to:
and sending a shared file to the second device based on the shared protocol and the folder path.
In some aspects of the disclosure, an electronic device is provided, the electronic device is a second device in a display system, the display system includes a first device and a second device, the first device is provided with a first operating system, the second device is provided with a second operating system, the second device includes a display, and the second device can control the display to display a display interface of the second operating system;
the second device is configured to:
establishing a communication connection with the first device;
receiving application information of a first application program sent by the first device, wherein the first application program is an application program installed in the first operating system;
and displaying a first identifier on a display interface of the second operating system according to the application information of the first application program, wherein the first identifier is an identifier corresponding to the first application program.
In some embodiments, the first device is an external computer module, the second device is an intelligent interaction tablet, the intelligent interaction tablet includes a communication interface, and the external computer module is in communication connection with the intelligent interaction tablet through the communication interface.
In some embodiments, the external computer module is an OPS module that includes an OPS interface.
In some embodiments, when the second device displays the first identifier on the display interface of the second operating system according to the application information, the second device is specifically configured to:
displaying a menu identifier on a first interface of the second operating system;
and when an access request for the menu identifier is received, displaying a second interface comprising the first identifier.
In some embodiments, the first interface is a functional interface of handwriting software of the second operating system.
In some embodiments, when the second device displays the first identifier on the display interface of the second operating system according to the application information, the second device is specifically configured to:
and displaying at least one first identifier and at least one second identifier on a display interface of the second operating system, wherein the second identifier is an identifier corresponding to a second application program installed in the second operating system.
In some aspects of the present disclosure, there is also provided an electronic device including: a memory, a processor, and a program stored on the memory and executable on the processor; the processor being configured to read a program in the memory to implement the steps of the method according to any of the preceding claims.
In some aspects of the disclosure, there is also provided a readable storage medium for storing a program which when executed by a processor implements the steps of the method according to any one of the preceding claims.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings that are needed in the description of the embodiments of the present disclosure will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present disclosure, and other drawings may be obtained according to these drawings without inventive effort to a person of ordinary skill in the art.
FIG. 1 is a connection scenario diagram of a first device and a second device provided by an embodiment of the present disclosure;
FIG. 2 is a flow chart of a display control method according to an embodiment of the disclosure;
FIG. 3 is a flow chart of a start target application provided in an embodiment of the present disclosure;
FIG. 4 is a schematic diagram of a display interface of a second device according to an embodiment of the disclosure;
FIG. 5 is a flow diagram of implementing file sharing in an embodiment of the present disclosure;
FIG. 6 is a schematic diagram of a first device and a second device according to an embodiment of the present disclosure
FIG. 7 is a schematic diagram of the structure of a first device and a second device according to an embodiment of the present disclosure;
fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
Detailed Description
The following description of the technical solutions in the embodiments of the present disclosure will be made clearly and completely with reference to the accompanying drawings in the embodiments of the present disclosure, and it is apparent that the described embodiments are some embodiments of the present disclosure, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without inventive effort, based on the embodiments in this disclosure are intended to be within the scope of this disclosure.
The terms "first," "second," and the like in embodiments of the present disclosure are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus. Furthermore, the use of "and/or" in the present application means at least one of the connected objects, such as a and/or B and/or C, means 7 cases including a alone a, B alone, C alone, and both a and B, both B and C, both a and C, and both A, B and C.
In some aspects of the present disclosure, a display control method is provided.
In some of these embodiments, the display control method is applied to a display system.
As shown in fig. 1, in one embodiment, the display system includes a first device 101 and a second device 102, where the first device 101 is installed with a first operating system, the second device 102 is installed with a second operating system, the first device 101 is communicatively connected to the second device 102, the second device 102 includes a display, and the second device 102 is capable of controlling the display to display a display interface of the second operating system.
In one embodiment, the first device 101 is an external computer module, in some embodiments, the external computer module is an OPS module including an OPS (Open Pluggable Specification, open pluggable specification, a computing module plug-in format) interface, in this embodiment, only the external computer module is taken as the OPS module for exemplary illustration, and the second device 102 is an intelligent interactive tablet.
It should be understood that, in this embodiment, only the first device 101 is taken as an OPS module, and the second device 102 is taken as an intelligent interaction tablet for exemplary illustration, and the first device 101 and the second device 102 may also be other devices, which is not limited thereto.
The intelligent interaction panel is also called as an intelligent panel or a conference panel, and is an intelligent device supporting man-machine interaction functions such as touch control, and the intelligent interaction panel usually supports a plurality of operation signal sources, for example, the intelligent interaction panel can operate an operation system installed by the intelligent interaction panel or an operation based on signals of external devices.
The display of the intelligent interactive tablet only supports the running interface for displaying one operating system at the same time, for example, different operating systems such as Android (Android, an operating system), windows (Windows, an operating system) system, linux (an operating system), kylin (an operating system), UOS (an operating system) and the like. In order to improve adaptability to different scenes, multi-system support can be provided for the intelligent interaction tablet.
For example, the intelligent interaction tablet serving as the second device 102 in this embodiment operates based on an Android system, for example, may be an Android system customized according to needs, so as to provide a better user experience. In order to provide better software services, in this embodiment, support for a Windows system is also required to be provided for the intelligent interactive tablet, where in this embodiment, the Windows system is run on the OPS module as the first device 101. Obviously, other operating systems can also be run on the OPS module as needed.
In some embodiments, the OPS module specifically includes a control chip SOC, a memory, a power supply, a power management system, a physical interface transceiver (PHY), a USB (Universal Serial Bus ) multiport repeater (UHB), a plurality of USB interfaces, a wireless communication module (e.g., wifi (wireless fidelity) module), and a video interface (e.g., HDMI (High Definition Multimedia Interface, high definition multimedia interface), DP (DisplayPort, digital video interface standard), DVI (Digital Visual Interface, digital video interface), VGA (Video Graphics Arra, video graphics array)), and the like. Obviously, the interfaces to be set may be set according to the needs, for example, UART (Universal Asynchronous Receiver/transceiver) interfaces, audio interfaces, etc. may be added, which are not further limited herein.
The OPS module can be in communication connection with the intelligent interaction panel through the connector, the connector can be an 80pin (80 needle) connector or the like, and a power signal, a USB signal, a video signal and the like are integrated in the connector.
It will be appreciated that the operating systems running on the first device 101 and the second device 102 may also be changed and adjusted as needed, which is not further limited in this embodiment.
In the related art, if software in the OPS module needs to be run during the use process of the intelligent interactive tablet, an operator is required to disconnect a video signal provided by the second operating system to the display of the second device 102, then access the video signal of the OPS module to the display of the second device 102, and further, start and run the software in the OPS module.
As shown in fig. 2, in some of these embodiments, the display control method includes the steps of:
step 201: the first device and the second device establish communication connection;
step 202: the first device sends application information of a first application program to the second device, wherein the first application program is an application program installed in the first operating system;
step 203: and the second equipment displays a first identifier on a display interface of the second operating system according to the application information.
In this embodiment, the first device and the second device first need to establish a communication connection. Next, the first device transmits application information of an application program installed on the first operating system to the second device.
In some of these embodiments, the application information is sent in response to a display request from the second device.
Specifically, in some embodiments, after step 202, the method further includes:
the second device sends a display request of the first application program to the first device;
the first device sending application information of the first application program to the second device, including:
and the first equipment sends the application information of the first application program to the second equipment according to the display request.
In this embodiment, the second device first sends a display request to the first device to obtain information about the first application in the first device. And after receiving the display request sent by the second device, the first device sends the application information of the callable first application program to the second device. And after receiving the application information, the second device displays the first identifier on a display interface of a second operating system installed by the second device.
In this embodiment, the first application may be an application installed on the first device, for example, an application installed in a windows system such as chat, video conference, browser, etc., and further, the first application may include a folder, a file (e.g., a word file) having a certain format, etc.
In this embodiment, the first identifier may be a first application identifier corresponding to the first application program, and the first identifier may also be a first folder identifier corresponding to a folder in which the first application program is located.
In this embodiment, the first application identifier may be displayed in different manners, and by way of example, an icon of the first application may be directly displayed as the first application identifier, or a name of the first application may be displayed as the first application identifier.
In this embodiment, the application information may specifically include information related to the first application program, such as a name, an icon, a start parameter, an application type, a link address, and the like of the first application program, so that the second device may display the first identifier according to the application information sent by the first device.
According to the embodiment, the first identifier on the first device can be displayed on the display interface of the second operating system when the second operating system is directly operated, and related information of the first application program available for use can be known without switching to the first operating system, so that convenience in operation of a user in the process of using the first device and the second device is improved.
In this embodiment, the identifier corresponding to the first application program may be used in different manners, so as to improve convenience in use.
In some embodiments, the step 203 includes:
the second device displays a menu identifier on a first interface of the second operating system;
and the second equipment displays a second interface comprising the first identifier when receiving an access request aiming at the menu identifier.
In this embodiment, a menu identifier may be displayed first, and the user may access the menu identifier in different manners, for example, may access the menu identifier by clicking, voice control, mouse control, touch pad control, and the like.
When the user accesses the menu identification, a second interface including the first identification is displayed.
In this embodiment, a folder may be opened as the second interface, and the first identifier may be displayed in the folder; for another example, an application list can be further expanded to serve as a second interface, and the first identifier is displayed in the application list; in addition, a sub-menu of the menu identifier can be set, and the sub-menu is used as a second interface for displaying the first identifier.
In some embodiments, the first interface is a functional interface of handwriting software of the second operating system, and on the functional interface, a first identifier corresponding to the first application program may be displayed in the form of an icon or a list.
In some embodiments, the handwriting software is specifically used as a handwriting board to provide handwriting functions during a conference, so that the handwriting software is equivalent to being used as a "conference whiteboard", and when in use, a participant can write content on a handwriting interface of the handwriting software to display the content to the participant.
The first interface is set as a functional interface of the handwriting software, so that when the first application program is needed to be used, the second interface can be conveniently and quickly unfolded based on the functional interface, for example, an icon is arranged on the functional interface of the handwriting software to serve as a menu identifier, a user clicks the menu identifier to open the second interface with the first identifier, the second interface can be the same as the content part of the first interface, for example, a sub-window is only opened in a partial area of the first interface to display the first identifier, the selection of the first identifier is further completed, and the convenience of operation is improved.
In some of these embodiments, the method further comprises:
the second device judges whether the second device establishes communication connection with the first device or not when receiving the first access request aiming at the menu identification,
and the second equipment establishes communication connection with the first equipment based on the initial access request under the condition that the second equipment does not establish communication connection with the first equipment.
The first device is taken as an OPS module, the second device is taken as an intelligent interaction tablet for carrying out an exemplary description, when the menu identifier is clicked on the second device for the first time to generate a first access request aiming at the menu identifier, whether the first device establishes communication connection with the second device is firstly detected, and if the communication connection is not established, the communication connection between the first device and the second device is required to be established.
Further, in some embodiments, the first device may be in a standby or power-off state, and when the menu identifier is clicked, the first device may be woken up or controlled to be turned on, so as to establish a communication connection between the first device and the second device.
In the implementation, the first device can be awakened or controlled to be started, and a prompt window can be popped up to enable a user to select whether the first device needs to be awakened or controlled to be started in the prompt window.
It should be noted that, the initial access request refers to a request before the second device establishes a communication connection with the first device, where the communication connection does not refer to a connection between physical interfaces, but refers to a connection between electrical signals, in actual product use, the actual ops module is always physically connected to the intelligent interaction panel, but in a case where the ops module is not powered on, there is no connection between the two electrical signals, so the initial access request refers to an access request before the two electrical signal connections are implemented. In addition, the initial access request is not particularly limited to a "one-time only" access request, and may be performed by the intelligent interaction tablet, and may be performed multiple times per power-on, because multiple times of initial access requests may be required due to device failure or incomplete user operation, and the initial access request may be understood as an access request for establishing a communication connection between the first device and the second device.
In some embodiments, the step 203 includes:
and displaying at least one first identifier and at least one second identifier on a display interface of the second operating system, wherein the second identifier is an identifier corresponding to a second application program installed in the second operating system.
In some embodiments, the first identifier and the second identifier may also be displayed in the same interface, and illustratively, the first identifier and the second identifier may be displayed in the same folder. The patterns of the first identifier and the second identifier may be the same or different, and for example, a specific symbol may be added to the first identifier to indicate that the identifier is the first identifier on the first device.
By displaying the first mark and the second mark on the same interface, a user can know the applicable application program comprehensively, and the use convenience is improved.
In some embodiments, after the second device displays the first identifier on the display interface of the second operating system according to the application information, the method further includes:
the second equipment receives an access request for a target application identifier in the first identifier;
The second device sends a starting request to the first device;
and the first equipment starts the target application program corresponding to the target application identifier according to the starting request.
In this embodiment, when a corresponding first application program needs to be executed according to the selection of the first identifier, the target application is executed by the first device based on the first operating system.
It can be understood that the second device can directly start the first device to run the target application program installed in the first operating system based on the start request, and in use, the target application program installed in the first operating system can be started without the need of manual switching of the operating system by an operator, so that the convenience of use is improved.
In some embodiments, after the first device starts the target application according to the start request, the method further comprises:
the display of the second device is switched to display a display interface of the first operating system;
and the first equipment operates the target application program based on a first operating system, and displays an operation interface of the target application program on a display interface of the first operating system.
In this embodiment, when the first application program is started, the display interface displayed on the display of the second device may be switched to display the display interface of the first operating system, and the target application program may be run on the display interface of the first operating system, or the running interface of the target application program may be displayed on the display interface of the second operating system.
Specifically, in this embodiment, the video signal provided by the second operating system to the display may be disconnected, and then the display is controlled to be connected to the video signal of the first operating system, so that the display interface of the target application running in the first operating system can be displayed on the display.
In addition, an application window can be established on the display interface of the second operating system, and the display interface of the target application program can be displayed in the application window.
In some embodiments, after the first device starts the target application according to the start request, the method further includes:
the second device generates an application window on a display interface of the second operating system, wherein the application window corresponds to at least part of the area of the display interface;
the first device runs the target application program and sends an application running interface of the target application program to the second device;
And the second equipment displays the application running interface on the application window.
As shown in fig. 4, in this embodiment, it may be understood that a certain area is divided on the display interface of the second operating system, and the area is used as an application window, and the display interface of the first operating system is displayed on the application window.
The implementation manner of the application window can be based on a Widget (Widget) provided by the android system, or can be based on a window management (window manager) function provided by the android system, and a floating window is established on a display interface of the second operating system to serve as the application window.
For example, it may be that a target application interface running based on the first operating system is displayed, which is equivalent to displaying the running content of two operating systems on the same display interface. At this time, the display interface of the first operating system and the display interface of the second operating system may coexist, and the first operating system and the second operating system may be simultaneously operated.
The application window may be understood as a player running in a floating window or a widget mode on a display interface of the second operating system, a video signal input by the OPS module is converted by an MIPI (Mobile Industry Processor Interface ) to realize a video stream of a camera, and then the video stream is played in the player, so that the running interface of the first operating system is played in a video manner, and the size and the position of the application window may be fixed, or an adjustment control may be set, and the size, the position, and the like of the application window may be adjusted by the adjustment control, which is not further limited herein.
In practice, a default may be set to launch the target application in the manner of an application window or an automatic switching operating system. The method can also set different control modes to correspond to different starting modes, and can be set as a mode of double-clicking a certain first application identifier to display a display interface of a corresponding first application program in an application window, and can start the corresponding first application program in a mode of switching an operating system by long-pressing the certain first application identifier. In this embodiment, a specific control manner is not further limited.
In some of these embodiments, the second device, after generating the application window on the display interface of the second operating system, the method further comprises:
the second device receives a first operation input aiming at an area corresponding to the application window;
the second device converts the first operation input into a second operation input corresponding to the first device;
the second device sends the second operational input to the first device.
In some other embodiments, the second device, after generating the application window on the display interface of the second operating system, the method further comprises:
The second device receives a first operation input aiming at an area corresponding to the application window;
the second device sending the first operational input to the first device;
the first device converts the first operation input into a second operation input corresponding to the first device.
There may be differences in the operating instructions in the different operating systems. For example, in the Android system, if an operation option of an application program needs to be opened, the operation option is usually implemented by long-pressing an icon of the application program, and in the Windows system, the operation option is implemented by clicking a right button of a mouse; if an application needs to be opened, in the Android system, a click is usually performed, and in Windows, a click is performed by left mouse button.
It follows that specific operation inputs corresponding to the same operation are different in different operation systems.
In this embodiment, if it is detected that the first operation input is input for the region of the application window, that is, for the target application running in the first operating system, the first operation input is converted into a second operation input matched with the first operating system, and sent to the first operating system.
The conversion process may be performed in the first device or in the second device. In other words, in this embodiment, after receiving the first operation input, the second device may convert the first operation input into a second operation input matched with the first device and then send the second operation input to the first device, or may directly send the first operation input to the first device and then convert the first operation input into the matched second operation input by the first device.
In this way, in the embodiment, the operation in the second operating system according to the operation habit corresponding to the second operating system can be realized, that is, the first device can be controlled to execute the corresponding operation task, the operation process is simplified, and the user experience is improved.
In this embodiment, the first device and the second device may be controlled to establish a communication connection in different manners.
In some embodiments, the first device has a first communication module and the second device has a second communication module, the first device and the second device establishing a connection of a first communication mode through the first communication module and the second communication module; the first device and the second device establish a communication connection of a second communication mode based on the target communication network; the data transmission speed of the second communication mode is greater than the data transmission speed of the first communication mode.
In some of these embodiments, the first device and the second device may be controlled to establish a communication connection by:
in the case that the first device and the second device are connected through a first communication mode, the second device sends network access information to the first device through the first communication mode;
and the first equipment is accessed to the target communication network according to the network access information, wherein when the first equipment is accessed to the target communication network, the first equipment and the second equipment establish connection in a second communication mode based on the target communication network.
In this embodiment, the first device and the second device perform data transmission in a multi-path communication manner, so as to improve convenience and data transmission speed of data transmission.
In this embodiment, the first device has a first communication module, the second device has a second communication module, and the first device and the second device establish a connection in a first communication mode through the first communication module and the second communication module. Specifically, the first device and the second device are first connected through a first communication mode. The first communication mode may be a relatively simple connection mode, and in some embodiments, the first communication module and the second communication module are matched serial ports, and the first communication mode may be serial port connection, where the serial ports refer to an expansion interface adopting a serial communication manner. The communication line of the serial port can be connected only by a pair of transmission lines, the realization is simpler, the serial port connection can be realized based on the UART interface, and thus, the communication connection of the first equipment and the second equipment can be realized directly and conveniently through the data line of the entity.
In some embodiments, before the first device accesses the target communication network according to the network access information, the method further comprises:
the first device detects whether a first application program in a target folder in the first device changes or not;
and the first equipment accesses the target communication network according to the network access information under the condition that the first application program in the target folder is changed.
In this embodiment, the first device may determine whether to establish a communication connection with the second device in the second communication mode according to the need, where in some embodiments, the first device establishes the communication connection with the second device in the second communication mode only when an application installed in the first device changes, or when the relevant information of the first application available to the second device needs to be updated.
Specifically, the first device detects whether the first application program in the target folder changes, specifically, whether the application list storing the first application program changes or not may also detect whether the application program in the target folder changes, and when the first application program in the target folder changes, the first device accesses the target communication network according to the network access information sent by the second device, so as to establish communication connection with the second communication mode of the second device.
In some embodiments, the first communication module and the second communication module may also select other hardware data interfaces, and can conveniently and quickly establish the connection of the first communication mode through a plug-in manner and the like.
After the first device and the second device are connected through the first communication mode, the second device transmits network access information to the first device.
It will be appreciated that some of the functions of the first device and the second device need to be implemented based on network access functions, the second device itself having a display, and the second device being able to access the network, which may be a local area network or a wide area network, such as the internet, by way of a wireless access point or the like, which is relatively convenient due to the nature of the second device itself.
In some of these embodiments, the second device includes a third communication module, the second device is communicatively connected to the target communication network through the third communication module, and the network access information includes network access information of the target communication network.
The third communication module may be a wifi module. Specifically, in this embodiment, the second device is provided with a wifi module, and accesses the target communication network through the wifi module, where the target communication network may be provided by a wireless access point such as a router, a gateway, or the like.
In some embodiments, the network access information may specifically include network access information such as a name, an encryption manner, a key, a password, and the like of the wireless access point, and based on the network access information, the first device may automatically access the wireless access point based on the network access information, so as to control the first device to access the target communication network, and implement network connection. In this way, the first device and the second device are able to access a target communication network provided by the same wireless access point.
In some of these embodiments, the second device includes a third communication module and the target communication network is provided by the second device through the third communication module.
In this embodiment, the wifi module is disposed on the second device, however, the wifi module is not used to enable the second device to implement network connection, but is used to perform network sharing. It can be understood that the second device realizes network connection through other modes, further, a wireless access point is established based on the wifi module, and the first device accesses the wireless access point established by the wifi module, so that network connection is realized.
Specifically, in some embodiments, the second device further includes a fourth communication module, the fourth communication module including a wireless communication module and/or a network interface. That is, the fourth communication module may be a wireless communication module, such as a wifi module, or a wired communication module, such as a network interface that needs to be connected to a communication line.
The network interface is taken as a network cable interface for illustration, and the second device can be connected with a network cable to realize network connection based on the network cable interface. Further, the second device establishes a wireless hotspot through the wifi module to provide network sharing, and the first device accesses the wireless hotspot to realize network connection.
In another embodiment, it may be understood that the second device is provided with two wifi modules, where one wifi module is used to implement network connection, and the other wifi module is used to establish a wireless hotspot, and the first device is in communication connection with the second device through the wireless hotspot established by the wifi module, so that the first device can establish network connection with the second device through the wifi module that establishes the wireless hotspot, so that high-speed network data communication between the first device and the second device is implemented, and the first device can indirectly implement network access through the second device.
It can be appreciated that, in this embodiment, the hardware structure and the required software support of the wifi module may refer to related technologies, and the wifi module itself is not further limited herein.
As shown in fig. 1, in this embodiment, two-way communication between the first device and the second device may also be implemented in other manners, and in some embodiments, the first communication mode is serial communication, and the second communication mode is wireless local area network data communication (Wireless Local Area Networks, WLAN), specifically, may be a wifi network; in other embodiments, the first communication mode is serial communication and the second communication mode is bluetooth communication.
In an exemplary embodiment, the second device may transmit bluetooth pairing information to the first device through the first communication mode, and bluetooth modules are disposed in the first device and the second device, and the first device and the second device may establish bluetooth connection through the bluetooth modules based on the bluetooth pairing information.
In some of these embodiments, the data transmission speed of the second communication mode is greater than the data transmission speed of the first communication mode. The first communication mode is used for transmitting one or more of network access information, file path information and instruction execution results of the target communication network. The file path information may include path information of a file shared in the first device and the second device.
The second communication mode is for transmitting one or more of file data and multimedia data.
In this embodiment, the communication connection established based on the first communication mode is more convenient, for example, when the communication connection is based on the serial port connection, the implementation process of the OPS module and the intelligent interactive UART interface is simpler by directly implementing the connection on the hardware structure, and further, based on the first communication mode, the first device and the second device can establish a second communication mode with a faster data transmission speed, so that based on the second communication mode, various files, multimedia data such as picture video and the like and other large files can be more rapidly transmitted.
In the technical scheme of the embodiment, the data transmission speed and convenience are improved through a communication mode of two-way communication.
In some embodiments, the first device and the second device are located in the same local area network, and are connected through the local area network, and before the first device sends the application information of the first application program to the second device, the method further includes:
the second equipment sends broadcast information to a local area network;
the first device sends response information to the second device, wherein the response information is generated according to the broadcast information and carries the device information of the first device;
and the second equipment establishes communication connection with the first equipment according to the response information.
It can be understood that in this embodiment, the local area network refers to an area network established in a local area, the distribution area range of the local area network is limited, the data transmission speed inside the local area network is faster, the performance is more stable, the framework is simple, and the local area network has a certain sealing property. The second device may broadcast a specific message in its local area network, and may, for example, broadcast the broadcast information by means of UDP (User Datagram Protocol ) communication. The first device and the second device may access the same local area network in different manners such as wired or wireless manners.
In some embodiments, the second device establishes a communication connection with the first device according to the response information, including:
the second device adds the first device to a device list according to the response information;
the second device obtains a selection instruction for the first device;
and the second equipment establishes communication connection with the first equipment according to the selection instruction.
In this embodiment, the first device and the second device may be two devices in the local area network, and when in implementation, the second device sends broadcast information, and multiple devices receiving the broadcast information may return response information, and the second device may add each device returning the response information to the device list, further, confirm the first device according to the selection of the user, and establish communication connection with the first device according to the device information carried in the response information returned by the first device, so as to implement interaction between the first device and the second device and service sharing of applications, files and the like.
In other embodiments, the first device and the second device may also establish a communication connection based on a wide area network, which may be the internet, for example.
In some embodiments, the display system further comprises a management server, and before the first device sends the application information of the first application program to the second device, the method further comprises:
the second device sends a connection request to a management server;
the management server sends device information of a first device to the second device according to the connection request, wherein the first device is registered in the management server in advance;
and the second equipment establishes communication connection with the first equipment according to the equipment information.
In this embodiment, each device that can provide a service is first registered in the management server, and when the second device needs to establish a communication connection with the first device, the first device may be selected from the list of registered devices provided by the management server, and further, the communication connection with the first device may be established based on the relevant information of the first device carried in the registration information.
It will be understood that when the first device and the second device are communicatively connected through a local area network or a wide area network, all interactive data such as command messages, file data, instruction execution results, etc. between the first device and the second device are transmitted through the local area network or the wide area network.
In some of these embodiments, the first device sending application information of a first application to the second device includes:
the first device acquires application information of a first application program in a target folder;
the first device sends the acquired application information to the second device;
in this embodiment, the application program in the first device that can be invoked by the second device may be all application programs or may be part of application programs, and illustratively, the second device may invoke all application programs in the first device by accessing registry information of the first device.
In some of these embodiments, to improve the convenience of device interaction, a specific target folder is set, and the second device can only call the application in the target folder. The target folder may also be a folder having a preset path.
In some embodiments, the target folder body may be a desktop folder of the first device, a launch bar folder of the first device. In addition, the application sharing service provided by the first device can be controlled more conveniently by the preset path folders such as folders named as sharing folders on the desktop.
In some embodiments, before the first device obtains the application information of the first application program located in the target folder, the method further comprises:
the first device retrieves one or more of an application program of a preset program type, a file of a preset file type and an application program with a preset name in the target folder as the first application program.
In this embodiment, after the target folder is determined, the first application program in the target folder is further determined, and in this embodiment, one or more of an application program of a preset program type, a file of a preset file type, and an application program with a preset name in the target folder may be searched for as the first application program.
For example, in the case where the first device is an OPS module in which the windows system is installed, an application program having a preset name ". Exe" extension in the target folder may be retrieved as the first application program, an application program having a preset program type of "executable application" or "application program" may be retrieved, and a file having a file type of "shortcut" or "shortcut start" may be retrieved as the first application program.
In this embodiment, in order to improve the convenience of interaction between the first device and the second device, a file sharing function is also provided.
In some of these embodiments, the file sharing functionality may be provided on the basis of the first device.
In some of these embodiments, the method further comprises:
the second device sends a sharing request to the first device;
the second device receives sharing information returned by the first device according to the sharing request, wherein the sharing information comprises a folder path of a sharing folder and a sharing protocol, and the sharing folder is a folder in the first device;
the second device accesses the shared folder according to the shared protocol and the folder path.
When the method is implemented, the second device starts the file management function first, then sends a file sharing request to the first device, starts the file sharing service when the first device monitors the file sharing request, and returns sharing information to the second device, wherein the sharing information can carry related information such as addresses, user names, passwords and the like of the sharing space.
Based on the sharing information, the second device can access the folder path through a sharing protocol to enable access to shared files in the shared folder, thereby enabling access to and manipulation of files located in the second operating system based on the file sharing function.
The sharing request and the sharing information can be transmitted based on the first communication mode or the second communication mode, and the file to be shared is transmitted through the second communication mode, so that the file transmission speed is improved.
In this embodiment, the sharing protocol may select an existing or modified file sharing protocol, and may implement file sharing based on ftp (File Transfer Protocol ), sampa (a file sharing service), nfs (Network File System ), and the like, for example.
For example, a shared memory space may be provided by the ftp, samba, or nfs protocols described above, and then the first device sends shared information of the shared space to the second device for the second device to access the shared space.
In other embodiments, the file sharing functionality may be provided based on the second device.
In some of these embodiments, the method further comprises:
the second device generates a shared space;
the second device sends space information of the shared space to the first device, wherein the space information comprises a folder path and a sharing protocol of the shared space;
The first device sends a shared file to the second device based on the sharing protocol and the folder path.
In this embodiment, the shared space is generated on the second device, which may be, for example, a shared folder that is created to share the files in the shared folder.
Next, spatial information of the shared space is generated, the spatial information at least needs to include a folder path of the spatial information, and the first device in communication connection with the second device can access the shared folder based on the folder path, so that file transmission to the shared folder or file acquisition from the shared folder is realized.
The spatial information may also include some other information, including, by way of example, the size of the shared folder, the time of validity, etc.
After the space information is generated, the space information of the shared folder is then sent to the first device, and the first device can send the file to be shared into the shared folder based on the space information, or can acquire the required file from the shared folder, so that the file is equivalent to a local file serving as the second device, and at the moment, the second device can directly call the file by calling the local device.
In this way, the embodiment realizes file sharing in the first device and the second device, and improves the interactive control effect between the first device and the second device.
As shown in fig. 5, the technical solution of this embodiment may be summarized as that first, a first device or a second device generates a shared space and starts a file sharing function, and then spatial information of the shared space is sent to another device, so that the other device can access a shared file in the shared space according to the spatial information, and implement the file sharing function.
Furthermore, in some of these embodiments, the file sharing functionality may also be implemented through a cloud server. Specifically, a file sharing space can be provided through the cloud server, in the working process, the first device and the second device can both upload files to the file sharing space and download files from the file sharing space, and file sharing between the first device and the second device can also be realized.
In some embodiments, file sharing may also be implemented by hardware sharing, specifically, the hardware structure is a data interface or a memory, and in this embodiment, the hardware structure is first used as the data interface, and the data interface is specifically illustrated as a USB interface.
In one embodiment, a USB interface is provided on the second device, where the USB interface has a switching configuration that can be switched from hardware to being hung on the board system to the first device or to being hung on the board system of the second device. In this embodiment, a control switch may be provided, and the circuit connection state of the USB interface is controlled by the control switch, so that the USB interface is mounted on the board card system of the first device or on the board card system of the second device. When the file is required to be called in the first equipment, the switching control switch enables the USB interface to be hung on the board card system of the first equipment, so that the file in the mobile storage can be read based on the first operating system, and similarly, when the file is required to be called in the second equipment, the switching control switch enables the USB interface to be hung on the board card system of the second equipment.
When the hardware interface is a memory, the working principle is similar to the above process, and the mounting state of the memory can be controlled by setting a control switch, so that the file sharing function is realized.
As shown in fig. 6, it can be understood that, compared with the related art, in the technical solution of the present embodiment, a control instruction receiving module 611, a file sharing service module 612, and an application manipulation module 613 are added to the first device 610, and each module in the first device 610 is a software module.
The control instruction receiving module 611 performs message interception through the command control class channel to obtain the control message, and the intercepted and obtained message may include control messages such as application list obtaining, application opening, and file sharing service opening/closing.
The file sharing service module 612 performs operations such as opening/closing of the file sharing service, configuration of the file sharing service, and the like according to the instruction related to file sharing received by the control instruction receiving module 611, and returns the result to the first system through the control instruction receiving module 611.
The application manipulation module 613 may control the application in the first device 610 to be opened and closed in the first operating system after the control instruction receiving module 611 receives the application opening and closing instructions, and focus control of the application, and the like.
In the solution of this embodiment, a window and input control module 621, an application list management module 622, and a shared file processing module 623 are added to the second device 620, and each module in the second device 620 is a software module.
It should be understood that the second device 620 is a first processor of the peripheral input, and after the second device 620 receives the external operation input, it may determine whether to send the input event to the first device 610 through the serial port or the USB interface or the hardware module of the relay, and may determine whether the event needs to be converted.
For example, when the first operating system installed on the first device 610 is windows, the second device 620 may convert the long event into the right key event and send the right key event to the first device 610, and obviously, the event may also be sent to the first device 610 and then converted by the first device 610.
Different hardware platforms of the window and input control module 621 have various implementation manners, including that a chip scheme supports scaling of a display window of an OPS source input content, an OPS input video signal realizes video streaming of camera through mipi conversion, and the like, that is, when the second device 620 supports that video output of the first device 610 exists on a display interface of the second device 620 in a sub-window form, window fusion display of two systems can be realized, and the second device 620 judges whether the event is distributed to the first device 610 according to the position of the current touch operation, and whether the event needs to be sent to the first device 610 after the event conversion.
The application list management module 622 is configured to manage a list of application programs, where in a common application list or all application lists displayed by the second device 620, management functions such as addition and deletion of an application may be supported, and when an application is added, the first device 610 may be notified through instruction control class communication to request application list information of the first device 610, where the application list information returned by the first device 610 through the instruction control channel includes a location link of an application icon in addition to an application name, where the location link is generated by a file sharing service of the first device 610 or the second device 620, and the second device 620 may display and add after acquiring the application list of the first device 610; in the application list edited by the second device 620, an opening operation of the application may be set, for example, clicking is to switch systems and open the application, or opening the application in a window fusion manner, if the application is in the window fusion manner, display contents of the second system are displayed in a sub-window of the first system, and the window may be moved, scaled, and closed.
The shared file processing module 623 is for managing file sharing functions. The shared file processing module 623 informs the first device 610 to initialize a file sharing service through an instruction control channel, if the first device 610 is ready to complete, informs the second device 620 of a sharing protocol, a root path, and a sharing status, the second device 620 may mount according to the sharing protocol, such as samba, nfs, etc., and generate a file list under the root path, and the second device 620 may operate the files of the first device 610, where the file network sharing between the first device 610 and the second device 620 may be performed using wifi networks established therebetween or using a physical interface for large data volume transmission, such as usb.
Further, as shown in fig. 7, in one embodiment, a service management module 711, a control instruction receiving module 712, a file transmitting module 713, and a window event simulation module 714 are added to the first device 710, where each module in the first device 710 is a software module.
The service management module 711 interacts with the second device 720 in the background by running a service on the first device 710, and the overall interactive flow control performs control and scheduling in the service management module, such as processing of device discovery messages, device screen content acquisition, and coded plug flow.
The manner of service herein refers to distinguishing from software having a visualization window whose running interface is not visible when the service-based manner is running.
The control instruction receiving module 712 is configured to process and execute the command message sent by the second device 720.
The file transfer module 713 places the shared file to a specific path through the file sharing mode designated by the second device 720.
The window event simulation module 714, after receiving the touch event message sent by the second device 720, performs simulation sending of the event through the system API (Application Programming Interface, application program interface) to achieve the effect of local interaction control.
A device discovery module 721, a window control module 722, an instruction processing module 723, a shared file processing module 724, and an application list management module 725 are added to the second device 720, and each module in the first device 710 is a software module.
The device discovery module 721 may search for the first device 710 that may perform a converged interaction with the second device 720. For example, a specific message may be broadcasted by selectively using a UDP communication method in the lan, and after receiving a specific response message, the device may be added to the list, and for device discovery in the wan, a cloud device management server may be used to perform intermediation, so as to directly obtain the first device 710 registered to the device management service. After the second device 720 discovers the first device 710, it may be presented in a list, and from the list it may choose to add the selected first device 710 to the current second device 720.
The window control module 722 may establish a corresponding display window based on video signals provided by different first devices 710. It is understood that in this embodiment, one second device 720 may correspond to a plurality of first devices 710, for example, the first devices 710 include an OPS module, and the first devices 710 further include one or more network devices connected based on a local area network or a wide area network.
In practice, each first device 710 may provide a corresponding application program, and the window control module 722 determines the number of applications currently open and automatically manages the layout of the window. For example, the window on which each application is running may have functions such as closing and moving zoom for manual adjustment by the user.
The screen of the second device 720 may have multiple running windows of the application programs at the same time, and the applications running in the windows include the application program installed on the second device 720 itself, the application program installed on the OPS module, and the application program installed on the network device, and these three applications may be displayed at the same time.
Besides the display layout management, the window control module also records the current position and size of each window on the screen and the screen resolution information on the heterogeneous system corresponding to the window, and after the interaction information such as touch and the like occurring on the screen is captured by the first system, the interaction information is converted into coordinates on the corresponding heterogeneous system according to the position of the event to be forwarded.
The interactive information is sent to the first device 710 through a serial port, a USB interface, or a hardware module in transit, and whether the interactive information needs to be subjected to format conversion can be determined according to needs, and in an exemplary embodiment, when an operating system installed on the second device 720 is android and an operating system installed on the first device 710 is windows, a long press event can be converted into a right press event for the second device 720 and sent to the first device 710.
The instruction processing module 723 is configured to interact with the first device 710 by, for example, acquiring application information installed on the first device 710, opening or closing an application program installed on the first device 710, sending a touch event to the first device 710, configuring a wifi network connection of the first device 710, reading a file list of the first device 710, configuring the first device 710 to upload a local file to a specific address, acquiring a screen display content of a certain area on the first device 710, and meanwhile, being responsible for receiving feedback and processing of a command execution result of the first device 710.
The shared file processing module 724 is configured to implement a file sharing function, and in this embodiment, the shared file processing module 724 provides two ways to establish a file sharing mechanism. One is for the first device 710 to actively share files, such as storing the files on nfs, samba, ftp or other cloud servers, and then the first device 710 sends the file address to the second device 720, which second device 720 downloads. The other is that the second device 720 provides a shared memory space through nfs, samba, ftp, etc., and the second device 720 informs the first device 710 of the access address, user name, password, etc. of the memory space, and the first device 710 stores the required shared components to the address.
In one embodiment, when a file on the first device 710 needs to be opened on the second device 720, file sharing is first established based on the above process, the second device 720 actually triggers sending of an acquisition instruction after opening the directory of the first device 710 through a corresponding file management interface, waits for feedback of the first device 710, determines whether the first device 710 and the second device 720 enter the same wifi network after receiving a service preparation instruction, if the first device 710 does not have the configuration information of the wifi network through an instruction control channel, then initializes the service and configures the file information to be shared after configuring the network, and notifies the second device 720 after preparation, the second device 720 searches for the file by itself through the shared root directory and displays the file, and can operate the displayed file.
The application list management module 725 obtains application information on the heterogeneous system from the first device 710 by means of a command message, where the information may include an application name, a version number, icon data, an openable file type, an actual installation path, and the like, and the application list management further includes a display function of an application portal, and fuses an application list of the desktop to include a local application and an application list on other multiple first devices 710; the application in the list is selected, and a command message for opening the application can be sent to the first device 710 according to the device corresponding to the application and the opening mode.
In some aspects of the disclosure, a display control method is provided and applied to a first device in a display system, wherein the display system comprises the first device and a second device, the first device is provided with a first operating system, the second device is provided with a second operating system, the second device comprises a display, and the second device can control the display to display a display interface of the second operating system;
the method comprises the following steps:
establishing a communication connection with the second device,
and sending application information of a first application program to the second device so that the second device can display a first identifier on a display interface of the second operating system according to the application information, wherein the first identifier is an identifier corresponding to the first application program, and the first application program is an application program installed in the first operating system.
In this embodiment, the first device and the second device first need to establish a communication connection. Next, the first device transmits application information of an application program installed on the first operating system to the second device.
In some of these embodiments, the application information is sent in response to a display request from the second device.
In some embodiments, after the first device and the second device establish a communication connection, the method further comprises:
receiving a display request of the first application program sent by the second equipment;
the sending the application information of the first application program to the second device includes:
and sending the application information of the first application program to the second equipment according to the display request.
In this embodiment, the second device first sends a display request to the first device to obtain information about the first application in the first device. And after receiving the display request sent by the second device, the first device sends the application information of the callable first application program to the second device. And after receiving the application information, the second device displays the first identifier on a display interface of a second operating system installed by the second device.
In this embodiment, the first identifier may be a first application identifier corresponding to the first application program, and the first identifier may also be a first folder identifier corresponding to a folder in which the first application program is located.
In this embodiment, the first application identifier may be displayed in different manners, and by way of example, an icon of the first application may be directly displayed as the first application identifier, or a name of the first application may be displayed as the first application identifier.
In this embodiment, the application information may specifically include information related to the first application program, such as a name, an icon, a start parameter, an application type, a link address, and the like of the first application program, so that the second device may display the first identifier according to the application information sent by the first device.
According to the embodiment, the first identifier on the first device can be displayed on the display interface of the second operating system when the second operating system is directly operated, and related information of the first application program available for use can be known without switching to the first operating system, so that convenience in operation of a user in the process of using the first device and the second device is improved.
In this embodiment, the identifier corresponding to the first application program may be used in different manners, so as to improve convenience in use.
In some embodiments, the method further comprises:
receiving a starting request sent by the second equipment;
and starting the target application program corresponding to the target application identifier according to the starting request.
In this embodiment, when a corresponding first application program needs to be executed according to the selection of the first identifier, the target application is executed by the first device based on the first operating system.
It can be understood that the second device can directly start the first device to run the target application program installed in the first operating system based on the start request, and in use, the target application program installed in the first operating system can be started without the need of manual switching of the operating system by an operator, so that the convenience of use is improved.
In some embodiments, the method further comprises:
the display of the second device is switched to display a display interface of the first operating system;
and operating the target application program based on a first operating system, and displaying an operating interface of the target application program on a display interface of the first operating system.
In this embodiment, when the first application program is started, the display interface displayed on the display of the second device may be switched to display the display interface of the first operating system, and the target application program may be run on the display interface of the first operating system, or the running interface of the target application program may be displayed on the display interface of the second operating system.
Specifically, in this embodiment, the video signal provided by the second operating system to the display may be disconnected, and then the display is controlled to be connected to the video signal of the first operating system, so that the display interface of the target application running in the first operating system can be displayed on the display.
In addition, an application window can be established on the display interface of the second operating system, and the display interface of the target application program can be displayed in the application window.
In some embodiments, after the first device starts the target application according to the start request, the method further comprises:
and the first equipment operates the target application program and sends an application operation interface of the target application program to the second equipment so as to display the application operation interface on an application window of the second equipment.
In this embodiment, the video signal provided by the second operating system to the display may be disconnected, and then the display is controlled to access the video signal of the first operating system, so that the display interface running the target application program in the first operating system can be displayed on the display.
As shown in fig. 4, in this embodiment, it may be understood that a certain area is divided on the display interface of the second operating system, and the area is used as an application window, and the display interface of the first operating system is displayed on the application window.
The implementation manner of the application window can be based on a Widget (Widget) provided by the android system, or can be based on a window management (window manager) function provided by the android system, and a floating window is established on a display interface of the second operating system to serve as the application window.
For example, it may be that a target application interface running based on the first operating system is displayed, which is equivalent to displaying the running content of two operating systems on the same display interface. At this time, the display interface of the first operating system and the display interface of the second operating system may coexist, and the first operating system and the second operating system may be simultaneously operated.
The application window may be understood as a player running in a floating window or a widget mode on a display interface of the second operating system, a video signal input by the OPS module is converted by an MIPI (Mobile Industry Processor Interface ) to realize a video stream of a camera, and then the video stream is played in the player, so that the running interface of the first operating system is played in a video manner, and the size and the position of the application window may be fixed, or an adjustment control may be set, and the size, the position, and the like of the application window may be adjusted by the adjustment control, which is not further limited herein.
In practice, a default may be set to launch the target application in the manner of an application window or an automatic switching operating system. The method can also set different control modes to correspond to different starting modes, and can be set as a mode of double-clicking a certain first application identifier to display a display interface of a corresponding first application program in an application window, and can start the corresponding first application program in a mode of switching an operating system by long-pressing the certain first application identifier. In this embodiment, a specific control manner is not further limited.
In some embodiments, the method further comprises:
and receiving a second operation input sent by the second equipment.
In some embodiments, the method further comprises:
receiving a first operation input sent by the second equipment;
the first operation input is converted into a second operation input corresponding to the first device.
There may be differences in the operating instructions in the different operating systems. For example, in the Android system, if an operation option of an application program needs to be opened, the operation option is usually implemented by long-pressing an icon of the application program, and in the Windows system, the operation option is implemented by clicking a right button of a mouse; if an application needs to be opened, in the Android system, a click is usually performed, and in Windows, a click is performed by left mouse button.
It follows that specific operation inputs corresponding to the same operation are different in different operation systems.
In this embodiment, if it is detected that the first operation input is input for the region of the application window, that is, for the target application running in the first operating system, the first operation input is converted into a second operation input matched with the first operating system, and sent to the first operating system.
The conversion process may be performed in the first device or in the second device. In other words, in this embodiment, after receiving the first operation input, the second device may convert the first operation input into a second operation input matched with the first device and then send the second operation input to the first device, or may directly send the first operation input to the first device and then convert the first operation input into the matched second operation input by the first device.
In this way, in the embodiment, the operation in the second operating system according to the operation habit corresponding to the second operating system can be realized, that is, the first device can be controlled to execute the corresponding operation task, the operation process is simplified, and the user experience is improved.
In some embodiments, the first device has a first communication module and the second device has a second communication module, the first device and the second device establishing a connection of a first communication mode through the first communication module and the second communication module; the first device and the second device establish a communication connection of a second communication mode based on a target communication network; the data transmission speed of the second communication mode is greater than the data transmission speed of the first communication mode.
In some embodiments, before the first device sends the application information of the first application to the second device, the method further comprises:
receiving network access information sent by the second device through a first communication mode under the condition that the first device and the second device are connected through the first communication mode;
and accessing the target communication network according to the network access information, wherein when the first equipment is accessed to the target communication network, the first equipment and the second equipment establish connection of a second communication mode based on the target communication network.
In this embodiment, the first device and the second device perform data transmission in a multi-path communication manner, so as to improve convenience and data transmission speed of data transmission.
In this embodiment, the first device has a first communication module, the second device has a second communication module, and the first device and the second device establish a connection in a first communication mode through the first communication module and the second communication module. Specifically, the first device and the second device are first connected through a first communication mode. The first communication mode may be a relatively simple connection mode, and in some embodiments, the first communication module and the second communication module are matched serial ports, and the first communication mode may be serial port connection, where the serial ports refer to an expansion interface adopting a serial communication manner. The communication line of the serial port can be connected only by a pair of transmission lines, the realization is simpler, the serial port connection can be realized based on the UART interface, and thus, the communication connection of the first equipment and the second equipment can be realized directly and conveniently through the data line of the entity.
In some embodiments, the method further comprises:
detecting whether a first application program in a target folder in the first device changes or not;
and accessing the target communication network according to the network access information under the condition that the first application program in the target folder is changed.
In this embodiment, the first device may determine whether to establish a communication connection with the second device in the second communication mode according to the need, where in some embodiments, the first device establishes the communication connection with the second device in the second communication mode only when an application installed in the first device changes, or when it is necessary to update information about the first application available to the second device.
Specifically, the first device detects whether the first application program in the target folder changes, specifically, whether the application list storing the first application program changes or not may also detect whether the application program in the target folder changes, and when the first application program in the target folder changes, the first device accesses the target communication network according to the network access information sent by the second device, so as to establish communication connection with the second communication mode of the second device.
In some embodiments, the first communication module and the second communication module may also select other hardware data interfaces, and can conveniently and quickly establish the connection of the first communication mode through a plug-in manner and the like.
After the first device and the second device are connected through the first communication mode, the second device transmits network access information to the first device.
It will be appreciated that some of the functions of the first device and the second device need to be implemented based on network access functions, the second device itself having a display, and the second device being able to access the network, which may be a local area network or a wide area network, such as the internet, by way of a wireless access point or the like, which is relatively convenient due to the nature of the second device itself.
In some of these embodiments, the second device includes a third communication module, the second device is communicatively connected to the target communication network through the third communication module, and the network access information includes network access information of the target communication network.
The third communication module may be a wifi module. Specifically, in this embodiment, the second device is provided with a wifi module, and accesses the target communication network through the wifi module, where the target communication network may be provided by a wireless access point such as a router, a gateway, or the like.
In some embodiments, the network access information may specifically include network access information such as a name, an encryption manner, a key, a password, and the like of the wireless access point, and based on the network access information, the first device may automatically access the wireless access point based on the network access information, so as to control the first device to access the target communication network, and implement network connection. In this way, the first device and the second device are able to access a target communication network provided by the same wireless access point.
In some of these embodiments, the second device includes a third communication module and the target communication network is provided by the second device through the third communication module.
In this embodiment, the wifi module is disposed on the second device, however, the wifi module is not used to enable the second device to implement network connection, but is used to perform network sharing. It can be understood that the second device realizes network connection through other modes, further, a wireless access point is established based on the wifi module, and the first device accesses the wireless access point established by the wifi module, so that network connection is realized.
Specifically, in some embodiments, the second device further includes a fourth communication module, the fourth communication module including a wireless communication module and/or a network interface. That is, the fourth communication module may be a wireless communication module, such as a wifi module, or a wired communication module, such as a network interface that needs to be connected to a communication line.
The network interface is taken as a network cable interface for illustration, and the second device can be connected with a network cable to realize network connection based on the network cable interface. Further, the second device establishes a wireless hotspot through the wifi module to provide network sharing, and the first device accesses the wireless hotspot to realize network connection.
In another embodiment, it may be understood that the second device is provided with two wifi modules, where one wifi module is used to implement network connection, and the other wifi module is used to establish a wireless hotspot, and the first device is in communication connection with the second device through the wireless hotspot established by the wifi module, so that the first device can establish network connection with the second device through the wifi module that establishes the wireless hotspot, so that high-speed network data communication between the first device and the second device is implemented, and the first device can indirectly implement network access through the second device.
It can be appreciated that, in this embodiment, the hardware structure and the required software support of the wifi module may refer to related technologies, and the wifi module itself is not further limited herein.
As shown in fig. 1, in this embodiment, two paths of communication between the first device and the second device may also be implemented in other manners, and in some embodiments, the first communication mode is serial communication, and the second communication mode is WLAN, specifically may be a wifi network; in other embodiments, the first communication mode is serial communication and the second communication mode is bluetooth communication.
In an exemplary embodiment, the second device may transmit bluetooth pairing information to the first device through the first communication mode, and bluetooth modules are disposed in the first device and the second device, and the first device and the second device may establish bluetooth connection through the bluetooth modules based on the bluetooth pairing information.
In some of these embodiments, the data transmission speed of the second communication mode is greater than the data transmission speed of the first communication mode. The first communication mode is used for transmitting one or more of network access information, file path information and instruction execution results of the target communication network. The file path information may include path information of a file shared in the first device and the second device.
The second communication mode is for transmitting one or more of file data and multimedia data.
In this embodiment, the communication connection established based on the first communication mode is more convenient, for example, when the communication connection is based on the serial port connection, the implementation process of the OPS module and the intelligent interactive UART interface is simpler by directly implementing the connection on the hardware structure, and further, based on the first communication mode, the first device and the second device can establish a second communication mode with a faster data transmission speed, so that based on the second communication mode, various files, multimedia data such as picture video and the like and other large files can be more rapidly transmitted.
In the technical scheme of the embodiment, the data transmission speed and convenience are improved through a communication mode of two-way communication.
In some embodiments, the first device and the second device are connected through a local area network, and before the first device sends the application information of the first application program to the second device, the method further includes:
and sending response information to the second equipment, wherein the response information is generated according to the broadcast information sent by the second equipment, and the response information carries the equipment information of the first equipment.
It can be understood that in this embodiment, the local area network refers to an area network established in a local area, the distribution area range of the local area network is limited, the data transmission speed inside the local area network is faster, the performance is more stable, the framework is simple, and the local area network has a certain sealing property. The second device may broadcast a specific message in its local area network, and may, for example, broadcast the broadcast information by means of UDP (User Datagram Protocol ) communication. The first device and the second device may access the same local area network in different manners such as wired or wireless manners.
In this embodiment, the first device and the second device may be two devices in the local area network, and when in implementation, the second device sends broadcast information, and multiple devices receiving the broadcast information may return response information, and the second device may add each device returning the response information to the device list, further, confirm the first device according to the selection of the user, and establish communication connection with the first device according to the device information carried in the response information returned by the first device, so as to implement interaction between the first device and the second device and service sharing of applications, files and the like.
In other embodiments, the first device and the second device may also establish a communication connection based on a wide area network, which may be the internet, for example.
In some embodiments, the first device sending application information of a first application to the second device includes:
acquiring application information of a first application program in a target folder;
sending the acquired application information to the second device;
the target folder is a folder with a preset path in the first device.
In some embodiments, the target folder is a desktop folder of the first device and/or a launch bar folder of the first device.
In some embodiments, the method further comprises:
and retrieving one or more of an application program of a preset program type, a file of a preset file type and an application program with a preset name in the target folder as the first application program.
In this embodiment, after the target folder is determined, the first application program in the target folder is further determined, and in this embodiment, one or more of an application program of a preset program type, a file of a preset file type, and an application program with a preset name in the target folder may be searched for as the first application program.
For example, in the case where the first device is an OPS module in which the windows system is installed, an application program having a preset name ". Exe" extension in the target folder may be retrieved as the first application program, an application program having a preset program type of "executable application" or "application program" may be retrieved, and a file having a file type of "shortcut" or "shortcut start" may be retrieved as the first application program.
In some embodiments, the method further comprises:
receiving a sharing request sent by the second equipment;
And sending sharing information to the second device according to the sharing request, wherein the sharing information comprises a folder path of a sharing folder and a sharing protocol, and the sharing folder is the folder in the first device.
When the method is implemented, the second device starts the file management function first, then sends a file sharing request to the first device, starts the file sharing service when the first device monitors the file sharing request, and returns sharing information to the second device, wherein the sharing information can carry related information such as addresses, user names, passwords and the like of the sharing space.
Based on the sharing information, the second device can access the folder path through a sharing protocol to enable access to shared files in the shared folder, thereby enabling access to and manipulation of files located in the second operating system based on the file sharing function.
The sharing request and the sharing information can be transmitted based on the first communication mode or the second communication mode, and the file to be shared is transmitted through the second communication mode, so that the file transmission speed is improved.
In this embodiment, the sharing protocol may select an existing or modified file sharing protocol, and may implement file sharing based on ftp (File Transfer Protocol ), sampa (a file sharing service), nfs (Network File System ), and the like, for example.
For example, a shared memory space may be provided by the ftp, samba, or nfs protocols described above, and then the first device sends shared information of the shared space to the second device for the second device to access the shared space.
In some embodiments, the method further comprises:
receiving space information sent by the second equipment, wherein the space information comprises a folder path of a shared space and a sharing protocol;
and sending a shared file to the second device based on the shared protocol and the folder path.
In this embodiment, the shared space is generated on the second device, which may be, for example, a shared folder that is created to share the files in the shared folder.
Next, spatial information of the shared space is generated, the spatial information at least needs to include a folder path of the spatial information, and the first device in communication connection with the second device can access the shared folder based on the folder path, thereby realizing file transmission to the shared folder or file acquisition from the shared folder.
The spatial information may also include some other information, including, by way of example, the size of the shared folder, the time of validity, etc.
After the space information is generated, the space information of the shared folder is then sent to the first device, and the first device can send the file to be shared into the shared folder based on the space information, or can acquire the required file from the shared folder, so that the file is equivalent to a local file serving as the second device, and at the moment, the second device can directly call the file by calling the local device.
In this way, the embodiment realizes file sharing in the first device and the second device, and improves the interactive control effect between the first device and the second device.
In some aspects of the disclosure, a display control method is provided and applied to a second device in a display system, wherein the display system comprises a first device and a second device, the first device is provided with a first operating system, the second device is provided with a second operating system, the second device comprises a display, and the second device can control the display to display a display interface of the second operating system;
the method comprises the following steps:
establishing a communication connection with the first device;
receiving application information of a first application program sent by the first device, wherein the first application program is an application program installed in the first operating system;
And displaying a first identifier on a display interface of the second operating system according to the application information, wherein the first identifier is an identifier corresponding to the first application program.
In this embodiment, the first device and the second device first need to establish a communication connection. Next, the first device transmits application information of an application program installed on the first operating system to the second device.
In some of these embodiments, the application information is sent in response to a display request from the second device.
In some embodiments, after the first device and the second device establish a communication connection, the method further comprises:
sending a display request of the first application program to the first device;
receiving application information of a first application program sent by the first device, wherein the application information comprises:
and receiving application information of the first application program, which is sent by the first equipment according to the display request.
In this embodiment, the second device first sends a display request to the first device to obtain information about the first application in the first device. And after receiving the display request sent by the second device, the first device sends the application information of the callable first application program to the second device. And after receiving the application information, the second device displays the first identifier on a display interface of a second operating system installed by the second device.
In this embodiment, the first identifier may be a first application identifier corresponding to the first application program, and the first identifier may also be a first folder identifier corresponding to a folder in which the first application program is located.
In this embodiment, the first application identifier may be displayed in different manners, and by way of example, an icon of the first application may be directly displayed as the first application identifier, or a name of the first application may be displayed as the first application identifier.
In this embodiment, the application information may specifically include information related to the first application program, such as a name, an icon, a start parameter, an application type, a link address, and the like of the first application program, so that the second device may display the first identifier according to the application information sent by the first device.
According to the embodiment, the first identifier on the first device can be displayed on the display interface of the second operating system when the second operating system is directly operated, and related information of the first application program available for use can be known without switching to the first operating system, so that convenience in operation of a user in the process of using the first device and the second device is improved.
In this embodiment, the identifier corresponding to the first application program may be used in different manners, so as to improve convenience in use.
In some embodiments, the second device displays a first identifier on a display interface of the second operating system according to the application information, including:
a first interface of the second operating system displays a menu identifier;
and when an access request for the menu identifier is received, displaying a second interface comprising the first identifier.
In this embodiment, a folder may be opened as the second interface, and the first identifier may be displayed in the folder; for another example, an application list can be further expanded to serve as a second interface, and the first identifier is displayed in the application list; in addition, a sub-menu of the menu identifier can be set, and the sub-menu is used as a second interface for displaying the first identifier.
In some embodiments, the first interface is a functional interface of handwriting software of the second operating system, and on the functional interface, a first identifier corresponding to the first application program may be displayed in the form of an icon or a list.
In some embodiments, the handwriting software is specifically used as a handwriting board to provide handwriting functions during a conference, so that the handwriting software is equivalent to being used as a "conference whiteboard", and when in use, a participant can write content on a handwriting interface of the handwriting software to display the content to the participant.
The first interface is set as a functional interface of the handwriting software, so that when the first application program is needed to be used, the second interface can be conveniently and quickly unfolded based on the functional interface, for example, an icon is arranged on the functional interface of the handwriting software to serve as a menu identifier, a user clicks the menu identifier to open the second interface with the first identifier, the second interface can be the same as the content part of the first interface, for example, a sub-window is only opened in a partial area of the first interface to display the first identifier, the selection of the first identifier is further completed, and the convenience of operation is improved.
In some embodiments, the method further comprises:
when the first access request for the menu identification is received, judging whether the second equipment establishes communication connection with the first equipment,
and establishing a communication connection with the first device based on the initial access request under the condition that the communication connection with the first device is not established.
In some embodiments, the first interface is a functional interface of handwriting software of the second operating system.
The first device is taken as an OPS module, the second device is taken as an intelligent interaction tablet for carrying out an exemplary description, when the menu identifier is clicked on the second device for the first time to generate a first access request aiming at the menu identifier, whether the first device establishes communication connection with the second device is firstly detected, and if the communication connection is not established, the communication connection between the first device and the second device is required to be established.
Further, in some embodiments, the first device may be in a standby or power-off state, and when the menu identifier is clicked, the first device may be woken up or controlled to be turned on, so as to establish a communication connection between the first device and the second device.
In the implementation, the first device can be awakened or controlled to be started, and a prompt window can be popped up to enable a user to select whether the first device needs to be awakened or controlled to be started in the prompt window.
In some embodiments, the second device displays a first identifier on a display interface of the second operating system according to the application information, including:
and displaying at least one first identifier and at least one second identifier on a display interface of the second operating system, wherein the second identifier is an identifier corresponding to a second application program installed in the second operating system.
In some embodiments, the first identifier and the second identifier may also be displayed in the same interface, and illustratively, the first identifier and the second identifier may be displayed in the same folder. The patterns of the first identifier and the second identifier may be the same or different, and for example, a specific symbol may be added to the first identifier to indicate that the identifier is the first identifier on the first device.
By displaying the first mark and the second mark on the same interface, a user can know the applicable application program comprehensively, and the use convenience is improved.
In some embodiments, the method further comprises:
receiving an access request for a target application identifier in the first identifier;
and sending a starting request to the first equipment so that the first equipment starts the target application program corresponding to the target application identifier according to the starting request.
In this embodiment, when a corresponding first application program needs to be executed according to the selection of the first identifier, the target application is executed by the first device based on the first operating system.
It can be understood that the second device can directly start the first device to run the target application program installed in the first operating system based on the start request, and in use, the target application program installed in the first operating system can be started without the need of manual switching of the operating system by an operator, so that the convenience of use is improved.
In some embodiments, the method further comprises:
and switching the display of the second device to display the display interface of the first operating system so that the first device runs the target application program based on the first operating system and displays the running interface of the target application program on the display interface of the first operating system.
In this embodiment, when the first application program is started, the display interface displayed on the display of the second device may be switched to display the display interface of the first operating system, and the target application program may be run on the display interface of the first operating system, or the running interface of the target application program may be displayed on the display interface of the second operating system.
Specifically, in this embodiment, the video signal provided by the second operating system to the display may be disconnected, and then the display is controlled to be connected to the video signal of the first operating system, so that the display interface of the target application running in the first operating system can be displayed on the display.
In addition, an application window can be established on the display interface of the second operating system, and the display interface of the target application program can be displayed in the application window.
In some embodiments, the method further comprises:
generating an application window on a display interface of the second operating system, wherein the application window corresponds to at least part of the area of the display interface;
receiving an application running interface of the first device for running the target application program;
and displaying the application running interface on the application window.
As shown in fig. 4, in this embodiment, it may be understood that a certain area is divided on the display interface of the second operating system, and is used as an application window, and the display interface of the first operating system is displayed on the application window.
The implementation manner of the application window can be based on a Widget (Widget) provided by the android system, or can be based on a window management (window manager) function provided by the android system, and a floating window is established on a display interface of the second operating system to serve as the application window.
For example, it may be that a target application interface running based on the first operating system is displayed, which is equivalent to displaying the running content of two operating systems on the same display interface. At this time, the display interface of the first operating system and the display interface of the second operating system may coexist, and the first operating system and the second operating system may be simultaneously operated.
The application window may be understood as a player running in a floating window or a widget mode on a display interface of the second operating system, a video signal input by the OPS module is converted by an MIPI (Mobile Industry Processor Interface ) to realize a video stream of a camera, and then the video stream is played in the player, so that the running interface of the first operating system is played in a video manner, and the size and the position of the application window may be fixed, or an adjustment control may be set, and the size, the position, and the like of the application window may be adjusted by the adjustment control, which is not further limited herein.
In practice, a default may be set to launch the target application in the manner of an application window or an automatic switching operating system. The method can also set different control modes to correspond to different starting modes, and can be set as a mode of double-clicking a certain first application identifier to display a display interface of a corresponding first application program in an application window, and can start the corresponding first application program in a mode of switching an operating system by long-pressing the certain first application identifier. In this embodiment, a specific control manner is not further limited.
In some embodiments, the method further comprises:
receiving a first operation input aiming at an area corresponding to the application window;
converting the first operation input into a second operation input corresponding to the first device;
the second operational input is sent to the first device.
In some embodiments, the second device, after generating the application window on the display interface of the second operating system, the method further comprises:
receiving a first operation input aiming at an area corresponding to the application window;
the first operational input is sent to the first device.
There may be differences in the operating instructions in the different operating systems. For example, in the Android system, if an operation option of an application program needs to be opened, the operation option is usually implemented by long-pressing an icon of the application program, and in the Windows system, the operation option is implemented by clicking a right button of a mouse; if an application needs to be opened, in the Android system, a click is usually performed, and in Windows, a click is performed by left mouse button.
It follows that specific operation inputs corresponding to the same operation are different in different operation systems.
In this embodiment, if it is detected that the first operation input is input for the region of the application window, that is, for the target application running in the first operating system, the first operation input is converted into a second operation input matched with the first operating system, and sent to the first operating system.
The conversion process may be performed in the first device or in the second device. In other words, in this embodiment, after receiving the first operation input, the second device may convert the first operation input into a second operation input matched with the first device and then send the second operation input to the first device, or may directly send the first operation input to the first device and then convert the first operation input into the matched second operation input by the first device.
In this way, in the embodiment, the operation in the second operating system according to the operation habit corresponding to the second operating system can be realized, that is, the first device can be controlled to execute the corresponding operation task, the operation process is simplified, and the user experience is improved.
In some embodiments, the first device has a first communication module and the second device has a second communication module, the first device and the second device establishing a connection of a first communication mode through the first communication module and the second communication module; the first device and the second device establish a communication connection of a second communication mode based on the target communication network; the data transmission speed of the second communication mode is greater than the data transmission speed of the first communication mode.
In some of these embodiments, the first device and the second device may be controlled to establish a communication connection by:
in the case that the first device and the second device are connected through a first communication mode, the second device sends network access information to the first device through the first communication mode;
and the first equipment is accessed to the target communication network according to the network access information, wherein when the first equipment is accessed to the target communication network, the first equipment and the second equipment establish connection in a second communication mode based on the target communication network.
In this embodiment, the first device and the second device perform data transmission in a multi-path communication manner, so as to improve convenience and data transmission speed of data transmission.
In this embodiment, the first device has a first communication module, the second device has a second communication module, and the first device and the second device establish a connection in a first communication mode through the first communication module and the second communication module. Specifically, the first device and the second device are first connected through a first communication mode. The first communication mode may be a relatively simple connection mode, and in some embodiments, the first communication module and the second communication module are matched serial ports, and the first communication mode may be serial port connection, where the serial ports refer to an expansion interface adopting a serial communication manner. The communication line of the serial port can be connected only by a pair of transmission lines, the realization is simpler, the serial port connection can be realized based on the UART interface, and thus, the communication connection of the first equipment and the second equipment can be realized directly and conveniently through the data line of the entity.
In some embodiments, before the first device accesses the target communication network according to the network access information, the method further comprises:
the first device detects whether a first application program in a target folder in the first device changes or not;
And the first equipment accesses the target communication network according to the network access information under the condition that the first application program in the target folder is changed.
In this embodiment, the first device may determine whether to establish a communication connection with the second device in the second communication mode according to the need, where in some embodiments, the first device establishes the communication connection with the second device in the second communication mode only when an application installed in the first device changes, or when the relevant information of the first application available to the second device needs to be updated.
Specifically, the first device detects whether the first application program in the target folder changes, specifically, whether the application list storing the first application program changes or not may also detect whether the application program in the target folder changes, and when the first application program in the target folder changes, the first device accesses the target communication network according to the network access information sent by the second device, so as to establish communication connection with the second communication mode of the second device.
In some embodiments, the first communication module and the second communication module may also select other hardware data interfaces, and can conveniently and quickly establish the connection of the first communication mode through a plug-in manner and the like.
After the first device and the second device are connected through the first communication mode, the second device transmits network access information to the first device.
It will be appreciated that some of the functions of the first device and the second device need to be implemented based on network access functions, the second device itself having a display, and the second device being able to access the network, which may be a local area network or a wide area network, such as the internet, by way of a wireless access point or the like, which is relatively convenient due to the nature of the second device itself.
In some of these embodiments, the second device includes a third communication module, the second device is communicatively connected to the target communication network through the third communication module, and the network access information includes network access information of the target communication network.
The third communication module may be a wifi module. Specifically, in this embodiment, the second device is provided with a wifi module, and accesses the target communication network through the wifi module, where the target communication network may be provided by a wireless access point such as a router, a gateway, or the like.
In some embodiments, the network access information may specifically include network access information such as a name, an encryption manner, a key, a password, and the like of the wireless access point, and based on the network access information, the first device may automatically access the wireless access point based on the network access information, so as to control the first device to access the target communication network, and implement network connection. In this way, the first device and the second device are able to access a target communication network provided by the same wireless access point.
In some of these embodiments, the second device includes a third communication module and the target communication network is provided by the second device through the third communication module.
In this embodiment, the wifi module is disposed on the second device, however, the wifi module is not used to enable the second device to implement network connection, but is used to perform network sharing. It can be understood that the second device realizes network connection through other modes, further, a wireless access point is established based on the wifi module, and the first device accesses the wireless access point established by the wifi module, so that network connection is realized.
Specifically, in some embodiments, the second device further includes a fourth communication module, the fourth communication module including a wireless communication module and/or a network interface. That is, the fourth communication module may be a wireless communication module, such as a wifi module, or a wired communication module, such as a network interface that needs to be connected to a communication line.
The network interface is taken as a network cable interface for illustration, and the second device can be connected with a network cable to realize network connection based on the network cable interface. Further, the second device establishes a wireless hotspot through the wifi module to provide network sharing, and the first device accesses the wireless hotspot to realize network connection.
In another embodiment, it may be understood that the second device is provided with two wifi modules, where one wifi module is used to implement network connection, and the other wifi module is used to establish a wireless hotspot, and the first device is in communication connection with the second device through the wireless hotspot established by the wifi module, so that the first device can establish network connection with the second device through the wifi module that establishes the wireless hotspot, so that high-speed network data communication between the first device and the second device is implemented, and the first device can indirectly implement network access through the second device.
It can be appreciated that, in this embodiment, the hardware structure and the required software support of the wifi module may refer to related technologies, and the wifi module itself is not further limited herein.
As shown in fig. 1, in this embodiment, two-way communication between the first device and the second device may also be implemented in other manners, and in some embodiments, the first communication mode is serial communication, and the second communication mode is wireless local area network data communication (Wireless Local Area Networks, WLAN), specifically, may be a wifi network; in other embodiments, the first communication mode is serial communication and the second communication mode is bluetooth communication.
In an exemplary embodiment, the second device may transmit bluetooth pairing information to the first device through the first communication mode, and bluetooth modules are disposed in the first device and the second device, and the first device and the second device may establish bluetooth connection through the bluetooth modules based on the bluetooth pairing information.
In some of these embodiments, the data transmission speed of the second communication mode is greater than the data transmission speed of the first communication mode. The first communication mode is used for transmitting one or more of network access information, file path information and instruction execution results of the target communication network. The file path information may include path information of a file shared in the first device and the second device.
The second communication mode is for transmitting one or more of file data and multimedia data.
In this embodiment, the communication connection established based on the first communication mode is more convenient, for example, when the communication connection is based on the serial port connection, the implementation process of the OPS module and the intelligent interactive UART interface is simpler by directly implementing the connection on the hardware structure, and further, based on the first communication mode, the first device and the second device can establish a second communication mode with a faster data transmission speed, so that based on the second communication mode, various files, multimedia data such as picture video and the like and other large files can be more rapidly transmitted.
In the technical scheme of the embodiment, the data transmission speed and convenience are improved through a communication mode of two-way communication.
In some embodiments, the first device and the second device are connected through a local area network, and before the first device sends the application information of the first application program to the second device, the method further includes:
transmitting broadcast information to a local area network;
receiving response information sent by the first device, wherein the response information is generated according to the broadcast information and carries device information of the first device;
and establishing communication connection with the first equipment according to the response information.
It can be understood that in this embodiment, the local area network refers to an area network established in a local area, the distribution area range of the local area network is limited, the data transmission speed inside the local area network is faster, the performance is more stable, the framework is simple, and the local area network has a certain sealing property. The second device may broadcast a specific message in its local area network, and may, for example, broadcast the broadcast information by means of UDP (User Datagram Protocol ) communication. The first device and the second device may access the same local area network in different manners such as wired or wireless manners.
In some embodiments, the second device establishes a communication connection with the first device according to the response information, including:
adding the first equipment to an equipment list according to the response information;
acquiring a selection instruction for the first equipment;
and establishing communication connection with the first equipment according to the selection instruction.
In this embodiment, the first device and the second device may be two devices in the local area network, and when in implementation, the second device sends broadcast information, and multiple devices receiving the broadcast information may return response information, and the second device may add each device returning the response information to the device list, further, confirm the first device according to the selection of the user, and establish communication connection with the first device according to the device information carried in the response information returned by the first device, so as to implement interaction between the first device and the second device and service sharing of applications, files and the like.
In other embodiments, the first device and the second device may also establish a communication connection based on a wide area network, which may be the internet, for example.
In some embodiments, the display system further comprises a management server, the method further comprising:
Sending a connection request to the management server;
receiving device information of a first device sent by the management server according to the connection request, wherein the first device is registered in the management server in advance;
and establishing communication connection with the first equipment according to the equipment information.
In this embodiment, each device that can provide a service is first registered in the management server, and when the second device needs to establish a communication connection with the first device, the first device may be selected from the list of registered devices provided by the management server, and further, the communication connection with the first device may be established based on the relevant information of the first device carried in the registration information.
It will be understood that when the first device and the second device are communicatively connected through a local area network or a wide area network, all interactive data such as command messages, file data, instruction execution results, etc. between the first device and the second device are transmitted through the local area network or the wide area network.
In some embodiments, the method further comprises:
sending a sharing request to the first device;
receiving sharing information returned by the first device according to the sharing request, wherein the sharing information comprises a folder path of a sharing folder and a sharing protocol, and the sharing folder is a folder in the first device;
The sharing protocol and the folder path access the shared folder.
When the method is implemented, the second device starts the file management function first, then sends a file sharing request to the first device, starts the file sharing service when the first device monitors the file sharing request, and returns sharing information to the second device, wherein the sharing information can carry related information such as addresses, user names, passwords and the like of the sharing space.
Based on the sharing information, the second device can access the folder path through a sharing protocol to enable access to shared files in the shared folder, thereby enabling access to and manipulation of files located in the second operating system based on the file sharing function.
The sharing request and the sharing information can be transmitted based on the first communication mode or the second communication mode, and the file to be shared is transmitted through the second communication mode, so that the file transmission speed is improved.
In this embodiment, the sharing protocol may select an existing or modified file sharing protocol, and may implement file sharing based on ftp (File Transfer Protocol ), sampa (a file sharing service), nfs (Network File System ), and the like, for example.
For example, a shared memory space may be provided by the ftp, samba, or nfs protocols described above, and then the first device sends shared information of the shared space to the second device for the second device to access the shared space.
In some embodiments, the method further comprises:
generating a shared space;
transmitting space information of the shared space to the first device, wherein the space information comprises a folder path and a sharing protocol of the shared space;
and receiving the shared file sent by the first equipment based on the shared protocol and the folder path.
In this embodiment, the shared space is generated on the second device, which may be, for example, a shared folder that is created to share the files in the shared folder.
Next, spatial information of the shared space is generated, the spatial information at least needs to include a folder path of the spatial information, and the first device in communication connection with the second device can access the shared folder based on the folder path, thereby realizing file transmission to the shared folder or file acquisition from the shared folder.
The spatial information may also include some other information, including, by way of example, the size of the shared folder, the time of validity, etc.
After the space information is generated, the space information of the shared folder is then sent to the first device, and the first device can send the file to be shared into the shared folder based on the space information, or can acquire the required file from the shared folder, so that the file is equivalent to a local file serving as the second device, and at the moment, the second device can directly call the file by calling the local device.
In this way, the embodiment realizes file sharing in the first device and the second device, and improves the interactive control effect between the first device and the second device.
It should be understood that, in the speed limit control method applied to the first device and the display control method applied to the second device in this embodiment, reference may be made to the functions implemented by the first device and the second device in the display control method applied to the display system.
In some aspects of the disclosure, a display system is provided that includes a first device having a first operating system installed therein and a second device having a second operating system installed therein, the second device including a display, the second device being capable of controlling the display to display a display interface of the second operating system.
The second device is configured to:
establishing a communication connection between the first device and the second device;
the first device is configured to:
transmitting application information of a first application program to the second device, wherein the first application program is an application program installed in the first operating system;
the second device is further configured to:
and displaying a first identifier on a display interface of the second operating system according to the application information.
In this embodiment, the first device and the second device first need to establish a communication connection. Next, the first device transmits application information of an application program installed on the first operating system to the second device.
In some embodiments, the second device is configured to:
sending a display request of the first application program to the first device;
the first device is configured to:
and sending the application information of the first application program to the second equipment according to the display request.
In this embodiment, the second device first sends a display request to the first device to obtain information about the first application in the first device. And after receiving the display request sent by the second device, the first device sends the application information of the callable first application program to the second device. And after receiving the application information, the second device displays the first identifier on a display interface of a second operating system installed by the second device.
In this embodiment, the first identifier may be a first application identifier corresponding to the first application program, and the first identifier may also be a first folder identifier corresponding to a folder in which the first application program is located.
In this embodiment, the first application identifier may be displayed in different manners, and by way of example, an icon of the first application may be directly displayed as the first application identifier, or a name of the first application may be displayed as the first application identifier.
In this embodiment, the application information may specifically include information related to the first application program, such as a name, an icon, a start parameter, an application type, a link address, and the like of the first application program, so that the second device may display the first identifier according to the application information sent by the first device.
According to the embodiment, the first identifier on the first device can be displayed on the display interface of the second operating system when the second operating system is directly operated, and related information of the first application program available for use can be known without switching to the first operating system, so that convenience in operation of a user in the process of using the first device and the second device is improved.
In this embodiment, the identifier corresponding to the first application program may be used in different manners, so as to improve convenience in use.
In some embodiments, the first device is an external computer module, in some embodiments, the external computer module may be an OPS module, in this embodiment, only the external computer module is used as an OPS module for performing an exemplary description, and the second device is an intelligent interaction tablet, where the intelligent interaction tablet includes a communication interface, and the OPS module is communicatively connected to the intelligent interaction tablet through the communication interface. The structure of the OPS module and the connection manner between the OPS module and the intelligent interaction panel may refer to the embodiment shown in fig. 1, and will not be described herein.
In some embodiments, when the second device displays the first identifier on the display interface of the second operating system according to the application information, the second device is specifically configured to:
displaying a menu identifier on a first interface of the second operating system;
and when an access request for the menu identifier is received, displaying a second interface comprising the first identifier.
In this embodiment, a menu identifier may be displayed first, and the user may access the menu identifier in different manners, for example, may access the menu identifier by clicking, voice control, mouse control, touch pad control, and the like.
When the user accesses the menu identification, a first interface including a first identification is displayed.
In this embodiment, a folder may be opened as the second interface, and the first identifier of the first application program is displayed in the folder; for another example, an application list may be further developed as the second interface, where the first identifier of the first application program is displayed in the application list; in addition, a sub-menu of a menu identifier can be set, and the sub-menu is used as a second interface for displaying the first identifier.
In some embodiments, the first interface is a functional interface of handwriting software of the second operating system, and on the functional interface, a first identifier corresponding to the first application program may be displayed in the form of an icon or a list.
In some embodiments, the handwriting software is specifically used as a handwriting board to provide handwriting functions during a conference, so that the handwriting software is equivalent to being used as a "conference whiteboard", and when in use, a participant can write content on a handwriting interface of the handwriting software to display the content to the participant.
The first interface is set as a functional interface of the handwriting software, so that when the first application program is needed to be used, the second interface can be conveniently and quickly unfolded based on the functional interface, for example, an icon is arranged on the functional interface of the handwriting software to serve as a menu identifier, a user clicks the menu identifier to open the second interface with the first identifier, the second interface can be the same as the content part of the first interface, for example, a sub-window is only opened in a partial area of the first interface to display the first identifier, the selection of the first identifier is further completed, and the convenience of operation is improved.
In some of these embodiments, the second device is configured to:
when the first access request for the menu identification is received, judging whether the second equipment establishes communication connection with the first equipment,
and the second device establishes a communication connection with the first device based on the initial access request under the condition that the communication connection with the first device is not established.
The first device is taken as an OPS module, the second device is taken as an intelligent interaction tablet for carrying out an exemplary description, when the menu identifier is clicked on the second device for the first time to generate a first access request aiming at the menu identifier, whether the first device establishes communication connection with the second device is firstly detected, and if the communication connection is not established, the communication connection between the first device and the second device is required to be established.
Further, in some embodiments, the first device may be in a standby or power-off state, and when the menu identifier is clicked, the first device may be woken up or controlled to be turned on, so as to establish a communication connection between the first device and the second device.
In the implementation, the first device can be awakened or controlled to be started, and a prompt window can be popped up to enable a user to select whether the first device needs to be awakened or controlled to be started in the prompt window.
In some embodiments, when the second device displays the first identifier on the display interface of the second operating system according to the application information, the second device is specifically configured to:
and displaying at least one first identifier and at least one second identifier on a display interface of the second operating system, wherein the second identifier is an identifier corresponding to a second application program installed in the second operating system.
In some embodiments, the first identifier and the second identifier may also be displayed in the same interface, and illustratively, the first identifier and the second identifier may be displayed in the same folder. The patterns of the first identifier and the second identifier may be the same or different, and for example, a specific symbol may be added to the first identifier to indicate that the identifier is the first identifier on the first device.
By displaying the first mark and the second mark on the same interface, a user can know the applicable application program comprehensively, and the use convenience is improved.
In some of these embodiments, the second device is further configured to:
receiving an access request for a target application identifier in the first identifier;
sending a start request to the first device;
The first device is further configured to:
and starting the target application program corresponding to the target application identifier according to the starting request.
In this embodiment, when a corresponding first application program needs to be executed according to the selection of the first identifier, the target application is executed by the first device based on the first operating system.
It can be understood that the second device can directly start the first device to run the target application program installed in the first operating system based on the start request, and in use, the target application program installed in the first operating system can be started without the need of manual switching of the operating system by an operator, so that the convenience of use is improved.
In some embodiments, after the first device starts the target application according to the start request, the method further comprises:
the display of the second device is switched to display a display interface of the first operating system;
and the first equipment operates the target application program based on a first operating system, and displays an operation interface of the target application program on a display interface of the first operating system.
In this embodiment, when the first application program is started, the display interface displayed on the display of the second device may be switched to display the display interface of the first operating system, and the target application program may be run on the display interface of the first operating system, or the running interface of the target application program may be displayed on the display interface of the second operating system.
Specifically, in this embodiment, the video signal provided by the second operating system to the display may be disconnected, and then the display is controlled to be connected to the video signal of the first operating system, so that the display interface of the target application running in the first operating system can be displayed on the display.
In addition, an application window can be established on the display interface of the second operating system, and the display interface of the target application program can be displayed in the application window.
In some of these embodiments, the second device is further configured to: generating an application window on a display interface of the second operating system, wherein the application window corresponds to at least part of the area of the display interface;
the first device is further configured to: operating the target application program and sending an application operation interface of the target application program to the second device;
the second device is further configured to: and displaying the application running interface on the application window.
As shown in fig. 3, in this embodiment, it may be understood that a certain area is divided on the display interface of the second operating system, and is used as an application window, and the display interface of the first operating system is displayed on the application window.
The implementation mode of the application window can be based on a widget provided by the android system, and also can be based on a window management function provided by the android system, and a floating window is established on a display interface of the second operating system to serve as the application window.
For example, it may be that a target application interface running based on the first operating system is displayed, which is equivalent to displaying the running content of two operating systems on the same display interface. At this time, the display interface of the first operating system and the display interface of the second operating system may coexist, and the first operating system and the second operating system may be simultaneously operated.
The application window may be understood as a player running in a floating window or a widget mode on a display interface of the second operating system, a video signal input by the OPS module is converted by MIPI to realize a video stream of camera, and then the video stream is played in the player, so that an operation interface of the first operating system is played in a video manner, and the size and the position of the application window may be fixed, or an adjustment control may be set, and the size, the position, etc. of the application window are adjusted by the adjustment control, which is not limited herein.
As shown in fig. 3, the technical solution of this embodiment may be summarized as adding, first, a first identifier of a first application program in a first device in a second application list of a second device, when an application program selected by the second application list in the second device is a target application identifier corresponding to a target application program in the first device, starting the target application program by displaying a widget in a window fusion manner or an operating system switching manner, and finally, performing fusion display and control on the target application to display an operation interface of the target application, so as to implement that, without first performing system switching in the first operating system, calling the application program in the second operating system.
In practice, a default may be set to launch the target application in the manner of an application window or an automatic switching operating system. The method can also set different control modes to correspond to different starting modes, and can be set as a mode of double-clicking a certain first identifier to display a display interface of a corresponding first application program in an application window, and the corresponding first application program is started in a mode of switching an operating system by long-pressing the certain first identifier. In this embodiment, a specific control manner is not further limited.
In some of these embodiments, the second device is further configured to:
receiving a first operation input aiming at an area corresponding to the application window;
converting the first operation input into a second operation input corresponding to the first device;
the second operational input is sent to the first device.
In some other embodiments, the second device is further configured to:
receiving a first operation input aiming at an area corresponding to the application window;
transmitting the first operation input to the first device;
the first operation input is converted into a second operation input corresponding to the first device.
There may be differences in the operating instructions in the different operating systems. For example, in the Android system, if an operation option of an application program needs to be opened, the operation option is usually implemented by long-pressing an icon of the application program, and in the Windows system, the operation option is implemented by clicking a right button of a mouse; if an application needs to be opened, in the Android system, a click is usually performed, and in Windows, a click is performed by left mouse button.
It follows that specific operation inputs corresponding to the same operation are different in different operation systems.
In this embodiment, if it is detected that the first operation input is input for the region of the application window, that is, for the target application running in the first operating system, the first operation input is converted into a second operation input matched with the first operating system, and sent to the first operating system.
The conversion process may be performed in the first device or in the second device. In other words, in this embodiment, after receiving the first operation input, the second device may convert the first operation input into a second operation input matched with the first device and then send the second operation input to the first device, or may directly send the first operation input to the first device and then convert the first operation input into the matched second operation input by the first device.
In this way, in the embodiment, the operation in the second operating system according to the operation habit corresponding to the second operating system can be realized, that is, the first device can be controlled to execute the corresponding operation task, the operation process is simplified, and the user experience is improved.
In this embodiment, the first device and the second device may be controlled to establish a communication connection in different manners.
In some of these embodiments, the second device is further configured to: transmitting network access information to the first device through a first communication mode when the first device and the second device are connected through the first communication mode;
the first device is configured to: and accessing a target communication network according to the network access information, wherein when the first equipment is accessed to the target communication network, the first equipment and the second equipment establish connection of a second communication mode based on the target communication network.
In this embodiment, the first device and the second device perform data transmission in a multi-path communication manner, so as to improve convenience and data transmission speed of data transmission.
In this embodiment, the first device has a first communication module, the second device has a second communication module, and the first device and the second device establish a connection in a first communication mode through the first communication module and the second communication module. Specifically, the first device and the second device are first connected through a first communication mode. The third communication module may choose to implement a relatively simple connection mode, and in some embodiments, the first communication module and the second communication module are matched serial ports, and the first communication mode may be serial port connection, where the serial ports refer to an expansion interface adopting a serial communication manner. The communication line of the serial port can be connected only by a pair of transmission lines, the realization is simpler, the serial port connection can be realized based on the UART interface, and thus, the communication connection of the first equipment and the second equipment can be realized directly and conveniently through the data line of the entity.
In some embodiments, the first device is configured to:
detecting whether a first application program in a target folder in the first device changes or not;
and accessing the target communication network according to the network access information under the condition that the first application program in the target folder is changed.
In this embodiment, the first device may determine whether to establish a communication connection with the second device in the second communication mode according to the need, where in some embodiments, the first device establishes the communication connection with the second device in the second communication mode only when an application installed in the first device changes, or when the relevant information of the first application available to the second device needs to be updated.
Specifically, the first device detects whether the first application program in the target folder changes, specifically, whether the application list storing the first application program changes or not may also detect whether the application program in the target folder changes, and when the first application program in the target folder changes, the first device accesses the target communication network according to the network access information sent by the second device, so as to establish communication connection with the second communication mode of the second device.
In some embodiments, the first communication module and the second communication module may also select other hardware data interfaces, and can conveniently and quickly establish the connection of the first communication mode through a plug-in manner and the like.
After the first device and the second device are connected through the first communication mode, the second device transmits network access information to the first device.
It will be appreciated that some of the functions of the first device and the second device need to be implemented based on network access functions, the second device itself having a display, and the second device being able to access the network, which may be a local area network or a wide area network, such as the internet, by way of a wireless access point or the like, which is relatively convenient due to the nature of the second device itself.
In some of these embodiments, the second device includes a third communication module, the second device is communicatively connected to the target communication network through the third communication module, and the network access information includes access information of the target communication network.
The third communication module may be a wifi module. Specifically, in this embodiment, the second device is provided with a wifi module, and accesses the target communication network through the wifi module, where the target communication network may be provided by a wireless access point such as a router, a gateway, or the like.
In some embodiments, the network access information may specifically include network access information such as a name, an encryption manner, a key, and the like of the wireless access point, and based on the network access information, the first device may be capable of automatically accessing the wireless access point based on the network access information, so as to control the first device to access the target communication network, and implement network connection. In this way, the first device and the second device are able to access a target communication network provided by the same wireless access point.
In some of these embodiments, the second device includes a third communication module and the target communication network is provided by the second device through the third communication module.
In this embodiment, the wifi module is disposed on the second device, however, the wifi module is not used to enable the second device to implement network connection, but is used to perform network sharing. It can be understood that the second device realizes network connection through other modes, further, a wireless access point is established based on the wifi module, and the first device accesses the wireless access point established by the wifi module, so that network connection is realized.
In some embodiments, the second device further comprises a fourth communication module, wherein the fourth communication module comprises a wireless communication module and/or a network interface, and the second device realizes network connection through the wireless communication module and/or the network interface.
The network interface is taken as a network cable interface for illustration, and the second device can be connected with a network cable to realize network connection based on the network cable interface. Further, the second device establishes a wireless hotspot through the wifi module to provide network sharing, and the first device accesses the wireless hotspot to realize network connection.
In another embodiment, it may be understood that the second device is provided with two wifi modules, where one wifi module is used to implement network connection, and the other wifi module is used to establish a wireless hotspot, and the first device is in communication connection with the second device through the wireless hotspot established by the wifi module, so that the first device can establish network connection with the second device through the wifi module that establishes the wireless hotspot, so that high-speed network data communication between the first device and the second device is implemented, and the first device can indirectly implement network access through the second device.
It can be appreciated that, in this embodiment, the hardware structure and the required software support of the wifi module may refer to related technologies, and the wifi module itself is not further limited herein.
As shown in fig. 1, in this embodiment, two paths of communication between the first device and the second device may also be implemented in other manners, and in some embodiments, the first communication mode is serial communication, and the second communication mode is wireless local area network data communication, specifically may be a wifi network; in other embodiments, the first communication mode is serial communication and the second communication mode is bluetooth communication.
In an exemplary embodiment, the second device may transmit bluetooth pairing information to the first device through the first communication mode, and bluetooth modules are disposed in the first device and the second device, and the first device and the second device may establish bluetooth connection through the bluetooth modules based on the bluetooth pairing information.
In some of these embodiments, the data transmission speed of the second communication mode is greater than the data transmission speed of the first communication mode. The first communication mode is used for transmitting one or more of network access information, file path information and instruction execution results of the target communication network; the second communication mode is for transmitting one or more of file data and multimedia data.
In this embodiment, the communication connection established based on the first communication mode is more convenient, for example, when the communication connection is based on the serial port connection, the implementation process of the OPS module and the intelligent interactive UART interface is simpler by directly implementing the connection on the hardware structure, and further, based on the first communication mode, the first device and the second device can establish the second communication mode with higher data transmission speed, so that based on the fourth communication module, various files, multimedia data such as picture video and the like, can be more quickly transmitted.
In the technical scheme of the embodiment, the data transmission speed and convenience are improved through a communication mode of two-way communication.
In some of these embodiments, the first device and the second device are located within the same local area network and are connected by the local area network, the second device being further configured to: transmitting broadcast information to a local area network;
the first device is further configured to: transmitting response information to the second device, wherein the response information is generated according to the broadcast information, and the response information carries the device information of the first device;
the second device is further configured to: and establishing communication connection with the first equipment according to the response information.
It can be understood that in this embodiment, the local area network refers to an area network established in a local area, the distribution area range of the local area network is limited, the data transmission speed inside the local area network is faster, the performance is more stable, the framework is simple, and the local area network has a certain sealing property. The second device may broadcast a specific message in its local area network, and may broadcast the broadcast information, for example, by means of UDP communication. The first device and the second device may access the same local area network in different manners such as wired or wireless manners.
In some embodiments, when the second device establishes a communication connection with the first device according to the response information, the second device is specifically configured to:
adding the first equipment to an equipment list according to the response information;
acquiring a selection instruction for the first equipment;
and establishing communication connection with the first equipment according to the selection instruction.
In this embodiment, the first device and the second device may be two devices in the local area network, and when in implementation, the second device sends broadcast information, and multiple devices receiving the broadcast information may return response information, and the second device may add each device returning the response information to the device list, further, confirm the first device according to the selection of the user, and establish communication connection with the first device according to the device information carried in the response information returned by the first device, so as to implement interaction between the first device and the second device and service sharing of applications, files and the like.
In other embodiments, the first device and the second device may also establish a communication connection based on a wide area network, which may be the internet, for example.
In some of these embodiments, the display system further comprises a management server, the second device further configured to: sending a connection request to a management server;
The management server is configured to: transmitting device information of a first device to the second device according to the connection request, wherein the first device is registered in the management server in advance;
the second device is further configured to: and establishing communication connection with the first equipment according to the equipment information.
In this embodiment, each device that can provide a service is first registered in the management server, and when the second device needs to establish a communication connection with the first device, the first device may be selected from the list of registered devices provided by the management server, and further, the communication connection with the first device may be established based on the relevant information of the first device carried in the registration information.
It will be understood that when the first device and the second device are communicatively connected through a local area network or a wide area network, all interactive data such as command messages, file data, instruction execution results, etc. between the first device and the second device are transmitted through the local area network or the wide area network.
In some embodiments, when sending the application information of the first application program to the second device, the first device is specifically configured to:
acquiring application information of a first application program in a target folder;
Sending the acquired application information to the second device;
the target folder is a folder with a preset path in the first device.
In this embodiment, the application program in the first device that can be invoked by the second device may be all application programs or may be part of application programs, and illustratively, the second device may invoke all application programs in the first device by accessing registry information of the first device.
In some of these embodiments, to improve the convenience of device interaction, a specific target folder is set, and the second device can only call the application in the target folder. The target folder may also be a folder having a preset path.
In some embodiments, the target folder body may be a desktop folder of the first device, a launch bar folder of the first device. In addition, the application sharing service provided by the first device can be controlled more conveniently by the preset path folders such as folders named as sharing folders on the desktop.
In some embodiments, the first device is configured to:
And retrieving one or more of an application program of a preset program type, a file of a preset file type and an application program with a preset name in the target folder as the first application program.
In this embodiment, after the target folder is determined, the first application program in the target folder is further determined, and in this embodiment, one or more of an application program of a preset program type, a file of a preset file type, and an application program with a preset name in the target folder may be searched for as the first application program.
For example, in the case where the first device is an OPS module in which the windows system is installed, an application program having a preset name ". Exe" extension in the target folder may be retrieved as the first application program, an application program having a preset program type of "executable application" or "application program" may be retrieved, and a file having a file type of "shortcut" or "shortcut start" may be retrieved as the first application program.
In this embodiment, in order to improve the convenience of interaction between the first device and the second device, a file sharing function is also provided.
In some of these embodiments, the second device is further configured to:
Sending a sharing request to the first device;
receiving sharing information returned by the first device according to the sharing request, wherein the sharing information comprises a folder path of a sharing folder and a sharing protocol, and the sharing folder is a folder in the first device;
and accessing the shared folder according to the shared protocol and the folder path.
When the method is implemented, the second device starts the file management function first, then sends a file sharing request to the first device, starts the file sharing service when the first device monitors the file sharing request, and returns sharing information to the second device, wherein the sharing information can carry related information such as addresses, user names, passwords and the like of the sharing space.
Based on the sharing information, the second device can access the folder path through a sharing protocol to enable access to shared files in the shared folder, thereby enabling access to and manipulation of files located in the second operating system based on the file sharing function.
The sharing request and the sharing information can be transmitted based on the first communication mode or the second communication mode, and the file to be shared is transmitted through the second communication mode, so that the file transmission speed is improved.
In this embodiment, the sharing protocol may select an existing or modified file sharing protocol, and may implement file sharing based on ftp, sampa, nfs, for example.
For example, a shared memory space may be provided by the ftp, samba, or nfs protocols described above, and then the first device sends shared information of the shared space to the second device for the second device to access the shared space.
In other embodiments, the file sharing functionality may be provided based on the second device.
In some of these embodiments, the second device is further configured to:
generating a shared space;
transmitting space information of the shared space to the first device, wherein the space information comprises a folder path and a sharing protocol of the shared space;
the first device is further configured to:
and sending a shared file to the second device based on the shared protocol and the folder path.
In this embodiment, the shared space is generated on the second device, which may be, for example, a shared folder that is created to share the files in the shared folder.
Next, spatial information of the shared space is generated, the spatial information at least needs to include a folder path of the spatial information, and the first device in communication connection with the second device can access the shared folder based on the folder path, thereby realizing file transmission to the shared folder or file acquisition from the shared folder.
The spatial information may also include some other information, including, by way of example, the size of the shared folder, the time of validity, etc.
After the space information is generated, the space information of the shared folder is then sent to the first device, and the first device can send the file to be shared into the shared folder based on the space information, or can acquire the required file from the shared folder, so that the file is equivalent to a local file serving as the second device, and at the moment, the second device can directly call the file by calling the local device.
In this way, the embodiment realizes file sharing in the first device and the second device, and improves the interactive control effect between the first device and the second device.
As shown in fig. 5, the technical solution of this embodiment may be summarized as that first, a first device or a second device generates a shared space and starts a file sharing function, and then spatial information of the shared space is sent to another device, so that the other device can access a shared file in the shared space according to the spatial information, and implement the file sharing function.
Furthermore, in some of these embodiments, the file sharing functionality may also be implemented through a cloud server. Specifically, a file sharing space can be provided through the cloud server, in the working process, the first device and the second device can both upload files to the file sharing space and download files from the file sharing space, and file sharing between the first device and the second device can also be realized.
In some embodiments, file sharing may also be implemented by hardware sharing, specifically, the hardware structure is a data interface or a memory, and in this embodiment, the hardware structure is first used as the data interface, and the data interface is specifically illustrated as a USB interface.
In one embodiment, a USB interface is provided on the second device, where the USB interface has a switching configuration that can be switched from hardware to being hung on the board system to the first device or to being hung on the board system of the second device. In this embodiment, a control switch may be provided, and the circuit connection state of the USB interface is controlled by the control switch, so that the USB interface is mounted on the board card system of the first device or on the board card system of the second device. When the file is required to be called in the first equipment, the switching control switch enables the USB interface to be hung on the board card system of the first equipment, so that the file in the mobile memory can be read based on the first operating system, and similarly, when the file is required to be called in the second equipment, the switching control switch enables the USB interface to be hung on the board card system of the second equipment.
When the hardware interface is a memory, the working principle is similar to the above process, and the mounting state of the memory can be controlled by setting a control switch, so that the file sharing function is realized.
The embodiment of the disclosure also provides an electronic device, which is a second device in a display system, wherein the display system comprises a first device and a second device, the first device is provided with a first operating system, the second device is provided with a second operating system, the second device comprises a display, and the second device can control the display to display a display interface of the second operating system;
establishing a communication connection with the first device;
receiving application information of a first application program sent by the first device, wherein the first application program is an application program installed in the first operating system;
and displaying a first identifier on a display interface of the second operating system according to the application information of the first application program, wherein the first identifier is an identifier corresponding to the first application program. The first identifier is an identifier corresponding to the first application program and is sent by the second device.
In some embodiments, the first device is an external computer module, the second device is an intelligent interaction tablet, the intelligent interaction tablet includes a communication interface, and the external computer module is in communication connection with the intelligent interaction tablet through the communication interface.
In some of these embodiments, the external computer module is an OPS module that includes an OPS interface.
In some embodiments, when the second device displays the first identifier on the display interface of the second operating system according to the application information, the second device is specifically configured to:
displaying a menu identifier on a first interface of the second operating system;
and when an access request for the menu identifier is received, displaying a second interface comprising the first identifier.
In some embodiments, the first interface is a functional interface of handwriting software of the second operating system.
In some embodiments, when the second device displays the first identifier on the display interface of the second operating system according to the application information, the second device is specifically configured to:
and displaying at least one first identifier and at least one second identifier on a display interface of the second operating system, wherein the second identifier is an identifier corresponding to a second application program installed in the second operating system.
The electronic device in this embodiment is specifically the second device in the above display system embodiment, and will not be described herein again.
The embodiment of the disclosure also provides electronic equipment. The electronic device may be the first device or the second device described above, referring to fig. 8, the electronic device may include a processor 801, a memory 802, and a program 8021 stored on the memory 802 and executable on the processor 801.
In the case where the electronic device is the first device, the second device, or the management server, any steps in the method embodiments described above and the same beneficial effects can be achieved when the program 8021 is executed by the processor 801, which will not be described herein.
Those of ordinary skill in the art will appreciate that all or a portion of the steps of implementing the methods of the embodiments described above may be implemented by hardware associated with program instructions, where the program may be stored on a readable medium.
The embodiment of the disclosure further provides a readable storage medium, on which a computer program is stored, where the computer program when executed by a processor can implement any step in the above method embodiments and achieve the same technical effects, and in order to avoid repetition, a description is omitted here.
Such as Read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), magnetic or optical disk, etc.
It should be noted that, it should be understood that the above division of each module is merely a division of a logic function, and may be fully or partially integrated into one physical entity or may be physically separated. And these modules may all be implemented in software in the form of calls by the processing element; or can be realized in hardware; the method can also be realized in a form of calling software by a processing element, and the method can be realized in a form of hardware by a part of modules. For example, the determining module may be a processing element that is set up separately, may be implemented in a chip of the above apparatus, or may be stored in a memory of the above apparatus in the form of program code, and may be called by a processing element of the above apparatus and execute the functions of the determining module. The implementation of the other modules is similar. In addition, all or part of the modules can be integrated together or can be independently implemented. The processing element described herein may be an integrated circuit having signal processing capabilities. In implementation, each step of the above method or each module above may be implemented by an integrated logic circuit of hardware in a processor element or an instruction in a software form.
For example, each module, unit, sub-unit, or sub-module may be one or more integrated circuits configured to implement the above methods, e.g.: one or more specific integrated circuits (Application Specific Integrated Circuit, ASIC), or one or more microprocessors (digital signal processor, DSP), or one or more field programmable gate arrays (Field Programmable Gate Array, FPGA), or the like. For another example, when a module above is implemented in the form of a processing element scheduler code, the processing element may be a general purpose processor, such as a central processing unit (Central Processing Unit, CPU) or other processor that may invoke the program code. For another example, the modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).
While the foregoing is directed to the preferred implementation of the disclosed embodiments, it should be noted that numerous modifications and adaptations to those skilled in the art may be made without departing from the principles of the disclosure, and such modifications and adaptations are intended to be within the scope of the disclosure.

Claims (70)

  1. The display control method is applied to a display system, the display system comprises a first device and a second device, the first device is provided with a first operating system, the second device is provided with a second operating system, the second device comprises a display, and the second device can control the display to display a display interface of the second operating system;
    The method comprises the following steps:
    the first device and the second device establish communication connection;
    the first device sends application information of a first application program to the second device, wherein the first application program is an application program installed in the first operating system;
    and the second device displays a first identifier on a display interface of the second operating system according to the application information, wherein the first identifier is an identifier corresponding to the first application program.
  2. The method of claim 1, wherein after the first device and the second device establish a communication connection, the method further comprises:
    the second device sends a display request of the first application program to the first device;
    the first device sending application information of the first application program to the second device, including:
    and the first equipment sends the application information of the first application program to the second equipment according to the display request.
  3. The method of claim 1, wherein the second device displaying a first identification on a display interface of the second operating system according to the application information, comprising:
    The second device displays a menu identifier on a first interface of the second operating system;
    and the second equipment displays a second interface comprising the first identifier when receiving an access request aiming at the menu identifier.
  4. A method according to claim 3, wherein the method further comprises:
    the second device judges whether the second device establishes communication connection with the first device or not when receiving the first access request aiming at the menu identification,
    and the second equipment establishes communication connection with the first equipment based on the initial access request under the condition that the second equipment does not establish communication connection with the first equipment.
  5. A method according to claim 3, wherein the first interface is a functional interface of handwriting software of the second operating system.
  6. The method of claim 1, wherein the second device displaying a first identification on a display interface of the second operating system according to the application information, comprising:
    and displaying at least one first identifier and at least one second identifier on a display interface of the second operating system, wherein the second identifier is an identifier corresponding to a second application program installed in the second operating system.
  7. The method of any of claims 1-6, wherein the second device, after displaying a first identification on a display interface of the second operating system according to the application information, further comprises:
    the second equipment receives an access request for a target application identifier in the first identifier;
    the second device sends a starting request to the first device;
    and the first equipment starts the target application program corresponding to the target application identifier according to the starting request.
  8. The method of claim 7, wherein after the first device launches the target application according to the launch request, the method further comprises:
    the display of the second device is switched to display a display interface of the first operating system;
    and the first equipment operates the target application program based on a first operating system, and displays an operation interface of the target application program on a display interface of the first operating system.
  9. The method of claim 7, wherein after the first device launches the target application according to the launch request, the method further comprises:
    the second device generates an application window on a display interface of the second operating system, wherein the application window corresponds to at least part of the area of the display interface;
    The first device runs the target application program and sends an application running interface of the target application program to the second device;
    and the second equipment displays the application running interface on the application window.
  10. The method of claim 9, wherein the second device is on a display interface of the second operating system after generating an application window, the method further comprising:
    the second device receives a first operation input aiming at an area corresponding to the application window;
    the second device converts the first operation input into a second operation input corresponding to the first device;
    the second device sends the second operational input to the first device.
  11. The method of claim 9, wherein the second device is on a display interface of the second operating system after generating an application window, the method further comprising:
    the second device receives a first operation input aiming at an area corresponding to the application window;
    the second device sending the first operational input to the first device;
    the first device converts the first operation input into a second operation input corresponding to the first device.
  12. The method of any one of claims 1 to 6, wherein the first device has a first communication module and the second device has a second communication module, the first and second devices establishing a connection of a first communication mode through the first and second communication modules;
    the first device and the second device establish a communication connection of a second communication mode based on a target communication network;
    the data transmission speed of the second communication mode is greater than the data transmission speed of the first communication mode.
  13. The method of claim 12, wherein prior to the first device sending the application information of the first application to the second device, the method further comprises:
    in the case that the first device and the second device are connected through a first communication mode, the second device sends network access information to the first device through the first communication mode;
    and the first equipment is accessed to the target communication network according to the network access information, wherein when the first equipment is accessed to the target communication network, the first equipment and the second equipment establish connection in a second communication mode based on the target communication network.
  14. The method of claim 13, wherein prior to the first device accessing the target communication network according to the network access information, the method further comprises:
    the first device detects whether a first application program in a target folder in the first device changes or not;
    and the first equipment accesses the target communication network according to the network access information under the condition that the first application program in the target folder is changed.
  15. The method of claim 13, wherein the second device comprises a third communication module through which the second device is communicatively coupled with the target communication network, the network access information comprising access information of the target communication network.
  16. The method of claim 12, wherein the second device comprises a third communication module, the target communication network being provided by the second device through the third communication module.
  17. The method of claim 16, wherein the second device further comprises a fourth communication module comprising a wireless communication module and/or a network interface through which the second device is network connected.
  18. The method of claim 12, wherein the first communication mode is serial communication and the second communication mode is wireless local area network data communication.
  19. The method of claim 12, wherein the first communication mode is serial communication and the second communication mode is bluetooth communication.
  20. The method of claim 12, wherein the first communication mode is used to transmit one or more of network access information, file path information, and instruction execution results of the target communication network;
    the second communication mode is for transmitting one or more of file data and multimedia data.
  21. The method of claim 1, wherein the first device and the second device are connected by a local area network, the method further comprising, prior to the first device sending application information for a first application to the second device:
    the second equipment sends broadcast information to a local area network;
    the first device sends response information to the second device, wherein the response information is generated according to the broadcast information and carries the device information of the first device;
    And the second equipment establishes communication connection with the first equipment according to the response information.
  22. The method of claim 21, wherein the second device establishing a communication connection with the first device according to the response information comprises:
    the second device adds the first device to a device list according to the response information;
    the second device obtains a selection instruction for the first device;
    and the second equipment establishes communication connection with the first equipment according to the selection instruction.
  23. The method of claim 1, wherein the display system further comprises a management server, the method further comprising, prior to the first device sending the application information of the first application to the second device:
    the second device sends a connection request to the management server;
    the management server sends device information of a first device to the second device according to the connection request, wherein the first device is registered in the management server in advance;
    and the second equipment establishes communication connection with the first equipment according to the equipment information.
  24. The method of claim 1, wherein the first device sending application information of a first application to the second device comprises:
    The first device acquires application information of a first application program in a target folder;
    the first device sends the acquired application information to the second device;
    the target folder is a folder with a preset path in the first device.
  25. The method of claim 24, wherein the target folder is a desktop folder of the first device and/or a launch bar folder of the first device.
  26. The method of claim 24 or 25, wherein before the first device obtains application information for a first application located in a target folder, the method further comprises:
    the first device retrieves one or more of an application program of a preset program type, a file of a preset file type and an application program with a preset name in the target folder as the first application program.
  27. The method of claim 1, wherein the first operating system is a Windows operating system and the second operating system is an android system.
  28. The method of claim 1, wherein the method further comprises:
    the second device sends a sharing request to the first device;
    The second device receives sharing information returned by the first device according to the sharing request, wherein the sharing information comprises a folder path of a sharing folder and a sharing protocol, and the sharing folder is a folder in the first device;
    the second device accesses the shared folder according to the shared protocol and the folder path.
  29. The method of claim 1, wherein the method further comprises:
    the second device generates a shared space;
    the second device sends space information of the shared space to the first device, wherein the space information comprises a folder path and a sharing protocol of the shared space;
    the first device sends a shared file to the second device based on the sharing protocol and the folder path.
  30. The display control method is applied to first equipment in a display system, the display system comprises first equipment and second equipment, the first equipment is provided with a first operating system, the second equipment is provided with a second operating system, the second equipment comprises a display, and the second equipment can control the display to display a display interface of the second operating system;
    The method comprises the following steps:
    establishing a communication connection with the second device;
    and sending application information of a first application program to the second device so that the second device can display a first identifier on a display interface of the second operating system according to the application information, wherein the first identifier is an identifier corresponding to the first application program, and the first application program is an application program installed in the first operating system.
  31. The display control method is applied to second equipment in a display system, the display system comprises first equipment and second equipment, the first equipment is provided with a first operating system, the second equipment is provided with a second operating system, the second equipment comprises a display, and the second equipment can control the display to display a display interface of the second operating system;
    the method comprises the following steps:
    establishing a communication connection with the first device;
    receiving application information of a first application program sent by the first device, wherein the first application program is an application program installed in the first operating system;
    and displaying a first identifier on a display interface of the second operating system according to the application information, wherein the first identifier is an identifier corresponding to the first application program.
  32. A display system comprising a first device and a second device, wherein the first device is provided with a first operating system, the second device is provided with a second operating system, the first device is in communication connection with the second device, the second device comprises a display, and the second device can control the display to display a display interface of the second operating system;
    the first device and the second device are configured to:
    establishing a communication connection between the first device and the second device;
    the first device is configured to:
    transmitting application information of a first application program to the second device, wherein the first application program is an application program installed in the first operating system;
    the second device is further configured to:
    and displaying a first identifier on a display interface of the second operating system according to the application information, wherein the first identifier is an identifier corresponding to the first application program.
  33. The display system of claim 32, wherein the second device is configured to:
    sending a display request of the first application program to the first device;
    the first device is configured to:
    and sending the application information of the first application program to the second equipment according to the display request.
  34. The display system of claim 32, wherein the first device is an external computer module and the second device is a smart interactive tablet, the smart interactive tablet including a communication interface through which the external computer module is communicatively coupled with the smart interactive tablet.
  35. The display system of claim 34, wherein the external computer module is an OPS module including an OPS interface.
  36. The display system of claim 32, wherein the second device, when displaying the first identifier on the display interface of the second operating system according to the application information, is specifically configured to:
    displaying a menu identifier on a first interface of the second operating system;
    and when an access request for the menu identifier is received, displaying a second interface comprising the first identifier.
  37. The display system of claim 36, wherein the second device is configured to:
    when the first access request for the menu identification is received, judging whether the second equipment establishes communication connection with the first equipment,
    and establishing a communication connection with the first device based on the initial access request under the condition that the communication connection with the first device is not established.
  38. The display system of claim 36, wherein the first interface is a functional interface of handwriting software of the second operating system.
  39. The display system of claim 32, wherein the second device, when displaying the first identifier on the display interface of the second operating system according to the application information, is specifically configured to:
    and displaying at least one first identifier and at least one second identifier on a display interface of the second operating system, wherein the second identifier is an identifier corresponding to a second application program installed in the second operating system.
  40. The display system of any one of claims 32 to 39, wherein the second device is further configured to:
    receiving an access request for a target application identifier in the first identifier;
    sending a start request to the first device;
    the first device is further configured to:
    and starting the target application program corresponding to the target application identifier according to the starting request.
  41. The display system of claim 40, wherein the second device is further configured to:
    the second device is configured to:
    the display is switched to display the display interface of the first operating system;
    The first device is configured to:
    and operating the target application program based on a first operating system, and displaying an operating interface of the target application program on a display interface of the first operating system.
  42. The display system of claim 40, wherein,
    the second device is further configured to:
    generating an application window on a display interface of the second operating system, wherein the application window corresponds to at least part of the area of the display interface;
    the first device is further configured to:
    operating the target application program and sending an application operation interface of the target application program to the second device;
    the second device is further configured to:
    and displaying the application running interface on the application window.
  43. The display system of claim 42, wherein the second device is further configured to:
    receiving a first operation input aiming at an area corresponding to the application window;
    converting the first operation input into a second operation input corresponding to the first device;
    the second operational input is sent to the first device.
  44. The display system of claim 42, wherein the second device is further configured to:
    Receiving a first operation input aiming at an area corresponding to the application window;
    transmitting the first operation input to the first device;
    the first operation input is converted into a second operation input corresponding to the first device.
  45. The display system of any one of claims 32 to 39, wherein the first device has a first communication module and the second device has a second communication module, the first and second devices establishing a connection of a first communication mode through the first and second communication modules;
    the first device and the second device establish a communication connection of a second communication mode based on a target communication network;
    the data transmission speed of the second communication mode is greater than the data transmission speed of the first communication mode.
  46. The display system of claim 45, wherein the second device is further configured to:
    transmitting network access information to the first device through a first communication mode when the first device and the second device are connected through the first communication mode;
    the first device is configured to:
    and accessing a target communication network according to the network access information, wherein when the first equipment is accessed to the target communication network, the first equipment and the second equipment establish connection of a second communication mode based on the target communication network.
  47. The display system of claim 46, wherein the first device is configured to:
    detecting whether a first application program in a target folder in the first device changes or not;
    and accessing the target communication network according to the network access information under the condition that the first application program in the target folder is changed.
  48. The display system of claim 46, wherein the second device includes a third communication module through which the second device is communicatively coupled with the target communication network, the network access information including access information of the target communication network.
  49. The display system of claim 45, wherein the second device includes a third communication module, the target communication network being provided by the second device through the third communication module.
  50. The display system of claim 49, wherein the second device further comprises a fourth communication module comprising a wireless communication module and/or a network interface through which the second device is network connected.
  51. The display system of claim 45, wherein the first communication mode is serial communication and the second communication mode is wireless local area network data communication.
  52. The display system of claim 45, wherein the first communication mode is serial communication and the second communication mode is bluetooth communication.
  53. The display system of claim 45, wherein the first communication mode is for transmitting one or more of network access information, file path information, and instruction execution results of the target communication network;
    the second communication mode is for transmitting one or more of file data and multimedia data.
  54. The display system of claim 32, wherein the first device and the second device are connected by a local area network;
    the second device is further configured to:
    transmitting broadcast information to a local area network;
    the first device is further configured to:
    transmitting response information to the second device, wherein the response information is generated according to the broadcast information, and the response information carries the device information of the first device;
    the second device is further configured to:
    and establishing communication connection with the first equipment according to the response information.
  55. The display system of claim 54, wherein the second device, when establishing a communication connection with the first device according to the response information, is specifically configured to:
    adding the first equipment to an equipment list according to the response information;
    acquiring a selection instruction for the first equipment;
    and establishing communication connection with the first equipment according to the selection instruction.
  56. The display system of claim 32, wherein the display system further comprises a management server;
    the second device is further configured to:
    sending a connection request to the management server;
    the management server is configured to:
    transmitting device information of a first device to the second device according to the connection request, wherein the first device is registered in the management server in advance;
    the second device is further configured to:
    and establishing communication connection with the first equipment according to the equipment information.
  57. The display system of claim 32, wherein the first device, when sending the application information of the first application to the second device, is specifically configured to:
    acquiring application information of a first application program in a target folder;
    Sending the acquired application information to the second device;
    the target folder is a folder with a preset path in the first device.
  58. The display system of claim 57, wherein the target folder is a desktop folder of the first device and/or a launch bar folder of the first device.
  59. The display system of claim 58, wherein the first device is configured to:
    and retrieving one or more of an application program of a preset program type, a file of a preset file type and an application program with a preset name in the target folder as the first application program.
  60. The display system of claim 32, wherein the first operating system is a Windows operating system and the second operating system is an android system.
  61. The display system of claim 32, wherein the second device is further configured to:
    sending a sharing request to the first device;
    receiving sharing information returned by the first device according to the sharing request, wherein the sharing information comprises a folder path of a sharing folder and a sharing protocol, and the sharing folder is a folder in the first device;
    And accessing the shared folder according to the shared protocol and the folder path.
  62. The display system of claim 32, wherein the second device is further configured to:
    generating a shared space;
    transmitting space information of the shared space to the first device, wherein the space information comprises a folder path and a sharing protocol of the shared space;
    the first device is further configured to:
    and sending a shared file to the second device based on the shared protocol and the folder path.
  63. The electronic equipment is second equipment in a display system, the display system comprises first equipment and second equipment, the first equipment is provided with a first operating system, the second equipment is provided with a second operating system, the second equipment comprises a display, and the second equipment can control the display to display a display interface of the second operating system;
    the second device is configured to:
    establishing a communication connection with the first device;
    receiving application information of a first application program sent by the first device, wherein the first application program is an application program installed in the first operating system;
    And displaying a first identifier on a display interface of the second operating system according to the application information of the first application program, wherein the first identifier is an identifier corresponding to the first application program.
  64. The electronic device of claim 63, wherein the first device is an external computer module and the second device is an intelligent interactive tablet, the intelligent interactive tablet including a communication interface, the external computer module communicatively coupled to the intelligent interactive tablet via the communication interface.
  65. The electronic device of claim 64, wherein the external computer module is an OPS module that includes an OPS interface.
  66. The electronic device of claim 63, wherein the second device, when displaying the first identifier on the display interface of the second operating system according to the application information, is specifically configured to:
    displaying a menu identifier on a first interface of the second operating system;
    and when an access request for the menu identifier is received, displaying a second interface comprising the first identifier.
  67. The electronic device of claim 66, wherein the first interface is a functional interface of handwriting software of the second operating system.
  68. The electronic device of claim 63, wherein the second device, when displaying the first identifier on the display interface of the second operating system according to the application information, is specifically configured to:
    and displaying at least one first identifier and at least one second identifier on a display interface of the second operating system, wherein the second identifier is an identifier corresponding to a second application program installed in the second operating system.
  69. An electronic device, comprising: a memory, a processor, and a program stored on the memory and executable on the processor; the processor configured to read a program in a memory to implement the steps in the display control method according to any one of claims 1 to 31.
  70. A readable storage medium storing a program which, when executed by a processor, implements the steps in the display control method according to any one of claims 1 to 31.
CN202280000225.XA 2021-10-29 2022-02-18 Display control method, display system, electronic device, and readable storage medium Pending CN116635825A (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN2021112690949 2021-10-29
CN202111269094.9A CN113961295A (en) 2021-10-29 2021-10-29 Device interaction control method and device, electronic device and readable storage medium
PCT/CN2022/076856 WO2023070993A1 (en) 2021-10-29 2022-02-18 Display control method, display system, electronic device, and readable storage medium

Publications (1)

Publication Number Publication Date
CN116635825A true CN116635825A (en) 2023-08-22

Family

ID=79468231

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202111269094.9A Pending CN113961295A (en) 2021-10-29 2021-10-29 Device interaction control method and device, electronic device and readable storage medium
CN202280000225.XA Pending CN116635825A (en) 2021-10-29 2022-02-18 Display control method, display system, electronic device, and readable storage medium

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN202111269094.9A Pending CN113961295A (en) 2021-10-29 2021-10-29 Device interaction control method and device, electronic device and readable storage medium

Country Status (2)

Country Link
CN (2) CN113961295A (en)
WO (1) WO2023070993A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113961295A (en) * 2021-10-29 2022-01-21 京东方科技集团股份有限公司 Device interaction control method and device, electronic device and readable storage medium
CN116560736A (en) * 2022-01-30 2023-08-08 京东方科技集团股份有限公司 Display system, electronic equipment and communication control method
CN114741142A (en) * 2022-03-16 2022-07-12 维沃移动通信有限公司 Screen control method and device, electronic equipment and storage medium

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102426633B1 (en) * 2015-07-27 2022-07-29 삼성전자주식회사 Method for Operating OS and Electronic Device supporting the same
CN112230943A (en) * 2020-10-23 2021-01-15 维沃移动通信有限公司 Application processing method and device and electronic equipment
CN112306325B (en) * 2020-10-30 2022-05-31 维沃移动通信有限公司 Interaction control method and device
CN112286667A (en) * 2020-11-18 2021-01-29 安徽鸿程光电有限公司 Application program control method and device, electronic equipment and medium
CN113961295A (en) * 2021-10-29 2022-01-21 京东方科技集团股份有限公司 Device interaction control method and device, electronic device and readable storage medium

Also Published As

Publication number Publication date
WO2023070993A1 (en) 2023-05-04
CN113961295A (en) 2022-01-21

Similar Documents

Publication Publication Date Title
CN116635825A (en) Display control method, display system, electronic device, and readable storage medium
JP5030522B2 (en) Data processing system, method, computer program (user interface widget unit sharing for application user interface distribution)
US20130290882A1 (en) Method and apparatus for displaying a graphical user interface of a portable computation unit on an external display unit
US8707321B2 (en) Resource sharing system and method thereof
EP2901435B1 (en) A device control method and apparatus
CN110012328B (en) Method and device for interacting with smart television
EP2941715B1 (en) Unified communications with a cloud client device
CN114286165B (en) Display equipment, mobile terminal, and screen-throwing data transmission method and system
CN104618793A (en) Information processing method and electronic equipment
KR20050009713A (en) User interface for transferring data with a communications terminal
CN113794928B (en) Audio playing method and display device
CN113407134A (en) Method and device for realizing file sharing among multiple clients based on split screen display
WO2017193926A1 (en) Data transmission method and device
WO2023185817A1 (en) Multi-device cooperation method and apparatus, and electronic device and medium
CN111511045B (en) Interaction method and device for mobile terminal and computer, electronic equipment and storage medium
US20180091602A1 (en) Method and system for operating and controlling data, and user terminal
CN115794095A (en) JavaScript-based unreal engine UI development method and system
JP7101313B2 (en) Providing virtual desktops within a computing environment
JP2013117944A (en) Electronic device and multi-panel interface displaying method
CN112272223B (en) Application running method and device, server and computer readable storage medium
CN112217872A (en) Control method, control device and computer readable storage medium
US12118265B2 (en) Method, system and apparatus for accessing a user interface of a mobile computer
CN117615188A (en) Display equipment, terminal and terminal control method
CN115914732A (en) Display device and intelligent routing method based on USB channel
CN113079545A (en) Network sharing method and device and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination