CN111857889B - Display data processing method and electronic equipment - Google Patents
Display data processing method and electronic equipment Download PDFInfo
- Publication number
- CN111857889B CN111857889B CN202010693037.2A CN202010693037A CN111857889B CN 111857889 B CN111857889 B CN 111857889B CN 202010693037 A CN202010693037 A CN 202010693037A CN 111857889 B CN111857889 B CN 111857889B
- Authority
- CN
- China
- Prior art keywords
- interface
- data
- display
- electronic device
- display data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/448—Execution paradigms, e.g. implementations of programming paradigms
- G06F9/4482—Procedural
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/26—Special purpose or proprietary protocols or architectures
Abstract
The application discloses a display data processing method and electronic equipment, wherein the method is applied to first electronic equipment with a first interface, and the method comprises the following steps: under the condition that the first interface is connected with second electronic equipment, acquiring identification information sent by the second electronic equipment, wherein the second electronic equipment is provided with a first display unit; calling a first interface library under the condition that the equipment type of the second electronic equipment is determined to meet a first preset condition based on the identification information; configuring a first data packet containing first display data through a first interface library based on the data transmission capability of a first interface; and sending the first data packet to the second electronic equipment through the first interface so that the first display unit displays the display content corresponding to the first display data. According to the method for processing the display data, the common first electronic equipment with the first interface can provide the first display data for the second electronic equipment, and the limitation of the data transmission capability of the first interface is broken through.
Description
Technical Field
The present disclosure relates to the field of electronic devices, and in particular, to a method for processing display data and an electronic device.
Background
With the development of electronic devices and related technologies, head-mounted display devices have entered a long way, and are increasingly widely used in Virtual Reality (VR) head displays, Augmented Reality (AR) head displays, Mixed Reality (MR) head displays, and extended reality (XR) head displays.
The head-mounted display device is generally connected to another electronic device such as a smartphone to acquire display data and perform content display. Taking AR glasses as an example, the AR glasses currently connected to a mobile phone all display video data in a Displayport (DP) protocol depending on a Type-C interface, such as WatchAR with good survivability and AR of huacheng, which requires the Type-C interface of the mobile phone to support USB3.0+ DP at the same time. However, at present, smart phones generally only provide USB interfaces, and very few smart phones support video data output in DP protocol. Therefore, the AR glasses can only be connected with a mobile phone with a specific model, and can not be generalized.
Content of application
In view of the foregoing problems in the prior art, the present application provides a method for processing display data and an electronic device, and the technical solution adopted in the embodiments of the present application is as follows:
a first aspect of an embodiment of the present application provides a method for processing display data, which is applied to a first electronic device with a first interface, and includes:
under the condition that a second electronic device is connected to the first interface, acquiring identification information sent by the second electronic device, wherein the second electronic device is provided with a first display unit;
calling a first interface library under the condition that the equipment type of the second electronic equipment is determined to meet a first preset condition based on the identification information;
configuring a first data packet containing first display data through the first interface library based on the data transmission capability of the first interface;
and sending the first data packet to the second electronic equipment through the first interface so as to enable the first display unit to display the display content corresponding to the first display data.
In some embodiments, the second electronic device further has a first processing unit, the identification information includes a first identification for identifying the first display unit, and a second identification for identifying the first processing unit; the calling a first interface library under the condition that the device type of the second electronic device is determined to meet a first preset condition based on the identification information includes:
and calling the first interface library under the condition that the device type of the second electronic device is determined to meet the first preset condition based on the first identifier and the second identifier.
In some embodiments, the configuring, by the first interface library, a first data packet containing first display data based on the data transmission capability of the first interface includes:
acquiring first display data;
and processing the first display data through the first interface library to generate a first data packet which meets the requirements of a first communication protocol and has data volume meeting the data transmission capability of the first interface, wherein the first interface performs data transmission based on the first communication protocol.
In some embodiments, the obtaining first display data comprises:
and capturing display content displayed by a second display unit of the first electronic equipment to generate first display data.
In some embodiments, the sending the first data packet to the second electronic device through the first interface to cause the first display unit to display the display content corresponding to the first display data includes:
and sending the first data packet to the second electronic equipment through the first interface, so that the first processing unit analyzes the first data packet and extracts the first display data, and the display content corresponding to the first display data is displayed through the first display unit.
In some embodiments, the second electronic device further has a first image capturing unit, and the identification information further includes a third identification for identifying the first image capturing unit; the method further comprises the following steps:
calling the first interface library under the condition that the device type of the second electronic device is determined to accord with a second preset condition based on the third identifier;
acquiring a second data packet through the first interface, wherein the second data packet comprises second display data acquired by the first image acquisition unit;
and analyzing the first data packet through the first interface library to extract the second display data, so that a second display unit of the first electronic equipment displays display content corresponding to the second display data.
In some embodiments, the second electronic device further has a first sensing unit, and the identification information further includes a fourth identifier for identifying the first sensing unit; the method further comprises the following steps:
calling the first interface library under the condition that the device type of the second electronic device is determined to accord with a third preset condition based on the fourth identification;
acquiring a third data packet through the first interface, wherein the third data packet contains first sensing data generated by the first sensing unit;
analyzing the third data packet through the first interface library to extract the first sensing data;
determining a current state of the second electronic device based on the first sensed data.
In some embodiments, said determining a current state of said second electronic device based on said first sensory data comprises:
and acquiring first posture data representing the posture of the second electronic equipment based on the first sensing data.
A second aspect of embodiments of the present application provides an electronic device, including:
the device comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring identification information sent by second electronic equipment under the condition that a first interface of the electronic equipment is connected with the second electronic equipment, and the second electronic equipment is provided with a first display unit;
the first calling module is used for calling the first interface library under the condition that the equipment type of the second electronic equipment is determined to accord with a first preset condition based on the identification information;
the configuration module is used for configuring a first data packet containing first display data through the first interface library based on the data transmission capability of the first interface;
the first communication module is used for sending a first data packet to the second electronic device through the first interface so as to enable the first display unit to display the display content corresponding to the first display data.
In some embodiments, the second electronic device further has a first processing unit, the identification information includes a first identification for identifying the first display unit, and a second identification for identifying the first processing unit; the calling module is specifically configured to:
and calling the first interface library under the condition that the device type of the second electronic device is determined to meet the first preset condition based on the first identifier and the second identifier.
In some embodiments, the configuration module comprises:
a first acquisition unit configured to acquire first display data;
the first processing unit is configured to process the first display data through the first interface library, and generate a first data packet that meets a requirement of a first communication protocol and has a data volume that meets a data transmission capability of a first interface, where the first interface performs data transmission based on the first communication protocol.
In some embodiments, the first obtaining unit is specifically configured to:
and capturing display content displayed by a second display unit of the electronic equipment to generate first display data.
In some embodiments, the first communication module is specifically configured to:
and sending the first data packet to the second electronic equipment through the first interface, so that the first processing unit analyzes the first data packet and extracts the first display data, and the display content corresponding to the first display data is displayed through the first display unit.
In some embodiments, the second electronic device further has a first image capturing unit, and the identification information further includes a third identification for identifying the first image capturing unit; the electronic device further includes:
the second calling module is used for calling the first interface library under the condition that the equipment type of the second electronic equipment is determined to accord with a second preset condition based on the third identifier;
the second communication module is used for acquiring a second data packet through the first interface, wherein the second data packet comprises second display data acquired by the first image acquisition unit;
and the first analysis module is used for analyzing the first data packet through the first interface library so as to extract the second display data, so that the second display unit of the electronic equipment displays the display content corresponding to the second display data.
In some embodiments, the second electronic device further has a first sensing unit, and the identification information further includes a fourth identification for identifying the first sensing unit; the electronic device further includes:
the third calling module is used for calling the first interface library under the condition that the equipment type of the second electronic equipment is determined to accord with a third preset condition based on the fourth identification;
the third communication module is used for acquiring a third data packet through the first interface, wherein the third data packet comprises first sensing data generated by the first sensing unit;
the second analysis module is used for analyzing the third data packet through the first interface library so as to extract the first induction data;
and the determining module is used for determining the current state of the second electronic equipment based on the first sensing data.
In some embodiments, the determining module is specifically configured to:
first posture data representing the posture of the second electronic equipment is obtained based on the first sensing data.
A third aspect of the embodiments of the present application provides an electronic device, which at least includes a memory and a processor, where the memory stores an executable program, and the processor implements the following steps when executing the executable program on the memory:
under the condition that a first interface of the electronic equipment is connected with second electronic equipment, acquiring identification information sent by the second electronic equipment, wherein the second electronic equipment is provided with a first display unit;
calling a first interface library under the condition that the equipment type of the second electronic equipment is determined to meet a first preset condition based on the identification information;
configuring a first data packet containing first display data through a first interface library based on the data transmission capability of a first interface;
and sending the first data packet to the second electronic equipment through the first interface so that the first display unit displays the display content corresponding to the first display data.
According to the method for processing the display data, under the condition that the device type of the second electronic device is determined to be in accordance with the first preset condition, the first interface library is called to configure the first data packet, so that the first data packet is in accordance with the data transmission capability of the first interface, the bandwidth requirement on the first interface is reduced, the common first electronic device with the first interface can provide the first display data for the second electronic device, the limitation of the data transmission capability of the first interface is broken through, and the first interface library is located on the local layer of the system framework, so that the core layer in the system framework does not need to be modified, and the limitation that the core layer cannot be modified or is not suitable for modification is broken through.
Drawings
FIG. 1 is a flowchart illustrating a method for processing display data according to an embodiment of the present disclosure;
fig. 2 is a schematic diagram illustrating a matching connection between a first electronic device and a second electronic device in a display data processing method according to an embodiment of the present application;
fig. 3 is a flowchart of step S3 in the display data processing method according to the embodiment of the present application;
fig. 4 is a system framework diagram of a first electronic device in a display data processing method according to an embodiment of the present application;
fig. 5 is a block diagram of an electronic device according to an embodiment of the present application.
Detailed Description
Various aspects and features of the present application are described herein with reference to the drawings.
It will be understood that various modifications may be made to the embodiments of the present application. Accordingly, the foregoing description should not be construed as limiting, but merely as exemplifications of embodiments. Those skilled in the art will envision other modifications within the scope and spirit of the application.
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the application and, together with a general description of the application given above and the detailed description of the embodiments given below, serve to explain the principles of the application.
These and other characteristics of the present application will become apparent from the following description of preferred forms of embodiment, given as non-limiting examples, with reference to the attached drawings.
It should also be understood that, although the present application has been described with reference to some specific examples, a person of skill in the art shall certainly be able to achieve many other equivalent forms of application, having the characteristics as set forth in the claims and hence all coming within the field of protection defined thereby.
The above and other aspects, features and advantages of the present application will become more apparent in view of the following detailed description when taken in conjunction with the accompanying drawings.
Specific embodiments of the present application are described hereinafter with reference to the accompanying drawings; however, it is to be understood that the disclosed embodiments are merely exemplary of the application, which can be embodied in various forms. Well-known and/or repeated functions and constructions are not described in detail to avoid obscuring the application of unnecessary or unnecessary detail. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a basis for the claims and as a representative basis for teaching one skilled in the art to variously employ the present application in virtually any appropriately detailed structure.
The specification may use the phrases "in one embodiment," "in another embodiment," "in yet another embodiment," or "in other embodiments," which may each refer to one or more of the same or different embodiments in accordance with the application.
The embodiment of the application provides a method for processing display data, which is applied to a first electronic device 100, where the first electronic device 100 may be an electronic device such as a smart phone, a tablet computer, and an all-in-one computer, and the first electronic device 100 includes a first interface 110, and the first interface 110 may be, for example, a serial interface, such as a USB type-a interface, a USB type-C interface, or other serial interfaces.
Referring to fig. 1 and 2, a method for processing display data according to an embodiment of the present application includes:
s1, when the second electronic device 200 is connected to the first interface 110, the identification information transmitted by the second electronic device 200 is acquired.
The second electronic device 200 has a first display unit 215, and the number of the first display units 215 may be one or more. Specifically, the second electronic device 200 may be, for example, a wearable device, an external display device, and the like, such as a head-mounted display device, e.g., AR glasses, VR glasses, MR glasses, and XR glasses. Taking the second electronic device 200 as AR glasses as an example, the second electronic device 200 includes a frame adapted to be worn on the eyes of the user, and two second display units disposed on the frame. The second electronic device 200 can be connected to the first electronic device 100 through the first interface 110, for example, the second electronic device 200 can have a second interface 211 matched with the first interface 110, and the second interface 211 can be connected to the first interface 110, so as to connect the first electronic device 100 and the second electronic device 200 to each other.
The first electronic device 100 may determine whether the second electronic device 200 is connected by detecting the potential of the corresponding pin in the first interface 110. Taking the USB interface as an example, whether the second electronic device 200 is connected to the USB interface may be determined by detecting potentials of the D + pin and the D-pin of the USB interface. When detecting that the second electronic device 200 is connected to the first interface 110, an acquisition request for acquiring identification information may be sent to the second electronic device 200, and the second electronic device 200 may feed back, to the first electronic device 100, the identification information based on the acquisition request, where the identification information is used to identify a type of hardware device included in the second electronic device 200, configuration information of the hardware device, and the like. It may be determined whether the second electronic device 200 includes the first display unit 215, configuration information of the first display unit 215, and the like based on the identification information. Specifically, the identification information may be, for example, a manufacturer identification code (VID) or a Product identification code (PID).
After the driver of the first interface 110 acquires the identification information, an equipment directory is created based on the acquired identification information, where the equipment directory includes the hardware equipment of the second electronic equipment 200. In implementation, it may also be determined whether the second electronic device 200 is connected to the first interface 110 by detecting the device object, and in the case that it is determined that the second electronic device 200 is connected, the identification information may be acquired based on the device directory.
S2, in case that it is determined that the device type of the second electronic device 200 meets the first preset condition based on the identification information, calling the first interface library.
The first preset condition may be used to indicate that the second electronic device 200 is capable of outputting display content based on the display data, and the first preset condition may also be used to indicate that the second electronic device 200 is capable of analyzing a data packet containing the display data to obtain the display data therein and outputting the display content based on the display data when the data packet is received. Based on the acquired identification information sent by the second electronic device 200, the device type of the hardware device included in the second electronic device 200 can be determined, and further, whether the second electronic device 200 meets the first preset condition can be determined.
In implementation, when it is determined that the device type of the second electronic device 200 meets the first preset condition, the first interface library may be called by an application program. The first interface library is used for operating the first interface 110, such as initializing the first interface 110, configuring the first interface 110 with transmission data, and the like.
S3, configuring a first data packet containing first display data through the first interface library based on the data transmission capability of the first interface 110.
In specific implementation, referring to fig. 3, the first interface library may configure a first data packet containing first display data to the first interface 110 based on the data transmission capability of the first interface 110 through the following steps:
s31, first display data is acquired. The first display data may be display data generated based on display contents displayed by the second display unit of the first electronic device 100. At this time, the interface image of the application program may be continuously grabbed at specific time intervals, thereby forming first display data having continuous frames. Of course, the first display data may also be display data configured by the first electronic device 100 specifically for the second electronic device 200, and the first electronic device 100 itself does not display corresponding display content based on the first display data, and at this time, the first display data may be directly obtained from, for example, a graphics processor of the first electronic device 100.
S32 processes the first display data through the first interface library, and generates a first data packet meeting the requirement of the first communication protocol and having a data volume meeting the data transmission capability of the first interface 110, where the first interface 110 performs data transmission based on the first communication protocol.
The directly acquired first display data has a large data volume, which has a high bandwidth requirement on the first interface 110, and the first interface 110 may not have a corresponding data transmission capability, and the first display data does not conform to the requirement of the first communication protocol followed by the first interface 110. Therefore, after the first display data is acquired, the first display data needs to be processed, so that the processed data can meet the requirement of the first communication protocol, and the data volume meets the data transmission capability of the first interface 110.
Specifically, the processing of the first display may include the steps of:
the first display data having consecutive frames is compressed to obtain compressed first display data having a data amount conforming to the data transmission capability of the first interface 110. For example, the first display data with consecutive frames may be encoded and compressed based on the mjpeg video encoding format or the h.264 encoding format to reduce the data size of the first display data, and the compressed first display data conforms to the bandwidth requirement of the first interface 110.
And performing packet processing on the compressed first display data to acquire a first data packet conforming to a first communication protocol. Specifically, as shown in fig. 4, the first interface library may be configured at a local layer of the system framework, that is, a system runtime library layer. And the first interface library can be used for carrying out packet processing on the compressed first display data in a self-defined mode. For example, the compressed first display data may be divided into a plurality of blocks, and information such as a header and a trailer may be added to the blocks, and the blocks are encapsulated into a first data packet conforming to the first communication protocol, so that the first data packet may be transmitted through the first interface 110. Therefore, under the condition that the core layer is not modified, the purpose of processing the first display data in a user-defined mode is achieved, and the technical problem that the core layer of the electronic equipment cannot be modified or the system burden is increased when the core layer of the electronic equipment is modified is solved.
Thereafter, the first data packet may be configured to the first interface 110 through the first interface library. For example, the first data packet may be configured to the corresponding buffer of the first interface 110 through the first interface library to be transmitted by the first interface 110.
S4, the first data packet is transmitted to the second electronic device 200 through the first interface 110, so that the first display unit 215 displays the display content corresponding to the first display data.
The first data packet conforms to the first communication protocol followed by the first interface 110, and the data size conforms to the data transmission capability of the first interface 110, and after the first data packet configured by the first interface library is acquired, the first interface 110 can send the first data packet to the second electronic device 200 connected thereto.
The device type of the second electronic device 200 meets a first preset condition, and after the first data packet is obtained, the first data packet can be analyzed to obtain first display data therein, and then the first display data can be sent to the first display unit 215, so that the first display unit 215 displays corresponding display content based on the first display data.
In the method for processing display data according to the embodiment of the present application, when it is determined that the device type of the second electronic device 200 meets the first preset condition, the first interface library is invoked to configure the first data packet, so that the first data packet meets the data transmission capability of the first interface 110, and the bandwidth requirement on the first interface 110 is reduced, so that the common first electronic device 100 having the first interface 110 can provide the first display data for the second electronic device 200, thereby breaking through the limitation of the data transmission capability of the first interface 110, and because the first interface library is located at the local layer of the system framework, it is not necessary to modify the core layer in the system framework, and breaking through the limitation that the core layer cannot be modified or is not suitable for modification.
Taking the first electronic device 100 as a smart phone and the second electronic device 200 as AR glasses as an example, the first interface 110 may be a USB interface on the smart phone, and applying the processing method of the Display data enables the smart phone to send the Display data to the AR glasses through a common USB interface, so that the AR glasses Display corresponding Display content without requiring that the smart phone must have a USB Type-C interface supporting Display Port (DP) standard, thereby reducing hardware requirements on the first electronic device 100 and expanding the device types of the first electronic device 100 that can be connected with the AR glasses.
In addition, in the Android system, both display data and wireless screen projection (WFD) output in compliance with the DP standard belong to an extended display (external display) function, whereas the Android system only supports the opening of one extended display function, so if display data in compliance with the DP standard is output, the wireless screen projection function cannot be opened. If the display data processing method is applied, the display data can be output to external equipment such as AR glasses based on a common USB interface, the display data meeting the DP standard does not need to be output, the display function is not expanded, the wireless screen projection function can be started while the smart phone is connected with the AR glasses, and a user can share the first visual angle with other people conveniently.
Taking the first electronic device 100 as an AR box as an example, the AR box is used for connecting with a head-mounted display device such as AR glasses and sending display data to the head-mounted display device, the AR box is generally configured with two USB interfaces, one of the USB interfaces is a USB Type-C interface compatible with the DP standard, and the USB Type-C interface is also used as a debugging interface (ADB) and a charging interface of the AR box. If wear-Type display device is connected with the AR box through this USB Type-C interface, then the AR box can not debug and charge simultaneously, has restricted the use of AR box. If the processing method of the display data is applied, the head-mounted display device can be inserted into any one USB interface on the AR box, can acquire the display data, does not occupy a debugging interface and a charging interface, and can be charged and debugged simultaneously in the using process. Here, although AR glasses are taken as an example, the technical solution of the embodiment of the present application is also applicable to VR glasses, MR glasses and XR glasses as the second electronic device 200.
In some embodiments, the second electronic device 200 further has a first processing unit 213, the identification information includes a first identification for identifying the first display unit 215, and a second identification for identifying the first processing unit 213; in the case where it is determined that the device type of the second electronic device 200 meets the first preset condition based on the identification information, calling a first interface library including:
in case it is determined that the device type of the second electronic device 200 meets the first preset condition based on the first identifier and the second identifier, the first interface library is invoked.
Wherein the first identifier is used to identify the first display unit 215, and the second identifier is used to identify the first processing unit 213. The first display unit 215 is configured to display corresponding display content, the first processing unit 213 is configured to parse the first data packet to obtain first display data, and the first processing unit 213 may be, for example, a graphics processing unit. If the acquired identification information includes the first identification and the second identification, it may be determined that the second electronic device 200 has the first display unit 215 and the first processing unit 213, which indicates that the second electronic device 200 has the capability of analyzing the first data to acquire the first display data and displaying corresponding display content based on the first display data, that is, the device type of the second electronic device 200 meets the first preset condition.
In specific implementation, after the identification information is acquired, the hardware device included in the second electronic device 200 may be determined based on each identification in the identification information, and when it is determined that the second electronic device 200 includes a display unit and a processing unit capable of analyzing the first data packet to acquire the first display data, it may be determined that the second electronic device 200 meets the first preset condition. In this case, a first data packet including the first display data may be configured with the first interface library. Specifically, the first interface library may be called by an application program on the first electronic device 100, and the first interface library may be, for example, a libob interface library.
In some embodiments, transmitting the first data packet to the second electronic device 200 through the first interface 110 to cause the first display unit 215 to display the display content corresponding to the first display data includes:
the first data packet is transmitted to the second electronic device 200 through the first interface 110, so that the first processing unit 213 parses the first data packet and extracts the first display data, so as to display the display content corresponding to the first display data through the first display unit 215.
The process of parsing the first data packet and extracting the first display data by the first processing unit 213 may be opposite to the process of processing the first display data by the first electronic device 100 to obtain the first data packet. After acquiring the first data packet, the first processing unit 213 may first perform unpacking processing on the first data packet to acquire compressed first display data. The compressed first display data may then be decompressed to obtain first display data having consecutive frames. The first processing unit 213 can transmit a display signal to the first display unit 215 based on the first display data to cause the first display unit 215 to display the corresponding display content. For example, in an implementation, the first display unit 215 may be an OLED display or an LCOS display, and as shown in fig. 2, the second electronic device 200 may further include a first conversion unit 214, and the first conversion unit 214 may be a signal converter. The first processing unit 213 may generate an HDMI display signal based on the first display data and send the HDMI display signal to the first converting unit 214, and the first converting unit 214 may convert the HDMI display signal into a Low Voltage Differential Signaling (LVDS) signal and then send the LVDS signal to the first display unit 215, so that the first display unit 215 displays the corresponding display content based on the LVDS signal.
In some embodiments, the second electronic device 200 further has a first image capturing unit 217, and the identification information further includes a third identification for identifying the first image capturing unit 217; the method may further comprise:
under the condition that the device type of the second electronic device 200 is determined to meet the second preset condition based on the third identifier, calling the first interface library;
acquiring a second data packet through the first interface 110, wherein the second data packet includes second display data acquired by the first image acquisition unit 217;
the first data packet is parsed through the first interface library to extract the second display data, so that the second display unit of the first electronic device 100 displays the display content corresponding to the second display data.
The first image collecting unit 217 may be a camera device disposed on the second electronic device 200, and configured to collect an annular image and generate second display data, for example, the second electronic device 200 is an AR glasses, the first image collecting unit 217 may be a camera disposed on a frame, and when the user wears the AR glasses, the camera may collect an image of an environment where the user is located and generate the second display data.
The second preset condition may be used to indicate that the second electronic device 200 has an image capturing function. When the first electronic device 100 recognizes that the second electronic device 200 has the first image capturing unit 217 based on the third identifier in the identifier information, it may be determined that the second electronic device 200 meets the second preset condition, and the first interface library may be called, so that the first electronic device 100 may receive the second data packet containing the second display data sent by the second electronic device 200. The first data packet is unpacked by the first interface library to obtain compressed second display data, the compressed second display data is unpacked to obtain second display data with continuous frames, and the second display data is converted into a data format supported by an application program on the first electronic device 100 by, for example, a Java native interface program, and the display content responding to the second display data is displayed by the second display unit under the control of the application program. If the first display device is taken as the smart phone as an example, when the AR glasses are connected with the smart phone, an image shot by a camera of the AR glasses can be displayed on a display screen of the smart phone.
In specific implementation, as shown in fig. 2, the second electronic device 200 may further include a repeater 212 and a second processing unit 216, the repeater 212 is connected to the second interface 211, the first processing unit 213, and the second processing unit 216, the second processing unit 216 is connected to the first image acquisition unit 217, the second display data generated by the first image acquisition unit 217 is sent to the second processing unit 216, and the second processing unit 216 processes the second display data to generate a second data packet that conforms to the first communication protocol and has a data amount that conforms to the data transmission capabilities of the first interface 110 and the second interface 211, and forwards the second data packet to the second interface 211 through the repeater 212, and sends the second data packet to the first electronic device 100 through the second interface 211.
After the first electronic device 100 acquires the second display data, the display content corresponding to the second display data may be displayed through the second display unit, or the first display data may be generated based on the second display data, so that the virtual display content corresponding to the first display data displayed by the first display unit 215 may be superimposed on the scene image of the environment where the second electronic device 200 is located, thereby achieving the purpose of enhanced display.
In some embodiments, the second electronic device 200 further has a first sensing unit 219, and the identification information further includes a fourth identifier for identifying the first sensing unit 219; the method further comprises the following steps:
under the condition that the device type of the second electronic device 200 is determined to meet the third preset condition based on the fourth identifier, calling the first interface library;
acquiring a third data packet through the first interface 110, wherein the third data packet includes the first sensing data generated by the first sensing unit 219;
analyzing the third data packet through the first interface library to extract first induction data;
the current state of the second electronic device 200 is determined based on the first sensing data.
The first sensing unit 219 may be a sensor or a sensor disposed on the second electronic device 200, and specifically, the first sensing unit 219 may be, for example, a motion sensor, a pressure sensor, a temperature sensor, a speed sensor, and the like. The first sensing unit 219 can detect the detected information and generate first sensing data, and for example, a motion sensor can detect a motion state of the second electronic device 200 and generate the first sensing data.
When it is determined that the second electronic device 200 has the first sensing unit 219 based on the fourth identifier in the identification information, the first interface library may be called, so that the first electronic device 100 can obtain the third data packet containing the first sensing data through the first interface 110. The analysis process of the third data packet is similar to that of the first data packet and the second data packet, the first sensing data can be obtained after the analysis, and the current motion state of the second electronic device 200 can be determined based on the first sensing data. As in a preferred embodiment, first pose data characterizing the pose of the second electronic device 200 is acquired based on the first sensed data, and a corresponding instruction may be generated based on the first pose data. The first display data may be adjusted, for example, based on the first posture data, so that the virtual display content displayed by the first display unit 215 based on the first display data can be adapted to the motion state of the second electronic device 200.
In specific implementation, as shown in fig. 2, the second electronic device 200 may further have a third processing unit 218, and the third processing unit 218 is connected to the first sensing unit 219 and the transponder 212, respectively. The third processing unit 218 may be specifically a micro processing unit (MCU), for example, the first sensor may be a motion sensor such as an accelerometer or a gyroscope, the first sensing data generated by the motion sensor is sent to the third processing unit 218, the third processing unit 218 may process the first sensing data to generate a third data packet, and send the third data packet to the repeater 212, and the repeater 212 sends the third data packet to the first electronic device 100 through the second interface 211.
In some embodiments, the second electronic device 200 may further include an audio unit 220, the audio unit 220 may include, for example, a speaker, a microphone, and an audio codec, the audio codec is respectively connected to the third processing unit 218, the speaker, and the microphone, the identification information of the second electronic device 200 also includes corresponding identifications for identifying the speaker, the microphone, and the audio encoder, and the method may further include: in a case where it is determined that the second electronic device 200 has a speaker based on the identification information, calling a first interface library; configuring a fourth data packet containing the first audio data through the first interface library based on the data transmission capability of the first interface 110, and transmitting the fourth data packet to the second electronic device 200 through the first interface 110 to cause the speaker to output audio content in response to the first audio data. Alternatively, the method may further comprise; in a case where it is determined that the second electronic device 200 has a microphone based on the identification information, calling a first interface library; acquiring a fifth data packet through the first interface 110, wherein the fifth data packet includes second audio data collected by a microphone; and parsing the fifth data packet through the first interface library to extract the second audio data, so that the audio output device on the first electronic device 100 can output corresponding audio content.
In specific implementation, the first interface 110 may also be operated through the first interface library, and the operation instruction is sent to the second electronic device 200 through the first interface 110, so that the second electronic device 200 executes a corresponding operation based on the operation instruction. Such as controlling the first display unit 215, the first image capturing unit 217, the audio unit 220, and the like of the second electronic device 200, or obtaining an operation instruction sent by the second electronic device 200 through the first interface 110, and performing a corresponding operation based on the operation instruction.
Referring to fig. 5, an embodiment of the present application further provides an electronic device, including:
the acquiring module 10 is configured to acquire, when a first interface of the electronic device is connected to a second electronic device, identification information sent by the second electronic device, where the second electronic device has a first display unit;
the first calling module 20 is configured to call the first interface library when it is determined that the device type of the second electronic device meets a first preset condition based on the identification information;
a configuration module 30, configured to configure a first data packet containing first display data through a first interface library based on a data transmission capability of a first interface;
the first communication module 40 is configured to send the first data packet to the second electronic device through the first interface, so that the first display unit displays display content corresponding to the first display data.
In some embodiments, the second electronic device further has a first processing unit, the identification information includes a first identification for identifying the first display unit, and a second identification for identifying the first processing unit; the calling module is specifically configured to:
and calling the first interface library under the condition that the device type of the second electronic device is determined to meet the first preset condition based on the first identifier and the second identifier.
In some embodiments, the configuration module 30 includes:
a first acquisition unit configured to acquire first display data;
the first processing unit is configured to process the first display data through the first interface library, and generate a first data packet that meets a requirement of a first communication protocol and has a data volume that meets a data transmission capability of a first interface, where the first interface performs data transmission based on the first communication protocol.
In some embodiments, the first obtaining unit is specifically configured to:
and capturing display content displayed by a second display unit of the electronic equipment to generate first display data.
In some embodiments, the first communication module 40 is specifically configured to:
and sending the first data packet to the second electronic equipment through the first interface, so that the first processing unit analyzes the first data packet and extracts the first display data, and the display content corresponding to the first display data is displayed through the first display unit.
In some embodiments, the second electronic device further has a first image capturing unit, and the identification information further includes a third identification for identifying the first image capturing unit; the electronic device further includes:
the second calling module is used for calling the first interface library under the condition that the equipment type of the second electronic equipment is determined to accord with a second preset condition based on the third identifier;
the second communication module is used for acquiring a second data packet through the first interface, wherein the second data packet comprises second display data acquired by the first image acquisition unit;
and the first analysis module is used for analyzing the first data packet through the first interface library so as to extract the second display data, so that the second display unit of the electronic equipment displays the display content corresponding to the second display data.
In some embodiments, the second electronic device further has a first sensing unit, and the identification information further includes a fourth identification for identifying the first sensing unit; the electronic device further includes:
the third calling module is used for calling the first interface library under the condition that the equipment type of the second electronic equipment is determined to accord with a third preset condition based on the fourth identification;
the third communication module is used for acquiring a third data packet through the first interface, wherein the third data packet comprises first sensing data generated by the first sensing unit;
the second analysis module is used for analyzing the third data packet through the first interface library so as to extract the first induction data;
and the determining module is used for determining the current state of the second electronic equipment based on the first sensing data.
In some embodiments, the determining module is specifically configured to:
first posture data representing the posture of the second electronic equipment is obtained based on the first sensing data.
The embodiment of the present application further provides an electronic device, which at least includes a memory and a processor, where the memory stores an executable program, and the processor implements the method for processing display data provided in any of the above embodiments of the present application when executing the executable program on the memory.
The above embodiments are only exemplary embodiments of the present application, and are not intended to limit the present application, and the protection scope of the present application is defined by the claims. Various modifications and equivalents may be made by those skilled in the art within the spirit and scope of the present application and such modifications and equivalents should also be considered to be within the scope of the present application.
Claims (8)
1. A processing method of display data is applied to a first electronic device with a first interface, and comprises the following steps:
under the condition that a second electronic device is connected to the first interface, acquiring identification information sent by the second electronic device, wherein the second electronic device is provided with a first display unit;
calling a first interface library under the condition that the equipment type of the second electronic equipment is determined to meet a first preset condition based on the identification information;
configuring a first data packet containing first display data through the first interface library based on the data transmission capability of the first interface;
sending the first data packet to the second electronic device through the first interface so as to enable the first display unit to display content corresponding to the first display data;
the second electronic equipment is also provided with a first processing unit, and the identification information comprises a first identification for identifying the first display unit and a second identification for identifying the first processing unit; the calling a first interface library under the condition that the device type of the second electronic device is determined to meet a first preset condition based on the identification information includes:
and calling the first interface library under the condition that the device type of the second electronic device is determined to meet the first preset condition based on the first identifier and the second identifier.
2. The method for processing display data according to claim 1, wherein the configuring, through the first interface library, a first data packet containing first display data based on the data transmission capability of the first interface comprises:
acquiring first display data;
and processing the first display data through the first interface library to generate a first data packet which meets the requirements of a first communication protocol and has data volume meeting the data transmission capability of the first interface, wherein the first interface performs data transmission based on the first communication protocol.
3. The method for processing display data according to claim 2, wherein the acquiring the first display data includes:
and capturing display content displayed by a second display unit of the first electronic equipment to generate first display data.
4. The method for processing display data according to claim 1, wherein the sending the first data packet to the second electronic device through the first interface to cause the first display unit to display content corresponding to the first display data includes:
and sending the first data packet to the second electronic equipment through the first interface, so that the first processing unit analyzes the first data packet and extracts the first display data, and the display content corresponding to the first display data is displayed through the first display unit.
5. The display data processing method according to claim 1, wherein the second electronic device further has a first image capturing unit, and the identification information further includes a third identification for identifying the first image capturing unit; the method further comprises the following steps:
calling the first interface library under the condition that the device type of the second electronic device is determined to accord with a second preset condition based on the third identifier;
acquiring a second data packet through the first interface, wherein the second data packet comprises second display data acquired by the first image acquisition unit;
and analyzing the first data packet through the first interface library to extract the second display data, so that a second display unit of the first electronic equipment displays display content corresponding to the second display data.
6. The processing method of display data according to claim 1, wherein the second electronic device further has a first sensing unit, and the identification information further includes a fourth identifier for identifying the first sensing unit; the method further comprises the following steps:
calling the first interface library under the condition that the device type of the second electronic device is determined to accord with a third preset condition based on the fourth identification;
acquiring a third data packet through the first interface, wherein the third data packet contains first sensing data generated by the first sensing unit;
analyzing the third data packet through the first interface library to extract the first sensing data;
determining a current state of the second electronic device based on the first sensed data.
7. The method for processing display data according to claim 6, wherein the determining the current state of the second electronic device based on the first sensing data comprises:
and acquiring first posture data representing the posture of the second electronic equipment based on the first sensing data.
8. An electronic device, comprising:
the device comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring identification information sent by second electronic equipment under the condition that a first interface of the electronic equipment is connected with the second electronic equipment, and the second electronic equipment is provided with a first display unit;
the calling module is used for calling a first interface library under the condition that the equipment type of the second electronic equipment is determined to accord with a first preset condition based on the identification information;
a configuration module, configured to configure, based on the data transmission capability of the first interface, a first data packet including first display data through the first interface library;
a sending module, configured to send the first data packet to the second electronic device through the first interface, so that the first display unit displays display content corresponding to the first display data;
the second electronic equipment is also provided with a first processing unit, and the identification information comprises a first identification for identifying the first display unit and a second identification for identifying the first processing unit; the calling module is specifically configured to:
and calling the first interface library under the condition that the device type of the second electronic device is determined to meet the first preset condition based on the first identifier and the second identifier.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010693037.2A CN111857889B (en) | 2020-07-17 | 2020-07-17 | Display data processing method and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010693037.2A CN111857889B (en) | 2020-07-17 | 2020-07-17 | Display data processing method and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111857889A CN111857889A (en) | 2020-10-30 |
| CN111857889B true CN111857889B (en) | 2021-11-16 |
Family
ID=73000941
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010693037.2A Active CN111857889B (en) | 2020-07-17 | 2020-07-17 | Display data processing method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111857889B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009181318A (en) * | 2008-01-30 | 2009-08-13 | Kyocera Corp | Information processor and mobile terminal |
| CN106126148A (en) * | 2016-06-30 | 2016-11-16 | 联想(北京)有限公司 | Display control method and electronic equipment |
| CN107948568A (en) * | 2016-10-12 | 2018-04-20 | 广州视源电子科技股份有限公司 | Realize the method and device of wired biography screen |
| CN108090012A (en) * | 2016-11-23 | 2018-05-29 | 三星电子株式会社 | The electronic equipment to be communicated using USB connector with external electronic device |
| CN110062186A (en) * | 2019-05-29 | 2019-07-26 | 北京硬壳科技有限公司 | A kind of data transmission method, system and touch control display |
| CN111314549A (en) * | 2020-02-10 | 2020-06-19 | 联想(北京)有限公司 | Transmission apparatus and processing method |
-
2020
- 2020-07-17 CN CN202010693037.2A patent/CN111857889B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009181318A (en) * | 2008-01-30 | 2009-08-13 | Kyocera Corp | Information processor and mobile terminal |
| CN106126148A (en) * | 2016-06-30 | 2016-11-16 | 联想(北京)有限公司 | Display control method and electronic equipment |
| CN107948568A (en) * | 2016-10-12 | 2018-04-20 | 广州视源电子科技股份有限公司 | Realize the method and device of wired biography screen |
| CN108090012A (en) * | 2016-11-23 | 2018-05-29 | 三星电子株式会社 | The electronic equipment to be communicated using USB connector with external electronic device |
| CN110062186A (en) * | 2019-05-29 | 2019-07-26 | 北京硬壳科技有限公司 | A kind of data transmission method, system and touch control display |
| CN111314549A (en) * | 2020-02-10 | 2020-06-19 | 联想(北京)有限公司 | Transmission apparatus and processing method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111857889A (en) | 2020-10-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10922041B2 (en) | Wireless screen transmission method, extension device, and wireless screen transmission system | |
| US9294607B2 (en) | Headset computer (HSC) as auxiliary display with ASR and HT input | |
| WO2019184499A1 (en) | Video call method and device, and computer storage medium | |
| EP2631901A2 (en) | Apparatus and method for displaying an image on a sink device | |
| CN103559150A (en) | Realizing method and device for external camera of host, and mobile terminal | |
| KR20200051591A (en) | Information processing apparatus, information processing method, and program | |
| CN112949547A (en) | Data transmission and display method, device, system, equipment and storage medium | |
| CN111479148B (en) | Wearable device, glasses terminal, processing terminal, data interaction method and medium | |
| CN113238727A (en) | Screen switching method and device, computer readable medium and electronic equipment | |
| CN101593506B (en) | Data transmission method,communication system and a display apparatus | |
| CN110515610B (en) | Page drawing control method, device and equipment | |
| CN210090827U (en) | Portable AR glasses implementation system | |
| CN111857889B (en) | Display data processing method and electronic equipment | |
| CN112351234A (en) | Intelligent near-eye display device, system and extended display method | |
| US20230350631A1 (en) | Projection display method and electronic device | |
| CN215121012U (en) | Signal processing system | |
| CN208782954U (en) | A kind of terminal device | |
| CN109542218B (en) | Mobile terminal, human-computer interaction system and method | |
| CN107015935B (en) | Docking apparatus and control method thereof | |
| KR101187269B1 (en) | Electronic apparatus for transmitting/receiving data using mhl interface and data transmitting/receiving method thereof | |
| CN115328414A (en) | Collaborative display method, electronic device, medium, and program product | |
| CN213426310U (en) | Intelligent near-to-eye display device and system | |
| CN108509227B (en) | Information processing method, electronic equipment and information processing system | |
| CN215067521U (en) | Head-mounted display device and system | |
| CN215818357U (en) | Display screen |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |