CN115016685A - Display control method and device, wearable device and storage medium - Google Patents

Display control method and device, wearable device and storage medium Download PDF

Info

Publication number
CN115016685A
CN115016685A CN202210565856.8A CN202210565856A CN115016685A CN 115016685 A CN115016685 A CN 115016685A CN 202210565856 A CN202210565856 A CN 202210565856A CN 115016685 A CN115016685 A CN 115016685A
Authority
CN
China
Prior art keywords
application
card
data
controller
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210565856.8A
Other languages
Chinese (zh)
Inventor
江海永
刘章奇
张宇
张恺毅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202210565856.8A priority Critical patent/CN115016685A/en
Publication of CN115016685A publication Critical patent/CN115016685A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Abstract

The embodiment of the application discloses a display control method and device, wearable equipment and a storage medium, and belongs to the technical field of communication. The wearable device comprises a controller, an application and a first card of the application, the wearable device is connected with the terminal, the terminal runs a second card of the application and the application, and the display control method comprises the following steps: in response to the data sent by the second card, the controller recognizes that the data includes incremental data for the first card; and controlling the first card to display the display content corresponding to the incremental data through the controller. According to the technical scheme of the embodiment of the application, the speed of updating the application content on the side of the wearable device is improved, and the scene requirement of real-time display is favorably met.

Description

Display control method and device, wearable device and storage medium
Technical Field
The embodiment of the application relates to the technical field of communication, in particular to a display control method, a device wearing device and a storage medium.
Background
Wearing equipment can pass through modes such as bluetooth, mobile network and terminal communication such as cell-phone, panel computer like intelligent bracelet, intelligent wrist-watch, intelligent glasses. The terminal can send the application content to the wearable device in the form of the picture through the Bluetooth protocol, and then the wearable device displays the picture content. However, the data volume of the picture is large and limited by the speed limit of bluetooth itself, which causes a large transmission delay, so the speed of updating the application content on the wearable device is slow.
Disclosure of Invention
The embodiment of the application provides a display control method and device, wearable equipment and a storage medium.
In a first aspect, an embodiment of the present application provides a display control method, which is applied to a wearable device, where the wearable device includes a controller, an application, and a first card of the application, the wearable device is connected to a terminal, and the terminal runs a second card of the application and the application, and the display control method includes: in response to the data sent by the second card, the controller recognizes that the data includes incremental data for the first card; and controlling the first card to display the display content corresponding to the incremental data through the controller.
In a second aspect, an embodiment of the present application provides a display control device, is applied to wearing equipment, and wearing equipment includes the first card of controller, application and application, and wearing equipment is connected with the terminal, and the terminal operation has the second card of application and application, and this display control device includes: the identification unit is used for responding to the data sent by the second card, and identifying that the data comprises the incremental data of the first card through the controller; and the control unit is used for controlling the display content corresponding to the incremental data displayed by the first card through the controller.
In a third aspect, embodiments of the present application provide a wearable device, comprising a processor, a memory, a bluetooth module, a display, and one or more programs, the one or more programs being stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps of the method of the first aspect.
In a fourth aspect, embodiments of the present application provide a computer-readable storage medium, which stores at least one instruction for execution by a processor to implement the method provided in the first aspect.
In a fifth aspect, embodiments of the present application provide a computer program product or a computer program comprising computer instructions stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the method provided by the first aspect.
According to the display control method and device, the wearable device and the storage medium, the wearable device responds to data sent by a second card of the terminal, and the controller recognizes that the data comprises incremental data of the first card; controlling the first card to display the display content corresponding to the incremental data through the controller; for the terminal picture transmission to the wearing equipment, the data volume that needs spread out reduces, has improved transmission speed, has reduced the time delay that the transmission arouses, and then makes the wearing equipment can in time acquire the data that the second card sent, and then accomplishes the demonstration refresh operation of first card according to the increment data that determines, has so not only improved the speed of update application content, still is favorable to satisfying the scene demand of real-time demonstration better.
Drawings
The drawings are included to provide a better understanding of the present solution and are not intended to limit the present application. Wherein:
fig. 1 is a first flowchart of a display control method according to an embodiment of the present disclosure;
fig. 2 is a second flowchart of a display control method according to an embodiment of the present application;
fig. 3 is a flowchart three of a display control method provided in the embodiment of the present application;
fig. 4 is a schematic diagram of a communication architecture between smart glasses and a terminal provided in an embodiment of the present application;
fig. 5 is a fourth flowchart of a display control method provided in an embodiment of the present application;
FIG. 6 is a schematic diagram of an AR glasses display weather card provided in the embodiments of the present application;
FIG. 7 is a schematic diagram of an AR glasses display navigation card provided by an exemplary embodiment of the present application;
fig. 8 is a schematic view of an AR glasses display car boarding card provided in an embodiment of the present application;
fig. 9 is a first block diagram of a display control apparatus according to an embodiment of the present application;
fig. 10 is a block diagram of a second configuration of the display control apparatus according to the embodiment of the present application;
fig. 11 is a block diagram of an electronic device according to an exemplary embodiment of the present application.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are illustrative and are only for the purpose of explaining the present application and are not to be construed as limiting the present application.
In the description of the present application, it is to be understood that the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or as implying that the number of indicated technical features is indicated. Thus, features defined as "first", "second", may explicitly or implicitly include one or more of the described features. In the description of the present application, "a plurality" means two or more unless specifically defined otherwise.
As described above in the background, the wearable device needs to present at least part of the information of the three-party application of the terminal in real time. Here, at least part of the information includes user interface prompt information or user interface content information.
Augmented Reality (AR) technology refers to a display technology in which virtual information is applied to the real world so that the real world and the virtual world are superimposed on the same screen in real time or coexist in space. At present, AR technology can be implemented through smart wearable devices such as AR glasses, AR helmets, and the like.
In the related art, there are generally two ways for developing an application of smart glasses based on an Android (Android) system. The first way is to independently develop and apply for the smart glasses: when an interaction event occurs on the smart glasses, the data is updated through an Application Programming Interface (API) Interface through a mobile network or a wireless local area network, and then a User Interface (UI) is refreshed. The second mode is that the applications on the intelligent glasses are all realized on the terminal: the terminal is connected with the intelligent glasses through modes such as Bluetooth, when the application is updated, a new picture is generated at the terminal, and the picture is transmitted to the intelligent glasses through Bluetooth transmission and displayed. However, the smart glasses adopting the first mode need to support an Embedded-Subscriber Identity Module (ESIM) or Wireless Fidelity (WIFI) in hardware, and when the WIFI is turned on for a long time, the power consumption is large, and the cruising ability of the smart glasses is greatly reduced. In addition, the three-party application cannot synchronize the application instruction of the glasses-mobile phone terminal, for example, when the mobile phone terminal opens the navigation application, the glasses terminal navigation application cannot be opened, and the relevant navigation information is displayed. However, the second method is limited by the speed limit of bluetooth itself, and is not suitable for high frame rate picture transmission, and therefore cannot satisfy scenes such as application content real-time preview and in-application animation.
In order to at least partially solve one or more of the above-mentioned problems and other potential problems, the present application provides a display control scheme, and with the technical solution of the embodiments of the present application, a requirement that a wearable device rapidly displays at least part of information of a three-party application of a terminal can be satisfied.
The embodiment of the application provides a display control method which can be applied to wearable equipment, wherein the wearable equipment comprises a controller, an application and a first card of the application, the wearable equipment is connected with a terminal, and the terminal runs with the application and a second card of the application. The wearable device includes but is not limited to a smart bracelet, a smart watch, smart glasses, a smart helmet, and the like. Wherein the smart glasses include, but are not limited to, AR glasses. As shown in fig. 1, the display control method includes:
s101: in response to the data sent by the second card, the controller recognizes that the data includes incremental data for the first card;
s102: and controlling the first card to display the display content corresponding to the incremental data through the controller.
In the embodiment of the present application, the terminal includes, but is not limited to, a mobile phone or a tablet computer. The terminal and the wearable device can be in wireless communication.
In the embodiment of the application, the application is an application which can be installed on both the terminal and the wearable device and has a certain function, such as a navigation application, a sports application, a weather application, a chat application and the like.
The application of the wearable device has at least a part of the functions of the application of the terminal. In particular, the application may be referred to as a three-party application or a third-party application, etc. The application of the terminal and the application of the wearable device can be the same three-party application. For the same three-party application installed on the terminal and the wearable device, the application of the wearable device has at least partial functions of the application of the terminal. For example, an application of the wearable device has a UI display function of an application of the terminal. In practical applications, the application of the wearable device may be a simple application of the terminal, and the application of the wearable device may also be an application having a UI display function of the application of the terminal.
In an embodiment of the present application, the incremental data includes at least one of the following data: display content change data and control command change data.
The display content change data may include change data of the content to be displayed at this time relative to the content displayed last time. Illustratively, the change data of the display content includes change data of display information, for example, information in the interface content that needs to be displayed this time includes message 1 and message 2, and information in the interface content that is displayed last time includes message 1; if the content to be displayed at this time changes from the change data of the content displayed last time, and the specific changed content is "message 2" added, the change data of the displayed content may only include: this message 2. For another example, the change data of the display content includes change data of the display interface, for example, the icons in the interface content that needs to be displayed this time include icon 1, icon 2 and icon 3, and the icons in the interface content that is displayed last time include icon 1 and icon 2; if the content to be displayed at this time changes from the change data of the content displayed last time, and the specific changed content is "icon 3" added, the change data of the displayed content may only include: the icon 3. The above is merely an exemplary illustration, and is not intended to be a limitation on all possible types of change data of the display contents, but is not exhaustive.
The change data of the control command may include change data of the control command to be executed at this time relative to the control command executed last time. For example, the change data of the control instruction includes change data of volume control, for example, the target volume is 30 this time, and the volume is maintained at 10 after the volume adjustment is performed last time; the volume adjustment needs to be executed at this time, and the specific control instruction is "increase by 20 on the basis of the previous volume", and then the change data of the control instruction may only include: up 20 on the last volume basis. As another example, the change data of the control command includes change data of brightness control, for example, the target brightness is 50% at this time, and the brightness is maintained at 60% after the last brightness adjustment is performed; the brightness adjustment to be executed at this time is changed from the target brightness data of the previous brightness adjustment, and the specific change instruction is "decrease by 10% on the basis of the previous brightness", and then the change data of the control instruction may only include: dimming is 10% on the last brightness basis. For another example, the change data of the control command includes change data of the control command regarding the display mode, for example, the display mode desired at this time is highlighted, and the display mode at the last time is non-highlighted; if the display mode to be executed at this time is changed from the previous display mode, and the specific change instruction is "change the display mode to the highlight display mode", the change data of the control instruction may include only: the display mode is changed to the highlight display mode. The above is merely an exemplary illustration, and is not a limitation on all possible types of variation data of the control command, which is not exhaustive here.
In an embodiment of the present application, the first card is a card displayed on the wearable device, specifically, an image displayed on a user interface of the wearable device. The second card is a card displayed on the terminal, in particular an image displayed on a user interface of the terminal.
According to the technical scheme of the embodiment of the application, the wearable device responds to data sent by a second card of the terminal, and the controller identifies that the data comprises incremental data of the first card; the display content corresponding to the incremental data is displayed on the first card through the controller, and compared with the process of transmitting pictures to the wearable device through the terminal, the process mode has the advantages that the data volume required to be transmitted is reduced, the transmission speed is increased, the time delay caused by transmission is reduced, the wearable device can acquire the data sent by the second card in time, and the display refreshing operation of the first card is completed according to the incremental data, so that the speed of updating the application content is increased, and the scene requirement of real-time display is favorably met. In addition, the requirement for transmission capability between the wearable device and the terminal is also reduced due to the reduced amount of data that needs to be transmitted out. Simultaneously, also reduced the hardware requirement to wearing equipment, can also save the wearing equipment because of with the terminal communication consumption the consumption.
In some embodiments, before controlling, by the controller, the first card to display the display content corresponding to the incremental data, the display control method may further include: the controller sends the incremental data to the application of the wearable device; according to the incremental data, applying and recombining the display content of the first card; the application sends the display content to the controller.
In the present embodiment, the controller may be an actuator of the first control application. Here, the first control application may be configured to determine incremental data of a first card of an application on the wearable device according to data sent from a second card of the application on the terminal, distribute the incremental data to a corresponding application in the wearable device, and update display content in a display interface of the application in the wearable device, that is, display content corresponding to the incremental data of the first card. For example, the first control application may be a Launcher application, and it should be understood that the control-class application having the above-mentioned function may be the first control application, which is not exhaustive here.
It should be understood that the number of the aforementioned applications may be one or more, and there is a one-to-one correspondence between the applications on the wearable device and the applications on the terminal.
Taking the number of the applications as an example, in one example, the first control application of the wearable device may receive data from the plurality of applications on the terminal based on a wireless communication protocol, such as a bluetooth protocol. Then, through the first control application of the wearable device, the incremental data corresponding to the plurality of applications can be distributed to the plurality of corresponding applications of the wearable device.
The incremental data from the multiple applications are distributed to the multiple corresponding applications of the wearable device, which may specifically refer to: sending the incremental data of the ith application in the multiple applications to the ith application in the multiple applications corresponding to the wearable device; wherein i is an integer greater than or equal to 1. It should be understood that, here, only any one of the multiple applications (i.e., the ith application) is taken as an example for description, and in the actual processing, since the processing procedures for the respective applications are the same and can be performed simultaneously, the description is not repeated here.
For example, the plurality of applications of the terminal include application a, application B, and application C, and the plurality of applications of the wearable device include application a, application B, and application C. After receiving the data of the application A, the application B and the second card of the application C of the terminal, the first control application of the wearable device distributes the incremental data of the application A to the application A of the wearable device, distributes the incremental data of the application B to the application B of the wearable device, and distributes the incremental data of the application C to the application C of the wearable device.
So, receive the data that terminal second card sent like first control application through wearing equipment side controller, and then confirm, distribute and show the increment data of using, the application of the wearing equipment side of can being convenient for acquires the increment data fast, and then can be convenient for should apply the first card that generates the increment data fast and correspond, has improved the generation efficiency of first card.
Furthermore, under the condition that the number of the applications is multiple, the incremental data of the multiple applications is determined, distributed and displayed through the controller such as the first control application, so that the multiple applications can be managed uniformly, and occupation of memory resources of the wearable device can be saved compared with the case that a plug-in with the function of the first control application is embedded in each application.
In some embodiments, after the controller recognizes that the data includes incremental data for the first card, it may further include: the controller queries a UI service associated with the application and triggers the application when the presence of the UI service is queried.
Here, the UI service refers to a service related to interface display. In practical applications, the wearable device side application may be a simple version application of the terminal side application, and the wearable device side application may also be an application having a UI display function of the terminal side application.
For example, if the controller determines from the query that the UI service installation package related to the application exists on the wearable device, it determines that the UI service exists.
For another example, if the controller queries that the application identifier exists on the wearable device from the database in the UI service list, it is determined that the UI service exists. Here, the UI service list records an identification of an application supporting the UI service.
In this way, the display control of the application is realized by calling the UI service, which is helpful for improving the real-time performance of the display.
In some embodiments, the controller sends the incremental data to an application of the wearable device, including: the controller wakes up the application in the dormant state and sends the incremental data to the application.
Therefore, the wearable device side application can be used as UI service display, and is only awakened when the UI service is triggered, and can be dormant before, so that the energy consumption of the wearable device can be saved.
In other embodiments, the controller sends the incremental data to an application of the wearable device, comprising: and the controller calls the application in the running state and sends the incremental data to the application.
So, wearing equipment side application is running always to whether monitor the incremental data that has the controller to send, can improve the speed that the application acquireed the incremental data, and then be convenient for this application generate the first card that the incremental data corresponds fast, improved the generation efficiency of first card.
In some embodiments, prior to responding to the data sent by the second card, the display control method may further include: the controller receives a synchronous registration instruction sent by a terminal; the controller sends a notification message to the application when inquiring that the UI service installation package corresponding to the synchronous registration instruction exists in the application, so as to notify the application to be bound with an operating system of the controller; in response to binding of the application with an operating system of the controller, the controller executes a UI service associated with the application through the operating system.
Here, the operating system is an operating system of the wearable device. Taking the wearable device as AR glasses as an example, the operating system is a glasses operating system. Taking the wearable device as an AR helmet as an example, the operating system is a helmet operating system.
Further, in the case that it is determined that the application binding operation system is completed, the controller receives a default card from the application, and notifies the operation system to set the display content of the display interface of the application as the default card.
Here, the default card is a card to be displayed after registration is completed, and may also be referred to as an initialization card, and the initialization card may be a system initialization card of an application or an initialization card designated by a user. It can be understood that different applications can correspond to different default cards, and the default cards can be set or changed according to the requirements of users.
Illustratively, the controller of the wearable device receives a synchronous registration instruction of the application sent by a second control application of the terminal, such as the wearable device control application, based on a wireless communication protocol, for example, a bluetooth protocol. The controller can search whether a UI service installation package corresponding to the application exists in the wearable device according to the synchronous registration instruction. If so, invoking the synchronous registration service of the application. If not, the synchronous registration instruction is ignored. After the application binds to the operating system, a notification may be sent to the controller to notify the controller that the application binds to the operating system, that is, the registration is completed. After the controller learns that the application is bound with the operating system, the controller can receive a default card from the application and inform the operating system to set the display content of the display interface of the application as the default card.
Here, the following two ways of determining that the application binds to the os are mainly possible, which are described below respectively.
In some embodiments, determining the manner in which the application binding operating system is completed may include: and when receiving the notification that the binding of the operating system is successful, which is sent by the application, the controller determines that the binding of the operating system by the application is completed.
In some embodiments, determining the manner in which the application binding operating system is completed may include: the controller receives a service request of binding the operating system sent by the application, binds the application to the operating system based on the service request, and determines that the application binding the operating system is completed after detecting that the binding connection is successfully established.
So, through accomplish in advance on wearing equipment with the synchronous register of terminal, can provide basic support for follow-up wearing equipment based on the data update display content that the second card that uses sent on the terminal, owing to establish synchronous connection in advance, after the data that the second card sent spread into, can carry out the demonstration of the relevant content of increment data fast, satisfy wearing equipment's real-time display demand.
In some embodiments, applying the reorganization of the display content of the first card according to the delta data includes: determining the message type and the message data according to the incremental data; and determining a target card layout of the application according to the message type, and filling the message data into the target card layout of the application to obtain a first card comprising display content associated with the incremental data.
Here, the message type is used to indicate the type of the message. Here, a message may be understood as a message to be presented on a display interface. Message types include, but are not limited to: text messages, icon messages.
Here, the message data is used to indicate specific content data contained in the message. For example, the message data is: the vehicle travels 100 meters straight to the south. As another example, the message data includes: the compass icon points to the south.
In practice, one message type may correspond to one or more card layouts. The corresponding card layout may be different for the same message type of different applications.
The card layout is a layout frame of the card, the layout frame can be filled with data, and after the data is filled, the card is generated. Illustratively, different positions in the card layout are used for filling different types of data, specifically, a first position of the card layout is used for filling the first type of data, a second position of the card layout is used for filling the second type of data, and a third position of the card layout is used for filling the third type of data.
In practical applications, one application can correspond to a plurality of card layouts, and as for which card layout is selected to generate the first card, the selection or the designation can be performed. For example, the card layout is divided into a cartoon version, a common version and a simplified version, and if the simplified version is selected, incremental data is filled in the card layout of the simplified version to generate a target card of the simplified version; and if the cartoon edition is selected, filling the incremental data into the card layout of the cartoon edition to generate a target card of the cartoon edition. The above is merely an exemplary illustration and is not intended as a limitation on all possible types of card layouts, which are not exhaustive herein.
Here, for a processing mode in which the controller, for example, the first control application, is responsible for uniformly acquiring the target card layouts corresponding to the multiple applications and generating the first cards for the multiple applications, the respective target card layouts are determined by the applications, and the first cards are generated based on the target card layouts.
Therefore, the first card can be generated quickly based on the incremental data, and the efficiency of updating the display content of the wearable device according to the display incremental data is improved.
In some embodiments, determining a target card layout for an application based on a message type includes at least one of:
determining an original card layout of the first card as a target card layout of the first card under the condition that the message type is not changed, wherein the original card layout is a card layout adopted by the first card before the incremental data is received;
in the case where the message type is changed, a card layout matching the message type is determined as a target card layout of the first card.
Here, the original card layout is a card layout adopted by the application on the wearable device when the wearable device receives data sent by the second card applied on the terminal.
Here, the target card layout is a card layout to be adopted by the application on the wearable device after the wearable device receives data sent by the second card applied on the terminal.
Therefore, the target card layout is determined according to the message type included by the incremental data, the finally presented display content can be adapted to the message type included by the incremental data, and the display effect is improved.
The method comprises the steps that at the first moment when synchronous registration connection is completed between an application on a terminal and an application on wearable equipment, an original card applied on the wearable equipment is a default card; and at a second moment after synchronous registration connection between the application on the terminal and the application on the wearable device is completed, if the wearable device receives the incremental data at the second moment, the card at the first moment is used as an original card, and the card at the first moment is updated on the basis of the card at the first moment by combining the incremental data received at the second moment to obtain the first card, wherein the first moment is earlier than the second moment. And at a third moment after synchronous registration connection between the application on the terminal and the application on the wearable device is completed, if the wearable device receives the incremental data at the third moment, updating the card generated based on the incremental data received at the second moment by combining the incremental data received at the third moment on the basis of the card generated based on the incremental data received at the second moment to obtain the first card, wherein the second moment is earlier than the third moment.
Here, compared to a processing manner in which a controller, such as the first control application, is responsible for acquiring original cards corresponding to the multiple applications respectively and then determining the first cards of the multiple applications based on the original cards corresponding to the multiple applications respectively, the first cards of the multiple applications are determined by the applications according to the respective incremental data, so that the first cards of the applications can be determined in time, the wearable device is facilitated to complete card updating of the applications quickly, and updating efficiency is improved.
Therefore, the first card can be obtained on the basis of the applied original card based on incremental data updating, the switching speed of the first card is favorably improved, and the display effect of the wearable device in scenes such as high-frame-rate image display, in-application animation display and the like is favorably improved.
In some embodiments, populating the message data into a target card layout of the application, resulting in a first card including display content associated with the delta data, includes: determining a first element included in the message data in the case that the content of a parameter included in the message data changes; determining the parameter name of a first element on the target card layout; replacing the first content of the parameter name of the target card layout with the second content of the parameter name included in the message data; and packaging the target card layout and the data filled in the target card layout to obtain a first card comprising display content associated with the incremental data.
Here, the first element is an object included in the message data, which is an object displayed on the card.
Illustratively, the message data includes: when the air temperature value is changed from 20 ℃ to 25 ℃, the first element is the air temperature, the parameter name of the first element on the target card layout is the temperature, and the first content 20 ℃ of the parameter name of the target card layout is replaced by the second content 25 ℃ included in the message data.
As yet another example, the message data includes: when the position is changed from the hail area to the sunny area, the first element is the "position", the parameter name of the first element on the target card layout is "Location", and the first content "hail area" with the parameter name of the target card layout being "Location" is replaced with the second content "sunny area" included in the message data.
Therefore, the first card can be generated quickly based on the incremental data, and the efficiency of updating the display content of the wearable device according to the incremental data is improved.
In some embodiments, populating the message data into a target card layout of the application, resulting in a first card including display content associated with the delta data, includes: in the case that the message data includes a display instruction, determining a second element indicated by the display instruction; determining a code position of a second element in the target card layout; and filling control data indicated by the display instruction into the code position in the target card layout to obtain a first card comprising the display content associated with the incremental data.
Here, the display instruction is an instruction for controlling a display mode or a display style. For example, the display instruction includes highlight display, animation display, and the like.
Here, the second element is an object included in the display instruction, which is an object displayed on the card.
Illustratively, the message data includes: and highlighting the route, wherein the second element is a display mode, searching a code position of the display mode on the target card layout, and writing a calling code or function corresponding to highlighting in the code position.
As yet another example, the message data includes: and adopting the camouflage lamp identification characters, wherein the second element is an identification mode, searching a code position of the identification mode on the target card layout, and writing a calling code or function corresponding to the camouflage lamp in the code position.
So, can be based on the first card of increment data generation fast, help promoting the wearing equipment and update the efficiency of display content according to increment data.
In some implementations, an application on the wearable device can transmit a first card to a controller on the wearable device, such as a first control application, via a mechanism that updates a view across processes, such as Remote Views (Remote Views).
It is understood that the manner of transmitting the target card to the controller by the application is not limited to updating the view across processes, and may also be transmitted by Inter-Process Communication (IPC) or the like.
So, through the interaction between wearing equipment's application and the controller, the controller of being convenient for acquires first card fast, and the display content that the controller of also being convenient for updated application based on this first card fast to help promoting the wearing equipment and carry out the speed that shows to the data that the second card that uses was sent on the terminal.
In some embodiments, the data transmission between the terminal and the wearable device is based on a wireless communication protocol. The wireless communication may specifically include at least one of: WIFI communication, cellular communication (or referred to as mobile communication), bluetooth communication, and the like.
In a preferred example, the data transmission between the terminal and the wearable device, such as the data of the second card of the application, is based on bluetooth protocol transmission.
In this way, hardware requirements on the wearable device are reduced. Wearable equipment need not to have the WIFI module, perhaps can close the WIFI module of wearable equipment in order to save the consumption, adopts data transmission and user interface to show the scheme of phase separation, can realize being in under the scene that the bluetooth is connected at wearable equipment and terminal, with the demonstration change of using on the terminal in the real-time effect that demonstrates of wearable equipment side.
The embodiment of the application provides a display control method, which can be applied to a terminal, wherein the terminal comprises but is not limited to a mobile phone, a tablet computer and the like, and wearing equipment related to the embodiment comprises but is not limited to a smart bracelet, a smart watch, smart glasses, a smart helmet and the like. Among them, the smart glasses are not limited to AR glasses. As shown in fig. 2, the method includes:
s201: acquiring data of a second card of the application;
s202: the data are sent to the wearable device, the wearable device determines incremental data of the first card based on the data, and the first card is controlled to display content corresponding to the incremental data.
In an embodiment of the application, the second card is an image displayed on a user interface of the terminal application.
In an embodiment of the application, the first card is an image displayed on a user interface of the wearable device application.
In an embodiment of the present application, the data of the second card includes at least one of the following data: display content change data and control command change data.
The change data of the display content may include change data of the content that needs to be displayed at this time relative to the content that is displayed last time. Illustratively, the change data of the display content includes change data of the display information. As another example, the change data of the display content includes change data of the display interface.
The change data of the control command may include change data of the control command to be executed at this time relative to the control command executed last time. Illustratively, the change data of the control command includes change data of a volume control command. As another example, the variation data of the control command includes variation data of the luminance control command.
According to the technical scheme, user interface pictures are transmitted to the wearable device relative to the terminal, the wearable device displays the display control mode of the user interface pictures, the scheme that data transmission and the user interface display are separated is adopted, data of the second card are transmitted to the wearable device, the data volume which needs to be transmitted is reduced, the wearable device can timely acquire incremental data of application of the terminal, refreshing is completed in real time according to the incremental data, the incremental data are displayed at the wearable device end in a card mode, and the real-time display effect of the wearable device is improved. In addition, the data volume required to be transmitted is reduced, so that the requirement on transmission capacity between the wearing equipment and the terminal is reduced, the hardware requirement on the wearing equipment is also reduced, and the power consumption of the wearing equipment due to communication with the terminal can be saved.
In some embodiments, obtaining data for the second card comprises: receiving incremental data sent by the application through a second control application of the terminal; correspondingly, send the data of second card to wearing equipment, include: and sending the data of the second card to the first control application of the wearable device through the second control application.
Here, the second control application may be configured to acquire data of the second card from the application and transmit the data of the second card into the wearable device. For example, the second control application is a control application of the wearable device on the terminal, and it should be understood that the control application having the above functions may be used as the second control application. Taking the wearable device as the AR glasses as an example, the AR glasses control application may serve as the second control application. Taking the wearable device as an intelligent bracelet as an example, the bracelet control application can be used as a second control application.
It should be understood that the number of applications on the terminal can be one or more, and likewise, the number of applications on the wearable device can also be one or more. In a preferred example, the applications on the terminal and the applications on the wearable device have a one-to-one correspondence relationship.
Taking the number of the applications as an example, in an example, the data of the second card corresponding to each of the plurality of applications may be sent to the wearable device through a second control application of the terminal based on a wireless communication protocol, for example, a bluetooth protocol. Then, the controller of the wearable device, such as the first control application, may distribute the data of the second card corresponding to each of the plurality of applications to the corresponding plurality of applications of the wearable device.
Wherein, with the data of the second card that a plurality of applications correspond respectively, send a plurality of applications of wearing equipment's correspondence, specifically can refer to: sending data of a second card of an ith application in the multiple applications to an ith application in the multiple corresponding applications of the wearable device; the ith application on the wearable device has at least partial functions of the ith application on the terminal; i is an integer greater than or equal to 1. It should be understood that, here, only any one of the multiple applications (i.e., the ith application) is taken as an example for description, and in the actual processing, since the processing procedures for the respective applications are the same and can be performed simultaneously, the description is not repeated here.
For example, the plurality of applications of the terminal include application a, application B, and application C, and the plurality of applications of the wearable device include application a, application B, and application C. After receiving the data of the second cards corresponding to the application A, the application B and the application C, the second control application of the terminal transmits the data of the second card of the application A, the data of the second card of the application B and the data of the second card of the application C to a controller of the wearable device, such as the first control application. After the controller of the wearable device receives the data of the second cards of the application A, the application B and the application C of the terminal as the first control application, the data of the second card of the application A is distributed to the application A of the wearable device, the data of the second card of the application B is distributed to the application B of the wearable device, and the data of the second card of the application C is distributed to the application C of the wearable device.
Therefore, the data of the second card of the application is received and sent through the second control application, the application is not required to be in direct communication with the wearable device, and the data related to the display change of the application can be sent to the wearable device.
Furthermore, under the condition that the number of the applications is multiple, the display of the applications is controlled through the second control application, so that the applications can be managed uniformly, and the occupation of memory resources of the terminal can be saved compared with the situation that a plug-in with the second control application function is embedded in each application.
In some embodiments, the display control method may further include: the data of the second card is identified through a second control application of the terminal, and the identified data of the second card is obtained; correspondingly, send the data of second card to wearing equipment, include: and sending the data of the identified second card to the wearable device. Illustratively, the identification process includes adding preset characters, where different applications correspond to different preset characters, for example, the preset character of the 1 st application is 001, and the preset character of the 2 nd application is 002, then the identification process includes: adding a preset character 001 to the head of the data of the second card from the 1 st application; at the head of the data from the second card of the 2 nd application, a preset character 002 is added; in this way, it is convenient for the wearing device to distinguish from which application the data of the current second card comes. As another example, the identification process includes adding a protocol specification type, where different applications correspond to different protocol specification types, for example, the protocol specification type of the 1 st application is type 1, and the preset character of the 2 nd application is type 002, then the identification process includes: adding information of which the protocol designation type is type 1 to data from a second card of the 1 st application; for data from the second card of the 2 nd application, information that the protocol specifies a type as type 2 is added. It will be appreciated that, to further reduce the amount of data, the data of the identified second card may also be compressed.
In this way, by identifying the data of the second card from the different application, the wearable device is helped to quickly identify the data of the second card from the different application, so that the speed of updating the display content based on the data exhibition of the second card by the wearable device is helped to be increased.
In some embodiments, the synchronization registration instruction is sent to the first control application of the wearable device prior to obtaining data of the second card of the application. The display control method may further include: receiving a synchronous registration instruction sent by an application through a second control application of the terminal; and sending a synchronous registration instruction to a first control application of the wearable device through a second control application.
Therefore, synchronous registration with the terminal is completed in advance by the wearable device, basic support can be provided for data updating display content of the second card of the application of the terminal of the follow-up wearable device, due to the fact that synchronous connection is established in advance, after the data of the second card are transmitted into the wearable device, the wearable device can rapidly display related content, and the real-time display requirement of the wearable device is met.
In some embodiments, the data of the second card is transmitted between the terminal and the wearable device based on a wireless communication protocol. The wireless communication may specifically include at least one of: WIFI communication, cellular communication (or referred to as mobile communication), bluetooth communication, and so on.
In a preferred example, the data of the second card is transmitted between the terminal and the wearable device based on a bluetooth protocol.
Therefore, the hardware requirement on the wearing equipment is lowered, the wearing equipment does not need to be provided with a WIFI module, or the WIFI module of the wearing equipment can be closed so as to save power consumption, a scheme of separating data transmission and user interface display can be adopted, the application data of the terminal can be refreshed in real time on the side of the wearing equipment under the condition that the wearing equipment and the terminal are connected through Bluetooth, and the effect of displaying the application data of the terminal on the side of the wearing equipment in real time is achieved.
The embodiment of the application provides a display control method, which is applied to a display control system composed of a terminal and wearable equipment, wherein the terminal comprises but is not limited to a mobile phone, a tablet computer and the like, and the wearable equipment comprises but is not limited to intelligent glasses such as AR glasses. As shown in fig. 3, the method includes:
s301: the terminal acquires data of a second card of the application;
s302: the terminal sends data of the second card of the application to the wearable device;
s303: the wearable device obtains the incremental data of the first card based on the data of the second card, and updates the display content of the first card based on the incremental data.
How the terminal specifically obtains the data of the second card applied, how the wearable device specifically obtains the incremental data of the first card applied to the wearable device based on the data of the second card, and how the wearable device specifically updates the display content of the first card based on the incremental data can refer to the description of the display control method applied to the wearable device and the terminal, and are not repeated here.
Taking a wearable device as an example of smart glasses, fig. 4 shows a schematic diagram of a communication architecture between the smart glasses and a terminal, as shown in fig. 4, the terminal includes an application (e.g., application a) and a first control application (e.g., glasses control application), the smart glasses include an application (e.g., application a) and a second control application (e.g., Launcher application), and the glasses control application of the terminal and the Launcher application of the smart glasses transmit data through a bluetooth protocol. Specifically, the application a communicates with an Operating System (OS) in the glasses control application through a built-in glasses Software Development Kit (SDK), and the glasses OS is responsible for registration, logout, lifecycle management, and message distribution of the glasses-side application. For example, the application a sends a registration instruction, a logout instruction, a synchronization instruction, change data, and the like to the glasses OS, and the glasses OS completes registration, logout, synchronization, and the like of the application a at the glasses side. The Launcher application of the smart glasses receives display change related data such as display content change data and control instruction change data sent by a glasses control application of a terminal, and is responsible for sending the display change related data of the application A to the application A of the smart glasses, the application A of the smart glasses obtains a target card based on the display change related data by using a built-in glasses SDK, and informs the Launcher application of the smart glasses in a Remote Views manner, so that the Launcher application informs a glasses OS to update an original card of the application A to the target card.
It should be understood that the communication architecture diagram shown in fig. 4 is merely illustrative, and those skilled in the art may make various obvious changes and/or substitutions based on the example of fig. 4, and the obtained technical solution still belongs to the disclosure scope of the embodiments of the present application.
Next, taking the wearable device as AR glasses, the first control application as Launcher application, the terminal as a mobile phone, the second control application as glasses control application, and the application as application a as an example, an exemplary specific embodiment is given, as shown in fig. 5, the display control process includes:
s501: the mobile phone terminal application A is started, and when the function of projecting the screen to the AR glasses is used, the application A is registered to the mobile phone terminal glasses control application;
s502: after receiving the registration message of the application A, the mobile phone end glasses control application sends an application A registration instruction to the AR glasses end Launcher application through a Bluetooth protocol;
s503: the AR glasses end Launcher application analyzes the related instruction, recognizes that the application A has an independent UI function APK at the AR glasses end, and invokes the registration service of the AR glasses end application A;
s504: the AR glasses end application A binds the glasses operating system service of the AR glasses end, and informs the AR glasses end Launcher application to update the display content of the application A to be a default card in a Remote Views mode;
s505: the data source of the mobile phone terminal application A changes in real time, and data are continuously synchronized to the mobile phone terminal glasses control application through the glasses SDK built in the application A;
s506: after receiving the data, the mobile phone end glasses control application synchronously applies the data to the AR glasses end Launcher through a Bluetooth protocol;
s507: the AR glasses end Launcher application synchronizes data to the AR glasses end application A, the application A reassembles the UI to generate a first card, and the Launcher application updates the card in a Remote Views manner;
s508: the display content of the AR glasses end application A is updated to be the first card by the AR glasses end Launcher application.
The data in S506 includes, but is not limited to, data such as change data of display content, change data of control command, and in-application animation command.
It should be noted that the AR glasses end may only synchronize the relevant prompt information of the application a of the mobile phone end, the AR glasses end may also only synchronize the relevant display frame of the application a of the mobile phone end, and may also synchronize all display contents (including the relevant display frame and the relevant prompt information) of the application a of the mobile phone end.
Therefore, the application content of the mobile phone end can be synchronously displayed at the glasses end in a card mode in a Bluetooth connection mode, the problem that the application content of the mobile phone and the glasses end needs to be synchronized in real time and displayed at the glasses end in a scene only connected by Bluetooth is solved, the application content can be updated in real time, and high frame rate scenes such as animation in application can be supported.
Taking application a as an example of a weather application, fig. 6 shows a schematic diagram of displaying a weather card on an AR glasses end, as shown in fig. 6, weather-related information on the card includes: haze, lowest temperature of-5 ℃, highest temperature of 5 ℃, current temperature of 1 ℃, body sensing temperature of-3 ℃, severe pollution of air quality, and gold water region information of a user. When the mobile phone end detects that the weather information changes, the AR glasses end sends out related prompt information. For example, when the mobile phone end detects that the body sensing temperature is changed to 0 ℃, the body sensing temperature information in the weather card of the AR glasses end is changed from-3 ℃ to 0 ℃. For another example, when the mobile phone end detects that the air quality is converted into light pollution, the air quality in the weather card of the AR glasses end is updated from "heavy pollution" to "light pollution", so that the weather card of the AR glasses end changes according to the change of the prompt information of the weather application of the mobile phone end, and can be synchronized with the related information of the weather detected by the mobile phone end.
Taking application a as an example of navigation application, fig. 7 shows a schematic diagram of displaying a navigation card at an AR glasses end, as shown in fig. 7, a riding icon, riding indication information "start west along a road" and a compass icon are displayed on the navigation card, the mobile phone end navigation application sends detected current geomagnetic information of a user to the AR glasses end, and the compass icon in the navigation card at the AR glasses end changes along with the change of the geomagnetic information, that is, the compass icon moves along with the change of the current position of the user, so as to meet an animation scene in the application. Therefore, the navigation card at the AR glasses end changes according to the change of the display picture information of the navigation application at the mobile phone end, and can be synchronous with the related information of the geomagnetic information detected by the mobile phone end.
Taking application a as a car-shooting application as an example, fig. 8 shows a schematic diagram of displaying car-shooting cards at an AR glasses end, as shown in fig. 8, destination, distance and car-shooting icons are displayed on the car-shooting cards, the car-shooting application at a mobile phone end sends detected car-shooting information of a user to the AR glasses end, after the user determines a destination at the mobile phone end, the car-shooting application at the mobile phone end informs the AR glasses end of performing camouflage lamp decoration on the destination, and in the car-shooting cards at the AR glasses end, the user is reminded of the currently determined destination information in a striking reminding manner of camouflage lamps around the destination, so that an animation scene in the application is satisfied. Therefore, the car playing card at the AR glasses end prompts the destination according to the control instruction of the car playing application at the mobile phone end.
It should be understood that the cards shown in fig. 6-8 are exemplary only, and are not intended as limitations on the types of cards, but are not exhaustive.
As an implementation of the foregoing methods, an embodiment of the present application further provides a display control device, which is applied to a wearable device, where the wearable device includes a controller, an application, and a first card of the application, the wearable device is connected to a terminal, and the terminal runs a second card of the application and the application. Fig. 9 shows a schematic diagram of a display control apparatus, which, as shown in fig. 9, includes: an identifying unit 910, configured to identify, by the controller, that the data includes incremental data of the first card in response to the data sent by the second card; and the control unit 920 is configured to control, through the controller, the display content corresponding to the incremental data displayed on the first card.
In some embodiments, the control unit 920 is further configured to: before the controller controls the first card to display the display content corresponding to the incremental data, the controller sends the incremental data to the application of the wearable device; the notification application reassembles the display content of the first card according to the incremental data and sends the display content to the controller.
In some embodiments, the control unit 920 is further configured to: after the controller recognizes that the data comprises incremental data of the first card, querying a User Interface (UI) service associated with the application through the controller, and triggering the application when the UI service is queried to exist.
In some embodiments, the control unit 920 sends the incremental data to the application of the wearable device through the controller, including at least one of:
awakening the application in the dormant state by using the controller, and sending the incremental data to the application; alternatively, the first and second liquid crystal display panels may be,
and calling the application in the running state by using the controller, and sending the incremental data to the application.
In some embodiments, the display control apparatus further comprises:
a registration unit 930 (not shown in the figure) for receiving, with the controller, a synchronous registration instruction transmitted by the terminal before the identification unit 910 responds to the data transmitted by the second card; under the condition that the controller inquires that the UI service installation package corresponding to the synchronous registration instruction exists in the application, sending a notification message to the application to notify the application to be bound with an operating system of the controller;
a binding unit 940 (not shown in the figure) for executing the UI service associated with the application through the operating system by the controller in response to the binding of the application with the operating system of the controller.
In some embodiments, the control unit 920 includes: the first determining subunit is used for determining the message type and the message data according to the incremental data; the second determining subunit is used for determining the target card layout of the application according to the message type; and the control subunit is used for filling the message data into the target card layout of the application to obtain a first card comprising the display content associated with the incremental data.
In some embodiments, the second determining subunit determines the target card layout of the application according to the message type, including at least one of:
determining an original card layout of the first card as a target card layout of the first card under the condition that the message type is not changed, wherein the original card layout is a card layout adopted by the first card before the incremental data is received;
in the case where the message type is changed, a card layout matching the message type is determined as a target card layout of the first card.
In some embodiments, the control subunit is configured to determine, in a case where a content of a parameter included in the message data changes, a first element included in the message data; determining the parameter name of the first element on the target card layout; replacing the first content of the parameter name of the target card layout with the second content of the parameter name included in the message data; and packaging the target card layout and the data filled in the target card layout to obtain a first card comprising display content associated with the incremental data.
In some embodiments, the control subunit is further configured to: in the case that the message data includes a display instruction, determining a second element indicated by the display instruction; determining a code position of a second element in the target card layout; and filling control data indicated by the display instruction into the code position in the target card layout to obtain a first card comprising the display content associated with the incremental data.
It should be understood by those skilled in the art that the functions of the processing modules in the display control apparatus according to the embodiment of the present application can be understood by referring to the description related to the display control method applied to the wearable device, and the processing modules in the display control apparatus according to the embodiment of the present application can be implemented by analog circuits that implement the functions described in the embodiment of the present application, or by running software that executes the functions described in the embodiment of the present application on an electronic device.
The display control device of the embodiment can acquire the data sent by the second card in time and complete the display refreshing operation of the first card according to the determined incremental data, so that the speed of updating the application content is increased, and the scene requirement of real-time display is better met.
As an implementation of the foregoing methods, an embodiment of the present application further provides a display control apparatus, which is applied to a terminal. Fig. 10 shows a schematic diagram of a display control apparatus, as shown in fig. 10, the apparatus comprising: an acquisition unit 1010 for acquiring data of a second card of the application; the sending unit 1020 is configured to send the data to the wearable device, determine, by the wearable device, incremental data of the first card based on the data, and control the first card to display content corresponding to the incremental data.
In some embodiments, the obtaining unit 1010 is configured to receive, through a second control application of the terminal, data of a second card sent by the application; the sending unit 1020 is configured to send data of the second card to the first control application of the wearable device through the second control application.
In some embodiments, the display control apparatus further comprises: an identifying unit 1030 (not shown in the figure) configured to perform an identifying process on the data of the second card through a second control application of the terminal, so as to obtain identified data of the second card. Correspondingly, the sending unit 1020 is further configured to send the identified data of the second card to the wearable device.
In some embodiments, the display control apparatus further comprises: a receiving unit 1040 (not shown in the figure) configured to receive, by a second control application of the terminal, a synchronization registration instruction sent by the application; a synchronization processing unit 1050 (not shown in the figure) for sending a synchronization registration instruction to a controller of the wearable device, such as the first control application, through the second control application.
In some embodiments, the data of the second card includes at least one of:
displaying change data of the content;
change data of the control command.
In some embodiments, the terminal transmits the data of the second card to the wearable device based on a bluetooth protocol.
It should be understood by those skilled in the art that the functions of the processing modules in the display control apparatus according to the embodiment of the present application can be understood by referring to the description related to the display control method applied to the terminal, and the processing modules in the display control apparatus according to the embodiment of the present application can be implemented by analog circuits that implement the functions described in the embodiment of the present application, or by running software that executes the functions described in the embodiment of the present application on an electronic device.
The display control device of the embodiment of the application can transmit the data sent by the second card to the wearable device quickly, the wearable device can acquire the data sent by the second card in time, and the display refreshing operation of the first card is completed according to the determined incremental data, so that the speed of updating the application content is improved, and the scene requirement of real-time display is favorably met.
An embodiment of the present application further provides a display control system, including: a terminal, comprising: the display control device applied to the terminal is adopted; wearing equipment includes: the display control device applied to the wearable device is adopted.
In some embodiments, the wearable device is smart glasses.
According to the display control system, the terminal sends the relevant data of the display change of the application to the wearable device, the wearable device finishes refreshing in real time according to the relevant data of the display change, the relevant data of the display change is displayed at the wearable device end in a card mode, and the real-time display effect of the prompt information applied to the terminal on the wearable device is improved. In addition, the hardware requirement on the wearable device is reduced, the wearable device does not need to be provided with a WIFI module, or the WIFI module of the wearable device can be closed to save power consumption.
Embodiments of the present application also provide a wearable device comprising a processor, a memory, a bluetooth module, a display, and one or more programs stored in the memory and configured to be executed by the processor, the programs including instructions for performing steps in a display control method applied to a wearable device.
Embodiments of the present application also provide a terminal comprising a processor, a memory, a bluetooth module, a display, and one or more programs stored in the memory and configured to be executed by the processor, the programs including instructions for performing steps in a display control method applied to the terminal.
Fig. 11 shows a block diagram of an electronic device according to an exemplary embodiment of the present application. Which can be implemented as the terminal device in the above embodiments, the electronic device in this application may include one or more of the following components: a processor 1110 and a memory 1120.
Processor 1110 may include one or more processing cores. The processor 1110 interfaces with various parts throughout the electronic device using various interfaces and lines, performs various functions of the electronic device and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 1120, and calling data stored in the memory 1120. Alternatively, the processor 1110 may be implemented in hardware using at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 1010 may integrate one or a combination of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a Neural-Network Processing Unit (NPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing contents required to be displayed by the touch display screen; the NPU is used for realizing an Artificial Intelligence (AI) function; the modem is used to handle wireless communications. It is to be understood that the modem may not be integrated into the processor 1110, but may be implemented by a single chip.
The Memory 1120 may include a Random Access Memory (RAM) or a Read-Only Memory (ROM). Optionally, the memory 1120 includes a non-transitory computer-readable medium. The memory 1120 may be used to store instructions, programs, code, sets of codes, or sets of instructions. The memory 1120 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing the various method embodiments described above, and the like; the storage data area may store data (such as audio data, a phonebook) created according to the use of the electronic device, and the like.
The electronic device in the embodiment of the present application further includes a camera assembly 1130, where the camera assembly 1130 is used for acquiring an environment image. In one possible implementation, when the electronic device is a terminal, the camera component 1130 may be a front camera or a rear camera of the terminal; in another possible implementation, when the electronic device is an HMD, the camera assembly 1130 may be a camera disposed in front of the HMD.
In addition, the electronic device may further include a display component 1140, and the display component 1140 may include a display screen for displaying pictures and may also include a projection device (such as a projector on smart glasses) for projecting images.
In addition, those skilled in the art will appreciate that the configurations of the electronic devices illustrated in the above-described figures do not constitute limitations on the electronic devices, which may include more or fewer components than illustrated, or some components may be combined, or a different arrangement of components. For example, the electronic device further includes a radio frequency circuit, an input unit, a sensor, an audio circuit, a speaker, a microphone, a power supply, and other components, which are not described herein again.
The embodiment of the present application further provides a computer-readable storage medium, where at least one instruction is stored, and the at least one instruction is used for being executed by a processor to implement the display control method according to the embodiment.
Embodiments of the present application provide a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and executes the computer instructions, so that the computer device executes the display control method provided by the above-mentioned embodiment.
Those skilled in the art will recognize that, in one or more of the examples described above, the functions described in the embodiments of the present application may be implemented in hardware, software, firmware, or any combination thereof. When implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.
The above description is only exemplary of the present application and should not be taken as limiting, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims (21)

1. A display control method is applied to wearable equipment, and is characterized in that the wearable equipment comprises a controller, an application and a first card of the application, the wearable equipment is connected with a terminal, the terminal runs the application and a second card of the application, and the method comprises the following steps:
in response to the data sent by the second card, the controller recognizes that the data includes incremental data for the first card;
and controlling the first card to display the display content corresponding to the incremental data through the controller.
2. The display control method according to claim 1, wherein before the first card is controlled by the controller to display the display content corresponding to the incremental data, the method includes:
the controller sends incremental data to an application of the wearable device;
according to the incremental data, the application reorganizes the display content of the first card;
the application sends the display content to the controller.
3. The display control method of claim 2, wherein after the controller recognizes that the data includes incremental data for the first card, the method further comprises:
and the controller inquires a User Interface (UI) service associated with the application, and triggers the application when the UI service is inquired to exist.
4. The method of claim 3, wherein the controller sending incremental data to the application of the wearable device comprises at least one of:
the controller wakes up the application in a dormant state and sends the incremental data to the application; alternatively, the first and second electrodes may be,
and the controller calls the application in the running state and sends the incremental data to the application.
5. The method of any of claims 2 to 4, wherein said applying reorganizes said display of said first card according to said delta data, comprising:
determining the message type and the message data according to the incremental data;
determining a target card layout of the application according to the message type, and filling the message data into the target card layout of the application to obtain a first card including display content associated with the incremental data.
6. The method of claim 5, wherein determining the target card layout for the application based on the message type comprises at least one of:
determining an original card layout of the first card as a target card layout of the first card when the message type is not changed, wherein the original card layout is a card layout adopted by the first card before the incremental data is received;
and under the condition that the message type is changed, determining a card layout matched with the message type as a target card layout of the first card.
7. The method of claim 5, wherein the populating the message data into a target card layout of the application resulting in a first card including display content associated with the delta data comprises:
determining a first element included in the message data when the content of a parameter included in the message data changes;
determining a parameter name of the first element on the target card layout;
replacing first content of the parameter name of the target card layout with second content of the parameter name included in the message data;
and packaging the target card layout and the data filled in the target card layout to obtain a first card comprising display content associated with the incremental data.
8. The method of claim 5, wherein the populating the message data into a target card layout of the application resulting in a first card including display content associated with the delta data comprises:
if the message data comprises a display instruction, determining a second element indicated by the display instruction;
determining a code position of the second element in the target card layout;
and filling control data indicated by the display instruction into the code position in the target card layout to obtain a first card comprising display content associated with the incremental data.
9. The method of any of claims 1 to 8, wherein prior to the data sent in response to the second card, the method further comprises:
the controller receives a synchronous registration instruction sent by the terminal;
the controller sends a notification message to the application when inquiring that a UI service installation package corresponding to the synchronous registration instruction exists in the application, so as to notify the application to be bound with an operating system of the controller;
in response to the binding of the application to an operating system of the controller, the controller executes a UI service associated with the application through the operating system.
10. The utility model provides a display control device, is applied to wearing equipment, its characterized in that, wearing equipment includes the controller, uses and the first card of using, wearing equipment is connected with the terminal, the terminal operation have use and the second card of using, the device includes:
the identification unit is used for responding to the data sent by the second card, and the data comprises the incremental data of the first card through the controller;
and the control unit is used for controlling the first card to display the display content corresponding to the incremental data through the controller.
11. The display control apparatus according to claim 10, wherein the control unit is further configured to:
before the controller controls the first card to display the display content corresponding to the incremental data, the controller sends the incremental data to an application of the wearable device;
notifying the application to reassemble the display content of the first card according to the incremental data, and sending the display content to the controller.
12. The display control device according to claim 11, wherein the control unit is further configured to query, through the controller, a user interface UI service associated with the application after the controller recognizes that the data includes the incremental data of the first card, and trigger the application when the presence of the UI service is queried.
13. The apparatus of claim 12, wherein the control unit sends the incremental data to the application of the wearable device via the controller, including at least one of:
waking up the application in a dormant state by using the controller, and sending the incremental data to the application; alternatively, the first and second electrodes may be,
and calling the application in the running state by using the controller, and sending the incremental data to the application.
14. The apparatus according to any one of claims 11 to 13, wherein the control unit comprises:
the first determining subunit is used for determining the message type and the message data according to the incremental data;
the second determining subunit is used for determining the target card layout of the application according to the message type;
and the control subunit is used for filling the message data into the target card layout of the application to obtain a first card comprising the display content related to the incremental data.
15. The apparatus according to claim 14, wherein the second determining subunit determines a target card layout of the application according to the message type, including at least one of:
determining an original card layout of the first card as a target card layout of the first card when the message type is not changed, wherein the original card layout is a card layout adopted by the first card before the incremental data is received;
and under the condition that the message type is changed, determining a card layout matched with the message type as a target card layout of the first card.
16. The apparatus of claim 14, wherein the control subunit is configured to:
determining a first element included in the message data when the content of a parameter included in the message data changes;
determining a parameter name of the first element on the target card layout;
replacing first content of the parameter name of the target card layout with second content of the parameter name included in the message data;
and packaging the target card layout and the data filled in the target card layout to obtain a first card comprising display content related to the incremental data.
17. The apparatus of claim 14, wherein the control subunit is further configured to:
if the message data comprises a display instruction, determining a second element indicated by the display instruction;
determining a code position of the second element in the target card layout;
and filling control data indicated by the display instruction into the code position in the target card layout to obtain a first card comprising display content associated with the incremental data.
18. The apparatus of any one of claims 10 to 17, further comprising:
the registration unit is used for receiving a synchronous registration instruction sent by the terminal by using the controller before the identification unit responds to the data sent by the second card; sending a notification message to the application to notify the application to be bound with an operating system of the controller when the controller inquires that a UI service installation package corresponding to the synchronous registration instruction exists in the application;
a binding unit to respond to binding of the application with an operating system of the controller, the controller to execute a UI service associated with the application through the operating system.
19. A wearable device comprising a processor, a memory, a bluetooth module, a display, and one or more programs stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps in the method of any of claims 1-9.
20. A computer-readable storage medium, characterized in that the computer-readable storage medium is used to store a computer program which, when being executed by a processor, carries out the method according to any one of claims 1-9.
21. A computer program product, characterized in that the computer program product comprises computer instructions, the computer instructions being stored in a computer readable storage medium; a processor of a computer device reads the computer instructions from the computer-readable storage medium, the processor executing the computer instructions causing the computer device to perform the method of any of claims l-9.
CN202210565856.8A 2022-05-23 2022-05-23 Display control method and device, wearable device and storage medium Pending CN115016685A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210565856.8A CN115016685A (en) 2022-05-23 2022-05-23 Display control method and device, wearable device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210565856.8A CN115016685A (en) 2022-05-23 2022-05-23 Display control method and device, wearable device and storage medium

Publications (1)

Publication Number Publication Date
CN115016685A true CN115016685A (en) 2022-09-06

Family

ID=83068187

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210565856.8A Pending CN115016685A (en) 2022-05-23 2022-05-23 Display control method and device, wearable device and storage medium

Country Status (1)

Country Link
CN (1) CN115016685A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170193302A1 (en) * 2016-01-05 2017-07-06 Daqri, Llc Task management system and method using augmented reality devices
CN109067986A (en) * 2018-07-26 2018-12-21 努比亚技术有限公司 Synchronous display method, mobile terminal and the readable storage medium storing program for executing of intelligent wearable device
CN109445660A (en) * 2018-10-30 2019-03-08 努比亚技术有限公司 A kind of wearable device control method, mobile terminal and wearable device
CN110515580A (en) * 2019-09-02 2019-11-29 联想(北京)有限公司 A kind of display control method, device and terminal
CN113010257A (en) * 2021-03-30 2021-06-22 维沃移动通信有限公司 Electronic device, display control method, display control apparatus, and readable storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170193302A1 (en) * 2016-01-05 2017-07-06 Daqri, Llc Task management system and method using augmented reality devices
CN109067986A (en) * 2018-07-26 2018-12-21 努比亚技术有限公司 Synchronous display method, mobile terminal and the readable storage medium storing program for executing of intelligent wearable device
CN109445660A (en) * 2018-10-30 2019-03-08 努比亚技术有限公司 A kind of wearable device control method, mobile terminal and wearable device
CN110515580A (en) * 2019-09-02 2019-11-29 联想(北京)有限公司 A kind of display control method, device and terminal
CN113010257A (en) * 2021-03-30 2021-06-22 维沃移动通信有限公司 Electronic device, display control method, display control apparatus, and readable storage medium

Similar Documents

Publication Publication Date Title
CN107369197B (en) Picture processing method, device and equipment
WO2022052772A1 (en) Application interface display method under multi-window mirroring scenario, and electronic device
WO2018040945A1 (en) Data display and control method and device for tiled screens, system, and display apparatus
US20220398059A1 (en) Multi-window display method, electronic device, and system
EP4148567A1 (en) Adaptive card generation method, terminal device and server
WO2022083296A1 (en) Display method and electronic device
US20230229463A1 (en) Function execution method and apparatus
CN116052618B (en) Screen refresh rate switching method and electronic equipment
CN112612386B (en) Mobile terminal and display method of application card thereof
CN105224337A (en) A kind of desktop starter dynamically adds floating window method
WO2023001163A1 (en) Screen refreshing method and device capable of improving dynamic effect performance
CN112104985A (en) Electronic price tag reservation image brushing method, equipment and computer readable storage medium
CN113656118B (en) Off-screen display method and electronic equipment
KR102588235B1 (en) An electronic device and a controlling method thereof
CN111158617A (en) Screen-casting content synchronization method, mobile terminal and computer-readable storage medium
CN115016685A (en) Display control method and device, wearable device and storage medium
CN114706549A (en) Display method, intelligent terminal and storage medium
US20150007255A1 (en) Terminal and method for updating applications thereof
CN112954611A (en) Display control method, wearable device and storage medium
CN111586454A (en) Large screen splicing synchronization method and system
CN115658213B (en) Display method, electronic equipment and storage medium
WO2022206707A1 (en) Off-screen display method and electronic device
WO2023124227A1 (en) Frame rate switching method and device
CN116594543B (en) Display method, device and readable storage medium
WO2023103800A1 (en) Drawing method and electronic device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination