Disclosure of Invention
The embodiment of the invention provides a display control method and device of split AR glasses and the split AR glasses, and aims to solve the problems that the power consumption of the existing split AR glasses is large during working, and the electric quantity of a battery is easy to exhaust.
In order to solve the technical problem, the invention is realized as follows:
in a first aspect, the invention provides a display control method for split AR glasses, where the split AR glasses include a control terminal and an AR glasses body, the AR glasses body is provided with a display unit, the display unit includes a micro display and a microcontroller, the control terminal is provided with a processor, and the control terminal is in communication connection with the AR glasses body and provides a power supply for the AR glasses body;
the method comprises the following steps:
when the micro display is in a sleep mode, if the micro display receives an image signal sent by the processor, the micro display is controlled to enter a working mode, under the working mode, the micro display displays content data corresponding to the image signal, and under the sleep mode, the backlight of the micro display is closed;
when the micro-display is in a working mode, if the micro-controller detects that the image signal stops transmission, the micro-display is controlled to enter a sleep mode.
Optionally, the AR glasses body includes a camera, and the method further includes:
when the micro display enters a sleep mode, the micro controller controls the camera to keep a working mode and continuously collects image data;
the microcontroller acquires the image data and sends the image data to the processor; the processor performs recognition processing on the image data.
Optionally, the method further includes:
when the processor identifies a target object in the image data, the processor transmits an image signal to the display unit. Optionally, the target objects include a first type of target object and a second type of target object, and the method further includes:
when the target object is the first type of target object, the processor controls the control terminal to display content data, and if an instruction for performing AR display on the content data is received, an image signal corresponding to the content data is output to the AR glasses body;
and when the target object is the second type target object, controlling the processor to output the image signal to the AR glasses body.
Optionally, the first type of target object is an object whose similarity to a preset object is within a first threshold range, and the second type of target object is an object whose similarity to the preset object is within a second threshold range.
Optionally, the second threshold range is greater than α, and the first threshold range is from β to α, where α and β are percentages, and α > β;
the method further comprises the steps that the processor obtains a quality parameter corresponding to the image data, when the value of the quality parameter is higher than a preset threshold value, the value of alpha is set to be x, the value of beta is set to be y, when the value of the quality parameter is lower than the preset threshold value, the value of alpha is set to be m, and the value of beta is set to be n, wherein x is larger than m, and y is larger than n.
Optionally, the method further includes:
after the control terminal establishes communication connection and power connection with the AR glasses body, the microcontroller controls the micro display and the camera to execute initialization;
after initialization is finished, the microcontroller continuously judges whether the image signal is received, if the current judgment result is negative, the micro display is controlled to sleep, and if the current judgment result is positive, the micro display is determined to be awakened or not by combining the previous judgment result of the current judgment result.
In a second aspect, an embodiment of the present invention further provides a display control device for split AR glasses, where the display control device includes a microcontroller and a processor, the split AR glasses include a control terminal and an AR glasses body, the display unit is disposed on the AR glasses body, the processor is disposed on the control terminal, the control terminal is in communication connection with the AR glasses body and provides a power supply for the AR glasses body, the display unit includes a microdisplay and a microcontroller, the control terminal is disposed with the processor, and the microcontroller and the processor are configured to run computer instructions stored in a computer-readable storage medium to execute the display control method for the split AR glasses.
In a third aspect, an embodiment of the present invention further provides a pair of split AR glasses, including a control terminal and an AR glasses body, where the AR glasses body is provided with a display unit, the display unit includes a micro display and a microcontroller, the control terminal is provided with a processor, the control terminal is in communication connection with the AR glasses body and provides a power supply for the AR glasses body, and the microcontroller and the processor are configured to run a computer instruction stored in a computer-readable storage medium to execute the steps of the display control method for the split AR glasses.
In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, where computer instructions are stored on the computer-readable storage medium, and when executed by a processor, the computer instructions implement the steps of the display control method for split AR glasses.
In a fifth aspect, an embodiment of the present invention further provides a microcontroller, including: the display control method comprises a memory, at least one processor and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the computer program to realize the steps of the display control method of the split type AR glasses.
In the embodiment of the invention, the working state of a micro display of split AR glasses is controlled by detecting an image signal, when the micro display is in a sleep mode, if the micro display receives the image signal sent by the processor, the micro display is controlled to enter a working mode, in the working mode, the micro display displays content data corresponding to the image signal, and in the sleep mode, the backlight of the micro display is turned off; when the micro-display is in a working mode, if the micro-controller detects that the image signal stops transmission, the micro-display is controlled to enter a sleep mode. Thus, the split AR glasses can avoid unnecessary power loss on the micro display, so that the power consumption speed of the whole machine becomes slow. In addition, because the distance between the micro-display of the AR glasses and the human eyes is short, if the working state of the micro-display is kept under the condition that no content data needs to be output, the visual field of a user can be influenced, the eye hygiene of the user is not facilitated, and ophthalmic diseases are easily caused.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a flowchart of a display control method for split AR glasses according to an embodiment of the present invention, where the split AR glasses include a control terminal and an AR glasses body, the AR glasses body is provided with a display unit, the display unit includes a micro display and a micro controller, the control terminal is provided with a processor, and the control terminal is in communication connection with the AR glasses body and provides a power supply for the AR glasses body, as shown in fig. 1, the method includes the following steps:
step 101, when the micro-display is in a sleep mode, if the micro-display receives an image signal sent by the processor, the micro-display is controlled to enter a working mode, in the working mode, the micro-display displays content data corresponding to the image signal, and in the sleep mode, a backlight of the micro-display is turned off.
The microcontroller is mainly used for controlling display parameters and states of the microdisplay, and for example, the microcontroller may control the microdisplay to be turned on, turned off or turned off, or may adjust parameters such as backlight brightness and saturation of the microdisplay. Of course, the microcontroller may also control the operating states of other components, and the like, which is not limited. Further, the stopping of the data display may be stopping the display of the screen content data corresponding to the image signal, that is, the microdisplay does not display any screen content.
And 102, when the micro-display is in a working mode, if the micro-controller detects that the image signal stops transmission, controlling the micro-display to enter a sleep mode.
The above-mentioned detection that the transmission of the image signal is stopped may mean that no new image signal is received within a set time after the image signal is received.
In the embodiment of the invention, when the micro-display is in a sleep mode, if the micro-controller receives an image signal sent by the processor, the micro-display is controlled to enter a working mode, in the working mode, the micro-display displays content data corresponding to the image signal, and in the sleep mode, the backlight of the micro-display is turned off; when the micro-display is in a working mode, if the micro-controller detects that the image signal stops transmission, the micro-display is controlled to enter a sleep mode. In this way, the micro-display is controlled by the micro-controller to enter the working mode to display the content data only in the case of receiving the image signal sent by the processor, and the micro-display stops displaying the data in the case of stopping transmitting the image signal; therefore, the situation that the micro-display is always in a working state after initialization but only enters the working state to perform data display when content data need to be displayed is avoided, further the electricity waste of the split type AR glasses is effectively reduced, and the purpose of reducing power consumption is finally achieved.
Referring to fig. 2, fig. 2 is a flowchart of another display control method for split AR glasses according to an embodiment of the present invention. The control terminal may be a Mobile phone, a Tablet Personal Computer (Tablet Personal Computer), a Laptop Computer (Laptop Computer), a Personal Digital Assistant (PDA), a Mobile Internet Device (MID), a Wearable Device (Wearable Device), or the like.
As shown in fig. 2, fig. 2 is a flowchart of a display control method for split AR glasses according to an embodiment of the present invention, where the split AR glasses include a control terminal and an AR glasses body, the AR glasses body is provided with a display unit, the display unit includes a micro display and a micro controller, the control terminal is provided with a processor, the control terminal is in communication connection with the AR glasses body and provides a power supply for the AR glasses body, and the method includes the following steps:
step 201, when the micro display is in a sleep mode, if the micro controller receives an image signal sent by the processor, the micro display is controlled to enter a working mode, in the working mode, the micro display displays content data corresponding to the image signal, and in the sleep mode, a backlight of the micro display is turned off.
The related description of step 201 is already described in detail in step 101 of the first embodiment, and is not repeated here to avoid repetition.
Optionally, the content data at least includes content data corresponding to the target object. The content data may be any screen content data, may be set by a user, or may be generated by a server or a terminal device itself. In addition, the target object may be an object preset by the user through the split AR glasses or other terminal devices, or may also be an object preset by the server; here, the target object may be a living body or an inanimate object, which is not limited thereto. In this embodiment, the content data corresponding to the target object may be content data stored in association with the target object, and may include image, text, video data, and the like. Therefore, the method and the device are beneficial to the user to more effectively acquire the information wanted by the user.
Step 202, when the micro-display is in a working mode, if the micro-controller detects that the image signal stops transmitting, controlling the micro-display to enter a sleep mode.
The related description of step 202 is already described in detail in step 102 of the first embodiment, and is not repeated here to avoid repetition.
And 203, when the micro display enters a sleep mode, controlling the camera to keep a working mode by the micro controller, and continuously acquiring image data.
Step 204, the microcontroller acquires the image data and sends the image data to the processor; the processor performs recognition processing on the image data.
The processor may perform recognition processing on the image data in a background, so as to obtain a recognition result of whether the target object is recognized, that is, whether the target object is recognized or not is recognized; the target object may be a preset object of a user, and may be a living body or an inanimate object, which is not limited in this respect; the content data may refer to information content stored in association with the target object, which may include image, text, or video information, etc. In practical application, each target object can store a series of image, text and video information in an associated manner, and when the target object is identified, the content stored in the associated manner can be automatically called out.
To make this step clearer and more complete, reference may be made to the flow chart shown in fig. 3, where the following is a complete example: the method comprises the following steps that a user establishes communication connection and power connection between a mobile phone and an AR (augmented reality) glasses body, wherein the AR glasses body is provided with a camera, a micro display and a microcontroller and can also comprise other devices, and the method is not limited in the application; this intelligent glasses passes through the camera and gathers the image to AR glasses body is connected with the cell-phone, and the cell-phone switches to the dormant state from normal operating condition, and the microcontroller control camera of intelligent glasses lasts to gather image data and sends the treater on the cell-phone this moment, and the treater then can be at the background processing received image data, and whether the discernment has the target object in the image of follow receipt. Here, if the processor does not recognize the target object from the image, the mobile phone continues to be in the sleep state, at this time, the mobile phone does not output an image signal to the AR glasses body, the microcontroller of the AR glasses body does not receive the image signal, and the micro display is controlled to enter the sleep state, at this time, the micro display of the AR glasses body does not perform any data display; if the processor identifies a target object from the image, the mobile phone is switched from a dormant state to an awakening state, the mobile phone outputs an image signal to the AR glasses body, the micro-display is controlled to enter a working state when the micro-controller of the AR glasses body detects that the image signal is received, and the micro-display of the intelligent glasses can display a real-time picture on the mobile phone and can be information corresponding to the target object; if the mobile phone is not operated within the set time, the mobile phone enters a sleep state, the output of image signals to the AR glasses body is stopped, and the micro-controller detects that the image signals are not received, controls the micro-display to enter the sleep state and does not display any picture.
Optionally, when the processor identifies a target object in the image data, the processor sends an image signal to the display unit. Therefore, only when the processor identifies the target object in the image data, the micro display enters the working mode, and in the working mode, the micro display displays the content data corresponding to the image signal, so that the micro display can be prevented from being always in the working mode, the electric quantity is saved, and the power consumption is reduced.
Optionally, the target objects include a first type of target object and a second type of target object, and the method further includes:
when the target object is the first type of target object, the processor controls the control terminal to display content data, and if an instruction for performing AR display on the content data is received, an image signal corresponding to the content data is output to the AR glasses body;
when the target object is the second type target object, the processor outputs the image signal to the AR glasses body.
In this embodiment, the first type target object and the second type target object may be two preset target objects, in one embodiment, the second type target object may be a target object with a high reminding level, the first type target object may be a target object with a low reminding level, for example, the second type target object may be an object whose similarity to the user monitoring object is within a second threshold range, the first type target object may be an object whose similarity to the user monitoring object is within a first threshold range, when the similarity to the user monitoring object of the object in the current screen identified by the processor is within the second threshold range, the corresponding content data may be directly output through the AR glasses, when the similarity to the user monitoring object of the object in the current screen identified by the processor is within the first threshold range, the corresponding content data can be displayed on the control terminal, a prompt that the content output exists is output, and whether the AR display is carried out on the content data through the AR glasses or not is judged by the user. Wherein the second threshold range may be greater than α and the first threshold range may be between β and α. Wherein α and β are percentages, and α > β.
In an embodiment, when the processor performs the identification processing on the image data, the processor further obtains a quality parameter corresponding to the image data, and when the value of the quality parameter is higher than a preset threshold value, sets a value of α as x, sets a value of β as y, and when the value of the quality parameter is lower than the preset threshold value, sets a value of α as m, and sets a value of β as n, where x > m, y > n. In practical application, when the quality of an image acquired by a camera is poor, for example, the sharpness and brightness of the image are abnormal, or the image is out of focus, and the like, the similarity between an object in a current picture and a user monitoring object is low, and at the moment, the judgment threshold of an output AR image is reduced, so that monitoring omission can be avoided, and the monitoring robustness is improved under the condition of controlling power consumption. The quality parameter corresponding to the image data may be obtained by an out-of-focus detection, brightness detection and/or sharpness detection algorithm, or may be obtained by another algorithm that can obtain the image quality, which is not limited in this application. The quality parameter may be multiple, and for example, the quality parameter may include a defocus parameter, a brightness parameter, and a sharpness parameter, and the threshold values also include a defocus threshold value, a brightness threshold value, and a sharpness threshold value, respectively, or the quality parameter may be a comprehensive parameter obtained by comprehensively calculating based on the defocus parameter, the brightness parameter, and the sharpness parameter. The threshold value is the threshold value corresponding to the comprehensive parameter.
The control terminal outputs a prompt indicating that content output exists, wherein the prompt can be that the control terminal prompts the content data in a mode of sound, vibration, light and the like. Receiving an instruction to display the content data, may specifically be: the control terminal displays the content data through a screen of the control terminal, sends out prompt tone or vibration, enables a user to look at the screen of the control terminal, and generates information which can be controlled by the user whether to output the content data to the AR glasses body, for example, the control terminal outputs information 'whether to need AR glasses for display' below the content, and has two options, namely 'yes' and 'no', if the user selects 'yes', the control terminal outputs the content data to the AR glasses body.
According to the embodiment, the split AR glasses can distinguish different target objects, AR display can be timely performed on key monitoring objects, whether AR display is performed on approximate target objects can be judged by a user, so that the timely display of important information is guaranteed, the error display caused by approximate identification is avoided, the power consumption of the micro display of the AR split glasses is effectively controlled, and the eye fatigue of the user is effectively relieved.
Optionally, the method further includes:
after the control terminal establishes communication connection and power connection with the AR glasses body, the microcontroller controls the micro display and the camera to execute initialization;
after the initialization of the control terminal is completed, the microcontroller continuously judges whether the image signal is received, if the current judgment result is negative, the micro display is controlled to sleep, and if the current judgment result is positive, the micro display is determined whether to wake up or not by combining the previous judgment result of the current judgment result.
In this embodiment, the microcontroller controls the microdisplay and the camera to perform initialization, which may be to control the microdisplay and the camera to enter a working state. The current determination result may be a result of a latest determination in the continuous determination process.
Optionally, the determining, in combination with a previous determination result of the current determination result, whether to perform the wake-up of the driver includes:
if the previous judgment result of the current judgment result is negative, the micro display is awakened; and if the previous judgment result of the current judgment result is yes, not executing the awakening of the micro display. Thus, the probability of erroneous judgment can be further reduced, and power consumption can be further saved.
According to the embodiment of the invention, when the display enters the sleep mode, the camera is used for collecting image data, and the processor is used for identifying and processing the image data in the background.
Referring to fig. 4, fig. 4 is a structural diagram of a display control device of split AR glasses according to an embodiment of the present invention, where the split AR glasses include a control terminal and an AR glasses body, the AR glasses body is provided with the display unit, the control terminal is provided with a processor, and the control terminal is used for communicating with the AR glasses body and providing a power control terminal for the AR glasses body.
As shown in fig. 4, the display control apparatus 400 includes: a first control module 401 and a second control module 402; wherein:
a first control module 401, configured to, when the microdisplay is in a sleep mode, if an image signal sent by the processor is received, control the microdisplay to enter a working mode, where in the working mode, the microdisplay displays content data corresponding to the image signal, and in the sleep mode, a backlight of the microdisplay is turned off;
a second control module 402, configured to, when the micro display is in the working mode, control the micro display to enter a sleep mode if it is detected that the image signal stops transmitting.
Optionally, the AR glasses body includes a camera, as shown in fig. 5, the apparatus 400 further includes:
the acquisition processing module 403 is configured to control the camera to maintain a working mode and continuously acquire image data when the microdisplay enters a sleep mode; the microcontroller acquires the image data and sends the image data to the processor; the processor performs recognition processing on the image data.
Optionally, as shown in fig. 6, the display control apparatus 400 further includes a sending module 406, configured to send an image signal to the display unit when the processor identifies a target object in the image data.
Optionally, the content data at least includes content data corresponding to the target object.
Optionally, the target objects include a first type target object and a second type target object, as shown in fig. 7, the apparatus 400 further includes:
a first output module 404, configured to, when the target object is the first-class target object, control the control terminal to display content data by the processor, and if an instruction for performing AR display on the content data is received, output an image signal corresponding to the content data to the AR glasses body;
a second output module 405, configured to control the processor to output the image signal to the AR glasses body when the target object is the second type target object.
Optionally, the first type of target object is an object whose similarity to a preset object is within a first threshold range, and the second type of target object is an object whose similarity to the preset object is within a second threshold range.
Optionally, the second threshold range is greater than α, and the first threshold range is from β to α, where α and β are percentages, and α > β;
as shown in fig. 8, the display control apparatus 400 further includes a setting module 407, configured to obtain a quality parameter corresponding to the image data, where when the value of the quality parameter is higher than a preset threshold, the value of α is set to x, the value of β is set to y, and when the value of the quality parameter is lower than the preset threshold, the value of α is set to m, and the value of β is set to n, where x > m, y > n.
Optionally, as shown in fig. 9, the display control apparatus 400 further includes an execution module 408, configured to, after the control terminal establishes a communication connection and an electric power connection with the AR glasses body, control the micro display and the camera to execute initialization by the micro controller;
after initialization is finished, the microcontroller continuously judges whether the image signal is received, if the current judgment result is negative, the micro display is controlled to sleep, and if the current judgment result is positive, the micro display is determined to be awakened or not by combining the previous judgment result of the current judgment result.
The display control device 400 of the split AR glasses provided in the embodiment of the present invention can implement each process implemented in the above method embodiments, and can achieve the same beneficial effects, and is not described herein again to avoid repetition.
The embodiment of the present invention further provides a pair of split AR glasses, where the pair of split AR glasses includes a display unit and a processor, the display unit includes a micro-display and a micro-controller, and the micro-controller and the processor are configured to run a computer instruction stored in a computer-readable storage medium to execute each process of the display control method embodiment of the split AR glasses, and the same technical effect can be achieved, and in order to avoid repetition, details are not repeated here.
Optionally, as shown in fig. 10, an embodiment of the present invention provides a pair of split AR glasses 1000, where a processor 800 of the pair of split AR glasses 1000 is disposed in a control terminal, and the pair of split AR glasses include:
a micro display 1040, the micro display 1040 being disposed on the glasses frame, e.g., in front of the right eye;
a camera 1030, said camera 1030 disposed on said eyeglass frame to the right of said micro display 1030;
a display driver board 1020, wherein the display driver board 1020 can be positioned at a right side temple and used for driving the micro display 1040 and the camera;
the coaxial cable 1050 is made of 20 micro coaxial wires, wherein the coaxial cable 1050 has the advantages of strong anti-interference capability, good shielding performance and stable data transmission;
and the Type-c adapter board 1010 is used for switching the output signal of the processor 800 and transmitting the output signal to the display driving board 1020 through the coaxial cable 1050.
The display driving board 1020 further includes:
a video interface conversion unit 1023, wherein the video interface conversion unit 1023 converts the video interface signal of the processor 800 into a video input interface signal required by the micro display 1040; and, is used for converting the video signal of the lens into the USB2.0 signal, transmit to the processor 800;
a microcontroller 1021, the microcontroller 1021 for initializing the microdisplay 1040 and the camera and video interface conversion unit 1023;
a power module 1022, wherein the power module 1022 is configured to convert a power supply of the processor 800 into various power supplies required by a display driver board.
The Type-c adapter board 1010 and the video interface conversion unit 1023 are optional components. When the data transmitted by the processor 800 and the data collected by the camera can be used, no conversion is needed, and the Type-c adapter board 1010 and the video interface conversion unit 1023 are not needed.
In one embodiment, when the split AR glasses 1000 are connected to the mobile phone, the power module 1022 performs power conversion, the microcontroller 1021 is powered, and initializes the microdisplay 1040 and the camera 1030 and the video interface conversion unit 1023 (power up, perform parameter configuration). When the split AR glasses 1000 enter the sleep mode, the microcontroller 1021 controls the microdisplay 1040 to power down.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the above-mentioned split AR glasses display control method embodiment, and can achieve the same technical effect, and in order to avoid repetition, the detailed description is omitted here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.