Disclosure of Invention
The embodiment of the application provides a split type AR display device and a display method, and aims to at least solve the problems that AR glasses in the related art are heavy in weight and display driving parts are high in cost.
In a first aspect, an embodiment of the present application provides a split-type AR display device, where the AR display device includes a display device and an operation processing device, where the display device includes an information acquisition module, a calculation processing module, a display module, and an interface module, and the display device is connected to the operation processing device through the interface module;
the calculation processing module acquires environmental information of the environment where the AR display equipment is located through the information acquisition module;
the computing processing module processes the environment information to obtain an environment signal;
the computing processing module transmits the environment signal to the operation processing device through the interface module;
the operation processing device processes the environment signal to obtain a first display signal;
and the operation processing device transmits the first display signal to the display module through the interface module and displays the first display signal.
In some embodiments, the information acquisition module includes an inertial sensing element, an optical sensing element, an audio sensing module, and a camera module, and the acquiring, by the computation processing module, the environmental information of the environment where the AR display device is located by the information acquisition module includes:
the inertial sensing element acquires motion information of the AR display device;
the optical sensing element acquires ambient light information of an environment where the AR display device is located;
the audio sensing module acquires environmental audio information of an environment where the AR display equipment is located;
the camera module acquires environment image information of an environment where the AR display equipment is located.
In some embodiments, the interface module includes a USB hub element, a Type-C interface element, and the transmitting, by the computing processing module, the environment signal to the arithmetic processing device through the interface module includes: the computing processing module transmits the environment signal to the USB line concentration element, and the USB line concentration element processes the environment signal and transmits the environment signal to the operation processing device through the Type-C interface element.
In some embodiments, the interface module further includes a signal switching control module, where the signal switching control module includes a DP-MIPI interface element, and the transmitting, by the arithmetic processing device, the first display signal to the display module for displaying through the interface module includes:
the operation processing device transmits the first display signal to the DP-MIPI interface element;
the calculation processing module processes the first display signal through the DP-MIPI interface element to obtain a second display signal;
the calculation processing module transmits the second display signal to the display module through the DP-MIPI interface element;
and the calculation processing module processes the second display signal into an image signal through the display module and displays the image signal.
In some embodiments, the audio sensing module includes an audio capturing element, an audio playing element, and an audio control element, and the acquiring, by the audio sensing module, the environmental audio information of the environment where the AR display device is located includes:
the audio control element acquires environmental audio information of the environment where the AR display equipment is located through the audio acquisition element;
and the audio control element receives the audio signal of the interface module and plays the audio signal through the audio playing element.
In some embodiments, the camera module includes an RGB camera element, a first camera element, and a second camera element, and the camera module acquiring the environment image information of the environment where the AR display device is located includes:
the RGB camera shooting element acquires video image information of the environment where the AR display equipment is located in real time;
the first camera element and the second camera element acquire the spatial information of the environment where the AR display equipment is located in real time.
In some embodiments, the display module includes an optical waveguide driver and a display element, and the processing module processes the second display signal into an image signal through the display module and displays the image signal includes: and the calculation processing module processes the second display signal into an image signal by controlling the logic operation of the optical waveguide drive, and displays the image signal on the display element.
In a second aspect, an embodiment of the present application provides a split AR display method, where the AR display method includes:
the calculation processing module acquires environmental information of the environment where the AR display equipment is located through the information acquisition module;
the computing processing module processes the environment information to obtain an environment signal;
the computing processing module transmits the environment signal to an operation processing device through an interface module;
the operation processing device processes the environment signal to obtain a first display signal;
and the operation processing device transmits the first display signal to the display module through the interface module and displays the first display signal.
In some embodiments, the interface module further includes a signal switching control module, where the signal switching control module includes a DP-MIPI interface element, and the transmitting, by the arithmetic processing device, the first display signal to the display module for displaying through the interface module includes:
the operation processing device transmits the first display signal to the DP-MIPI interface element;
the calculation processing module processes the first display signal through the DP-MIPI interface element to obtain a second display signal;
the calculation processing module transmits the second display signal to the display module through the DP-MIPI interface element;
and the calculation processing module processes the second display signal into an image signal through the display module and displays the image signal.
In some embodiments, the display module includes an optical waveguide driver and a display element, and the processing module processes the second display signal into an image signal through the display module and displays the image signal includes: and the calculation processing module processes the second display signal into an image signal by controlling the logic operation of the optical waveguide drive, and displays the image signal on the display element.
Compare in correlation technique, the split type AR display device and method that this application embodiment provided acquire through information acquisition module AR display device place environment information, it is right to calculate processing module environment information handles, obtains the ambient signal, and will through interface module ambient signal transmission to operation processing apparatus, and operation processing apparatus is right ambient signal handles, obtains first display signal, and DP-MIPI interface element obtains the second display signal with first display signal processing, and the logical operation of calculation processing module control optical waveguide drive is shown the signal processing with the second and is become image signal, and show on the display element, solved the heavier and higher problem of display driver part cost of weight of AR glasses, realized reducing the weight and the cost of AR glasses.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be described and illustrated below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments provided in the present application without any inventive step are within the scope of protection of the present application.
It is obvious that the drawings in the following description are only examples or embodiments of the present application, and that it is also possible for a person skilled in the art to apply the present application to other similar contexts on the basis of these drawings without inventive effort. Moreover, it should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another.
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the specification. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of ordinary skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments without conflict.
Unless defined otherwise, technical or scientific terms referred to herein shall have the ordinary meaning as understood by those of ordinary skill in the art to which this application belongs. Reference to "a," "an," "the," and similar words throughout this application are not to be construed as limiting in number, and may refer to the singular or the plural. The present application is directed to the use of the terms "including," "comprising," "having," and any variations thereof, which are intended to cover non-exclusive inclusions; for example, a process, method, apparatus, product, or apparatus that comprises a list of steps or modules (elements) is not limited to the listed steps or elements, but may include other steps or elements not listed or inherent to such process, method, product, or apparatus. Reference to "connected," "coupled," and the like in this application is not intended to be limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The term "plurality" as referred to herein means two or more. "and/or" describes an association relationship of associated objects, meaning that three relationships may exist, for example, "A and/or B" may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. Reference herein to the terms "first," "second," "third," and the like, are merely to distinguish similar objects and do not denote a particular ordering for the objects.
The embodiment of the application provides a split-type AR display device, fig. 1 is a structural block diagram of the split-type AR display device according to the embodiment of the application, as shown in fig. 1, the AR display device includes a display device 11 and an operation processing device 12, where the display device 11 includes an information acquisition module 13, a calculation processing module 14, a display module 15 and an interface module 16, the display device 11 and the operation processing device 12 are connected through the interface module 16, it should be noted that a built-in power supply is configured inside the display device 11, the operation processing device 12 may be a device with a certain operation capability, such as a smart phone, a tablet computer, a notebook computer, a desktop computer, and the like, and meanwhile, the operation processing device 12 may be an external power supply, and may also serve as an external power supply of the display device 11;
the calculation processing module 14 acquires environmental information of an environment where the AR display device is located through the information acquisition module 13;
the calculation processing module 14 processes the environment information to obtain an environment signal;
the calculation processing module 14 transmits the environment signal to the operation processing device 12 through the interface module 16;
the arithmetic processing device 12 processes the environment signal to obtain a first display signal;
the arithmetic processing device 12 transmits the first display signal to the display module 15 through the interface module 16 and displays the first display signal.
Through the split AR display equipment provided by the embodiment of the application, the information acquisition module 13 acquires the environmental information of the environment where the AR display equipment is located, the calculation processing module 14 processes the environmental information to obtain an environmental signal, the environmental signal is transmitted to the operation processing device 12 through the interface module 16, the operation processing device 12 processes the environmental signal to obtain a first display signal, the operation processing device 12 transmits the first display signal to the display module 15 through the interface module 16 to display, because the display device 11 and the operation processing device 12 of the AR display equipment are separated, the operation processing device 12 can be externally connected with a power supply and also can be used as an external power supply of the display device 11, a user can independently update and upgrade hardware needing updating and upgrading, the whole replacement is not needed, and the problem of high updating and upgrading cost of the AR glasses is solved, the cruising ability and performance of the AR display equipment are improved
In some embodiments, fig. 2 is a specific structural block diagram of a split-type AR display device according to an embodiment of the present application, as shown in fig. 2, the information acquisition module 13 includes an inertial sensing element 21, an optical sensing element 22, an audio sensing module 23, and a camera module 24, where the inertial sensing element 21 specifically includes mechanically related detection elements such as a gyroscope, an accelerometer, and a magnetometer, and the acquiring, by the calculation processing module 14, environment information of an environment where the AR display device is located through the information acquisition module 13 includes:
the inertial sensing element 21 acquires motion information of the AR display device;
the optical sensing element 22 acquires ambient light information of the environment in which the AR display device is located;
the audio sensing module 23 acquires environmental audio information of an environment where the AR display device is located;
the camera module 24 acquires environmental image information of the environment in which the AR display device is located.
In some embodiments, fig. 3 is a specific block diagram of a split AR display device according to an embodiment of the present application, as shown in fig. 3, the interface module 16 includes a USB HUB element 31 and a Type-C interface element 32, the USB HUB element 31 specifically includes a USB HUB chip, the Type-C interface element 32 specifically is a Type-C USB3.0 high-speed interface, and the transmitting, by the calculation processing module 14, the environment signal to the operation processing apparatus 12 through the interface module 16 includes: the calculation processing module 14 transmits the environment signal to the USB HUB chip, and the USB HUB chip processes the environment signal and transmits the environment signal to the operation processing device 12 through the USB3.0 high-speed interface of Type-C.
In some embodiments, fig. 4 is a specific structural block diagram of a split AR display device according to an embodiment of the present application, as shown in fig. 4, the interface module 16 further includes a signal switching control module 41, where the signal switching control module 41 specifically includes a DP-MIPI interface element, the signal switching control module 41 specifically further includes a DP & USB interface element, and meanwhile, the DP-MIPI interface element is specifically a DP-MIPI interface chip, and the DP & USB interface element is specifically a USB3.0 high-speed interface of DP & USB, and the transmitting, by the operation processing device 12, the first display signal to the display module 15 through the interface module 16 for displaying includes:
the arithmetic processing device 12 transmits the first display signal to the USB3.0 high-speed interface of the DP & USB;
the calculation processing module 14 converts the first display signal into a DP signal by controlling a signal switching logic of a USB3.0 high-speed interface of the DP & USB;
the calculation processing module 14 transmits the DP signal to a DP-MIPI interface chip, and converts the DP signal into a MIPI signal;
the calculation processing module 14 transmits the MIPI signal to the display module 15;
the computation processing module 14 processes the MIPI signal into a video signal through the display module 15 and displays the video signal.
In some embodiments, fig. 5 is a block diagram of a specific structure of a split-type AR display device according to an embodiment of the present application, as shown in fig. 5, an Audio sensing module 23 includes an Audio collecting element 51, an Audio playing element 52, and an Audio control element 53, where the Audio control element 53 is specifically a USB Audio Codec chip, where the acquiring, by the Audio sensing module 23, environmental Audio information of an environment where the AR display device is located includes:
the USB Audio Codec chip acquires an environment MIC signal of the environment where the AR display equipment is located through an Audio acquisition element 51;
the USB Audio Codec chip receives the Audio signal from the interface module 16 and plays the Audio signal through the Audio playing component 52.
In some embodiments, fig. 6 is a specific block diagram of a split AR display device according to an embodiment of the present application, as shown in fig. 6, a camera module 24 includes an RGB camera element 61, a first camera element 62 and a second camera element 63, where the first camera element 62 is specifically a first 6DOF camera (also called a fisheye camera), the second camera element 63 is specifically a second 6DOF camera, and meanwhile, the camera module 24 further includes a USB bridge chip and a video synthesizer, where the camera module 24 acquires environment image information of an environment where the AR display device is located, including:
the RGB camera element 61 acquires video image information of the environment where the AR display equipment is located in real time;
the method comprises the steps that a first 6DOF camera and a second 6DOF camera acquire spatial information of an environment where AR display equipment is located in real time;
video image information acquired in real time through the RGB camera element 61 and spatial information of a first 6DOF camera and a second 6DOF camera (binocular fisheye camera) scanning environment in real time are converted into USB signals in a USB bridge chip, the USB signals are sent to a USB HUB chip and then sent to the operation processing device 12 for processing, real-time millimeter-scale positioning and map construction are carried out on a real three-dimensional space, and the head 6DOF function and the gesture recognition function are achieved.
In some embodiments, fig. 7 is a specific structural block diagram six of the split AR display device according to the embodiment of the present application, as shown in fig. 7, the display module 15 includes an optical waveguide Driver 71 and a display element 72, the optical waveguide Driver 71 specifically includes two digital micromirror device drivers (DMD Driver and PMIC), the display element 72 specifically includes two Digital Micromirror Device (DMD), wherein the processing module 14 processes the second display signal into the image signal through the display module 15 and displays the image signal, including: the calculation processing module 14 processes the second display signal into an image signal by controlling the logic operation of the digital micromirror device Driver (DMD Driver and PMIC), and displays the image signal on the Digital Micromirror Device (DMD), and processes the second signal into an image signal by controlling the logic operation of the digital micromirror device Driver (DMD Driver and PMIC), and displays the image signal on the Digital Micromirror Device (DMD).
An embodiment of the present application provides a split-type AR display method, fig. 8 is a flowchart of the split-type AR display method according to the embodiment of the present application, and as shown in fig. 8, the method includes the following steps:
s802, the calculation processing module 14 acquires the environment information of the environment where the AR display equipment is located through the information acquisition module 13;
s804, the calculation processing module 14 processes the environment information to obtain an environment signal;
s806, the calculation processing module 14 transmits the environment signal to the operation processing device 12 through the interface module 16;
s808, the operation processing device 12 processes the environment signal to obtain a first display signal, and transmits the first display signal to a USB3.0 high-speed interface of the DP & USB;
s810, the calculation processing module 14 converts the first display signal into a DP signal by controlling a signal switching logic of a USB3.0 high-speed interface of the DP & USB;
s812, the calculation processing module 14 transmits the DP signal to the DP-MIPI interface chip, and converts the DP signal into an MIPI signal;
s814, the calculation processing module 14 processes the MIPI signal into an image signal by controlling the logic operation of the digital micromirror device Driver (DMD Driver and PMIC), and displays the image signal on the Digital Micromirror Device (DMD);
in the embodiment of the present application, through steps S802 to S814, the information acquisition module 13 obtains environment information of an environment where the AR display device is located, the calculation processing module 14 processes the environment information to obtain an environment signal, and transmits the environment signal to the operation processing device 12 through the interface module 16, the operation processing device 12 processes the environment signal to obtain a first display signal, the calculation processing module 14 converts the first display signal into a DP signal through a signal switching logic of a USB3.0 high-speed interface controlling DP & USB, and converts the DP signal into an MIPI signal through a DP-MIPI interface chip, and finally the calculation processing module 14 processes the MIPI signal into a micromirror image signal through a logic operation controlling digital micromirror device drivers (DMD drivers and PMICs) and displays the micromirror image signal on a Digital Micromirror Device (DMD), thereby solving the problems of heavy weight of AR glasses and high cost of a display driving part, reduced weight and cost of AR eyewear is achieved.
It should be understood by those skilled in the art that various features of the above-described embodiments can be combined in any combination, and for the sake of brevity, all possible combinations of features in the above-described embodiments are not described in detail, but rather, all combinations of features which are not inconsistent with each other should be construed as being within the scope of the present disclosure.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.