CN110928516B - Augmented reality display method, device, terminal and computer readable storage medium - Google Patents

Augmented reality display method, device, terminal and computer readable storage medium Download PDF

Info

Publication number
CN110928516B
CN110928516B CN201911280561.0A CN201911280561A CN110928516B CN 110928516 B CN110928516 B CN 110928516B CN 201911280561 A CN201911280561 A CN 201911280561A CN 110928516 B CN110928516 B CN 110928516B
Authority
CN
China
Prior art keywords
display
target
display content
parameters
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911280561.0A
Other languages
Chinese (zh)
Other versions
CN110928516A (en
Inventor
黄凯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201911280561.0A priority Critical patent/CN110928516B/en
Publication of CN110928516A publication Critical patent/CN110928516A/en
Application granted granted Critical
Publication of CN110928516B publication Critical patent/CN110928516B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1415Digital output to display device ; Cooperation and interconnection of the display device with other functional units with means for detecting differences between the image stored in the host and the images displayed on the displays

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application belongs to the technical field of augmented reality, and particularly relates to an augmented reality display method, an apparatus, a terminal and a computer readable storage medium, wherein the augmented reality display method comprises the following steps: acquiring signal parameters of biological signals; the biological signal comprises a biological signal acquired when a target object views display content of augmented reality; calculating target display parameters of virtual display content in the display content according to the signal parameters of the biological signals; adjusting the display parameters of the virtual display content to the target display parameters; the technical problem of single display mode of virtual display content is solved.

Description

Augmented reality display method, device, terminal and computer readable storage medium
Technical Field
The application belongs to the technical field of augmented reality, and particularly relates to an augmented reality display method, an augmented reality display device, a terminal and a computer readable storage medium.
Background
Augmented reality (Augmented Reality, AR) is a technology that superimposes virtual information on the real world after being simulated by a scientific technology simulation, and is perceived by human senses, thereby achieving a sense experience of super reality.
However, in the current augmented reality technology, the display mode of the virtual information in the real world is still too single, and the requirements of users in different scenes cannot be met.
Disclosure of Invention
The embodiment of the application provides an augmented reality display method, an augmented reality display device, a terminal and a computer readable storage medium, which can solve the technical problem of single display mode of virtual display content.
An embodiment of the present application provides a display method for augmented reality, including:
acquiring signal parameters of biological signals; the biological signal comprises a biological signal acquired when a target object views display content of augmented reality;
calculating target display parameters of virtual display content in the display content according to the signal parameters of the biological signals;
adjusting the display parameters of the virtual display content to the target display parameters
A second aspect of embodiments of the present application provides an augmented reality display device, including:
an acquisition unit for acquiring signal parameters of the biological signal; the biological signal comprises a biological signal acquired when a target object views display content of augmented reality;
a calculating unit for calculating a target display parameter of a virtual display content in the display content according to the signal parameter of the biological signal;
And the adjusting unit is used for adjusting the display parameters of the virtual display content to the target display parameters.
A third aspect of the embodiments of the present application provides a terminal comprising a memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing the steps of the above method when executing the computer program.
A fourth aspect of the embodiments of the present application provides a computer-readable storage medium storing a computer program, which when executed by a processor, implements the steps of the above method.
In the embodiment of the application, the signal parameters of the biological signals are obtained; then calculating target display parameters of virtual display contents in the display contents according to the signal parameters of the biological signals; the display parameters of the virtual display content can be adjusted according to the signal parameters of the biological signals so as to meet the requirements of the target object in different viewing states, and the technical problem of single display mode of the virtual display content is solved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments will be briefly described below, it being understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered limiting the scope, and that other related drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic implementation flow chart of a display method of augmented reality according to an embodiment of the present application;
fig. 2 is a schematic diagram of a first structure of a terminal according to an embodiment of the present application.
Fig. 3 is a schematic flowchart of a first implementation of step 102 of the augmented reality display method according to an embodiment of the present application;
FIG. 4 is a schematic flow chart of an implementation of transforming virtual display content according to an embodiment of the present application;
fig. 5 is a schematic flow chart of a second implementation of step 102 of the augmented reality display method provided in the embodiment of the present application;
fig. 6 is a schematic flowchart of an implementation of actively adjusting display parameters of virtual display content by a user according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of a display device for augmented reality according to an embodiment of the present application;
fig. 8 is a second structural schematic diagram of a terminal provided in an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.
It should be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It is also to be understood that the terminology used in the description of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should be further understood that the term "and/or" as used in this specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.
In order to illustrate the technical solution of the present application, the following description is made by specific examples.
Augmented reality (Augmented Reality, AR) is a technology of simulating virtual information (virtual display content) through a scientific technology, and then overlaying the virtual information (virtual display content) to the real world (real display content) to be perceived by human senses, so that the sense experience of super reality is achieved. However, in the current augmented reality technology, the virtual display content is simply superimposed in the real world, which has a problem of a single display mode, and the requirements of users in different scenes cannot be met.
For example, in practical applications, a user may have a situation where the user feels uncomfortable with the virtual display content superimposed on the live-action display content and wishes to weaken the display effect of the virtual display content superimposed on the live-action display content, or a situation where the virtual display content superimposed on the live-action display content is very thick and wishes to enhance the display effect of the virtual display content superimposed on the live-action display content.
Based on this, the embodiments of the present application provide an augmented reality display method, apparatus, terminal, and computer readable storage medium, which can solve the technical problem of single display mode of virtual display content.
Fig. 1 shows a schematic implementation flow chart of an augmented reality display method according to an embodiment of the present application, where the method is applied to a terminal and may be executed by an augmented reality display device configured on the terminal. The terminal may be an augmented reality device such as AR glasses, which may implement an augmented reality function. The above-described augmented reality display method may include steps 101 to 103.
Step 101, acquiring signal parameters of biological signals.
The biological signal may include a biological signal acquired when the target object views the augmented reality display content.
When the target object uses the augmented reality function of the terminal having the augmented reality function, the real-scene display content and the virtual display content superimposed on the real-scene display content output by the terminal device can be seen through the terminal device, and therefore, the display content of the target object for viewing the augmented reality can include the real-scene display content and the virtual display content superimposed on the real-scene display content.
At present, the virtual display content is a display screen projected on a projection surface with a certain fixed distance through a terminal, so that discomfort such as dizziness and fatigue may occur when a target object views the virtual display content for a long time, and when the plot of the virtual display content is a display content which is more frightened and liable to fear the target object, discomfort of the target object may also occur, and meanwhile, the plot of the virtual display content is more falling and fluctuant, resonance of the target object is liable to occur, so that the target object has higher probability of being highly productive to the virtual display content.
Therefore, in order to know in real time whether the target object has such discomfort, whether the target object is in a state where rest is required or whether the target object is in a state where it is more comfortable is determined, it is necessary to perform judgment by acquiring in real time the signal parameters of the bio-signal of the target object when viewing the display content of augmented reality.
Wherein, the signal parameters of the biological signal may include: parameters such as signal parameters of brain nerve signals of a target object, eye opening and closing degree parameters, heart rate parameters, blood pressure parameters, pupil size and the like.
The eye opening and closing degree parameter includes a blink frequency of the target object and a change rate of an eye opening area of the target object; the change rate of the eye opening area of the target object is obtained by subtracting the initial eye opening area of the target object from the real-time eye opening area of the target object and dividing the initial eye opening area of the target object. The initial eye opening area is the eye opening area when the target object just begins to watch the display content of the augmented reality.
In some embodiments of the present application, if the signal parameter of the biological signal is a cranial nerve signal parameter of the target object, a cranial nerve signal sensor provided on the terminal may be used to obtain a cranial nerve signal of the target object when the augmented reality display content in the viewing field of view is viewed.
The signal parameters of the cranial nerve signal may include signal parameters such as frequency, phase, and signal intensity of the cranial nerve signal.
Specifically, the above-mentioned cranial nerve signal sensor provided on the terminal may include a cranial nerve signal sensor for contact detection and/or a cranial nerve signal sensor for non-contact detection; for example, the above-mentioned cranial nerve signal sensor provided on the terminal device may be a micro current sensor capable of acquiring a cranial nerve signal of a target object when the augmented reality display content of the target object is viewed in a visual field by detecting a micro current change generated when the brain activity is detected by touching the scalp of the target object; for another example, the sensor provided on the terminal device may be a micro-magnetic sensor, and the micro-magnetic sensor may detect a magnetic field change generated by brain current without touching the target object, so as to obtain a cranial nerve signal when the target object views the augmented reality display content in the field of view.
As shown in fig. 2, a first structural schematic diagram of a terminal provided in this embodiment of the present application, in some embodiments of the present application, the terminal may include sensors 21, 22, 23 respectively disposed at the front, side and rear of the terminal, and may be used to detect cranial nerve signals of a plurality of parts such as the forehead, the near-ear and the hindbrain of a user.
In addition, in some embodiments of the present application, the terminal may further include a micro display DLP, which may include a driving power chip, a data control chip, a digital micromirror DMD (Digital Micro Mirror Device), a light source, an optical system, and the like. The driving power chip and the data control chip control the digital micro mirror and the light source to work cooperatively, and the digital micro mirror is a semiconductor switch reflection display device with high resolution. The light emitted by the light source passes through the optical system and reaches the digital micro-mirror, and the digital micro-mirror reflects the light to form display content.
And 102, calculating target display parameters of virtual display contents in the display contents according to the signal parameters of the biological signals.
In this embodiment of the present application, before calculating the target display parameters of the virtual display content in the display content according to the signal parameters of the biological signals, a large number of experiments may be performed to obtain target display parameters corresponding to the signal parameters of different biological signals; or obtaining target display parameters corresponding to the signal parameters of different biological signals according to practical experience in advance.
And step 103, adjusting the display parameters of the virtual display content to target display parameters.
In this embodiment of the present application, the adjusting the display parameter of the virtual display content to the target display parameter may include: according to the signal parameters of the biological signals of the user, the display effect of the virtual display content superimposed on the live-action display content is weakened, so that the attention of human eyes is transferred to the live-action display content, and the discomfort of the target object brought by the virtual display content is reduced; or the display effect of the virtual display content overlapped on the live-action display content is enhanced, so that the target object obtains a stronger visual effect, and the display requirement of the target object on the virtual display content under different scenes is met.
In the embodiment of the application, the signal parameters of the biological signals of the target object when the display content of the augmented reality is watched are obtained, and then the target display parameters of the virtual display content in the display content are calculated according to the signal parameters of the biological signals; the display parameters of the virtual display content can be adjusted according to the signal parameters of the biological signals so as to meet the requirements of the target object in different viewing states, and the technical problem of single display mode of the virtual display content is solved.
For example, the signal parameter of the above-mentioned biological signal may reflect an emotional state of the target object when viewing the display content of the augmented reality, and thus, the target display parameter may be a display parameter of the target object in a virtual display content corresponding to different emotional states; according to the method and the device, the display parameters of the virtual display content are adjusted to the target display parameters, so that the display parameters of the virtual display content can be adjusted according to the emotion state of the target object, the diversification of the display mode of the virtual display content is realized, and different requirements of the target object on comfort level or visual effect and the like are met.
Specifically, as shown in fig. 3, in some embodiments of the present application, in the step 102, calculating the target display parameter of the virtual display content in the display content according to the signal parameter of the biological signal may include: steps 301 to 302.
Step 301, judging whether the target object is in a state requiring rest according to the signal parameters of the biological signals.
In this embodiment of the present application, the state requiring rest may include a state requiring rest caused by fear of the target object, a state requiring rest caused by fatigue of the target object, a state requiring rest caused by stress of the target object, and a state requiring rest caused by other reasons of the target object.
Specifically, before judging whether the target object is in a state requiring rest according to the signal parameters of the biological signal, the terminal can acquire the state requiring rest of the target object caused by fear, the state requiring rest of the target object caused by fatigue, or the reference signal parameters of the biological signal corresponding to the state requiring rest of the target object caused by stress, so that when judging whether the target object is in the state requiring rest according to the signal parameters of the biological signal, the terminal can confirm whether the target object is in the state requiring rest by comparing the signal parameters of the biological signal with the reference signal parameters.
For example, a large number of experiments can be performed to obtain reference signal parameters such as frequency, phase and signal intensity of a cranial nerve signal of different target objects in a state where rest is required caused by different reasons, then obtain signal parameters of the cranial nerve signal of the target objects when the augmented reality device is used for watching the virtual display content and the real display content of the augmented reality, and compare the signal parameters of the cranial nerve signal with the reference signal parameters to obtain whether the target objects are in the state where rest is required when the augmented reality device is used for watching the virtual display content and the real display content of the augmented reality.
Step 302, if the target object is in a state requiring rest, one or more target display parameters of target brightness, target chromaticity, target display area and target display position of the virtual display content corresponding to the state requiring rest are obtained.
In this embodiment of the present invention, the above-mentioned target display parameter corresponding to the state requiring rest is a display parameter for weakening the display effect of the virtual display content, improving the virtual display content of the target object state, for example, for improving the state requiring rest caused by fear of the target object, improving the state requiring rest caused by fatigue of the target object, improving the state requiring rest caused by tension of the target object, and improving the virtual display content of the state requiring rest caused by other reasons of the target object, so that the target object may be converted from the state requiring rest to the state not requiring rest.
Likewise, the above-mentioned acquisition of the target display parameters corresponding to the state requiring rest can still be obtained by performing a large number of experiments.
For example, a large number of experiments can be performed to obtain display parameters of virtual display contents adopted when different target objects are in a state of needing to rest caused by different reasons and are converted into a state of not needing to rest, statistics and analysis are performed on a large amount of obtained data, and the display parameters of the virtual display contents with the highest success rate are selected to be respectively used as target display parameters corresponding to the state of the different target objects needing to rest caused by different reasons.
In some embodiments of the present application, the specific values of the target display parameters, such as the target brightness, the target chromaticity, the target display area, and the target display position, of the virtual display content corresponding to the state requiring rest may be set according to actual experience.
For example, the target luminance may be set to 0 or other luminance value capable of reducing the attractive force to the target object to a set degree; and/or setting the target chromaticity to a cool tone capable of alleviating fatigue of the target object; and/or setting the target display area to 0 or other display area capable of reducing the attractive force to the target object to a set degree; and/or setting the target display position of the virtual display content to be a position deviating from the center of the visual field of the target object, so that the virtual display content cannot attract the target object, and the target object is allowed to rest.
Accordingly, in some embodiments of the present application, the adjusting the display parameter of the virtual display content to the target display parameter may include: and adjusting the brightness of the virtual display content in the display content to be the target brightness corresponding to the state needing rest, and/or adjusting the chromaticity of the virtual display content in the display content to be the target chromaticity corresponding to the state needing rest, and/or adjusting the display area of the virtual display content in the display content to be the target display area corresponding to the state needing rest, and/or adjusting the display position of the virtual display content in the display content to be the target display position corresponding to the state needing rest.
For example, when the target brightness of the virtual display content in the display content calculated according to the signal parameters of the biological signal is lower than the brightness of the virtual display content in the display content of the current augmented reality, the brightness of the virtual display content can be adjusted to be the target brightness, and the brightness of the virtual display content overlapped on the real display content is reduced, so that the target object is at rest; for another example, the target chromaticity of the virtual display content in the display content calculated according to the signal parameters of the biological signal is higher than the chromaticity of the virtual display content in the display content of the current augmented reality, so that when the chromaticity of the virtual display content is adjusted to the target chromaticity, the virtual display content superimposed on the real display content tends to be the cold tone, and the target object is at rest; for another example, the target display area of the virtual display content in the display content calculated according to the signal parameters of the biological signal is smaller than the display area of the virtual display content in the display content of the current augmented reality, so that when the display area of the virtual display content is adjusted to be the target display area, the virtual display content overlapped on the real scene display content is reduced, and the target object is at rest; for another example, the target display position of the virtual display content in the display content calculated according to the signal parameter of the biological signal is further away from the center of the visual field range than the display position of the virtual display content in the display content of the current augmented reality, so that when the display position of the virtual display content is adjusted to the target display position, the attention of the target object is focused on the real display content, and rest is obtained.
In the embodiment described in fig. 3, the acquiring the target luminance and the target chromaticity corresponding to the state requiring rest may include: and acquiring the brightness and the chromaticity of the real scene display content in the display content, and calculating the target brightness and the target chromaticity corresponding to the state needing rest according to the brightness and the chromaticity of the real scene display content.
The brightness and the chromaticity of the live-action display content in the display content can be acquired through a camera arranged on the augmented reality terminal equipment.
Specifically, the target luminance calculated when the luminance of the live-action display content is high is higher than the target luminance calculated when the luminance of the live-action display content is low, that is, in order to divert the human eye attention of the target object to the live-action display content as well, the degree of lowering the luminance of the virtual display content when the luminance of the live-action display content is high is smaller than the degree of lowering the luminance of the virtual display content when the luminance of the live-action display content is low.
Similarly, the target tone of the virtual display content in the display content calculated when the tone of the live-action display content is warm is warmer than the target tone of the virtual display content in the display content calculated when the brightness of the live-action display content is colder.
In some embodiments of the present application, after the step 301, the method may further include: and if the target object is in the state requiring rest, converting virtual display content in the display content according to the signal parameters of the biological signals.
That is, in addition to the aforementioned change of the display parameters of the virtual display content according to the signal parameters of the biological signal, the present application further achieves the effect of resting the target object by changing the virtual display content superimposed on the live-action display content according to the signal parameters of the biological signal.
Specifically, as shown in fig. 4, the transforming the virtual display content in the display content according to the signal parameter of the biological signal may include: steps 401 to 402.
Step 401, uploading signal parameters of the biological signals to a cloud server.
After receiving the signal parameters of the biological signal, the cloud server may recommend virtual display content corresponding to the signal parameters of the biological signal to the augmented reality terminal device.
For example, if the cloud server receives the signal parameter of the biological signal corresponding to the state that the target object is in need of rest, the virtual display content that enables the target object to get rest may be recommended to the augmented reality terminal device.
It should be noted that, the virtual display content recommended by the cloud server according to the signal parameters of the biological signal may include one or more virtual display contents.
And step 402, receiving and displaying virtual display contents recommended by the cloud server according to the signal parameters of the biological signals.
When the virtual display content recommended by the cloud server according to the signal parameters of the biological signal is a plurality of virtual display contents, after receiving and displaying the virtual display content recommended by the cloud server according to the signal parameters of the biological signal, the method may further include: and acquiring a virtual display content selection operation, and displaying virtual display content corresponding to the virtual display content selection operation.
In the embodiment of the application, the virtual display content in the display content is changed according to the signal parameters of the biological signals, so that the terminal equipment can change the virtual display content simultaneously according to the display parameters of the virtual display content, the diversification of the display mode of the virtual display content is further realized, and different requirements of a target object on comfort level, visual effect and the like are met.
In some embodiments of the present application, after adjusting the display parameter of the virtual display content to the target display parameter, the method may further include: monitoring whether the rest time length of the target object is longer than the preset time length, and if the rest time length of the target object is longer than the preset time length, restoring the display parameters of the virtual display content to the display parameters before adjustment.
Wherein, the preset time period can be set according to practical experience.
In the embodiment of the application, if the rest time of the target object is longer than the preset time, the target object is fully resting, and the augmented reality function can be reused, at this time, the terminal device can restore the display parameters of the virtual display content to the display parameters before adjustment, so that the target object experiences the immersion experience brought by the augmented reality again.
In some embodiments of the present application, as shown in fig. 5, the calculating, in step 102, the target display parameter of the virtual display content in the display content according to the signal parameter of the biological signal may further include: step 501 to step 502.
Step 501, judging whether the target object is in a better state according to the signal parameters of the biological signals.
In this embodiment, the above-mentioned state of being in a better state may include a state in which the attention of the target object is highly concentrated, or a state in which the target object is relatively excited and pleasant.
Step 502, if the target object is in a better state, obtaining one or more target display parameters of target brightness, target chromaticity, target display area and target display position of the virtual display content corresponding to the better state.
In this embodiment of the present invention, the target display parameter corresponding to the well-developed state is a display parameter for enhancing a display effect of the virtual display content and improving a visual effect of the target object watching the virtual display content.
Specifically, the specific implementation manner of determining whether the target object is in the state of good making and obtaining the target display parameter corresponding to the state of good making may refer to the descriptions of determining whether the target object is in the state of needing rest and obtaining the target display parameter corresponding to the state of needing rest in steps 301 to 302, which are not repeated herein.
Correspondingly, the adjusting the display parameter of the virtual display content to the target display parameter may include: and adjusting the brightness of the virtual display content in the display content to be the target brightness corresponding to the good state, and/or adjusting the chromaticity of the virtual display content in the display content to be the target chromaticity corresponding to the good state, and/or adjusting the display area of the virtual display content in the display content to be the target display area corresponding to the good state, and/or adjusting the display position of the virtual display content in the display content to be the target display position corresponding to the good state.
In practical applications, the target object may need to adjust the display parameters of the virtual display content by itself, for example, after the display parameters of the virtual display content are adjusted to the target display parameters, the target object may want to restore to the display parameters before adjustment; for example, after the above-described restoration of the display parameters of the virtual display content to the display parameters before adjustment, the target object may wish to continue restoration of the display parameters of the virtual display content to the display parameters after adjustment.
Thus, in other embodiments of the present application, as shown in fig. 6, the above-mentioned augmented reality display method may further include: steps 601 to 602.
Step 601, a display mode selection instruction is received.
Wherein the display mode selection instruction is triggered by a button provided by the terminal device, and different display mode selection instructions correspond to different display parameters.
Step 602, adjusting the display parameters of the virtual display content to the display parameters corresponding to the display mode selection instruction.
According to the embodiment of the application, after the target object triggers the display mode selection instruction according to the needs of the target object, the terminal equipment adjusts the display parameters of the virtual display content to the display parameters corresponding to the display mode selection instruction, so that the display parameters of the virtual display content accord with the current needs of the target object, and misoperation of adjusting the display parameters is avoided.
For the foregoing method embodiments, for simplicity of explanation, the methodologies are shown as a series of acts, but one of ordinary skill in the art will appreciate that the present invention is not limited by the order of acts described, as some steps may occur in other orders in accordance with the invention.
Fig. 7 shows a schematic structural diagram of an augmented reality display device 700 according to an embodiment of the present application, including an acquisition unit 701, a calculation unit 702, and an adjustment unit 703.
An acquisition unit 701 for acquiring signal parameters of a biological signal; the biological signal comprises a biological signal acquired when a target object views display content of augmented reality;
a calculating unit 702, configured to calculate a target display parameter of a virtual display content in the display content according to a signal parameter of the biological signal;
an adjusting unit 703, configured to adjust a display parameter of the virtual display content to the target display parameter.
In some embodiments of the present application, the calculating unit 702 is further configured to determine whether the target object is in a state that needs to rest according to the signal parameter of the biological signal; and if the target object is in a state needing to be at rest, acquiring one or more target display parameters of the virtual display content, namely target brightness, target chromaticity, target display area and target display position, corresponding to the state needing to be at rest.
In some embodiments of the present application, the adjusting unit 703 is further configured to, after determining whether the target object is in a state that requires rest according to the signal parameter of the biological signal, transform the virtual display content in the display content according to the signal parameter of the biological signal if the target object is in the state that requires rest.
In some embodiments of the present application, the adjusting unit 703 is further configured to upload signal parameters of the biological signal to a cloud server; and receiving and displaying virtual display contents recommended by the cloud server according to the signal parameters of the biological signals.
In some embodiments of the present application, the adjusting unit 703 is further configured to monitor whether a rest duration of the target object is greater than a preset duration after adjusting the display parameter of the virtual display content to the target display parameter, and if the rest duration of the target object is greater than the preset duration, restore the display parameter of the virtual display content to the display parameter before adjustment.
In some embodiments of the present application, the calculating unit 702 is further configured to determine whether the target object is in a better-developed state according to the signal parameter of the biological signal; and if the target object is in a good state, acquiring one or more target display parameters of the virtual display content, namely target brightness, target chromaticity, target display area and target display position corresponding to the good state.
In some embodiments of the present application, the display device for augmented reality is further configured to receive a display mode selection instruction; and adjusting the display parameters of the virtual display content to display parameters corresponding to the display mode selection instruction.
It should be noted that, for convenience and brevity of description, the specific working process of the above-described augmented reality display device 700 may refer to the corresponding process of the above-described method in fig. 1 to 6, and will not be repeated here.
As shown in fig. 8, the present application provides a terminal for implementing the above-mentioned augmented reality display method, where the terminal may include: a processor 81, a memory 82, one or more input devices 83 (only one shown in fig. 8) and one or more output devices 84 (only one shown in fig. 8). The processor 81, the memory 82, the input device 83 and the output device 84 are connected by a bus 85.
It should be appreciated that in embodiments of the present application, the processor 81 may be a central processing unit (Central Processing Unit, CPU), which may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The input device 83 may include a virtual keyboard, a touch pad, a fingerprint sensor (for collecting fingerprint information of a user and direction information of a fingerprint), a microphone, etc., and the output device 84 may include a display, a speaker, etc.
The memory 82 stores a computer program that is executable on the processor 81, for example, a program for an augmented reality display method. The steps in the embodiment of the display method for augmented reality are implemented when the processor 81 executes the computer program, for example, steps 101 to 103 shown in fig. 1. Alternatively, the processor 81 may perform the functions of the units in the above embodiment of the apparatus when executing the computer program, for example, the functions of the units 701 to 703 shown in fig. 7.
The computer program may be divided into one or more modules/units, which are stored in the memory 82 and executed by the processor 81 to complete the present application. The one or more modules/units may be a series of instruction segments of a computer program capable of performing a specific function for describing the execution of the computer program in the first terminal for augmented reality display. For example, the above-described computer program may be divided into an acquisition unit, a calculation unit, and an adjustment unit, each unit having the following specific functions:
An acquisition unit for acquiring signal parameters of the biological signal; the biological signal comprises a biological signal acquired when a target object views display content of augmented reality;
a calculating unit for calculating a target display parameter of a virtual display content in the display content according to the signal parameter of the biological signal;
and the adjusting unit is used for adjusting the display parameters of the virtual display content to the target display parameters.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions. The functional units and modules in the embodiment may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit, where the integrated units may be implemented in a form of hardware or a form of a software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working process of the units and modules in the above system may refer to the corresponding process in the foregoing method embodiment, which is not described herein again.
The embodiments of the present application provide a computer program product, which when run on a terminal device, causes the terminal device to execute the steps of the augmented reality display method in the above embodiments.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and in part, not described or illustrated in any particular embodiment, reference is made to the related descriptions of other embodiments.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus/terminal and method may be implemented in other manners. For example, the apparatus/terminal embodiments described above are merely illustrative, e.g., the division of the modules or units described above is merely a logical functional division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection via interfaces, devices or units, which may be in electrical, mechanical or other forms.
The units described above as separate components may or may not be physically separate, and components shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated modules/units described above, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the present application may implement all or part of the flow of the method of the above embodiment, or may be implemented by a computer program to instruct related hardware, where the above computer program may be stored in a computer readable storage medium, and when the computer program is executed by a processor, the computer program may implement the steps of each method embodiment described above. The computer program comprises computer program code, and the computer program code can be in a source code form, an object code form, an executable file or some intermediate form and the like. The computer readable medium may include: any entity or device capable of carrying the computer program code described above, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), an electrical carrier wave signal, a telecommunications signal, a software distribution medium, and so forth. It should be noted that the content of the computer readable medium described above can be appropriately increased or decreased according to the requirements of the jurisdiction's legislation and the patent practice, for example, in some jurisdictions, the computer readable medium does not include electrical carrier signals and telecommunication signals according to the legislation and the patent practice.
The above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present application, and are intended to be included in the scope of the present application.

Claims (9)

1. An augmented reality display method, comprising:
acquiring signal parameters of biological signals; the biological signal comprises a biological signal acquired when a target object views display content of augmented reality;
calculating target display parameters of virtual display content in the display content according to the signal parameters of the biological signals, wherein the target display parameters comprise one or more of target brightness, target chromaticity, target display area and target display position;
adjusting the display parameters of the virtual display content to the target display parameters;
and if the rest time period of the target object is longer than the preset time period, the display parameters of the virtual display content are restored to the display parameters before adjustment.
2. The augmented reality display method of claim 1, wherein calculating target display parameters of virtual display content in the display content according to signal parameters of the biological signal comprises:
judging whether the target object is in a state requiring rest according to the signal parameters of the biological signals;
and if the target object is in a state needing to be at rest, acquiring one or more target display parameters of the virtual display content, namely target brightness, target chromaticity, target display area and target display position, corresponding to the state needing to be at rest.
3. The augmented reality display method according to claim 2, further comprising, after the determining whether the target object is in a state requiring rest according to the signal parameters of the biological signal:
and if the target object is in the state needing rest, converting virtual display content in the display content according to the signal parameters of the biological signals.
4. The augmented reality display method of claim 3, wherein transforming virtual display content of the display content according to signal parameters of the biological signal comprises:
Uploading signal parameters of the biological signals to a cloud server;
and receiving and displaying virtual display contents recommended by the cloud server according to the signal parameters of the biological signals.
5. The augmented reality display method of claim 1, wherein calculating target display parameters of virtual display content in the display content according to signal parameters of the biological signal comprises:
judging whether the target object is in a good-rising state or not according to the signal parameters of the biological signals;
and if the target object is in a good state, acquiring one or more target display parameters of the virtual display content, namely target brightness, target chromaticity, target display area and target display position corresponding to the good state.
6. The augmented reality display method of claim 1, further comprising:
receiving a display mode selection instruction;
and adjusting the display parameters of the virtual display content to display parameters corresponding to the display mode selection instruction.
7. An augmented reality display device, comprising:
an acquisition unit for acquiring signal parameters of the biological signal; the biological signal comprises a biological signal acquired when a target object views display content of augmented reality;
A calculating unit, configured to calculate target display parameters of virtual display content in the display content according to signal parameters of the biological signal, where the target display parameters include one or more of target brightness, target chromaticity, target display area, and target display position;
an adjustment unit configured to adjust a display parameter of the virtual display content to the target display parameter; and the adjusting unit is further configured to, after the determining that the target object is in the state requiring rest according to the signal parameters of the biological signal, transform the virtual display content in the display content according to the signal parameters of the biological signal if the target object is in the state requiring rest.
8. A terminal comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the method according to any one of claims 1 to 6 when the computer program is executed.
9. A computer readable storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the steps of the method according to any one of claims 1 to 6.
CN201911280561.0A 2019-12-12 2019-12-12 Augmented reality display method, device, terminal and computer readable storage medium Active CN110928516B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911280561.0A CN110928516B (en) 2019-12-12 2019-12-12 Augmented reality display method, device, terminal and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911280561.0A CN110928516B (en) 2019-12-12 2019-12-12 Augmented reality display method, device, terminal and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN110928516A CN110928516A (en) 2020-03-27
CN110928516B true CN110928516B (en) 2023-08-01

Family

ID=69859524

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911280561.0A Active CN110928516B (en) 2019-12-12 2019-12-12 Augmented reality display method, device, terminal and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN110928516B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112996203B (en) * 2021-03-10 2022-07-12 重庆第二师范学院 Intelligent illumination control system and control method

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014138925A1 (en) * 2013-03-15 2014-09-18 Interaxon Inc. Wearable computing apparatus and method
CN104166530A (en) * 2013-05-16 2014-11-26 中兴通讯股份有限公司 Display parameter adjustment method and device and terminal
CN104598037B (en) * 2015-03-02 2018-08-31 联想(北京)有限公司 Information processing method and device
CN106293557B (en) * 2015-05-04 2019-12-03 北京智谷睿拓技术服务有限公司 Display control method and device
IL311155A (en) * 2016-03-25 2024-04-01 Magic Leap Inc Virtual and augmented reality systems and methods
CN106454311B (en) * 2016-09-29 2019-09-27 北京德火新媒体技术有限公司 A kind of LED 3-D imaging system and method
CN106681491A (en) * 2016-11-29 2017-05-17 维沃移动通信有限公司 Data processing method of virtual reality terminal and virtual reality terminal
CN106875477A (en) * 2017-03-20 2017-06-20 北京幻鲸数字科技有限公司 Display methods and device based on virtual reality
CN109002164B (en) * 2018-07-10 2021-08-24 歌尔光学科技有限公司 Display method and device of head-mounted display equipment and head-mounted display equipment

Also Published As

Publication number Publication date
CN110928516A (en) 2020-03-27

Similar Documents

Publication Publication Date Title
CN109644261B (en) Single depth tracking adjustment-vergence solution
KR102495139B1 (en) Blue light adjustment for biometric security
EP2502410B1 (en) A method for augmenting sight
CN107949819A (en) Apparatus and method for being rendered based on the motion graphics that saccade detects
US20140292637A1 (en) Method for adjusting head-mounted display adaptively and head-mounted display
CN108762496B (en) Information processing method and electronic equipment
US11354805B2 (en) Utilization of luminance changes to determine user characteristics
CN112006900B (en) Control method and system of intelligent desk lamp capable of preventing myopia and storage medium
CN106774929B (en) Display processing method of virtual reality terminal and virtual reality terminal
CN109283997A (en) Display methods, device and system
US20210081047A1 (en) Head-Mounted Display With Haptic Output
CN110928516B (en) Augmented reality display method, device, terminal and computer readable storage medium
JP2012063589A (en) Diopter correcting device
Lausegger et al. OmniColor--A Smart Glasses App to Support Colorblind People.
JPH0713497A (en) Image display device
CN113534949A (en) Head-mounted display device and control method thereof
CN113491502A (en) Eyeball tracking calibration inspection method, device, equipment and storage medium
CN107111366B (en) Method for adapting the sensory output mode of a sensory output device to a user
Hussain et al. Improving depth perception in immersive media devices by addressing vergence-accommodation conflict
US20220128813A1 (en) Eye movement controls in extended reality
KR20220055579A (en) Method for alleviating visual complexity metric of augmented reality device and computer-readable recording medium thereof
CN113132642A (en) Image display method and device and electronic equipment
JP6925490B1 (en) Information terminal, information terminal control program and information terminal control method
US11823343B1 (en) Method and device for modifying content according to various simulation characteristics
Saeedpour-Parizi et al. Perceptual Thresholds for Radial Optic Flow Distortion in Near-Eye Stereoscopic Displays

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant