CN115599217A - Display control method, display control device, head-mounted display equipment and medium - Google Patents
Display control method, display control device, head-mounted display equipment and medium Download PDFInfo
- Publication number
- CN115599217A CN115599217A CN202211338112.9A CN202211338112A CN115599217A CN 115599217 A CN115599217 A CN 115599217A CN 202211338112 A CN202211338112 A CN 202211338112A CN 115599217 A CN115599217 A CN 115599217A
- Authority
- CN
- China
- Prior art keywords
- transparency
- canvas
- image
- brightness
- current
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 238000009877 rendering Methods 0.000 claims abstract description 3
- 230000008859 change Effects 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 17
- 239000011521 glass Substances 0.000 description 17
- 238000012545 processing Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 238000004590 computer program Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000003247 decreasing effect Effects 0.000 description 3
- 230000002829 reductive effect Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000001902 propagating effect Effects 0.000 description 2
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- XSQUKJJJFZCRTK-UHFFFAOYSA-N Urea Chemical compound NC(N)=O XSQUKJJJFZCRTK-UHFFFAOYSA-N 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000004202 carbamide Substances 0.000 description 1
- 208000018747 cerebellar ataxia with neuropathy and bilateral vestibular areflexia syndrome Diseases 0.000 description 1
- 229910052802 copper Inorganic materials 0.000 description 1
- 239000010949 copper Substances 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
- 239000007858 starting material Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Optics & Photonics (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
Abstract
The embodiment of the disclosure discloses a display control method, a display control device, a head-mounted display device and a medium, wherein the method comprises the following steps: rendering and displaying image data of a first application on a first canvas in a desktop environment of a head-mounted display device; acquiring a first image of the current environment where the head-mounted display equipment is located, wherein the first image is acquired by a camera device of the head-mounted display equipment; adjusting a current transparency of the first canvas according to the first image.
Description
Technical Field
The embodiment of the disclosure relates to the technical field of wearable devices, and more particularly, to a display control method, a display control device, a head-mounted display device, and a computer-readable storage medium.
Background
With the continuous development of the augmented reality technology, a lot of AR products and AR applications appear, a user can use a terminal device such as a mobile phone to project content displayed in a virtual screen of the user to the AR products in a wireless streaming manner for viewing, and meanwhile, the user can establish a plurality of canvases in a desktop scene displayed by the AR products to display a plurality of applications in the mobile phone, so as to realize that the applications are opened more in the AR products.
However, when the AR product realizes the multi-open application, in order to better adapt to the AR usage scenario, the canvas of the multi-open application is usually semi-transparent, when the color of the usage environment of the user is bright, the semi-transparent canvas may have a problem of being difficult to see, and when the color of the usage environment of the user is dim, the semi-transparent canvas may completely block the current environment.
Disclosure of Invention
The embodiment of the disclosure aims to provide a display control method and device, a head-mounted display device and a medium.
According to a first aspect of embodiments of the present disclosure, there is provided a display control method, the method including:
rendering and displaying image data of a first application on a first canvas in a desktop environment of a head-mounted display device;
acquiring a first image of the current environment where the head-mounted display equipment is located, wherein the first image is acquired by a camera device of the head-mounted display equipment;
adjusting a current transparency of the first canvas according to the first image.
Optionally, the adjusting the current transparency of the first canvas according to the first image comprises:
acquiring brightness of the first image;
decreasing a current transparency of the first canvas if the brightness of the first image is less than a first brightness threshold;
controlling the current transparency of the first canvas not to change when the brightness of the first image is greater than or equal to a first brightness threshold and less than a second brightness threshold;
increasing a current transparency of the first canvas if the brightness of the first image is greater than or equal to a second transparency threshold.
Optionally, the reducing the current transparency of the first canvas comprises:
reducing a current transparency of the first canvas based on a first transparency threshold; and the number of the first and second groups,
the increasing the current transparency of the first canvas comprises:
increasing a current transparency of the first canvas based on a second transparency threshold.
Optionally, before the adjusting the current transparency of the first canvas according to the first image, the method further comprises:
providing a transparency setting interface, and acquiring the transparency of a first canvas set by a user through the transparency setting interface as the current transparency of the first canvas; alternatively, the first and second liquid crystal display panels may be,
and acquiring a preset transparency as the current transparency of the first canvas.
Optionally, the method further comprises:
under the condition that a user sets the transparency of the first canvas for N times through the transparency setting interface, acquiring the transparency of the first canvas set each time; wherein N is an integer greater than 1;
acquiring brightness of a first image which is acquired by the camera device and corresponds to the transparency of the first canvas which is set each time;
classifying the transparency of the first canvas which is set each time according to the brightness of the first image corresponding to the transparency of the first canvas which is set each time, the first brightness threshold and the second brightness threshold to obtain classification result data;
and updating the first transparency threshold and the second transparency threshold according to the classification result data.
According to a second aspect of the embodiments of the present disclosure, there is provided a display control apparatus, characterized in that the apparatus includes:
a display module to render and display image data of a first application on a first canvas in a display area of a head mounted display device;
the acquisition module is used for acquiring a first image of the current environment where the head-mounted display equipment is located, wherein the first image is acquired by a camera device of the head-mounted display equipment;
an adjustment module to adjust a current transparency of the first canvas according to the first image.
Optionally, the adjusting module is specifically configured to:
acquiring brightness of the first image;
reducing a current transparency of the first canvas if the brightness of the first image is less than a first brightness threshold;
controlling the current transparency of the first canvas not to change if the brightness of the first image is greater than or equal to a first brightness threshold and less than a second brightness threshold;
increasing a current transparency of the first canvas if the brightness of the first image is greater than or equal to a second transparency threshold.
Optionally, the adjusting module is specifically configured to:
reducing a current transparency of the first canvas based on a first transparency threshold; and the number of the first and second groups,
increasing a current transparency of the first canvas based on a second transparency threshold.
According to a third aspect of embodiments of the present disclosure, there is provided a head mounted display device including:
a memory for storing executable computer instructions;
a processor for executing the display control method according to the first aspect above, according to the control of the executable computer instructions.
According to a fourth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium having stored thereon computer instructions which, when executed by a processor, perform the display control method of the above first aspect.
One beneficial effect of the embodiment of the present disclosure is that, under the condition that image data of a first application is rendered and displayed on a first canvas in a desktop environment of a head-mounted display device, a first image of an environment where the head-mounted display device is currently located, which is acquired by a camera device of the head-mounted display device, is acquired, and then the current transparency of the first canvas is adjusted according to the first image, that is, when an AR product is implemented with applications being opened more, the AR product can adaptively adjust the current transparency of the first canvas through the environment where the head-mounted display device is currently located, thereby improving product experience of a user.
Other features of the present description and advantages thereof will become apparent from the following detailed description of exemplary embodiments thereof, which proceeds with reference to the accompanying drawings.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the specification and together with the description, serve to explain the principles of the specification.
Fig. 1 is a hardware configuration schematic diagram of a head mounted display device according to an embodiment of the present disclosure;
FIG. 2 is a schematic flow diagram of a display control method according to an embodiment of the disclosure;
FIG. 3 is a functional block diagram of a display control device according to an embodiment of the present disclosure;
FIG. 4 is a functional block diagram of a head mounted display device according to an embodiment of the present disclosure.
Detailed Description
Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of parts and steps, numerical expressions and numerical values set forth in these embodiments do not limit the scope of the embodiments of the present disclosure unless specifically stated otherwise.
The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the disclosure, its application, or uses.
Techniques, methods, and apparatus known to one of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.
In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.
< hardware configuration >
Fig. 1 is a block diagram of a hardware configuration of a head mounted display apparatus 1000 according to an embodiment of the present disclosure.
As shown in fig. 1, the head-mounted display device 1000 may be smart glasses, which may be AR glasses, but may also be other devices, which is not limited in this disclosure.
In one embodiment, as shown in fig. 1, the head mounted display apparatus 1000 may include a processor 1100, a memory 1200, an interface device 1300, a communication device 1400, a display device 1500, an input device 1600, a speaker 1700, a microphone 1800, and the like.
The processor 1100 may include, but is not limited to, a central processing unit CPU, a microprocessor MCU, and the like. The memory 1200 includes, for example, a ROM (read only memory), a RAM (random access memory), a nonvolatile memory such as a hard disk, and the like. The interface device 1300 includes, for example, various bus interfaces such as a serial bus interface (including a USB interface), a parallel bus interface, and the like. Communication device 1400 is capable of wired or wireless communication, for example. The display device 1500 is, for example, a liquid crystal display, an LED display, an OLED (Organic Light-Emitting Diode) display, or the like. The input device 1600 includes, for example, a touch screen, a keyboard, a handle, and the like. The head mounted display device 1000 may output audio information through the speaker 1700 and may collect audio information through the microphone 1800.
It should be understood by those skilled in the art that although a plurality of apparatuses of the head mounted display apparatus 1000 are illustrated in fig. 1, the head mounted display apparatus 1000 of the embodiments of the present specification may only refer to some of the apparatuses, and may also include other apparatuses, which are not limited herein.
In this embodiment, the memory 1200 of the head mounted display device 1000 is used to store instructions for controlling the processor 1100 to operate to implement or support the implementation of a display control method according to any of the embodiments. The skilled person can design the instructions according to the solution disclosed in the present specification. How the instructions control the operation of the processor is well known in the art and will not be described in detail herein.
In the above description, the skilled person can design the instructions according to the solutions provided in the present disclosure. How the instructions control the operation of the processor is well known in the art and will not be described in detail herein.
The head mounted display device shown in fig. 1 is merely illustrative and is in no way intended to limit the present disclosure, its application, or uses.
Various embodiments and examples according to the present disclosure are described below with reference to the drawings.
< method examples >
Fig. 2 illustrates a display control method according to an embodiment of the disclosure, where the display control method may be implemented by a head-mounted display device, or may be implemented by a control device independent of the head-mounted display device and the head-mounted display device together, or may be implemented by a cloud server, a terminal device and the head-mounted display device together, where the head-mounted display device may be an AR glasses, and the terminal device may be a mobile phone.
As shown in fig. 2, the display control method of this embodiment may include steps S2100 to S2300 of:
in step S2100, image data displaying a first application is rendered on a first canvas in a display area of a head mounted display device.
In this embodiment, a desktop starter of the AR glasses is called an AR Launcher, the AR Launcher is automatically started when the AR glasses are turned on, a desktop environment of the AR glasses starts to run, and after a user wears the AR glasses, the AR glasses display the desktop environment in a sight range of the user. It will be appreciated that the desktop environment is typically a 3D desktop environment.
Here, different mobile phones may stream image data of an application running in their own virtual screens to the AR glasses in a wireless streaming manner, and a 3D engine in the AR glasses, such as Unity or urea, may establish a corresponding canvas texture in a desktop environment of the AR glasses, so as to render and display the streamed image data on the corresponding canvas.
Taking the example of interaction between the mobile phone and the AR glasses, the mobile phone 1 may stream the image data of the applications 1 and 2 to the AR glasses, and the mobile phone 2 may stream the image data of the applications 3 and 4 to the AR glasses. Meanwhile, the 3D engine of the AR glasses, for example, unity, may establish the canvas 1, the canvas 2, the canvas 3, and the canvas 4 in the desktop environment of the AR glasses, and the canvas 1, the canvas 2, the canvas 3, and the canvas 4 are located at different positions of the desktop environment of the AR glasses and may have different sizes. The image data of the application 1 can be rendered and displayed through the canvas 1, the image data of the application 2 can be rendered and displayed through the canvas 2, the image data of the application 3 can be rendered and displayed through the canvas 3, and the image data of the application 4 can be rendered and displayed through the canvas 4.
In this embodiment, in a usage scenario where multiple applications are implemented based on AR glasses, for better fusion with the real world, the first canvas may be automatically set to be semi-transparent, specifically, the value a in the color channel of R (Red ) G (Green, green) B (Blue ) a (Alpha channel) may be set to be 150, where the value a may represent transparency of the image data, 0 is completely transparent, and 255 is opaque, that is, the larger the value a, that is, the greater the transparency, the more opaque the first canvas, the smaller the value a, that is, the smaller the transparency, and the more transparent the first canvas, that is, the transparency of the first canvas is inversely proportional to the transparency of the first canvas.
In one example, where the first canvas is typically created in a desktop environment of the head mounted display device, a transparency may be automatically preset for the first canvas, where the preset transparency may be obtained as a current transparency of the first canvas.
In another example, where the first canvas is typically created in a desktop environment of the head mounted display device, the transparency may be automatically preset for the first canvas, where the user may manually adjust the preset transparency based on the actual situation. Here, the head mounted display device is provided with a transparency setting interface, and acquires the transparency of the first canvas set by the user through the transparency setting interface as the current transparency of the first canvas.
The transparency setting interface can be a selection box or an input box. The input box may be a text input box or a voice input box, for example, through which a user manually enters the transparency 100 as the current transparency of the first canvas. The selection box may provide different degrees of transparency, such as a range of transparency provided by the selection box of 50-255, where a user may select the degree of transparency 60 as the current degree of transparency of the first canvas through the selection box.
Subsequently, step S2200 is performed to obtain a first image of an environment where the head-mounted display device is currently located, where the first image is acquired by a camera of the head-mounted display device.
In this embodiment, be provided with camera device on wearing display device, this camera device can include the RGBA camera, can gather the environment image of wearing the current environment that display device is located through the RGBA camera, and then adjusts the current transparency of first canvas based on the environment image of the current environment that is located of gathering.
It can be understood that an image in YUV format can be directly acquired by the RGBA camera, where the acquired first image, i.e., the environment image, is in YUV format, where the Y value can reflect the brightness of the first image, the larger the Y value, i.e., the larger the brightness, the brighter the current environment color is, the smaller the Y value, i.e., the smaller the brightness, the dimmer the current environment color is, and the transparency of the first canvas can be adaptively adjusted based on the brightness of the current environment.
In a particular embodiment, a first application rendered and displayed in an AR Launcher or a first canvas of a head mounted display device invokes an RGBA camera to take a first image of an environment in which it is currently located based on a set period. The set period may be a value set according to an actual application scene and an actual requirement, and the set period may be 2s, that is, the AR Launcher of the head-mounted display device or the first application rendered and displayed in the first canvas may invoke the RGBA camera to capture a first image of an environment where the RGBA camera is currently located every 2 s.
Subsequently, step S2300 is entered, wherein the current transparency of the first canvas is adjusted according to the first image.
In a specific embodiment, the adjusting the current transparency of the first canvas according to the first image in step S2300 may further include steps S2310 to S2340 as follows:
step S2310, a brightness of the first image is obtained.
In this step S2310, the Y value in the first image may be acquired as the brightness of the first image.
Step S2320, in a case that the brightness of the first image is less than a first brightness threshold, the current transparency of the first canvas is reduced.
The first brightness threshold may be a preset value according to an actual application scenario and an actual requirement, and the first brightness threshold may be 100, or it may be understood that when the brightness of the first image is less than the first brightness threshold, for example, less than 100, it indicates that the brightness of the current environment is low, that is, the color of the current environment is dark, and at this time, the current transparency of the first canvas needs to be reduced, so that the first canvas becomes more transparent. Here, the step S2320 of reducing the current transparency of the first canvas may specifically include: reducing a current transparency of the first canvas based on a first transparency threshold.
The first transparency threshold may be a value preset according to an actual application scenario and an actual requirement, and the first transparency threshold may be 25. That is, in the case that the brightness of the current environment is less than the first brightness threshold, for example, less than 100, it is determined that the brightness of the current environment is low, and at this time, the a value of the first canvas may be decreased by 25, that is, the transparency of the first canvas is decreased, so that the first canvas becomes more transparent.
In step S2330, the current transparency of the first canvas is controlled not to change when the brightness of the first image is greater than or equal to a first brightness threshold and less than a second brightness threshold.
The second brightness threshold may be a value preset according to an actual application scenario and an actual requirement, and the second brightness threshold may be 150, or it may be understood that when the brightness of the first image is greater than or equal to the second brightness threshold, for example, greater than 150, it indicates that the brightness of the current environment is high, that is, the current environment is vivid, and when the brightness of the first image is greater than or equal to the first brightness threshold, for example, greater than or equal to 100, and less than the second brightness threshold, for example, less than 150, it indicates that the brightness of the current environment is moderate. In case of moderate brightness of the current environment, no adjustment of the current transparency of the first canvas is needed at this time, i.e. the transparency of the first canvas is kept at the current transparency.
In step S2340, the current transparency of the first canvas is increased when the brightness of the first image is greater than or equal to a second transparency threshold.
In step S2340, when the brightness of the first image is greater than the second brightness threshold, for example, greater than 150, it indicates that the brightness of the current environment is high, that is, the current environment is bright in color, and at this time, the current transparency of the first canvas needs to be increased, so that the first canvas becomes less transparent. Here, in step S2340, the increasing the current transparency of the first canvas may specifically include: increasing a current transparency of the first canvas based on a second transparency threshold. For example, in the case that the brightness of the current environment is greater than the second brightness threshold, for example greater than 150, it is determined that the brightness of the current environment is high, at which point the a value of the first canvas may be increased by 25, i.e., the transparency of the first canvas is increased, so that the first canvas becomes less transparent.
According to the embodiment of the disclosure, under the condition that image data of a first application is rendered and displayed on a first canvas in a desktop environment of a head-mounted display device, a first image of the environment where the head-mounted display device is located currently is acquired by a camera device of the head-mounted display device, and then the current transparency of the first canvas is adjusted according to the first image, namely, when an AR product achieves the condition that the application is opened too much, the current transparency of the first canvas can be adaptively adjusted through the environment where the head-mounted display device is located currently, and the problem that the user experience is reduced due to the fact that the brightness of the current environment is too high or too low when the AR application is opened too much is solved.
In an embodiment, in a scene where a user manually sets the current transparency of the first canvas, the display control method according to the embodiment of the present disclosure further includes steps S3100 to S3400:
step S3100, under the condition that a user sets the transparency of the first canvas for N times through the transparency setting interface, acquiring the transparency of the first canvas set each time; wherein N is an integer greater than 1.
In this embodiment, when the user sets the transparency of the first canvas through the transparency setting interface for multiple times, the transparency of the first canvas set by the user through the transparency setting interface each time is recorded.
Step S3200 is performed to obtain brightness of the first image corresponding to the transparency of the first canvas set each time, which is acquired by the image capturing apparatus.
In this embodiment, when the user sets the transparency of the first canvas through the transparency setting interface each time, the head-mounted display device may use the set transparency as the current transparency of the first canvas, obtain the brightness of the first image of the environment where the head-mounted display device is currently located, which is acquired by the camera device of the head-mounted display device, and adjust the current transparency of the first canvas according to the brightness of the first image.
And step S3300, classifying the transparency of the first canvas which is set each time according to the brightness of the first image corresponding to the transparency of the first canvas which is set each time, the first brightness threshold value and the second brightness threshold value, and obtaining classification result data.
In this embodiment, the brightness of the first image acquired each time in correspondence may be divided into three levels, i.e., low brightness, moderate brightness, and high brightness, according to the first brightness threshold and the second brightness threshold. As described in the above embodiments, the brightness of the first image is determined to be low when the brightness of the first image is less than the first brightness threshold, for example, less than 100, moderate when the brightness of the first image is greater than or equal to the first brightness threshold, for example, greater than or equal to 100, and less than the second brightness threshold, for example, less than 150, and high when the brightness of the first image is greater than or equal to the second brightness threshold, for example, greater than or equal to 150.
Here, the transparency set by the user N times may be classified and stored based on three levels of low brightness, moderate brightness, and high brightness, and each level may store, for example, the latest 1-10 transparencies, resulting in three sets of transparency data.
Step S3400, updating the first transparency threshold and the second transparency threshold according to the classification result data.
In this embodiment, based on the three divided levels of low brightness, moderate brightness, and high brightness, the transparency set by the user N times is classified and stored, each level stores the latest 1 to 10 transparencies, after three sets of transparency data are obtained, an average value of each set of transparency data is calculated, polynomial fitting is performed on the obtained average value, and the first transparency threshold and the second transparency threshold are updated according to the fitting result.
According to the embodiment, the first transparency threshold and the second transparency threshold can be automatically updated according to the requirements of the user, so that the current transparency of the first canvas is more accurately adjusted based on the brightness of the current environment.
< apparatus embodiment >
Fig. 3 is a schematic diagram of a display control apparatus according to an embodiment, and referring to fig. 3, the display control apparatus 300 includes a display module 310, an obtaining module 320, and an adjusting module 330.
A display module 310 to render image data displaying a first application on a first canvas in a display area of a head mounted display device;
the obtaining module 320 is configured to obtain a first image of an environment where the head-mounted display device is currently located, where the first image is collected by a camera device of the head-mounted display device;
an adjusting module 330, configured to adjust a current transparency of the first canvas according to the first image.
In an embodiment, the adjusting module 330 is specifically configured to: acquiring brightness of the first image; reducing a current transparency of the first canvas if the brightness of the first image is less than a first brightness threshold; controlling the current transparency of the first canvas not to change if the brightness of the first image is greater than or equal to a first brightness threshold and less than a second brightness threshold; increasing a current transparency of the first canvas if the brightness of the first image is greater than or equal to a second transparency threshold.
In an embodiment, the adjusting module 330 is specifically configured to: reducing a current transparency of the first canvas based on a first transparency threshold; and increasing a current transparency of the first canvas based on a second transparency threshold.
In an embodiment, before the adjusting module 330 adjusts the current transparency of the first canvas according to the first image, the obtaining module 310 is further configured to provide a transparency setting interface, and obtain the transparency of the first canvas set by the user through the transparency setting interface as the current transparency of the first canvas; or acquiring a preset transparency as the current transparency of the first canvas.
In one embodiment, the apparatus 300 further comprises a classification module and an update module (neither shown).
The obtaining module 310 is further configured to, under the condition that the user sets the transparency of the first canvas through the transparency setting interface N times, obtain the transparency of the first canvas that is set each time; wherein N is an integer greater than 1;
the obtaining module 310 is further configured to obtain brightness of the first image, which is acquired by the image capturing device and corresponds to the transparency of the first canvas set each time;
the classification module is used for classifying the transparency of the first canvas which is set each time according to the brightness of the first image corresponding to the transparency of the first canvas which is set each time, the first brightness threshold and the second brightness threshold to obtain classification result data;
and the updating module is used for updating the first transparency threshold and the second transparency threshold according to the classification result data.
According to the embodiment, under the condition that image data of a first application is rendered and displayed on a first canvas in a desktop environment of the head-mounted display device, a first image of the environment where the head-mounted display device is currently located, which is acquired by a camera device of the head-mounted display device, is acquired, and then the current transparency of the first canvas is adjusted according to the first image, that is, when the AR product realizes that the application is opened more, the current transparency of the first canvas can be adaptively adjusted through the environment where the head-mounted display device is currently located, so that the product experience of a user is improved.
< apparatus embodiment >
Fig. 4 is a hardware configuration diagram of a head-mounted display device according to an embodiment. As shown in fig. 4, the head mounted display device 400 includes a processor 410 and a memory 420.
The memory 420 may be used to store executable computer instructions.
The processor 410 may be configured to execute the display control method according to the disclosed method embodiment, according to the control of the executable computer instructions.
The head-mounted display device 400 may be the head-mounted display device 1000 shown in fig. 1, or may be a device having another hardware structure, which is not limited herein.
In further embodiments, the head mounted display apparatus 400 may include the above display control apparatus 300.
In one embodiment, the above modules of the display control apparatus 300 may be implemented by the processor 410 executing computer instructions stored in the memory 420.
< computer-readable storage Medium >
Embodiments of the present disclosure also provide a computer-readable storage medium, on which computer instructions are stored, and when the computer instructions are executed by a processor, the computer instructions perform the display control method provided by the embodiments of the present disclosure.
The present disclosure may be systems, methods, and/or computer program products. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied thereon for causing a processor to implement various aspects of the present disclosure.
The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.
The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device over a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.
Computer program instructions for carrying out operations of the present disclosure may be assembler instructions, instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, the electronic circuitry that can execute the computer-readable program instructions implements aspects of the present disclosure by utilizing the state information of the computer-readable program instructions to personalize the electronic circuitry, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA).
Various aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.
These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, by software, and by a combination of software and hardware are equivalent.
Having described embodiments of the present disclosure, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the present disclosure is defined by the appended claims.
Claims (10)
1. A display control method, characterized in that the method comprises:
rendering and displaying image data of a first application on a first canvas in a desktop environment of a head-mounted display device;
acquiring a first image of the current environment where the head-mounted display equipment is located, wherein the first image is acquired by a camera device of the head-mounted display equipment;
adjusting a current transparency of the first canvas according to the first image.
2. The method of claim 1, wherein the adjusting the current transparency of the first canvas according to the first image comprises:
acquiring brightness of the first image;
reducing a current transparency of the first canvas if the brightness of the first image is less than a first brightness threshold;
controlling the current transparency of the first canvas not to change if the brightness of the first image is greater than or equal to a first brightness threshold and less than a second brightness threshold;
increasing a current transparency of the first canvas if the brightness of the first image is greater than or equal to a second transparency threshold.
3. The method of claim 2, wherein the reducing the current transparency of the first canvas comprises:
reducing a current transparency of the first canvas based on a first transparency threshold; and the number of the first and second groups,
the increasing the current transparency of the first canvas comprises:
increasing a current transparency of the first canvas based on a second transparency threshold.
4. The method of claim 1, wherein prior to the adjusting the current transparency of the first canvas according to the first image, the method further comprises:
providing a transparency setting interface, and acquiring the transparency of a first canvas set by a user through the transparency setting interface as the current transparency of the first canvas; alternatively, the first and second electrodes may be,
and acquiring a preset transparency as the current transparency of the first canvas.
5. The method of claim 3, further comprising:
under the condition that a user sets the transparency of the first canvas for N times through the transparency setting interface, acquiring the transparency of the first canvas set each time; wherein N is an integer greater than 1;
acquiring brightness of a first image which is acquired by the camera device and corresponds to the transparency of the first canvas which is set each time;
classifying the transparency of the first canvas which is set each time according to the brightness of the first image corresponding to the transparency of the first canvas which is set each time, the first brightness threshold and the second brightness threshold to obtain classification result data;
and updating the first transparency threshold and the second transparency threshold according to the classification result data.
6. A display control apparatus, characterized in that the apparatus comprises:
a display module to render and display image data of a first application on a first canvas in a display area of a head mounted display device;
the acquisition module is used for acquiring a first image of the environment where the head-mounted display equipment is currently located, wherein the first image is acquired by a camera device of the head-mounted display equipment;
an adjustment module to adjust a current transparency of the first canvas according to the first image.
7. The apparatus of claim 6, wherein the adjustment module is specifically configured to:
acquiring brightness of the first image;
reducing a current transparency of the first canvas if the brightness of the first image is less than a first brightness threshold;
controlling the current transparency of the first canvas not to change if the brightness of the first image is greater than or equal to a first brightness threshold and less than a second brightness threshold;
increasing a current transparency of the first canvas if the brightness of the first image is greater than or equal to a second transparency threshold.
8. The apparatus of claim 7, wherein the adjustment module is specifically configured to:
reducing a current transparency of the first canvas based on a first transparency threshold; and the number of the first and second groups,
increasing a current transparency of the first canvas based on a second transparency threshold.
9. A head-mounted display device, comprising:
a memory for storing executable computer instructions;
a processor for executing the display control method according to any one of claims 1 to 5, according to the control of the executable computer instructions.
10. A computer-readable storage medium having stored thereon computer instructions which, when executed by a processor, perform the display control method of any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211338112.9A CN115599217A (en) | 2022-10-28 | 2022-10-28 | Display control method, display control device, head-mounted display equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211338112.9A CN115599217A (en) | 2022-10-28 | 2022-10-28 | Display control method, display control device, head-mounted display equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115599217A true CN115599217A (en) | 2023-01-13 |
Family
ID=84850411
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211338112.9A Pending CN115599217A (en) | 2022-10-28 | 2022-10-28 | Display control method, display control device, head-mounted display equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115599217A (en) |
-
2022
- 2022-10-28 CN CN202211338112.9A patent/CN115599217A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106030503B (en) | Adaptive video processing | |
| CN105278905B (en) | Apparatus and method for displaying object having visual effect | |
| EP4093016A1 (en) | Frame interpolation processing method and related product | |
| US20140092006A1 (en) | Device and method for modifying rendering based on viewer focus area from eye tracking | |
| KR102463304B1 (en) | Video processing method and device, electronic device, computer-readable storage medium and computer program | |
| CN104754239A (en) | Photographing method and device | |
| EP2789159A1 (en) | Guided image capture | |
| CN104010124A (en) | Method and device for displaying filter effect, and mobile terminal | |
| WO2018214431A1 (en) | Method and apparatus for presenting scene using virtual reality device, and virtual reality apparatus | |
| CN110351540B (en) | Method and device for extracting image of vibrating mirror test unit of projector and electronic equipment | |
| CN110780730A (en) | Adaptive brightness/color correction for displays | |
| CN108702460B (en) | Using display light to improve front camera performance | |
| CN105607260A (en) | Picture display method and device, and head-mounted device | |
| CN106792255B (en) | Video playing window frame body display method and device | |
| GB2532953A (en) | Overlay display | |
| CN104238906A (en) | Information processing method and electronic device | |
| CN115599217A (en) | Display control method, display control device, head-mounted display equipment and medium | |
| US10706590B2 (en) | Subtitle beat generation method, image processing method, terminal, and server | |
| CN115599206A (en) | Display control method, display control device, head-mounted display equipment and medium | |
| CN109062645B (en) | Method and apparatus for processing information for terminal | |
| CN110225177B (en) | Interface adjusting method, computer storage medium and terminal equipment | |
| CN105335591A (en) | Method and apparatus for providing background image of software | |
| US20230410721A1 (en) | Illumination portions on displays | |
| CN110989833B (en) | Control method, AR device and computer readable storage medium | |
| CN117237499A (en) | Image rendering method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |