CN112506463A - Display method, device and equipment based on head-mounted equipment - Google Patents
Display method, device and equipment based on head-mounted equipment Download PDFInfo
- Publication number
- CN112506463A CN112506463A CN202011401355.3A CN202011401355A CN112506463A CN 112506463 A CN112506463 A CN 112506463A CN 202011401355 A CN202011401355 A CN 202011401355A CN 112506463 A CN112506463 A CN 112506463A
- Authority
- CN
- China
- Prior art keywords
- display
- real
- image
- determining
- corner points
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 238000004590 computer program Methods 0.000 claims description 9
- 230000004044 response Effects 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 14
- 238000012545 processing Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 7
- 238000000605 extraction Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 208000003464 asthenopia Diseases 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000001902 propagating effect Effects 0.000 description 2
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 229910052802 copper Inorganic materials 0.000 description 1
- 239000010949 copper Substances 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
Abstract
The application discloses a display method, a display device and display equipment based on head-mounted equipment. The method comprises the following steps: acquiring a real image; wherein the real image comprises a real display image; determining the target position of the real display image in the real image according to the real image; determining the display positions of a preset number of virtual displays according to the target position; displaying the real images, and displaying a preset number of virtual display images on the upper layer of the real images according to the display positions.
Description
Technical Field
The present disclosure relates to the field of image processing technologies, and in particular, to a display method for a display based on a head-mounted device, a display apparatus for a display based on a head-mounted device, and a computer-readable storage medium.
Background
For some workers who do specific tasks, one worker needs to work with multiple displays, such as stock traders.
At present, when one worker works by utilizing a plurality of displays, the plurality of displays need to be arranged, and the working cost and the working space are greatly improved.
Disclosure of Invention
An object of the present application is to provide a new technical solution of a display method based on a head-mounted device.
According to a first aspect of the present application, there is provided a head-mounted device based display method, including:
acquiring a real image; wherein the real image comprises a real display image;
determining a target position of the real display image in the real image according to the real image;
determining the display positions of a preset number of virtual display images according to the target position;
displaying the real images, and displaying a preset number of virtual display images on the upper layer of the real images according to the display positions.
Optionally, the determining, according to the real image, a target position of the real display image in the real image includes:
extracting angular points in the reality image;
extracting corner points of the real display from the corner points in the real image;
and determining the position of the image of the real display in the real image according to the coordinates of the corner points of the real display in the real image.
Optionally, the extracting the corner points of the real display from the corner points in the real image includes:
and extracting the corner points of the real display from the corner points in the real image according to the corner points in the real image and the display corner point set.
Optionally, the method further includes:
determining the size of the real display according to the position of the real display;
the displaying a preset number of the virtual display images on the upper layer of the real image according to the display position includes:
and displaying a preset number of virtual display images with the same size as the real display on the upper layer of the real image according to the display position.
Optionally, the determining the size of the real display according to the position of the real display includes:
determining corner coordinates of any pair of corner points on a diagonal line in the corner points of the real display;
and determining the size of the real display according to the coordinates of the corner points of any pair of corner points.
Optionally, the method further includes:
and triggering the step of acquiring the real image in response to a set trigger event.
Optionally, the method further includes:
providing an operation entrance for receiving the number of the virtual displays;
acquiring a numerical value received through the operation entry;
and determining the numerical value as the preset number.
According to a second aspect of the present application, there is provided an apparatus for display based on a display of a head-mounted device, the apparatus comprising:
the acquisition module is used for acquiring a real image; wherein the real image comprises a real display image;
a first determining module, configured to determine, according to the real image, a target position of the real display image in the real image;
the second determining module is used for determining the display positions of a preset number of virtual display images according to the target position;
and the display module is used for displaying the real images and displaying a preset number of the virtual display images on the upper layer of the real images according to the display positions.
According to a third aspect of the application, there is provided a head-mounted device comprising an apparatus as described in the second aspect; alternatively, the first and second electrodes may be,
comprising a memory for storing computer instructions and a processor for invoking the computer instructions from the memory for performing the method according to any of the first aspects.
According to a fourth aspect of the present application, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method according to any one of the first aspects.
In the embodiment of the application, the real image is obtained; determining the target position of the real display image in the real image according to the real image; determining the display positions of a preset number of virtual display images according to the target position; displaying the real images, and displaying a preset number of virtual display images on the upper layer of the real images according to the display positions. Thus, the head-mounted equipment can display real display images and can also display a preset number of virtual display images. Through this application embodiment only need set up a reality display promptly, alright realize utilizing a plurality of displays official working, this greatly reduced the hardware cost of handling official business, still saved office space simultaneously. In addition, because the depth of the virtual display image is basically consistent with that of the real display image, when the user views the virtual display image, the focus of eyes does not need to be adjusted greatly, and therefore the visual fatigue of the user can be relieved.
Further features of the present application and advantages thereof will become apparent from the following detailed description of exemplary embodiments thereof, which is to be read in connection with the accompanying drawings.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the application and together with the description, serve to explain the principles of the application.
Fig. 1 is a block diagram of a hardware configuration of a head-mounted device for implementing a display method of a display based on the head-mounted device according to an embodiment of the present application;
fig. 2 is a flowchart of a display method based on a head-mounted device according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a display device based on a head-mounted device according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a head-mounted device according to an embodiment of the present application.
Detailed Description
Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, the numerical expressions, and numerical values set forth in these embodiments do not limit the scope of the present application unless specifically stated otherwise.
The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the application, its application, or uses.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.
In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.
< hardware configuration embodiment >
Fig. 1 is a block diagram of a hardware configuration of a head-mounted device implementing a display method based on the head-mounted device according to an embodiment of the present application.
The head-mounted device 1000 may be an augmented reality head-mounted device, a virtual reality head-mounted device, or a mixed reality head-mounted device. Additionally, the head-mounted device 1000 may be a helmet or eyeglasses.
The headset 1000 may include a processor 1100, a memory 1200, an interface device 1300, a communication device 1400, a display device 1500, an input device 1600, a speaker 1700, a microphone 1800, a depth camera 1900, and so forth. The processor 1100 may be a central processing unit CPU, a microprocessor MCU, or the like. The memory 1200 includes, for example, a ROM (read only memory), a RAM (random access memory), a nonvolatile memory such as a hard disk, and the like. The interface device 1300 includes, for example, a USB interface, a headphone interface, and the like. Communication device 1400 is capable of wired or wireless communication, for example. The display device 2500 is, for example, a liquid crystal display panel, a touch panel, or the like. The input device 1600 may include, for example, a touch screen, a keyboard, and the like. A user can input/output voice information through the speaker 1700 and the microphone 1800. Depth camera 1900 may be, for example, a 6DoF camera, and is configured to capture an image of an external environment with depth information.
Although a plurality of devices are shown for the headset 1000 in fig. 1, the present invention may relate to only some of the devices, for example, the headset 1000 may relate to only the memory 1200 and the processor 1100.
In an embodiment of the present invention, the memory 1200 of the head-mounted device 1000 is used to store instructions for controlling the processor 1100 to execute the display method of the head-mounted device according to the embodiment of the present application.
In the above description, the skilled person can design the instructions according to the solution disclosed in the present application. How the instructions control the operation of the processor is well known in the art and will not be described in detail herein.
< method examples >
The embodiment of the application provides a display method based on a head-mounted device, and an executive body of the method can be the head-mounted device 1000 shown in fig. 1.
As shown in fig. 2, the method includes the following S2100-S2400:
s2100, acquiring a real image.
The real image includes a real display image.
In the present embodiment, a real image is acquired with the depth camera 1900 in the head mount 1000. The real image is an image including a display in a real environment, that is, an image including a real display. And the real image is an image containing depth information.
In one embodiment, in order to avoid not including or including an incomplete real display image in the real image, the method for displaying a display based on a head-mounted device provided in the embodiment of the present application further includes, after S2100 described above, the following steps S2110 to S2130:
s2110, detecting whether the real image comprises the real display image.
S2120, if included, determines whether the real display image is complete.
And S2130, outputting prompt information for prompting the adjustment of the position to reacquire the real image in the incomplete condition.
Correspondingly, when the real image is not included, the prompting information for prompting the adjustment position to reacquire the real image is output. And, in the complete case, continuing to perform S2200 described below.
In one embodiment, S2110 and S2120 may be implemented by an image recognition algorithm. The image recognition algorithm may be a neural network algorithm, for example.
S2200, determining the target position of the real display image in the real image according to the real image.
In an embodiment, the specific implementation of S2200 may be: and taking the image of the real display as a target, and carrying out target detection on the image of the real display to obtain the area where the image of the real display is located. This region is taken as the position of the real display image in the real image.
In another embodiment, the above S2200 may also be implemented by the following S2210-S2230:
s2210, extracting corner points in the real image.
In this embodiment, the corner points can be extracted from the real image by a corner point detection algorithm. The corner detection algorithm may be exemplified by FAST corner method, among others.
S2220, extracting corner points of the real display from the corner points in the real image.
In this embodiment, since there is a possibility that the real image includes an image of an object other than the real display image, for example, an image of a computer desk, there are corners including other objects in the real image. On this basis, it is necessary to extract the corner points of the real display from the corner points in the real image.
In one embodiment, the above S2220 may be implemented by the following S2221:
s2221, extracting the corner points of the real display from the corner points in the real image according to the corner points in the real image and the display corner point set.
In this embodiment, the corner set of the display includes a plurality of sets of corners, and the plurality of sets of corners correspond to corners of displays of different sizes and different types. It should be noted that the display corner point set is obtained by extracting corner points of displays of different sizes and different types in advance by a technician.
In this embodiment, the corner points in the real image may be matched with each set of corner points in the display corner point set by using a corner point matching algorithm, and the corner points in the real image that can be matched with the set of corner points in the display corner point set are used as the corner points of the real display in the real image.
And S2230, determining the position of the image of the real display in the real image according to the coordinates of the corner point of the real display in the real image.
In this embodiment, the coordinates of the corner point of the real display in the real image include coordinate values and corresponding depth information.
And S2300, determining the display positions of a preset number of virtual display images according to the target position.
In this embodiment, the predetermined number is greater than or equal to 1.
In one embodiment, the predetermined number may be a default number.
In another embodiment, the user can set the specific values of the preset number according to the needs of the user. On this basis, the display method of the display based on the head-mounted device provided by the embodiment of the present application further includes the following steps S2310-S2330:
s2310, providing an operation entry for receiving the number of virtual displays.
S2320, obtaining the numerical value received through the operation entry.
S2330, determine the number as a preset number.
In the present embodiment, the relative position between the virtual display and the target position of the real display is set in advance for any one of the preset number of virtual displays. The relative position is a relative position in three dimensions. And the relative position is set with reference to a relative position between the plurality of real displays in the real environment. On this basis, after the target position of the real display is determined, the position of each virtual display can be determined based on the relative position. And the depth of the virtual display image is substantially the same as the depth of the real display image.
And S2400, displaying the real images, and displaying a preset number of virtual display images on the upper layer of the real images according to the display positions.
In one embodiment, the size of the display to which the virtual display image corresponds is a default. And after the virtual display image is displayed, office content required by the user can be displayed in the range of the image according to actual requirements.
On the basis of the above, a user can see a plurality of non-overlapping display images through the head-mounted device, wherein the plurality of display images comprise a real display image and a preset number of virtual display images. Meanwhile, based on the characteristics of the head-mounted equipment, when the user turns the head to drive the head-mounted equipment to rotate, the user can view a plurality of displays at different visual angles.
In the embodiment of the application, the real image is obtained; determining the target position of the real display image in the real image according to the real image; determining the display positions of a preset number of virtual display images according to the target position; displaying the real images, and displaying a preset number of virtual display images on the upper layer of the real images according to the display positions. Thus, the head-mounted equipment can display real display images and can also display a preset number of virtual display images. Through this application embodiment only need set up a reality display promptly, alright realize utilizing a plurality of displays official working, this greatly reduced the hardware cost of handling official business, still saved office space simultaneously. In addition, because the depth of the virtual display image is basically consistent with that of the real display image, when the user views the virtual display image, the focus of eyes does not need to be adjusted greatly, and therefore the visual fatigue of the user can be relieved.
In one embodiment, the virtual display image corresponds to a display that is the same size as the real display. On the basis, the display method of the display based on the head-mounted device provided by the embodiment of the application further includes the following step S2500:
and S2500, determining the size of the real display according to the position of the real display.
In one embodiment, the length and width of the real display are determined based on the location where the real display is displayed. And determining the size of the real display according to the length and the width.
In another embodiment, the real world display is sized according to the length of the diagonal of the real world display. On this basis, in the case where the position of the real display is represented by coordinates of the corner points, S2500 described above can be implemented by S2510 and S2520 as follows:
s2510, determining the corner coordinates of any pair of corners on the diagonal line among the corners of the real display.
And S2520, determining the size of the real display according to the coordinates of any pair of corner points.
In this embodiment, the real display is generally rectangular, and therefore, the corner points of the real display are four vertices of the real display. On the basis, the size of the real display can be determined according to the corner point coordinates of any pair of corner points on the diagonal. Specifically, the distance between any pair of corner points is determined according to the corner point coordinates of the pair of corner points, and the distance is taken as the size of the real display.
Based on the above, the displaying of the preset number of virtual display images on the upper layer of the real image according to the display position in the above S2400 may be implemented by the following S2410:
and S2410, displaying a preset number of virtual display images with the size same as that of the real display on the upper layer of the real image according to the display position.
In this embodiment, the virtual display image displayed in the head-mounted device corresponds to the size of the virtual display, and the size of the real display corresponding to the real display image displayed in the head-mounted device is the same. In this way, the user experience can be improved.
On the basis of any of the above embodiments, the method provided by the embodiment of the present application further includes the following step S2600:
and S2600, responding to the set trigger event, and triggering the step of acquiring the real image.
In this embodiment, the triggering event may trigger a button on the head-mounted device for starting the display method of the display based on the head-mounted device provided by the embodiment of the present application. The trigger event may also be a voice indicating initiation of the head-mounted device based display method provided by embodiments of the present application.
In this embodiment, in a case where a user needs to work with multiple displays, the trigger event may be input, and the method provided by the embodiment of the present application may be executed by the head-mounted device.
< apparatus embodiment >
The embodiment of the present application provides a display device 3000 of a head-mounted apparatus, where the display device 3000 includes: an acquisition module 3100, a first determination module 3200, a second determination module 3300, and a display module 3400. Wherein:
the acquisition module 3100 is for acquiring a real image; wherein the real image includes a real display image.
The first determining module 3200 is configured to determine a target position of the real display image in the real image according to the real image.
The second determining module 3300 is configured to determine display positions of a preset number of virtual display images according to the target position.
The display module 3400 is configured to display the real image, and display a preset number of the virtual display images on an upper layer of the real image according to the display position.
In one embodiment, the first determination module 3200 includes a first extraction unit, a second extraction unit, and a determination unit. Wherein:
the first extraction unit is used for extracting angular points in the reality image.
The second extraction unit is used for extracting the corner points of the real display from the corner points in the real image.
The determining unit is used for determining the position of the image of the real display in the real image according to the coordinates of the corner points of the real display in the real image.
In an embodiment, the second extraction unit is specifically configured to extract the corner points of the real display from the corner points in the real image according to the corner points in the real image and the display corner point set.
In one embodiment, the apparatus 3000 further comprises a third determining unit configured to determine a size of the real display according to the position of the real display.
In this embodiment, the display unit 3400 is specifically configured to: and displaying a preset number of virtual display images with the same size as the real display on the upper layer of the real image according to the display position.
In an embodiment, the third determining unit is specifically configured to determine, among the corner points of the real display, corner point coordinates of any pair of corner points on a diagonal; and determining the size of the real display according to the coordinates of the corner points of any pair of corner points.
In one embodiment, the apparatus 3000 further includes a triggering module, and the triggering module is configured to trigger the step of acquiring the real image in response to a set triggering event.
In one embodiment, the apparatus 3000 further comprises a providing module and a fourth determining module. Wherein:
the providing module is used for providing an operation entrance for receiving the number of the virtual displays.
The obtaining module is further configured to obtain the numerical value received through the operation entry.
And the fourth determining module is used for determining the numerical value as the preset number.
< apparatus embodiment >
The embodiment of the application provides a head-mounted device 1000, which comprises a display device based on the head-mounted device, provided by the embodiment of the device; alternatively, the first and second electrodes may be,
comprising a memory 1200 and a processor 1100, said memory 1200 being adapted to store computer instructions, said processor 1100 being adapted to retrieve said computer instructions from said memory 1200 for performing the method according to any of the above described method embodiments.
< storage Medium embodiment >
The present application provides a computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements the method according to any one of the above method embodiments.
The present application may be a system, method and/or computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied thereon for causing a processor to implement various aspects of the present application.
The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.
The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.
The computer program instructions for carrying out operations of the present application may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, the electronic circuitry can execute computer-readable program instructions to implement aspects of the present application by utilizing state information of the computer-readable program instructions to personalize the electronic circuitry, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA).
Various aspects of the present application are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.
These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, by software, and by a combination of software and hardware are equivalent.
Having described embodiments of the present application, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terms used herein were chosen in order to best explain the principles of the embodiments, the practical application, or technical improvements to the techniques in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the application is defined by the appended claims.
Claims (10)
1. A display method based on a head-mounted device is characterized by comprising the following steps:
acquiring a real image; wherein the real image comprises a real display image;
determining a target position of the real display image in the real image according to the real image;
determining the display positions of a preset number of virtual display images according to the target position;
displaying the real images, and displaying a preset number of virtual display images on the upper layer of the real images according to the display positions.
2. The method of claim 1, wherein determining the target location of the real display image in the real image from the real image comprises:
extracting angular points in the reality image;
extracting corner points of the real display from the corner points in the real image;
and determining the position of the image of the real display in the real image according to the coordinates of the corner points of the real display in the real image.
3. The method of claim 2, wherein the extracting the corner points of the real display from the corner points in the real image comprises:
and extracting the corner points of the real display from the corner points in the real image according to the corner points in the real image and the display corner point set.
4. The method of claim 2, further comprising:
determining the size of the real display according to the position of the real display;
the displaying a preset number of the virtual display images on the upper layer of the real image according to the display position includes:
and displaying a preset number of virtual display images with the same size as the real display on the upper layer of the real image according to the display position.
5. The method of claim 4, wherein determining the size of the real display based on the position of the real display comprises:
determining corner coordinates of any pair of corner points on a diagonal line in the corner points of the real display;
and determining the size of the real display according to the coordinates of the corner points of any pair of corner points.
6. The method of claim 1, further comprising:
and triggering the step of acquiring the real image in response to a set trigger event.
7. The method of claim 1, further comprising:
providing an operation entrance for receiving the number of the virtual displays;
acquiring a numerical value received through the operation entry;
and determining the numerical value as the preset number.
8. An apparatus for display based on a head-mounted device, the apparatus comprising:
the acquisition module is used for acquiring a real image; wherein the real image comprises a real display image;
a first determining module, configured to determine, according to the real image, a target position of the real display image in the real image;
the second determining module is used for determining the display positions of a preset number of virtual display images according to the target position;
and the display module is used for displaying the real images and displaying a preset number of the virtual display images on the upper layer of the real images according to the display positions.
9. A headset comprising the apparatus of claim 8; alternatively, the first and second electrodes may be,
comprising a memory for storing computer instructions and a processor for invoking the computer instructions from the memory to perform the method of any of claims 1-7.
10. A computer-readable storage medium, characterized in that a computer program is stored thereon, which computer program, when being executed by a processor, carries out the method according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011401355.3A CN112506463A (en) | 2020-12-04 | 2020-12-04 | Display method, device and equipment based on head-mounted equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011401355.3A CN112506463A (en) | 2020-12-04 | 2020-12-04 | Display method, device and equipment based on head-mounted equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112506463A true CN112506463A (en) | 2021-03-16 |
Family
ID=74968242
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011401355.3A Pending CN112506463A (en) | 2020-12-04 | 2020-12-04 | Display method, device and equipment based on head-mounted equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112506463A (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103049728A (en) * | 2012-12-30 | 2013-04-17 | 成都理想境界科技有限公司 | Method, system and terminal for augmenting reality based on two-dimension code |
| CN108038916A (en) * | 2017-12-27 | 2018-05-15 | 上海徕尼智能科技有限公司 | A kind of display methods of augmented reality |
| CN108377361A (en) * | 2016-11-14 | 2018-08-07 | 杭州海康威视数字技术股份有限公司 | A kind of display control method and device of monitor video |
| CN108520552A (en) * | 2018-03-26 | 2018-09-11 | 广东欧珀移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
| US20180332335A1 (en) * | 2017-05-15 | 2018-11-15 | Daqri, Llc | Virtual expansion of desktop |
| CN109255819A (en) * | 2018-08-14 | 2019-01-22 | 清华大学 | Kinect scaling method and device based on plane mirror |
| CN109903129A (en) * | 2019-02-18 | 2019-06-18 | 北京三快在线科技有限公司 | Augmented reality display methods and device, electronic equipment, storage medium |
| US20190250873A1 (en) * | 2018-02-13 | 2019-08-15 | SentiAR, Inc. | Augmented Reality Display Sharing |
| CN111178127A (en) * | 2019-11-20 | 2020-05-19 | 青岛小鸟看看科技有限公司 | Method, apparatus, device and storage medium for displaying image of target object |
| CN111427446A (en) * | 2020-03-04 | 2020-07-17 | 青岛小鸟看看科技有限公司 | Virtual keyboard display method and device of head-mounted display equipment and head-mounted display equipment |
-
2020
- 2020-12-04 CN CN202011401355.3A patent/CN112506463A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103049728A (en) * | 2012-12-30 | 2013-04-17 | 成都理想境界科技有限公司 | Method, system and terminal for augmenting reality based on two-dimension code |
| CN108377361A (en) * | 2016-11-14 | 2018-08-07 | 杭州海康威视数字技术股份有限公司 | A kind of display control method and device of monitor video |
| US20180332335A1 (en) * | 2017-05-15 | 2018-11-15 | Daqri, Llc | Virtual expansion of desktop |
| CN108038916A (en) * | 2017-12-27 | 2018-05-15 | 上海徕尼智能科技有限公司 | A kind of display methods of augmented reality |
| US20190250873A1 (en) * | 2018-02-13 | 2019-08-15 | SentiAR, Inc. | Augmented Reality Display Sharing |
| CN108520552A (en) * | 2018-03-26 | 2018-09-11 | 广东欧珀移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
| CN109255819A (en) * | 2018-08-14 | 2019-01-22 | 清华大学 | Kinect scaling method and device based on plane mirror |
| CN109903129A (en) * | 2019-02-18 | 2019-06-18 | 北京三快在线科技有限公司 | Augmented reality display methods and device, electronic equipment, storage medium |
| CN111178127A (en) * | 2019-11-20 | 2020-05-19 | 青岛小鸟看看科技有限公司 | Method, apparatus, device and storage medium for displaying image of target object |
| CN111427446A (en) * | 2020-03-04 | 2020-07-17 | 青岛小鸟看看科技有限公司 | Virtual keyboard display method and device of head-mounted display equipment and head-mounted display equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102038639B1 (en) | Touch screen hover detection in augmented reality and / or virtual reality | |
| US20160180594A1 (en) | Augmented display and user input device | |
| US11880956B2 (en) | Image processing method and apparatus, and computer storage medium | |
| US20170153698A1 (en) | Method and apparatus for providing a view window within a virtual reality scene | |
| CN110928627B (en) | Interface display method and device, electronic equipment and storage medium | |
| CN107209568A (en) | Phone control and presence in virtual reality | |
| WO2022188305A1 (en) | Information presentation method and apparatus, and electronic device, storage medium and computer program | |
| CN115617166A (en) | Interaction control method and device and electronic equipment | |
| CN110036356B (en) | Image processing in VR systems | |
| CN112506463A (en) | Display method, device and equipment based on head-mounted equipment | |
| CN111968176A (en) | Method, device and equipment for determining pose of head-mounted equipment and storage medium | |
| CN115576457A (en) | Display control method and device, augmented reality head-mounted device and medium | |
| CN115599206A (en) | Display control method, display control device, head-mounted display equipment and medium | |
| CN111105440A (en) | Method, device and equipment for tracking target object in video and storage medium | |
| CN106598247B (en) | Response control method and device based on virtual reality | |
| CN111427446A (en) | Virtual keyboard display method and device of head-mounted display equipment and head-mounted display equipment | |
| CN112288889A (en) | Indication information display method and device, computer equipment and storage medium | |
| CN106775245B (en) | User attribute setting method and device based on virtual reality | |
| CN112035771A (en) | Web-based camera data drawing method and device and electronic equipment | |
| US20200012855A1 (en) | Operation assistance apparatus, operation assistance method, and computer readable recording medium | |
| US11783724B1 (en) | Interactive training apparatus using augmented reality | |
| CN114442804A (en) | Boundary generation method and device, head-mounted display equipment and readable storage medium | |
| CN117215688A (en) | Control method, control device, electronic equipment and medium | |
| CN115617165A (en) | Display control method, display control device, head-mounted display equipment and medium | |
| CN115713562A (en) | Camera calibration method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20221130 Address after: No. 500, Songling Road, Laoshan District, Qingdao, Shandong 266101 Applicant after: GOERTEK TECHNOLOGY Co.,Ltd. Address before: 261031 north of Yuqing street, east of Dongming Road, high tech Zone, Weifang City, Shandong Province (Room 502, Geer electronics office building) Applicant before: GoerTek Optical Technology Co.,Ltd. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210316 |