CN111260792A - Virtual content display method and device, terminal equipment and storage medium - Google Patents

Abstract

The embodiment of the application discloses a virtual content display method, a virtual content display device, terminal equipment and a storage medium, and relates to the technical field of display. The virtual content display method is applied to terminal equipment and comprises the following steps: acquiring an image comprising a solid object, the solid object comprising at least one marker; identifying a marker in the image, and acquiring relative spatial position information between the terminal equipment and the entity object; displaying a first virtual picture containing at least one first virtual option according to the relative spatial position information, wherein the first virtual option corresponds to at least one second virtual option; and switching and displaying the first virtual picture into a second virtual picture containing a second virtual option according to a first instruction of the first virtual option. The method can realize the augmented reality display of the multi-level options and improve the display effect.

Description

Virtual content display method and device, terminal equipment and storage medium

Technical Field

The present application relates to the field of display technologies, and in particular, to a method and an apparatus for displaying virtual content, a terminal device, and a storage medium.

Background

With the development of science and technology, machine intellectualization and information intellectualization are increasingly popularized, and the technology of identifying user images through image acquisition devices such as machine vision or virtual vision and the like to realize human-computer interaction is more and more important. Augmented Reality (AR) constructs virtual content that does not exist in a real environment by means of a computer graphics technology and a visualization technology, accurately fuses the virtual content into a real environment by means of an image recognition and positioning technology, fuses the virtual content and the real environment into a whole by means of a display device, and displays the virtual content to a user for real sensory experience. The first technical problem to be solved by the augmented reality technology is how to accurately fuse virtual content into the real world, that is, to make the virtual content appear at the correct position of the real scene with the correct angular pose, so as to generate strong visual reality. Therefore, how to improve the display effect of the virtual content is an important research direction for augmented reality or mixed reality.

Disclosure of Invention

In view of the foregoing problems, embodiments of the present application provide a method and an apparatus for displaying virtual content, a terminal device, and a storage medium, which can improve the display effect of multi-level options.

In a first aspect, an embodiment of the present application provides a virtual content display method, which is applied to a terminal device, and the method includes: acquiring an image comprising a solid object, the solid object comprising at least one marker; identifying a marker in the image, and acquiring relative spatial position information between the terminal equipment and the entity object; displaying a first virtual picture containing at least one first virtual option according to the relative spatial position information, wherein the first virtual option corresponds to at least one second virtual option; and switching and displaying the first virtual picture into a second virtual picture containing a second virtual option according to a first instruction of the first virtual option.

In a second aspect, an embodiment of the present application provides a virtual content display apparatus, which is applied to a terminal device, and the apparatus includes: the system comprises an image acquisition module, a position acquisition module, a display module and a control module, wherein the image acquisition module is used for acquiring an image containing an entity object, and the entity object comprises at least one marker; the position acquisition module is used for identifying a marker in the image and acquiring relative spatial position information between the terminal equipment and the entity object; the display module is used for displaying a first virtual picture containing at least one first virtual option according to the relative spatial position information, wherein the first virtual option corresponds to at least one second virtual option; the control module is used for switching and displaying the first virtual picture into a second virtual picture containing a second virtual option according to a first instruction of the first virtual option.

In a third aspect, an embodiment of the present application provides a terminal device, including: one or more processors, a memory, and one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the virtual content display method provided by the first aspect above.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where a program code is stored in the computer-readable storage medium, and the program code may be called by a processor to execute the virtual content display method provided in the first aspect.

The scheme provided by the application is applied to the terminal equipment, the image containing the entity object is collected, the marker in the image is identified, the relative space position information between the terminal equipment and the entity object is obtained, then the first virtual picture containing at least one first virtual option is displayed according to the relative space position information, the first virtual option corresponds to at least one second virtual option, and then the first virtual picture is switched and displayed to be the second virtual picture containing the second virtual option according to the first instruction of the first virtual option. Therefore, the multi-level virtual options are displayed in the virtual space according to the spatial position of the entity object, so that a user can observe the effect that the multi-level virtual options are superposed on the real world, the augmented reality display of the multi-level options is realized, and the display effect of the multi-level options is improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 shows a schematic diagram of an application environment suitable for the embodiment of the present application.

Fig. 2 shows a schematic structural diagram of an entity object suitable for the embodiment of the present application.

FIG. 3 shows a flow diagram of a virtual content display method according to one embodiment of the present application.

Fig. 4 shows a schematic diagram of a display effect according to an embodiment of the application.

Fig. 5 shows another display effect diagram according to an embodiment of the application.

Fig. 6 shows a schematic diagram of another display effect according to an embodiment of the application.

Fig. 7 is a schematic diagram illustrating a further display effect according to an embodiment of the application.

FIG. 8 shows a flow diagram of a method of virtual content display according to another embodiment of the present application.

Fig. 9 shows a flowchart of step S230 in the virtual content display method according to the embodiment of the present application.

Fig. 10 shows a schematic diagram of a display effect according to an embodiment of the application.

Fig. 11 shows another display effect diagram according to an embodiment of the application.

Fig. 12 is a flowchart illustrating step S240 in the virtual content display method according to the embodiment of the present application.

Fig. 13 is a schematic diagram illustrating still another display effect according to an embodiment of the application.

FIG. 14 shows a block diagram of a virtual content display apparatus according to one embodiment of the present application.

Fig. 15 is a block diagram of a terminal device for executing a virtual content display method according to an embodiment of the present application.

Detailed Description

In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.

Currently, in many application scenarios, such as information retrieval, news, shopping, software downloading, etc., navigation menus with different categories exist to present different categories of information content to users, and such menus are often presented in a multi-level option manner. However, in the conventional multi-level option display, a multi-level option list is usually displayed by using a display screen of an electronic device, so that a user performs relevant operations, such as selecting, determining and the like, on an option of a certain level of the multi-level options to fulfill the purpose of the requirement. For example, when a user needs to download game software, a mobile terminal such as a tablet or a mobile phone is usually used to display various multi-level options related to a game (such as game options of continuous watching, tank fighting, and the like) on a display screen of the mobile terminal, and then a game option (such as tank fighting) in a multi-level option list displayed on the display screen is selected and determined to achieve the purpose of downloading the game of the user. However, the multi-level options displayed in such a display manner are not good in display effect.

In view of the above problems, the inventors have developed a virtual content display method, an apparatus, a terminal device, and a storage medium in the embodiments of the present application to perform augmented reality display on a multi-level option, so as to improve a display effect of the multi-level option. Augmented Reality (AR) is a technology for increasing the perception of a user to the real world through information provided by a computer system, and superimposes a virtual object, a scene, or content objects such as system prompt information generated by a computer to a real scene to enhance or modify the perception of the real world environment or data representing the real world environment.

Referring to fig. 1, a schematic view of an application scenario of the virtual content display method provided in the embodiment of the present application is shown, where the application scenario includes a display system 10 provided in the embodiment of the present application. The display system 10 includes: a terminal device 100 and an entity object 200.

In the embodiment of the present application, the terminal device 100 may be a head-mounted display device, or may be a mobile device such as a mobile phone and a tablet. When the terminal device 100 is a head-mounted display device, the head-mounted display device may be an integrated head-mounted display device. The terminal device 100 may also be an intelligent terminal such as a mobile phone connected to an external head-mounted display device, that is, the terminal device 100 may be inserted or connected to the external head-mounted display device as a processing and storage device of the head-mounted display device, and display virtual content in the head-mounted display device.

In an embodiment of the present application, the solid object 200 may be a polyhedral marker, which may include a plurality of faces, a plurality of edges, and a plurality of vertices. Specifically, the solid object 200 includes a plurality of marking surfaces, and at least two of the marking surfaces that are not coplanar are provided with the markers 201. In some embodiments, marker 201 may include at least one sub-marker having one or more feature points.

In the embodiment of the present application, the specific morphological structure of the entity object 200 is not limited, and may be a polyhedron in which a plane is combined with a curved surface, or a polyhedron in which a curved surface is combined with a curved surface. In some embodiments, the entity object 200 may be a combination of any one or more of the following structures: a pyramid, a prism, a truncated pyramid, a polyhedron, a sphere, but a sphere can be understood to be a polyhedron formed by numerous faces.

In the embodiment of the present application, when the physical object 200 is located in the visual field of the terminal device 100, the terminal device 100 may acquire an image of the physical object 200, identify marker 201 information on the physical object 200 in the image, obtain spatial position information such as a position and an orientation of the terminal device 100 relative to the physical object 200, and identification results such as identity information of the marker 201, and then the terminal device 100 may display corresponding virtual content based on the spatial position information. The specific marker 201 is not limited in the embodiment of the present application, and only needs to be identified and tracked by the terminal device 100.

In some embodiments, different markers 201 on the physical object 200 may rotate or/and displace within the field of view of the terminal device 100, so that the terminal device 100 may acquire information of the markers 201 on the physical object 200 in real time, and further acquire spatial position information of the physical object 200, so that the terminal device 100 displays corresponding virtual content according to the spatial position information.

For example, referring to fig. 1 again, the user can scan the physical object 200 in real time through the head-mounted display device 100 worn by the user, so as to see the superimposed display of the virtual space scene containing a plurality of virtual stars and the real space, which embodies the augmented reality display effect of the virtual content and improves the display effect of the virtual content.

Referring to fig. 2, fig. 2 shows a schematic diagram of a solid object 200 provided by an embodiment of the present application, the solid object 200 is a twenty-hexagonal body, and includes eighteen square faces and eight triangular faces, where the eighteen square faces are all marking faces, and each marking face is provided with markers, and patterns of the markers on each face are different from each other. Specifically, the first surface 202 of the solid object 200 is provided with a first marker 203, and the second surface 204 is provided with a second marker 205 different from the first marker 203. The terminal device 100 recognizes either one or both of the first marker 203 and the second marker 205, and further acquires spatial position information of the physical object 200. It is to be understood that the entity object is not limited to the form shown in fig. 2, and may be in other forms, which are not limited herein.

Based on the display system, the embodiment of the present application provides a virtual content display method, which is applied to a terminal device and an entity object of the display system, acquires an image including the entity object, identifies a marker in the image to obtain relative spatial position information between the terminal device and the entity object, and displays a first virtual picture including at least one first virtual option according to the relative spatial position information, wherein the first virtual option corresponds to at least one second virtual option, and switches and displays the first virtual picture into a second virtual picture including the second virtual option according to a first instruction for the first virtual option, so as to display a multi-level virtual option in a virtual space according to a spatial position of the entity object, so that a user can observe an effect of superimposing the multi-level virtual option on a real world, the enhanced display of the multi-level options is realized, and the display effect of the multi-level options is improved. A specific virtual content display method will be described below.

Referring to fig. 3, an embodiment of the present application provides a virtual content display method, which is applicable to a terminal device, and the virtual content display method may include:

step S110: an image is acquired that includes a solid object that includes at least one marker.

Because the display effect of the multi-level options displayed on the display screens of the electronic devices such as the mobile phone and the tablet is poor, the multi-level options can achieve the display effect of augmented reality so as to improve the display effect. In this embodiment of the application, when it is required to display the multi-level virtual option in the virtual space, the terminal device may collect an image including the physical object, so as to determine a spatial position of the physical object. Wherein the physical object comprises at least two different markers that are not coplanar.

In the embodiment of the present application, the entity object is a polyhedral marker having a polyhedral structure, and may be a tetrahedral marker, a hexahedral marker, a hexacosanal marker, or the like, and may also be a polyhedral marker with other numbers of faces, which are not listed here. In one form, the polyhedral marker includes a plurality of marker faces, and wherein at least two of the non-coplanar marker faces have different markers disposed thereon.

In some embodiments, the marker may include at least one sub-marker, and the sub-marker may be a pattern having a shape. In one embodiment, each sub-marker may have one or more feature points, wherein the shape of the feature points is not limited, and may be a dot, a ring, a triangle, or other shapes. In addition, the distribution rules of the sub-markers within different markers are different, and thus, each marker may have different identity information. The terminal device may acquire identity information corresponding to the tag by identifying the sub-tag included in the tag, and the identity information may be information that can be used to uniquely identify the tag, such as a code, but is not limited thereto.

In one embodiment, the outline of the marker may be rectangular, but the shape of the marker may be other shapes, and the rectangular region and the plurality of sub-markers in the region constitute one marker. It should be noted that the shape, style, size, color, number of feature points, and distribution of the specific marker are not limited in this embodiment, and only the marker needs to be identified and tracked by the terminal device.

In the embodiment of the application, the entity object can be arranged at a position within the visual field range of the terminal equipment. When the terminal equipment needs to display the multi-level virtual options, the image acquisition device can be used for acquiring images of the entity objects positioned in the visual field range of the terminal equipment. The field of view of the terminal device refers to the field of view of the image capturing device of the terminal device, and the field of view of the image capturing device may be determined by the size of the field of view. In some embodiments, the image containing the solid object may be stored in the terminal device after being acquired by the image acquisition device, so as to determine information such as a position or a posture of the terminal device relative to the solid object.

Further, the spatial position of the solid object can be adjusted so that the solid object is within the visual field of the image acquisition device of the terminal device, so that the terminal device can perform image acquisition and image recognition on the solid object.

It can be understood that, since the physical object includes at least one marker, when the terminal device acquires the image including the physical object, the terminal device may also acquire the marker of the physical object. In some embodiments, all markers that may be physical objects are within the field of view of the image capture device, such that the markers in the image captured by the terminal device may be all markers of the physical object. In other embodiments, some of the markers that may be solid objects are within the field of view of the image capture device, and thus the markers in the image captured by the terminal device may be part of the markers of the solid objects.

In some embodiments, the physical object may include at least two different markers that are not coplanar. When the image containing the marker on the certain surface of the solid object needs to be acquired, the orientation and the rotation angle of the solid object relative to the terminal device can be changed by rotating the solid object, so that the terminal device can acquire the marker on the certain surface of the solid object. Similarly, by rotating the solid object, markers on multiple faces of the solid object may also be acquired.

Step S120: and identifying the marker in the image, and acquiring relative spatial position information between the terminal equipment and the entity object.

Because the terminal device collects the marker in the entity object after collecting the image containing the entity object, when the multi-level virtual option needs to be displayed in the virtual space, the terminal device can identify the marker in the collected image to obtain the relative spatial position information between the terminal device and the entity object. The relative spatial position information may include position information and posture information of the terminal device relative to the entity object, and the posture information is an orientation and a rotation angle of the terminal device relative to the entity object.

Since the solid object includes at least one marker, in some embodiments, the number of markers in the image may be one. In one embodiment, the spatial position information of the terminal device relative to the physical object may be obtained by recognizing spatial position information of one marker in the image relative to the terminal device and based on a position of the marker relative to another marker of the physical object, which is stored in advance.

In other embodiments, the number of markers in the image may be multiple. As one mode, the spatial position information of the terminal device relative to the entity object may be obtained by identifying the spatial position information of each marker in the plurality of markers relative to the terminal device and according to the spatial position information of each marker relative to the terminal device. For example, the marker in the image recognized by the terminal device includes a first marker and a second marker, the second marker is different from the first marker, and the terminal device may calculate the relative positions and rotational relationships between the first marker and the terminal device and the second marker, respectively, to determine the spatial position information of the terminal device relative to the entity object.

It is understood that in order to accurately obtain the relative spatial position information between the terminal device and the physical object, a plurality of markers may be disposed on the physical object.

Step S130: and displaying a first virtual picture containing at least one first virtual option according to the relative spatial position information, wherein the first virtual option corresponds to at least one second virtual option.

In this embodiment, the first virtual option may be any option in any hierarchy of the multiple hierarchy options. For example, in a virtual game scenario, if a first level of the multi-level options is a game category, the level options include shooting category and educational category, and a second level is a game application, the level options include gobang and tank war, the first virtual option may be an option of the first level game category, and may also be an option of the second level game application. Of course, the above scenario and the first virtual option are only examples, and do not represent a limitation on the first virtual option in the embodiment of the present application.

In some embodiments, when it is required to implement multiple levels of virtual options to be displayed in the virtual space, the terminal device may display the same level of virtual options. Specifically, after obtaining the spatial position information of the terminal device relative to the entity object, a first virtual screen to be displayed may be displayed in the virtual space according to the spatial position information, where the first virtual screen includes at least one first virtual option. It is understood that, when there are a plurality of first virtual options in the first virtual screen, the plurality of first virtual options are options in the same hierarchy.

The relative space position information obtained by the terminal device includes the position, the orientation and the rotation angle of the terminal device relative to the entity object, so that the space position coordinate of the entity object in the real space can be obtained, then the space position coordinate can be converted into the space coordinate in the virtual space, and the rendering coordinate for rendering each first virtual option in the virtual space is obtained according to the position relation between the first virtual option to be displayed and the entity object, so that the corresponding first virtual option is rendered according to the rendering coordinate of each first virtual option, and the first virtual picture is generated and displayed.

Specifically, after the space coordinates of the entity object in the real space are converted into rendering coordinates of the virtual space, the terminal device may obtain data of a first virtual option to be displayed, then construct the first virtual option according to the data of the first virtual option, and render the first virtual option according to the rendering coordinates of the first virtual option, so as to generate and display the first virtual picture. The data of the first virtual option to be displayed may include model data of the at least one first virtual option, where the model data is data used for rendering virtual content, such as color data, vertex data, and contour data used for modeling. As one way, the model data of the at least one first virtual option may be pre-stored in the terminal device (or may be downloaded from a server or obtained from another terminal).

Through the method, the first virtual picture containing at least one first virtual option is displayed in the virtual space by utilizing the relative space position information between the entity object and the terminal equipment. For example, in a virtual zoo scene, please refer to fig. 4, a user scans the physical object 200 through the head-mounted display device 100 worn by the user, and can see that the first virtual screen 300 is superimposed with the real space for display, wherein the first virtual screen 300 includes a plurality of first virtual options such as a dolphin 301, an octopus 302, a goldfish 303, and the like, so that the display effect of augmented reality of the virtual options is achieved, and the display effect of the virtual options is improved.

In this embodiment, the second virtual option is any one of multiple levels of options, and the level of the second virtual option is different from the level of the first virtual option. For example, in the virtual game scenario, if the multi-level options further include game information at a third level, the level of options includes game introduction, game video and the like, when the first virtual option is a gobang option at a second level, the second virtual option may be any option at any level except the second level of options, such as a shooting option at the first level, a game introduction option at the third level and the like. Of course, the above scenario and the second virtual option are only examples, and do not represent a limitation on the second virtual option in the embodiment of the present application.

In one embodiment, the second virtual option is at an adjacent level to the first virtual option, which may be a parent level (i.e., a previous level) or a child level (i.e., a next level) of the first virtual option. Further, the first virtual option corresponds to at least one second virtual option. When the second virtual option is multiple, the multiple second virtual options are options of the same level. In some embodiments, the hierarchy in which the second virtual option is located may be subordinate to the hierarchy in which the first virtual option is located, and the corresponding second virtual option of each first virtual option may be different, and the second virtual option belongs to a sub-hierarchy option of the corresponding first virtual option. Therefore, the first virtual option corresponds to at least one second virtual option, and it is understood that one parent option corresponds to at least one child option, the first virtual option is a parent option of the second virtual option, and the corresponding second virtual option is a child option of the first virtual option.

For example, the first virtual option is located at a level of different parks in the virtual zoo, and the second virtual option is located at a level subordinate to the level of the first virtual option when the second virtual option is located at a level of different animals in the park. If the first virtual option is a marine zoo, the at least one second virtual option corresponding to the first virtual option may be one or more virtual marine animals, such as virtual jellyfish, virtual whales, etc. If the first virtual option is a bird park, the at least one second virtual option corresponding to the first virtual option may be one or more virtual birds, such as, but not limited to, virtual carve, virtual eagle, etc.

In other embodiments, the first virtual option is at a level subordinate to the level at which the second virtual option is at, and the corresponding second virtual option may be an option of a parent level of the first virtual option. And one second virtual option exists in the at least one second virtual option and is a parent option of the first virtual option. Therefore, the first virtual option corresponds to at least one second virtual option, and it is understood that one sub option corresponds to at least one option of the parent hierarchy.

For example, if the first virtual option is at a level of different animals in the marine zoo, the options for the level include: virtual jellyfish, virtual whale and the like, wherein the second virtual option is positioned in different parks in the virtual zoo at a hierarchy, and the options of the hierarchy comprise: and when the bird garden, the panda garden, the marine life garden and the like exist, the level of the first virtual option is subordinate to the level of the second virtual option. If the first virtual option is a virtual jellyfish, the corresponding at least one second virtual option is one or more options of a father level, namely one or more parks in a virtual zoo, such as a bird park, a panda park, a marine zoo and the like, wherein the marine zoo is a father option of the virtual jellyfish.

It is understood that the corresponding relationship between the first virtual option and the second virtual option may be pre-stored in the terminal device (or may be downloaded from a server or obtained from another terminal).

Step S140: and switching and displaying the first virtual picture into a second virtual picture containing a second virtual option according to a first instruction of the first virtual option.

In some embodiments, after the display of the first virtual screen, when it is required to display a multi-level virtual option in a virtual space, the terminal device may acquire a first instruction for the first virtual option, and switch the currently displayed first virtual screen to a second virtual screen including a second virtual option for display according to the first instruction, where the second virtual option corresponds to the first virtual option in the first virtual screen.

It is understood that after acquiring the first instruction for the first virtual option, the terminal device may also display a second virtual screen containing a second virtual option according to the relative spatial position information. The display principle of the second virtual frame may refer to the display principle of the first virtual frame, and is not repeated herein.

Therefore, the expanded display of the virtual options is realized by switching the currently displayed first virtual picture to the second virtual picture for displaying, so that the multi-level virtual options are displayed in the virtual space, and a user can observe the effect that the multi-level virtual options are superposed on the real world.

In one embodiment, the expanded display of the multi-level options may be performed according to a first instruction, where the first instruction may be an instruction to enter a next level, and then one option in a parent level may be determined first, and then sub-level options of the option may be expanded and displayed, for example, sub-level options of a zoo option (each garden option of a zoo) may be displayed; the first instruction may also be an instruction to enter a previous level, and the parent option corresponding to the sub-level option may be determined first, and then one or more options in a level where the parent option is located are displayed, for example, the parent options of the panda animals (different parks of a zoo, such as a panda museum, a marine museum, a penguin museum, and the like) are displayed. Therefore, the switching of the display of the first virtual screen to the second virtual screen of the second virtual option may be performed by switching the first virtual screen currently displaying the option of the parent hierarchy to the second virtual screen including the option of the child hierarchy, or by switching the first virtual screen currently displaying the option of the child hierarchy to the second virtual screen including the option of the parent hierarchy.

For example, in a virtual zoo scenario, please refer to fig. 4 and 5, fig. 5 shows different parks of the virtual zoo, and fig. 4 shows different virtual animals in a certain park. If the currently displayed first virtual screen is shown in fig. 5, when the terminal device 100 receives a first instruction to enter the next hierarchy level, the currently displayed first virtual screen (shown in fig. 5) may be switched to a second virtual screen (shown in fig. 4); if the currently displayed first virtual screen is shown in fig. 4, when the terminal device 100 receives a first instruction to enter the previous layer, the currently displayed first virtual screen (shown in fig. 4) may be switched to the second virtual screen (shown in fig. 5).

In the embodiment of the application, the virtual screen can be switched according to the first instruction of the first virtual option. The first instruction is used for controlling the switching display effect between different virtual pictures.

As one way, the first instruction may be generated by collecting a user operation on the physical object. The entity object comprises at least one control area, and the control area can comprise at least one of a touch screen and a key. In some embodiments, the user's operation on the physical object may include, but is not limited to, a single-finger slide, click, press, multi-finger fit slide, etc. acting on the manipulation region of the physical object to control the switching display effect of the virtual screen. For example, referring to fig. 2, eight triangular faces in the twenty-hexahedral solid object 200 are all manipulation areas.

As another mode, the first instruction may be generated according to a gesture of a user, specifically, the terminal device scans the user in real time through a camera, recognizes the gesture of the user, generates the first instruction, and performs switching display of the virtual screen according to the first instruction. In some embodiments, the user's gesture may be raising, falling, waving left or right, etc. to control the switching display effect of the virtual screen. Of course, the above gestures of the user are only examples, and do not represent a limitation of the gestures of the user in the embodiment of the present application.

For example, the currently displayed first virtual screen is an option of a panda park, a bird park, or the like, and the second virtual screen to be displayed is an option of a movie of a bird, a body shape of a bird, or the like, and the terminal device may switch and display the currently displayed first virtual screen including the option of the panda park, the bird park, or the like to the second virtual screen including the option of the movie of the bird, the sound of the bird, the body shape of the bird, or the like, according to a pressing operation performed by the user in the control area of the physical object. The currently displayed first virtual screen including options such as a panda garden and a bird garden may be switched and displayed to a second virtual screen including options such as a movie of a bird, a song of a bird, and a body shape of a bird according to a gesture of waving a hand left or right of the user.

Furthermore, when the terminal device displays the second virtual screen, corresponding audio playing can be performed. For example, when the second virtual option displayed by the terminal device is a movie of a bird, the terminal device can play a bird call.

In some embodiments, the second virtual screen may also include the first virtual screen, that is, the second virtual screen displayed by the terminal device includes the first virtual option and the second virtual option.

For example, in a medical scenario, referring to fig. 6 as one way, a user scans a physical object 200 via a mobile device 100, and may see that the displayed second virtual frame 400 includes only a heart model 402; as another way, referring to fig. 7, the user scans the physical object 200 through the mobile device 100, and can see that the displayed second virtual screen 400 includes a medical human body model 401 and a heart model 402, where the medical human body model 401 is a first virtual option and the heart model 402 is a second virtual option.

It is understood that the terminal device may perform the display of the second virtual screen by detecting the spatial position information of the physical object in real time, and then the terminal device displays the second virtual screen in the virtual space according to the spatial position information.

The virtual content display method provided by the embodiment of the application acquires and identifies the markers on the entity object to obtain the spatial position information of the terminal equipment relative to the entity object, and displays a first virtual picture containing at least one first virtual option according to the relative spatial position information, wherein the first virtual option corresponds to at least one second virtual option, and the first virtual picture is switched and displayed to be a second virtual picture containing the second virtual option according to a first instruction of the first virtual option, therefore, the multi-level options are not displayed on the display screen of the electronic equipment, but the virtual options are expanded and displayed according to the spatial position information of the entity object, so that the multi-level virtual options are displayed in the virtual space, a user can observe the effect that the multi-level virtual options are superposed on the real world, and the display effect of the multi-level options is improved.

Referring to fig. 8, another embodiment of the present application provides a virtual content display method, which is applicable to a terminal device, and the method may include:

step S210: an image is acquired that includes a solid object that includes at least one marker.

As an embodiment, the acquiring the image including the physical object may be acquiring a scene image of an environment in which the physical object is located, where the scene image includes an image of the physical object. As another embodiment, the capturing of the image including the physical object may be capturing only the image of the physical object without capturing the scene image of the environment where the physical object is located.

Step S220: and identifying the marker in the image, and acquiring relative spatial position information between the terminal equipment and the entity object.

In some embodiments, after the terminal device recognizes the marker in the image, the identity information of the marker may also be obtained, that is, after the terminal device recognizes the marker in the image, the terminal device may obtain the relative spatial position information between the terminal device and the entity object, and the identity information of the marker.

Further, at least one virtual option corresponding to the identity information may be acquired, where a correspondence between the identity information of the marker and the virtual option is stored in the terminal device, and therefore, the virtual option corresponding to the identity information of the marker may be acquired according to the identity information of the marker and the correspondence.

In some embodiments, different markers may correspond to different virtual options in the same scene, for example, in a virtual zoo scene, please refer to fig. 2 and 4, marker 203 corresponds to dolphin 301, marker 204 corresponds to octopus 302; the method can also correspond to virtual options under different scenes, for example, under a virtual game scene, the marker 1 corresponds to a game downloading option, the marker 2 corresponds to a game video option, under a commodity purchasing scene, the marker 1 corresponds to a jacket option, and the marker 2 corresponds to a casual pants option; the method can also correspond to virtual options of different levels in multi-level virtual options, for example, in a parent level option, the marker 1 corresponds to a continuous-viewing option, the marker 2 corresponds to a tank war option, in a sub-level option of the continuous-viewing option, the marker 1 corresponds to a continuous-viewing introduction option, and the marker 2 corresponds to a continuous-viewing download option. Of course, the above virtual options and application scenarios are only examples, and do not represent limitations on the virtual options and application scenarios in the embodiments of the present application.

In some embodiments, different sub-markers of the same marker may correspond to different virtual options, i.e. one marker corresponds to different virtual options. For example, in the virtual zoo scene, please refer to fig. 2 and 4, the marker 203 corresponds to three different virtual options, i.e. dolphin 301, octopus 302, goldfish 303, etc.

In some embodiments, the APPs, website links, and the like of different application scenes, such as APPs, network connections, and the like of application scenes for shopping, games, news, entertainment, education, and the like, can be bound to the entity object in a customized manner, so as to realize virtual option display in different scenes.

Therefore, the virtual option content corresponding to the identity information of the marker on the entity object can be obtained for subsequent display according to the space position of the terminal device relative to the entity object.

Step S230: and displaying a first virtual picture containing at least one first virtual option according to the relative spatial position information, wherein the first virtual option corresponds to at least one second virtual option.

In some embodiments, to improve the display effect of the virtual option, the displayed first virtual screen may further include a scene image. The scene image may be a scene image corresponding to the first virtual option, for example, if the first virtual option is a virtual jellyfish, the scene image may be a virtual sea, and thus the displayed first virtual picture is that the virtual jellyfish is in the virtual sea. Of course, the above scene images are only examples, and the specific scene images are not limited herein. Similarly, the scene image may be a real environment image where the scene image is currently located.

In some embodiments, when the terminal device displays a first virtual screen including at least one first virtual option, in order to improve the display effect of the virtual option, the first virtual option may be displayed in any one or more of the following manners: controlling the first virtual option to be displayed in a predetermined static posture; controlling the first virtual option to be displayed in a preset movement posture; controlling the first virtual option to be displayed in a three-dimensional image; controlling the first virtual option to be displayed in an enlarged mode or in a reduced mode; and controlling the first virtual option to be displayed at a preset display position.

Further, the controlling of the first virtual option to be displayed at the predetermined display position may be controlling of a one-to-one correspondence between the display position of the different first virtual options and different surfaces of the physical object. For example, a displayed panda corresponds to one side of the physical object, and a displayed monkey corresponds to another side of the physical object. Or the first virtual option can be controlled to be uniformly arranged and displayed around the entity object. Of course, the specific predetermined display position may not be limited in the embodiment of the present application.

Further, when the number of the first virtual options to be displayed is relatively large, the first virtual options can be limited to be displayed. Therefore, referring to fig. 9, the displaying a first virtual frame including at least one first virtual option according to the relative spatial position information includes:

step S231: when the number of the first virtual options needing to be displayed is larger than a preset threshold value, selecting the first virtual options corresponding to the preset threshold value from the first virtual options needing to be displayed.

In some embodiments, before the terminal device displays the first virtual screen, it may be determined whether the number of the first virtual options that need to be displayed is greater than a preset threshold, so as to determine whether the terminal device can completely display all the option information.

The preset threshold may be the maximum number of the first virtual options that can be displayed by the terminal device at one time. The preset threshold value can be stored in the terminal device in advance, and can be set reasonably according to the specific situation of the first virtual option and the user requirement. It is understood that the larger the preset threshold is set, the smaller the display form of the first virtual item is.

When the number of the first virtual options to be displayed obtained by the terminal device is greater than the preset threshold, the first virtual option corresponding to the preset threshold can be selected from the first virtual options to be displayed, so as to display the first virtual picture. When the number of the first virtual options required to be displayed, which is obtained by the terminal device, is smaller than the preset threshold, the first virtual options can be directly displayed, so that the first virtual picture is displayed.

For example, the preset threshold is set to be 2, if only one panda animal option needs to be displayed, the terminal device can obtain a judgment result that the number of the first virtual options needing to be displayed is smaller than the preset threshold, so that the panda animal option can be directly displayed; if the first virtual options to be displayed include animal options such as pandas, monkeys, tigers and the like, the terminal device can obtain a judgment result that the number of the first virtual options to be displayed is larger than a preset threshold value, so that the terminal device can select the first virtual options corresponding to the preset threshold value to display, namely select 2 first virtual options to display, such as displaying the panda animal options and the monkey animal options.

In some embodiments, to meet the browsing requirement of the user, the selection of the first virtual option corresponding to the preset threshold may be selected according to a priority of the first virtual option. The priority may be a priority of importance, a priority of selected frequency, a priority of user's preference, etc., and the specific priority is not limited herein.

In some embodiments, to meet timeliness of the information, the selection of the first virtual option corresponding to the preset threshold may be selected according to an update time of the first virtual option. The update time may be in units of day, hour, minute, and second, and the specific update time unit is not limited herein.

Step S232: and displaying a first virtual picture containing a first virtual option corresponding to a preset threshold value according to the relative spatial position information.

After the terminal device selects the first virtual option corresponding to the preset threshold, the terminal device may display a first virtual picture including the first virtual option corresponding to the preset threshold according to the relative spatial position information.

Further, after the first virtual screen including the first virtual option corresponding to the preset threshold is displayed according to the relative spatial position information, the virtual content display method may further include:

when a switching instruction is detected, at least one of the currently displayed first virtual options is switched to other first virtual options, and the other first virtual options are first virtual options except the currently displayed first virtual option in the first virtual options required to be displayed.

In order to ensure that all the option information is displayed, after the first virtual option corresponding to the preset threshold is displayed, the terminal device also needs to display other first virtual options. In this embodiment of the application, when detecting a switching instruction, the terminal device may switch at least one of the currently displayed first virtual options to another first virtual option, where the another first virtual option is a first virtual option other than the currently displayed first virtual option in all the first virtual options that need to be displayed.

In some embodiments, the switching of at least one of the currently displayed first virtual options to other first virtual options may be switching part of the currently displayed first virtual options to other first virtual options, that is, the currently displayed first virtual screen includes both the originally displayed first virtual option and the new first virtual option.

For example, in a virtual game scene, if a currently displayed first virtual option is a game such as continuous watching, box pushing and the like, when the terminal device detects a switching instruction, the currently displayed first virtual option such as continuous watching, box pushing and the like can be switched to a first virtual option such as box pushing, greedy snake and the like, and when the terminal device detects the switching instruction again, the currently displayed first virtual option such as box pushing, greedy snake and the like can be switched to a first virtual option such as greedy snake, tank war and the like.

In other embodiments, the switching of at least one of the currently displayed first virtual options to other first virtual options may be to switch the first virtual option corresponding to the currently displayed preset threshold to the first virtual option corresponding to the preset threshold in other first virtual options, that is, the first virtual options to be displayed are displayed in groups, where the number of the first virtual options in each group is the preset threshold.

In some embodiments, the switching of the currently displayed first virtual option corresponding to the preset threshold to the first virtual option corresponding to the preset threshold in the other first virtual options may be to continue to select the first virtual option corresponding to the preset threshold from the other first virtual options, and then switch all the currently displayed first virtual options to the first virtual option corresponding to the preset threshold selected from the other first virtual options. The specific selection manner may refer to the selection of the first virtual option corresponding to the preset threshold, which is not described herein again.

For example, under the virtual game scene, the preset threshold value is 2, if the first virtual option that needs to be displayed includes continuous watching, box pushing, greedy snake, and tank fighting, the terminal device can display the continuous watching and the box pushing first, and then switch the continuous watching and the box pushing options that are currently displayed into greedy snake and tank fighting options.

Further, the displaying of the other first virtual options may be performed when the terminal device detects a switching instruction. That is, the terminal device may switch at least one of the currently displayed first virtual options to another first virtual option when detecting the switching instruction.

In some embodiments, the detecting of the handover command includes:

and when the change of the spatial position of the entity object is detected to exceed the set change, determining that the switching instruction is detected.

After the terminal device displays the first virtual option corresponding to the preset threshold, whether a switching instruction is detected or not can be determined by detecting the spatial position information of the entity object, so that the other first virtual options are displayed according to the switching instruction. Specifically, the terminal device determines whether a switching instruction is detected by detecting whether a change in the spatial position of the physical object exceeds a set change.

The spatial position change comprises orientation change and rotation angle change of the entity object relative to the terminal equipment. As one approach, the spatial position of the solid object may be changed by rotating the solid object.

The setting change is a change interval of the change of the spatial position of the physical object, and the setting change can be stored in the terminal device in advance and can be set reasonably according to the specific situation of the first virtual option. In some embodiments, the set change may be a change in a number of degrees of rotation, such as a rotation of 90 °. It may also be a change in direction of rotation, such as a right turn, a left turn. The above setting variations are merely examples, and specific setting variations are not limited in the embodiments of the present application.

Further, forward switching or backward switching may be determined according to the rotation direction, where the forward switching is to switch the first virtual option corresponding to the currently displayed preset threshold to the first virtual option corresponding to the previously displayed preset threshold, and similarly, the backward switching is to switch to the first virtual option corresponding to the subsequently displayed preset threshold. For example, rotating the physical object to the left effects a forward switch, and rotating the physical object to the right effects a backward switch.

For example, in an application scenario, please refer to fig. 4 and 10, the user can see that the currently displayed dolphin 301, octopus 302, goldfish 303 (fig. 4) are switched to starfish 304, conch 305, tortoise 306 (fig. 10) by rotating the entity object 200 to the right. In another application scenario, referring to fig. 4 and 11, the user can see that the currently displayed dolphin 301, octopus 302, goldfish 303 (fig. 4) are switched to octopus 302, goldfish 303, tortoise 304 (fig. 11) by rotating the solid object 200 to the right, that is, there are the currently displayed first virtual option and the new first virtual option. In some embodiments, the detecting of the switching instruction may be further that the terminal device determines that the switching instruction is detected when a user operation (such as user pressing, single finger sliding, and the like) of the manipulation area of the entity object is detected. Also, the forward switching and the backward switching (such as the number of times of pressing, the direction of sliding, etc.) may be determined according to a specific user operation.

Step S240: and switching and displaying the first virtual picture into a second virtual picture containing a second virtual option according to a first instruction of the first virtual option.

In some embodiments, referring to fig. 12, the switching and displaying the first virtual frame to the second virtual frame including the second virtual option according to the first instruction for the first virtual option includes:

step S241: and acquiring a target first virtual option from at least one first virtual option according to a first instruction of the first virtual option.

When the terminal device performs the extended display of the first virtual option, it needs to determine the target first virtual option first to perform the display of the corresponding second virtual option. The target first virtual option is any one of the at least one first virtual option.

In some embodiments, the determining the target first virtual option may be that the terminal device obtains the target first virtual option from at least one first virtual option according to a first instruction for the first virtual option. The generation mode of the first instruction includes but is not limited to: the method comprises the steps of generating according to user operation of an operation area of an entity object and generating according to gestures of a user.

Further, the obtaining a target first virtual option from at least one first virtual option according to the first instruction for the first virtual option includes:

when the first virtual option in the selected state is detected to exist in the at least one first virtual option and the first instruction is obtained, the first virtual option in the selected state is used as a target first virtual option.

Before determining the target first virtual option, the terminal device may first detect whether a first virtual option in a selected state exists in at least one first virtual option, and then detect whether the first instruction is acquired. And taking the first virtual option currently in the selected state as a target first virtual option.

In this embodiment of the present application, the first virtual option is in a selected state, and includes:

and the first virtual option is in a preset display range, and one or more of the selection operation of the first virtual option and the time when the distance between the display position of the first virtual option and the terminal equipment is less than a preset distance are obtained.

As an embodiment, it may be determined whether the first virtual item is in the selected state according to a display position of the first virtual item. Specifically, the display position of each displayed first virtual option can be detected in real time, when the display position of the first virtual option is in the preset display range, it can be determined that the first virtual option in the position in the preset range is in the selected state, and when the first virtual option is not in the preset range, the first virtual option is not in the selected state. That is, a coordinate area corresponding to the preset range may be set, and when the display coordinate of the first virtual option is in the coordinate area, the first virtual option is in the selected state. For example, the preset range may be a coordinate region corresponding to a region between the physical object and the terminal device, and the coordinate region may also be a coordinate region corresponding to a boundary region of a field of view of an image capturing apparatus of the terminal device. Of course, the specific preset range may not be limited in the embodiments of the present application.

Therefore, the first virtual option can be in the preset range by adjusting the display position of the first virtual option, so that the first virtual option is in the selected state. For example, the display position of the first virtual option may be changed by adjusting the position of the entity object, for example, rotating the entity object, or by adjusting the posture or position of the terminal device, and when the display position of the first virtual option is adjusted to the preset range, the first virtual option is in the selected state. For another example, the display position of the first virtual item may be adjusted through the manipulation area of the physical object, so that the display position of the first virtual item is changed to be in the selected state.

In another embodiment, it may be determined whether the first virtual option is in the selected state by detecting a selection operation of the user on the first virtual option. The selection operation of the first virtual option may be a selection operation (such as pressing, sliding, and the like) of the first virtual option by detecting the manipulation area of the entity object, and when the selection operation of the first virtual option is detected, it may be determined that the first virtual option corresponding to the selection operation is in a selected state, and of course, if the selection operation of the first virtual option is not detected, the first virtual option is in an unselected state. Therefore, the operation of the first virtual option through the control area of the entity object can be realized, and the first virtual option is in a selected state.

As still another embodiment, it may be determined whether the first virtual item is in the selected state according to a display position of the first virtual item. The display position of the first virtual option is the display position of the virtual option seen by the user through the terminal device, that is, the 3D coordinates of the virtual option rendered in the virtual space.

Specifically, the display position of each displayed virtual option content can be detected in real time, when the distance between the display position where the first virtual option exists and the terminal device is smaller than the preset distance, it can be determined that the first virtual option whose display position is smaller than the preset distance is in the selected state, and when the distance between the display position of the first virtual option and the terminal device is not smaller than the preset distance, the first virtual option is not in the selected state. That is, a preset distance may be set, and when the distance between the display position of the first virtual option and the terminal device is smaller than the preset distance, the first virtual option is in the selected state.

Therefore, the distance between the display position of the first virtual option and the terminal equipment can be changed by adjusting the display position of the first virtual option, so that the distance between the first virtual option and the terminal equipment is smaller than the preset distance, and the first virtual option is in a selected state. For example, the display position of the first virtual option may be changed relative to the distance of the terminal device by adjusting the position of the entity object, for example, moving the entity object, or adjusting the posture or position of the terminal device, and when the distance of the first virtual option relative to the terminal device is adjusted to be smaller than the preset distance, the first virtual option is in the selected state. For another example, the display position of the first virtual option may be adjusted through the manipulation area of the entity object, so that the display position of the first virtual option is changed, the distance between the first virtual option and the terminal device is changed, and the terminal device is in the selected state.

Further, the terminal device may highlight the first virtual option in the selected state, where the highlighting may be in a manner of zooming in, highlighting, changing a color, or pointing to a prompt with an arrow, and the specific highlighting is not limited in this embodiment of the application. For example, referring to fig. 13, it can be seen that the goldfish 303 in the selected state is displayed in an enlarged manner.

It will be appreciated that the first virtual option is in the selected state when the first virtual option is in any one or more of the above-described situations. In one embodiment, when any of the first virtual options is in the selected state, a virtual object corresponding to the first virtual option in the selected state may be obtained and displayed, and the virtual object may be virtual content associated with the first virtual option, such as a three-dimensional virtual model, a virtual animation, and the like, but is not limited thereto. For example, the first virtual option is a plurality of different parks in the virtual zoo, when any first virtual option is in the selected state, a virtual object of the first virtual option in the selected state may be obtained, and the virtual object may be introduction information of the park corresponding to the first virtual option in the selected state, or an animation of a promotion, and the like.

In one embodiment, when a target operation on the first virtual option in the selected state is detected, the option data corresponding to the first virtual option in the selected state is added to the selection list, and then the option data contained in the selection list is sent to other devices. In some scenarios, a user needs to perform a related operation on a first virtual option in a selected state to achieve a purpose of selecting option data corresponding to the first virtual option. The target operation is used for indicating to add option data of the first virtual option to the selection list, where the option data refers to data of option content corresponding to the first virtual option, for example, when the first virtual option is a virtual option corresponding to a dish, the option data is data of the dish. When the target operation on the first virtual option in the selected state is detected, the option data of the first virtual option may be added to the selection list, and the option data in the selection list may be subsequently sent to other devices, so that the other devices process the selection data in the selection list. For example, in a food ordering scenario, when a target operation of a virtual option corresponding to a selected dish is detected, dish data of the dish may be added to a selection list of the dish, and the dish data in the selection list may be sent to a server for ordering the dish.

Step S242: and acquiring at least one second virtual option corresponding to the target first virtual option.

After determining the target first virtual option, the terminal device may acquire at least one second virtual option corresponding to the target first virtual option. The second virtual option is obtained, which can also be understood as obtaining virtual options of other hierarchies to implement extended display of the target first virtual option.

In some embodiments, the correspondence between the specific target first virtual option and the second virtual option may be pre-stored in the terminal device (or downloaded from a server or obtained from another terminal).

Step S243: and switching and displaying the first virtual picture into a second virtual picture containing a second virtual option.

After the terminal device obtains at least one second virtual option corresponding to the target first virtual option, the terminal device can display the second virtual option. Specifically, the terminal device switches the currently displayed first virtual screen to a second virtual screen containing the second virtual option for display.

Similarly, the display effect of the second virtual option can be improved by setting the display modes such as the preset display state, the preset display position and the preset threshold value for the second virtual option to be displayed. The display mode of the second virtual option may refer to the display mode of the first virtual option, and is not described herein again.

Further, after the first virtual screen is switched and displayed to be the second virtual screen containing the second virtual option according to the first instruction for the first virtual option, the virtual content display method may further include:

and switching the currently displayed second virtual picture back to the first virtual picture according to a second instruction of the second virtual option.

After the terminal device switches the first virtual picture to the second virtual picture for display, the currently displayed second virtual picture can be switched back to the first virtual picture for display according to a second instruction for the second virtual option, so that the random switching of the virtual options between adjacent layers is realized.

It can be understood that, before the terminal device switches the currently displayed first virtual screen, the currently displayed first virtual screen may be stored, so that when the switched second virtual screen is displayed, the first virtual screen can be directly switched back, and the operation of repeatedly acquiring data is avoided.

It is understood that the number of levels of the multi-level option is not limited herein, and may be, for example, two levels, three levels, five levels, etc. For example, the multi-level option may be three levels, that is, the second virtual option may further correspond to at least one third virtual option, where the levels of the first, second, and third virtual options are different from each other, and the correspondence between the second virtual option and the third virtual option may refer to the correspondence between the first virtual option and the second virtual option.

According to the virtual content display method provided by the embodiment of the application, switching display of adjacent levels such as the first virtual option and the second virtual option is performed through the space position information and the identity information of the terminal device relative to the entity object and various operation instructions of a user, and the display state and the display position of the terminal device can be set so as to improve the virtual reality effect of the multi-level options, so that the multi-level options are not displayed on a display screen of the electronic device, but expanded display of the virtual options is performed according to the space position information of the entity object, the multi-level virtual options are displayed in the virtual space, the user can observe the effect that the multi-level virtual options are superposed on the real world, and the display effect of the multi-level options is improved.

Referring to fig. 14, a block diagram of a virtual content display apparatus 500 according to an embodiment of the present application is shown, and the apparatus is applied to a terminal device, and may include: an image acquisition module 510, a position acquisition module 520, a display module 530, and a control module 540. Wherein the image acquisition module 510 is configured to acquire an image including a solid object, the solid object including at least one marker; the position obtaining module 520 is configured to identify a marker in the image and obtain relative spatial position information between the terminal device and the entity object; the display module 530 is configured to display a first virtual screen including at least one first virtual option according to the relative spatial location information, where the first virtual option corresponds to at least one second virtual option; the control module 540 is configured to switch and display the first virtual screen to a second virtual screen including a second virtual option according to a first instruction for the first virtual option.

In the embodiment of the present application, the control module 540 may include: the device comprises a target acquisition unit, an option acquisition unit and a first display unit. The target acquisition unit is used for acquiring a target first virtual option from at least one first virtual option according to a first instruction of the first virtual option; the option acquisition unit is used for acquiring at least one second virtual option corresponding to the target first virtual option; the first display unit is used for switching and displaying the first virtual picture into a second virtual picture containing a second virtual option.

In this embodiment of the present application, the target obtaining unit may be specifically configured to: when the first virtual option in the selected state is detected to exist in the at least one first virtual option and the first instruction is obtained, the first virtual option in the selected state is used as a target first virtual option.

In some embodiments, the first virtual option is in a selected state, including: and the first virtual option is in a preset display range, and one or more of the selection operation of the first virtual option and the time when the distance between the display position of the first virtual option and the terminal equipment is less than a preset distance are obtained.

In this embodiment, the display module 530 may include: a judging unit and a second display unit. The device comprises a judging unit, a display unit and a display unit, wherein the judging unit is used for selecting a first virtual option corresponding to a preset threshold from first virtual options to be displayed when the number of the first virtual options to be displayed is greater than the preset threshold; the second display unit is used for displaying a first virtual picture containing a first virtual option corresponding to a preset threshold value according to the relative spatial position information.

Further, the virtual content display apparatus 500 further includes: and a display switching module. The display switching module is used for switching at least one of the currently displayed first virtual options into other first virtual options when a switching instruction is detected, wherein the other first virtual options are first virtual options except the currently displayed first virtual option in the first virtual options to be displayed.

In some embodiments, detecting a handover instruction comprises: and when the change of the spatial position of the entity object is detected to exceed the set change, determining that the switching instruction is detected.

In some embodiments, the virtual content display apparatus 500 further comprises: a display return module. The display returning module is used for switching the currently displayed second virtual picture back to the first virtual picture according to a second instruction of the second virtual option.

It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and modules may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the several embodiments provided in the present application, the coupling or direct coupling or communication connection between the modules shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or modules may be in an electrical, mechanical or other form.

In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.

To sum up, the virtual content display method and apparatus provided in the embodiments of the present application are applied to a terminal device, obtain spatial position information of the terminal device with respect to an entity object by collecting and recognizing a marker on the entity object, and display a first virtual screen including at least one first virtual option according to the relative spatial position information, where the first virtual option corresponds to at least one second virtual option, and switch and display the first virtual screen into a second virtual screen including the second virtual option according to a first instruction for the first virtual option, so that a multi-level option is not displayed on a display screen of an electronic device, but an extended display of the virtual option is performed according to the spatial position information of the entity object, so that the multi-level virtual option is displayed in a virtual space, and a user can observe an effect of superimposing the multi-level virtual option in the real world, the display effect of the multi-level options is improved.

Referring to fig. 15, a block diagram of a terminal device according to an embodiment of the present application is shown. The terminal device 100 may be a terminal device capable of running an application, such as a smart phone, a tablet computer, an electronic book, or the like. The terminal device 100 in the present application may include one or more of the following components: a processor 110, a memory 120, an image acquisition apparatus 130, and one or more applications, wherein the one or more applications may be stored in the memory 120 and configured to be executed by the one or more processors 110, the one or more programs configured to perform a method as described in the aforementioned method embodiments.

Processor 110 may include one or more processing cores. The processor 110 connects various parts within the entire terminal device 100 using various interfaces and lines, and performs various functions of the terminal device 100 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 120 and calling data stored in the memory 120. Alternatively, the processor 110 may be implemented in hardware using at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 110 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 110, but may be implemented by a communication chip.

The Memory 120 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). The memory 120 may be used to store instructions, programs, code sets, or instruction sets. The memory 120 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The storage data area may also store data created by the terminal device 100 in use, and the like.

In the embodiment of the present application, the image capturing device 130 is used for capturing an image of a physical object and capturing a scene image of a target scene. The image capturing device 130 may be an infrared camera or a color camera, and the specific type of the camera is not limited in the embodiment of the present application.

The embodiment of the application provides a structural block diagram of a computer readable storage medium. The computer-readable storage medium 800 has stored therein program code that can be invoked by a processor to perform the methods described in the method embodiments above.

The computer-readable storage medium 800 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Alternatively, the computer-readable storage medium 800 includes a non-volatile computer-readable storage medium. The computer readable storage medium 800 has storage space for program code 810 to perform any of the method steps of the method described above. The program code can be read from or written to one or more computer program products. The program code 810 may be compressed, for example, in a suitable form.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims (11)

1. A virtual content display method is applied to a terminal device, and comprises the following steps:

acquiring an image comprising a solid object, the solid object comprising at least one marker;

identifying a marker in the image and acquiring relative spatial position information between the terminal equipment and the entity object;

displaying a first virtual picture containing at least one first virtual option according to the relative spatial position information, wherein the first virtual option corresponds to at least one second virtual option;

and switching and displaying the first virtual picture into a second virtual picture containing the second virtual option according to a first instruction of the first virtual option.

2. The method according to claim 1, wherein the switching and displaying the first virtual screen as a second virtual screen containing the second virtual option according to the first instruction for the first virtual option comprises:

according to a first instruction of the first virtual option, acquiring a target first virtual option from the at least one first virtual option;

acquiring at least one second virtual option corresponding to the target first virtual option;

and switching and displaying the first virtual picture into a second virtual picture containing the second virtual option.

3. The method of claim 2, wherein the obtaining the target first virtual option from the at least one first virtual option according to the first instruction for the first virtual option comprises:

and when the first virtual option in the selected state is detected to exist in the at least one first virtual option and the first instruction is acquired, taking the first virtual option in the selected state as a target first virtual option.

4. The method of claim 3, wherein the first virtual option is in a selected state, comprising:

and the first virtual option is in a preset display range, and one or more of the selection operation of the first virtual option and the time when the distance between the display position of the first virtual option and the terminal equipment is less than a preset distance are obtained.

5. The method according to claim 1, wherein the displaying a first virtual screen containing at least one first virtual option according to the relative spatial position information comprises:

when the number of first virtual options to be displayed is larger than a preset threshold value, selecting a first virtual option corresponding to the preset threshold value from the first virtual options to be displayed;

and displaying a first virtual picture containing a first virtual option corresponding to the preset threshold according to the relative spatial position information.

6. The method according to claim 5, wherein after displaying the first virtual screen containing the first virtual option corresponding to the preset threshold according to the relative spatial position information, the method further comprises:

when a switching instruction is detected, switching at least one of the currently displayed first virtual options to other first virtual options, where the other first virtual options are first virtual options except the currently displayed first virtual option in the first virtual options to be displayed.

7. The method of claim 6, wherein the detecting the handover command comprises:

and when the change of the spatial position of the entity object is detected to exceed the set change, determining that a switching instruction is detected.

8. The method according to any one of claims 1 to 7, wherein after the switching and displaying the first virtual screen as a second virtual screen containing the second virtual option according to the first instruction for the first virtual option, the method further comprises:

and switching the currently displayed second virtual picture back to the first virtual picture according to a second instruction of the second virtual option.

9. A virtual content display device, applied to a terminal device, includes:

an image acquisition module for acquiring an image containing a solid object, the solid object comprising at least one marker;

the position acquisition module is used for identifying a marker in the image and acquiring relative spatial position information between the terminal equipment and the entity object;

the display module is used for displaying a first virtual picture containing at least one first virtual option according to the relative spatial position information, wherein the first virtual option corresponds to at least one second virtual option;

and the control module is used for switching and displaying the first virtual picture into a second virtual picture containing the second virtual option according to a first instruction of the first virtual option.

10. A terminal device, comprising:

one or more processors;

a memory;

one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the method of any of claims 1-8.

11. A computer-readable storage medium, having stored thereon program code that can be invoked by a processor to perform the method according to any one of claims 1 to 8.

Images