CN115496840A

CN115496840A - Animation display method, device, equipment and storage medium

Info

Publication number: CN115496840A
Application number: CN202211030840.3A
Authority: CN
Inventors: 曾亮; 涂贤玲
Original assignee: Beijing SoundAI Technology Co Ltd
Current assignee: Beijing SoundAI Technology Co Ltd
Priority date: 2022-08-26
Filing date: 2022-08-26
Publication date: 2022-12-20

Abstract

The application provides an animation display method, device, equipment and storage medium, and belongs to the technical field of augmented reality. The method is performed by an Augmented Reality (AR) device, and comprises: collecting appearance data of the magic cube, wherein the appearance data comprise images corresponding to all surfaces; querying a restoration path matched with the appearance data in a database, wherein the restoration path comprises at least one operation step; and shooting a real picture of the current scene, and displaying the AR animation corresponding to each operation step, wherein the AR animation comprises the real picture and indication information added in the real picture, and the indication information is used for indicating the operation step to be executed on the magic cube. The embodiment of the application provides a scheme for guiding a magic cube user to control the magic cube, and the display mode is vivid and vivid, so that the magic cube user can simply and easily know the operation steps required by restoring the magic cube, and the difficulty of restoring the magic cube by the magic cube user is reduced.

Description

Animation display method, device, equipment and storage medium

Technical Field

The present application relates to the field of augmented reality, and in particular, to an animation display method, apparatus, device, and storage medium.

Background

The magic cube is used as an intelligence toy and has various playing methods such as racing, blind twisting and single twisting, and the playing methods have the common characteristic that the magic cube needs to be disturbed and then restored through a series of operations, so that the color of each surface of the magic cube is the same. The magic cube is widely popular among the public due to the variability of the restoring method, and is one of the most popular intelligent games.

Currently, most magic cube enthusiasts can only try to complete the restoration of the cube by reading the instructional book, watching the instructional video, or groping themselves. But the difficulty of restoring the cube is still great.

Disclosure of Invention

The embodiment of the application provides an animation display method, device, equipment and storage medium, which can reduce the difficulty of a magic cube user in restoring the magic cube. The technical scheme is as follows:

in one aspect, an animation display method performed by an Augmented Reality (AR) device is provided, and the method includes:

collecting appearance data of the magic cube, wherein the appearance data comprise images corresponding to all surfaces;

querying a restoration path matched with the appearance data in a database, wherein the restoration path comprises at least one operation step, and the database is used for storing at least one restoration path matched with the appearance data of the magic cube;

shooting a real picture of a current scene, and displaying an AR animation corresponding to each operation step, wherein the AR animation comprises the real picture and indication information added in the real picture, and the indication information is used for indicating the magic cube to execute the operation steps.

In a possible implementation manner, after the capturing a real picture of the current scene, the method further includes:

adding the special effect corresponding to the operation step into the display area of the magic cube in the real picture to obtain the AR animation corresponding to the operation step, wherein the special effect is the special effect of the virtual magic cube executing the operation step, and the special effect covers the display area of the magic cube.

In a possible implementation manner, the operation step includes a direction in which a rotating target in the magic cube needs to rotate, and after the real picture of the current scene is taken, the method further includes:

and adding a direction mark corresponding to the direction in a display area corresponding to the rotating target in the real picture to obtain the AR animation corresponding to the operation step.

In a possible implementation manner, the restoring path includes a plurality of operation steps, and the capturing a real picture of a current scene and displaying an AR animation corresponding to each operation step includes:

displaying the AR animation corresponding to the first operation step under the condition that switching display operation is detected, wherein the switching display operation is used for indicating switching display of the AR animation;

and under the condition that the display switching operation is detected again, displaying the AR animation corresponding to a second operation step, wherein the second operation step is the next operation step of the first operation step in the restoration path until the AR animation corresponding to the last operation step is displayed.

In a possible implementation manner, the switching the display operation includes at least one of:

triggering the switching key;

recognizing an operation of switching a keyword included in the voice data;

and collecting the operation of the target gesture.

In a possible implementation manner, the restoring path includes a plurality of operation steps, and the displaying an AR animation corresponding to each operation step includes:

and sequentially displaying the AR animations corresponding to the operation steps according to the sequence of the operation steps, wherein the display time lengths of the displayed multi-frame AR animations are equal.

In a possible implementation manner, the acquiring appearance data of the magic cube includes:

responding to a shooting instruction under the condition of outputting first prompt information, and shooting a first image, wherein the first prompt information is used for prompting to shoot an image corresponding to a first surface of the magic cube;

and under the condition of outputting second prompt information, responding to the shooting instruction, shooting a second image, wherein the second prompt information is used for prompting to shoot images corresponding to the second surface of the magic cube until the number of the shot images is equal to the number of targets, and forming the shot images into the appearance data, wherein the number of the targets is the number of the surfaces of the magic cube.

In one possible implementation, the method further includes:

displaying an image display area, wherein the image display area comprises sub-areas of the target number which are arranged in sequence;

every time an image is taken, the taken image is presented in a target sub-area, the order of which matches the order in which the images were taken.

In a possible implementation manner, the querying, in the database, a restoration path matching the appearance data further includes:

querying the database for a restoration path matching the appearance data;

and under the condition that a plurality of restoration paths are inquired, randomly selecting one restoration path or selecting an unused restoration path of the AR equipment.

In a possible implementation manner, the capturing a real picture of a current scene and displaying an AR animation corresponding to each operation step includes:

and in the teaching mode, shooting a real picture of the current scene, and displaying the AR animation corresponding to each operation step.

In one possible implementation, after querying the database for the restoration path matching the appearance data, the method further includes:

in a simple mode, displaying guidance information, the guidance information including the at least one operation step.

In one possible implementation, the database is located in a server, and the querying the database for the restoration path matching the appearance data includes:

sending a query request to the server, wherein the query request carries the appearance data;

and receiving the restoration path queried in the database by the server.

In another aspect, a restoration path query method is provided, which is executed by a server, and includes:

receiving an inquiry request sent by AR equipment, wherein the inquiry request carries appearance data collected by the AR equipment, and the appearance data comprises images corresponding to each surface of the magic cube;

in response to the query request, querying a database for a restoration path matched with the appearance data, wherein the restoration path comprises at least one operation step, and the database is used for storing at least one restoration path matched with the appearance data of the magic cube;

and sending the restoration path to the AR equipment, wherein the AR equipment is used for shooting a real picture of the current scene and displaying an AR animation corresponding to each operation step, the AR animation comprises the real picture and indication information added in the real picture, and the indication information is used for indicating the magic cube to execute the operation step.

In one possible implementation, the method further includes:

receiving updating data sent by a terminal, wherein the updating data comprises appearance data and a corresponding restoration path, and the terminal is a terminal with the authority of updating the database;

adding the update data to the database.

In another aspect, there is provided an animation display device, the device including:

the image acquisition module is used for acquiring appearance data of the magic cube, wherein the appearance data comprises images corresponding to all surfaces;

the restoration path query module is used for querying a restoration path matched with the appearance data in a database, the restoration path comprises at least one operation step, and the database is used for storing at least one restoration path matched with the appearance data of the magic cube;

and the animation display module is used for shooting a real picture of the current scene and displaying the AR animation corresponding to each operation step, wherein the AR animation comprises the real picture and indication information added in the real picture, and the indication information is used for indicating the magic cube to execute the operation step.

In one possible implementation, the apparatus further includes:

and the special effect adding module is used for adding the special effect corresponding to the operation step in the display area of the magic cube in the real picture to obtain the AR animation corresponding to the operation step, wherein the special effect is the special effect of the virtual magic cube executing the operation step, and the special effect covers the display area of the magic cube.

In one possible implementation, the apparatus further includes:

and the direction mark adding module is used for adding a direction mark corresponding to the direction in a display area corresponding to the rotating target in the real picture to obtain the AR animation corresponding to the operation step.

In one possible implementation, the restore path includes a plurality of operation steps, and the animation display module includes:

the switching display unit is used for displaying the AR animation corresponding to the first operation step under the condition that switching display operation is detected, and the switching display operation is used for indicating switching display of the AR animation; and under the condition that the display switching operation is detected again, displaying the AR animation corresponding to a second operation step, wherein the second operation step is the operation step next to the first operation step in the restoration path until the AR animation corresponding to the last operation step is displayed.

In one possible implementation manner, the switching the display operation includes at least one of:

triggering the switching key;

recognizing the operation of switching keywords contained in the voice data;

and collecting the operation of the target gesture.

In one possible implementation manner, the restoration path includes a plurality of operation steps, and the animation display module is configured to:

In one possible implementation, the image acquisition module is configured to:

and under the condition of outputting second prompt information, responding to the shooting instruction, shooting a second image, wherein the second prompt information is used for prompting to shoot images corresponding to the second surface of the magic cube until the number of the shot images is equal to the number of targets, and the shot images form the appearance data, wherein the number of the targets is the number of the surfaces of the magic cube.

In one possible implementation, the apparatus is further configured to:

In one possible implementation manner, the restoration path query module includes:

the query unit is used for querying the restoration path matched with the appearance data in the database;

and the selecting unit is used for randomly selecting one restoration path or selecting an unused restoration path of the AR equipment under the condition that a plurality of restoration paths are inquired.

In one possible implementation, the animation display module is configured to:

In a possible implementation manner, after querying the database for the restoration path matching the appearance data, the apparatus further includes:

and the guiding module is used for displaying guiding information under a simple mode, and the guiding information comprises the at least one operation step.

a sending unit, configured to send a query request to the server, where the query request carries the appearance data;

a receiving unit, configured to receive the restoration path queried by the server in the database.

In another aspect, a restoration path query apparatus is provided, the apparatus including:

the receiving module is used for receiving an inquiry request sent by the AR equipment, wherein the inquiry request carries appearance data collected by the AR equipment, and the appearance data comprises images corresponding to each surface of the magic cube;

the query module is used for responding to the query request, querying a database for a restoration path matched with the appearance data, wherein the restoration path comprises at least one operation step, and the database is used for storing at least one restoration path matched with the appearance data of the magic cube;

and the sending module is used for sending the restoration path to the AR equipment, the AR equipment is used for shooting a real picture of the current scene and displaying AR animation corresponding to each operation step, the AR animation comprises the real picture and indication information added in the real picture, and the indication information is used for indicating the magic cube to execute the operation step.

In one possible implementation, the apparatus further includes:

the updating module is used for receiving updating data sent by a terminal, wherein the updating data comprises appearance data and a corresponding restoration path, and the terminal is a terminal with the permission of updating the database; adding the update data to the database.

In another aspect, an AR device is provided, which includes a processor and a memory, where at least one program code is stored in the memory, and the program code is loaded and executed by the processor to implement the animation display method in any one of the above possible implementation manners.

In another aspect, a server is provided, which includes a processor and a memory, wherein the memory stores at least one program code, and the program code is loaded and executed by the processor to implement the animation display method in any one of the above possible implementation manners.

In another aspect, a computer-readable storage medium is provided, in which at least one program code is stored, the program code being loaded and executed by a processor to implement the animation display method in any one of the above possible implementations.

In another aspect, a computer program product is provided, comprising at least one program code, which is loaded and executed by a processor to implement the animation display method of any one of the above possible implementations.

In this application embodiment, gather the corresponding reduction route of inquiry behind the appearance data of magic cube through AR equipment, adopt the form of AR animation to show again, the display mode is vivid for the magic cube user can understand the required operating procedure of reduction magic cube simply understandable, thereby has reduced the degree of difficulty of magic cube user reduction magic cube.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

FIG. 1 is a schematic illustration of an implementation environment provided by an embodiment of the present application;

FIG. 2 is a flow chart of an animation display method according to an embodiment of the present disclosure;

FIG. 3 is a flow chart of another animation display method provided by an embodiment of the application;

fig. 4 is a flowchart of a restore path query according to an embodiment of the present application;

FIG. 5 is a flowchart of another animation display method according to an embodiment of the present application;

FIG. 6 is a schematic structural diagram of an animation display device according to an embodiment of the present application;

FIG. 7 is a schematic structural diagram of another animation display device according to an embodiment of the present application;

fig. 8 is a schematic structural diagram of an AR device according to an embodiment of the present disclosure;

fig. 9 is a schematic structural diagram of a server according to an embodiment of the present application.

Detailed Description

To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.

The terms "first," "second," "third," "fourth," and the like as used herein may be used herein to describe various concepts, but these concepts are not limited by these terms unless otherwise specified. These terms are only used to distinguish one concept from another. For example, a first image may be referred to as a second image, and similarly, a second image may be referred to as a first image, without departing from the scope of the present application.

As used herein, the terms "at least one," "a plurality," "each," and "any," at least one of which includes one, two, or more than two, and a plurality of which includes two or more than two, each of which refers to each of the corresponding plurality, and any of which refers to any of the plurality. For example, the plurality of candidate images includes 3 candidate images, each of the 3 candidate images is referred to, and any one of the 3 candidate images is referred to as any one of the 3 candidate images, which may be the first one, the second one, or the third one.

It should be noted that the user information (including but not limited to user device information, user personal information, etc.) referred to in the present application is information authorized by the user or sufficiently authorized by each party.

Fig. 1 is a schematic diagram of an implementation environment provided by an embodiment of the disclosure. Referring to fig. 1, the implementation environment includes an AR (Augmented Reality) device 101 and a server 102, and the AR device 101 and the server 102 are connected through a wireless or wired network. Illustratively, the AR device 101 is AR glasses, a head-mounted AR display, an AR helmet, or the like. The server 102 is illustratively a cloud server that provides services such as cloud computing and cloud storage, and is capable of providing services for the AR device 101.

Illustratively, the AR device 101 has installed thereon an application served by the server 102, through which the AR device interacts with the server 102.

The embodiment of the application provides a game scene for playing the magic cube, and the server 102 is provided with a database, and a plurality of restoration paths matched with appearance data of the magic cube are collected in the database. The magic cube user wears the AR device 101, holds the magic cube by hand, collects appearance data of the magic cube through the AR device 101, searches a restoration path matched with the appearance data in a database of the server 102, displays the AR animation on the AR device 101 based on the restoration path, can watch the AR animation, knows operation steps required for restoring the magic cube, controls the magic cube in the hand according to the operation steps displayed in the AR animation, and completes restoration of the magic cube.

Fig. 2 is a flowchart of an animation display method according to an embodiment of the present application. This embodiment is performed by an AR device, see fig. 2, and comprises the steps of:

201. the AR device collects appearance data of the cube, the appearance data including images corresponding to each surface.

The magic cube can be any type of magic cube, for example, according to the square on each surface of the magic cube, the magic cube can be a three-order magic cube, a four-order magic cube or a multi-order magic cube, and according to the shape of the magic cube, the magic cube can be a cube magic cube, a pyramid magic cube, an irregular magic cube and the like, which is not limited in the embodiment of the application. Illustratively, the cube is a three-order cube, and accordingly, the cube includes six surfaces.

Wherein, AR equipment is AR glasses, wear-type AR display, AR helmet etc. and this AR equipment can demonstrate the augmented reality picture, both can add real scene picture in this augmented reality picture, also can add virtual element to fuse virtual element and real scene's picture as an organic whole, bring better visual experience for the magic cube user.

In this application embodiment, the magic cube user can wear AR equipment to handheld magic cube, the magic cube is located the collection within range of AR equipment this moment, therefore the appearance data of magic cube can be gathered to AR equipment. The appearance data comprises an image corresponding to each surface, and each surface of the magic cube has one or more colors, so that the image corresponding to each surface can reflect the colors on the corresponding surface, and the current state of the magic cube can be determined according to the appearance data.

202. The AR device queries a database for a restoration path matching the appearance data.

The database is used for storing at least one appearance data matched restoration path of the magic cube, and the restoration path comprises at least one operation step. The matching of the appearance data and the restoration path means that the magic cube with the appearance data can be restored to an initial state after being operated by the restoration path, and the initial state means that each surface of the magic cube has only one color.

The database provides data support for the restoration of the magic cube, and a plurality of kinds of appearance data and the matched restoration paths are stored in the database, so that the current required restoration paths can be conveniently inquired in the database when a user of the magic cube plays the magic cube.

203. And the AR equipment shoots the real picture of the current scene and displays the AR animation corresponding to each operation step.

The AR animation comprises a real picture and indication information added in the real picture, the real picture comprises a magic cube, and the real picture is a picture shot in real time, namely the real picture can change along with the change of the current scene. The indication information is used for indicating the magic cube to execute the operation steps, the indication information is not limited in form, as long as the magic cube user can be guided to perform the corresponding operation steps required for restoring the magic cube, each operation step corresponds to one AR animation, and each AR animation is a fusion image of the real image corresponding to the current operation step and the indication information added in the real image.

The recovery path comprises at least one operation step, and the operation steps need to be displayed to the magic cube user, so that the magic cube user is guided to operate the magic cube according to the at least one operation step to recover the magic cube. And in order to vividly and vividly display, the AR equipment displays AR animation, the AR animation is animation of the magic cube executing operation steps, the AR animation corresponding to each operation step is sequentially displayed, dynamic recovery pictures of the magic cube can be displayed, visual cool experience is brought to a user of the magic cube, and the user of the magic cube is enabled to have substitution feeling when learning to recover the magic cube.

The embodiment of the application provides a guide magic cube user to control scheme of magic cube, inquires corresponding reduction route after the appearance data of magic cube is gathered through AR equipment, adopts the form of AR animation to show again, and the display mode is vivid for the magic cube user can simply understand the required operating procedure of reduction magic cube understandably, thereby has reduced the degree of difficulty of magic cube user reduction magic cube.

Fig. 3 is a flowchart of another animation display method according to an embodiment of the present application. This embodiment is performed by an AR device, see fig. 3, and comprises the steps of:

301. the AR device collects appearance data of the cube, the appearance data including images corresponding to each surface.

The AR device and the magic cube are similar to the embodiment shown in fig. 2, and are not described herein again.

In this application embodiment, the magic cube user can wear the AR equipment to hand the magic cube, the magic cube was located the collection within range of AR equipment this moment, therefore the appearance data of magic cube can be gathered to the AR equipment.

Optionally, step 301 includes: the AR equipment responds to a shooting instruction to shoot a first image under the condition of outputting first prompt information, the first prompt information is used for prompting collection of an image corresponding to a first surface of the magic cube, responds to the shooting instruction under the condition of outputting second prompt information, a second image is shot, the second prompt information is used for prompting collection of an image corresponding to a second surface of the magic cube, and the shot images form appearance data until the number of the shot images is equal to the target number. Wherein the target number is the number of surfaces of the magic cube.

Because the magic cube comprises a plurality of surfaces, when the appearance data of the magic cube is collected, the image corresponding to each surface needs to be collected, and the position relations of different surfaces are different, the AR equipment needs to sequentially collect the images corresponding to each surface according to the sequence so as to accurately determine the current color distribution of the magic cube. Therefore, in order to ensure that the magic cube user can shoot the magic cube according to the sequence specified by the AR, the AR equipment outputs prompt information to prompt the magic cube user which surface needs to be shot currently each time shooting is carried out. The prompt information output by the AR device may be text information or voice information, and the form of the prompt information is not limited in the embodiment of the present application.

For example, the first prompt message is used for prompting acquisition of an image corresponding to the first surface of the magic cube, and after the magic cube user views or hears the first prompt message, it can be determined that the first surface of the magic cube needs to be displayed to the AR device for the AR device to shoot. Similarly, after the magic cube user checks or hears the second prompt information, the fact that the second surface of the magic cube needs to be displayed to the AR equipment at present for the AR equipment to shoot can be determined, and the like. Also, in the first prompt message, the first surface may be a surface currently facing the AR device, and in the subsequent prompt message, the positional relationship between the surface to be photographed this time and the first surface may be used to indicate which surface the surface to be photographed this time is, for example, the second prompt message includes "a surface on the left side of the first surface". Alternatively, in the subsequent prompt information, which surface the surface to be shot at this time is may be indicated by a positional relationship between the surface to be shot at this time and the surface shot at the last time, for example, the third prompt information includes "the surface on the right side of the last surface to be shot". Through the mode of pointing out the position relation between the surfaces, the magic cube user is prompted to shoot the surfaces in sequence, the magic cube user can be ensured to quickly and accurately know which surface needs to be shot at present, and the magic cube is quickly controlled to rotate to the correct direction, so that shooting is smoothly completed.

In addition, considering that the AR device can cause a wrong image to be shot if the shooting is too fast or too slow in the process of the magic cube user operating the magic cube, the AR device can shoot only when the magic cube user triggers a shooting instruction. That is, after a prompt message is output each time, the image of the magic cube can be obtained only when a shooting instruction is received.

The shooting instruction may be an operation of clicking a shooting key on the AR device, or an operation of recognizing a shooting keyword from the collected voice data, or other operations.

If the image is only cached and not displayed to the magic cube user after one image is shot each time, the magic cube user cannot determine whether the shot image is correct or not and can accurately reflect the color distribution on the corresponding surface, so that the shot image can be displayed after each shooting in order to ensure the image quality.

Optionally, this step 301 further includes: the AR equipment displays an image display area, wherein the image display area comprises sub-areas of the target number which are arranged in sequence; when an image is shot, the shot image is displayed in the target sub-area, and the sequence of the target sub-area is matched with the shooting sequence of the image, so that the displayed image sequence can be ensured to be consistent with the shooting sequence, and a user of the magic cube can see the image shot each time.

Every time an image is shot, a magic cube user can check whether the shot image is consistent with the surface of AR equipment currently displayed by the magic cube through the image display area, whether the shot image is complete and clear, and the problems of area missing, blurring and the like exist.

For example, the AR device detects a selection operation on a certain image, cancels the image, that is, deletes the cached image, and clears the sub-area where the image is located. The next image taken thereafter may be considered a replacement image for the cancelled image. Or the AR equipment collects the voice information, recognizes the cancel keyword and the image serial number included in the voice information, determines to cancel the image corresponding to the image serial number, and shoots the replacement image of the image.

302. The AR device queries a database for a restoration path matching the appearance data.

The database may be set on the AR device or on the server, which is not limited in this embodiment of the present application. The database is used for storing at least one appearance data matched restoration path of the magic cube, wherein the appearance data matched restoration path can be set by a technician or uploaded by a common user.

In addition, the restoration path matched with the appearance data comprises at least one operation step, which indicates that the magic cube with the appearance data can be restored to an initial state after being controlled according to the operation steps included in the restoration path.

Optionally, in order to reduce the data amount local to the AR device, the database is disposed in the server, and accordingly, step 302 includes: the AR equipment sends a query request to the server, the query request carries appearance data, and the AR equipment receives a restoration path queried in the database by the server.

Optionally, since the playing methods of the magic cube are various, the appearance data of a magic cube may correspond to a plurality of restoration paths, and therefore, the step 302 further includes: the restoration paths matched with the appearance data are searched in the database, and one restoration path is randomly selected by the AR equipment under the condition that a plurality of restoration paths are searched, or the unused restoration paths of the AR equipment are selected, so that a magic cube user can learn a new restoration path, and the interestingness of the magic cube user in restoration of the magic cube is improved.

303. The AR device shoots a real picture of a current scene.

The real picture comprises a magic cube, and is a real-time shot picture, namely the real picture can change along with the change of the current scene.

Optionally, in a case that the shooting instruction is not triggered, the AR device automatically shoots a real picture of a current scene, and caches the shot real picture.

After the real picture is shot, indication information can be added in the real picture, wherein the indication information is used for indicating the operation steps executed on the magic cube, so that AR animation is obtained, and the AR animation is displayed to a magic cube user subsequently, so that the magic cube user can know the operation steps required to be executed on the magic cube.

The indication information may be in various forms, and in the embodiment of the present application, two forms of indication information are listed in step 304 and step 305 described below.

304. And adding the special effect corresponding to the operation step in the display area of the magic cube in the real picture by the AR equipment to obtain the AR animation corresponding to the operation step.

The special effect is the special effect of the virtual magic cube executing the operation steps, and the special effect covers the display area of the magic cube, so that when the AR animation is displayed, other display areas except the real magic cube in the real picture can be displayed, and the special effect covers the real magic cube, so that a picture formed by fusing the virtual magic cube and the real scene can be displayed. For example, the operation steps are that the first column of the magic cube rotates upwards, correspondingly, the special effect is that the first column of the virtual magic cube rotates upwards, the AR animation is a picture that a real picture and the special effect are integrated, and the operation steps for restoring the magic cube are vividly displayed, so that a magic cube user can simply and easily know the operation steps required for restoring the magic cube, and the difficulty of the magic cube user for restoring the magic cube is reduced.

Under the condition that the restoration path comprises a plurality of operation steps, each operation step corresponds to one special effect, therefore, the AR equipment respectively adds the special effect corresponding to each operation step to the display area of the magic cube in the real picture, so that AR animations corresponding to each operation step are obtained, the obtained AR animations are sequentially arranged according to the sequence of the operation steps, and the AR animations can be sequentially displayed subsequently.

305. And adding a direction mark corresponding to the direction in a display area corresponding to the rotating target in the real picture by the AR equipment to obtain the AR animation corresponding to the operation step.

The operation steps comprise the direction in which the rotating target in the magic cube needs to rotate, and the direction marks are used for indicating the rotating direction of the magic cube, so that all areas in a real picture can be displayed when the AR animation is displayed, and the direction marks can be added in the display areas corresponding to the real magic cube, so that a fusion picture of the real picture and the direction marks can be displayed. Where the rotating object can be any row or any column of the puzzle, the direction marker can be an arrow, for example, the rotating object is the first row of the puzzle, the direction marker is arrow "→" pointing to the right, and accordingly, the AR animation is a fusion of the puzzle in the real picture and the arrow pointing to the right located in the first row of the puzzle.

And in order to accurately indicate the rotating target to which the direction mark is directed, the direction mark needs to be displayed in a display area corresponding to the rotating target. For example, if the rotating object is the first row of the puzzle, the direction indicator is displayed in the first row of the puzzle, or to the right of the first row of the puzzle, or if the rotating object is the first column of the puzzle, the direction indicator is displayed in the first column of the puzzle, or above the first column of the puzzle.

It should be noted that the indication information added by the AR device on the real picture may be a special effect, may also be a direction mark, and may also be indication information in other forms.

306. And the AR equipment displays the AR animation corresponding to each operation step.

Each operation step corresponds to one AR animation, and each AR animation is a fusion picture of a real picture corresponding to the current operation step and the indication information added in the real picture. In the case that the restoration path includes a plurality of operation steps, the AR device may sequentially display the AR animation corresponding to each operation step in the order of the plurality of operation steps.

Alternatively, the AR device may generate an AR animation corresponding to a plurality of operation steps first, and after generating the AR animations corresponding to all the operation steps, sequentially display the AR animation corresponding to each operation step. Or the AR device may display the AR animation generated this time after generating an AR animation corresponding to one operation step each time, and then continue to generate an AR animation corresponding to the next operation step, and so on until displaying an AR animation corresponding to the last operation step.

Considering that in the process of restoring the magic cube by the magic cube user, if the time for displaying the AR animation corresponding to each operation step by the AR device is too short, the progress of restoring the magic cube by the magic cube user is inconsistent with the progress of restoring the magic cube displayed in the AR animation, therefore, in order to ensure that the magic cube user restores the magic cube according to the operation steps of restoring the magic cube displayed by the AR animation, the AR device may display the AR animation corresponding to the next operation step when the magic cube user performs the switching display operation.

Optionally, the restoration path includes a plurality of operation steps, and then this step 306 includes: displaying the AR animation corresponding to the first operation step under the condition that the switching display operation is detected, wherein the switching display operation is used for indicating to switch and display the AR animation; and under the condition that the display switching operation is detected again, displaying the AR animation corresponding to the second operation step, wherein the second operation step is the operation step next to the first operation step in the restoration path until the AR animation corresponding to the last operation step is displayed. After checking the AR animation corresponding to the current operation step, the magic cube user can control the magic cube to execute the operation step, then the magic cube user performs switching display operation on the AR equipment, and the AR equipment displays the AR animation displayed in the next operation step according to the detected switching display operation. And the magic cube user can control and display the AR animation according to the speed of restoring the magic cube by himself, so that the magic cube user can know the operation steps of restoring the magic cube more thoroughly, and the difficulty of restoring the magic cube is reduced.

In one possible implementation of the above alternatives, the switching the display operation includes at least one of:

triggering the switching key;

recognizing an operation of switching a keyword included in the voice data;

and collecting the operation of the target gesture.

The specific content of the switching keyword is not limited, and may be set according to needs, for example, the switching keyword may be "next step" or "next step". The target gesture is a hand action made by the magic cube user, and the target gesture can be set according to needs, for example, the target gesture is 'hand raising' or 'gesture of contact between index finger and thumb', and the like.

Optionally, the switching display operation includes at least two operations among the above three operations, and when the magic cube user plays the magic cube, the AR device can be controlled no matter which switching display operation is made, that is, the diversity of the switching display operation meets the requirements of the magic cube user, and various choices are provided for the magic cube user.

Optionally, in the case that the restoration path includes multiple operation steps, the magic cube user may not be required to trigger the display switching operation, and instead, the AR device may sequentially display the AR animation according to the sequence of the operation steps. Then step 306 includes: and sequentially displaying the AR animations corresponding to the operation steps according to the sequence of the operation steps, wherein the display time lengths of the displayed multi-frame AR animations are equal. The display duration can be set by the AR device in a default mode or can be set by the magic cube user.

It should be noted that, in the embodiment of the present application, the case of displaying the AR animation is taken as an example for description, and in another embodiment, the AR device is provided with a teaching mode and a simple mode, and in the teaching mode, the step 306 is executed, so that in the teaching mode, each operation step on the restoration route can be explained in detail one by one according to the AR animation displayed by the AR device, which is convenient for the magic cube user to learn. In a simple mode, the step 306 can be replaced by the following steps: in the simple mode, the guiding information is output, and the guiding information comprises at least one operation step.

Because the magic cube restoration levels of the magic cube users are different and the comprehension abilities are different, for some magic cube users who have strong comprehension abilities and want to restore the magic cube quickly, the AR device provides a simple mode, and displays the operation steps required for restoring the magic cube through the guide information, wherein the guide information can be text information or voice information, and the form of the guide information is not limited in the embodiment of the application. For example: the guiding information is the first left turn of the magic cube, and after the magic cube user checks or hears the guiding information, the corresponding operation steps required for restoring the magic cube can be carried out according to the guiding information.

The embodiment of the application provides a scheme for guiding a magic cube user to control a magic cube, a corresponding restoration path is inquired after appearance data of the magic cube is collected through AR equipment, then the AR equipment shoots a real picture of a current scene, and AR animation corresponding to each operation step is displayed, wherein the AR animation comprises the real picture and indication information added in the real picture, the AR animation is a picture formed by integrating the real picture and the indication information, the display mode is vivid, the magic cube user can simply and easily know the operation steps required by restoring the magic cube, and the difficulty of restoring the magic cube by the magic cube user is reduced.

And because the magic cube comprises a plurality of surfaces, when the appearance data of the magic cube is collected, the image corresponding to each surface needs to be collected, and the position relations of different surfaces are different, the AR equipment needs to sequentially collect the images corresponding to each surface according to the sequence so as to accurately determine the current color distribution of the magic cube. Therefore, by means of the mode of pointing out the position relation between the surfaces, the magic cube user is prompted to shoot the surfaces in sequence, the magic cube user can be guaranteed to quickly and accurately know which surface needs to be shot at present, and the magic cube is quickly controlled to rotate to the correct direction, so that shooting can be smoothly completed.

Moreover, if the image is only cached after each image is shot and is not displayed to the magic cube user, the magic cube user cannot determine whether the shot image is correct, so that the shot image can be displayed after each shooting in order to ensure the image quality. Every time an image is shot, the magic cube user can check whether the shot image is consistent with the current surface displayed for the AR equipment by the magic cube through the image display area, whether the shot image is complete and clear, the problems of area missing, blurring and the like exist, if the problems occur in a certain image, the magic cube user can cancel the image and shoot again, so that the problems that the collected magic cube appearance data is incorrect due to the fact that the shot image is fuzzy and the shooting sequence is wrong, and then the matched restoration path is incorrect can be avoided, and the magic cube user can not restore the magic cube correctly.

Moreover, because the magic cube has various playing methods, the appearance data of one magic cube can correspond to a plurality of restoration paths, so that the AR equipment randomly selects one restoration path or selects an unused restoration path of the AR equipment under the condition of inquiring the plurality of restoration paths, so that a magic cube user can learn a new restoration path, and the interestingness of the magic cube user in restoring the magic cube is improved.

Moreover, if the time for displaying the AR animation corresponding to each operation step by the AR device is too short, the progress of the magic cube user in restoring the magic cube is inconsistent with the progress of the magic cube displayed in the AR animation, so in order to ensure that the magic cube user restores the magic cube according to the operation steps of restoring the magic cube displayed by the AR animation, the AR device may display the AR animation corresponding to the next operation step when the magic cube user performs the switching display operation. The magic cube user can control and display the AR animation according to the speed of restoring the magic cube, so that the magic cube user can know the operation steps of restoring the magic cube more thoroughly, and the difficulty of restoring the magic cube is reduced. The variety of the switching display operation meets the requirements of the magic cube user, and various choices are provided for the magic cube user.

Fig. 4 is a flowchart of a restoration path query method according to an embodiment of the present application. This embodiment is performed by a server, see fig. 4, and comprises the following steps:

401. the server receives an inquiry request sent by the AR equipment, the inquiry request carries appearance data collected by the AR equipment, and the appearance data comprise images corresponding to each surface of the magic cube.

In the embodiment of the application, the AR equipment sends the collected appearance data to the server, and the server confirms the state of the magic cube according to the received appearance data. The appearance data comprises an image corresponding to each surface, and each surface of the magic cube has one or more colors, so that the image corresponding to each surface can reflect the colors on the corresponding surface, and the current state of the magic cube can be determined according to the appearance data.

402. And the server responds to the query request and queries the database for the restoration path matched with the appearance data.

The database is used for storing at least one appearance data matched restoration path of the magic cube. The restoration path in which the appearance data is matched may be set by a technician or uploaded by an ordinary user. In addition, the restoration path matched with the appearance data comprises at least one operation step, which indicates that the magic cube with the appearance data can be restored to the initial state after being manipulated according to the operation steps included in the restoration path.

403. The server sends the restoration path to the AR device.

The AR equipment is used for shooting a real picture of a current scene and displaying an AR animation corresponding to each operation step, the AR animation comprises the real picture and indication information added in the real picture, and the indication information is used for indicating the operation step to be executed on the magic cube.

In addition, since there are many restoration paths of the magic cube, the database needs to be updated, and the updating process includes: and the server receives the updating data sent by the terminal, the updating data comprises appearance data and a corresponding restoration path, and the terminal is a terminal with updating authority and adds the updating data to the database. For example, a terminal used by a technician managing the server may be updated into the database after the technician collects the update data. Or the terminal is used by the magic cube amateur, namely the terminal used by one or more magic cube amateurs issues the updating authority, and the magic cube amateurs are encouraged to update various restoration paths into the database, so that a large data volume can be rapidly collected, the burden of technicians is reduced, and the majority of the magic cube amateurs can be attracted to participate in a magic cube game by using AR equipment.

The embodiment of the application provides a scheme of route of reduction inquiry, because AR's memory capacity is limited, set up the database in the server, the server inquires the route of reduction who matches with it in the database according to received appearance data, then send this route of reduction for AR equipment, thereby the storage burden of AR equipment has been alleviateed, and the route of reduction of magic cube is various, need carry out real-time update to the database, the database is arranged in the server, AR equipment can inquire the route of reduction after the update fast in time like this, bring better operation experience for the magic cube user.

Fig. 5 is a flowchart of another animation display method according to an embodiment of the present application. This embodiment is performed by the AR device interacting with the server, and referring to fig. 5, the embodiment includes the following steps:

501. the AR equipment collects appearance data of the magic cube, and the appearance data comprise images corresponding to all surfaces.

502. And the AR equipment sends a query request to the server, wherein the query request carries the appearance data.

503. And the server responds to the query request sent by the AR device and queries the database for the restoration path matched with the appearance data.

504. The server sends the restoration path to the AR device.

505. And the AR equipment receives the restoration path inquired in the database by the server, shoots the real picture of the current scene and displays the AR animation corresponding to each operation step.

The embodiment of the application provides a scheme for guiding a magic cube user to control a magic cube, wherein a database is arranged in a server, display of AR animation is completed through interactive execution of AR equipment and the server, the AR equipment sends an inquiry request to the server after collecting appearance data of the magic cube, the server inquires a restoring path matched with the appearance data in the database according to the appearance data in the inquiry request, then the server sends the inquired restoring path to the AR equipment, the AR equipment generates corresponding AR animation according to received operation steps in the restoring path, and finally the AR animation corresponding to each operation step is displayed. The display mode of the restoring magic cube is vivid, so that a magic cube user can simply and easily know the operation steps required by the restoring magic cube, and when the AR equipment is worn, the magic cube user can liberate both hands, and make the corresponding magic cube restoring operation according to the displayed AR animation, thereby improving the efficiency of the magic cube user when restoring the magic cube, and reducing the difficulty of restoring the magic cube.

Fig. 6 is a block diagram of an animation display device according to an embodiment of the present application. Referring to fig. 6, the animation display device includes:

the image acquisition module 601 is used for acquiring appearance data of the magic cube, wherein the appearance data comprises images corresponding to all surfaces;

a restoration path query module 602, configured to query a database for a restoration path matched with the appearance data, where the restoration path includes at least one operation step, and the database is used to store at least one restoration path matched with the appearance data of the magic cube;

and the animation display module 603 is configured to shoot a real picture of a current scene, and display an AR animation corresponding to each operation step, where the AR animation includes the real picture and indication information added to the real picture, and the indication information is used to indicate that the operation step is performed on the magic cube.

In one possible implementation, the apparatus further includes:

In one possible implementation, the operation step includes a direction in which a rotating target in the puzzle needs to rotate, and the apparatus further includes:

and the direction mark adding module is used for adding a direction mark corresponding to the direction in the display area corresponding to the rotating target in the real picture to obtain the AR animation corresponding to the operation step.

In one possible implementation, the animation display module 603 includes:

the switching display unit is used for displaying the AR animation corresponding to the first operation step under the condition that the switching display operation is detected, and the switching display operation is used for indicating the switching display of the AR animation; and under the condition that the display switching operation is detected again, displaying the AR animation corresponding to the second operation step, wherein the second operation step is the operation step next to the first operation step in the restoration path until the AR animation corresponding to the last operation step is displayed.

In one possible implementation, switching the display operation includes at least one of:

triggering the switching key;

recognizing an operation of switching a keyword included in the voice data;

and collecting the operation of the target gesture.

In one possible implementation, the animation display module 603 is configured to:

In one possible implementation, the image acquisition module 601 is configured to:

and under the condition of outputting second prompt information, responding to the shooting instruction, shooting a second image, wherein the second prompt information is used for prompting to shoot images corresponding to the second surface of the magic cube until the number of the shot images is equal to the number of targets, and forming appearance data by using a plurality of shot images, wherein the number of the targets is the number of the surfaces of the magic cube.

In one possible implementation, the apparatus is further configured to:

In one possible implementation, the restoration path query module 602 includes:

and the guiding module is used for displaying guiding information under a simple mode, and the guiding information comprises at least one operation step.

In one possible implementation, the restoration path query module 602 includes:

the sending unit is used for sending a query request to the server, and the query request carries appearance data;

and the receiving unit is used for receiving the restoration path queried in the database by the server.

It should be noted that: in the above-described embodiment, when displaying the AR animation, the animation display apparatus is exemplified by only the division of the above-described functional modules, and in practical applications, the above-described function distribution may be completed by different functional modules according to needs, that is, the internal structure of the AR device is divided into different functional modules to complete all or part of the above-described functions. In addition, the animation display device and the animation display method provided by the above embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments in detail and are not described herein again.

Fig. 7 is a block diagram of a restoration path query apparatus according to an embodiment of the present application. Referring to fig. 7, the restore path query includes:

a receiving module 701, configured to receive a query request sent by an AR device, where the query request carries appearance data collected by the AR device, and the appearance data includes an image corresponding to each surface of the magic cube;

a query module 702, configured to query, in response to a query request, a database for a restoration path matched with appearance data, where the restoration path includes at least one operation step, and the database is configured to store at least one restoration path matched with appearance data of the magic cube;

the sending module 703 is configured to send the restoration path to an AR device, where the AR device is configured to shoot a real picture of a current scene, and display an AR animation corresponding to each operation step, where the AR animation includes the real picture and indication information added in the real picture, and the indication information is used to indicate that the operation step is performed on the magic cube.

In one possible implementation, the apparatus further includes:

the updating module is used for receiving updating data sent by the terminal, the updating data comprises appearance data and a corresponding restoration path, and the terminal is a terminal with the authority of updating the database; the update data is added to the database.

In the embodiment of the application, the storage capacity of the AR is limited, the database is arranged in the server, the server inquires the restoration path matched with the received appearance data in the database according to the received appearance data, and then sends the restoration path to the AR equipment, so that the storage burden of the AR equipment is reduced, the restoration path of the magic cube is various, the database needs to be updated in real time, and the database is arranged in the server, so that the AR equipment can quickly and timely inquire the updated restoration path, and better operation experience is brought to a user of the magic cube.

It should be noted that: in the embodiment, when querying the restoration path, the restoration path querying apparatus is only illustrated by dividing the functional modules, and in practical applications, the function distribution may be completed by different functional modules according to needs, that is, the internal structure of the server is divided into different functional modules to complete all or part of the functions described above. In addition, the embodiment of the restoration path query device and the embodiment of the restoration path query method provided in the above embodiments belong to the same concept, and the specific implementation process thereof is described in detail in the method embodiments and is not described herein again.

The embodiment of the present application further provides an AR device, where the AR device includes a processor and a memory, where the memory stores at least one program code, and the at least one program code is loaded and executed by the processor, so as to implement the animation display method according to the above embodiment.

Optionally, fig. 8 shows a block diagram of an AR device 800 according to an exemplary embodiment of the present application. The AR device 800 may be: AR glasses, a head-mounted AR display, and an AR helmet.

The AR device 800 includes: a processor 801 and a memory 802.

The processor 801 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and so forth. The processor 801 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), PLA (Programmable Logic Array). The processor 801 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 801 may be integrated with a GPU (Graphics Processing Unit) which is responsible for rendering and drawing the content required to be displayed by the display screen. In some embodiments, the processor 801 may further include an AI (Artificial Intelligence) processor for processing computing operations related to machine learning.

Memory 802 may include one or more computer-readable storage media, which may be non-transitory. Memory 802 may also include high speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 802 is used to store at least one program code for execution by processor 801 to implement the animation display method provided by method embodiments herein.

In some embodiments, the AR device 800 may further optionally include: a peripheral interface 803 and at least one peripheral. The processor 801, memory 802, and peripheral interface 803 may be connected by buses or signal lines. Various peripheral devices may be connected to the peripheral interface 803 by a bus, signal line, or circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 804, a display screen 805, a camera assembly 806, an audio circuit 807, a positioning assembly 808, and a power supply 809.

The peripheral interface 803 may be used to connect at least one peripheral device related to I/O (Input/Output) to the processor 801 and the memory 802. In some embodiments, the processor 801, memory 802, and peripheral interface 803 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 801, the memory 802, and the peripheral interface 803 may be implemented on separate chips or circuit boards, which is not limited by the present embodiment.

The Radio Frequency circuit 804 is used for receiving and transmitting RF (Radio Frequency) signals, also called electromagnetic signals. The radio frequency circuitry 804 communicates with a communication network and other communication devices via electromagnetic signals. The rf circuit 804 converts an electrical signal into an electromagnetic signal to be transmitted, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 804 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a magic cube user identity module card, and the like. The radio frequency circuitry 804 may communicate with other AR devices via at least one wireless communication protocol. The wireless communication protocols include, but are not limited to: metropolitan area networks, various generation mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and/or WiFi (Wireless Fidelity) networks. In some embodiments, the radio frequency circuit 804 may further include NFC (Near Field Communication) related circuits, which are not limited in this application.

The display 805 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display 805 is a touch display, the display 805 also has the ability to capture touch signals on or above the surface of the display 805. The touch signal may be input to the processor 801 as a control signal for processing. At this point, the display 805 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, the display 805 may be one, providing the front panel of the AR device 800; in other embodiments, the display screens 805 may be at least two, each disposed on a different surface of the AR device 800 or in a folded design; in other embodiments, the display 805 may be a flexible display, disposed on a curved surface or on a folded surface of the AR device 800. Even further, the display 805 may be arranged in a non-rectangular irregular pattern, i.e., a shaped screen. The Display 805 can be made of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), and other materials.

The camera assembly 806 is used to capture images or video. Optionally, camera assembly 806 includes a front camera and a rear camera. The front camera is arranged on the front panel of the AR equipment, and the rear camera is arranged on the back of the AR equipment. In some embodiments, the number of the rear cameras is at least two, and each rear camera is any one of a main camera, a depth-of-field camera, a wide-angle camera and a telephoto camera, so that the main camera and the depth-of-field camera are fused to realize a background blurring function, the main camera and the wide-angle camera are fused to realize panoramic shooting and a VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, camera assembly 806 may also include a flash. The flash lamp can be a monochrome temperature flash lamp or a bicolor temperature flash lamp. The double-color-temperature flash lamp is a combination of a warm-light flash lamp and a cold-light flash lamp, and can be used for light compensation at different color temperatures.

The audio circuit 807 may include a microphone and a speaker. The microphone is used for collecting sound waves of the magic cube user and the environment, converting the sound waves into electric signals, inputting the electric signals into the processor 801 for processing, or inputting the electric signals into the radio frequency circuit 804 to realize voice communication. For stereo capture or noise reduction purposes, multiple microphones may be provided, each at a different location of the AR device 800. The microphone may also be an array microphone or an omni-directional pick-up microphone. The speaker is used to convert electrical signals from the processor 801 or the radio frequency circuit 804 into sound waves. The loudspeaker can be a traditional film loudspeaker or a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, the speaker can be used for purposes such as converting an electric signal into a sound wave audible to a human being, or converting an electric signal into a sound wave inaudible to a human being to measure a distance. In some embodiments, the audio circuitry 807 may also include a headphone jack.

The positioning component 808 is used to locate the current geographic Location of the AR device 800 to implement navigation or LBS (Location Based Service). The Positioning component 808 may be a Positioning component based on the GPS (Global Positioning System) in the united states, the beidou System in china, the graves System in russia, or the galileo System in the european union.

A power supply 809 is used to power the various components in the AR device 800. The power supply 809 can be ac, dc, disposable or rechargeable. When power source 809 comprises a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery may also be used to support fast charge technology.

In some embodiments, the AR device 800 also includes one or more sensors 810. The one or more sensors 810 include, but are not limited to: acceleration sensor 811, gyro sensor 812, pressure sensor 813, fingerprint sensor 814, optical sensor 815 and proximity sensor 816.

The acceleration sensor 811 may detect the magnitude of acceleration in three coordinate axes of a coordinate system established with the AR device 800. For example, the acceleration sensor 811 may be used to detect components of the gravitational acceleration in three coordinate axes. The processor 801 may control the display 805 to display the magic cube user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 811. The acceleration sensor 811 may also be used for acquisition of motion data of a game or puzzle user.

The gyro sensor 812 may detect the body direction and the rotation angle of the AR apparatus 800, and the gyro sensor 812 may collect the 3D motion of the magic cube user to the AR apparatus 800 in cooperation with the acceleration sensor 811. From the data collected by the gyro sensor 812, the processor 801 may implement the following functions: motion sensing (e.g. changing the UI according to the tilting operation of the puzzle user), image stabilization while filming, game control, and inertial navigation.

The pressure sensors 813 may be disposed on the side bezel of the AR device 800 and/or underneath the display screen 805. When the pressure sensor 813 is arranged on the side frame of the AR device 800, the holding signal of the magic cube user to the AR device 800 can be detected, and the processor 801 performs left-right hand recognition or quick operation according to the holding signal collected by the pressure sensor 813. When the pressure sensor 813 is arranged at the lower layer of the display screen 805, the processor 801 controls the operability control on the UI interface according to the pressure operation of the magic cube user on the display screen 805. The operability control comprises at least one of a button control, a scroll bar control, an icon control, and a menu control.

The fingerprint sensor 814 is used for collecting the fingerprint of the magic cube user, and the identity of the magic cube user is identified by the processor 801 according to the fingerprint collected by the fingerprint sensor 814, or the identity of the magic cube user is identified by the fingerprint sensor 814 according to the collected fingerprint. When the identity of the magic cube user is identified as a trusted identity, the magic cube user is authorized by the processor 801 to perform relevant sensitive operations, including unlocking the screen, viewing encrypted information, downloading software, paying, changing settings, and the like. The fingerprint sensor 814 may be disposed on the front, back, or side of the AR device 800. When a physical button or vendor Logo is provided on the AR device 800, the fingerprint sensor 814 may be integrated with the physical button or vendor Logo.

The optical sensor 815 is used to collect ambient light intensity. In one embodiment, the processor 801 may control the display brightness of the display 805 based on the ambient light intensity collected by the optical sensor 815. Specifically, when the ambient light intensity is high, the display brightness of the display screen 805 is increased; when the ambient light intensity is low, the display brightness of the display 805 is reduced. In another embodiment, the processor 801 may also dynamically adjust the shooting parameters of the camera assembly 806 according to the ambient light intensity collected by the optical sensor 815.

A proximity sensor 816, also known as a distance sensor, is disposed on the front panel of the AR device 800. The proximity sensor 816 is used to capture the distance between the user of the cube and the front face of the AR device 800. In one embodiment, the processor 801 controls the display 805 to switch from the bright screen state to the dark screen state when the proximity sensor 816 detects that the distance between the puzzle user and the front face of the AR device 800 is gradually reduced; when the proximity sensor 816 detects that the distance between the user of the puzzle and the front face of the AR device 800 is gradually increasing, the display 805 is controlled by the processor 801 to switch from a breath-screen state to a bright-screen state.

Those skilled in the art will appreciate that the configuration shown in fig. 8 does not constitute a limitation of AR device 800, and may include more or fewer components than shown, or may combine certain components, or may employ a different arrangement of components.

The embodiment of the present application further provides a server, where the server includes a processor and a memory, where at least one program code is stored in the memory, and the at least one program code is loaded and executed by the processor, so as to implement the animation display method according to the above embodiment.

Optionally, fig. 9 is a schematic structural diagram of a server provided in this embodiment of the present application, where the server 900 may generate a relatively large difference due to a difference in configuration or performance, and may include one or more processors (CPUs) 901 and one or more memories 902, where at least one program code is stored in the memory 902, and the at least one program code is loaded and executed by the processors 901 to implement the animation display method provided in each method embodiment described above. Of course, the server may also have components such as a wired or wireless network interface, a keyboard, and an input/output interface, so as to perform input/output, and the server may also include other components for implementing the functions of the device, which are not described herein again.

The embodiment of the present application further provides a computer-readable storage medium, in which at least one program code is stored, and the at least one program code is loaded and executed by a processor, so as to implement the animation display method of the above embodiment.

The embodiment of the present application further provides a computer program product, which includes at least one program code, and the program code is loaded and executed by a processor to implement the animation display method of the above embodiment.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, and the program may be stored in a computer-readable storage medium, where the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk.

The present application is intended to cover various modifications, equivalent arrangements, improvements, etc. without departing from the spirit and scope of the present application.

Claims

1. An animation display method, performed by an Augmented Reality (AR) device, the method comprising:

2. The method according to claim 1, wherein after the capturing of the real picture of the current scene, the method further comprises:

3. The method according to claim 1, wherein the operation step comprises a direction in which a rotating target in the magic cube needs to rotate, and after the real picture of the scene where the current scene is located is shot, the method further comprises:

4. The method according to claim 1, wherein the restoration path includes a plurality of operation steps, and the capturing a real picture of a current scene and displaying an AR animation corresponding to each operation step includes:

and under the condition that the display switching operation is detected again, displaying the AR animation corresponding to a second operation step, wherein the second operation step is the operation step next to the first operation step in the restoration path until the AR animation corresponding to the last operation step is displayed.

5. A method according to claim 1, wherein said collecting appearance data of a puzzle cube comprises:

6. The method of claim 5, further comprising:

displaying an image display area including the target number of sub-areas arranged in order;

7. The method of claim 1, wherein querying the database for a restoration path matching the appearance data further comprises:

querying the database for a restoration path matching the appearance data;

8. The method according to claim 1, wherein the capturing a real picture of a current scene and displaying the AR animation corresponding to each operation step comprises:

9. The method according to any one of claims 1-8, wherein the database is located in a server, and the querying the database for the restoration path matching the appearance data comprises:

and receiving the restoration path queried in the database by the server.

10. A restoration path query method, performed by a server, the method comprising:

responding to the query request, querying a database for a restoration path matched with the appearance data, wherein the restoration path comprises at least one operation step, and the database is used for storing at least one restoration path matched with the appearance data of the magic cube;

11. An animation display device, characterized in that the device comprises:

the restoration path query module is used for querying a restoration path matched with the appearance data in a database, the restoration path comprises at least one operation step, and the database is used for storing the restoration path matched with at least one appearance data of the magic cube;

12. A restoration path querying device, the device comprising:

the receiving module is used for receiving a query request sent by the AR equipment, wherein the query request carries appearance data collected by the AR equipment, and the appearance data comprises images corresponding to each surface of the magic cube;

and the sending module is used for sending the restoration path to the AR equipment, the AR equipment is used for shooting a real picture of the current scene and displaying the AR animation corresponding to each operation step, the AR animation comprises the real picture and indication information added in the real picture, and the indication information is used for indicating the magic cube to execute the operation step.

13. An AR device comprising a processor and a memory, the memory having stored therein at least one program code, the program code loaded and executed by the processor to implement the animation display method of any of claims 1 to 9.

14. A server, characterized in that the server comprises a processor and a memory, wherein at least one program code is stored in the memory, and the program code is loaded and executed by the processor to implement the restoration path query method according to claim 10.

15. A computer-readable storage medium, characterized in that at least one program code is stored in the storage medium, which is loaded and executed by a processor to implement the animation display method as claimed in any one of claims 1 to 9 or to implement the restoration path query method as claimed in claim 10.