CN107291222B - Interactive processing method, device and system of virtual reality equipment and virtual reality equipment - Google Patents
Interactive processing method, device and system of virtual reality equipment and virtual reality equipment Download PDFInfo
- Publication number
- CN107291222B CN107291222B CN201710343042.9A CN201710343042A CN107291222B CN 107291222 B CN107291222 B CN 107291222B CN 201710343042 A CN201710343042 A CN 201710343042A CN 107291222 B CN107291222 B CN 107291222B
- Authority
- CN
- China
- Prior art keywords
- real object
- preset
- scene
- preset real
- operated
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Abstract
The embodiment of the application discloses an interactive processing method, an interactive processing device and an interactive processing system for virtual reality equipment and the virtual reality equipment. The method comprises the following steps: determining a preset real object for simulating a virtual object to be operated in a Virtual Reality (VR) scene, wherein the preset real object comprises a real object of which the matching degree of preset object attribute information and the object attribute information of the virtual object to be operated in the VR scene is greater than or equal to a preset matching degree; acquiring the moving track information of the preset real object; and moving the virtual object to be operated in the VR scene according to the movement track information. By means of the method and the device, the problem that a user generates large deviation when controlling the virtual object in the virtual scene through operation of the VR handle can be solved, operation reality of the user is improved, and user interaction experience is improved.
Description
Technical Field
The present application relates to the field of information processing technologies, and in particular, to an interactive processing method, an interactive processing device, an interactive processing system, and a virtual reality device.
Background
Virtual Reality (VR) technology is a computer simulation system that can create and experience a Virtual world, which uses a computer to create a simulated environment, which is a systematic simulation of interactive three-dimensional dynamic views and physical behaviors with multi-source information fusion, and immerses users in the environment.
With the increasing maturity of VR technology, VR devices have gradually become one of essential entertainment devices in people's lives. Present VR equipment can provide the VR handle that supports with the VR scene for the user in the use, and the VR handle can be used for simulating various virtual object in the VR scene, makes the user in the reality can interact with the virtual object in VR scene or the VR scene, and the user realizes the virtual object operation in the virtual scene of VR through removing the VR handle or pressing the button on the handle etc.. For example: a ski stick in a virtual scene is simulated by using a VR handle in a skiing VR game, and the user can wave the ski stick in the virtual scene by waving the VR handle in hands, so that the interaction between the user in reality and the virtual skiing scene is realized.
However, when a virtual object is simulated by using the VR handle in the prior art, the virtual object in some VR scenes is greatly different from the VR handle, so that the operation reality of a user is greatly reduced, and meanwhile, the operation mode is different, so that the user is difficult to simulate and operate a real object in real life by operating the VR handle, which causes a large deviation when the user controls the virtual object in the virtual scene by operating the VR handle. Therefore, the virtual object in the VR virtual scene simulated by the VR handle in the prior art has great limitation, the interaction effect is poor, and the user experience is greatly reduced.
Disclosure of Invention
The embodiment of the application aims to provide an interaction processing method, device and system for virtual reality equipment and the virtual reality equipment, which can solve the problem that a user has a large deviation when controlling a virtual object in a virtual scene through operating a VR handle, improve the operation reality of the user and improve the user interaction experience.
In order to solve the above technical problem, the embodiment of the present application is implemented as follows:
an interactive processing method of virtual reality equipment comprises the following steps:
determining a preset real object for simulating a virtual object to be operated in a Virtual Reality (VR) scene, wherein the preset real object comprises a real object of which the matching degree of preset object attribute information and the object attribute information of the virtual object to be operated in the VR scene is greater than or equal to a preset matching degree;
acquiring the moving track information of the preset real object;
and moving the virtual object to be operated in the VR scene according to the movement track information.
An interaction processing apparatus of a virtual reality device, comprising:
the virtual object simulation system comprises a preset real object determining module, a virtual object simulation module and a virtual object simulation module, wherein the preset real object determining module is used for determining a preset real object used for simulating a virtual object to be operated in a Virtual Reality (VR) scene, and the preset real object comprises a real object of which the matching degree of preset object attribute information and the object attribute information of the virtual object to be operated in the VR scene is greater than or equal to a preset matching degree;
the moving track information acquisition module is used for acquiring moving track information of a preset real object;
and the control module is used for moving the virtual object to be operated in the VR scene according to the movement track information.
An interaction processing system for a virtual reality device, comprising a processor and a memory, the memory storing computer program instructions for execution by the processor, the computer program instructions comprising:
determining a preset real object for simulating a virtual object to be operated in a Virtual Reality (VR) scene, wherein the preset real object comprises a real object of which the matching degree of preset object attribute information and the object attribute information of the virtual object to be operated in the VR scene is greater than or equal to a preset matching degree;
acquiring the moving track information of the preset real object;
and moving the virtual object to be operated in the VR scene according to the movement track information.
A virtual reality device comprising a processor and a memory, the memory storing computer program instructions for execution by the processor, the computer program instructions comprising:
determining a preset real object for simulating a virtual object to be operated in a Virtual Reality (VR) scene, wherein the preset real object comprises a real object of which the matching degree of preset object attribute information and the object attribute information of the virtual object to be operated in the VR scene is greater than or equal to a preset matching degree;
acquiring the moving track information of the preset real object;
and moving the virtual object to be operated in the VR scene according to the movement track information.
A computer storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of:
determining a preset real object for simulating a virtual object to be operated in a Virtual Reality (VR) scene, wherein the preset real object comprises a real object of which the matching degree of preset object attribute information and the object attribute information of the virtual object to be operated in the VR scene is greater than or equal to a preset matching degree;
acquiring the moving track information of the preset real object;
and moving the virtual object to be operated in the VR scene according to the movement track information.
According to the technical scheme provided by the embodiment of the application, the movement track information of the preset real object which can be used for simulating the virtual object to be operated in the virtual reality VR scene is obtained, so that the user can control the virtual object in the VR scene by operating the real object, the operation sense of reality of the user can be greatly improved, and the user interaction experience is improved. Compared with the prior art, the technical scheme provided by the application can greatly improve the operation reality of the user and improve the user interaction experience; meanwhile, the problem that when a virtual object is simulated by the VR handle in the prior art, the operation mode caused by the large difference between the virtual object and the VR handle is different, and the large deviation occurs when the user controls the virtual object in a virtual scene through the operation of the VR handle due to the different operation modes is solved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the present application, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a schematic flowchart of an embodiment of an interaction processing method for a virtual reality device provided in the present application;
fig. 2 is a schematic flowchart of an embodiment of obtaining information of a movement track of a preset real object according to the present application;
fig. 3 is a schematic flowchart of another embodiment of obtaining information of a movement track of a preset real object according to the present application;
fig. 4 is a schematic structural diagram of an embodiment of an interaction processing apparatus of a virtual reality device provided in the present application;
fig. 5 is a schematic structural diagram of an embodiment of a head-display virtual reality device provided in the present application.
Detailed Description
The embodiment of the application provides an interactive processing method, an interactive processing device and an interactive processing system for virtual reality equipment and the virtual reality equipment.
In order to make those skilled in the art better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The following describes specific implementations of embodiments of the present application in detail with reference to several specific examples.
First, an embodiment of an interaction processing method of a virtual reality device according to the present application is described below. Fig. 1 is a flow chart of an embodiment of an interaction processing method for a virtual reality device provided by the present application, which provides the method operation steps described in the embodiment or the flow chart, but may include more or less operation steps based on conventional or non-creative labor. The order of steps recited in the embodiments is merely one manner of performing the steps in a multitude of orders and does not represent the only order of execution. In actual implementation, the system or client product may execute sequentially or in parallel (e.g., in the context of parallel processors or multi-threaded processing) according to the embodiments or methods shown in the figures. Specifically, as shown in fig. 1, the method may include:
s1: determining a preset real object for simulating a virtual object to be operated in a Virtual Reality (VR) scene, wherein the preset real object comprises preset object attribute information and a real object with the matching degree of the object attribute information of the virtual object to be operated in the VR scene greater than or equal to the preset matching degree.
The preset real object in the embodiment of the application can be used for simulating one or more virtual objects to be operated in a VR scene. Correspondingly, the preset real object corresponds to one or more to-be-operated virtual objects in the VR scene. The preset real object may include a real object whose matching degree between the preset object attribute information and the object attribute information of the virtual object to be operated in the VR scene is greater than or equal to a preset matching degree. Specifically, the virtual object to be operated may be any virtual object in a VR scene.
Specifically, the object attribute information may include information such as a shape, a material, a state, and a color of the object. Specifically, the preset matching degree may be quantized to a specific value in advance according to a preset rule according to information included in the object attribute information of the two objects. For example, the preset matching degree may be 60%. Specifically, the influence of the information contained in the object attribute information on the matching degree of the two objects may be different, so that the matching degree of different information may be combined with a corresponding preset weight coefficient (the preset weight coefficient may be preset according to the influence of the corresponding information on the matching degree of the two objects), and then the matching degree of the two objects is calculated.
In a specific embodiment, the matching degree between the object attribute information of the preset real object and the object attribute information of the virtual object to be operated is a degree or trend of a symbolized representation, rather than a specific numerical value, and accordingly, the content of the symbolized representation can be quantized to a specific value by a preset rule. And then, subsequently, determining a real object which can be used for simulating the virtual object to be operated by using the quantized value and the preset matching degree. In a common example, the degree of matching between the object attribute information of the preset real object and the object attribute information of the virtual object to be operated may be "middle", and the "middle" of the character may be quantized to be the binary value or the hexadecimal value of the ASCII code.
In a specific embodiment, the determining a preset real object for simulating a virtual object to be operated in a virtual reality VR scene may include:
shooting a photo including a virtual object to be operated in a simulated VR scene;
and identifying the preset real object from the photo.
Specifically, a preset real object identified from the shot picture may be set as a simulation of one or more virtual objects (virtual objects to be operated) in the current VR scene. Specifically, the preset real object may be a real object whose matching degree between the object attribute information specified by the user and the object attribute information of the virtual object to be operated reaches a preset matching degree.
In a specific embodiment, taking VR chess game as an example, a real chess piece may be used to simulate a chess piece in a VR scene, or a small wood piece in a real scene, similar in shape to a chess piece, may be used to simulate a chess piece in a VR scene.
S2: and acquiring the moving track information of the preset real object.
In the embodiment of the application, the movement track information of the preset real object can be acquired. Specifically, the movement track information may include track information composed of one or more pieces of movement information such as a movement distance, a direction, and a speed in a movement process of the preset object, and the movement track information may reflect real operations of the user on the preset object, such as movement, rotation, extrusion, stretching, and throwing operations of the user on the object.
In a specific embodiment, fig. 2 is a schematic flowchart of an embodiment of obtaining information of a movement track of a preset real object according to the present application, and as shown in fig. 2, the method may include:
s210: and shooting a video of the user in the preset real object operation process.
In a specific embodiment, the information of the moving track of the preset real object in the operation process of the user on the preset real object may be recorded by shooting a video of the operation process of the user on the preset real object.
Specifically, for the VR chess game, as an example, it is assumed that a real chess piece is used to simulate a chess piece in a VR scene, and it is assumed that a current operation is a chess piece "soldier", and a video of a user in the operation process of the chess piece "soldier" can be shot, and the movement track information of the user on a preset object in the operation process of the preset object is recorded in the video.
S220: and identifying the preset real object from the video, and determining the moving track information of the preset real object.
Specifically, with the chess piece in the VR chess game that uses a real chess piece to simulate the VR scene as an example, after obtaining the video of user to piece "soldier" operation in-process, can follow through image recognition software discern in the video predetermine the real object, then determine predetermine the removal orbit information of real object. Specifically, the moving track information such as the direction, the moving distance, the speed and the like of the preset real object can be determined by extracting the video frame and combining the video duration and the like.
In another specific embodiment, fig. 3 is a schematic flowchart of another embodiment of obtaining information of a movement track of a preset real object provided by the present application, and as shown in fig. 3, the method may include:
s310: and arranging mobile information sensing equipment on the preset real object.
Specifically, the step of setting the mobile information sensing device on the preset physical object may include installing the mobile information sensing device on the preset physical object. In practical application, in order to ensure the sense of reality when a user operates a preset real object, the mobile information sensing device may be packaged and installed on the preset real object in combination with the object attribute information of the preset real object.
The movement information sensing device can comprise a distance sensor, a position sensor, a speed sensor and other sensing devices which can record the movement track information of an object. Specifically, in combination with the movement trace information that needs to be acquired in practical application, the movement information sensing device may include one or more movement information sensing devices that can be used to detect the movement trace information that needs to be acquired.
In addition, it should be noted that, in the embodiment of the present application, the movement information sensing device is not limited to the above-mentioned sensor, and in practical applications, other devices capable of sensing movement information, such as a radar sensor, may also be included, and the embodiment of the present application is not limited to the above.
S320: detecting the mobile information of the user in the operation process of the preset real object by utilizing the mobile information sensing equipment;
in practical application, when the user operates the preset real object, the mobile information sensing device is arranged together with the preset real object, and the mobile information sensing device can detect the mobile information of the preset real object caused by the user operation in the process of operating the preset real object by the user
S330: and determining the movement track information of the preset real object by using the movement information.
Specifically, after the mobile information sensing device detects the mobile information in the operation process of the user on the preset real object, the mobile information may be used to determine the mobile track information of the preset real object.
S3: and moving the virtual object to be operated in the VR scene according to the movement track information.
In a specific embodiment, the moving the virtual object to be operated in the VR scene according to the movement track information may include:
determining a virtual object to be operated corresponding to the preset real object from the VR scene;
and controlling the corresponding virtual object to be operated to move according to the movement track information of the preset real object in the VR scene.
Therefore, according to the embodiment of the interaction processing method of the virtual reality equipment, the movement track information of the preset real object which can be used for simulating the virtual object to be operated in the virtual reality VR scene is obtained, so that the user can control the virtual object in the VR scene by operating the real object, the operation sense of reality of the user can be greatly improved, and the interaction experience of the user is improved. Compared with the prior art, the technical scheme provided by the application can greatly improve the operation reality of the user and improve the user interaction experience; meanwhile, the problem that when a virtual object is simulated by the VR handle in the prior art, the operation mode caused by the large difference between the virtual object and the VR handle is different, and the large deviation occurs when the user controls the virtual object in a virtual scene through the operation of the VR handle due to the different operation modes is solved.
Another aspect of the present application further provides an interaction processing apparatus for a virtual reality device, fig. 4 is a schematic structural diagram of an embodiment of the interaction processing apparatus for a virtual reality device provided in the present application, and as shown in fig. 4, the apparatus 400 may include:
the preset real object determining module 410 may be configured to determine a preset real object used for simulating a virtual object to be operated in a virtual reality VR scene, where the preset real object includes a real object whose matching degree between preset object attribute information and object attribute information of the virtual object to be operated in the VR scene is greater than or equal to a preset matching degree;
the moving track information acquiring module 420 may be configured to acquire moving track information of a preset real object;
the control module 430 may be configured to move the virtual object to be operated in the VR scene according to the movement track information.
In another aspect, the present application further provides an interaction processing system of a virtual reality device, and specifically, the system includes a processor and a memory, where the memory stores computer program instructions executed by the processor, and the computer program instructions include:
determining a preset real object for simulating a virtual object to be operated in a Virtual Reality (VR) scene, wherein the preset real object comprises a real object of which the matching degree of preset object attribute information and the object attribute information of the virtual object to be operated in the VR scene is greater than or equal to a preset matching degree;
acquiring the moving track information of the preset real object;
and moving the virtual object to be operated in the VR scene according to the movement track information.
Specifically, in the embodiment of the present application, the processor may include a Central Processing Unit (CPU), and may also include other single-chip microcomputers, logic gates, integrated circuits, and the like with logic processing capability, or a suitable combination thereof. The memory may include a non-volatile memory or the like.
In another embodiment, the determining, in the computer program instructions, a preset real object to be operated for simulating a virtual object in a virtual reality VR scene may specifically include:
shooting a photo including a virtual object to be operated in a simulated VR scene;
and identifying the preset real object from the photo.
Correspondingly, the system further comprises:
a first camera device coupled to the processor for taking a photograph including a virtual object to be manipulated in a simulated VR scene.
In another embodiment, the obtaining of the movement track information of the preset real object in the computer program instruction may specifically include:
shooting a video of the user in the operation process of the preset real object;
identifying the preset real object from the video and determining the moving track information of the preset real object;
accordingly, the system may further include:
and the second camera shooting device is coupled with the processor and is used for shooting a video of the user in the preset real object operation process.
In addition, in the embodiment of the present application, the third image capturing apparatus and the fourth image capturing apparatus may be the same apparatus or different apparatuses.
In another embodiment, the obtaining of the movement track information of the preset real object in the computer program instruction may specifically include:
setting mobile information sensing equipment on the preset real object;
detecting the mobile information of the user in the operation process of the preset real object by utilizing the mobile information sensing equipment;
determining the movement track information of the preset real object by using the movement information;
correspondingly, the system further comprises: and the mobile information sensing equipment is coupled with the processor and used for detecting the mobile information of the user in the operation process of the preset real object.
In another embodiment, the moving, by the computer program instruction, the virtual object to be operated in the VR scene according to the movement track information specifically includes:
determining a virtual object to be operated corresponding to the preset real object from the VR scene;
and controlling the corresponding virtual object to be operated to move according to the movement track information of the preset real object in the VR scene.
The application also provides a virtual reality device embodiment. Specifically, the virtual reality device includes a processor and a memory, where the memory stores computer program instructions executed by the processor, and the computer program instructions may include:
determining a preset real object for simulating a virtual object to be operated in a Virtual Reality (VR) scene, wherein the preset real object comprises a real object of which the matching degree of preset object attribute information and the object attribute information of the virtual object to be operated in the VR scene is greater than or equal to a preset matching degree;
acquiring the moving track information of the preset real object;
and moving the virtual object to be operated in the VR scene according to the movement track information.
Specifically, in the embodiment of the present application, the processor may include a Central Processing Unit (CPU), and may also include other single-chip microcomputers, logic gates, integrated circuits, and the like with logic processing capability, or a suitable combination thereof. The memory may include a non-volatile memory or the like.
In another embodiment, the determining, in the computer program instructions, a preset real object for simulating a virtual object to be operated in a virtual reality VR scene specifically includes:
shooting a photo including a virtual object to be operated in a simulated VR scene;
and identifying the preset real object from the photo.
Correspondingly, the device may further include:
and the third camera equipment is coupled with the processor and is used for shooting a picture comprising a virtual object to be operated in the simulated VR scene.
In another embodiment, the obtaining of the movement track information of the preset real object in the computer program instruction specifically includes:
shooting a video of the user in the operation process of the preset real object;
identifying the preset real object from the video and determining the moving track information of the preset real object;
correspondingly, the device may further include:
and the fourth camera shooting device is coupled to the processor and is used for shooting a video of the user in the preset real object operation process.
In addition, in the embodiment of the present application, the third image capturing apparatus and the fourth image capturing apparatus may be the same apparatus or different apparatuses.
In another embodiment, the obtaining of the movement track information of the preset real object in the computer program instruction specifically includes:
setting mobile information sensing equipment on the preset real object;
detecting the mobile information of the user in the operation process of the preset real object by utilizing the mobile information sensing equipment;
determining the movement track information of the preset real object by using the movement information;
correspondingly, the device may further include: and the mobile information sensing equipment is coupled with the processor and used for detecting the mobile information of the user in the operation process of the preset real object.
Specifically, the movement information sensing device herein may include one or more sensing devices that can record movement trace information of an object.
In another embodiment, the moving, by the computer program instruction, the virtual object to be operated in the VR scene according to the movement track information specifically includes:
determining a virtual object to be operated corresponding to the preset real object from the VR scene;
and controlling the corresponding virtual object to be operated to move according to the movement track information of the preset real object in the VR scene.
As shown in fig. 5, fig. 5 is a schematic structural diagram of an embodiment of a head-display virtual reality device provided in the present application. In the figure, it is assumed that the third camera device and the fourth camera device are different camera devices and are both directly connected to the virtual reality device with the head display, and in a hardware level, the virtual reality device includes a processor and a memory, and may include hardware, an internal bus, a network interface, a memory, and the like required by other services. The processor reads the corresponding computer program from the memory into the memory and then runs the computer program to form the page jump device on the logic level. In addition, it should be noted that the virtual reality device in the present application is not limited to the one shown in fig. 5, and other configurations may also be included in practical applications, for example, the image pickup device and the virtual reality device may communicate with each other, but the embodiments of the present application are not limited to the above configuration.
Another aspect of the present application also provides a computer storage medium having a computer program stored thereon, which when executed by a processor, performs the steps of:
determining a preset real object for simulating a virtual object to be operated in a Virtual Reality (VR) scene, wherein the preset real object comprises a real object of which the matching degree of preset object attribute information and the object attribute information of the virtual object to be operated in the VR scene is greater than or equal to a preset matching degree;
acquiring the moving track information of the preset real object;
and moving the virtual object to be operated in the VR scene according to the movement track information.
Therefore, according to the method, the device and the system for interactive processing of the virtual reality equipment or the embodiment of the virtual reality equipment, the movement track information of the preset real object which can be used for simulating the virtual object to be operated in the virtual reality VR scene is obtained, so that the user can control the virtual object in the VR scene by operating the real object, the operation reality sense of the user can be greatly improved, and the user interactive experience is improved. Compared with the prior art, the technical scheme provided by the application can greatly improve the operation reality of the user and improve the user interaction experience; meanwhile, the problem that when a virtual object is simulated by the VR handle in the prior art, the operation mode caused by the large difference between the virtual object and the VR handle is different, and the large deviation occurs when the user controls the virtual object in a virtual scene through the operation of the VR handle due to the different operation modes is solved.
In the 90 th generation of 20 th century, it is obvious that improvements in Hardware (for example, improvements in Circuit structures such as diodes, transistors and switches) or software (for improvement in method flow) can be distinguished for a technical improvement, however, as technology develops, many of the improvements in method flow today can be regarded as direct improvements in Hardware Circuit structures, designers almost all obtain corresponding Hardware Circuit structures by Programming the improved method flow into Hardware circuits, and therefore, it cannot be said that an improvement in method flow cannot be realized by Hardware entity modules, for example, Programmable logic devices (Programmable logic devices L organic devices, P L D) (for example, Field Programmable Gate Arrays (FPGAs) are integrated circuits whose logic functions are determined by user Programming of devices), and a digital system is "integrated" on a P L D "by self Programming of designers without requiring many kinds of integrated circuits manufactured and manufactured by special chip manufacturers to design and manufacture, and only a Hardware software is written in Hardware programs such as Hardware programs, software programs, such as Hardware programs, software, Hardware programs, software programs, Hardware programs, software, Hardware programs, software, Hardware programs, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software.
A controller may be implemented in any suitable manner, e.g., in the form of, for example, a microprocessor or processor and a computer readable medium storing computer readable program code (e.g., software or firmware) executable by the (micro) processor, logic gates, switches, Application Specific Integrated Circuits (ASICs), programmable logic controllers (PLC's) and embedded microcontrollers, examples of which include, but are not limited to, microcontrollers 625D, Atmel AT91SAM, Microchip PIC18F26K20 and Silicone L abs C8051F320, which may also be implemented as part of the control logic of a memory.
The apparatuses, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or implemented by a product with certain functions. One typical implementation device is a computer. In particular, the computer may be, for example, a personal computer, a laptop computer, a cellular telephone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.
For convenience of description, the above devices are described as being divided into various units by function, and are described separately. Of course, the functionality of the units may be implemented in one or more software and/or hardware when implementing the present application.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (devices), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, apparatus or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The application may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The application may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the apparatus and computer storage medium embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference may be made to some descriptions of the method embodiments for relevant points.
The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (14)
1. An interactive processing method of virtual reality equipment comprises the following steps:
shooting a photo including a virtual object to be operated in a simulated VR scene;
recognizing a preset real object from the photo; the preset real object comprises a real object with the matching degree of the preset object attribute information and the object attribute information of the virtual object to be operated in the VR scene being more than or equal to the preset matching degree; the preset real object is used for simulating one or more virtual objects to be operated in a VR scene so as to avoid simulating the virtual objects which are different from the VR handle in operation mode through a VR handle;
acquiring the moving track information of the preset real object;
and moving the virtual object to be operated in the VR scene according to the movement track information.
2. The method according to claim 1, wherein the acquiring of the movement track information of the preset real object comprises:
shooting a video of the user in the operation process of the preset real object;
and identifying the preset real object from the video, and determining the moving track information of the preset real object.
3. The method according to claim 1, wherein the acquiring of the movement track information of the preset real object comprises:
setting mobile information sensing equipment on the preset real object;
detecting the mobile information of the user in the operation process of the preset real object by utilizing the mobile information sensing equipment;
and determining the movement track information of the preset real object by using the movement information.
4. The method of claim 1, wherein the moving the virtual object to be operated in the VR scene according to the movement trace information comprises:
determining a virtual object to be operated corresponding to the preset real object from the VR scene;
and controlling the corresponding virtual object to be operated to move according to the movement track information of the preset real object in the VR scene.
5. An interaction processing apparatus of a virtual reality device, comprising:
the device comprises a preset real object determining module, a virtual object determining module and a virtual object determining module, wherein the preset real object determining module is used for shooting a photo for simulating a virtual object to be operated in a VR scene and identifying a preset real object from the photo; the preset real object comprises a real object with the matching degree of the preset object attribute information and the object attribute information of the virtual object to be operated in the VR scene being more than or equal to the preset matching degree; the preset real object is used for simulating one or more virtual objects to be operated in a VR scene so as to avoid simulating the virtual objects which are different from the VR handle in operation mode through a VR handle;
the moving track information acquisition module is used for acquiring moving track information of a preset real object;
and the control module is used for moving the virtual object to be operated in the VR scene according to the movement track information.
6. An interactive processing system of virtual reality equipment comprises a processor, a memory and a first camera device, wherein the first camera device is coupled to the processor and used for shooting a photo including a virtual object to be operated in a simulated VR scene; the memory stores computer program instructions executed by the processor that, when executed, implement:
shooting a photo which comprises a virtual object to be operated in a simulated VR scene, and identifying a preset real object from the photo, wherein the preset real object comprises a real object of which the matching degree of preset object attribute information and the object attribute information of the virtual object to be operated in the VR scene is greater than or equal to the preset matching degree; the preset real object is used for simulating one or more virtual objects to be operated in a VR scene so as to avoid simulating the virtual objects which are different from the VR handle in operation mode through a VR handle;
acquiring the moving track information of the preset real object;
and moving the virtual object to be operated in the VR scene according to the movement track information.
7. The system according to claim 6, wherein the acquiring of the movement track information of the preset real object in the computer program instruction specifically includes:
shooting a video of the user in the operation process of the preset real object;
identifying the preset real object from the video and determining the moving track information of the preset real object;
correspondingly, the system further comprises:
and the second camera shooting device is coupled with the processor and is used for shooting a video of the user in the preset real object operation process.
8. The system according to claim 6, wherein the acquiring of the movement track information of the preset real object in the computer program instruction specifically includes:
setting mobile information sensing equipment on the preset real object;
detecting the mobile information of the user in the operation process of the preset real object by utilizing the mobile information sensing equipment;
determining the movement track information of the preset real object by using the movement information;
correspondingly, the system further comprises: and the mobile information sensing equipment is coupled with the processor and used for detecting the mobile information of the user in the operation process of the preset real object.
9. The system of claim 6, wherein the computer program instructions to move the virtual object to be operated in the VR scene according to the movement trace information specifically include:
determining a virtual object to be operated corresponding to the preset real object from the VR scene;
and controlling the corresponding virtual object to be operated to move according to the movement track information of the preset real object in the VR scene.
10. A virtual reality device comprises a processor, a memory and a third camera device, wherein the third camera device is coupled to the processor and used for shooting a photo comprising a virtual object to be operated in a simulated VR scene; the memory stores computer program instructions executed by the processor that, when executed, implement:
shooting a photo which comprises a virtual object to be operated in a simulated VR scene, and identifying a preset real object from the photo, wherein the preset real object comprises a real object of which the matching degree of preset object attribute information and the object attribute information of the virtual object to be operated in the VR scene is greater than or equal to the preset matching degree; the preset real object is used for simulating one or more virtual objects to be operated in a VR scene so as to avoid simulating the virtual objects which are different from the VR handle in operation mode through a VR handle;
acquiring the moving track information of the preset real object;
and moving the virtual object to be operated in the VR scene according to the movement track information.
11. The device according to claim 10, wherein the acquiring, in the computer program instruction, the movement trajectory information of the preset real object specifically includes:
shooting a video of the user in the operation process of the preset real object;
identifying the preset real object from the video and determining the moving track information of the preset real object;
correspondingly, the device further comprises:
and the fourth camera shooting device is coupled to the processor and is used for shooting a video of the user in the preset real object operation process.
12. The device according to claim 10, wherein the acquiring, in the computer program instruction, the movement trajectory information of the preset real object specifically includes:
setting mobile information sensing equipment on the preset real object;
detecting the mobile information of the user in the operation process of the preset real object by utilizing the mobile information sensing equipment;
determining the movement track information of the preset real object by using the movement information;
correspondingly, the device further comprises: and the mobile information sensing equipment is coupled with the processor and used for detecting the mobile information of the user in the operation process of the preset real object.
13. The device of claim 10, wherein the computer program instructions to move the virtual object to be operated in the VR scene according to the movement trace information specifically include:
determining a virtual object to be operated corresponding to the preset real object from the VR scene;
and controlling the corresponding virtual object to be operated to move according to the movement track information of the preset real object in the VR scene.
14. A computer storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of:
shooting a photo including a virtual object to be operated in a simulated VR scene;
recognizing a preset real object from the photo; the preset real object comprises a real object with the matching degree of the preset object attribute information and the object attribute information of the virtual object to be operated in the VR scene being more than or equal to the preset matching degree; the preset real object is used for simulating one or more virtual objects to be operated in a VR scene so as to avoid simulating the virtual objects which are different from the VR handle in operation mode through a VR handle;
acquiring the moving track information of the preset real object;
and moving the virtual object to be operated in the VR scene according to the movement track information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710343042.9A CN107291222B (en) | 2017-05-16 | 2017-05-16 | Interactive processing method, device and system of virtual reality equipment and virtual reality equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710343042.9A CN107291222B (en) | 2017-05-16 | 2017-05-16 | Interactive processing method, device and system of virtual reality equipment and virtual reality equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107291222A CN107291222A (en) | 2017-10-24 |
| CN107291222B true CN107291222B (en) | 2020-08-04 |
Family
ID=60093994
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710343042.9A Active CN107291222B (en) | 2017-05-16 | 2017-05-16 | Interactive processing method, device and system of virtual reality equipment and virtual reality equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107291222B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109710054B (en) * | 2017-10-26 | 2022-04-26 | 北京京东尚科信息技术有限公司 | Virtual object presenting method and device for head-mounted display equipment |
| CN108573531A (en) * | 2018-04-23 | 2018-09-25 | 新华网股份有限公司 | The method that terminal device and virtual reality are shown |
| CN110858097A (en) * | 2018-08-22 | 2020-03-03 | 阿里巴巴集团控股有限公司 | Interaction method and device |
| CN113516744B (en) * | 2020-06-01 | 2022-09-27 | 阿里巴巴集团控股有限公司 | Virtual scene generation method, interface interaction method, commodity display method and equipment |
| CN112650390A (en) * | 2020-12-22 | 2021-04-13 | 科大讯飞股份有限公司 | Input method, related device and input system |
| CN114764327B (en) * | 2022-05-09 | 2023-05-05 | 北京未来时空科技有限公司 | Method and device for manufacturing three-dimensional interactive media and storage medium |
| CN114637412B (en) * | 2022-05-17 | 2022-08-02 | 广东控银实业有限公司 | Rocker control method and system for VR device figure movement |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103995584A (en) * | 2014-04-29 | 2014-08-20 | 深圳超多维光电子有限公司 | Three-dimensional interactive method, display device, handling rod and system |
| CN204990263U (en) * | 2015-08-11 | 2016-01-20 | 王燕军 | Real -time motion is caught, interactive sport equipment interactive terminal |
| CN105279795A (en) * | 2014-07-09 | 2016-01-27 | 先科媒体有限公司 | Augmented reality system based on 3D marker |
| CN106097454A (en) * | 2016-06-06 | 2016-11-09 | 成都天福创造机器人有限公司 | A kind of man-machine interactive system and exchange method |
| CN106648038A (en) * | 2015-10-30 | 2017-05-10 | 北京锤子数码科技有限公司 | Method and apparatus for displaying interactive object in virtual reality |
-
2017
- 2017-05-16 CN CN201710343042.9A patent/CN107291222B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103995584A (en) * | 2014-04-29 | 2014-08-20 | 深圳超多维光电子有限公司 | Three-dimensional interactive method, display device, handling rod and system |
| CN105279795A (en) * | 2014-07-09 | 2016-01-27 | 先科媒体有限公司 | Augmented reality system based on 3D marker |
| CN204990263U (en) * | 2015-08-11 | 2016-01-20 | 王燕军 | Real -time motion is caught, interactive sport equipment interactive terminal |
| CN106648038A (en) * | 2015-10-30 | 2017-05-10 | 北京锤子数码科技有限公司 | Method and apparatus for displaying interactive object in virtual reality |
| CN106097454A (en) * | 2016-06-06 | 2016-11-09 | 成都天福创造机器人有限公司 | A kind of man-machine interactive system and exchange method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107291222A (en) | 2017-10-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107291222B (en) | Interactive processing method, device and system of virtual reality equipment and virtual reality equipment | |
| CN108010112B (en) | Animation processing method, device and storage medium | |
| US9501140B2 (en) | Method and apparatus for developing and playing natural user interface applications | |
| EP3786901A1 (en) | Augmentation modification based on user interaction with augmented reality scene | |
| US20160171739A1 (en) | Augmentation of stop-motion content | |
| CN105892651B (en) | A kind of display methods and electronic equipment of virtual objects | |
| CN109816758B (en) | Two-dimensional character animation generation method and device based on neural network | |
| CN103686418A (en) | Information processing method and electronic device | |
| CN112947969B (en) | Page off-screen rendering method, device, equipment and readable medium | |
| WO2012103372A2 (en) | Method and apparatus for providing context sensitive interactive overlays for video | |
| CN105824422B (en) | A kind of information processing method and electronic equipment | |
| CN113223101B (en) | Image processing method, device and equipment based on privacy protection | |
| CN108096833B (en) | Motion sensing game control method and device based on cascade neural network and computing equipment | |
| CN111667420B (en) | Image processing method and device | |
| CN107368184B (en) | Password input method and device in virtual reality scene | |
| KR20180013892A (en) | Reactive animation for virtual reality | |
| CN103608761A (en) | Input device, input method and recording medium | |
| CN111651058A (en) | Historical scene control display method and device, electronic equipment and storage medium | |
| CN109040838B (en) | Video data processing method and device, video playing method and client | |
| CN113485548A (en) | Model loading method and device of head-mounted display equipment and head-mounted display equipment | |
| CN112987924A (en) | Method, apparatus, device and storage medium for device interaction | |
| KR20130095488A (en) | Apparatus and method for providing three-dimensional model in the smart device | |
| CN110532755B (en) | Computer-implemented risk identification method and device | |
| CN111476291A (en) | Data processing method, device and storage medium | |
| CN109816744B (en) | Neural network-based two-dimensional special effect picture generation method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 1245932 Country of ref document: HK |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20201019 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Patentee after: Innovative advanced technology Co.,Ltd. Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Patentee before: Advanced innovation technology Co.,Ltd. Effective date of registration: 20201019 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Patentee after: Advanced innovation technology Co.,Ltd. Address before: Greater Cayman, British Cayman Islands Patentee before: Alibaba Group Holding Ltd. |