CN117745982A - Method, device, system, electronic equipment and storage medium for recording video - Google Patents

Abstract

The method, the device, the system, the electronic equipment and the storage medium for recording the video are provided, by acquiring a video image of a user, determining human body key characteristic point information based on the video image, sending the human body key characteristic point information to the augmented reality equipment worn by the user, so that the augmented reality equipment adjusts the action gesture of a virtual role controlled by the user in a virtual reality space based on the human body key characteristic point information, receives target data of the virtual reality space containing the adjusted virtual role and sent by the augmented reality equipment, and displays the video image on a video recording end based on the target data, thereby being capable of displaying the virtual role generated based on the real image and a corresponding virtual scene on the video recording end while capturing the real image of the user by utilizing the video recording end, having higher matching degree with the virtual scene, and being capable of avoiding the problem of unclear in the process of constructing the virtual scene by adopting the real image of the user.

Description

Method, device, system, electronic equipment and storage medium for recording video

Technical Field

The present disclosure relates to the field of computer technologies, and in particular, to a method, an apparatus, a system, an electronic device, and a storage medium for recording video.

Background

Mixed reality recording (MRC) supports the use of deep learning matting models to scratch out the user's real images from the environment and superimpose them into the virtual scene. However, the final composite effect is often limited by the accuracy of the matting and the matching of the real image to the virtual scene.

Disclosure of Invention

This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.

In a first aspect, according to one or more embodiments of the present disclosure, there is provided a method for recording video, for a video recording terminal, including:

acquiring a video image of a user, and determining key feature point information of a human body based on the video image;

transmitting the human body key feature point information to the augmented reality equipment worn by the user, so that the augmented reality equipment adjusts the action gesture of the virtual character controlled by the user in the virtual reality space based on the human body key feature point information;

And receiving target data, which is sent by the augmented reality equipment and contains the virtual reality space of the adjusted virtual character, and displaying a video image on the video recording end based on the target data.

In a second aspect, according to one or more embodiments of the present disclosure, there is provided a method of recording video for an augmented reality device, comprising:

receiving human body key feature point information from a video recording end;

adjusting the action gesture of the virtual character controlled by the user in the virtual reality space based on the human body key feature point information;

and sending target data containing the virtual reality space of the adjusted virtual character to the video recording end so that the video recording end displays video images based on the target data.

In a third aspect, according to one or more embodiments of the present disclosure, there is provided an apparatus for recording video, comprising:

the image acquisition unit is used for acquiring a video image of a user and determining key feature point information of a human body based on the video image;

a feature information sending unit, configured to send the human body key feature point information to an augmented reality device worn by the user, so that the augmented reality device adjusts an action gesture of a virtual character controlled by the user in a virtual reality space based on the human body key feature point information;

And the data receiving unit is used for receiving target data, which is sent by the augmented reality equipment and contains the virtual reality space of the adjusted virtual character, and displaying video images on the video recording end based on the target data.

In a fourth aspect, according to one or more embodiments of the present disclosure, there is provided an apparatus for recording video, comprising:

the characteristic information receiving unit is used for receiving the key characteristic point information of the human body from the video recording end;

a virtual character unit for adjusting the motion gesture of a virtual character controlled by a user in the virtual reality space based on the human body key feature point information;

and the data transmitting unit is used for transmitting target data of the virtual reality space containing the adjusted virtual role to the video recording end so that the video recording end displays video images based on the target data.

In a fifth aspect, according to one or more embodiments of the present disclosure, there is provided a system for recording video, comprising:

a video recording end having an apparatus for recording video according to a third aspect of the present disclosure; or alternatively

An augmented reality device having an apparatus for recording video provided according to a fourth aspect of the present disclosure.

In a sixth aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device comprising: at least one memory and at least one processor; wherein the memory is for storing program code, and the processor is for invoking the program code stored by the memory to cause the electronic device to perform a method of recording video provided in accordance with one or more embodiments of the present disclosure.

In a seventh aspect, according to one or more embodiments of the present disclosure, there is provided a non-transitory computer storage medium storing program code which, when executed by a computer device, causes the computer device to perform a method of recording video provided according to one or more embodiments of the present disclosure.

Drawings

The above and other features, advantages, and aspects of embodiments of the present disclosure will become more apparent by reference to the following detailed description when taken in conjunction with the accompanying drawings. The same or similar reference numbers will be used throughout the drawings to refer to the same or like elements. It should be understood that the figures are schematic and that elements and components are not necessarily drawn to scale.

FIG. 1 is a flowchart of a method for recording video according to an embodiment of the present disclosure;

FIG. 2 is an alternative schematic illustration of a virtual field of view of an augmented reality device provided in accordance with an embodiment of the present disclosure;

FIG. 3 is a schematic diagram of an augmented reality device and video recording end according to an embodiment of the present disclosure;

FIG. 4 is a flowchart of a method of recording video according to another embodiment of the present disclosure;

fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.

Detailed Description

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure have been shown in the accompanying drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustration purposes only and are not intended to limit the scope of the present disclosure.

It should be understood that the steps recited in the embodiments of the present disclosure may be performed in a different order, and/or performed in parallel. Furthermore, embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.

The term "including" and variations thereof as used herein are intended to be open-ended, i.e., including, but not limited to. The term "based on" is based at least in part on. The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments. The term "responsive to" and related terms mean that one signal or event is affected to some extent by another signal or event, but not necessarily completely or directly. If event x occurs "in response to" event y, x may be directly or indirectly in response to y. For example, the occurrence of y may ultimately lead to the occurrence of x, but other intermediate events and/or conditions may exist. In other cases, y may not necessarily result in the occurrence of x, and x may occur even though y has not yet occurred. Furthermore, the term "responsive to" may also mean "at least partially responsive to".

The term "determining" broadly encompasses a wide variety of actions, which may include obtaining, calculating, computing, processing, deriving, investigating, looking up (e.g., looking up in a table, a database or another data structure), ascertaining and the like, and may also include receiving (e.g., receiving information), accessing (e.g., accessing data in a memory) and the like, as well as parsing, selecting, choosing, establishing and the like. Related definitions of other terms will be given in the description below. Related definitions of other terms will be given in the description below.

It should be noted that the terms "first," "second," and the like in this disclosure are merely used to distinguish between different devices, modules, or units and are not used to define an order or interdependence of functions performed by the devices, modules, or units.

It should be noted that references to "one", "a plurality" and "a plurality" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be understood as "one or more" unless the context clearly indicates otherwise.

For the purposes of this disclosure, the phrase "a and/or B" means (a), (B), or (a and B).

The names of messages or information interacted between the various devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

Referring to fig. 1, fig. 1 shows a flowchart of a method 100 for recording video according to an embodiment of the disclosure, where the method 100 includes steps S120-S160.

Step S120: and acquiring a video image of the user, and determining key feature point information of the human body based on the video image.

The method 100 provided in this embodiment may be used for a video recording terminal, including, but not limited to, a mobile phone with a video recording function, a notebook computer, a PAD (tablet computer), a vehicle-mounted terminal, a desktop computer, and the like.

In some embodiments, the human key feature points may be human skeletal feature points. In a specific embodiment, the acquired video image may be input into a pre-obtained human skeleton key point detection model to obtain human skeleton key point information, where the human skeleton key point information is used to represent a position of a human skeleton key point in the image.

In some embodiments, the training steps of the human skeletal keypoint detection model are as follows: acquiring a training sample set, wherein the training sample comprises a sample image and human skeleton key point information marked by aiming at the sample image; and using a machine learning method, taking a sample image included in a training sample in the training sample set as input of an initial model, taking human skeleton key point information corresponding to the input sample image as expected output of the initial model, and training to obtain a human skeleton key point detection model.

The human skeletal keypoint detection model may be trained based on convolutional neural networks (Convolutional Neural Network, CNN) or residual networks (res net), but the disclosure is not limited thereto.

Step S140: and sending the human body key feature point information to the augmented reality equipment worn by the user, so that the augmented reality equipment adjusts the action gesture of the virtual character controlled by the user in the virtual reality space based on the human body key feature point information.

The virtual reality space may be a simulation environment for the real world, a virtual scene of half simulation and half virtual, or a virtual scene of pure virtual. The virtual scene may be any one of a two-dimensional virtual scene, a 2.5-dimensional virtual scene or a three-dimensional virtual scene, and the dimension of the virtual scene is not limited in the embodiment of the present application. For example, a virtual scene may include sky, land, sea, etc., the land may include environmental elements of a desert, city, etc., and a user may control a virtual object to move in the virtual scene.

The augmented reality device may provide or display a virtual reality space for the user. In some embodiments, a user may enter the virtual reality space through an augmented reality device, such as head-mounted VR glasses, and control his or her Avatar (Avatar) in the virtual reality space to socially interact with other user-controlled avatars, entertain, learn, remotely office, and so forth.

In one embodiment, in virtual reality space, a user may implement related interactive operations through a controller, which may be a handle, for example, a user performs related operation control through operation of keys of the handle. Of course, in other embodiments, the target object in the augmented reality device may be controlled using gesture or voice or multi-modal control without using a controller.

The method for recording video provided by one or more embodiments of the present disclosure employs Extended Reality (XR) technology. The augmented reality technology can combine reality with virtual through a computer, and provides a virtual reality space for a user to interact with. In virtual reality space, users can conduct social interactions, entertainment, learning, work, tele-office, authoring UGC (User Generated Content ), etc. through an augmented reality device such as a head mounted display (Head Mount Display, HMD).

The sensor (such as a nine-axis sensor) for detecting the gesture in the augmented reality device is arranged in the augmented reality device, and is used for detecting the gesture change of the augmented reality device in real time, if the user wears the augmented reality device, when the gesture of the head of the user changes, the real-time gesture of the head is transmitted to the processor, so that the gaze point of the sight of the user in the virtual environment is calculated, an image in the gaze range (namely a virtual field of view) of the user in the three-dimensional model of the virtual environment is calculated according to the gaze point, and the image is displayed on the display screen, so that the user looks like watching in the real environment.

Fig. 2 shows an alternative schematic view of a virtual field of view of an augmented reality device according to an embodiment of the disclosure, where a horizontal field of view angle and a vertical field of view angle are used to describe a distribution range of the virtual field of view in a virtual environment, a vertical direction of distribution range is represented by a vertical field of view angle BOC, a horizontal direction of distribution range is represented by a horizontal field of view angle AOB, and an image of the virtual field of view in the virtual environment can always be perceived by a human eye through a lens. The angle of view represents a distribution range of viewing angles that the lens has when sensing an environment. For example, the angle of view of an augmented reality device represents the range of distribution of viewing angles that the human eye has when a virtual environment is perceived through a lens of the augmented reality device; for another example, in a mobile terminal provided with a camera, the field angle of the camera is a distribution range of the viewing angle that the camera has when sensing the real environment to shoot.

An augmented reality device, such as an HMD, incorporates several cameras (e.g., depth cameras, RGB cameras, etc.), the purpose of which is not limited to providing a through view only. The camera images and integrated Inertial Measurement Unit (IMU) provide data that can be processed by computer vision methods to automatically analyze and understand the environment. Also, HMDs are designed to support not only passive computer vision analysis, but also active computer vision analysis. The passive computer vision method analyzes image information captured from the environment. These methods may be monoscopic (images from a single camera) or stereoscopic (images from two cameras). Including but not limited to feature tracking, object recognition, and depth estimation. Active computer vision methods add information to the environment by projecting a pattern that is visible to the camera but not necessarily to the human vision system. Such techniques include time-of-flight (ToF) cameras, laser scanning, or structured light to simplify stereo matching issues. Active computer vision is used to implement scene depth reconstruction.

In this step, the augmented reality device may drive a virtual character in the virtual reality space to do an action simulation based on the real pose of the user. Illustratively, when the user swings the left arm forward, then the avatar swings the left arm forward accordingly; when the user swings the right arm to the right, the virtual character correspondingly swings the right arm to the right.

In some embodiments, the 3D coordinates may be obtained based on the human body key feature point information and converted into a rotation matrix of a corresponding joint, and then the virtual character model is driven to move according to the rotation matrix of the joint.

In some embodiments, a corresponding virtual skeleton model may be built in the three-dimensional scene based on the human body key feature point information, and a preset three-dimensional virtual character model may be loaded according to the virtual skeleton model.

It should be noted that the motion gesture of the virtual character may also be determined based on other related motion capture methods provided in the art, and the disclosure is not limited herein.

Step S160: and receiving target data, which is sent by the augmented reality equipment and contains the virtual reality space of the adjusted virtual character, and displaying a video image on the video recording end based on the target data.

In some embodiments, the augmented reality device may record video images of the virtual reality space on a frame-by-frame basis (the video images of the virtual reality space including the virtual character presented in the adjusted motion pose) and transmit the recorded video image data to the video recording device in real time to cause the video recording device to display the corresponding video image.

It should be noted that, in this embodiment, the virtual reality space frame adjusted by the augmented reality device based on the key feature points of the human body and sent to the video recording end may be identical to or different from the virtual reality space frame simultaneously displayed to the device user by the augmented reality device. For example, the virtual reality space frame transmitted by the augmented reality device to the video recording end for MRC recording may be a third person frame determined based on a shooting angle of view of the video recording end, and the virtual reality space frame presented by the augmented reality device to the device user may be a default first person frame, which is not limited herein.

In one embodiment, a first virtual camera for presenting a first virtual reality space image to a device user and a second virtual camera for rendering a second virtual reality space image for video recording may be provided, respectively. The second virtual camera corresponds to the video recording end, and the rendered second virtual reality space image is sent to the video recording end to display the video image at the video recording end. Wherein a virtual camera is a tool used in a virtual reality environment to simulate the viewing angle, field of view seen by a user, which can be used to present a two-dimensional image of a three-dimensional scene within a virtual world. Virtual camera information includes, but is not limited to, focal length, imaging perspective, spatial location (i.e., virtual location), and the like.

Thus, according to one or more embodiments of the present disclosure, a real user image is acquired through a video recording end, human body key feature point information is generated based on the real user image and is sent to an augmented reality device, so that the augmented reality device adjusts an action gesture of a virtual character controlled by a user in a virtual reality space currently displayed by itself based on the human body key feature point information, and receives target data including the virtual reality space of the adjusted virtual character sent by the augmented reality device to display the video image on the video recording end, so that a virtual character generated based on the real image and a corresponding virtual scene can be displayed on the video recording end while capturing the real image of the user by the video recording end, the matching degree between the virtual character and the virtual scene is higher, and the problem of unclear matting existing in constructing the virtual scene by adopting the real image of the user can be avoided.

In some embodiments, the displaying the video image on the video recording side includes: and displaying the target video image on a video recording interface provided by a preset application program loaded on the video recording end in real time. The preset application program may be an application program dedicated to recording a real image of a user and displaying a virtual scene. In this embodiment, the target video image is displayed in real time on a video recording interface provided by a preset application program, so that the video recording end captures the real image of the user and simultaneously enables the user to preview the virtual scene finally formed on the video recording interface.

In some embodiments, prior to performing step S120, the method 100 further comprises:

step S110: and the video recording end is in communication connection with the augmented reality equipment.

In some embodiments, the video recording side and the augmented reality device may be connected by a communication network, which may include, but is not limited to, a local area network ("LAN"), a wide area network ("WAN"), the internet (e.g., the internet), an end-to-end network (e.g., an ad hoc end-to-end network).

In one embodiment, the video recording end may be connected to a Wi-Fi network consistent with the augmented reality device.

Illustratively, referring to fig. 3, there is a network communication connection between the video recording end 10 and the augmented reality device 20 (head mounted display). The video recording terminal 10 may be configured to capture a real image of a user, generate key feature point information of a human body of the user based on the real image, and transmit the key feature point information to the augmented reality device 20. The augmented reality device 20 is used to present a virtual reality space to a user so that the user can interact with the virtual reality space through a virtual character in the virtual reality space. After the augmented reality device receives the human body key feature point information, the motion gesture of the virtual character controlled by the user in the currently displayed virtual reality space can be adjusted based on the human body key feature point information, and the virtual reality space image containing the adjusted virtual character is returned to the video recording end 10, so that the video recording end 10 can display the corresponding virtual video image 30 on the video recording interface in real time.

In some embodiments, step S120 includes: a whole-body video image of a user is acquired.

In the related art, a head mounted display generally relies on its own configured camera device to capture a real image of a user to drive a virtual character. However, the imaging device built in the head-mounted display is limited by the imaging angle, and usually only the motion posture of the upper body (for example, the upper limb) of the user can be clearly imaged. In this regard, the video recording device with additional configuration can be used to display the virtual scene formed by the video recording device according to the recorded real image, and the whole body image of the user can be captured more easily because the video recording device is independent of the augmented reality device, so that the action gesture of the generated virtual character can reflect the action gesture of the whole body of the user.

In some embodiments, the video recording end includes an intelligent mobile terminal, for example, including but not limited to a mobile phone, a notebook computer, a PAD (tablet computer), and the like. In this embodiment, by capturing the real image of the user and displaying the virtual scene by using the intelligent mobile terminal, the user can conveniently record the real image of the user and perform subsequent processing on the virtual scene currently displayed by the user, for example, sharing the real image to other people (such as live broadcasting).

Referring to fig. 4, fig. 4 shows a flowchart of a method 200 for recording video according to an embodiment of the disclosure, where the method 200 is used for an augmented reality device, and the method 200 includes steps S220-S260.

Step S220: receiving human body key feature point information from a video recording end;

step S230: adjusting the action gesture of the virtual character controlled by the user in the virtual reality space based on the human body key feature point information;

step S260: and sending target data containing the virtual reality space of the adjusted virtual character to the video recording end so that the video recording end displays video images based on the target data.

For the method embodiment executed by the augmented reality device, since the method embodiment basically corresponds to the method embodiment executed by the video recording device, the relevant portions will be referred to in part description of the video recording device, and will not be described herein.

Accordingly, there is provided in accordance with an embodiment of the present disclosure an apparatus for recording video, comprising:

the image acquisition unit is used for acquiring a video image of a user and determining key feature point information of a human body based on the video image;

a feature information sending unit, configured to send the human body key feature point information to an augmented reality device worn by the user, so that the augmented reality device adjusts an action gesture of a virtual character controlled by the user in a virtual reality space based on the human body key feature point information;

And the data receiving unit is used for receiving target data, which is sent by the augmented reality equipment and contains the virtual reality space of the adjusted virtual character, and displaying video images on the video recording end based on the target data.

There is provided, in accordance with an embodiment of the present disclosure, an apparatus for recording video, including:

the characteristic information receiving unit is used for receiving the key characteristic point information of the human body from the video recording end;

a virtual character unit for adjusting the motion gesture of a virtual character controlled by a user in the virtual reality space based on the human body key feature point information;

and the data transmitting unit is used for transmitting target data of the virtual reality space containing the adjusted virtual role to the video recording end so that the video recording end displays video images based on the target data.

In some embodiments, the data receiving unit is configured to display the target video image in real time on a video recording interface provided by a preset application program loaded on the video recording end.

In some embodiments, the apparatus for recording video further comprises:

and the communication unit is used for communicably connecting the video recording end with the augmented reality equipment.

In some embodiments, the human critical feature points comprise human skeletal feature points.

In some embodiments, the image acquisition unit is configured to acquire a whole-body video image of the user.

In some embodiments, the video recording terminal comprises an intelligent mobile terminal. For embodiments of the device, reference is made to the description of method embodiments for the relevant points, since they essentially correspond to the method embodiments. The apparatus embodiments described above are merely illustrative, wherein the modules illustrated as separate modules may or may not be separate. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.

Accordingly, in accordance with one or more embodiments of the present disclosure, there is provided an electronic device comprising:

at least one memory and at least one processor;

wherein the memory is for storing program code, and the processor is for invoking the program code stored by the memory to cause the electronic device to perform a method of recording video provided in accordance with one or more embodiments of the present disclosure.

Accordingly, in accordance with one or more embodiments of the present disclosure, there is provided a non-transitory computer storage medium storing program code executable by a computer device to cause the computer device to perform a method of recording video provided in accordance with one or more embodiments of the present disclosure.

Referring now to fig. 5, a schematic diagram of an electronic device (e.g., a terminal device or server) 800 suitable for use in implementing embodiments of the present disclosure is shown. The terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and the like, and stationary terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 5 is merely an example and should not be construed to limit the functionality and scope of use of the disclosed embodiments.

As shown in fig. 5, the electronic device 800 may include a processing means (e.g., a central processor, a graphics processor, etc.) 801, which may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 802 or a program loaded from a storage means 808 into a Random Access Memory (RAM) 803. In the RAM803, various programs and data required for the operation of the electronic device 800 are also stored. The processing device 801, the ROM 802, and the RAM803 are connected to each other by a bus 804. An input/output (I/O) interface 805 is also connected to the bus 804.

In general, the following devices may be connected to the I/O interface 805: input devices 806 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, and the like; an output device 807 including, for example, a Liquid Crystal Display (LCD), speakers, vibrators, etc.; storage 808 including, for example, magnetic tape, hard disk, etc.; communication means 809. The communication means 809 may allow the electronic device 800 to communicate wirelessly or by wire with other devices to exchange data. While fig. 5 shows an electronic device 800 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may be implemented or provided instead.

In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network via communication device 809, or installed from storage device 808, or installed from ROM 802. The above-described functions defined in the methods of the embodiments of the present disclosure are performed when the computer program is executed by the processing device 801.

It should be noted that the computer readable medium described in the present disclosure may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.

In some implementations, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol ), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the internet (e.g., the internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.

The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device.

The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to perform the methods of the present disclosure described above.

Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units involved in the embodiments of the present disclosure may be implemented by means of software, or may be implemented by means of hardware. Wherein the names of the units do not constitute a limitation of the units themselves in some cases.

The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

According to one or more embodiments of the present disclosure, there is provided a method of recording video, the method being used at a video recording end, the method comprising: acquiring a video image of a user, and determining key feature point information of a human body based on the video image; transmitting the human body key feature point information to the augmented reality equipment worn by the user, so that the augmented reality equipment adjusts the action gesture of the virtual character controlled by the user in the virtual reality space based on the human body key feature point information; and receiving target data, which is sent by the augmented reality equipment and contains the virtual reality space of the adjusted virtual character, and displaying a video image on the video recording end based on the target data.

According to one or more embodiments of the present disclosure, the displaying a video image on the video recording end includes: and displaying the target video image on a video recording interface provided by a preset application program loaded on the video recording end in real time.

In accordance with one or more embodiments of the present disclosure, prior to the capturing the video image of the user, the method further comprises: and the video recording end is in communication connection with the augmented reality equipment.

According to one or more embodiments of the present disclosure, the human critical feature points include human skeletal feature points.

According to one or more embodiments of the present disclosure, the acquiring a video image of a user includes: a whole-body video image of a user is acquired.

According to one or more embodiments of the present disclosure, the video recording terminal includes an intelligent mobile terminal.

According to one or more embodiments of the present disclosure, there is provided a method of recording video for an augmented reality device, the method comprising: receiving human body key feature point information from a video recording end; adjusting the action gesture of the virtual character controlled by the user in the virtual reality space based on the human body key feature point information; and sending target data containing the virtual reality space of the adjusted virtual character to the video recording end so that the video recording end displays video images based on the target data.

The present disclosure [ example a ] provides an apparatus for recording video, comprising: the image acquisition unit is used for acquiring a video image of a user and determining key feature point information of a human body based on the video image; a feature information sending unit, configured to send the human body key feature point information to an augmented reality device worn by the user, so that the augmented reality device adjusts an action gesture of a virtual character controlled by the user in a virtual reality space based on the human body key feature point information; and the data receiving unit is used for receiving target data, which is sent by the augmented reality equipment and contains the virtual reality space of the adjusted virtual character, and displaying video images on the video recording end based on the target data.

The present disclosure [ example B ] provides an apparatus for recording video, comprising: the characteristic information receiving unit is used for receiving the key characteristic point information of the human body from the video recording end; a virtual character unit for adjusting the motion gesture of a virtual character controlled by a user in a virtual reality space based on the human body key feature point information; and the data transmitting unit is used for transmitting target data of the virtual reality space containing the adjusted virtual role to the video recording end so that the video recording end displays video images based on the target data.

According to one or more embodiments of the present disclosure, there is provided a system for recording video, comprising: a video recording end having the video recording apparatus provided by the present disclosure [ example a ]; or an augmented reality device having a video recording apparatus provided by the present disclosure [ example B ].

According to one or more embodiments of the present disclosure, there is provided a non-transitory computer storage medium storing program code which, when executed by a computer device, causes the computer device to perform a method of recording video provided according to one or more embodiments of the present disclosure.

The foregoing description is only of the preferred embodiments of the present disclosure and description of the principles of the technology being employed. It will be appreciated by persons skilled in the art that the scope of the disclosure referred to in this disclosure is not limited to the specific combinations of features described above, but also covers other embodiments which may be formed by any combination of features described above or equivalents thereof without departing from the spirit of the disclosure. Such as those described above, are mutually substituted with the technical features having similar functions disclosed in the present disclosure (but not limited thereto).

Moreover, although operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. In certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are example forms of implementing the claims.

Claims (12)

1. A method for recording video, the method being used at a video recording end, the method comprising:

acquiring a video image of a user, and determining key feature point information of a human body based on the video image;

transmitting the human body key feature point information to the augmented reality equipment worn by the user, so that the augmented reality equipment adjusts the action gesture of the virtual character controlled by the user in the virtual reality space based on the human body key feature point information;

and receiving target data, which is sent by the augmented reality equipment and contains the virtual reality space of the adjusted virtual character, and displaying a video image on the video recording end based on the target data.

2. The method of claim 1, wherein displaying the video image at the video recording end comprises:

And displaying the target video image on a video recording interface provided by a preset application program loaded on the video recording end in real time.

3. The method of claim 1, wherein prior to the capturing the video image of the user, the method further comprises:

and the video recording end is in communication connection with the augmented reality equipment.

4. The method of claim 1, wherein the human critical feature points comprise human skeletal feature points.

5. The method of claim 1, wherein the acquiring the video image of the user comprises:

a whole-body video image of a user is acquired.

6. The method of claim 1, wherein the video recording side comprises an intelligent mobile terminal.

7. A method of recording video for an augmented reality device, the method comprising:

receiving human body key feature point information from a video recording end;

adjusting the action gesture of the virtual character controlled by the user in the virtual reality space based on the human body key feature point information;

and sending target data containing the virtual reality space of the adjusted virtual character to the video recording end so that the video recording end displays video images based on the target data.

8. An apparatus for recording video, comprising:

the image acquisition unit is used for acquiring a video image of a user and determining key feature point information of a human body based on the video image;

a feature information sending unit, configured to send the human body key feature point information to an augmented reality device worn by the user, so that the augmented reality device adjusts an action gesture of a virtual character controlled by the user in a virtual reality space based on the human body key feature point information;

and the data receiving unit is used for receiving target data, which is sent by the augmented reality equipment and contains the virtual reality space of the adjusted virtual character, and displaying video images on the video recording end based on the target data.

9. An apparatus for recording video, comprising:

the characteristic information receiving unit is used for receiving the key characteristic point information of the human body from the video recording end;

a virtual character unit for adjusting the motion gesture of a virtual character controlled by a user in a virtual reality space based on the human body key feature point information;

and the data transmitting unit is used for transmitting target data of the virtual reality space containing the adjusted virtual role to the video recording end so that the video recording end displays video images based on the target data.

10. A system for recording video, comprising:

a video recording end having the apparatus of claim 8; or alternatively

An augmented reality device having the apparatus of claim 9.

11. An electronic device, comprising:

at least one memory and at least one processor;

wherein the memory is for storing program code and the processor is for invoking the program code stored by the memory to cause the electronic device to perform the method of any of claims 1-7.

12. A non-transitory computer storage medium comprising,

the non-transitory computer storage medium stores program code that, when executed by a computer device, causes the computer device to perform the method of any of claims 1 to 7.