CN114115528B - Virtual object control method, device, computer equipment and storage medium - Google Patents
Virtual object control method, device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN114115528B CN114115528B CN202111288006.XA CN202111288006A CN114115528B CN 114115528 B CN114115528 B CN 114115528B CN 202111288006 A CN202111288006 A CN 202111288006A CN 114115528 B CN114115528 B CN 114115528B
- Authority
- CN
- China
- Prior art keywords
- target
- action
- virtual object
- information
- drawing board
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 238000004590 computer program Methods 0.000 claims description 17
- 238000006073 displacement reaction Methods 0.000 claims description 11
- 238000013507 mapping Methods 0.000 claims description 2
- 238000012216 screening Methods 0.000 claims 1
- 230000006870 function Effects 0.000 abstract description 16
- 238000000605 extraction Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 238000013519 translation Methods 0.000 description 4
- 238000001514 detection method Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000010422 painting Methods 0.000 description 1
- 238000004091 panning Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the application provides a virtual object control method, a virtual object control device, computer equipment and a storage medium, which can acquire an action image, and perform action recognition on the action image to obtain a target action; determining a target virtual object of the electronic drawing board according to the target action; acquiring target operation information aiming at a target virtual object, and identifying the target operation information to obtain information characteristics corresponding to the target operation information; and controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics. According to the method and the device for determining the target action, the target virtual object of the electronic drawing board can be determined based on the target action by identifying the action image, and the control of the target virtual object is achieved through the information characteristics of the target operation information, so that the electronic drawing board is used, the influence of factors of the size of a display screen on the functions of the electronic drawing board is reduced, the cost of the electronic drawing board can be reduced, and the utilization rate of the electronic drawing board is improved.
Description
Technical Field
The application relates to the technical field of intelligent televisions, in particular to a virtual object control method, a device, computer equipment and a storage medium, wherein the storage medium is a computer readable storage medium.
Background
With the development of science and technology, there is an increasing demand from users for terminals, for example, users desire that a display screen of a terminal be capable of having a drawing board function.
At present, a display screen of a part of terminals has a drawing board function, and terminals with the drawing board function can be divided into terminals with large display screens and terminals with small display screens. Terminals with large display screens are costly and are typically purchased relatively rarely by users in the average home, such as touch-type educational machines. The terminal with a small display screen has the defects of small display screen, limited drawing board range, inconvenient operation of a user and low drawing board utilization rate.
Disclosure of Invention
The embodiment of the application provides a virtual object control method, a virtual object control device, computer equipment and a storage medium, wherein the storage medium is a computer readable storage medium, and the storage medium is a computer readable storage medium, so that the cost of an electronic drawing board can be reduced and the utilization rate can be improved.
A virtual object control method, comprising:
acquiring an action image, and performing action recognition on the action image to obtain a target action;
determining a target virtual object of the electronic drawing board according to the target action;
acquiring target operation information aiming at a target virtual object, and identifying the target operation information to obtain information characteristics corresponding to the target operation information;
and controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics.
Accordingly, an embodiment of the present application provides a virtual object control device, including:
the first acquisition unit is used for acquiring an action image, and performing action recognition on the action image to obtain a target action;
the determining unit is used for determining a target virtual object of the electronic drawing board according to the target action;
the second acquisition unit is used for acquiring target operation information aiming at the target virtual object, identifying the target operation information and obtaining information characteristics corresponding to the target operation information;
and the control unit is used for controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics.
In some embodiments, the target operation information includes an action image of the target action; the second acquisition unit is specifically configured to identify a position of an action in the action image, so as to obtain a position coordinate of the action in the action image; and taking the position coordinates as information features corresponding to the target operation information.
In some embodiments, the control unit may be specifically configured to control the target virtual object to perform a displacement operation on the electronic drawing board according to the position coordinates.
In some embodiments, the second obtaining unit may be specifically configured to screen out a reference motion image from the motion images; identifying the action position in the reference action image to obtain the reference position coordinate of the action in the reference action image; and identifying the action position in the action image by taking the reference position coordinate as a reference to obtain the action position coordinate in the action image.
In some embodiments, the control unit may be specifically configured to map according to the position coordinate to obtain a target position coordinate of the target virtual object on the electronic drawing board; and controlling the target virtual object to execute displacement operation on the electronic drawing board according to the target position coordinates.
In some embodiments, the second obtaining unit may specifically be configured to identify an action in the action image with reference to the reference position coordinate, and determine that the action in the action image is a target action; and identifying the position of the target action in the action image to obtain the position coordinates of the action in the action image.
In some embodiments, the target operational information comprises voice information; the second obtaining unit can be specifically used for extracting characteristics of the voice information to obtain voice characteristics of the voice information; if the voice feature is matched with the preset voice feature, determining the voice feature as a target voice feature; and taking the target voice characteristic as the information characteristic.
In some embodiments, the control unit may be specifically configured to obtain, according to the information feature, an operation instruction for the target virtual object; and controlling the target virtual object to execute the operation corresponding to the operation instruction on the electronic drawing board according to the operation instruction.
In some embodiments, the first obtaining unit may be specifically configured to perform feature extraction on the motion in the motion image to obtain a motion feature; calculating the similarity between the action characteristics and the preset action characteristics; and when the similarity reaches a preset threshold, determining the action corresponding to the action characteristic as a target action.
In addition, the embodiment of the application also provides computer equipment, which comprises a memory and a processor; the memory stores a computer program, and the processor is configured to execute the computer program in the memory to perform operations in any of the virtual object control methods provided in the embodiments of the present application.
In addition, the embodiment of the application further provides a storage medium, which is a computer readable storage medium, and the storage medium stores a computer program, and the computer program is suitable for being loaded by a processor to execute any one of the virtual object control methods provided by the embodiment of the application.
According to the method and the device, the action image can be obtained, and the action in the action image is identified, so that the target action is obtained; determining a target virtual object of the electronic drawing board according to the target action; acquiring target operation information aiming at a target virtual object, and identifying the target operation information to obtain information characteristics corresponding to the target operation information; and controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics. According to the method and the device for determining the target action, the target virtual object of the electronic drawing board can be determined based on the target action by identifying the action image, and the control of the target virtual object is achieved through the information characteristics of the target operation information, so that the electronic drawing board is used, the influence of factors of the size of a display screen on the functions of the electronic drawing board is reduced, the cost of the electronic drawing board can be reduced, and the utilization rate of the electronic drawing board is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly introduced below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic view of a scenario of a virtual object control method provided in an embodiment of the present application;
fig. 2 is a schematic flow chart of a virtual object control method according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a virtual object control device according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a computer device according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.
The embodiment of the application provides a virtual object control method, a virtual object control device, computer equipment and a storage medium, wherein the storage medium is a computer readable storage medium. The virtual object control device may be integrated in a computer device, and the computer device may be a server or a device such as a terminal.
The server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, network acceleration services (Content Delivery Network, CDN), basic cloud computing services such as big data and an artificial intelligent platform. The terminal may be, but is not limited to, a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart watch, etc. The terminal and the server may be directly or indirectly connected through wired or wireless communication, which is not limited herein.
For example, referring to fig. 1, taking a virtual object control device integrated in a computer device, where the computer device is an intelligent television, the intelligent television obtains an action image, and performs action recognition on the action image to obtain a target action; determining a target virtual object of the electronic drawing board according to the target action; acquiring target operation information aiming at a target virtual object, and identifying the target operation information to obtain information characteristics corresponding to the target operation information; and controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics.
The action image can be shot by a camera of the computer equipment.
The target virtual object is a virtual object in the electronic drawing board, and the expression form of the target virtual object can be a drawing pen in the electronic drawing board, an eraser in the electronic drawing board and the like.
The target operation information may be image information, voice information, or the like.
The following will describe in detail. The following description of the embodiments is not intended to limit the preferred embodiments.
The present embodiment will be described from the viewpoint of a virtual object control apparatus, which may be specifically integrated in a computer device, and the computer device may be a server or a device such as a terminal; the terminal may include a tablet computer, a notebook computer, a personal computer (PC, personal Computer), a wearable device, a virtual reality device, or other devices that may obtain data.
As shown in fig. 2, a virtual object control method specifically includes the following steps:
s101, acquiring an action image, and performing action recognition on the action image to obtain a target action.
S102, determining a target virtual object of the electronic drawing board according to the target action.
The target virtual object is a virtual object in the electronic drawing board, and the expression form of the target virtual object can be a drawing pen in the electronic drawing board, an eraser in the electronic drawing board and the like.
S103, acquiring target operation information aiming at the target virtual object, and identifying the target operation information to obtain information characteristics corresponding to the target operation information.
The target operation information may be image information, voice information, or the like.
S104, controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics.
According to the method and the device, the action image can be obtained, and the action in the action image is identified, so that the target action is obtained; determining a target virtual object of the electronic drawing board according to the target action; acquiring target operation information aiming at a target virtual object, and identifying the target operation information to obtain information characteristics corresponding to the target operation information; and controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics. According to the method and the device for determining the target action, the target virtual object of the electronic drawing board can be determined based on the target action by identifying the action image, and the control of the target virtual object is achieved through the information characteristics of the target operation information, so that the electronic drawing board is used, the influence of factors of the size of a display screen on the functions of the electronic drawing board is reduced, the cost of the electronic drawing board can be reduced, and the utilization rate of the electronic drawing board is improved.
According to the method described in the above embodiments, examples are described in further detail below.
In this embodiment, explanation will be given by taking the specific integration of the virtual object control apparatus in a computer device, which may be a server or a terminal. As shown in fig. 2, the specific flow of the virtual object control method is as follows:
s101, acquiring an action image, and performing action recognition on the action image to obtain a target action.
The action image can be shot by a camera of the computer equipment. The camera can continuously shoot the action images, and the image collection of the action images can be shot according to the time sequence. The camera may be a 3D camera.
The method for identifying the motion image and obtaining the target motion specifically can be as follows:
for example, the computer device may perform feature extraction on the motion in the motion image to obtain motion features; calculating the similarity between the action characteristics and the preset action characteristics; and when the similarity reaches a preset threshold, determining the action corresponding to the action characteristic as a target action.
The embodiment of the application can perform motion recognition on the motion image through the trained motion recognition model so as to determine the target motion.
Wherein the preset threshold may be 95%, but is not limited to 95%.
The computer device may perform threshold division on the pixel value of the motion image according to the pixel value of the motion image, for example, when the pixel value of the motion image is greater than or equal to T, the pixel value greater than or equal to T is set to 255; when the pixel value of the motion image is smaller than T, the pixel value smaller than T is set to be 0, and T is a preset pixel threshold value, so that the motion image is converted into a binary image, and the binary image can be a black-and-white image.
Then, an image contour detection method may be adopted in the embodiment of the present application, and the image contour detection method may detect the action contour in the binary image by adopting the find contour method, so as to obtain the action contour. Based on the action profile, the embodiment of the application can adopt the trained action recognition model to extract the characteristics of the action corresponding to the action profile, so as to obtain the action characteristics corresponding to the action profile.
In this embodiment of the present application, an electronic drawing board is displayed in a display interface of a computer device, a preset area in the electronic drawing board may display a picture shot by a camera, and the preset area may be an upper right corner of the electronic drawing board. The user can adjust the action according to the picture shot by the camera displayed in the electronic drawing board.
S102, determining a target virtual object of the electronic drawing board according to the target action.
The target virtual object is a virtual object in the electronic drawing board, and the expression form of the target virtual object can be a drawing pen in the electronic drawing board, an eraser in the electronic drawing board, a canvas of the electronic drawing board and the like.
For example, when the target action is an action of two-hand expansion, the target virtual object may be a canvas of an electronic drawing board; when the target action is the action of extending the index finger from the single hand, the target virtual object can be a brush of the electronic drawing board, and the electronic drawing board can display the brush in a preset area; when the target action is a one-hand unfolding action, the target virtual object can be an eraser of the electronic drawing board, and the electronic drawing board can display the eraser in a preset area. For example only, in the implementation process, the corresponding target actions can be set according to the requirements to determine the target virtual actions of the electronic drawing board.
S103, acquiring target operation information aiming at the target virtual object, and identifying the target operation information to obtain information characteristics corresponding to the target operation information.
The target operation information may be image information, voice information, or the like.
When the target operation information is image information, the following is specifically possible:
for example, the target operation information includes an action image of the target action; the computer equipment can identify the action position in the action image to obtain the action position coordinate in the action image; and taking the position coordinates as information features corresponding to the target operation information.
The target operation information includes a motion image of the target motion, that is, the computer device needs to perform motion recognition on the motion image to determine that the motion image is the motion image of the target motion.
Wherein, since the camera may be a 3D camera, the position coordinates obtained by the computer may be 3-dimensional information including the motion, and thus the position coordinates may represent depth position coordinates and plane position coordinates of the motion.
For example, the computer device screens the reference motion image from the motion images; identifying the action position in the reference action image to obtain the reference position coordinate of the action in the reference action image; and identifying the action position in the action image by taking the reference position coordinate as a reference to obtain the action position coordinate in the action image.
The embodiment of the application can determine the reference action image according to the time sequence of the acquired action images, wherein the reference action image can be the action image acquired first by the computer equipment.
The embodiment of the application takes the reference position coordinate as a reference to determine the position coordinate of the action in the action image, and then obtains the time sequence of the action image and the position coordinate of the action in the action image according to the computer equipment, so that the moving path of the action in the action image can be determined. In this embodiment, it is necessary to determine that the motion in the motion image is the target motion first, and then perform position recognition on the motion in the motion image to determine the position coordinates, for example:
the computer equipment can recognize the action in the action image by taking the reference position coordinates as a benchmark, and determine the action in the action image as a target action; and identifying the position of the target action in the action image to obtain the position coordinates of the action in the action image.
(II) when the target operation information is voice information, the following can be specifically adopted:
for example, the computer device may perform feature extraction on the voice information to obtain voice features of the voice information; if the voice feature is matched with the preset voice feature, determining the voice feature as a target voice feature; and taking the target voice characteristic as the information characteristic.
The embodiment of the application can adopt the trained language identification model to identify the language information. According to the embodiment of the application, the speech information is subjected to feature extraction through the trained language recognition model to obtain the speech features of the speech information, wherein the speech features can be text information or speech information.
The voice feature and the preset voice feature are matched, which means that the voice feature is the same as the preset voice feature, or the similarity between the voice feature and the preset voice feature is greater than a certain threshold, and the certain threshold may be 93%.
S104, controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics.
When the target operation information is image information, the following is specifically possible:
for example, the computer device may control the target virtual object to perform a displacement operation on the electronic palette according to the position coordinates.
Specifically, the computer device may map according to the position coordinates to obtain target position coordinates of the target virtual object on the electronic drawing board; and controlling the target virtual object to execute displacement operation on the electronic drawing board according to the target position coordinates.
For example, when the target virtual object is a brush of an electronic drawing board, a user stretches out an index finger with a single hand to perform translation, and a camera of the computer equipment shoots that the single hand stretches out the index finger to perform translation. The computer device may map the position coordinates of the extended index finger of the single hand to target position coordinates of the brush on the electronic drawing board, so as to control the brush to perform a displacement operation on the electronic drawing board according to the target position coordinates, for example, the extended index finger of the user draws a circle, a square, a line segment, etc. in space, and the brush in the electronic drawing board moves along with the finger of the user, drawing a circle, a square, etc. in the electronic drawing board.
According to the embodiment of the application, the reference position coordinate can be used as a reference, and if the motion is determined to be the translation motion based on the position coordinate of the motion in the motion image, the target virtual object can execute the characteristic operation corresponding to the target virtual object; if the motion is determined to be a depth motion based on the position coordinates of the motion in the motion image, the target virtual object may start executing the feature operation corresponding to the target virtual object or stop executing the feature operation corresponding to the target virtual object. The translation motion is to move up and down and left and right relative to the camera. The depth motion is to move forward and backward relative to the camera.
For example, when the target virtual object is a brush, if the motion is determined to be a panning motion based on the position coordinates of the motion in the motion image, the feature operation is a drawing operation, that is, the brush can be drawn while moving. If the motion is determined to be a depth motion based on the position coordinates of the motion in the motion image, the brush may begin a drawing operation, or a drawing operation. It can be understood that when the depth position coordinate of the motion of the user approaches the camera based on the depth position coordinate of the reference position coordinate, that is, when the depth position coordinate of the motion of the user is smaller than the depth position coordinate of the reference position coordinate, the drawing operation is started by the brush; when the action of the user is far away from the camera, namely, when the depth position coordinate of the action of the user is larger than the depth position coordinate of the reference position coordinate, the painting brush stops the drawing operation; of course, the brush may also perform a drawing operation when the depth position coordinates of the user's action are equal to the depth position coordinates of the reference position coordinates.
For example, the target virtual object is a brush, the user's action is a depth action first, the depth action is a depth action far away from the camera, then translate leftwards, and then get close to the camera, at this time, the brush in the electronic drawing board leaves the canvas in the electronic drawing board first, the brush moves leftwards and does not draw lines, and finally the brush returns to the canvas to draw.
For example, when the target virtual object is an eraser, if the motion is determined to be a translational motion based on the position coordinates of the motion in the motion image, the characteristic operation is an erasing operation, that is, the eraser may be erased while moving. If the motion is determined to be a depth motion based on the position coordinates of the motion in the motion image, the eraser may start an erasing operation, or an erasing operation. It can be understood that when the user's motion approaches the camera, that is, when the depth position coordinate of the user's motion is smaller than the depth position coordinate of the reference position coordinate, the eraser starts to erase operation based on the depth position coordinate of the reference position coordinate; when the motion of the user is far away from the camera, namely, when the depth position coordinate of the motion of the user is larger than the depth position coordinate of the reference position coordinate, the eraser stops erasing operation; of course, the eraser may perform the erasing operation when the depth position coordinates of the user's motion are equal to the depth position coordinates of the reference position coordinates.
In the embodiment of the application, the action of stretching the hands of the user is mapped to the computer equipment, and can be zooming of canvas in the electronic drawing board; the action of the user's one-hand zoom is mapped into the computer device, which may be to size a brush in the electronic palette.
(II) when the target operation information is voice information, the following can be specifically adopted:
for example, the computer device may obtain an operation instruction for the target virtual object according to the information feature; and controlling the target virtual object to execute the operation corresponding to the operation instruction on the electronic drawing board according to the operation instruction.
For example, the target virtual object is a brush; the voice information is voice which is spoken by a user and is used for switching a red brush, the computer equipment can determine information characteristics according to the voice information, and then extract an operation instruction aiming at a target virtual object according to the information characteristics, wherein the operation instruction is set in advance, and a unique mapping relation exists between the operation instruction and the information characteristics. As such, the computer device may operate a brush that instructs the color of the brush to change to red. The color of the brush refers to the color of the handwriting that the brush presents on the electronic brush after drawing on the electronic palette.
According to the method and the device, the action image can be obtained, and the action in the action image is identified, so that the target action is obtained; determining a target virtual object of the electronic drawing board according to the target action; acquiring target operation information aiming at a target virtual object, and identifying the target operation information to obtain information characteristics corresponding to the target operation information; and controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics. According to the method and the device for determining the target action, the target virtual object of the electronic drawing board can be determined based on the target action by identifying the action image, and the control of the target virtual object is achieved through the information characteristics of the target operation information, so that the electronic drawing board is used, the influence of factors of the size of a display screen on the functions of the electronic drawing board is reduced, the cost of the electronic drawing board can be reduced, and the utilization rate of the electronic drawing board is improved.
In order to better implement the above method, the embodiment of the application also provides a virtual object control device, where the virtual object control device may be integrated in a computer device, such as a server or a terminal, where the terminal may include a tablet computer, a notebook computer, and/or a personal computer.
For example, as shown in fig. 3, the virtual object control apparatus may include a first acquisition unit 301, a determination unit 302, a second acquisition unit 303, and a control unit 304, as follows:
(1) A first acquisition unit 301;
the first obtaining unit 301 may be configured to obtain an action image, and perform action recognition on the action image to obtain a target action.
The first obtaining unit 301 may specifically be configured to perform feature extraction on an action in the action image to obtain an action feature; calculating the similarity between the action characteristics and the preset action characteristics; and when the similarity reaches a preset threshold, determining the action corresponding to the action characteristic as a target action.
(2) A determination unit 302;
the determining unit 302 may be configured to determine a target virtual object of the electronic drawing board according to the target action.
(3) A second acquisition unit 303;
the second obtaining unit 303 may be configured to obtain target operation information for the target virtual object, and identify the target operation information, so as to obtain information features corresponding to the target operation information.
The target operation information includes an action image of the target action, and the second obtaining unit 303 may specifically be configured to identify a position of the action in the action image, so as to obtain a position coordinate of the action in the action image; and taking the position coordinates as information features corresponding to the target operation information.
The second obtaining unit 303 may specifically be configured to screen out a reference motion image from the motion images; identifying the action position in the reference action image to obtain the reference position coordinate of the action in the reference action image; and identifying the action position in the action image by taking the reference position coordinate as a reference to obtain the action position coordinate in the action image.
The second obtaining unit 303 may specifically be configured to identify an action in the action image with reference to the reference position coordinate, and determine that the action in the action image is a target action; and identifying the position of the target action in the action image to obtain the position coordinates of the action in the action image.
The target operation information includes voice information, and the second obtaining unit 303 may be specifically configured to perform feature extraction on the voice information to obtain voice features of the voice information; if the voice feature is matched with the preset voice feature, determining the voice feature as a target voice feature; and taking the target voice characteristic as the information characteristic.
(4) A control unit 304;
the control unit 304 may be configured to control the target virtual object to perform a corresponding operation on the electronic drawing board according to the information feature.
The control unit 304 may be specifically configured to control the target virtual object to perform a displacement operation on the electronic drawing board according to the position coordinates.
The control unit 304 may be specifically configured to map according to the position coordinate to obtain a target position coordinate of the target virtual object on the electronic drawing board; and controlling the target virtual object to execute displacement operation on the electronic drawing board according to the target position coordinates.
The control unit 304 may be specifically configured to obtain an operation instruction for the target virtual object according to the information feature; and controlling the target virtual object to execute the operation corresponding to the operation instruction on the electronic drawing board according to the operation instruction.
As can be seen from the above, the first obtaining unit 301 in the embodiment of the present application may obtain an action image, and perform action recognition on the action image to obtain a target action; the determining unit 302 may determine a target virtual object of the electronic drawing board according to the target action; the second obtaining unit 303 may obtain target operation information for the target virtual object, and identify the target operation information, so as to obtain information features corresponding to the target operation information; the control unit 304 may control the target virtual object to perform a corresponding operation on the electronic drawing board according to the information characteristic. According to the method and the device for determining the target action, the target virtual object of the electronic drawing board can be determined based on the target action by identifying the action image, and the control of the target virtual object is achieved through the information characteristics of the target operation information, so that the electronic drawing board is used, the influence of factors of the size of a display screen on the functions of the electronic drawing board is reduced, the cost of the electronic drawing board can be reduced, and the utilization rate of the electronic drawing board is improved.
The embodiment of the application further provides a computer device, as shown in fig. 4, which shows a schematic structural diagram of the computer device according to the embodiment of the application, specifically:
the computer device may include one or more processing cores 'processors 401, one or more storage media's memory 402, power supply 403, and input unit 404, among other components. Those skilled in the art will appreciate that the computer device structure shown in FIG. 4 is not limiting of the computer device and may include more or fewer components than shown, or may be combined with certain components, or a different arrangement of components. Wherein:
the processor 401 is a control center of the computer device, connects various parts of the entire computer device using various interfaces and lines, and performs various functions of the computer device and processes data by running or executing software programs and/or modules stored in the memory 402, and calling data stored in the memory 402, thereby performing overall monitoring of the computer device. Optionally, processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, a computer program, etc., and the modem processor mainly processes wireless communication. It will be appreciated that the modem processor described above may not be integrated into the processor 401.
The memory 402 may be used to store software programs and modules, and the processor 401 executes various functional applications and data processing by executing the software programs and modules stored in the memory 402. The memory 402 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, a computer program (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like; the storage data area may store data created according to the use of the computer device, etc. In addition, memory 402 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 with access to the memory 402.
The computer device further comprises a power supply 403 for supplying power to the various components, preferably the power supply 403 may be logically connected to the processor 401 by a power management system, so that functions of charge, discharge, and power consumption management may be performed by the power management system. The power supply 403 may also include one or more of any of a direct current or alternating current power supply, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.
The computer device may also include an input unit 404, which input unit 404 may be used to receive input digital or character information communications and to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.
Although not shown, the computer device may further include a display unit or the like, which is not described herein. In particular, in this embodiment, the processor 401 in the computer device loads executable files corresponding to the processes of one or more computer programs into the memory 402 according to the following instructions, and the processor 401 executes the computer programs stored in the memory 402, so as to implement various functions, as follows:
acquiring an action image, and performing action recognition on the action image to obtain a target action; determining a target virtual object of the electronic drawing board according to the target action; acquiring target operation information aiming at the target virtual object, and identifying the target operation information to obtain information characteristics corresponding to the target operation information; and controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristic.
The specific implementation of each operation above may be referred to the previous embodiments, and will not be described herein.
It will be appreciated by those of ordinary skill in the art that all or part of the steps of the various methods of the above embodiments may be performed by a computer program, or by computer program control related hardware, which may be stored in a storage medium and loaded and executed by a processor.
To this end, the embodiments of the present application provide a storage medium that is a computer readable storage medium, in which a computer program is stored, the computer program being capable of being loaded by a processor to perform any one of the virtual object control methods provided in the embodiments of the present application.
The specific implementation of each operation above may be referred to the previous embodiments, and will not be described herein.
Wherein the storage medium may include: read Only Memory (ROM), random access Memory (RAM, random Access Memory), magnetic or optical disk, and the like.
The steps in any virtual object control method provided in the embodiments of the present application may be executed due to the instructions stored in the storage medium, so that the beneficial effects that any virtual object control method provided in the embodiments of the present application may be achieved, which are detailed in the previous embodiments and are not repeated herein.
Among other things, according to one aspect of the present application, there is provided a computer program product or computer program comprising computer instructions stored in a storage medium. The processor of the computer device reads the computer instructions from the storage medium, and the processor executes the computer instructions, so that the computer device performs the methods provided in the various alternative implementations provided in the above embodiments.
The above description of the present application applies specific examples to illustrate the principles and embodiments of the present application, and the above description of the embodiments is only used to help understand the method and core ideas of the present application; meanwhile, those skilled in the art will have variations in the specific embodiments and application scope in light of the ideas of the present application, and the present description should not be construed as limiting the present application in view of the above.
Claims (11)
1. A virtual object control method, comprising:
acquiring an action image, and performing action recognition on the action image to obtain a target action;
determining a target virtual object of an electronic drawing board according to the target action, wherein the target virtual object is a drawing tool in the electronic drawing board;
acquiring target operation information aiming at the target virtual object, and identifying the target operation information to obtain information characteristics corresponding to the target operation information;
if the information features comprise position coordinates, controlling the target virtual object to execute displacement operation on the electronic drawing board according to the position coordinates;
and if the information features comprise target voice features matched with the preset voice features, controlling the target virtual object to execute operations corresponding to the operation instructions on the electronic drawing board according to the operation instructions corresponding to the target voice features.
2. The virtual object control method according to claim 1, wherein the target operation information includes an action image of the target action; the identifying the target operation information to obtain the information characteristics corresponding to the target operation information comprises the following steps:
identifying the action position in the action image to obtain the action position coordinate in the action image;
and taking the position coordinates as information features corresponding to the target operation information.
3. The method according to claim 2, wherein the identifying the position of the motion in the motion image to obtain the position coordinates of the motion in the motion image includes:
screening a reference action image from the action images;
identifying the action position in the reference action image to obtain the reference position coordinate of the action in the reference action image;
and identifying the action position in the action image by taking the reference position coordinate as a reference to obtain the action position coordinate in the action image.
4. A virtual object control method according to claim 3, wherein said controlling the target virtual object to perform a displacement operation on the electronic palette in accordance with the position coordinates comprises:
mapping according to the position coordinates to obtain target position coordinates of the target virtual object on the electronic drawing board;
and controlling the target virtual object to execute displacement operation on the electronic drawing board according to the target position coordinates.
5. The virtual object control method according to claim 3, wherein the identifying the position of the motion in the motion image based on the reference position coordinates to obtain the position coordinates of the motion in the motion image includes:
identifying actions in the action image by taking the reference position coordinates as references, and determining the actions in the action image as the target actions;
and identifying the position of the target action in the action image to obtain the position coordinates of the action in the action image.
6. The virtual object control method according to claim 1, wherein the target operation information includes voice information; the identifying the target operation information to obtain the information characteristics corresponding to the target operation information comprises the following steps:
extracting the characteristics of the voice information to obtain the voice characteristics of the voice information;
if the voice feature is matched with the preset voice feature, determining the voice feature as a target voice feature;
and taking the target voice characteristic as the information characteristic.
7. The method according to claim 6, wherein the controlling the target virtual object according to the operation instruction corresponding to the target voice feature to execute the operation corresponding to the operation instruction on the electronic drawing board includes:
acquiring an operation instruction aiming at the target virtual object according to the information characteristics;
and controlling the target virtual object to execute the operation corresponding to the operation instruction on the electronic drawing board according to the operation instruction.
8. The method according to claim 1, wherein the performing motion recognition on the motion image to obtain a target motion includes:
extracting characteristics of actions in the action image to obtain action characteristics;
calculating the similarity between the action characteristics and preset action characteristics;
and when the similarity reaches a preset threshold, determining the action corresponding to the action characteristic as the target action.
9. A virtual object control apparatus, comprising:
the first acquisition unit is used for acquiring an action image, and performing action recognition on the action image to obtain a target action;
the determining unit is used for determining a target virtual object of the electronic drawing board according to the target action, wherein the target virtual object is a drawing tool in the electronic drawing board;
the second acquisition unit is used for acquiring target operation information aiming at the target virtual object, identifying the target operation information and obtaining information characteristics corresponding to the target operation information;
the control unit is used for controlling the target virtual object to execute displacement operation on the electronic drawing board according to the position coordinates if the information features comprise the position coordinates;
and if the information features comprise target voice features matched with the preset voice features, controlling the target virtual object to execute operations corresponding to the operation instructions on the electronic drawing board according to the operation instructions corresponding to the target voice features.
10. A computer device comprising a memory and a processor; the memory stores a computer program, and the processor is configured to execute the computer program in the memory to perform the virtual object control method according to any one of claims 1 to 8.
11. A storage medium storing a computer program adapted to be loaded by a processor to perform the virtual object control method of any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111288006.XA CN114115528B (en) | 2021-11-02 | 2021-11-02 | Virtual object control method, device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111288006.XA CN114115528B (en) | 2021-11-02 | 2021-11-02 | Virtual object control method, device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114115528A CN114115528A (en) | 2022-03-01 |
| CN114115528B true CN114115528B (en) | 2024-01-19 |
Family
ID=80380266
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111288006.XA Active CN114115528B (en) | 2021-11-02 | 2021-11-02 | Virtual object control method, device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114115528B (en) |
Citations (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101382836A (en) * | 2008-09-05 | 2009-03-11 | 浙江大学 | Electronic painting creative method based on multi-medium user interaction |
| CN102364426A (en) * | 2011-07-29 | 2012-02-29 | 广东小天才科技有限公司 | Drawing and writing method with self-learning function |
| CN105631916A (en) * | 2014-11-25 | 2016-06-01 | 奥多比公司 | Paintbrush and liquid simulation |
| CN106601217A (en) * | 2016-12-06 | 2017-04-26 | 北京邮电大学 | Interactive-type musical instrument performing method and device |
| CN107273806A (en) * | 2017-05-18 | 2017-10-20 | 上海斐讯数据通信技术有限公司 | A kind of painting and calligraphy exercising method and system based on virtual reality |
| CN108227931A (en) * | 2018-01-23 | 2018-06-29 | 北京市商汤科技开发有限公司 | For controlling the method for virtual portrait, equipment, system, program and storage medium |
| CN108459704A (en) * | 2017-02-21 | 2018-08-28 | 奥多比公司 | Stroke for 3-dimensional digital content operates prediction |
| CN108519816A (en) * | 2018-03-26 | 2018-09-11 | 广东欧珀移动通信有限公司 | Information processing method, device, storage medium and electronic equipment |
| CN108525305A (en) * | 2018-03-26 | 2018-09-14 | 广东欧珀移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
| CN109091869A (en) * | 2018-08-10 | 2018-12-28 | 腾讯科技（深圳）有限公司 | Method of controlling operation, device, computer equipment and the storage medium of virtual objects |
| JP2019020836A (en) * | 2017-07-12 | 2019-02-07 | 株式会社コロプラ | Information processing method, device, and program for causing computer to execute the method |
| CN109407842A (en) * | 2018-10-22 | 2019-03-01 | Oppo广东移动通信有限公司 | Interface operation method, device, electronic equipment and computer readable storage medium |
| CN110456903A (en) * | 2018-11-09 | 2019-11-15 | 网易（杭州）网络有限公司 | Three-dimensional drawing method, device, storage medium, processor and terminal |
| CN110647236A (en) * | 2018-06-27 | 2020-01-03 | 深圳市掌网科技股份有限公司 | Virtual brush and drawing method |
| CN111103983A (en) * | 2019-12-31 | 2020-05-05 | 维沃移动通信有限公司 | AR musical instrument playing method and electronic equipment |
| CN111145315A (en) * | 2019-12-14 | 2020-05-12 | 中国科学院深圳先进技术研究院 | Drawing method, drawing device, toy robot and readable storage medium |
| CN111312012A (en) * | 2020-02-27 | 2020-06-19 | 广东工业大学 | Calligraphy exercise guiding method and device |
| CN111324207A (en) * | 2020-02-28 | 2020-06-23 | 京东方科技集团股份有限公司 | Drawing display method and device and electronic equipment |
| CN111862349A (en) * | 2019-04-26 | 2020-10-30 | 北京字节跳动网络技术有限公司 | Virtual brush implementation method and device and computer readable storage medium |
| CN111880657A (en) * | 2020-07-30 | 2020-11-03 | 北京市商汤科技开发有限公司 | Virtual object control method and device, electronic equipment and storage medium |
| CN112328075A (en) * | 2020-11-03 | 2021-02-05 | 上海镱可思多媒体科技有限公司 | Three-dimensional space drawing method, system, terminal and medium |
| CN112601100A (en) * | 2020-12-11 | 2021-04-02 | 北京字跳网络技术有限公司 | Live broadcast interaction method, device, equipment and medium |
| CN113052078A (en) * | 2021-03-25 | 2021-06-29 | Oppo广东移动通信有限公司 | Aerial writing track recognition method and device, storage medium and electronic equipment |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108355348B (en) * | 2015-10-10 | 2021-01-26 | 腾讯科技(成都)有限公司 | Information processing method, terminal and computer storage medium |
| CN108022301B (en) * | 2017-11-23 | 2020-05-19 | 腾讯科技（上海）有限公司 | Image processing method and device and storage medium |
-
2021
- 2021-11-02 CN CN202111288006.XA patent/CN114115528B/en active Active
Patent Citations (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101382836A (en) * | 2008-09-05 | 2009-03-11 | 浙江大学 | Electronic painting creative method based on multi-medium user interaction |
| CN102364426A (en) * | 2011-07-29 | 2012-02-29 | 广东小天才科技有限公司 | Drawing and writing method with self-learning function |
| CN105631916A (en) * | 2014-11-25 | 2016-06-01 | 奥多比公司 | Paintbrush and liquid simulation |
| CN106601217A (en) * | 2016-12-06 | 2017-04-26 | 北京邮电大学 | Interactive-type musical instrument performing method and device |
| CN108459704A (en) * | 2017-02-21 | 2018-08-28 | 奥多比公司 | Stroke for 3-dimensional digital content operates prediction |
| CN107273806A (en) * | 2017-05-18 | 2017-10-20 | 上海斐讯数据通信技术有限公司 | A kind of painting and calligraphy exercising method and system based on virtual reality |
| JP2019020836A (en) * | 2017-07-12 | 2019-02-07 | 株式会社コロプラ | Information processing method, device, and program for causing computer to execute the method |
| CN108227931A (en) * | 2018-01-23 | 2018-06-29 | 北京市商汤科技开发有限公司 | For controlling the method for virtual portrait, equipment, system, program and storage medium |
| CN108519816A (en) * | 2018-03-26 | 2018-09-11 | 广东欧珀移动通信有限公司 | Information processing method, device, storage medium and electronic equipment |
| CN108525305A (en) * | 2018-03-26 | 2018-09-14 | 广东欧珀移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
| CN110647236A (en) * | 2018-06-27 | 2020-01-03 | 深圳市掌网科技股份有限公司 | Virtual brush and drawing method |
| CN109091869A (en) * | 2018-08-10 | 2018-12-28 | 腾讯科技（深圳）有限公司 | Method of controlling operation, device, computer equipment and the storage medium of virtual objects |
| CN109407842A (en) * | 2018-10-22 | 2019-03-01 | Oppo广东移动通信有限公司 | Interface operation method, device, electronic equipment and computer readable storage medium |
| CN110456903A (en) * | 2018-11-09 | 2019-11-15 | 网易（杭州）网络有限公司 | Three-dimensional drawing method, device, storage medium, processor and terminal |
| CN111862349A (en) * | 2019-04-26 | 2020-10-30 | 北京字节跳动网络技术有限公司 | Virtual brush implementation method and device and computer readable storage medium |
| CN111145315A (en) * | 2019-12-14 | 2020-05-12 | 中国科学院深圳先进技术研究院 | Drawing method, drawing device, toy robot and readable storage medium |
| CN111103983A (en) * | 2019-12-31 | 2020-05-05 | 维沃移动通信有限公司 | AR musical instrument playing method and electronic equipment |
| CN111312012A (en) * | 2020-02-27 | 2020-06-19 | 广东工业大学 | Calligraphy exercise guiding method and device |
| CN111324207A (en) * | 2020-02-28 | 2020-06-23 | 京东方科技集团股份有限公司 | Drawing display method and device and electronic equipment |
| CN111880657A (en) * | 2020-07-30 | 2020-11-03 | 北京市商汤科技开发有限公司 | Virtual object control method and device, electronic equipment and storage medium |
| CN112328075A (en) * | 2020-11-03 | 2021-02-05 | 上海镱可思多媒体科技有限公司 | Three-dimensional space drawing method, system, terminal and medium |
| CN112601100A (en) * | 2020-12-11 | 2021-04-02 | 北京字跳网络技术有限公司 | Live broadcast interaction method, device, equipment and medium |
| CN113052078A (en) * | 2021-03-25 | 2021-06-29 | Oppo广东移动通信有限公司 | Aerial writing track recognition method and device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114115528A (en) | 2022-03-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111612873B (en) | GIF picture generation method and device and electronic equipment | |
| US11372518B2 (en) | Systems and methods for augmented or mixed reality writing | |
| CN104106078A (en) | Ocr cache update | |
| WO2022111458A1 (en) | Image capture method and apparatus, electronic device, and storage medium | |
| CN113050860B (en) | Control identification method and related device | |
| CN112532882B (en) | Image display method and device | |
| CN112492201B (en) | Photographing method and device and electronic equipment | |
| CN112422817B (en) | Image processing method and device | |
| CN110069126B (en) | Virtual object control method and device | |
| US20200311398A1 (en) | Scene controlling method, device and electronic equipment | |
| CN112578967B (en) | Chart information reading method and mobile terminal | |
| CN114115528B (en) | Virtual object control method, device, computer equipment and storage medium | |
| CN112101196A (en) | Data processing method, device, equipment and storage medium | |
| CN108829600B (en) | Method and device for testing algorithm library, storage medium and electronic equipment | |
| CN112686990B (en) | Three-dimensional model display method and device, storage medium and computer equipment | |
| CN111258413A (en) | Control method and device of virtual object | |
| CN113703577B (en) | Drawing method, drawing device, computer equipment and storage medium | |
| CN110941327A (en) | Virtual object display method and device | |
| US20220321798A1 (en) | Shooting method, apparatus, and electronic device | |
| CN111160265B (en) | File conversion method and device, storage medium and electronic equipment | |
| CN112449249A (en) | Video stream processing method and device, electronic equipment and storage medium | |
| CN111103967A (en) | Control method and device of virtual object | |
| CN108965718B (en) | Image generation method and device | |
| CN111385489B (en) | Method, device and equipment for manufacturing short video cover and storage medium | |
| CN109840457B (en) | Augmented reality registration method and augmented reality registration device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |