CN114115528A - Virtual object control method and device, computer equipment and storage medium - Google Patents
Virtual object control method and device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN114115528A CN114115528A CN202111288006.XA CN202111288006A CN114115528A CN 114115528 A CN114115528 A CN 114115528A CN 202111288006 A CN202111288006 A CN 202111288006A CN 114115528 A CN114115528 A CN 114115528A
- Authority
- CN
- China
- Prior art keywords
- target
- action
- virtual object
- motion
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 238000004590 computer program Methods 0.000 claims description 17
- 238000006073 displacement reaction Methods 0.000 claims description 10
- 238000000605 extraction Methods 0.000 claims description 10
- 238000013507 mapping Methods 0.000 claims description 5
- 238000012216 screening Methods 0.000 claims 1
- 238000010422 painting Methods 0.000 description 18
- 230000006870 function Effects 0.000 description 15
- 238000004891 communication Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 210000005224 forefinger Anatomy 0.000 description 4
- 238000013519 translation Methods 0.000 description 4
- 238000001514 detection method Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 210000003811 finger Anatomy 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000004091 panning Methods 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 210000004247 hand Anatomy 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
Abstract
The embodiment of the application provides a virtual object control method, a virtual object control device, a computer device and a storage medium, which can acquire a motion image and identify the motion in the motion image to obtain a target motion; determining a target virtual object of the electronic drawing board according to the target action; acquiring target operation information aiming at a target virtual object, and identifying the target operation information to obtain information characteristics corresponding to the target operation information; and controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics. According to the embodiment of the application, the target action can be determined by identifying the action image, so that the target virtual object of the electronic drawing board is determined based on the target action, and then the control on the target virtual object is realized through the information characteristics of the target operation information, so that the electronic drawing board is used, namely the influence of the factor of the size of the display screen on the function of the electronic drawing board is reduced, and the cost of the electronic drawing board can be reduced and the utilization rate of the electronic drawing board can be improved.
Description
Technical Field
The application relates to the technical field of intelligent televisions, in particular to a virtual object control method, a device computer device and a storage medium, wherein the storage medium is a computer-readable storage medium.
Background
With the development of scientific technology, the demand of users for terminals is higher and higher, for example, the users expect that the display screen of the terminal can have a drawing board function.
At present, the display screens of some terminals have a drawing board function, and the terminals having the drawing board function can be divided into terminals of large display screens and terminals of small display screens. The cost of terminals with large display screens is high, and users in ordinary households generally purchase less, for example, touch-type educational machines. The terminal of the small display screen is small in display screen, limited in drawing board range and inconvenient for user operation, so that the utilization rate of the drawing board is not high.
Disclosure of Invention
The embodiment of the application provides a virtual object control method, a virtual object control device, computer equipment and a storage medium, wherein the storage medium is a computer-readable storage medium, and the storage medium is a computer-readable storage medium, so that the cost of an electronic drawing board can be reduced, and the utilization rate can be improved.
A virtual object control method, comprising:
acquiring a motion image, and performing motion recognition on the motion image to obtain a target motion;
determining a target virtual object of the electronic drawing board according to the target action;
acquiring target operation information aiming at a target virtual object, and identifying the target operation information to obtain information characteristics corresponding to the target operation information;
and controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics.
Accordingly, an embodiment of the present application provides a virtual object control apparatus, including:
the first acquisition unit is used for acquiring the action image and performing action recognition on the action image to obtain a target action;
the determining unit is used for determining a target virtual object of the electronic drawing board according to the target action;
the second acquisition unit is used for acquiring target operation information aiming at the target virtual object, identifying the target operation information and acquiring information characteristics corresponding to the target operation information;
and the control unit is used for controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics.
In some embodiments, the target operation information includes a motion image of the target motion; the second acquisition unit may be specifically configured to identify a position of the motion in the motion image, and obtain a position coordinate of the motion in the motion image; and taking the position coordinates as information characteristics corresponding to the target operation information.
In some embodiments, the control unit may be specifically configured to control the target virtual object to perform a displacement operation on the electronic drawing board according to the position coordinates.
In some embodiments, the second obtaining unit may be specifically configured to screen out a reference motion image from the moving image; identifying the position of the action in the reference action image to obtain a reference position coordinate of the action in the reference action image; and recognizing the position of the action in the action image by taking the reference position coordinate as a reference to obtain the position coordinate of the action in the action image.
In some embodiments, the control unit may be specifically configured to perform mapping according to the position coordinates to obtain target position coordinates of the target virtual object on the electronic drawing board; and controlling the target virtual object to execute displacement operation on the electronic drawing board according to the target position coordinates.
In some embodiments, the second obtaining unit may be specifically configured to identify the motion in the motion image with reference to the reference position coordinate, and determine that the motion in the motion image is the target motion; and identifying the position of the target action in the action image to obtain the position coordinates of the action in the action image.
In some embodiments, the target operational information includes voice information; the second obtaining unit is specifically configured to perform feature extraction on the voice information to obtain a voice feature of the voice information; if the voice features are matched with the preset voice features, determining the voice features as target voice features; and taking the target voice characteristic as an information characteristic.
In some embodiments, the control unit may be specifically configured to obtain, according to the information characteristic, an operation instruction for the target virtual object; and controlling the target virtual object to execute the operation corresponding to the operation instruction on the electronic drawing board according to the operation instruction.
In some embodiments, the first obtaining unit may be specifically configured to perform feature extraction on the motion in the motion image to obtain a motion feature; calculating the similarity between the action characteristics and preset action characteristics; and when the similarity reaches a preset threshold value, determining the action corresponding to the action characteristic as a target action.
In addition, the embodiment of the application also provides a computer device, which comprises a memory and a processor; the memory stores a computer program, and the processor is used for executing the computer program in the memory to execute the operation in any one of the virtual object control methods provided by the embodiments of the present application.
In addition, a storage medium is provided in an embodiment of the present application, and the storage medium is a computer-readable storage medium, and stores a computer program, where the computer program is suitable for being loaded by a processor to execute any one of the virtual object control methods provided in the embodiment of the present application.
The method and the device can acquire the action image, and perform action recognition on the action image to obtain the target action; determining a target virtual object of the electronic drawing board according to the target action; acquiring target operation information aiming at a target virtual object, and identifying the target operation information to obtain information characteristics corresponding to the target operation information; and controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics. According to the embodiment of the application, the target action can be determined by identifying the action image, so that the target virtual object of the electronic drawing board is determined based on the target action, and then the control on the target virtual object is realized through the information characteristics of the target operation information, so that the electronic drawing board is used, namely the influence of the factor of the size of the display screen on the function of the electronic drawing board is reduced, and the cost of the electronic drawing board can be reduced and the utilization rate of the electronic drawing board can be improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a scene schematic diagram of a virtual object control method provided in an embodiment of the present application;
fig. 2 is a schematic flowchart of a virtual object control method provided in an embodiment of the present application;
fig. 3 is a schematic structural diagram of a virtual object control apparatus according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a computer device provided in an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The embodiment of the application provides a virtual object control method, a virtual object control device, computer equipment and a storage medium, wherein the storage medium is a computer-readable storage medium. The virtual object control apparatus may be integrated into a computer device, and the computer device may be a server or a terminal.
The server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing basic cloud computing services such as cloud service, a cloud database, cloud computing, a cloud function, cloud storage, Network service, cloud communication, middleware service, domain name service, security service, Network acceleration service (CDN), big data and an artificial intelligence platform. The terminal may be, but is not limited to, a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, and the like. The terminal and the server may be directly or indirectly connected through wired or wireless communication, and the application is not limited herein.
For example, referring to fig. 1, taking a virtual object control device integrated in a computer device, where the computer device is an intelligent television as an example, the intelligent television acquires a motion image and performs motion recognition on the motion image to obtain a target motion; determining a target virtual object of the electronic drawing board according to the target action; acquiring target operation information aiming at a target virtual object, and identifying the target operation information to obtain information characteristics corresponding to the target operation information; and controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics.
Wherein, the action image can be shot by a camera of the computer equipment.
The target virtual object is a virtual object in the electronic drawing board, and the representation form of the target virtual object may be a painting brush in the electronic drawing board, an eraser in the electronic drawing board, or the like.
The target operation information may be image information, voice information, and the like.
The following are detailed below. It should be noted that the following description of the embodiments is not intended to limit the preferred order of the embodiments.
This embodiment will be described from the perspective of a virtual object control apparatus, where the virtual object control apparatus may be specifically integrated in a computer device, and the computer device may be a server or a terminal; the terminal may include a tablet Computer, a notebook Computer, a Personal Computer (PC), a wearable device, a virtual reality device, or other intelligent devices capable of acquiring data.
As shown in fig. 2, a virtual object control method specifically includes the following processes:
s101, acquiring the motion image, and performing motion recognition on the motion image to obtain a target motion.
And S102, determining a target virtual object of the electronic drawing board according to the target action.
The target virtual object is a virtual object in the electronic drawing board, and the representation form of the target virtual object may be a painting brush in the electronic drawing board, an eraser in the electronic drawing board, or the like.
S103, acquiring target operation information aiming at the target virtual object, and identifying the target operation information to obtain information characteristics corresponding to the target operation information.
The target operation information may be image information, voice information, and the like.
And S104, controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics.
The method and the device can acquire the action image, and perform action recognition on the action image to obtain the target action; determining a target virtual object of the electronic drawing board according to the target action; acquiring target operation information aiming at a target virtual object, and identifying the target operation information to obtain information characteristics corresponding to the target operation information; and controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics. According to the embodiment of the application, the target action can be determined by identifying the action image, so that the target virtual object of the electronic drawing board is determined based on the target action, and then the control on the target virtual object is realized through the information characteristics of the target operation information, so that the electronic drawing board is used, namely the influence of the factor of the size of the display screen on the function of the electronic drawing board is reduced, and the cost of the electronic drawing board can be reduced and the utilization rate of the electronic drawing board can be improved.
The method described in the above examples is further illustrated in detail below by way of example.
In this embodiment, the virtual object control apparatus is specifically integrated in a computer device, which may be a server or a terminal. As shown in fig. 2, the specific flow of the virtual object control method is as follows:
s101, acquiring the motion image, and performing motion recognition on the motion image to obtain a target motion.
Wherein, the action image can be shot by a camera of the computer equipment. The camera can shoot action images continuously, and can shoot image sets of the action images according to time sequence. The camera may be a 3D camera.
The embodiment of the application identifies the motion of the motion image, and the obtained target motion specifically can be as follows:
for example, the computer device may perform feature extraction on the motion in the motion image to obtain motion features; calculating the similarity between the action characteristics and preset action characteristics; and when the similarity reaches a preset threshold value, determining the action corresponding to the action characteristic as a target action.
The method and the device for determining the target action can perform action recognition on the action image through the trained action recognition model so as to determine the target action.
Wherein the preset threshold may be 95%, but is not limited to 95%.
The computer device may perform threshold division on the pixel value of the motion image according to the pixel value of the motion image, for example, when the pixel value of the motion image is greater than or equal to T, the pixel value greater than or equal to T is set to 255; when the pixel value of the motion image is smaller than T, the pixel value smaller than T is set to be 0, and T is a preset pixel threshold value, so that the motion image is converted into a binary image, and the binary image can be a black-and-white image.
Then, the embodiment of the application may adopt an image contour detection method, and the image contour detection method may adopt a find constraints method to detect the motion contour in the binary image, so as to obtain the motion contour. Based on the action profile, the embodiment of the application can adopt the trained action recognition model to perform feature extraction on the action corresponding to the action profile to obtain the action feature corresponding to the action profile.
In the embodiment of the application, the electronic drawing board is displayed in a display interface of the computer device, a preset area in the electronic drawing board can display a picture shot by the camera, and the preset area can be the upper right corner of the electronic drawing board. The user can adjust the action according to the picture shot by the camera displayed in the electronic drawing board.
And S102, determining a target virtual object of the electronic drawing board according to the target action.
The target virtual object is a virtual object in the electronic drawing board, and the representation form of the target virtual object may be a painting brush in the electronic drawing board, an eraser in the electronic drawing board, a canvas of the electronic drawing board, and the like.
For example, when the target motion is a two-handed unfolding motion, the target virtual object may be a canvas of an electronic drawing board; when the target action is the action of stretching out the index finger by one hand, the target virtual object can be a painting brush of the electronic drawing board, and the electronic drawing board can display the painting brush in a preset area; when the target action is an action of one-hand expansion, the target virtual object may be an eraser of the electronic drawing board, and the electronic drawing board may display the eraser in a preset area. Here, the method is only an example, and in a specific implementation process, a corresponding target action may be set according to a requirement to determine a target virtual action of the electronic drawing board.
S103, acquiring target operation information aiming at the target virtual object, and identifying the target operation information to obtain information characteristics corresponding to the target operation information.
The target operation information may be image information, voice information, and the like.
When the target operation information is image information, the following may be specifically used:
for example, the target operation information includes a motion image of the target motion; the computer equipment can identify the position of the action in the action image to obtain the position coordinate of the action in the action image; and taking the position coordinates as information characteristics corresponding to the target operation information.
The target operation information includes a motion image of the target motion, that is, the computer device needs to perform motion recognition on the motion image to determine that the motion image is the motion image of the target motion.
Since the camera may be a 3D camera, the position coordinates acquired by the computer to the motion may be 3-dimensional information including the motion, and thus, the position coordinates may represent depth position coordinates and plane position coordinates of the motion.
For example, the computer device screens out a reference motion image from the motion image; identifying the position of the action in the reference action image to obtain a reference position coordinate of the action in the reference action image; and recognizing the position of the action in the action image by taking the reference position coordinate as a reference to obtain the position coordinate of the action in the action image.
The reference motion image can be determined according to the time sequence of obtaining the motion images, and the reference motion image can be the motion image obtained by the computer device first.
According to the method and the device, the reference position coordinates are used as a reference to determine the position coordinates of the action in the action image, and then the movement path of the action in the action image can be determined according to the time sequence of the action image acquired by the computer equipment and the position coordinates of the action in the action image. In this embodiment, it is necessary to determine that the motion in the motion image is the target motion, and then perform position recognition on the motion in the motion image to determine the position coordinates, for example:
the computer equipment can identify the action in the action image by taking the reference position coordinates as a reference, and determine that the action in the action image is a target action; and identifying the position of the target action in the action image to obtain the position coordinates of the action in the action image.
When the target operation information is voice information, the following specific steps may be performed:
for example, the computer device may perform feature extraction on the voice information to obtain a voice feature of the voice information; if the voice features are matched with the preset voice features, determining the voice features as target voice features; and taking the target voice characteristic as an information characteristic.
The embodiment of the application can adopt the trained language identification model to identify the voice information. The embodiment of the application performs feature extraction on the voice information through the trained language recognition model to obtain the voice feature of the voice information, wherein the voice feature can be text information or voice information.
The matching of the voice feature and the preset voice feature may be understood as that the voice feature is the same as the preset voice feature, or that the similarity between the voice feature and the preset voice feature is greater than a certain threshold, where the certain threshold may be 93%.
And S104, controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics.
When the target operation information is image information, the following may be specifically used:
for example, the computer device may perform a displacement operation on the electronic drawing board according to the position coordinate control target virtual object.
Specifically, the computer device may perform mapping according to the position coordinates to obtain target position coordinates of the target virtual object on the electronic drawing board; and controlling the target virtual object to execute displacement operation on the electronic drawing board according to the target position coordinates.
For example, when the target virtual object is a brush of an electronic drawing board, a user stretches out a forefinger with one hand to perform translation, and a camera of the computer device shoots the translation with the forefinger stretched out with one hand. The computer equipment can map the position coordinate of the forefinger stretched by the single hand into the target position coordinate of the painting brush on the electronic drawing board, so that the painting brush is controlled to perform displacement operation on the electronic drawing board according to the target position coordinate, for example, the user stretches the forefinger by the single hand to draw a circle, a square, a line segment and the like in the space, the painting brush in the electronic drawing board moves along with the fingers of the user, and the circle, the square and the like are drawn in the electronic drawing board.
According to the embodiment of the application, the reference position coordinates can be set as a standard, and if the determined action is a translation action based on the position coordinates of the action in the action image, the target virtual object can execute the characteristic operation corresponding to the target virtual object; if the motion is determined to be a depth motion based on the position coordinates of the motion in the motion image, the target virtual object may start to execute the feature operation corresponding to the target virtual object or stop executing the feature operation corresponding to the target virtual object. The translation motion refers to the up-down and left-right movement of the user relative to the camera. The depth action refers to the action of the user moving back and forth relative to the camera.
For example, when the target virtual object is a brush, if the determination operation is a panning operation based on the position coordinates of the motion in the motion image, the feature operation is a drawing operation, that is, the brush can draw while moving. If the motion is determined to be a depth motion based on the position coordinates of the motion in the motion image, the brush may start a drawing operation, or a drawing operation. The drawing operation of the paintbrush is started when the depth position coordinate of the action of the user is close to the camera, namely when the depth position coordinate of the action of the user is smaller than the depth position coordinate of the reference position coordinate; when the action of the user is far away from the camera, namely the depth position coordinate of the action of the user is larger than the depth position coordinate of the reference position coordinate, the painting brush stops the drawing operation; of course, the brush may also perform the drawing operation when the depth position coordinates of the user's action are equal to the depth position coordinates of the reference position coordinates.
For example, the target virtual object is a painting brush, the action of the user is a depth action firstly, the depth action is taken as a depth action far away from the camera, the painting brush moves leftwards and is close to the camera, the painting brush in the electronic drawing board firstly leaves a canvas in the electronic drawing board at the moment, the painting brush moves leftwards and cannot draw a line, and finally the painting brush returns to the canvas for drawing.
For example, when the target virtual object is an eraser, if the action is determined to be a panning action based on the position coordinates of the action in the action image, the characteristic operation is an erasing operation, that is, the eraser can be erased while moving. If the motion is determined to be a depth motion based on the position coordinates of the motion in the motion image, the eraser may begin an erasing operation, or an erasing operation. It can be understood that, taking the depth position coordinate of the reference position coordinate as a reference, when the action of the user approaches the camera, namely when the depth position coordinate of the action of the user is smaller than the depth position coordinate of the reference position coordinate, the eraser starts erasing operation; when the action of the user is far away from the camera, namely the depth position coordinate of the action of the user is larger than the depth position coordinate of the reference position coordinate, the eraser stops erasing operation; of course, the eraser may also perform the erasing operation when the depth position coordinates of the user's motion are equal to the depth position coordinates of the reference position coordinates.
In the embodiment of the application, the action of stretching by both hands of a user is mapped into computer equipment, and can be zooming on and zooming off canvas in an electronic drawing board; the action of zooming with one hand of the user is mapped into the computer equipment, and the action can be to set the size of a brush in the electronic drawing board.
When the target operation information is voice information, the following specific steps may be performed:
for example, the computer device may obtain an operation instruction for the target virtual object according to the information characteristics; and controlling the target virtual object to execute the operation corresponding to the operation instruction on the electronic drawing board according to the operation instruction.
For example, the target virtual object is a brush; the voice information is the voice 'switching red brush' spoken by the user, the computer device can determine the information characteristics according to the voice information, and then extract the operation instruction for the target virtual object according to the information characteristics, wherein the operation instruction is set in advance, and the operation instruction and the information characteristics have a unique mapping relation. As such, the computer device may operate a brush that instructs the color of the brush to change to red. The color of the painting brush refers to the color of handwriting which is presented on the electronic painting brush after the painting brush is drawn on the electronic painting board.
The method and the device can acquire the action image, and perform action recognition on the action image to obtain the target action; determining a target virtual object of the electronic drawing board according to the target action; acquiring target operation information aiming at a target virtual object, and identifying the target operation information to obtain information characteristics corresponding to the target operation information; and controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics. According to the embodiment of the application, the target action can be determined by identifying the action image, so that the target virtual object of the electronic drawing board is determined based on the target action, and then the control on the target virtual object is realized through the information characteristics of the target operation information, so that the electronic drawing board is used, namely the influence of the factor of the size of the display screen on the function of the electronic drawing board is reduced, and the cost of the electronic drawing board can be reduced and the utilization rate of the electronic drawing board can be improved.
In order to better implement the above method, the present application further provides a virtual object control apparatus, which may be integrated in a computer device, such as a server or a terminal, and the terminal may include a tablet computer, a notebook computer, and/or a personal computer.
For example, as shown in fig. 3, the virtual object control apparatus may include a first acquisition unit 301, a determination unit 302, a second acquisition unit 303, and a control unit 304 as follows:
(1) a first acquisition unit 301;
the first acquiring unit 301 may be configured to acquire a motion image, and perform motion recognition on the motion image to obtain a target motion.
The first obtaining unit 301 may be specifically configured to perform feature extraction on the motion in the motion image to obtain a motion feature; calculating the similarity between the action characteristics and preset action characteristics; and when the similarity reaches a preset threshold value, determining the action corresponding to the action characteristic as a target action.
(2) A determination unit 302;
the determining unit 302 may be configured to determine a target virtual object of the electronic drawing board according to the target motion.
(3) A second acquisition unit 303;
the second obtaining unit 303 may be configured to obtain target operation information for the target virtual object, and identify the target operation information to obtain an information feature corresponding to the target operation information.
The target operation information includes a motion image of the target motion, and the second obtaining unit 303 may be specifically configured to identify a position of the motion in the motion image, and obtain a position coordinate of the motion in the motion image; and taking the position coordinates as information characteristics corresponding to the target operation information.
The second obtaining unit 303 may be specifically configured to screen a reference motion image from the moving image; identifying the position of the action in the reference action image to obtain a reference position coordinate of the action in the reference action image; and recognizing the position of the action in the action image by taking the reference position coordinate as a reference to obtain the position coordinate of the action in the action image.
The second obtaining unit 303 may be specifically configured to recognize the motion in the motion image by using the reference position coordinate as a reference, and determine that the motion in the motion image is the target motion; and identifying the position of the target action in the action image to obtain the position coordinates of the action in the action image.
The target operation information includes voice information, and the second obtaining unit 303 may be specifically configured to perform feature extraction on the voice information to obtain a voice feature of the voice information; if the voice features are matched with the preset voice features, determining the voice features as target voice features; and taking the target voice characteristic as an information characteristic.
(4) A control unit 304;
and the control unit 304 may be configured to control the target virtual object to perform a corresponding operation on the electronic drawing board according to the information characteristic.
The control unit 304 may be specifically configured to control the target virtual object to perform a displacement operation on the electronic drawing board according to the position coordinates.
The control unit 304 may be specifically configured to perform mapping according to the position coordinate to obtain a target position coordinate of the target virtual object on the electronic drawing board; and controlling the target virtual object to execute displacement operation on the electronic drawing board according to the target position coordinates.
The control unit 304 may be specifically configured to obtain an operation instruction for the target virtual object according to the information characteristic; and controlling the target virtual object to execute the operation corresponding to the operation instruction on the electronic drawing board according to the operation instruction.
As can be seen from the above, the first obtaining unit 301 in the embodiment of the present application may obtain the motion image, and perform motion recognition on the motion image to obtain the target motion; the determining unit 302 may determine a target virtual object of the electronic drawing board according to the target action; the second obtaining unit 303 may obtain target operation information for the target virtual object, and identify the target operation information to obtain an information feature corresponding to the target operation information; the control unit 304 may control the target virtual object to perform a corresponding operation on the electronic drawing board according to the information characteristic. According to the embodiment of the application, the target action can be determined by identifying the action image, so that the target virtual object of the electronic drawing board is determined based on the target action, and then the control on the target virtual object is realized through the information characteristics of the target operation information, so that the electronic drawing board is used, namely the influence of the factor of the size of the display screen on the function of the electronic drawing board is reduced, and the cost of the electronic drawing board can be reduced and the utilization rate of the electronic drawing board can be improved.
The embodiment of the present application further provides a computer device, as shown in fig. 4, which shows a schematic structural diagram of the computer device according to the embodiment of the present application, specifically:
the computer device may include components such as a processor 401 of one or more processing cores, memory 402 of one or more storage media, a power supply 403, and an input unit 404. Those skilled in the art will appreciate that the computer device configuration illustrated in FIG. 4 does not constitute a limitation of computer devices, and may include more or fewer components than those illustrated, or some components may be combined, or a different arrangement of components. Wherein:
the processor 401 is a control center of the computer device, connects various parts of the entire computer device using various interfaces and lines, and performs various functions of the computer device and processes data by running or executing software programs and/or modules stored in the memory 402 and calling data stored in the memory 402, thereby monitoring the computer device as a whole. Optionally, processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor, which mainly handles operating systems, user interfaces, computer programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 401.
The memory 402 may be used to store software programs and modules, and the processor 401 executes various functional applications and data processing by operating the software programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, a computer program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data created according to use of the computer device, and the like. Further, the memory 402 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 access to the memory 402.
The computer device further comprises a power supply 403 for supplying power to the various components, and preferably, the power supply 403 is logically connected to the processor 401 via a power management system, so that functions of managing charging, discharging, and power consumption are implemented via the power management system. The power supply 403 may also include any component of one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.
The computer device may also include an input unit 404, where the input unit 404 may be used to receive input numeric or character information communications, and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.
Although not shown, the computer device may further include a display unit and the like, which are not described in detail herein. Specifically, in this embodiment, the processor 401 in the computer device loads the executable file corresponding to the process of one or more computer programs into the memory 402 according to the following instructions, and the processor 401 runs the computer program stored in the memory 402, so as to implement various functions as follows:
acquiring a motion image, and performing motion recognition on the motion image to obtain a target motion; determining a target virtual object of the electronic drawing board according to the target action; acquiring target operation information aiming at the target virtual object, and identifying the target operation information to obtain information characteristics corresponding to the target operation information; and controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics.
The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.
It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by a computer program, which may be stored in a storage medium and loaded and executed by a processor, or by related hardware controlled by the computer program.
To this end, the present application provides a storage medium, which is a computer-readable storage medium, in which a computer program is stored, where the computer program can be loaded by a processor to execute any one of the virtual object control methods provided in the present application.
The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.
Wherein the storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.
Since the instructions stored in the storage medium may execute the steps in any virtual object control method provided in the embodiments of the present application, beneficial effects that can be achieved by any virtual object control method provided in the embodiments of the present application may be achieved, which are detailed in the foregoing embodiments and will not be described herein again.
According to an aspect of the application, there is provided, among other things, a computer program product or computer program comprising computer instructions stored in a storage medium. The processor of the computer device reads the computer instructions from the storage medium, and the processor executes the computer instructions to cause the computer device to perform the method provided in the various alternative implementations provided by the embodiments described above.
The foregoing provides a virtual object control method and a related apparatus according to an embodiment of the present application, where the related apparatus includes a virtual object control apparatus, a computer device, and a storage medium, and the storage medium is a computer-readable storage medium, and a detailed description is given herein by applying a specific example to explain the principle and the implementation manner of the present application, and the description of the foregoing embodiment is only used to help understand the method and the core idea of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Claims (11)
1. A virtual object control method, comprising:
acquiring a motion image, and performing motion recognition on the motion image to obtain a target motion;
determining a target virtual object of the electronic drawing board according to the target action;
acquiring target operation information aiming at the target virtual object, and identifying the target operation information to obtain information characteristics corresponding to the target operation information;
and controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics.
2. The virtual object control method according to claim 1, wherein the target operation information includes a motion image of the target motion; the identifying the target operation information to obtain the information characteristics corresponding to the target operation information includes:
identifying the position of the action in the action image to obtain the position coordinate of the action in the action image;
taking the position coordinates as information characteristics corresponding to the target operation information;
the controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics includes: and controlling the target virtual object to execute displacement operation on the electronic drawing board according to the position coordinate.
3. The virtual object control method according to claim 2, wherein the recognizing the position of the motion in the motion image to obtain the position coordinates of the motion in the motion image includes:
screening out a reference motion image from the motion images;
identifying the position of the action in the reference action image to obtain a reference position coordinate of the action in the reference action image;
and identifying the position of the action in the action image by taking the reference position coordinate as a reference to obtain the position coordinate of the action in the action image.
4. The virtual object control method according to claim 3, wherein the controlling the target virtual object to perform a displacement operation on the electronic drawing board according to the position coordinate comprises:
mapping according to the position coordinates to obtain target position coordinates of the target virtual object on the electronic drawing board;
and controlling the target virtual object to execute displacement operation on the electronic drawing board according to the target position coordinate.
5. The virtual object control method according to claim 3, wherein the recognizing a position of the motion in the motion image based on the reference position coordinates to obtain position coordinates of the motion in the motion image includes:
identifying the action in the action image by taking the reference position coordinates as a reference, and determining the action in the action image as the target action;
and identifying the position of the target action in the action image to obtain the position coordinate of the action in the action image.
6. The virtual object control method according to claim 1, wherein the target operation information includes voice information; the identifying the target operation information to obtain the information characteristics corresponding to the target operation information includes:
performing feature extraction on the voice information to obtain voice features of the voice information;
if the voice features are matched with preset voice features, determining the voice features as target voice features;
and taking the target voice characteristic as the information characteristic.
7. The virtual object control method according to claim 6, wherein the controlling the target virtual object to perform a corresponding operation on the electronic palette according to the information feature includes:
acquiring an operation instruction aiming at the target virtual object according to the information characteristics;
and controlling the target virtual object to execute the operation corresponding to the operation instruction on the electronic drawing board according to the operation instruction.
8. The virtual object control method according to claim 1, wherein the performing motion recognition on the motion image to obtain a target motion includes:
performing feature extraction on the motion in the motion image to obtain motion features;
calculating the similarity between the action characteristics and preset action characteristics;
and when the similarity reaches a preset threshold value, determining that the action corresponding to the action characteristic is the target action.
9. A virtual object control apparatus, comprising:
the first acquisition unit is used for acquiring a motion image and performing motion recognition on the motion image to obtain a target motion;
the determining unit is used for determining a target virtual object of the electronic drawing board according to the target action;
a second obtaining unit, configured to obtain target operation information for the target virtual object, and identify the target operation information to obtain an information feature corresponding to the target operation information;
and the control unit is used for controlling the target virtual object to execute corresponding operation on the electronic drawing board according to the information characteristics.
10. A computer device comprising a memory and a processor; the memory stores a computer program, and the processor is configured to execute the computer program in the memory to perform the virtual object control method according to any one of claims 1 to 8.
11. A storage medium storing a computer program adapted to be loaded by a processor to perform the virtual object control method of any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111288006.XA CN114115528B (en) | 2021-11-02 | 2021-11-02 | Virtual object control method, device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111288006.XA CN114115528B (en) | 2021-11-02 | 2021-11-02 | Virtual object control method, device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114115528A true CN114115528A (en) | 2022-03-01 |
| CN114115528B CN114115528B (en) | 2024-01-19 |
Family
ID=80380266
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111288006.XA Active CN114115528B (en) | 2021-11-02 | 2021-11-02 | Virtual object control method, device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114115528B (en) |
Citations (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101382836A (en) * | 2008-09-05 | 2009-03-11 | 浙江大学 | Electronic painting creative method based on multi-medium user interaction |
| CN102364426A (en) * | 2011-07-29 | 2012-02-29 | 广东小天才科技有限公司 | Painting and writing method with self-learning function |
| CN105631916A (en) * | 2014-11-25 | 2016-06-01 | 奥多比公司 | Paintbrush and liquid simulation |
| CN106601217A (en) * | 2016-12-06 | 2017-04-26 | 北京邮电大学 | Interactive-type musical instrument performing method and device |
| CN107273806A (en) * | 2017-05-18 | 2017-10-20 | 上海斐讯数据通信技术有限公司 | A kind of painting and calligraphy exercising method and system based on virtual reality |
| US20180024660A1 (en) * | 2015-10-10 | 2018-01-25 | Tencent Technology (Shenzhen) Company Limited | Information processing method, terminal, and computer storage medium |
| CN108227931A (en) * | 2018-01-23 | 2018-06-29 | 北京市商汤科技开发有限公司 | For controlling the method for virtual portrait, equipment, system, program and storage medium |
| CN108459704A (en) * | 2017-02-21 | 2018-08-28 | 奥多比公司 | Stroke for 3-dimensional digital content operates prediction |
| CN108519816A (en) * | 2018-03-26 | 2018-09-11 | 广东欧珀移动通信有限公司 | Information processing method, device, storage medium and electronic equipment |
| CN108525305A (en) * | 2018-03-26 | 2018-09-14 | 广东欧珀移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
| CN109091869A (en) * | 2018-08-10 | 2018-12-28 | 腾讯科技（深圳）有限公司 | Method of controlling operation, device, computer equipment and the storage medium of virtual objects |
| JP2019020836A (en) * | 2017-07-12 | 2019-02-07 | 株式会社コロプラ | Information processing method, device, and program for causing computer to execute the method |
| CN109407842A (en) * | 2018-10-22 | 2019-03-01 | Oppo广东移动通信有限公司 | Interface operation method, device, electronic equipment and computer readable storage medium |
| CN110456903A (en) * | 2018-11-09 | 2019-11-15 | 网易（杭州）网络有限公司 | Three-dimensional drawing method, device, storage medium, processor and terminal |
| CN110647236A (en) * | 2018-06-27 | 2020-01-03 | 深圳市掌网科技股份有限公司 | Virtual brush and drawing method |
| US20200051339A1 (en) * | 2017-11-23 | 2020-02-13 | Tencent Technology (Shenzhen) Company Ltd | Image processing method, electronic apparatus, and storage medium |
| CN111103983A (en) * | 2019-12-31 | 2020-05-05 | 维沃移动通信有限公司 | AR musical instrument playing method and electronic equipment |
| CN111145315A (en) * | 2019-12-14 | 2020-05-12 | 中国科学院深圳先进技术研究院 | Drawing method, drawing device, toy robot and readable storage medium |
| CN111312012A (en) * | 2020-02-27 | 2020-06-19 | 广东工业大学 | Calligraphy exercise guiding method and device |
| CN111324207A (en) * | 2020-02-28 | 2020-06-23 | 京东方科技集团股份有限公司 | Drawing display method and device and electronic equipment |
| CN111862349A (en) * | 2019-04-26 | 2020-10-30 | 北京字节跳动网络技术有限公司 | Virtual brush implementation method and device and computer readable storage medium |
| CN111880657A (en) * | 2020-07-30 | 2020-11-03 | 北京市商汤科技开发有限公司 | Virtual object control method and device, electronic equipment and storage medium |
| CN112328075A (en) * | 2020-11-03 | 2021-02-05 | 上海镱可思多媒体科技有限公司 | Three-dimensional space drawing method, system, terminal and medium |
| CN112601100A (en) * | 2020-12-11 | 2021-04-02 | 北京字跳网络技术有限公司 | Live broadcast interaction method, device, equipment and medium |
| CN113052078A (en) * | 2021-03-25 | 2021-06-29 | Oppo广东移动通信有限公司 | Aerial writing track recognition method and device, storage medium and electronic equipment |
-
2021
- 2021-11-02 CN CN202111288006.XA patent/CN114115528B/en active Active
Patent Citations (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101382836A (en) * | 2008-09-05 | 2009-03-11 | 浙江大学 | Electronic painting creative method based on multi-medium user interaction |
| CN102364426A (en) * | 2011-07-29 | 2012-02-29 | 广东小天才科技有限公司 | Painting and writing method with self-learning function |
| CN105631916A (en) * | 2014-11-25 | 2016-06-01 | 奥多比公司 | Paintbrush and liquid simulation |
| US20180024660A1 (en) * | 2015-10-10 | 2018-01-25 | Tencent Technology (Shenzhen) Company Limited | Information processing method, terminal, and computer storage medium |
| CN106601217A (en) * | 2016-12-06 | 2017-04-26 | 北京邮电大学 | Interactive-type musical instrument performing method and device |
| CN108459704A (en) * | 2017-02-21 | 2018-08-28 | 奥多比公司 | Stroke for 3-dimensional digital content operates prediction |
| CN107273806A (en) * | 2017-05-18 | 2017-10-20 | 上海斐讯数据通信技术有限公司 | A kind of painting and calligraphy exercising method and system based on virtual reality |
| JP2019020836A (en) * | 2017-07-12 | 2019-02-07 | 株式会社コロプラ | Information processing method, device, and program for causing computer to execute the method |
| US20200051339A1 (en) * | 2017-11-23 | 2020-02-13 | Tencent Technology (Shenzhen) Company Ltd | Image processing method, electronic apparatus, and storage medium |
| CN108227931A (en) * | 2018-01-23 | 2018-06-29 | 北京市商汤科技开发有限公司 | For controlling the method for virtual portrait, equipment, system, program and storage medium |
| CN108525305A (en) * | 2018-03-26 | 2018-09-14 | 广东欧珀移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
| CN108519816A (en) * | 2018-03-26 | 2018-09-11 | 广东欧珀移动通信有限公司 | Information processing method, device, storage medium and electronic equipment |
| CN110647236A (en) * | 2018-06-27 | 2020-01-03 | 深圳市掌网科技股份有限公司 | Virtual brush and drawing method |
| CN109091869A (en) * | 2018-08-10 | 2018-12-28 | 腾讯科技（深圳）有限公司 | Method of controlling operation, device, computer equipment and the storage medium of virtual objects |
| CN109407842A (en) * | 2018-10-22 | 2019-03-01 | Oppo广东移动通信有限公司 | Interface operation method, device, electronic equipment and computer readable storage medium |
| CN110456903A (en) * | 2018-11-09 | 2019-11-15 | 网易（杭州）网络有限公司 | Three-dimensional drawing method, device, storage medium, processor and terminal |
| CN111862349A (en) * | 2019-04-26 | 2020-10-30 | 北京字节跳动网络技术有限公司 | Virtual brush implementation method and device and computer readable storage medium |
| CN111145315A (en) * | 2019-12-14 | 2020-05-12 | 中国科学院深圳先进技术研究院 | Drawing method, drawing device, toy robot and readable storage medium |
| CN111103983A (en) * | 2019-12-31 | 2020-05-05 | 维沃移动通信有限公司 | AR musical instrument playing method and electronic equipment |
| CN111312012A (en) * | 2020-02-27 | 2020-06-19 | 广东工业大学 | Calligraphy exercise guiding method and device |
| CN111324207A (en) * | 2020-02-28 | 2020-06-23 | 京东方科技集团股份有限公司 | Drawing display method and device and electronic equipment |
| CN111880657A (en) * | 2020-07-30 | 2020-11-03 | 北京市商汤科技开发有限公司 | Virtual object control method and device, electronic equipment and storage medium |
| CN112328075A (en) * | 2020-11-03 | 2021-02-05 | 上海镱可思多媒体科技有限公司 | Three-dimensional space drawing method, system, terminal and medium |
| CN112601100A (en) * | 2020-12-11 | 2021-04-02 | 北京字跳网络技术有限公司 | Live broadcast interaction method, device, equipment and medium |
| CN113052078A (en) * | 2021-03-25 | 2021-06-29 | Oppo广东移动通信有限公司 | Aerial writing track recognition method and device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114115528B (en) | 2024-01-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111556278B (en) | Video processing method, video display device and storage medium | |
| CN113050860B (en) | Control identification method and related device | |
| CN112422817B (en) | Image processing method and device | |
| CA3185810A1 (en) | Systems and methods for augmented or mixed reality writing | |
| CN111199169A (en) | Image processing method and device | |
| WO2022111458A1 (en) | Image capture method and apparatus, electronic device, and storage medium | |
| CN110069125B (en) | Virtual object control method and device | |
| CN108537149B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| CN112149599B (en) | Expression tracking method and device, storage medium and electronic equipment | |
| US11755119B2 (en) | Scene controlling method, device and electronic equipment | |
| CN111258413A (en) | Control method and device of virtual object | |
| CN108052506B (en) | Natural language processing method, device, storage medium and electronic equipment | |
| CN114115528B (en) | Virtual object control method, device, computer equipment and storage medium | |
| CN110069126B (en) | Virtual object control method and device | |
| CN110941327A (en) | Virtual object display method and device | |
| CN111507139A (en) | Image effect generation method and device and electronic equipment | |
| CN112686990A (en) | Three-dimensional model display method and device, storage medium and computer equipment | |
| CN114202799A (en) | Method and device for determining change speed of controlled object, electronic equipment and storage medium | |
| CN114708443A (en) | Screenshot processing method and device, electronic equipment and computer readable medium | |
| US20220321798A1 (en) | Shooting method, apparatus, and electronic device | |
| CN110263743B (en) | Method and device for recognizing images | |
| CN111103967A (en) | Control method and device of virtual object | |
| CN113840177B (en) | Live interaction method and device, storage medium and electronic equipment | |
| CN109840457B (en) | Augmented reality registration method and augmented reality registration device | |
| CN110941974B (en) | Control method and device of virtual object |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |