CN111613218A - Voice drawing system and drawing method thereof - Google Patents
Voice drawing system and drawing method thereof Download PDFInfo
- Publication number
- CN111613218A CN111613218A CN202010291169.2A CN202010291169A CN111613218A CN 111613218 A CN111613218 A CN 111613218A CN 202010291169 A CN202010291169 A CN 202010291169A CN 111613218 A CN111613218 A CN 111613218A
- Authority
- CN
- China
- Prior art keywords
- module
- voice
- image
- local control
- control module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/80—Creating or modifying a manually drawn or painted image using a manual input device, e.g. mouse, light pen, direction keys on keyboard
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/24—Reminder alarms, e.g. anti-loss alarms
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B3/00—Audible signalling systems; Audible personal calling systems
- G08B3/10—Audible signalling systems; Audible personal calling systems using electric transmission; using electromagnetic transmission
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L13/00—Speech synthesis; Text to speech systems
- G10L13/02—Methods for producing synthetic speech; Speech synthesisers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Abstract
The invention discloses a voice drawing system and a drawing method thereof, wherein the system comprises user side equipment, and the user side equipment comprises a local control module, a voice acquisition module, a voice recognition module, a display module, an image synthesis module and a local storage module; the local control module is respectively connected with the voice recognition module, the image synthesis module, the manual input module and the local storage module and is used for realizing coordination control among the modules; the voice acquisition module is connected with the voice recognition module, and the voice recognition module is used for converting the voice information acquired by the voice acquisition module into a drawing operation instruction; the image synthesis module is used for synthesizing a drawing image according to the drawing operation instruction; the display module is used for displaying a drawing image; the local storage module is used for storing drawing images. The voice drawing device carries out drawing and painting through voice, improves the drawing efficiency, can be used for military operation drawing, scheme planning drawing and children drawing.
Description
Technical Field
The invention relates to the technical field of computer application, in particular to a voice drawing system and a drawing method thereof.
Background
In the conventional drawing system, a user performs drawing creation through a track input device, such as a mouse or a touch pen. Particularly, in some fields, drawing is performed only through the track input device, so that the efficiency is low, the attractiveness is poor, drawing needs to be drawn or modified on site in some working occasions (discussing scheme planning drawings and the like), and drawing modification is low, the participation is poor, the drawing modification is tedious, the modification is slow, and real-time sharing cannot be performed.
Therefore, there is a need in the art for a voice mapping system and a mapping method thereof to solve the above problems.
Disclosure of Invention
The invention provides a voice drawing system and a drawing method thereof, which can draw through voice, improve drawing efficiency and modification efficiency and share in real time, in order to solve the technical problems that the existing drawing system in the prior art needs to draw or modify drawings on site in some working occasions (discussing scheme plan drawings and the like), and has low efficiency, poor participation, tedious drawing modification, slow modification and incapability of real-time sharing through a track input device.
In order to achieve the above object, the technical solution of the present invention provides a voice mapping system, which includes a user end device, where the user end device includes a local control module, a voice acquisition module, a voice recognition module, a display module, an image synthesis module, and a local storage module;
the local control module is respectively connected with the voice recognition module, the image synthesis module and the local storage module, and is used for realizing coordination control among the voice recognition module, the image synthesis module and the local storage module;
the voice acquisition module is connected with the voice recognition module, and the voice recognition module is used for converting the voice information acquired by the voice acquisition module into a drawing operation instruction;
the image synthesis module is used for synthesizing a drawing image according to the drawing operation instruction;
the display module is connected with the image synthesis module and is used for displaying the drawing image;
the local storage module is used for storing the drawing image under the control of the local control module.
In the preferred technical solution of the voice drawing system, the user end device further includes a voice output module and a voice synthesis module;
the voice synthesis module is respectively connected with the voice output module and the local control module, the voice synthesis module is used for generating voice prompt information under the control of the local control module, and the voice output module is used for playing the voice prompt information.
In the preferable technical solution of the voice drawing system, the user side device further includes a manual input module connected to the local control module, and the local control module is further configured to generate a drawing instruction conversion library according to drawing operation setting information input by a user through the manual input module;
the voice recognition module converts the voice information collected by the voice collection module into a drawing operation instruction according to the drawing instruction conversion library, and calls a graph from the graph library in the storage module.
In a preferred embodiment of the voice drawing system, the drawing operation command includes at least one of the following:
delete, color change, zoom, move, copy, select, rotate, end.
In a preferred technical solution of the voice drawing system, the voice drawing system includes a cloud server and a plurality of the client devices;
the cloud server is used for realizing coordination control management among the plurality of user side devices so as to realize collaborative drawing through different user side devices.
In the preferable technical scheme of the voice painting system, the cloud server includes a cloud control module and a cloud storage module, and the cloud storage module is connected with the cloud control module.
In a preferred technical solution of the voice drawing system, the user-side device further includes an image recognition and evaluation module connected to the local control module;
the image identification scoring evaluation module is used for evaluating the drawing image according to a preset evaluation rule.
On the other hand, to achieve the above object, the technical solution of the present invention further provides a drawing method for a voice drawing system, where the voice drawing system includes a user end device, and the user end device includes a local control module, a voice acquisition module, a voice recognition module, a display module, an image synthesis module, and a local storage module, and the drawing method includes:
step S1: the local control module generates a drawing interface, controls the display module to display the drawing interface, and controls the voice recognition module to convert the voice information acquired by the voice acquisition module into a drawing operation instruction;
step S2: the local control module sends the drawing operation instruction converted by the voice recognition module to the image synthesis module;
step S3: the image synthesis module synthesizes drawing images according to the drawing operation instructions;
step S4: the display module displays the drawing image;
step S5: when the local control module receives an image saving instruction, the local control module saves the drawing image in the local storage module.
In the preferable technical solution of the drawing method of the voice drawing system, the user equipment further includes a voice output module, a voice synthesis module, and an image recognition and evaluation module;
before step S1, the method further includes:
the local control module controls the voice synthesis module to generate voice prompt information, and then controls the voice output module to play the voice prompt information;
further included after step S4 is:
and the image identification and evaluation module evaluates the drawing image according to a preset evaluation rule and the drawing completion degree of the user.
In a preferred embodiment of the drawing method of the voice drawing system, the voice drawing system includes a server and a plurality of the user end devices;
before step S3, the method further includes: one of the client devices sends the drawing operation instruction converted by the client device to the cloud server, and the cloud server forwards the drawing operation instruction to other client devices in the plurality of client devices;
wherein the step S3 includes: for the user side equipment, the image synthesis module synthesizes a drawing image according to the drawing operation instruction converted by the voice recognition module and the drawing operation instruction received from the cloud server.
The technical scheme includes that the voice drawing system and the voice drawing method can be used for drawing, painting, drawing size and position through voice commands, effectively improve drawing manufacturing efficiency and drawing attractiveness, shorten drawing time, simplify modification steps, realize real-time sharing, realize manufacturing and modification of drawing participation of multiple people, can be used for drawing in military operations, facilitate rapid display and route modification of different operation routes, can also be used for drawing of children, train the space imagination and creativity of the children, train language expression capacity and multi-person cooperation capacity in the aspect of multi-person drawing, increase motivation measures, slowly establish drawing circles of the children and enable the children to insist on playing.
Drawings
Fig. 1 is a schematic diagram of a user end device according to an embodiment of the present invention;
FIG. 2 is a diagram of a voice mapping system according to an embodiment of the present invention;
FIG. 3 is a flow chart of a plotting method according to an embodiment of the present invention;
FIG. 4 is a flow chart of a single person mapping method according to an embodiment of the present invention;
description of the drawings: 1. a user side device; 2. a cloud server; 101. a local control module; 102. a voice acquisition module; 103. a voice recognition module; 104. a display module; 105. an image synthesis module; 106. a local storage module; 107. a voice output module; 108. a speech synthesis module; 109. a manual input module; 110. and an image identification evaluation module.
Detailed Description
The present invention is described in terms of particular embodiments, other advantages and features of the invention will become apparent to those skilled in the art from the following disclosure, and it is to be understood that the described embodiments are merely exemplary of the invention and that it is not intended to limit the invention to the particular embodiments disclosed. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that in the description of the present invention, the terms "in", "upper", "lower", "inside", and the like indicate directions or positional relationships based on those shown in the drawings, which are merely for convenience of description, and do not indicate or imply that the apparatus or the elements must have a specific orientation, be constructed and operated in a specific orientation, and thus, should not be construed as limiting the present invention. Furthermore, the terms "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
Furthermore, it should be noted that, in the description of the present invention, unless otherwise explicitly specified or limited, the terms "disposed," "mounted," "connected," and "connected" are to be construed broadly and may be, for example, fixedly connected, detachably connected, or integrally connected; may be a mechanical connection; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
The invention can control drawing, painting, graph size and position through voice command, effectively improve drawing making efficiency and drawing aesthetic property, shorten drawing time, simplify modification steps, realize real-time sharing, realize making and modification of drawing by multiple persons, can be used for military operation drawing, is convenient for quickly showing and modifying different operation routes, can also be used for children, exercising space imagination and creativity of children, and can also exercise language expression ability, creativity in multi-person drawing aspect, The multi-person cooperation capability can be increased, meanwhile, the incentive measures can be added, the drawing circle of the child can be built slowly, and the child can play the drawing circle.
Specifically, as shown in fig. 1, the embodiment of the present invention provides a voice mapping system, where the voice mapping system includes a user end device 1, and the user end device 1 includes a local control module 101, a voice acquisition module 102, a voice recognition module 103, a display module 104, an image synthesis module 105, and a local storage module 106;
the local control module 101 is respectively connected with the voice recognition module 103, the image synthesis module 105 and the local storage module 106, and the local control module 101 is used for realizing coordination control among the voice recognition module 103, the image synthesis module 105 and the local storage module 106;
the voice collecting module 102 is connected to the voice recognizing module 103, and the voice recognizing module 103 is configured to convert the voice information collected by the voice collecting module 102 into a drawing operation instruction, where the drawing operation instruction at least includes one or more of the following:
deleting, changing color, zooming, moving, copying, full selecting, rotating and ending, for example, the voice recognition module 103 may recognize the voice information collected by the voice collection module 102 into text information, and then determine a corresponding drawing operation instruction according to the text information;
the image synthesis module 105 is used for synthesizing a drawing image according to a drawing operation instruction, and the image synthesis module 105 comprises an image library, a graph library and a color library, wherein the image library comprises a plurality of static images and dynamic images, the graph library comprises a plurality of graph templates, each graph template comprises a single graph, a graph block, a graph group and the like, and the color library comprises various color parameters;
the display module 104 is connected to the image synthesis module 105, and the display module 104 is configured to display the drawing image;
the local storage module 106 is used to store drawing images under the control of the local control module 101.
According to the voice drawing system provided by the embodiment of the invention, a user can make and modify drawings in a voice mode, so that the drawing working efficiency is improved.
Preferably, in the embodiment of the present invention, the client device 1 further includes a speech output module 107 and a speech synthesis module 108;
the voice synthesis module 108 is respectively connected to the voice output module 107 and the local control module 101, the voice synthesis module 108 is configured to generate voice prompt information under the control of the local control module 101, the voice output module 107 is configured to play the voice prompt information, and the voice output module 107 and the voice synthesis module 108 can prompt a user in a drawing process to help the user draw a drawing, for example, a text instruction output by the local control module 101 can be converted into a voice instruction by the voice synthesis module 108 and played by the voice output module 107;
preferably, in the embodiment of the present invention, the user end device 1 further includes a manual input module 109 connected to the local control module 101, and the local control module 101 is further configured to generate a drawing instruction conversion library according to the drawing operation setting information input by the user through the manual input module 109; the voice recognition module 103 converts the voice information collected by the voice collection module 102 into a drawing operation instruction according to a drawing instruction conversion library.
For example, before drawing, a user may set a drawing operation through the manual input module 109, that is, drawing operation setting information is input through the manual input module 109, the local control module 101 generates a drawing instruction conversion library according to the drawing operation setting information, where the drawing instruction conversion library includes a correspondence between key point information in text information recognized by voice information and a drawing operation instruction, and is a one-to-one instruction relationship, and when the user draws, the voice recognition module 103 first recognizes voice information collected by the voice collection module 102 as text information, reads key point information related to drawing, and then searches in the drawing instruction conversion library to obtain a drawing operation instruction corresponding to the text information.
As shown in fig. 2, which is a schematic view of a voice mapping system according to an embodiment of the present invention, the voice mapping system includes a cloud server 2 and a plurality of the above-mentioned client devices 1;
the cloud server 2 is used for realizing coordination control management among the plurality of user side devices 1 so as to realize coordinated drawing through different user side devices 1, wherein the cloud server 2 comprises a cloud control module and a cloud storage module, the cloud storage module is connected with the cloud control module, the cloud control module is used for realizing coordination control management among the plurality of user side devices 1, and the cloud storage module is used for storing information;
in the voice drawing system provided in the embodiment of the present invention, any one of the user end devices 1 may work independently, so as to implement a single-person drawing mode, and a plurality of user end devices 1 may also work cooperatively, so as to implement a multi-person cooperative drawing mode (i.e., different users complete drawing of a picture through different user end devices 1).
Preferably, in the embodiment of the present invention, the client device 1 further includes an image recognition and evaluation module 110 connected to the local control module 101;
the image recognition and evaluation module 110 is configured to evaluate the drawing image according to a preset evaluation rule, where the evaluation result is not limited to a score, and may also be an evaluation result in other forms, where the evaluation rule includes a scoring rule, a drawing completion degree but not limited to the scoring rule and the drawing completion degree, and the evaluation rule may be one of a plurality of evaluation rules, or may also be a combination of a plurality of evaluation rules to evaluate the drawing, and particularly, when a plurality of users participate in the drawing, the evaluation rule further includes evaluating how many times the users participate in the drawing, for example, the image recognition and evaluation module 110 may evaluate the drawing image of the user according to the drawing completion degree of the users, for example, by pre-storing a standard drawing image, and the image recognition and evaluation module 110 may compare the drawing image of the user with the standard drawing image, which is suitable for checking the drawing job, and evaluating the drawing image of the user by judging the matching degree of the main features, wherein after the image recognition and evaluation module 110 evaluates the drawing image, the local control module 101 can display the evaluation result through the display module 104 and determine whether to store the evaluation result in the local storage module 106 according to the instruction of the user.
The embodiment of the present invention further provides a drawing method for a voice drawing system, where the voice drawing system includes a user end device 1, and the user end device 1 includes a local control module 101, a voice acquisition module 102, a voice recognition module 103, a display module 104, an image synthesis module 105, and a local storage module 106, as shown in fig. 3, the drawing method includes:
step S1: the local control module 101 generates a drawing interface, controls the display module 104 to display the drawing interface, and simultaneously controls the voice recognition module 103 to convert the voice information acquired by the voice acquisition module 102 into a drawing operation instruction by the local control module 101;
step S2: the local control module 101 sends the drawing operation instruction converted by the voice recognition module 103 to the image synthesis module 105;
step S3: the image synthesis module 105 synthesizes a drawing image according to the drawing operation instruction;
step S4: the display module 104 displays the drawing image;
step S5: when the local control module 101 receives the image saving instruction, the local control module 101 saves the drawing image in the local storage module 106.
The specific implementation process of fig. 3 is: after the voice drawing system is started, the local control module 101 generates a drawing interface according to a program preset by the system, the local control module 101 controls the display module 104 to display the drawing interface, meanwhile, the local control module 101 controls the voice recognition module 103 to work, so that the voice recognition module 103 is in a working state, constantly monitors voice information and filters irrelevant noise in recognized sound, only human voice is kept, the voice recognition module 103 converts the voice information collected by the voice collection module 102 into a corresponding drawing operation instruction, for example, the voice recognition module 103 recognizes key information in the processed voice information, such as information of 'circle', 'rectangle', 'triangle', 'straight line', 'curve', and the like, and then the local control module 101 executes corresponding drawing instruction information. The local control module 101 converts the key information recognized by the voice recognition module 103 into corresponding drawing operation instruction information, such as drawing instructions corresponding to "circle", "rectangle", "triangle", "straight line", "curve", and the like, and sends the drawing operation instruction information corresponding to the voice to the image synthesis module 105. The image synthesis module 105 receives the corresponding drawing instruction information and generates a corresponding drawing image according to the drawing operation instruction. The local control module 101 sends the image synthesis module 105 to the display module 104, and commands the display of the corresponding drawing image. When the operator clicks the save button and the local control module 101 receives the image save instruction, the local control module 101 executes the save instruction to save the drawing image in the local storage module 106.
For example, the client device 1 may have a structure as shown in fig. 1, and each user may perform single-person drawing through one client device 1, as shown in fig. 4, the specific process is as follows:
1. starting drawing;
the local control module 101 controls drawing to start, firstly the local control module 101 sends text information of a drawing prompt to the voice synthesis module 108, the voice synthesis module 108 synthesizes the voice prompt information and plays the voice prompt information through the voice output module 107, then the local control module 101 generates a start page and controls the display module 104 to display the start page, for example, a start button can be set on the start page, and a user can manually click the start button through the manual input module 109 to start drawing;
2. collecting voice and extracting an instruction;
for example, the manual input module 109 receives a click signal and then sends the click signal to the local control module 101, the local control module 101 determines the signal, and if the determination is that the user clicks a start button, a drawing page is generated and the display module 104 is controlled to display the drawing page;
for example, a convenient and fast voice button is provided on the left side of the drawing page, which may include the following categories: the picture library, the eraser, the straight line/curve/oblique line and the like, the color number, the layer number, the free drawing/task drawing, the completion/completion and the sharing, wherein the picture library comprises common pictures (png format, pictures without colors), such as stars, small grass, squares and the like; the eraser is used for deleting the voice of a place where the pointer is unsatisfied or wrong with the picture; straight lines/curves/oblique lines and the like refer to materials called by voice in the drawing process; the color number refers to that the color can be quickly selected according to the color number when the color is selected after the basic drawing is finished; the layer numbering is convenient for the use of an eraser and a color numbering function; the free painting/task painting can be switched, wherein the free painting is randomly painted according to own will, the task painting refers to certain set requirements for painting, the task painting can be set to different difficulty levels so as to meet the requirements of children of different ages, and the children are prevented from losing the interest in painting due to overlarge difficulty.
Meanwhile, the local control module 101 controls the voice acquisition module 102 to start voice acquisition and controls the voice recognition module 103 to start voice recognition, and the instruction which can be recognized by the voice recognition module 103 at least comprises deletion, color change, scaling, movement, copying, full selection, rotation and ending;
3. executing the instruction;
after recognizing the drawing operation instruction, the voice recognition module 103 sends the drawing operation instruction to the local control module 101, the local control module 101 judges whether the instruction is an end instruction, if not, the instruction is sent to the image synthesis module 105, the image synthesis module 105 performs image processing according to the drawing operation instruction, and an image generated by the image synthesis module 105 is output to the display module 104 for display;
for example, when children use the present invention to draw, users can control the size, position (up, down, left, right), and color depth (deepening or lightening) of the graph by voice according to their own drawing will, and when selecting the pattern in the graph library, the user can directly speak the name of the desired selected pattern, such as a circle, a rectangle, etc., and more preferably, the graph library also has a display function, for example, the user selects the graph of a small animal from the graph library, and when appearing on the drawing page, the user can simply display, such as: when the user selects a pattern of a kitten, which appears on the drawing page, the local control module 101 controls the voice synthesis module 108 to synthesize the voice information of the cat call, and plays the voice information through the voice output module 107;
4. display results and graphical evaluation:
when the local control module 101 receives an instruction recognized by the voice recognition module 103 as ending drawing, the local control module 101 controls the voice recognition module 103 to stop recognizing, and sends a drawing image finally generated by the image synthesis module 105 to the image recognition evaluation module 110 for evaluation, after the evaluation is ended, the local control module 101 generates a drawing result page, the drawing result page comprises the finally generated drawing image and an evaluation result, then the local control module 101 controls the display module 104 to display the drawing result page, and in addition, the drawing result page can also comprise a button which is selected by a user to be stored or not;
5. the user selects whether to save:
the manual input module 109 sends the selection result of the user to the local control module 101, wherein if the user selects to save, the local control module 101 saves the finally generated drawing image and the evaluation result to the local storage module 106; and if the user abandons the current drawing image and selects not to store the current drawing image, the drawing image is not stored.
For example, for the voice mapping system shown in fig. 2, which includes a cloud server 2 and a plurality of user end devices 1, each user may perform independent mapping through one user end device 1, or a plurality of users may perform collaborative mapping through a plurality of user end devices 1, so as to implement a multi-user collaborative mapping mode, and implement real-time sharing of a mapping image, and is suitable for discussing a plan or a military combat plan, in which a plurality of users may participate, for example, the following voice buttons may be provided on the left side of a mapping page: inviting friends, single person drawing/multi person cooperation drawing, wherein a user can invite own friends to carry out multi person cooperation drawing through 'inviting friends', and switching between different modes can be realized through 'single person drawing/multi person cooperation drawing' buttons; the sharing mode is used for judging whether the drawing process and the drawing result are shared with others or not; and sharing permissions to modify the shared drawing.
When the user selects the multi-user collaborative drawing mode, the specific process is as follows:
step A: each client device 1 participating in the multi-person collaborative drawing performs the following operations: the local control module 101 generates a drawing interface, controls the display module 104 to display the drawing interface, simultaneously controls the voice recognition module 103 to convert voice information acquired by the voice acquisition module 102 into a drawing operation instruction, and sends the drawing operation instruction converted by the voice recognition module 103 to the image synthesis module 105 by the local control module 101;
and B: one user end device 1 sends the drawing operation instruction converted by the user end device 1 to the cloud end server 2, and the cloud end server 2 forwards the drawing operation instruction to other user end devices in the plurality of user end devices 1;
and C: for each client device 1, the image synthesis module 105 synthesizes a drawing image according to the drawing operation instruction converted by the voice recognition module 103 and the drawing operation instruction received from the cloud server 2, and then the display module 104 displays the drawing image and determines whether to store the drawing image in the local storage module 106 according to the user instruction.
The voice drawing system and the drawing method thereof can be used for drawing occasions needing drawing in work and drawing military battle charts by controlling the drawing, the painting, the size and the position of the graphs through voice, greatly improve the drawing efficiency, particularly facilitate participants to modify and share the drawing in real time, improve the working efficiency, have good visualization degree, can also be used for drawing training of children, can exercise the space imagination and creativity of the children, and can also exercise the language expression ability and the multi-person cooperation ability in the aspect of multi-person drawing.
Although the invention has been described in detail above with reference to a general description and specific examples, it will be apparent to one skilled in the art that modifications or improvements may be made thereto based on the invention. Accordingly, such modifications and improvements are intended to be within the scope of the invention as claimed.
Claims (10)
1. A voice drawing system is characterized by comprising user side equipment, wherein the user side equipment comprises a local control module, a voice acquisition module, a voice recognition module, a display module, an image synthesis module and a local storage module;
the local control module is respectively connected with the voice recognition module, the image synthesis module and the local storage module, and is used for realizing coordination control among the voice recognition module, the image synthesis module and the local storage module so as to realize the functions of each module;
the voice acquisition module is connected with the voice recognition module, and is used for acquiring voice information sent by a user, and the voice recognition module is used for converting the voice information acquired by the voice acquisition module into a drawing operation instruction;
the image synthesis module is used for synthesizing a drawing image according to the drawing operation instruction;
the display module is connected with the image synthesis module and is used for displaying the drawing image;
the local storage module is used for storing the drawing image under the control of the local control module.
2. The voice mapping system of claim 1, wherein the client device further comprises a voice output module and a voice synthesis module;
the voice synthesis module is respectively connected with the voice output module and the local control module, the voice synthesis module is used for generating voice prompt information under the control of the local control module, and the voice output module is used for playing the voice prompt information.
3. The voice mapping system according to claim 1, wherein the client device further includes a manual input module connected to the local control module, and the local control module is further capable of generating a mapping command conversion library according to mapping operation setting information input by a user through the manual input module;
and the voice recognition module converts the voice information acquired by the voice acquisition module into a drawing operation instruction according to the drawing instruction conversion library and calls a graph from a graph library in a storage module.
4. The voice mapping system of claim 3, wherein the mapping operation instructions include at least one of:
delete, color change, zoom, move, copy, select, rotate, end.
5. The voice mapping system of claim 1, wherein the voice mapping system comprises a cloud server and a plurality of the client devices;
the cloud server is used for realizing coordination control management among the plurality of user side devices so as to realize collaborative drawing through different user side devices.
6. The voice mapping system of claim 5, wherein the cloud server comprises a cloud control module and a cloud storage module, and the cloud control module is connected to the cloud storage module.
7. The voice mapping system according to any of claims 1-6, wherein said user device further comprises an image recognition evaluation module, said image recognition evaluation module being connected to said local control module;
and the image identification and evaluation module is used for evaluating the painting image according to a preset evaluation rule.
8. The drawing method of the voice drawing system is characterized in that the voice drawing system comprises user side equipment, the user side equipment comprises a local control module, a voice acquisition module, a voice recognition module, a display module, an image synthesis module and a local storage module, and the drawing method comprises the following steps:
step S1: the local control module generates a drawing interface, controls the display module to display the drawing interface, and controls the voice recognition module to convert the voice information acquired by the voice acquisition module into a drawing operation instruction;
step S2: the local control module sends the drawing operation instruction converted by the voice recognition module to the image synthesis module;
step S3: the image synthesis module synthesizes drawing images according to the drawing operation instructions;
step S4: the display module displays the drawing image;
step S5: when the local control module receives an image saving instruction, the local control module saves the drawing image in the local storage module.
9. The drawing method according to claim 8, wherein the client device further comprises a voice output module, a voice synthesis module, and an image recognition and evaluation module;
before step S1, the method further includes:
the local control module controls the voice synthesis module to generate voice prompt information, and then controls the voice output module to play the voice prompt information;
further included after step S4 is:
and the image identification evaluation module evaluates the drawing image according to a preset evaluation rule.
10. The drawing method according to claim 8, wherein the voice drawing system comprises a cloud server and a plurality of the client devices;
before step S3, the method further includes: one of the client devices sends the drawing operation instruction converted by the client device to the cloud server, and the cloud server forwards the drawing operation instruction to other client devices in the plurality of client devices;
wherein the step S3 includes: for each user terminal device, the image synthesis module synthesizes a drawing image according to the drawing operation instruction converted by the voice recognition module and the drawing operation instruction received from the cloud server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010291169.2A CN111613218A (en) | 2020-04-14 | 2020-04-14 | Voice drawing system and drawing method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010291169.2A CN111613218A (en) | 2020-04-14 | 2020-04-14 | Voice drawing system and drawing method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111613218A true CN111613218A (en) | 2020-09-01 |
Family
ID=72195952
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010291169.2A Withdrawn CN111613218A (en) | 2020-04-14 | 2020-04-14 | Voice drawing system and drawing method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111613218A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112596659A (en) * | 2020-12-23 | 2021-04-02 | 陇东学院 | Drawing method and device based on intelligent voice and image processing |
| CN112950735A (en) * | 2021-03-04 | 2021-06-11 | 爱昕科技(广州)有限公司 | Method for generating image by combining sketch and voice instruction, computer readable storage medium and display device |
-
2020
- 2020-04-14 CN CN202010291169.2A patent/CN111613218A/en not_active Withdrawn
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112596659A (en) * | 2020-12-23 | 2021-04-02 | 陇东学院 | Drawing method and device based on intelligent voice and image processing |
| CN112950735A (en) * | 2021-03-04 | 2021-06-11 | 爱昕科技(广州)有限公司 | Method for generating image by combining sketch and voice instruction, computer readable storage medium and display device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101855639B1 (en) | Camera navigation for presentations | |
| JP5896578B2 (en) | Data input device | |
| JP4340725B2 (en) | Video game processing apparatus, video game processing method, and video game processing program | |
| KR102463112B1 (en) | Simulation Sandbox System | |
| CN111613218A (en) | Voice drawing system and drawing method thereof | |
| DE112015002463T5 (en) | Systems and methods for gestural interacting in an existing computer environment | |
| WO2011082405A1 (en) | Interactive game environment | |
| CN105096387A (en) | Intelligent three-dimensional processing method of two-dimensional sketch | |
| WO2020129959A1 (en) | Computer program, server device, terminal device, and display method | |
| CN103405911A (en) | Method and system for prompting mahjong draws | |
| CN112734946A (en) | Vocal music performance teaching method and system | |
| JP2020080154A (en) | Information processing system | |
| CN107690348A (en) | The visualization performs device and method of a kind of fitness program | |
| KR102254193B1 (en) | System of generating animation character and Method thereof | |
| JPH0970030A (en) | Image display method for virtual conference system and virtual conference terminal equipment | |
| CN116342763A (en) | Intelligent multi-mode animation creation system and creation method | |
| Söderlund et al. | Participatory involvement and multitheoretical perspectives in visual management design | |
| Gu et al. | A grammar for the dynamic design of virtual architecture using rational agents | |
| CN113345103B (en) | Virtual reality interaction route recommendation system based on mental model | |
| Ramsier | Evaluating the Usability and User Experience of a Virtual Reality Painting Application. | |
| Chopra | Evaluating User Preferences for Augmented Reality Interactions for the Internet of Things | |
| Lu et al. | Towards happy housework: scenario-based experience design for a household cleaning robotic system | |
| JPH1049701A (en) | Method for fetching operation of articulated structural body | |
| JP2005050256A (en) | Opinion collection system | |
| CN115690331B (en) | City design entity interaction system and method for collecting public opinions |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20200901 |
|
| WW01 | Invention patent application withdrawn after publication |