CN114816091A - Point writing pen and audio file manufacturing method and system based on point writing pen - Google Patents
Point writing pen and audio file manufacturing method and system based on point writing pen Download PDFInfo
- Publication number
- CN114816091A CN114816091A CN202210469549.XA CN202210469549A CN114816091A CN 114816091 A CN114816091 A CN 114816091A CN 202210469549 A CN202210469549 A CN 202210469549A CN 114816091 A CN114816091 A CN 114816091A
- Authority
- CN
- China
- Prior art keywords
- audio file
- audio
- note
- pen
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03545—Pens or stylus
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11C—STATIC STORES
- G11C7/00—Arrangements for writing information into, or reading information out from, a digital store
- G11C7/16—Storage of analogue signals in digital stores using an arrangement comprising analogue/digital [A/D] converters, digital memories and digital/analogue [D/A] converters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Position Input By Displaying (AREA)
Abstract
The invention discloses a point pen and a method and a system for manufacturing an audio file based on the point pen, and relates to the technical field of intelligent electronic application. The method comprises the following steps: acquiring and starting a point writing pen according to a user audio production request; collecting and sending note writing video data of a user to a controller through a camera; extracting key frame images of the note writing video data through a controller to obtain and identify and analyze the note writing key frame images to obtain character information and corresponding note information; importing the note information into a preset audio generation model to obtain an initial audio file; and generating a target audio file according to the text information and the initial audio file. The invention can combine the audio production requirement of the user to carry out rapid audio creation.
Description
Technical Field
The invention relates to the technical field of intelligent electronic application, in particular to a point pen and an audio file manufacturing method and system based on the point pen.
Background
With the advance of modern technology, the popularization of computers and personal electronic devices and the rapid development of related technologies, input devices for connecting users and electronic devices are also diversified. The intelligent point-writing pen is widely applied.
Along with the increasingly improved life of people, the demands of people are also increasing, the requirements of basic point writing and point reading are not met when the intelligent point writing pen is applied, more functional applications are needed, audio files wanted by people can be made, and audio creation can be carried out simply and conveniently. However, the prior art does not meet the user's demand for easy and convenient audio production.
Disclosure of Invention
In order to overcome the above problems or at least partially solve the above problems, embodiments of the present invention provide a stylus pen and a method and a system for creating an audio file based on the stylus pen, which can perform fast audio creation according to the audio creation requirement of a user.
The embodiment of the invention is realized by the following steps:
in a first aspect, an embodiment of the present invention provides a stylus pen, including a pen body, a camera, an audio player, a controller, and a memory, where the pen body includes a pen point and a pen holder, the pen point is provided with a groove for placing the camera, the pen holder is provided with a through hole for placing the controller and a storage device, and the pen holder is provided with an interface for connecting the controller with an external device; the camera, the audio player and the storage device are respectively connected with the controller.
The working principle of the point writing pen is as follows:
this point pen uses with the books that are provided with the coordinate code cooperate, when the user needs carry out the audio frequency preparation, start the camera, electronic equipment such as controller, the user begins the note characters and writes, write video image through the camera on the nib to user's note and gather, then upload for the controller, write video image through the note of controller to the user who gathers and discern, in order to obtain corresponding text information and the note information that corresponds, then send to storage facilities, carry out complete record storage to data through storage facilities. And then, matching and analyzing the note information through an audio generation model preset in the controller to generate an initial audio file, and then combining the corresponding character information to manufacture a target audio file so as to meet the audio manufacturing requirement of a user.
In some embodiments of the invention according to the first aspect, the external device includes one or more of a headset, a sound, a speaker, a USB device, a memory card, and a display.
In a second aspect, an embodiment of the present invention provides a method for making an audio file based on a stylus, including the following steps:
acquiring and starting a point writing pen according to a user audio production request;
collecting and sending note writing video data of a user to a controller through a camera;
extracting key frame images of the note writing video data through a controller to obtain and identify and analyze the note writing key frame images to obtain character information and corresponding note information;
importing the note information into a preset audio generation model to obtain an initial audio file;
and generating a target audio file according to the text information and the initial audio file.
In order to solve the technical problem that the requirement of a user for simply and conveniently making audio cannot be met in the prior art, the method is used for analyzing and matching the audio making requirement of the user based on the point writing pen of the first aspect, and then making an audio file to meet the requirement of the user. When a user has an audio production requirement, sending an audio production request, and starting a point writing pen based on the audio production request of the user; then, acquiring corresponding note writing video data of the user to a controller based on a camera of the point writing pen; then, in order to further improve the data processing efficiency and the data extraction accuracy, key frame image extraction is carried out on the note writing video data through the controller, then note and character recognition analysis is carried out on the basis of the extracted note writing key frame image, after character and character information is obtained, an audio generation model preset in the controller is adopted to analyze the note information so as to match with corresponding audio, an initial audio file is obtained, then notes corresponding to all characters are combined and a target audio file is generated by combining the corresponding audio, and the requirement of a user for simply and conveniently making audio at any time and any place is met.
Based on the second aspect, in some embodiments of the present invention, the method for generating the target audio file according to the text information and the initial audio file includes the following steps:
extracting note association marks of each character in the character information and note association marks in the initial audio file;
and matching the character information with the initial audio file one by one according to the note association marks of the characters in the character information and the note association marks in the initial audio file to generate a target audio file.
Based on the second aspect, in some embodiments of the present invention, the method for producing an audio file based on a stylus pen further includes the steps of:
and acquiring and sending the target audio file to an audio player or external equipment for audio playing according to the audio playing requirement of the user.
In a third aspect, an embodiment of the present invention provides an audio file production system based on a stylus, including a starting module, a data acquisition module, an identification and analysis module, an initial audio module, and a target audio production module, where:
the starting module is used for acquiring and starting the point writing pen according to the user audio production request;
the data acquisition module is used for acquiring and sending the note writing video data of the user to the controller through the camera;
the recognition analysis module is used for extracting key frame images of the note writing video data through the controller to obtain and perform recognition analysis on the note writing key frame images to obtain character information and corresponding note information;
the initial audio module is used for importing the note information into a preset audio generation model to obtain an initial audio file;
and the target audio making module is used for generating a target audio file according to the text information and the initial audio file.
In order to solve the technical problem that the requirement of a user for simply and conveniently making audio cannot be met in the prior art, the system analyzes and matches the audio making requirement of the user through the matching of the starting module, the data acquisition module, the identification and analysis module, the initial audio module, the target audio making module and other modules, and then makes an audio file to meet the requirement of the user. When a user has an audio making requirement, sending an audio making request, and starting a point writing pen based on the audio making request of the user; then, acquiring corresponding note writing video data of the user to a controller based on a camera of the point writing pen; then, in order to further improve the data processing efficiency and the data extraction accuracy, key frame image extraction is carried out on the note writing video data through the controller, then note and character recognition analysis is carried out on the basis of the extracted note writing key frame image, after character and character information is obtained, an audio generation model preset in the controller is adopted to analyze the note information so as to match with corresponding audio, an initial audio file is obtained, then notes corresponding to all characters are combined and a target audio file is generated by combining the corresponding audio, and the requirement of a user for simply and conveniently making audio at any time and any place is met.
Based on the third aspect, in some embodiments of the present invention, the target audio production module includes a tag extraction sub-module and a matching sub-module, wherein:
the mark extraction submodule is used for extracting the note association marks of all characters in the character information and the note association marks in the initial audio file;
and the matching submodule is used for matching the character information with the initial audio file one by one according to the note association marks of all characters in the character information and the note association marks in the initial audio file so as to generate a target audio file.
Based on the third aspect, in some embodiments of the present invention, the system for creating an audio file based on a stylus pen further includes an audio playing module, configured to obtain and send the target audio file to an audio player or an external device for audio playing according to an audio playing requirement of a user.
In a fourth aspect, an embodiment of the present application provides an electronic device, which includes a memory for storing one or more programs; a processor. The program or programs, when executed by a processor, implement the method of any of the second aspects as described above.
In a fifth aspect, embodiments of the present application provide a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the method according to any one of the above second aspects.
The embodiment of the invention at least has the following advantages or beneficial effects:
the embodiment of the invention provides a point writing pen and a method and a system for making an audio file based on the point writing pen, solves the technical problem that the requirement of a user for simply and conveniently making audio cannot be met in the prior art, and realizes analysis and matching of the audio making requirement of the user so as to make the audio file and meet the requirement of the user. When a user has an audio making requirement, sending an audio making request, and starting a point writing pen based on the audio making request of the user; then, acquiring corresponding note writing video data of the user to a controller based on a camera of the point writing pen; then, in order to further improve the data processing efficiency and the accuracy of data extraction, key frame image extraction is carried out on the note writing video data through the controller, then, note and character recognition analysis is carried out on the basis of the extracted note writing key frame image, after character and character information is obtained, the note information is analyzed through an audio generation model preset in the controller so as to match with corresponding audio, an initial audio file is obtained, then, the note corresponding to each character is combined with the corresponding audio to generate a target audio file, and the requirement of a user for simply and conveniently making the audio anytime and anywhere is met.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
FIG. 1 is a schematic diagram of a stylus according to an embodiment of the present invention;
FIG. 2 is a flowchart of an audio file production method based on a stylus pen according to an embodiment of the present invention;
FIG. 3 is a flowchart of target audio file generation in a method for producing an audio file based on a stylus pen according to an embodiment of the present invention;
FIG. 4 is a functional block diagram of an audio file production system based on a stylus pen according to an embodiment of the present invention;
fig. 5 is a block diagram of an electronic device according to an embodiment of the present invention.
Description of reference numerals: 1. a camera; 2. a controller; 3. a storage device; 4. an audio player; 100. a starting module; 200. a data acquisition module; 300. a recognition analysis module; 400. an initial audio module; 500. a target audio production module; 600. an audio playing module; 101. a memory; 102. a processor; 103. a communication interface.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined or explained in subsequent figures.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
In the description of the embodiments of the present invention, it should be noted that, if the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings or the orientations or positional relationships that the products of the present invention are usually placed in when used, the orientations or positional relationships are only used for convenience of describing the present invention and simplifying the description, but the terms do not indicate or imply that the devices or elements indicated must have specific orientations, be constructed in specific orientations, and operate, and therefore, should not be construed as limiting the present invention.
Furthermore, the terms "horizontal", "vertical", "overhang" and the like do not require that the components be absolutely horizontal or overhang, but may be slightly inclined. For example, "horizontal" merely means that the direction is more horizontal than "vertical" and does not mean that the structure must be perfectly horizontal, but may be slightly inclined.
In the description of the embodiments of the present invention, it should be further noted that unless otherwise explicitly stated or limited, the terms "disposed," "mounted," "connected," and "connected" should be interpreted broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
Example (b):
as shown in fig. 1, in a first aspect, an embodiment of the present invention provides a writing pen, including a pen body, a camera 1, an audio player 4, a controller 2, and a memory, where the pen body includes a pen point and a pen holder, the pen point is provided with a groove for placing the camera 1, the pen holder is provided with a through hole for placing the controller 2 and a storage device 3, and the pen holder is provided with an interface for connecting the controller 2 with an external device; the camera 1, the audio player 4, and the storage device 3 are connected to the controller 2, respectively. The external equipment comprises one or more of earphones, a sound box, a loudspeaker, USB equipment, a memory card and a display screen.
The working principle of the point writing pen is as follows:
this point pen uses with the books that are provided with the coordinate code cooperate, when the user needs carry out the audio frequency preparation, start camera 1, electronic equipment such as controller 2, the user starts the note text and writes, write video image through camera 1 on the nib to user's note and gather, then upload and give controller 2, write video image through controller 2 to the note of the user who gathers and discern, in order to obtain corresponding text information and the note information that corresponds, then send to storage device 3, carry out complete record storage to data through storage device 3. And then, matching analysis is carried out on the note information through an audio generation model preset in the controller 2 to generate an initial audio file, and then a target audio file is made by combining corresponding character information to meet the audio making requirement of a user. When the user has a playing requirement, the target audio is played through the external device or the audio player 4.
As shown in fig. 2-3, in a second aspect, an embodiment of the present invention provides a method for making an audio file based on a stylus, including the following steps:
s1, acquiring and starting the point writing pen according to the user audio production request; the user audio production request includes user information, audio requirements, a stylus activation signal, and the like.
S2, acquiring and sending note writing video data of a user to the controller 2 through the camera 1; the note writing video data includes all videos in the production process, including note pictures, text pictures, time, and the like.
S3, extracting key frame images from the note writing video data through the controller 2 to obtain and identify and analyze the note writing key frame images to obtain character information and corresponding note information; the character information comprises various characters such as Chinese characters, English, small languages and the like, and also comprises note association marks of each character, wherein the note information comprises various note symbols and association marks of each character corresponding to each note symbol.
S4, importing the note information into a preset audio generation model to obtain an initial audio file; the initial audio files include sound files such as music scores, tunes, etc.
And S5, generating a target audio file according to the text information and the initial audio file. The target audio file includes information such as a melody, a tune, a word, a creator, etc.
Further, the method for generating the target audio file includes:
s51, extracting note associated marks of each character in the character information and note associated marks in the initial audio file;
and S52, matching the character information with the initial audio file one by one according to the note associated marks of the characters in the character information and the note associated marks in the initial audio file to generate a target audio file.
In some embodiments of the present invention, in order to ensure the accuracy of making the target audio file, the note association flag is used as an association keyword, and based on this, each character in the character information is matched with the tune, the music score, and the like in the initial audio file one by one to generate a complete target audio file.
In order to solve the technical problem that the requirement of a user for simply and conveniently making audio cannot be met in the prior art, the method is used for analyzing and matching the audio making requirement of the user based on the point writing pen of the first aspect, and then making an audio file to meet the requirement of the user. When a user has an audio making requirement, sending an audio making request, and starting a point writing pen based on the audio making request of the user; then, the camera 1 based on the point writing pen collects corresponding note writing video data of the user to the controller 2; then, in order to further improve the data processing efficiency and the accuracy of data extraction, key frame image extraction is carried out on the note writing video data through the controller 2, then note and character recognition analysis is carried out on the basis of the extracted note writing key frame image, after character and character information is obtained, an audio generation model preset in the controller is adopted to analyze the note information so as to match with corresponding audio, an initial audio file is obtained, then the note corresponding to each character is combined with the corresponding audio to generate a target audio file, and the requirement of a user for simply and conveniently making the audio at any time and any place is met.
Based on the second aspect, in some embodiments of the present invention, the method for producing an audio file based on a stylus pen further includes the steps of:
and acquiring and sending the target audio file to the audio player 4 or external equipment for audio playing according to the audio playing requirement of the user.
In order to better meet the requirements of the user, after the user completes the production of the corresponding target audio file, the audio player 4 or an external device may be used to play the target audio file based on the playing requirements of the user.
As shown in fig. 4, in a third aspect, an embodiment of the present invention provides an audio file production system based on a stylus pen, including a starting module 100, a data collecting module 200, a recognition analysis module 300, an initial audio module 400, and a target audio production module 500, where:
the starting module 100 is used for acquiring and starting the point writing pen according to the user audio production request;
the data acquisition module 200 is used for acquiring and sending the note writing video data of the user to the controller 2 through the camera 1;
the recognition analysis module 300 is configured to perform key frame image extraction on the note writing video data through the controller 2 to obtain and perform recognition analysis on the note writing key frame image to obtain text information and corresponding note information;
an initial audio module 400, configured to import note information into a preset audio generation model to obtain an initial audio file;
and the target audio making module 500 is configured to generate a target audio file according to the text information and the initial audio file.
In order to solve the technical problem that the requirement of a user for simply and conveniently making audio cannot be met in the prior art, the system analyzes and matches the audio making requirement of the user through the matching of the starting module 100, the data acquisition module 200, the identification and analysis module 300, the initial audio module 400, the target audio making module 500 and other modules, and then makes an audio file to meet the requirement of the user. When a user has an audio making requirement, sending an audio making request, and starting a point writing pen based on the audio making request of the user; then, the camera 1 based on the point writing pen collects corresponding note writing video data of the user to the controller 2; then, in order to further improve the data processing efficiency and the accuracy of data extraction, key frame image extraction is carried out on the note writing video data through the controller 2, then note and character recognition analysis is carried out on the basis of the extracted note writing key frame image, after character and character information is obtained, an audio generation model preset in the controller is adopted to analyze the note information so as to match with corresponding audio, an initial audio file is obtained, then the note corresponding to each character is combined with the corresponding audio to generate a target audio file, and the requirement of a user for simply and conveniently making the audio at any time and any place is met.
Based on the third aspect, in some embodiments of the present invention, the target audio production module 500 includes a tag extraction sub-module and a matching sub-module, wherein:
the mark extraction submodule is used for extracting the note association marks of all characters in the character information and the note association marks in the initial audio file;
and the matching submodule is used for matching the character information with the initial audio file one by one according to the note association marks of all characters in the character information and the note association marks in the initial audio file so as to generate a target audio file.
In some embodiments of the present invention, in order to ensure the accuracy of the target audio file production, the label extraction sub-module and the matching sub-module are matched with each other, the note association label is used as an association keyword, and on the basis of the association keyword, each character in the character information is matched with the tune, the tune spectrum and the like in the initial audio file one by one, so as to generate a complete target audio file.
Based on the third aspect, in some embodiments of the present invention, the system for producing an audio file based on a stylus pen further includes an audio playing module 600, configured to obtain and send the target audio file to the audio player 4 or an external device for audio playing according to the audio playing requirement of the user.
In order to better meet the requirements of the user, after the user completes the creation of the corresponding target audio file, the audio playing module 600 may further use the audio player 4 or an external device to play the target audio file based on the playing requirements of the user.
As shown in fig. 5, in a third aspect, an embodiment of the present application provides an electronic device, which includes a memory 101 for storing one or more programs; a processor 102. The one or more programs, when executed by the processor 102, implement the method of any of the second aspects as described above.
Also included is a communication interface 103, and the memory 101, processor 102 and communication interface 103 are electrically connected to each other, directly or indirectly, to enable transfer or interaction of data. For example, the components may be electrically connected to each other via one or more communication buses or signal lines. The memory 101 may be used to store software programs and modules, and the processor 102 executes the software programs and modules stored in the memory 101 to thereby execute various functional applications and data processing. The communication interface 103 may be used for communicating signaling or data with other node devices.
The Memory 101 may be, but is not limited to, a Random Access Memory (RAM), a Read Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Read-Only Memory (EPROM), an electrically Erasable Read-Only Memory (EEPROM), and the like.
The processor 102 may be an integrated circuit chip having signal processing capabilities. The Processor 102 may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.
In the embodiments provided in the present application, it should be understood that the disclosed method and system and method can be implemented in other ways. The method and system embodiments described above are merely illustrative, for example, the flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of methods and systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
In a fourth aspect, embodiments of the present application provide a computer-readable storage medium, on which a computer program is stored, which, when executed by the processor 102, implements the method according to any one of the second aspects described above. The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above is only a preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes will occur to those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
It will be evident to those skilled in the art that the present application is not limited to the details of the foregoing illustrative embodiments, and that the present application may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the application being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.
Claims (10)
1. A point writing pen is characterized by comprising a pen body, a camera, an audio player, a controller and a memory, wherein the pen body comprises a pen point and a pen holder, a groove for placing the camera is formed in the pen point, a through hole for placing the controller and a storage device is formed in the pen holder, and an interface for connecting the controller with an external device is formed in the pen holder; the camera, the audio player and the storage device are respectively connected with the controller.
2. The stylus of claim 1, wherein the external device comprises one or more of a headset, a sound, a speaker, a USB device, a memory card, and a display.
3. A method for making an audio file based on a point pen is characterized by comprising the following steps:
acquiring and starting a point writing pen according to a user audio production request;
collecting and sending note writing video data of a user to a controller through a camera;
extracting key frame images of the note writing video data through a controller to obtain and identify and analyze the note writing key frame images to obtain character information and corresponding note information;
importing the note information into a preset audio generation model to obtain an initial audio file;
and generating a target audio file according to the text information and the initial audio file.
4. The method for creating an audio file according to claim 3, wherein the method for creating the target audio file from the text information and the initial audio file comprises the following steps:
extracting note association marks of each character in the character information and note association marks in the initial audio file;
and matching the character information with the initial audio file one by one according to the note association marks of the characters in the character information and the note association marks in the initial audio file to generate a target audio file.
5. The method for making an audio file based on a point pen as claimed in claim 3, further comprising the steps of:
and acquiring and sending the target audio file to an audio player or external equipment for audio playing according to the audio playing requirement of the user.
6. The utility model provides an audio file system of making based on point-writing pen which characterized in that, includes start module, data acquisition module, identification and analysis module, initial audio module and target audio making module, wherein:
the starting module is used for acquiring and starting the point writing pen according to the user audio production request;
the data acquisition module is used for acquiring and sending the note writing video data of the user to the controller through the camera;
the recognition analysis module is used for extracting key frame images of the note writing video data through the controller to obtain and perform recognition analysis on the note writing key frame images to obtain character information and corresponding note information;
the initial audio module is used for importing the note information into a preset audio generation model to obtain an initial audio file;
and the target audio making module is used for generating a target audio file according to the text information and the initial audio file.
7. The stylus-based audio file production system of claim 6, wherein the target audio production module comprises a tag extraction sub-module and a matching sub-module, wherein:
the mark extraction submodule is used for extracting the note association marks of all characters in the character information and the note association marks in the initial audio file;
and the matching submodule is used for matching the character information with the initial audio file one by one according to the note association marks of all characters in the character information and the note association marks in the initial audio file so as to generate a target audio file.
8. The system of claim 6, further comprising an audio playing module, configured to obtain and send the target audio file to an audio player or an external device for audio playing according to the audio playing requirement of the user.
9. An electronic device, comprising:
a memory for storing one or more programs;
a processor;
the one or more programs, when executed by the processor, implement the method of any of claims 3-5.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 3-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210469549.XA CN114816091A (en) | 2022-04-30 | 2022-04-30 | Point writing pen and audio file manufacturing method and system based on point writing pen |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210469549.XA CN114816091A (en) | 2022-04-30 | 2022-04-30 | Point writing pen and audio file manufacturing method and system based on point writing pen |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114816091A true CN114816091A (en) | 2022-07-29 |
Family
ID=82510043
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210469549.XA Pending CN114816091A (en) | 2022-04-30 | 2022-04-30 | Point writing pen and audio file manufacturing method and system based on point writing pen |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114816091A (en) |
-
2022
- 2022-04-30 CN CN202210469549.XA patent/CN114816091A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110659366A (en) | Semantic analysis method and device, electronic equipment and storage medium | |
| CN110909548A (en) | Chinese named entity recognition method and device and computer readable storage medium | |
| CN109343696B (en) | Electronic book commenting method and device and computer readable storage medium | |
| US20220392493A1 (en) | Video generation method, apparatus, electronic device, storage medium and program product | |
| CN110874534A (en) | Data processing method and data processing device | |
| CN109165316A (en) | A kind of method for processing video frequency, video index method, device and terminal device | |
| CN107885483A (en) | Method of calibration, device, storage medium and the electronic equipment of audio-frequency information | |
| CN106161873A (en) | A kind of video information extracts method for pushing and system | |
| CN113536172B (en) | Encyclopedia information display method and device and computer storage medium | |
| CN114598933A (en) | Video content processing method, system, terminal and storage medium | |
| CN105139698A (en) | Information input method and device of point reading machine | |
| CN106686226B (en) | Terminal audio playing method and system | |
| CN103279457A (en) | Method and device for generating diagram based on Excel | |
| CN112784529A (en) | Mobile terminal sorting table based on BetterScroll and construction method thereof | |
| CN111178455A (en) | Image clustering method, system, device and medium | |
| CN113516984A (en) | Sign language interaction method, system, equipment and storage medium | |
| KR102122918B1 (en) | Interactive question-anwering apparatus and method thereof | |
| CN112232059B (en) | Text error correction method and device, computer equipment and storage medium | |
| CN114816091A (en) | Point writing pen and audio file manufacturing method and system based on point writing pen | |
| TWI749045B (en) | Method, device and electronic equipment for automatically generating dubbing text | |
| CN106162328A (en) | A kind of video synchronizing information methods of exhibiting and system | |
| CN107229698A (en) | A kind of method and device of information processing | |
| CN115083222B (en) | Information interaction method and device, electronic equipment and storage medium | |
| CN111523541A (en) | Data generation method, system, equipment and medium based on OCR | |
| CN115565188B (en) | Writing pen, writing track recording method and system using writing pen |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |