CN107885483B - Audio information verification method and device, storage medium and electronic equipment - Google Patents

Audio information verification method and device, storage medium and electronic equipment Download PDF

Info

Publication number
CN107885483B
CN107885483B CN201711087239.7A CN201711087239A CN107885483B CN 107885483 B CN107885483 B CN 107885483B CN 201711087239 A CN201711087239 A CN 201711087239A CN 107885483 B CN107885483 B CN 107885483B
Authority
CN
China
Prior art keywords
information
character
distinguishing
text
audio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201711087239.7A
Other languages
Chinese (zh)
Other versions
CN107885483A (en
Inventor
王君龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201711087239.7A priority Critical patent/CN107885483B/en
Publication of CN107885483A publication Critical patent/CN107885483A/en
Application granted granted Critical
Publication of CN107885483B publication Critical patent/CN107885483B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/43Querying
    • G06F16/432Query formulation
    • G06F16/433Query formulation using audio data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/22Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Acoustics & Sound (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application discloses a method and a device for verifying audio information, a storage medium and electronic equipment, wherein the method comprises the following steps: acquiring a character image and recorded audio information corresponding to the character image; converting the recorded audio information into corresponding text information to obtain first text information; identifying the character information in the character image to obtain second character information; judging whether the first text information is the same as the second text information; and if not, prompting that the recorded audio information is wrong. And judging whether the character image is matched with the corresponding recorded audio information, and prompting if not.

Description

Audio information verification method and device, storage medium and electronic equipment
Technical Field
The present application belongs to the field of communications technologies, and in particular, to a method and an apparatus for verifying audio information, a storage medium, and an electronic device.
Background
The existing point reading equipment identifies and positions the point reading object according to the coordinate or code of the point reading object and other modes. The coding mode is a reading mode, codes are printed on a book, then the codes are identified by a reading pen to determine contents, and then corresponding audio is played according to the contents. The coordinate mode is that the position of the point reading machine is clicked by using the point reading pen to determine the coordinates, and corresponding audio is played in combination with the current page of the point reading machine after the coordinates are confirmed. Namely, the identification and positioning of the reading object can be realized by the aid of a reading pen or a reading machine. The reading machine or the reading pen can only simply play corresponding audio when the user clicks the reading object.
Disclosure of Invention
The application provides a method and a device for verifying audio information, a storage medium and an electronic device, which can judge the recorded audio information corresponding to a text image and further prompt whether the recorded audio is the same as the shot text image.
In a first aspect, an embodiment of the present application provides a method for verifying audio information, which is applied to an electronic device, and the method includes:
acquiring a character image and recorded audio information corresponding to the character image;
converting the recorded audio information into corresponding text information to obtain first text information;
identifying the character information in the character image to obtain second character information;
judging whether the first text information is the same as the second text information;
and if not, prompting that the recorded audio information is wrong.
In a second aspect, an embodiment of the present application provides an apparatus for verifying audio information, where the apparatus includes:
the recording acquisition unit is used for acquiring the text image and the recorded audio information corresponding to the text image;
the first character acquisition unit is used for converting the recorded audio information into corresponding character information to obtain first character information;
the second character acquisition unit is used for identifying the character information in the character image to obtain second character information;
the judging unit is used for judging whether the first character information is the same as the second character information;
and the prompting unit is used for prompting that the recorded audio information is wrong if the first character information is different from the second character information.
In a third aspect, an embodiment of the present application provides a storage medium, on which a computer program is stored, and when the computer program runs on a computer, the computer is caused to execute the above-mentioned audio information verification method.
In a fourth aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, where the memory has a computer program, and the processor is configured to execute the method for verifying audio information by calling the computer program.
According to the method, the device, the storage medium and the electronic equipment for verifying the audio information, the character image and the recorded audio information corresponding to the character image are obtained; converting the recorded audio information into corresponding text information to obtain first text information; identifying the character information in the character image to obtain second character information; judging whether the first text information is the same as the second text information; and if not, prompting that the recorded audio information is wrong. When the electronic equipment is used for realizing point reading, whether the text images are matched with the corresponding recorded audio information is judged, and if not, prompt is given.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings used in the description of the embodiments will be briefly introduced below. It is obvious that the drawings in the following description are only some embodiments of the application, and that for a person skilled in the art, other drawings can be derived from them without inventive effort.
Fig. 1 is a schematic view of an application scenario of an apparatus for verifying audio information according to an embodiment of the present application;
fig. 2 is a schematic flowchart of a method for verifying audio information according to an embodiment of the present application;
fig. 3 is another schematic flowchart of a method for verifying audio information according to an embodiment of the present application;
fig. 4 is a schematic flowchart of another method for verifying audio information according to an embodiment of the present application;
fig. 5 is a schematic flow chart of a method for verifying audio information according to an embodiment of the present application;
fig. 6 is a schematic flow chart illustrating obtaining of pre-stored text information according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of a first apparatus for verifying audio information according to an embodiment of the present disclosure;
fig. 8 is a schematic structural diagram of a second apparatus for verifying audio information according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of a third apparatus for verifying audio information according to an embodiment of the present application;
fig. 10 is a schematic diagram of a fourth structure of an apparatus for verifying audio information according to an embodiment of the present application;
fig. 11 is a schematic structural diagram of a fifth apparatus for verifying audio information according to an embodiment of the present application;
fig. 12 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;
fig. 13 is another schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
Referring to the drawings, wherein like reference numbers refer to like elements, the principles of the present application are illustrated as being implemented in a suitable computing environment. The following description is in terms of particular embodiments of the application illustrated and should not be taken as limiting the application to other embodiments not described in detail herein.
In the description that follows, specific embodiments of the present application will be described with reference to steps and symbols executed by one or more computers, unless otherwise indicated. Accordingly, these steps and operations will be referred to, several times, as being performed by a computer, the computer performing operations involving a processing subunit of the computer processing represented by electronic signals representing data in a structured form. This operation transforms the data or maintains it at locations in the computer's memory system, which may be reconfigured or otherwise altered in a manner well known to those skilled in the art. The data maintains a data structure that is a physical location of the memory that has particular characteristics defined by the data format. However, while the principles of the application have been described in language specific to above, it is not intended to be limited to the specific form set forth herein, and it will be recognized by those of ordinary skill in the art that various of the steps and operations described below may be implemented in hardware.
The term "unit" as used herein may be considered a software object executing on the computing system. The various components, units, engines, and services described herein may be viewed as objects of implementation on the computing system. The apparatus and method described herein may be implemented in software, but may also be implemented in hardware, and are within the scope of the present application.
The terms "first", "second", and "third", etc. in this application are used to distinguish between different objects and not to describe a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but rather, some embodiments may include other steps or elements not listed or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
In an embodiment, the terminal may first obtain a click-to-read sample, where the click-to-read sample may be a shot photo or an acquired text picture. After the click-to-read sample is obtained, the terminal may obtain a multimedia sample, which is a recorded audio file or video file. The terminal may then associate the retrieved click-to-read sample with the multimedia sample. For example, the terminal associates photo a with audio a, photo B with audio B, and photo C with video C. After associating the click-to-read sample with the multimedia sample, the terminal may store the sample data in a preset database.
It is to be understood that, in some embodiments, the click-to-read sample and the multimedia sample may be in a one-to-one correspondence relationship, a one-to-many relationship, a many-to-one relationship, or the like, which is not specifically limited in this embodiment.
When the click-to-read function is used, a user can firstly use the mobile terminal to shoot a photo or select a photo from an album. The photo taken by the user or the selected photo is the object to be read. After the object needing to be read is acquired, the terminal can search the photo matched with the object needing to be read in the preset database. If the photo matched with the object needing to be read exists in the preset database, the terminal can search the multimedia file associated with the photo, and the multimedia file is played.
In one embodiment, for example, the sample is a photograph a containing three text segments, each of which is associated with a segment of audio. Then, when the photo shot by the user is matched with the photo a in the preset database, since the photo a contains three sections of characters and each section of character is associated with a corresponding section of audio, the user can select to play the corresponding audio by specifically selecting a certain section of character in the photo a. Or, the user may not make a specific selection, and then the terminal may play the audio corresponding to the three paragraphs of characters in sequence.
Referring to fig. 1, for example, a user uses a terminal to take a picture X, and the terminal finds that the picture X matches the picture a in a preset database. The photo A comprises three sections of characters, wherein the first section of characters is associated with the audio A, the second section of characters is associated with the audio B, and the third section of characters is associated with the audio C. For example, as shown in fig. 1, if the user circles the area of the second text on the screen, the terminal may play audio b accordingly.
It can be understood that the embodiment can realize the function of reading the text in a certain object (such as a photo) on the mobile terminal, and the mode has the advantages of low cost, good convenience and the like.
It can be understood that the execution subject of the embodiment of the present application may be a terminal device such as a smart phone or a tablet computer.
The embodiment of the application provides a method for verifying audio information, an execution main body of the method for verifying audio information may be a device for verifying audio information provided by the embodiment of the application, or an electronic device integrated with the device for verifying audio information, wherein the device for verifying audio information may be implemented in a hardware or software manner.
The embodiments of the present application will be described from the perspective of a verification apparatus for audio information, which may be specifically integrated in an electronic device. The audio information verification method comprises the following steps: acquiring character images and recorded audio information corresponding to the character images; converting the recorded audio information into corresponding text information to obtain first text information; identifying the character information in the character image to obtain second character information; judging whether the first character information is the same as the second character information; if not, prompting that the recorded audio information is wrong.
Specifically, please refer to fig. 2, and fig. 2 is a flowchart illustrating a method for verifying audio information according to an embodiment of the present disclosure. The audio information verification method provided by the embodiment of the application is applied to electronic equipment, and the specific process can be as follows:
step 101, acquiring a text image and recorded audio information corresponding to the text image.
The text image comprises text information, and specifically can comprise a character, a word, a sentence, a poem, a segment of text, an article and the like. The text image (e.g., the object to be clicked and read) may be captured by shooting, such as by using a smart phone, a tablet computer, a digital camera, or the like, or may be captured by other means, such as downloading via a network, calling from a photo library, or transmitting from other electronic devices. And then recording multimedia information corresponding to the character images, wherein the multimedia information comprises audio information corresponding to the character information of the character images. For example, a user first takes a picture of a short sentence through a smart phone, the picture is a text image, then the user reads the short sentence aloud, and records a reading audio of the user, wherein the reading audio is recorded audio information.
Step 102, converting the recorded audio information into corresponding text information to obtain first text information.
And converting the recorded audio information into corresponding text information through audio identification software, and then obtaining first text information. The recorded audio information may be a single audio file, and then the voice information of the recorded audio information is converted into text information. Or extracting the recorded audio information from the recorded video information and converting the recorded audio information into character information.
And 103, identifying the character information in the character image to obtain second character information.
And identifying the character information in the character image through image identification software, and then obtaining second character information. The character information in the character image can be recognized by, for example, light-dark contrast of the character image.
And 104, judging whether the first character information is the same as the second character information.
And comparing the first character information with the second character information to judge whether the first character information and the second character information are the same. The characters in the first character information and the second character information can be compared one by one in sequence.
And 105, if the first character information is different from the second character information, prompting that the recorded audio information is wrong.
There are many methods for prompting the recording of the audio information error, including voice prompt, such as playing the voice information of "audio and image disagreement"; the light prompt, such as the flashing of an LED lamp on the electronic equipment, the constant illumination of a red LED and the like, can also be a text prompt, such as a prompt box popped up on a display screen of the electronic equipment, and text information of 'inconsistent audio frequency and image' is displayed in the prompt box.
Referring to fig. 3, fig. 3 is another schematic flow chart illustrating a method for verifying audio information according to an embodiment of the present disclosure. In this embodiment, the method for prompting that the recorded audio information is incorrect includes the following steps:
step 201, acquiring the distinguishing text information different from the first text information in the second text information.
Firstly, the distinguishing character information different from the first character information is found out from the second character information. Specifically, different characters can be found out by comparing the characters of the second character information with the characters of the first character information one by one. If a plurality of different characters are adjacent, the adjacent characters are combined to obtain the information of the distinguished characters.
Step 202, setting prompt information according to the corresponding position of the distinguished text information in the text image to prompt that the recorded audio information is wrong.
Firstly, the position of the distinguishing character information in the character image is obtained, namely when the character image is displayed on a display screen of the electronic equipment, the position of the distinguishing character information displayed on the display screen is obtained, and then the prompt information is set corresponding to the position. There are many ways to set the prompt information, for example, adding underlines below the distinguishing text information, adding boxes corresponding to the distinguishing text information, changing the color of the distinguishing text information, setting a prompt box in the blank area, and connecting the prompt box with the distinguishing text through lines, etc.
Referring to fig. 4, fig. 4 is a schematic flowchart illustrating a verification method of audio information according to an embodiment of the present disclosure. In this embodiment, the method for setting the prompt information according to the corresponding position of the distinguished text information in the text image includes the following steps:
step 221, selecting the replacement text information corresponding to the distinguishing text information from the first text information.
The character information different from the second character information in the first character information is the replacement character information, and the replacement character information corresponds to the distinguishing character information.
Step 222, one of the distinguishing text information and the replacing information is used as the text information to be displayed.
And selecting one message from the distinguishing text message and the replacing message as the text message to be displayed.
Specifically, a first frequency of appearance of the replacement text in the first text information may be obtained, and a second frequency of appearance of the text in the second text information may be distinguished; and then selecting character information to be displayed with higher frequency from the distinguishing character information and the replacing information according to the first frequency and the second frequency.
But may be selected by other methods. For example, the consistency between the distinguished text information and the context is identified, the consistency between the replaced text information and the context is identified, and then the consistency between the two is compared, wherein the consistency is better to be the text information to be displayed.
The semantic meanings between the text information and the context can be distinguished, the semantic meanings between the text information and the context can be replaced, the rationality of the semantic meanings between the text information and the context is compared, and the text information to be displayed is better in rationality.
And 223, displaying the text information to be displayed on the display area corresponding to the position for distinguishing the text information, and setting prompt information.
On a display screen of the electronic equipment, acquiring display positions for distinguishing character information, then displaying the character information to be displayed, and simultaneously setting prompt information. If the text information to be displayed is the distinguishing text information, only the prompt information needs to be set.
If the character information to be displayed is the replacement character information, the position of the character information to be distinguished can be covered by the color with the same ground color as the character image to enable the position to become a blank display area, and then the replacement character information is displayed at the position. The position of the distinguished character information and the boundary range of the distinguished character information can be obtained firstly, then the image of the replaced character information is obtained, the size of the image is matched with the boundary range of the distinguished character information, and the image is covered at the position of the distinguished character information. The image of the replacement text information is obtained, the corresponding text image can be found by searching the database according to the replacement text information, and then the corresponding image is intercepted according to the boundary range of the distinguished text information, wherein the image comprises the replacement text information. And finally, setting prompt information and associating the prompt information with the replacement character information.
Referring to fig. 5, fig. 5 is a schematic flow chart of a verification method of audio information according to an embodiment of the present application. In this embodiment, the method further comprises the steps of:
step 301, pre-stored text information containing the distinguishing text information is obtained.
From the database, pre-stored text information including distinctive text information, which may be a word, a sentence, etc., is searched.
Step 302, pre-stored audio information corresponding to the pre-stored character information is obtained.
After the pre-stored character information including the distinguished character information is found, the pre-stored audio information corresponding to the pre-stored character information is found through the pre-stored character information.
Step 303, extracting first audio data corresponding to the distinguished text information from the pre-stored audio information.
After the pre-stored audio information is found, the first audio data corresponding to the different text information is found from the pre-stored audio information and then extracted.
And 304, replacing the first audio data with second audio data corresponding to the replacement text information in the recorded audio information.
And finding out second audio data corresponding to the replacement text information from the recorded audio information, and then replacing the second audio data with the first audio data. Therefore, the characters of the character images can be accurately corresponding to the audio frequency of the recorded audio information.
Referring to fig. 6, fig. 6 is a schematic view illustrating a process of acquiring pre-stored text information according to an embodiment of the present application. In this embodiment, the method for obtaining pre-stored text information includes the following steps:
and 311, acquiring the number of the distinguishing characters included in the distinguishing character information, and if the number of the distinguishing characters is greater than or equal to 2, determining the number of the interval characters between the two distinguishing characters in the distinguishing character information.
In step 312, if the number of the text intervals is less than the preset number of the text, the two distinct texts and the text between the two distinct texts are formed into a distinct text string.
Step 313, searching in the database according to the distinguishing character string to obtain the pre-stored character information including the distinguishing character string.
The audio data replaced is obtained through a plurality of characters, so that the recorded audio information can be more coherent. If the character string is distinguished to be a complete sentence, an obvious break gap exists between the corresponding audio and the front and back audio, so that the corresponding audio data can be conveniently obtained, the corresponding audio data can be broken from the two break gaps, the replacement is convenient, and the transition is natural.
According to the audio information verification method provided by the embodiment of the application, the character images and the recorded audio information corresponding to the character images are obtained; converting the recorded audio information into corresponding text information to obtain first text information; identifying the character information in the character image to obtain second character information; judging whether the first character information is the same as the second character information; if not, prompting that the recorded audio information is wrong. And judging whether the character image is matched with the corresponding recorded audio information, and prompting if not.
In order to better implement the audio information verification method provided by the embodiment of the present application, an embodiment of the present application further provides an audio information verification apparatus. The meaning of the noun is the same as the verification method of the audio information, and the specific implementation details can refer to the description in the method embodiment.
Referring to fig. 7, fig. 7 is a schematic view illustrating a first structure of an apparatus for verifying audio information according to an embodiment of the present application. The audio information verification device 500 includes a recording obtaining unit 501, a first character obtaining unit 502, a second character obtaining unit 503, a determining unit 505, and a prompting unit 505. Wherein:
the recording acquiring unit 501 is configured to acquire a text image and recorded audio information corresponding to the text image.
The text image comprises text information, and specifically can comprise a character, a word, a sentence, a poem, a segment of text, an article and the like. The text image can be obtained by shooting, such as shooting through a smart phone, a tablet computer, a digital camera and the like, or can be obtained by other modes, such as downloading through a network, calling in a picture library and transmitting through other electronic equipment. And then recording multimedia information corresponding to the character images, wherein the multimedia information comprises audio information corresponding to the character information of the character images. For example, a user first takes a picture of a short sentence through a smart phone, the picture is a text image, then the user reads the short sentence aloud, and records a reading audio of the user, wherein the reading audio is recorded audio information.
The first text acquiring unit 502 is configured to convert the recorded audio information into corresponding text information, so as to obtain first text information.
And converting the recorded audio information into corresponding text information through audio identification software, and then obtaining first text information. The recorded audio information may be a single audio file, and then the voice information of the recorded audio information is converted into text information. Or extracting the recorded audio information from the recorded video information and converting the recorded audio information into character information.
The second character obtaining unit 503 is configured to identify character information in the character image to obtain second character information.
And identifying the character information in the character image through image identification software, and then obtaining second character information. The character information in the character image can be recognized by, for example, light-dark contrast of the character image.
The determining unit 504 is configured to determine whether the first text information is the same as the second text information.
And comparing the first character information with the second character information to judge whether the first character information and the second character information are the same. The characters in the first character information and the second character information can be compared one by one in sequence.
The prompting unit 505 is configured to prompt that the recorded audio information is incorrect if the first text information is different from the second text information.
There are many methods for prompting the recording of the audio information error, including voice prompt, such as playing the voice information of "audio and image disagreement"; the light prompt, such as the flashing of an LED lamp on the electronic equipment, the constant illumination of a red LED and the like, can also be a text prompt, such as a prompt box popped up on a display screen of the electronic equipment, and text information of 'inconsistent audio frequency and image' is displayed in the prompt box.
Referring to fig. 8, fig. 8 is a schematic structural diagram of a second exemplary embodiment of an apparatus for verifying audio information. In the present embodiment, the presentation unit 505 includes:
a difference character acquisition sub-unit 5051 is configured to acquire difference character information, which is different from the first character information, in the second character information.
Firstly, the distinguishing character information different from the first character information is found out from the second character information. Specifically, different characters can be found out by comparing the characters of the second character information with the characters of the first character information one by one. If a plurality of different characters are adjacent, the adjacent characters are combined to obtain the information of the distinguished characters.
A prompt sub-unit 5052, configured to set a prompt message according to the corresponding position of the distinguished text message in the text image, so as to prompt that the recorded audio information is incorrect.
Firstly, the position of the distinguishing character information in the character image is obtained, namely when the character image is displayed on a display screen of the electronic equipment, the position of the distinguishing character information displayed on the display screen is obtained, and then the prompt information is set corresponding to the position. There are many ways to set the prompt information, for example, adding underlines below the distinguishing text information, adding boxes corresponding to the distinguishing text information, changing the color of the distinguishing text information, setting a prompt box in the blank area, and connecting the prompt box with the distinguishing text through lines, etc.
Referring to fig. 9, fig. 9 is a schematic structural diagram of a third exemplary embodiment of an apparatus for verifying audio information. In this embodiment, the prompt unit 505 further includes a substitute text acquisition sub-unit 5053, a text determination sub-unit 5054 to be displayed, and a prompt sub-unit 5052. Wherein:
a replaced text acquiring sub-unit 5053 is configured to select, from the first text information, replaced text information corresponding to the distinguished text information.
The character information different from the second character information in the first character information is the replacement character information, and the replacement character information corresponds to the distinguishing character information.
A text to be displayed determination subunit 5054 is configured to use one of the distinguished text information and the replacement information as text information to be displayed.
And selecting one message from the distinguishing text message and the replacing message as the text message to be displayed.
In some embodiment modes, the prompting unit further includes a frequency acquiring subunit, where the frequency acquiring subunit is configured to acquire a first frequency of appearance of the replacement text in the first text information, and distinguish a second frequency of appearance of the text in the second text information; and the prompting subunit is further used for selecting the character information to be displayed with higher frequency from the distinguishing character information and the replacing information according to the first frequency and the second frequency.
But may be selected by other methods. For example, the consistency between the text information and the context is identified and distinguished, the consistency between the text information and the context is replaced, and then the consistency between the text information and the context is compared, wherein the consistency is better to be the text information to be displayed.
The semantics between the text information and the context can be replaced by distinguishing the semantics between the text information and the context, and then the rationality of the semantics between the text information and the context is compared, so that the text information to be displayed has better rationality.
The prompt subunit 5052 is further configured to display the text information to be displayed on the display area corresponding to the position where the text information is distinguished, and set the prompt information.
On a display screen of the electronic equipment, acquiring display positions for distinguishing character information, then displaying the character information to be displayed, and simultaneously setting prompt information. If the text information to be displayed is the distinguishing text information, only the prompt information needs to be set.
If the character information to be displayed is the replacement character information, the position of the character information to be distinguished can be covered by the color with the same ground color as the character image to enable the position to become a blank display area, and then the replacement character information is displayed at the position. The position of the distinguished character information and the boundary range of the distinguished character information can be obtained firstly, then the image of the replaced character information is obtained, the size of the image is matched with the boundary range of the distinguished character information, and the image is covered at the position of the distinguished character information. The image of the replacement text information is obtained, the corresponding text image can be found by searching the database according to the replacement text information, and then the corresponding image is intercepted according to the boundary range of the distinguished text information, wherein the image comprises the replacement text information. And finally, setting prompt information and associating the prompt information with the replacement character information.
Referring to fig. 10, fig. 10 is a schematic diagram illustrating a fourth structure of an apparatus for verifying audio information according to an embodiment of the present application. In this embodiment, the apparatus 500 for acquiring audio information further includes a pre-stored text acquiring unit 506, a pre-stored audio acquiring unit 507, an extracting audio unit 508, and a replacing audio unit 509. Wherein:
a pre-stored text acquiring unit 506, configured to acquire pre-stored text information containing the distinguishing text information.
From the database, pre-stored text information including distinctive text information, which may be a word, a sentence, etc., is searched.
A pre-stored audio obtaining unit 507, configured to obtain pre-stored audio information corresponding to the pre-stored text information.
After the pre-stored character information including the distinguished character information is found, the pre-stored audio information corresponding to the pre-stored character information is found through the pre-stored character information.
The audio extracting unit 508 is configured to extract first audio data corresponding to the text information from the pre-stored audio information.
After the pre-stored audio information is found, the first audio data corresponding to the different text information is found from the pre-stored audio information and then extracted.
The replacing audio unit 509 is configured to replace and record the second audio data corresponding to the distinguished text information in the audio information with the first audio data.
And finding out second audio data corresponding to the replacement text information from the recorded audio information, and then replacing the second audio data with the first audio data. Therefore, the characters of the character images can be accurately corresponding to the audio frequency of the recorded audio information.
Referring to fig. 11, fig. 11 is a fifth structural schematic diagram of an apparatus for verifying audio information according to an embodiment of the present application. In the present embodiment, the pre-stored character retrieving unit 506 includes a first determining sub-unit 5061, a second determining sub-unit 5062, a character string retrieving sub-unit 5063, and a pre-stored character retrieving sub-unit 5064. Wherein:
the first determining subunit 5061 is configured to determine the number of the difference characters included in the difference character information.
A second determining subunit 5062, configured to determine, if the number of the distinguished characters is greater than or equal to 2, the number of the spaced characters between two distinguished characters in the distinguished character information;
a character string acquiring subunit 5063, configured to form a distinguishing character string from the two distinguishing characters and the characters between the two distinguishing characters if the number of character intervals is less than the preset number of characters;
the pre-stored character acquiring subunit 5064 is configured to search in the database according to the distinct character string to obtain pre-stored character information including the distinct character string.
The audio data replaced is obtained through a plurality of characters, so that the recorded audio information can be more coherent. If the character string is distinguished to be a complete sentence, an obvious break gap exists between the corresponding audio and the front and back audio, so that the corresponding audio data can be conveniently obtained, the corresponding audio data can be broken from the two break gaps, the replacement is convenient, and the transition is natural.
The audio information verifying device provided by the embodiment of the application obtains the character images and the recorded audio information corresponding to the character images; converting the recorded audio information into corresponding text information to obtain first text information; identifying the character information in the character image to obtain second character information; judging whether the first character information is the same as the second character information; if not, prompting that the recorded audio information is wrong. And judging whether the character image is matched with the corresponding recorded audio information, and prompting if not.
In specific implementation, the above modules may be implemented as independent entities, or may be combined arbitrarily to be implemented as the same or several entities, and specific implementation of the above modules may refer to the foregoing method embodiments, which are not described herein again.
In the embodiment of the present application, the audio information verification apparatus and the audio information verification method in the above embodiments belong to the same concept, and any method provided in the audio information verification method embodiment may be run on the audio information verification apparatus, and a specific implementation process thereof is described in detail in the embodiment of the audio information verification method, and is not described herein again.
The embodiment of the application also provides the electronic equipment. Referring to fig. 12, the electronic device 600 includes a processor 601 and a memory 602. The processor 601 is electrically connected to the memory 602.
The processor 600 is a control center of the electronic device 600, connects various parts of the entire electronic device using various interfaces and lines, performs various functions of the electronic device 600 by running or loading a computer program stored in the memory 602, and calls data stored in the memory 602, and processes the data, thereby performing overall monitoring of the electronic device 600.
The memory 602 may be used for storing software programs and units, and the processor 601 executes various functional applications and data processing by running the computer programs and units stored in the memory 602. The memory 602 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, a computer program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data created according to use of the electronic device, and the like. Further, the memory 602 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 602 may also include a memory controller to provide the processor 601 with access to the memory 602.
In the embodiment of the present application, the processor 601 in the electronic device 600 loads instructions corresponding to one or more processes of the computer program into the memory 602 according to the following steps, and the processor 601 runs the computer program stored in the memory 602, thereby implementing various functions as follows:
acquiring character images and recorded audio information corresponding to the character images;
converting the recorded audio information into corresponding text information to obtain first text information;
identifying the character information in the character image to obtain second character information;
judging whether the first character information is the same as the second character information;
if not, prompting that the recorded audio information is wrong.
In some embodiments, the processor 601 is further configured to perform the following steps:
acquiring different text information which is different from the first text information in the second text information;
and setting prompt information according to the corresponding position of the distinguished character information in the character image so as to prompt that the recorded audio information is wrong.
In some embodiments, the first parameter comprises a plurality of sub-parameters, and the processor 601 is further configured to perform the following steps:
selecting replacement character information corresponding to the distinguishing character information from the first character information;
one of the distinguishing character information and the replacing information is used as character information to be displayed;
and displaying the character information to be displayed on the display area corresponding to the position for distinguishing the character information, and setting prompt information.
In some embodiments, the processor 601 is further configured to perform the following steps:
acquiring a first frequency of appearance of the replacement characters in the first character information and distinguishing a second frequency of appearance of the characters in the second character information;
and selecting character information to be displayed with higher frequency from the distinguishing character information and the replacing information according to the first frequency and the second frequency.
In some embodiments, the processor 601 is further configured to perform the following steps:
acquiring prestored character information containing the distinguishing character information;
acquiring prestored audio information corresponding to prestored character information;
extracting first audio data corresponding to the different text information from prestored audio information;
and replacing and recording second audio data corresponding to the different text information in the audio information with the first audio data.
In some embodiments, the processor 601 is further configured to perform the following steps:
determining the number of the distinguishing characters included in the distinguishing character information, and if the number of the distinguishing characters is more than or equal to 2, determining the number of the interval characters between the two distinguishing characters in the distinguishing character information;
if the number of the character intervals is less than the preset number of the characters, forming a distinguishing character string by the two distinguishing characters and the characters between the two distinguishing characters;
and searching in the database according to the distinguishing character string to obtain the pre-stored character information comprising the distinguishing character string.
As can be seen from the above, the electronic device provided in the embodiment of the present application obtains the text image and the recorded audio information corresponding to the text image; converting the recorded audio information into corresponding text information to obtain first text information; identifying the character information in the character image to obtain second character information; judging whether the first character information is the same as the second character information; if not, prompting that the recorded audio information is wrong. And judging whether the character image is matched with the corresponding recorded audio information, and prompting if not.
Referring also to fig. 13, in some embodiments, the electronic device 600 may further include: a display 603, a radio frequency circuit 604, an audio circuit 605, and a power supply 606. The display 603, the rf circuit 604, the audio circuit 605 and the power supply 606 are electrically connected to the processor 601, respectively.
The display 603 may be used to display information entered by or provided to the user as well as various graphical user interfaces, which may be made up of graphics, text, icons, video, and any combination thereof. The Display 603 may include a Display panel, and in some embodiments, the Display panel may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
The rf circuit 604 may be used for transceiving rf signals to establish wireless communication with a network device or other electronic devices through wireless communication, and for transceiving signals with the network device or other electronic devices.
The audio circuit 605 may be used to provide an audio interface between the user and the electronic device through a speaker, microphone.
The power supply 606 may be used to power various components of the electronic device 600. In some embodiments, the power supply 606 may be logically connected to the processor 601 through a power management system, so as to implement functions of managing charging, discharging, and power consumption management through the power management system.
Although not shown in fig. 13, the electronic device 600 may further include a camera, a bluetooth unit, and the like, which are not described in detail herein.
An embodiment of the present application further provides a storage medium, where the storage medium stores a computer program, and when the computer program runs on a computer, the computer is caused to execute the application program management and control method in any one of the above embodiments, for example: acquiring a character image and recording audio information corresponding to the character image; converting the recorded audio information into corresponding text information to obtain first text information; identifying the character information in the character image to obtain second character information; judging whether the first character information is the same as the second character information; if not, prompting that the recorded audio information is wrong.
In the embodiment of the present application, the storage medium may be a magnetic disk, an optical disk, a Read Only Memory (ROM), a Random Access Memory (RAM), or the like.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
It should be noted that, for the audio information verification method in the embodiment of the present application, it can be understood by a person skilled in the art that all or part of the process for implementing the audio information verification method in the embodiment of the present application can be completed by controlling the relevant hardware through a computer program, where the computer program can be stored in a computer-readable storage medium, such as a memory of an electronic device, and executed by at least one processor in the electronic device, and during the execution process, the process of the embodiment of the audio information verification method can be included. The storage medium may be a magnetic disk, an optical disk, a read-only memory, a random access memory, etc.
For the audio information verification apparatus in the embodiment of the present application, each functional unit may be integrated in one processing chip, or each unit may exist alone physically, or two or more units are integrated in one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. The integrated unit, if implemented as a software functional unit and sold or used as a stand-alone product, may also be stored in a computer readable storage medium, such as a read-only memory, a magnetic or optical disk, or the like.
The method, the apparatus, the storage medium, and the electronic device for verifying audio information provided in the embodiments of the present application are described in detail above, and a specific example is applied in the present application to explain the principle and the implementation of the present application, and the description of the above embodiments is only used to help understand the method and the core idea of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (10)

1. A method for verifying audio information is applied to electronic equipment, and is characterized by comprising the following steps:
acquiring a character image and recorded audio information corresponding to the character image;
converting the recorded audio information into corresponding text information to obtain first text information;
identifying the character information in the character image to obtain second character information;
judging whether the first text information is the same as the second text information;
if the difference is not the same, acquiring the distinguishing character information which is different from the first character information in the second character information, and setting prompt information according to the corresponding position of the distinguishing character information in the character image so as to prompt that the recorded audio information is wrong;
acquiring prestored character information containing the distinguishing character information;
acquiring pre-stored audio information corresponding to the pre-stored character information;
extracting first audio data corresponding to the distinguishing character information from the pre-stored audio information;
and replacing the first audio data with second audio data corresponding to replacement text information in the recorded audio information, wherein the replacement text information is text information corresponding to the distinguishing text information in the first text information.
2. The method for verifying audio information according to claim 1, wherein the step of setting a prompt message according to the corresponding position of the distinguishing text message in the text image includes:
selecting replacement character information corresponding to the distinguishing character information from the first character information;
taking one of the distinguishing character information and the replacing information as character information to be displayed;
and displaying the character information to be displayed on a display area corresponding to the position of the distinguished character information, and setting the prompt information.
3. The method for verifying audio information according to claim 2, wherein the step of using one of the distinguishing textual information and the replacement information as textual information to be displayed includes:
acquiring a first frequency of the replacement characters appearing in the first character information and a second frequency of the distinguishing characters appearing in the second character information;
and selecting character information to be displayed with higher frequency from the distinguishing character information and the replacing information according to the first frequency and the second frequency.
4. The method for verifying audio information according to claim 1, wherein the step of obtaining pre-stored text information containing the distinctive text information comprises:
determining the number of the distinguishing characters included in the distinguishing character information, and if the number of the distinguishing characters is greater than or equal to 2, determining the number of the interval characters between two distinguishing characters in the distinguishing character information;
if the number of the character intervals is less than the preset number of characters, forming a distinguishing character string by the two distinguishing characters and the characters between the two distinguishing characters;
and searching in a database according to the distinguishing character string to obtain pre-stored character information comprising the distinguishing character string.
5. An apparatus for verifying audio information, the apparatus comprising:
the recording acquisition unit is used for acquiring the text image and the recorded audio information corresponding to the text image;
the first character acquisition unit is used for converting the recorded audio information into corresponding character information to obtain first character information;
the second character acquisition unit is used for identifying the character information in the character image to obtain second character information;
the judging unit is used for judging whether the first character information is the same as the second character information;
a prompt unit comprising: a distinguishing character acquisition subunit, configured to acquire, from the second character information, distinguishing character information that is different from the first character information; the prompting subunit is used for setting prompting information according to the corresponding position of the distinguishing character information in the character image so as to prompt that the recorded audio information is wrong;
a pre-stored character acquisition unit for acquiring pre-stored character information containing the distinguishing character information;
the pre-stored audio acquisition unit is used for acquiring pre-stored audio information corresponding to the pre-stored character information;
the extraction audio unit is used for extracting first audio data corresponding to the distinguishing character information from the prestored audio information;
and the replacement audio unit is used for replacing the first audio data with second audio data corresponding to replacement text information in the recorded audio information, wherein the replacement text information is text information corresponding to the distinguishing text information in the first text information.
6. The apparatus for verifying audio information according to claim 5, wherein the cue unit further comprises:
a replacement character acquisition subunit, configured to select, from the first character information, replacement character information corresponding to the distinguished character information;
a text to be displayed determining subunit, configured to use one of the distinguishing text information and the replacement information as text information to be displayed;
the prompt subunit is further configured to display the text information to be displayed on the display area corresponding to the position of the text information to be distinguished, and set the prompt information.
7. The apparatus for verifying audio information according to claim 6, wherein the cue unit further comprises:
a frequency obtaining subunit, configured to obtain a first frequency of the appearance of the replacement word in the first word information, and a second frequency of the appearance of the distinction word in the second word information;
and the prompt subunit is further configured to select, according to the first frequency and the second frequency, text information to be displayed with a higher frequency from the distinguishing text information and the replacement information.
8. The apparatus for verifying audio information according to claim 5, wherein the pre-stored text acquiring unit comprises:
a first determining subunit, configured to determine the number of the distinct characters included in the distinct character information,
the second determining subunit is configured to determine, if the number of the distinct characters is greater than or equal to 2, the number of the spaced characters between two distinct characters in the distinct character information;
a character string obtaining subunit, configured to form a distinguishing character string from the two distinguishing characters and the characters between the two distinguishing characters if the number of the character intervals is less than a preset number of characters;
and the pre-stored character acquisition subunit is used for searching in a database according to the distinguishing character strings to obtain pre-stored character information comprising the distinguishing character strings.
9. A storage medium having stored thereon a computer program, characterized in that, when the computer program is run on a computer, it causes the computer to execute a method of verifying audio information according to any one of claims 1 to 4.
10. An electronic device comprising a processor and a memory, said memory having a computer program, wherein said processor is adapted to execute the method of verifying audio information according to any one of claims 1 to 4 by calling said computer program.
CN201711087239.7A 2017-11-07 2017-11-07 Audio information verification method and device, storage medium and electronic equipment Expired - Fee Related CN107885483B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711087239.7A CN107885483B (en) 2017-11-07 2017-11-07 Audio information verification method and device, storage medium and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711087239.7A CN107885483B (en) 2017-11-07 2017-11-07 Audio information verification method and device, storage medium and electronic equipment

Publications (2)

Publication Number Publication Date
CN107885483A CN107885483A (en) 2018-04-06
CN107885483B true CN107885483B (en) 2021-03-02

Family

ID=61779242

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711087239.7A Expired - Fee Related CN107885483B (en) 2017-11-07 2017-11-07 Audio information verification method and device, storage medium and electronic equipment

Country Status (1)

Country Link
CN (1) CN107885483B (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7176272B2 (en) * 2018-07-26 2022-11-22 富士フイルムビジネスイノベーション株式会社 Information processing device and program
CN109872714A (en) * 2019-01-25 2019-06-11 广州富港万嘉智能科技有限公司 A kind of method, electronic equipment and storage medium improving accuracy of speech recognition
CN109658759A (en) * 2019-02-26 2019-04-19 安康学院 A kind of novel electrician's electronic experimental reports and appraisal system
CN112087653A (en) * 2020-09-18 2020-12-15 北京搜狗科技发展有限公司 Data processing method and device and electronic equipment
CN113722513B (en) * 2021-09-06 2022-12-20 抖音视界有限公司 Multimedia data processing method and equipment
CN114139216B (en) * 2021-12-06 2024-08-13 安天科技集团股份有限公司 Data verification method and device, electronic equipment and storage medium
CN115457957A (en) * 2022-08-25 2022-12-09 维沃移动通信有限公司 Voice information display method and device

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009187352A (en) * 2008-02-07 2009-08-20 Forex Co Ltd Document data verification method and document data verification support system
CN103442196A (en) * 2013-08-16 2013-12-11 福建省物联网科学研究院 Video recording method based on vector coding and applied to touch screen device
CN104008088A (en) * 2014-01-20 2014-08-27 广东小天才科技有限公司 Reading assisting method and device based on screen display
CN104599692A (en) * 2014-12-16 2015-05-06 上海合合信息科技发展有限公司 Recording method and device and recording content searching method and device
CN104951145A (en) * 2014-03-24 2015-09-30 联想(北京)有限公司 Information processing method and apparatus
CN105244026A (en) * 2015-08-24 2016-01-13 陈娟 Voice processing method and device
CN106710326A (en) * 2015-07-31 2017-05-24 曾晓敏 Reading textbook system based on Chinese
CN106980459A (en) * 2017-03-31 2017-07-25 广州华多网络科技有限公司 Reading method and device based on touch-screen equipment

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009187352A (en) * 2008-02-07 2009-08-20 Forex Co Ltd Document data verification method and document data verification support system
CN103442196A (en) * 2013-08-16 2013-12-11 福建省物联网科学研究院 Video recording method based on vector coding and applied to touch screen device
CN104008088A (en) * 2014-01-20 2014-08-27 广东小天才科技有限公司 Reading assisting method and device based on screen display
CN104951145A (en) * 2014-03-24 2015-09-30 联想(北京)有限公司 Information processing method and apparatus
CN104599692A (en) * 2014-12-16 2015-05-06 上海合合信息科技发展有限公司 Recording method and device and recording content searching method and device
CN106710326A (en) * 2015-07-31 2017-05-24 曾晓敏 Reading textbook system based on Chinese
CN105244026A (en) * 2015-08-24 2016-01-13 陈娟 Voice processing method and device
CN106980459A (en) * 2017-03-31 2017-07-25 广州华多网络科技有限公司 Reading method and device based on touch-screen equipment

Also Published As

Publication number Publication date
CN107885483A (en) 2018-04-06

Similar Documents

Publication Publication Date Title
CN107885483B (en) Audio information verification method and device, storage medium and electronic equipment
US20180276896A1 (en) System and method for augmented reality annotations
CN109189879B (en) Electronic book display method and device
CN107885823B (en) Audio information playing method and device, storage medium and electronic equipment
CN107885826B (en) Multimedia file playing method and device, storage medium and electronic equipment
CN105094760A (en) Picture marking method and device
CN102473304A (en) Metadata tagging system, image searching method and device, and method for tagging a gesture thereof
CN103714333A (en) Apparatus and method for recognizing a character in terminal equipment
CN106575361A (en) Method of providing visual sound image and electronic device implementing the same
CN112118395B (en) Video processing method, terminal and computer readable storage medium
CN113132780A (en) Video synthesis method and device, electronic equipment and readable storage medium
CN108255939A (en) A kind of cross-language search method and apparatus, a kind of device for cross-language search
CN107358233A (en) Information acquisition method and device
US10691717B2 (en) Method and apparatus for managing data
CN113039513B (en) Recommendation method for candidate content of input method and electronic equipment
CN108847066A (en) A kind of content of courses reminding method, device, server and storage medium
CN107885827B (en) File acquisition method and device, storage medium and electronic equipment
CN101984395A (en) Intelligent operation system and method based on personal computer (PC)
CN116226453B (en) Method, device and terminal equipment for identifying dancing teaching video clips
US10915778B2 (en) User interface framework for multi-selection and operation of non-consecutive segmented information
CN110543449A (en) chat record searching method based on AR equipment
KR20200101055A (en) Method for displaying visual object regarding contents and electronic device thereof
CN108052525B (en) Method and device for acquiring audio information, storage medium and electronic equipment
US20230185434A1 (en) Method for providing tag, and electronic device for supporting same
CN107194004B (en) Data processing method and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd.

Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20210302

CF01 Termination of patent right due to non-payment of annual fee