EP3942549A1 - Conversion parole-texte de langage technique non pris en charge - Google Patents

Conversion parole-texte de langage technique non pris en charge

Info

Publication number
EP3942549A1
EP3942549A1 EP20711580.9A EP20711580A EP3942549A1 EP 3942549 A1 EP3942549 A1 EP 3942549A1 EP 20711580 A EP20711580 A EP 20711580A EP 3942549 A1 EP3942549 A1 EP 3942549A1
Authority
EP
European Patent Office
Prior art keywords
text
speech
words
conversion system
technical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP20711580.9A
Other languages
German (de)
English (en)
Inventor
Oliver Kroehl
Gaetano Blanda
Stefan Silber
Inga HUSEN
Michael BARDAS
Thomas Lange
Ulf SCHÖNEBERG
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Evonik Operations GmbH
Original Assignee
Evonik Operations GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Evonik Operations GmbH filed Critical Evonik Operations GmbH
Publication of EP3942549A1 publication Critical patent/EP3942549A1/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/08—Speech classification or search
    • G10L15/14—Speech classification or search using statistical models, e.g. Hidden Markov Models [HMMs]
    • G10L15/142—Hidden Markov Models [HMMs]
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/08—Speech classification or search
    • G10L15/18—Speech classification or search using natural language modelling
    • G10L15/183—Speech classification or search using natural language modelling using context dependencies, e.g. language models
    • G10L15/19—Grammatical context, e.g. disambiguation of the recognition hypotheses based on word sequence rules
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/166—Editing, e.g. inserting or deleting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/253—Grammatical analysis; Style critique
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/26—Speech to text systems
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/28—Constructional details of speech recognition systems
    • G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/12—Use of codes for handling textual entities
    • G06F40/151—Transformation
    • G06F40/157—Transformation using dictionaries or tables
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/221—Announcement of recognition results

Definitions

  • the invention relates to computer-implemented methods for speech-to-text conversion, in particular of technical language in the chemical industry.
  • Wear protective equipment which, in addition to a laboratory coat, can also include protective goggles or a protective mask and protective gloves. As a rule, taking and consuming food and drinks is not permitted and to avoid contamination, the office area with a desk, manuals,
  • Security gate can be changed. It may also be mandatory to take off safety clothing when leaving the laboratory area.
  • Computers or computer-controlled machines and laboratory devices are therefore very limited and inefficient in the context of a chemical or biological laboratory.
  • the aim of the present invention is to provide an improved method and terminal device according to the independent claims, which enables an improved control of software and hardware components in a laboratory context.
  • Embodiments of the invention are given in the dependent claims.
  • Embodiments of the present invention can be freely combined with one another if they are not mutually exclusive.
  • the invention relates to a computer-implemented method for speech-to-text conversion.
  • the procedure includes:
  • a voice signal from a user by a terminal, the voice signal including general and technical words spoken by the user;
  • Hardware component configured to perform a function as specified in the corrected text.
  • Embodiments of the invention are particularly suitable for use in biological and chemical laboratories, since they do not have the disadvantages mentioned in the prior art.
  • Voice-based input allows information to be entered into a terminal device at any location where a microphone is available, i.e. also within a laboratory work area, without having to leave the laboratory workstation, take off gloves or even completely interrupt work.
  • Standard textbook of chemistry could be taken, would often be unsuitable for the practice of a special company or a special branch of the chemical industry, since in the laboratory work is often done with trade names of substances. These trade names can change or a large number of new trade names are added for relevant products every year.
  • this problem is solved by resorting to a speech-to-text conversion system which is known to not support the relevant technical terms. So no attempt is made from the outset, an expensive and time-consuming one
  • Allocation table replaces the incorrectly recognized words with technical terms so that a corrected text is created that is finally output.
  • Assignment table is supplemented with the new technical terms, each together with one or more target vocabulary words incorrectly recognized for this technical term. From a technical point of view, the storage and updating of the technical terms is completely decoupled from the actual speech recognition logic. This also has the advantage that a dependency on a certain provider of speech recognition services is avoided. The field of speech recognition is still young and it is not yet foreseeable which of the multitude of parallels
  • the binding to a specific speech-to-text conversion system only takes place in that the received speech signal is first sent to this conversion system and a (faulty) text is received.
  • the binding to a specific speech-to-text conversion system only takes place in that the received speech signal is first sent to this conversion system and a (faulty) text is received.
  • the method according to embodiments of the invention can also be advantageous for employees in the field service of the chemical industry or chemical production, since these employees often use a computer or at least a smartphone in the course of their work and through a
  • Correction software are less distracted by the customer or their work than by entering text on the keyboard.
  • the terminal only picks up the voice signal, corrects the text and outputs the result of executing a software and / or hardware function on the basis of the corrected text.
  • the actual speech-to-text conversion of the speech signal into a text i.e. by far the most computationally intensive step, is carried out by the speech-to-text conversion system.
  • the speech-to-text conversion system can for example be a server that is connected to the terminal via a network, for example the Internet.
  • a terminal device with a low processor capacity for example a smartphone or a single-board computer, can be used for the input and conversion of long and complex verbal inputs.
  • the text generated by the speech-to-text conversion system is received by the terminal.
  • the terminal then also carries out the text correction, with additional ones according to embodiments
  • Data processing steps are carried out by the terminal, e.g. the terminal
  • the terminal can be a
  • Speech input via a speech-to-text interface to the speech-to-text conversion system for receiving the text from this conversion system, for correcting the text using the assignment table and for outputting the corrected text to a software-based and / or hardware-based one
  • the software-based and / or hardware-based execution system is software or hardware or a combination of both which is configured to perform a function in accordance with the
  • the software program on the terminal can e.g. be designed as a browser plug-in or browser add-in or as a standalone software application that is interoperable with the speech-to-text conversion system.
  • the text generated by the speech-to-text conversion system is also received by the terminal.
  • the terminal then does not carry out the text correction itself, but sends the text via the Internet to a control computer with correction software, which carries out the text correction based on the assignment table as described and transfers the corrected text as input to an execution system.
  • the execution system can consist of a software and / or a
  • the execution system can be for example a laboratory software or a laboratory device. According to embodiments of the invention, the execution system returns the result of executing the corrected text to the control computer. Preferably this has
  • the result of the execution of the function is preferably returned by the control computer to the terminal and / or output via other devices.
  • the terminal then outputs the result of executing the function according to the corrected text.
  • the control computer can e.g. implemented as a cloud service or implemented on a single server. This implementation variant can be advantageous for terminals of medium performance, e.g. Smartphones or control modules, which are divided into individual
  • the terminal also coordinates the data input, the data exchange with the speech-to-text conversion system, and the data exchange with the control computer. Optionally, it can be the result of executing the function according to the
  • control computer does not perform the text correction function, but rather transmits the text received from the speech-to-text conversion system to one via the network
  • Correction computer that carries out the text as described above using the table.
  • the control computer receives the corrected text and forwards it over the network to an execution system which executes a software or hardware function according to the information in the corrected text.
  • This embodiment can be advantageous because a better separation of the access rights to the functions and data of the control computer on the one hand and the
  • Correction computers on the other hand are possible. If the text correction is carried out on a separate cloud system, a user can be granted access here for the purpose of updating the table, without this also giving access to sensitive data of the control computer, which e.g. Execution systems such as Laboratory equipment is required.
  • Embodiments of the method thus essentially a device with a microphone and an optional output interface for results of the execution of the corrected text.
  • the terminal can e.g. a loudspeaker and client software that is preconfigured for data exchange with the control computer. This means that the client software on the terminal is configured to send the voice signal to the control computer via a network and a result of the execution of the corrected text in response to it
  • the terminal is preferably designed as a portable terminal.
  • the terminal can be a single board computer, e.g. Raspberry Pi, be.
  • the software “Google Assistant on Raspberry Pi”, for example, can be installed on this, which is configured in such a way that the voice signals received from the end device are sent to the control computer.
  • the address of the control computer is therefore specified and stored in the terminal. This can be advantageous since a portable and very cost-effective terminal is provided for the purpose of simplified interaction with data processing devices and services within a laboratory. It is possible to position such a device anywhere in the room or laboratory. The user can take the device with him to other rooms in the laboratory or a larger laboratory can be equipped with several devices at low cost.
  • the target vocabulary consists of a set of general language words.
  • the target vocabulary consists of a set of general language words and words derived therefrom. These derived words can, for example, be dynamically created concatenations of two or more general language words.
  • derived words can, for example, be dynamically created concatenations of two or more general language words.
  • many words, especially nouns are formed by combining several other nouns.
  • the word "ship's propeller" is so common that it is usually used in most general language
  • Some speech-to-text conversion systems can also use heuristics and / or neural networks to recognize words such as “fastening screw”, provided that the individual word components “fastening” and “screw” are part of the target vocabulary. In this sense, the word “fastening screw” also belongs to the target vocabulary of this type of speech-to-text conversion system.
  • the target vocabulary consists of a set of general language words supplemented by words that are followed by
  • Recognition accuracy in practice is so low that in practice, even such systems ultimately have a target vocabulary that does not contain or does not support these chemical terms.
  • the target vocabulary consists of a set of general language words supplemented by words derived therefrom and supplemented by words that are formed by combining recognized syllables.
  • These conversion systems are also based on a target vocabulary which the
  • the technical words are words from one of the following categories:
  • Names of chemical substances especially paints and varnishes or additives in the paint and varnish sector; in particular, the names also refer to chemical names according to a chemical naming convention, e.g. according to the IUPAC nomenclature;
  • Names e.g. trade names or proper names assigned by the user for the laboratory equipment of a laboratory
  • laboratory equipment and chemical equipment e.g. trade names or proper names assigned by the user for the laboratory equipment of a laboratory
  • the technical terms are words from the field of chemistry, in particular the chemical industry, in particular the chemistry of paints and varnishes.
  • the device or computer system which carries out the text correction for example the terminal or the control computer or a further correction computer of its own, receives or calculates or receives frequency information for at least some of the words in the text which are used by the speech Text conversion system from the speech signal was generated.
  • the frequency information indicates for words in this text how often the occurrence of this word can be expected statistically.
  • received text contain words of the target vocabulary that are in the
  • Allocation table are assigned to a technical term and which would normally be replaced.
  • the text returned could contain the phrase “Polymer Innovation”. Since this term "polymer innovation" is used in the
  • Allocation table is assigned to a technical term "polymerisation", the expression would normally be replaced by "polymerisation” in the course of the text correction.
  • the correction software assumes that the expression “Polymer Innovation” is correct due to this occurrence, even though it is assigned to a technical term in the assignment table and leaves the expression unchanged As a result, “Polymer Innovation” remains unchanged in the text.
  • a context analysis of the words within the sentence or within the entire speech input can show that the word "innovation" occurs alone in the text, e.g. because the text comes from a sales representative who has the merits of a particular
  • the frequencies of occurrence of the words in the text are calculated by the speech-to-text conversion system and returned to the terminal or the control computer together with the text from the speech-to-text conversion system.
  • the speech-to-text conversion system can use Flidden Markov Models (HMMs) to calculate the probability of occurrence of a particular word in the context of a sentence.
  • HMMs Flidden Markov Models
  • the speech-to-text conversion system can equate the occurrence frequency of a word with the occurrence frequency of the word in a large reference corpus. For example, the entirety of the texts of a newspaper over several years or another large data set of texts can serve as a reference corpus. The ratio of the counted number of words in the corpus to the totality of the words in the corpus is the frequency of occurrence of this word observed in this reference corpus. If the text is corrected by a separate correction computer
  • the frequencies of occurrence of the words in the text are calculated by the terminal after the text has been received.
  • the calculation of the probability of occurrence of the individual words or expressions can be carried out by means of HMMs, taking into account the text context of a word or using the frequencies of the word in a reference corpus be calculated.
  • the entirety of the texts received so far from the speech-to-text conversion system by the terminal or by the control computer can be used as the reference corpus.
  • the frequency information is calculated (e.g. by the terminal or by a correction service) using a hidden Markov model.
  • the expected frequency of occurrence i.e. the probability of occurrence
  • the probability of occurrence can be calculated as the product of the emission probabilities of the individual words in a word sequence, e.g. in B. Cestnik "Estimating probabilities: A crucial task in machine learning" In Proceedings of the Ninth European Conference on Artificial Intelligence, pages 147-150, Sweden, 1990.
  • Control computer in addition to the text also part-of-speech tags (POS tags) - for at least some of the words in the text that was generated from the speech signal by the speech-to-text conversion system.
  • POS tags are received by the speech-to-text conversion system and contain at least tags for noun, adjective and verb. It is also possible that the POS tags contain additional types of syntactic or semantic tags. The exact composition of the POS tags taken into account can also depend on the respective language.
  • the technical words are stored linked together with their POS tags. When the corrected text is generated, only those words of the target vocabulary in the received text are replaced by technical-language words in accordance with the assignment table whose POS tags match.
  • POS tags of the text to be replaced do not match the POS tag of the technical words, this is an indication that the corresponding words in the Text could possibly be correct after all.
  • the recognition rate of the POS tags is comparatively high, so that the quality of the correction step can be increased by this measure.
  • a technical word is, for example, the trade name “Platilon®”. It refers to thermoplastic polyurethane films from Covestro.
  • a POS tag "noun" is assigned to this technical term.
  • the method comprises steps for
  • At least one reference speech signal is recorded which selectively reproduces this technical language word.
  • the reference speech signal originates from at least one speaker.
  • at least one reference speech signal which selectively reproduces this technical expression, can be spoken and recorded by at least one speaker.
  • the remaining steps are essentially for words and expressions identical, so that in the following, when a technical term is used, a technical term is included.
  • Each of the recorded reference speech signals is fed into the speech-to-text conversion system
  • the input can in particular be via a network, e.g. the internet.
  • the device which input the reference signals receives at least one word of the target vocabulary generated by the speech-to-text conversion system from the input reference speech signal.
  • This device can e.g. act around the end device.
  • the recording of the reference speech signals, as well as the reception of the (wrong) words or expressions of the target vocabulary, which ultimately serve to create or expand the assignment table, can also be done by any other device with a network connection to the speech-to-text conversion system will.
  • the reference speech signals are preferably input via a device that is as similar as possible to the terminal in terms of construction and in terms of its positioning relative to noise sources in order to ensure that the same errors are reproducibly generated.
  • the at least one word (which can also be an expression) of the target vocabulary that is received for each of the technical language words represents an incorrect conversion since the target vocabulary of the speech-to-text conversion system does not support the technical language words.
  • the assignment table is generated as a table which assigns to each of the technical language words for which at least one reference speech signal has been recorded the at least one word of the target vocabulary in text form, which is used by the language-to-text conversion system from this technical language word containing reference speech signal was generated in each case.
  • a table can be modified and supplemented very easily without having to change source code, recompile a program or retrain a neural network. Even if a different speech-to-text conversion system is used, only the corresponding client interface has to be adapted and the technical terms in the table have to be re-entered by one or more speakers via a microphone and transferred to the new speech-to-text conversion system be transmitted. The one from this one Incorrect target language words and expressions returned to the new system form the basis for the new mapping table. It is thus possible without profound or complex changes and without retraining one
  • the assignment table can be, for example, as a table of a relational database or as a
  • several reference speech signals are recorded by different speakers for each of at least some of the technical language words (or technical language expressions).
  • the multiple reference language signals reproduce this technical word (or this technical expression).
  • the assignment table assigns a plurality of words (or phrases) of the target vocabulary in text form to each of at least some of the technical language words (or phrases).
  • the multiple words (or phrases) of the target vocabulary represent miss-conversions that the speech-to-text conversion system has produced for the various speakers depending on their voice.
  • a specific technical word such as “1,2-methylenedioxybenzene” can be read out by 100 different people and recorded with a microphone as a reference speech signal.
  • Reference speech signals for this one substance name Each of these 100 reference speech signals is sent to the speech-to-text conversion system, and 100 words or phrases of the
  • Target vocabulary returned all of which do not correctly reflect the actual technical name. Often times the 100 words returned will be the same, but not always. Different people have different voices, which means that speech input differs in terms of emphasis, volume, pitch and articulation. Therefore it is possible that a specific language-to-text conversion system for a specific technical word (or a specific technical expression) returns several different, incorrect words or expressions, which are all included in the assignment table.
  • the terminal device or the computer system that carried out the text correction is configured to output the corrected text to the user via a loudspeaker and / or a display. This has the advantage that the user has another chance to check the correctness of the corrected text.
  • the terminal device or the computer system that carried out the text correction is configured to output the result of the execution of the corrected text that is supplied by the execution system to the user.
  • the output can take place, for example, in that the result is displayed in text form on a screen of the
  • the result of the execution of the corrected text can be output via a text-to-speech interface and a loudspeaker of the terminal.
  • the execution system that executes a function according to the corrected text is software.
  • the software can be a chemical one
  • this software can be a database management system (DBMS) and / or an external software program which is interoperable with this de BMS, the DBMS containing and managing the chemical database.
  • the software is designed to interpret the corrected text as a search entry and to determine and return information on the search entry in the database.
  • the Substance database can, for example, be part of a chemical plant, such as an HTE plant.
  • the software can be an Internet search engine which is designed to interpret the corrected text as a search input and to determine and return information about the search input on the Internet.
  • the software can be a
  • the simulation software is designed to determine properties of chemical products, in particular of paints and varnishes, based on a predetermined recipe for the production of the
  • the simulation software interprets the corrected text as a specification of the recipe of the product, its
  • Properties are to be simulated and / or as a specification of the properties of the product.
  • the software can be a
  • control software is designed to interpret the corrected text as a specification of the synthesis or the components of the substance mixture.
  • the corrected text is output by the terminal to the hardware component.
  • the hardware component can in particular be a system for the
  • the system can be a high throughput system (HTE system) for the analysis and manufacture of paints and varnishes.
  • HTE system can be a system for automatic testing and for the automatic production of chemical products, as described in WO 2017/072351 A2.
  • Hardware components can be very advantageous, especially in the context of a biological or chemical laboratory, as the voice input is processed in such a way that it can be passed on directly to a technical system and interpreted correctly by it, without the user having to take off gloves or leave the laboratory, for example .
  • the hardware component can be a device or device module or a computer system within a chemical or biological laboratory.
  • the hardware component can be an automatic or semi
  • This system for analyzing and / or synthesizing chemical products, especially paints and varnishes, can be an HTE system.
  • the system for the analysis and / or synthesis of chemical products can be any system for the analysis and / or synthesis of chemical products.
  • these analyzes can be carried out using optical measurements in cuvettes after sampling;
  • Viscosity measurement can be particularly useful for highly viscous substances or
  • Mixtures contain an automatic dilution step because the
  • Viscosity is easier to determine in a dilute solution; the viscosity of the original substance or substance mixture is calculated based on the viscosity of the diluted solution;
  • the substances and substance mixtures can in particular be substances and substance mixtures which are used to produce paints and varnishes. It can also be with the substances and
  • the speech-to-text conversion system is implemented as a service which is provided to a large number of terminals via the Internet.
  • the speech-to-text conversion system can be Google's “Speech-to-Text” cloud service.
  • This can be advantageous because a functionally powerful API client library is available for this, e.g. for .NET.
  • This can be advantageous because the computationally expensive conversion process of speech signals into text does not take place on the end device, but on a server, preferably a cloud server, which has a greater computing power than the end device and which recognizes the fast and parallel conversion of a large number of speech signals into Texts is designed.
  • the terminal can, for example, be a desktop computer, a notebook, a smartphone, a tablet computer, a computer integrated into a laboratory device, a computer locally coupled to a laboratory device, or a single-board computer
  • the software logic which implements the method according to embodiments of the invention can be implemented exclusively on the terminal device or on the terminal device and one or more other computers, in particular cloud computer systems, in a distributed manner.
  • the software logic is preferably software that is device-independent and preferably also independent of the terminal's operating system.
  • the terminal device is preferably a device which is located within a laboratory room or which is at least operatively connected to a microphone within a laboratory room.
  • the invention relates to a terminal.
  • the end device includes:
  • a microphone for receiving a voice signal from a user the
  • Speech signal spoken by the user general language and
  • the interface is designed to input the received speech signal into the speech-to-text conversion system.
  • the speech-to-text conversion system only supports the conversion of speech signals into a target vocabulary that does not contain the technical words.
  • the interface is designed to receive a text, which from the
  • Speech-to-text conversion system from the speech signal was generated.
  • a data memory with an assignment table of words in text form.
  • the assignment table assigns at least one word of the target vocabulary to each of a multiplicity of technical language words or technical language expressions.
  • the at least one word assigned to the technical-language word can also be an expression or a set of words and expressions from the target vocabulary.
  • the at least one word of the target vocabulary assigned to a technical-language word is a word or an expression which the speech-to-text conversion system incorrectly recognizes (and incorrectly recognized in the course of creating the assignment table) if this
  • a correction program which is designed to a corrected text by automatically replacing words and expressing the target vocabulary in the received text with technical words according to
  • the execution system is software and / or a hardware component and is configured to execute a function according to information in the corrected text.
  • the terminal is preferably configured to receive a result of the execution from the software or hardware via this or another interface;
  • the terminal further includes an output interface, e.g. to create an acoustic interface such as a loudspeaker, or an optical interface, e.g. a GUI (graphic
  • User interface can also be a different interface, e.g. a proprietary data format for exchanging text data with a specific laboratory device.
  • the invention relates to a system comprising one or more terminals according to one of the embodiments described here.
  • the system also includes a speech-to-text conversion system.
  • the speech-to-text conversion system includes:
  • an automatic speech recognition processor for generating text from a received speech signal.
  • the speech recognition processor only supports the conversion of speech signals into a target vocabulary that does not contain the technical words.
  • Said interface of the speech-to-text conversion system is designed to return the text generated from a received speech signal to the terminal from which the speech signal was received.
  • the system in particular in which the text correction is not carried out by the terminal but by the control computer or a correction computer, the system also includes the control computer and / or the correction computer.
  • the system further comprises the software or hardware component that performs the function according to the corrected text.
  • a “vocabulary” is understood here to mean a linguistic area, i.e. a set of words which an entity, e.g. a speech-to-text conversion system.
  • a “word” is understood here to mean a coherent sequence of characters which occur within a certain vocabulary and which represents an independent linguistic unit.
  • a word - in contrast to a sound or a syllable - has an independent one
  • An “expression” is understood here as a linguistic unit made up of two or more words.
  • a “technical word” or “technical term” is understood here to mean a word from a technical term vocabulary. A technical word does not belong to the target vocabulary and is typically not part of the
  • Conversion of speech signals into a target vocabulary supported means that words of another vocabulary either cannot be converted into text at all or are only converted into text with a very high error rate, whereby the error rate is above an error rate limit value per word or phrase to be converted, which is the maximum must be regarded as tolerable for a functioning translation of speech into text.
  • this limit value can be with an error probability per word or expression of over 50%, preferably already over 10%.
  • Labeling understood, which is assigned to each word in a text corpus in order to identify the part of the language and often also other grammatical categories such as tense, number (plural / singular), upper / lower case etc.
  • Tag sets for different languages are typically different.
  • Basic tag sets contain tags for the most common language components (e.g. N for noun, V for verb, A for adjective, etc.).
  • a “virtual laboratory assistant” is software or software routine that works with one or more laboratory devices and / or in a laboratory
  • Software programs is operatively linked in such a way that information from these laboratory equipment and laboratory software programs are received and instructions for use
  • a laboratory assistant has an interface for data exchange with and for controlling one or more laboratory devices and laboratory software programs.
  • the laboratory assistant also has an interface to a user and is configured to provide the user with Interface to enable easier use, monitoring and / or control of the laboratory equipment and the laboratory software programs.
  • the interface to the user can be an acoustic interface or
  • An “end device” is a data processing device (for example PC, notebook, tablet computer, single-board system, Raspberry Pi computer,
  • the terminal is preferably connected to a network connection.
  • a “reference speech signal” is a speech signal that was recorded by a microphone and that is based on a speech input that was not entered by the speaker into the microphone for the purpose of operating software or hardware, but rather for creation or to add to the allocation table.
  • Speech input is a spoken technical word or a spoken technical expression which is recorded in order to pass the corresponding speech signal on to the speech-to-text conversion system and to receive a word or an expression of the target vocabulary in response from the conversion system, that on a faulty one
  • FIG. 1 shows a flow chart of a method for speech-to-text
  • Figure 2 shows a block diagram of a distributed speech-to-text system
  • FIG. 3 shows a block diagram of another distributed system for
  • Figure 4 shows a block diagram of another distributed speech-to-text conversion system
  • FIG. 5 shows a block diagram of another distributed system for
  • Speech-to-text conversion in the context of a laboratory Speech-to-text conversion in the context of a laboratory.
  • FIG. 1 shows a flow diagram of a computer-implemented method for the speech-to-text conversion of texts with technical words.
  • the particular advantage of the process is that it uses an existing speech-to-text conversion system for recognizing and converting texts
  • Implementation system does not support the technical vocabulary at all.
  • the method can be carried out by a terminal device alone or by a terminal device and further data processing devices, for example a control computer and / or a computer that offers a correction service via a network.
  • FIGS. 2, 3 and 4 Data processing systems which can implement a method according to embodiments of the invention are shown in FIGS. 2, 3 and 4. In some cases, reference is also made to these figures in the description of the flow chart in FIG.
  • the method can typically be used in the context of a chemical or biological laboratory.
  • a chemical or biological laboratory In the laboratory there are a number of individual analysis devices and a high throughput system (high throughput
  • the HTE system contains a large number of units and modules that can analyze and measure various chemical or physical parameters of substances and substance mixtures and which can combine and synthesize a large number of different chemical products based on a recipe entered by a user.
  • the HTE system contains an internal database in which recipes, for example of paints and varnishes and their raw materials and their respective physical chemical, optical and other properties are stored.
  • recipes for example of paints and varnishes and their raw materials and their respective physical chemical, optical and other properties are stored.
  • other relevant data can be stored in the database, for example product data sheets of the manufacturers of the substances,
  • Safety data sheets parameters for the configuration of individual modules of the HTE system for the analysis or synthesis of certain substances or products and the like.
  • the HTE system is designed to carry out analyzes and syntheses based on recipes and instructions that are entered in text form.
  • Frequent activities within a laboratory with the laboratory room number 22 relate, for example, to the following activities and related possible voice inputs of a laboratory worker 202 to software or
  • the simulation can e.g. based on CNNs (convolutional neuronal networks).
  • CNNs convolutional neuronal networks
  • all of these inputs and commands can be sent to the respective execution systems without the user having to leave the laboratory and / or take off gloves.
  • the laboratory worker 202 makes a voice input 204 into a microphone 214 of the terminal 212, 312.
  • the voice input can consist of one of the above-mentioned voice commands.
  • the voice inputs usually contain both general and technical language Words and expressions.
  • the words or expressions “rheological”, “naphtenic oil”, “methol n-amyl ketone”, “n-pentyl propiona” are chemical terms and “LMGÜNSTIG” is a trade name for a chemical product. These words or phrases are typically not in that supported by common general language speech-to-text conversion systems
  • the microphone 214 converts the voice input into an electronic voice signal 206. This speech signal is then input to a speech-to-text conversion system 226 in step 104.
  • the terminal device can have an interface 224 and corresponding client application 222 to one of the known general language speech-to-text conversion systems 226 from, for example, Google, Apple, Amazon or Nuance.
  • This client application 222 sends that
  • Speech signal via the interface 224 directly to the speech-to-text conversion system 226. In other embodiments, however, it is also possible that the speech signal via one or more intermediary
  • Data processing equipment is sent to the speech-to-text conversion system 226.
  • the voice signal is first sent to a control computer 314, 414, which then forwards it to the voice-to-text conversion system 226 via a network 236.
  • the network can be, for example, the Internet.
  • the control computer system 314, 414 carries out coordination and control activities with regard to the management and processing of the speech signal and the text generated from it.
  • the control computer 314 is a data processing system which carries out the text correction itself.
  • Control computer 414 also has this calculation step to a further one
  • the speech-to-text conversion system 226 is general language
  • Conversion system that is, it only supports conversion of Speech signals in a general language target vocabulary 234 which does not contain the technical language words of the speech input 204.
  • the speech-to-text conversion system now performs the conversion of the
  • Speech signal into a text based on the target vocabulary is a cloud service that can process a large number of speech signals from several terminals in parallel and return them to them via the network.
  • the generated text will contain, with certainty or with a very high degree of probability, incorrectly recognized words and expressions, since at least some of the words and expressions of the voice input 204 consist of technical language words or expressions. Expressions exist, whereas the conversion system only supports the target vocabulary which does not contain the technical words and expressions.
  • step 106 the data processing system which receives the
  • Speech signal 206 to speech-to-text conversion system 226, in response thereto, the text 208 generated from that signal by the speech-to-text conversion system.
  • receiving system can, depending on
  • an allocation table 238 is used to correct the received text.
  • Correcting text is also referred to here as the "correction system" because of its function.
  • this can be the terminal 212, or the control computer system 314, or a
  • Correction computer system 402 act. If receiving system and
  • Correction system are not identical, the text 208 received from the receiving system is forwarded to the correction computer system.
  • words are assigned to one another in text form.
  • the assignment table assigns at least one word to each of a plurality of technical language words or technical language expressions from the target vocabulary.
  • the at least one word of the target vocabulary assigned to a technical word (or technical expression) is a word or an expression that the speech-to-text conversion system incorrectly recognizes (and has already incorrectly recognized earlier when creating the table) if this technical language Word in the form of an audio signal is input into the speech-to-text conversion system.
  • step 110 the correction system 212, 314, 402 generates a corrected text 210 from the erroneous text 208 of the conversion system 226.
  • the corrected text is automatically generated by the correction system in that words and expressions of the target vocabulary in the received text 208 by technical language according to the allocation table 238 can be replaced.
  • the corrected text is returned to a control computer.
  • the terminal device or the control computer inputs the corrected text 210 directly or indirectly into an execution system 240 in step 112. examples for
  • FIG. 1 The various execution systems are shown in FIG. The
  • Execution system a software and / or flardware component, executes a software and / or flardware function in accordance with the corrected text and returns a result 242.
  • the result can, for example, be returned directly to the terminal or returned to the terminal via the control computer as an intermediate station. Alternatively or additionally, however, the result can also be returned to other terminals and other data processing systems.
  • Control computer 314 functioning as a correction system sends the corrected text to the execution system 240, receives the result 242 of the execution therefrom and forwards this result to the terminal for output to the user 202.
  • the result is typically a text, e.g. a recipe researched in a database for the synthesis of a chemical substance, a document found in a database or on the Internet, e.g. Product data sheet of a substance that
  • terminal device or another data processing system can use the software and / or the result of the execution of the function
  • the software and / or the flardware is preferably software and flardware that are designed within a laboratory or specifically for the activities within a laboratory or that can at least be used for this purpose.
  • the terminal 212 can contain a loudspeaker or be communicatively coupled to it and output the result in acoustic form via this loudspeaker. Additionally or alternatively, the terminal can contain a screen for outputting the result to the user.
  • Other output interfaces are also possible, for example Bluetooth-based components.
  • the method can be used to implement voice control of electronic devices, in particular laboratory instruments and FITE systems, by means of voice control.
  • electronic devices in particular laboratory instruments and FITE systems
  • Voice control can also be used to research and output results of analyzes and syntheses already carried out in the laboratory, laboratory protocols and product data sheets in the corresponding databases of the laboratory and to carry out additional searches also on the Internet and public or proprietary databases accessible via the Internet using voice control. Also voice commands, which special names for chemicals or
  • Embodiments of the invention thus enable largely voice-controlled, highly integrated operation of a chemical or biological laboratory or a laboratory HTE system.
  • CONTROL COMPUTER The word "CONTROL COMPUTER" in the
  • Voice input can, for example, be the name of a virtual assistant 502 for voice-based operation of the devices in a laboratory and / or a FITE system of a laboratory.
  • the word "CONTROL COMPUTER” (or any other name that may be more pronounced of a person such as "EVA") can be used as a trigger signal to trigger a text evaluation logic of this laboratory assistant to evaluate the corrected text .
  • the laboratory assistant is configured to check every received text to see whether it contains its name and, if applicable,
  • the corrected text is further analyzed in order to recognize and execute commands encoded in it.
  • the output of the result data takes place via a loudspeaker which is located within the laboratory room.
  • the loudspeaker can be a loudspeaker that is part of the terminal that received the user's voice input.
  • it can also be another loudspeaker that is communicatively connected to this terminal. This has the advantage that a laboratory worker can enter commands with his voice without media discontinuity, for example about analysis results, product data sheets or other context
  • FIG. 2 shows a block diagram of a distributed system 200 for the speech-to-text conversion of texts with technical language words.
  • Terminal 212 can be, for example, a notebook, a standard computer, a tablet computer, or a smartphone. On the
  • Terminal has installed client software 222 which is interoperable with an existing general language speech-to-text conversion system 226.
  • the speech-to-text conversion system 226 is a cloud computer system which offers this conversion as a service via the Internet via a corresponding language-to-text interface (SZT interface) interface 224.
  • the service is a software program 232 implemented on the server side which, in functional terms, corresponds to a speech recognition and language conversion processor.
  • the software program 232 can be Google's Speech-to-Text
  • the interface 224 is a cloud-based API from Google.
  • the terminal has the assignment table 238 and sufficient computing power to carry out the correction of the text 208 generated by the speech-to-text conversion system 226 based on the table itself.
  • the sending of the voice signal 206 to the server 226, the reception of the text 208 from the server 226 and the Correction of the text to create the corrected text 210 can thus be implemented in the client program 222.
  • the client program 222 can be, for example, a browser plug-in or a standalone application that is interoperable with the server software 232 via the interface 224.
  • FIG. 3 shows a block diagram of a further distributed system 300 for speech-to-text conversion.
  • the system architecture of the system 300 differs from the architecture of the system 200 in that the terminal 312 has outsourced the function of text correction to a control computer 314.
  • Client software 316 installed on the terminal 312, called a control client here, is connected to a
  • control program 320 which is installed on a control computer 314, interoperable.
  • the terminal is connected to the control computer 314 via a network 236, for example the Internet.
  • the control interface 318 is used for data exchange between control client 316 and control program 320.
  • the control computer 314 can be, for example, a
  • Control computer around a server or a cloud computer system Control computer around a server or a cloud computer system.
  • the control program 320 installed on the control computer implements, on the one hand, coordinative functions 322 to facilitate the exchange of data (voice signal 206, recognized text 208, corrected text 210) between the various
  • Correction function 324 which is carried out in the system 200 by the terminal. Correction function 324 is to remove words and phrases from the
  • Conversion system 226 controls and does not perform the text correction can be implemented as part of control program 320. However, it is also possible for the control program 320 and the client 222 to be separate but interoperable programs.
  • the architecture shown in FIG. 3 has the advantage that the terminal does not have to carry out any computationally intensive operations. Both the implementation of the
  • Speech signal in text as well as the correction of this text are taken over by other data processing systems.
  • the function of the terminal device 312 is essentially limited to the reception of the voice signal 206, the
  • Execution system is returned when performing a function according to the corrected text.
  • FIG. 4 shows a block diagram of a further distributed system 400 for speech-to-text conversion.
  • the system architecture of the system 400 differs from the architecture of the system 300 in that the control computer 414 does not carry out the text correction itself, but rather has it carried out by another computer, referred to here as a “correction computer” or “correction server” 402, the other
  • Control program 320 of the control computer is interoperably connected.
  • control program 320 on the control computer 414 can, for example, have extensive access rights with regard to various, in some cases sensitive, data have that in the course of the analysis and synthesis of chemical substances and
  • control computer 414 can, for example, have a machine-to-machine interface in order to send the corrected text in the form of a control command directly to a laboratory device or an HTE system or to their database for analysis, chemical synthesis or Initiate research based on the corrected text 210.
  • a secure and strict access protection for the control computer 414 is therefore particularly important.
  • the correction server 402 in the context of the architecture of the system 400 only serves to correct the text 208 that is generated by the speech-to-text conversion system 226 and sent to the control program 320
  • adding technical terms and expressions has no reading and / or writing access to the control computer 414. It is thus possible to continuously update the assignment table and thus the text correction without the need to do this
  • the terminal 312 of the distributed systems 300, 400 can be, for example, computers, notebooks, smartphones and the like. But it is also possible that the single-board computers are comparatively weak, e.g. Raspberry Pi Systems.
  • All of the system architectures 200, 300, 400 and 500 shown here enable the use of existing speech-to-text APIs from various cloud providers using their own, cloud-provider-independent hardware for a subject-specific one To enable speech recognition and a control of laboratory equipment and electronic search services based on it in a laboratory.
  • FIG. 5 shows a block diagram of a further distributed system 500 for speech-to-text conversion in the context of a chemical laboratory.
  • the laboratory includes a laboratory area 504 with the usual safety regulations.
  • various individual laboratory devices 516 e.g. a centrifuge and an HTE system 518.
  • the HTE system contains a large number of modules and
  • Hardware units 506-514 that are managed and controlled by a controller 520.
  • the controller serves as the central interface for monitoring and
  • Control program 320 on control computer 414 contains a software module 502 which implements a virtual laboratory assistant.
  • control program 320 After the control program 320 has received the corrected text from
  • Correction computer 402 has received, the control program evaluates it and searches for a keyword such as "CONTROL COMPUTER” or "EVA". If the corrected text contains this keyword, the virtual laboratory assistant 502 is prompted to further analyze the corrected text to determine whether the corrected text includes instructions for performing a hardware or software function and, if so, which hardware or software is under control of the laboratory assistant 502 these commands are to be executed.
  • the corrected text can contain names of devices or laboratories, which specify which device and which software the command should be forwarded to.
  • corrected text 210 by the virtual laboratory assistant that an Internet search engine 528 is to search for a certain substance that is specified in the corrected text 210 as a technical word or phrase.
  • the corrected text or certain parts of it are entered into the search engine by the virtual assistant 502 via the Internet.
  • the results 524 of the Internet searches are returned to the assistant 502, who forwards them to a suitable output device in the vicinity of the user 202, for example terminal 312, where they are output via a loudspeaker or screen 218, for example.
  • the evaluation of the corrected text 210 by the virtual laboratory assistant shows that the laboratory device 512, a centrifuge, is to pellet a certain substance at a certain speed.
  • the name of the centrifuge and the substance are specified in the corrected text 210 as a technical word or phrase, which is sufficient because the centrifuge automatically reads the centrifugation parameters to be used such as duration and number of revolutions from an internal database based on the substance name.
  • the corrected text or certain parts of it are sent by the virtual assistant 502 to the centrifuge 512 via the Internet. The centrifuge starts one associated with the substance
  • Centrifugation program and returns a message about successful or unsuccessful centrifugation as text message 522.
  • the result 522 is returned to the assistant 502, which forwards it to a suitable output device, for example terminal 312, where it e.g. is output via a loudspeaker or screen 218.
  • the evaluation of the corrected text 210 by the virtual laboratory assistant shows that the HTE system 518 is to synthesize a specific paint.
  • the components of the paint are also specified in the corrected text and consist of a mixture of trade names of chemical products and IUPAC substance names.
  • the HTE system receives the corrected text 210 and autonomously decides to carry out the synthesis in the synthesis unit 514.
  • a message about the successful synthesis or an error message is returned as result 526 by the synthesis unit 514 to the controller of the HTE system 518, and the controller in turn returns the result 526 to the virtual laboratory assistant 592, which sends it to a suitable output device, for example Terminal 312, where it is output via a loudspeaker or screen 218, for example.
  • a suitable output device for example Terminal 312, where it is output via a loudspeaker or screen 218, for example.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • General Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Probability & Statistics with Applications (AREA)
  • Machine Translation (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

L'invention concerne un procédé implémenté par ordinateur destiné à la conversion parole-texte. Le procédé consiste : à recevoir (102) un signal de parole (206) qui contient des mots de langage général et de langage technique; - à entrer (104) le signal de parole reçu dans un système de conversion parole-texte (226) qui prend en charge uniquement la conversion de signaux de parole dans un vocabulaire cible (234) ne contenant pas les mots de langage technique; - à recevoir (106) un texte (208) qui a été généré par le système de conversion parole-texte à partir du signal de parole; - à générer (110) un texte corrigé (210) par la substitution automatique de mots et d'expressions du vocabulaire cible dans le texte reçu par des mots de langage technique selon une table d'attribution (238), qui attribue à chaque mot d'une pluralité de mots de langage technique au moins un mot ou une expression reconnus en erreur par le système de conversion parole-texte du vocabulaire cible; et - à émettre (112) le texte corrigé vers l'utilisateur ou vers un composant logiciel et/ou matériel pour l'exécution d'une fonction.
EP20711580.9A 2019-03-18 2020-03-13 Conversion parole-texte de langage technique non pris en charge Withdrawn EP3942549A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP19163510 2019-03-18
PCT/EP2020/056960 WO2020187787A1 (fr) 2019-03-18 2020-03-13 Conversion parole-texte de langage technique non pris en charge

Publications (1)

Publication Number Publication Date
EP3942549A1 true EP3942549A1 (fr) 2022-01-26

Family

ID=65818364

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20711580.9A Withdrawn EP3942549A1 (fr) 2019-03-18 2020-03-13 Conversion parole-texte de langage technique non pris en charge

Country Status (7)

Country Link
US (1) US20220270595A1 (fr)
EP (1) EP3942549A1 (fr)
JP (1) JP2022526467A (fr)
CN (1) CN113678196A (fr)
AR (1) AR118332A1 (fr)
TW (1) TWI742562B (fr)
WO (1) WO2020187787A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12057123B1 (en) * 2020-11-19 2024-08-06 Voicebase, Inc. Communication devices with embedded audio content transcription and analysis functions

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU7115400A (en) * 1999-08-31 2001-03-26 Accenture Llp System, method, and article of manufacture for a voice recognition system for identity authentication in order to gain access to data on the internet
ATE417346T1 (de) * 2003-03-26 2008-12-15 Koninkl Philips Electronics Nv Spracherkennungs- und korrektursystem, korrekturvorrichtung und verfahren zur erstellung eines lexikons von alternativen
US7539619B1 (en) * 2003-09-05 2009-05-26 Spoken Translation Ind. Speech-enabled language translation system and method enabling interactive user supervision of translation and speech recognition accuracy
JP2010066365A (ja) * 2008-09-09 2010-03-25 Toshiba Corp 音声認識装置、方法、及びプログラム
US9292621B1 (en) * 2012-09-12 2016-03-22 Amazon Technologies, Inc. Managing autocorrect actions
CH711717B1 (de) 2015-10-29 2019-11-29 Chemspeed Tech Ag Anlage und Verfahren zur Durchführung eines Bearbeitungsprozesses.
US10410622B2 (en) * 2016-07-13 2019-09-10 Tata Consultancy Services Limited Systems and methods for automatic repair of speech recognition engine output using a sliding window mechanism

Also Published As

Publication number Publication date
CN113678196A (zh) 2021-11-19
US20220270595A1 (en) 2022-08-25
TW202046292A (zh) 2020-12-16
AR118332A1 (es) 2021-09-29
TWI742562B (zh) 2021-10-11
JP2022526467A (ja) 2022-05-24
WO2020187787A1 (fr) 2020-09-24

Similar Documents

Publication Publication Date Title
Gilquin et al. Corpora and experimental methods: A state-of-the-art review
Sidhu et al. Sound symbolism shapes the English language: The maluma/takete effect in English nouns
CN111428467B (zh) 生成阅读理解的问题题目的方法、装置、设备及存储介质
US9613638B2 (en) Computer-implemented systems and methods for determining an intelligibility score for speech
JP2018045062A (ja) 学習者の口述音声から自動的に採点するプログラム、装置及び方法
Schoonen Structural equation modeling in L2 research
Blanchete et al. Formalizing Arabic inflectional and derivational verbs based on root and pattern approach using NooJ platform
Sabtan et al. Teaching Arabic machine translation to EFL student translators: A case study of Omani translation undergraduates
EP3942549A1 (fr) Conversion parole-texte de langage technique non pris en charge
EP3942302B1 (fr) Système de laboratoire pourvu d'appareil portable comprenant un microphone et procédé
CN113408253A (zh) 一种作业评阅系统及方法
Kiener et al. Different types of IT skills in occupational training curricula and labor market outcomes
Duan et al. Automatically build corpora for chinese spelling check based on the input method
Pfeifer et al. How ready is speech-to-text for psychological language research? Evaluating the validity of AI-generated English transcripts for analyzing free-spoken responses in younger and older adults
CN110851572A (zh) 会话标注方法、装置、存储介质及电子设备
Chan et al. A Computational Linguistic Approach to Modelling the Dynamics of Design Processes
Wilson Units and constituency in prosodic analysis: a quantitative assessment
Gero et al. Decomposition/recomposition design behavior of student and professional engineers
JP2018031828A (ja) 学習者の口述音声から自動的に採点するプログラム、装置及び方法
CN113822514A (zh) 一种全媒体文稿质量控制方法
Thierfelder et al. The Chinese lexicon of deaf readers: A database of character decisions and a comparison between deaf and hearing readers
DE112019005921T5 (de) Informationsverarbeitungsvorrichtung, informationsverarbeitungsverfahren und programm
Adesiji et al. Development of an automated descriptive text-based scoring system
WO2024190751A1 (fr) Procédé de traitement d'informations, dispositif de traitement d'informations, et programme de traitement d'informations
Cui et al. Corpus Construction for Aviation Speech Recognition

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20211018

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20230920

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20240131