WO2022222979A1 - 书写方法、装置、交互平板和存储介质 - Google Patents

书写方法、装置、交互平板和存储介质 Download PDF

Info

Publication number
WO2022222979A1
WO2022222979A1 PCT/CN2022/088060 CN2022088060W WO2022222979A1 WO 2022222979 A1 WO2022222979 A1 WO 2022222979A1 CN 2022088060 W CN2022088060 W CN 2022088060W WO 2022222979 A1 WO2022222979 A1 WO 2022222979A1
Authority
WO
WIPO (PCT)
Prior art keywords
writing
touch
vibration signal
touch object
display screen
Prior art date
Application number
PCT/CN2022/088060
Other languages
English (en)
French (fr)
Inventor
陈玉香
Original Assignee
广州创知科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州创知科技有限公司 filed Critical 广州创知科技有限公司
Publication of WO2022222979A1 publication Critical patent/WO2022222979A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • the embodiments of the present application relate to the technical field of touch control, for example, to a writing method, a device, an interactive tablet, and a storage medium.
  • Interactive tablets are gradually revolutionizing the education and office fields. Using touch to write can highlight or note important content in a more efficient way, thereby improving the efficiency and quality of learning and work.
  • the interactive tablet supports multi-touch operation, that is, it supports multiple users to write at the same time.
  • each user calls up the panel for controlling writing before writing, and sets the settings on the panel. Same configuration as before.
  • the embodiments of the present application propose a writing method, a device, an interactive tablet, and a storage medium, so as to solve the cumbersome problem of frequently switching and writing configurations on the interactive tablet.
  • the embodiment of the present application provides a writing method, which is applied to an interactive tablet, and the method includes:
  • the embodiment of the present application also provides a writing device, which is applied to an interactive tablet, and the device includes:
  • the writing interface display module is set to display the interface for writing on the display screen
  • a touch track determination module configured to determine a touch track generated when the touch object moves on the surface of the display screen
  • a target vibration signal detection module configured to collect the vibration signal generated when the touch object moves on the surface of the display screen, and use the vibration signal as the target vibration signal
  • a material identification module configured to determine the material of the touch object according to the target vibration signal
  • an identification configuration module configured to configure an identification for the touch object according to the material
  • the writing operation execution module is configured to execute the operation related to writing along the touch track and according to the identification on the writing interface.
  • the embodiment of the present application also provides an interactive tablet, the interactive tablet comprising:
  • processors one or more processors
  • a memory configured to store one or more programs, when the one or more programs are executed by the one or more processors, the one or more processors implement the writing method described in any embodiment of the present application .
  • Embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the writing method described in any embodiment of the present application is implemented.
  • FIG. 2A is an exemplary diagram of a writing operation provided in Embodiment 1 of the present application.
  • FIG. 2B is an exemplary diagram of another writing operation provided in Embodiment 1 of the present application.
  • FIG. 3 is a schematic structural diagram of a writing device according to Embodiment 2 of the present application.
  • FIG. 4 is a schematic structural diagram of an interactive tablet provided in Embodiment 3 of the present application.
  • FIG. 1 is a flow chart of a writing method provided in Embodiment 1 of the present application. This embodiment can be applied to the situation of recognizing different touch objects and switching to a corresponding configuration for writing.
  • the method can be executed by a writing device.
  • the writing device can be implemented by software and/or hardware, and can be configured in an interactive tablet, and the writing method includes the following steps:
  • Step 101 Display an interface for writing on the display screen.
  • a display screen is configured in the interactive flat panel, and the display screen includes a light emitting diode (Light Emitting Diode, LED) display screen, an organic light emitting diode (Organic Light-Emitting Diode, OLED) display screen, and a liquid crystal display screen (Liquid Crystal Display, LCD) ,and many more.
  • LED Light Emitting Diode
  • OLED Organic Light-Emitting Diode
  • LCD Liquid Crystal Display
  • a touch display can be formed by arranging optical touch sensors on both sides of the display surface.
  • the optical touch sensor is a sensor that uses an optical signal to scan a touch object.
  • the optical touch sensor can be used to scan a touch object, such as a user's finger, a stylus, etc., on the surface of the display screen using an optical signal.
  • the technical principle can include infrared touch technology, charge coupled device (CCD)/complementary metal oxide semiconductor (Complementary Metal Oxide Semiconductor, CMOS) touch technology, non-total internal reflection touch Technology (Frustrated Total Internal Reflection, FITR), laser plane touch technology (Laser Light Plane, LLP) and light-emitting diode plane multi-touch technology (Light emitting Diode Light Plane, LED-LP), and so on.
  • CCD charge coupled device
  • CMOS Complementary metal oxide semiconductor
  • FITR non-total internal reflection touch Technology
  • laser plane touch technology Laser Light Plane, LLP
  • light-emitting diode plane multi-touch technology Light emitting Diode Light Plane, LED-LP
  • the surface of the display screen may refer to the surface of the glass cover plate of the display screen.
  • a graphics processor (Graphics Processing Unit, GPU) is set in the interactive tablet, and the GPU can provide video processing functions, such as receiving information from the host controller, placing it in the frame memory, and generating a display screen for video signals in a partition-driven manner.
  • the required serial display data and scan control timing, the display screen plays according to the serial display data and scan control timing, so as to display various pictures on the display screen.
  • the user triggers the writing mode.
  • an interface can be displayed on the display screen, and the user can select the configuration parameters of the handwriting in the interface, such as color, width, etc. Configure parameters to display handwriting on this interface.
  • the interface for writing can be an independent interface.
  • the interactive tablet provides an electronic whiteboard
  • the user triggers a control operation to display the electronic whiteboard in the interactive tablet
  • the interactive tablet receives the control operation and displays the electronic whiteboard , as a writing interface
  • the user can trigger a touch operation on the electronic whiteboard
  • the touch operation is represented in the form of a track, so it can be called a touch track
  • the interactive tablet can be displayed on the screen of the interactive tablet.
  • the handwriting corresponding to the touch track is displayed on the screen.
  • the above control operations for displaying the electronic whiteboard include but are not limited to touch operations, keyboard operations, mouse operations and physical key operations.
  • the interface used for writing can also be an interface with a background, for example, the interactive tablet displays the local courseware, displays the transmission of the screen transmission device (Universal Serial Bus Dongle, USB Dongle) And it belongs to the screen image and other data of the source device (such as laptop, etc.), the user triggers the annotation operation in the interactive tablet, the interactive tablet receives the annotation operation, freezes the courseware, screen image and other data, making it the background, that is, maintaining the interactive tablet.
  • the current frame picture of the displayed courseware, screen picture and other data, and a mask layer is generated on the courseware, screen picture and other data, so as to serve as a writing interface.
  • Courseware can refer to the course documents produced according to the requirements of teaching, after the determination of teaching objectives, the analysis of teaching content and tasks, the structure of teaching activities and the design of interfaces.
  • the courseware can be Word documents, presentations (PowerPoint). , PPT) and other public format files, and can also be a custom page composed of elements such as text, tables, and pictures, which is not limited in this embodiment.
  • Step 102 Determine a touch track generated when the touch object moves on the surface of the display screen.
  • a user can use a touch object such as a finger or a touch pen to trigger a touch track on the surface of the display screen of the interactive tablet, and the touch track can be used to write handwriting.
  • a touch object such as a finger or a touch pen
  • the touch track can be used to write handwriting.
  • the touch operation is mostly represented in the form of a track, which can be called a touch track. Therefore, the interactive tablet can receive a touch track triggered when each touch object moves on the surface of the display screen.
  • An optical touch sensor and a touch sensor (such as a piezoelectric sensor, a bone conduction sensor, and an elastic wave sensor) are respectively provided in the interactive tablet.
  • the optical touch sensor generates a touch signal for the touch track when the touch object approaches or touches the surface of the display screen and moves, and the touch sensor is used for the touch track when the touch object touches the surface of the display screen and moves Generate a touch signal.
  • the touch signal and the touch signal caused by the touch object touching the surface of the display screen should be related in dimensions such as time and position, that is, the touch trace triggered by the same touch object is in the same
  • the touch signal and the touch signal caused by the time point and the same position are related in the dimensions of time and position. Therefore, the touch signal and the touch signal caused when multiple touch objects approach or touch the surface of the display screen at the same time are related.
  • the correlation between these touch signals and the touch signals can be detected from the dimensions of time, location, etc., so as to distinguish the touch trajectories triggered by different touch objects.
  • the touch signal as the filtering condition, if the touch signal and the touch signal are detected at the same time and at the same place, it can be determined that the touch object moves on the surface of the display screen, thereby recording its touch track.
  • Step 103 Collect vibration signals generated when the touch object moves on the surface of the display screen, and use the vibration signals as target vibration signals.
  • the vibration sensor can be called to collect the vibration signal generated when the touch object moves on the surface of the display screen. signal as the target vibration signal.
  • Step 104 Determine the material of the touch object according to the target vibration signal.
  • Different types of touch objects have different materials, so that different types of touch objects have different characteristics when they vibrate.
  • the material of the touch object can be analyzed.
  • the material of the touching object can be analyzed by machine learning or deep learning, and the accuracy of machine learning or deep learning is high. If the manufacturer configures the standard touching object, the current touching object can be recognized by machine learning or deep learning. The material can obtain higher accuracy.
  • Machine learning models are classification models that apply machine learning, such as Support Vector Machine (SVM), Logistic Regression (LR), Gradient Tree Boosting (GBTs), such as Gradient Boosting Decision Trees (Gradient Boosting Decison Tree, GBDT), Gradient Boosting Regression Tree (GBRT)), decision tree, etc.
  • the deep learning model is a classification model applying deep learning, such as Convolutional Neural Networks, LeNet, AlexNet, Visual Geometry Group (VGG) network, Inception network, Residual Network (Residual Network, ResNet), Dense Connected Network (DenseNet) in CNN), etc.
  • the machine learning model or deep learning model collect the vibration signals generated when objects of different materials move on the surface of the display screen of the interactive tablet, as the sample vibration signal, and use the sample vibration signal and/or the spectrum information of the sample vibration signal as the training signal.
  • sample the material of the object is used as a label tag, and the parameters in the machine learning model or the deep learning model are trained according to the training sample and the Tag, when the model training is completed, the machine learning model or the deep learning model is marked as a material recognition model, That is, the material recognition model is a machine learning model or a deep learning model, and is used to recognize the material of the object.
  • the material recognition model can be determined, that is, the machine learning model or the deep learning model is loaded into the memory, and the previously trained parameters are applied.
  • the material output by the material recognition model is a preset material, it means that the user has used a touch object matched with the interactive tablet to trigger the touch operation. If the material output by the material recognition model is a material other than the preset material. For other materials, it means that the user uses a touch object that is not compatible with the interactive tablet to trigger the touch operation.
  • the material of the touching object can be analyzed through rules, and the operation of the rules is relatively simple.
  • the material of the touching object can be analyzed by rules, and the material of the current touching object can be recognized while maintaining while reducing the computational time.
  • the vibration signals generated when objects of different materials move on the surface of the display screen of the interactive tablet are collected, the vibration signals are used as the sample vibration signals, and features are extracted from the sample vibration signals and/or the spectrum information of the sample vibration signals information.
  • the feature information may include time-domain-based features or transform-domain-based nonlinear features, such as peak points, the interval between the i-th peak point and the i+1-th peak point, zero-crossing rate, short time energy, short-term autocorrelation function, short-term average amplitude difference, short-term power spectral density, spectral entropy, fundamental frequency, formant, etc., which are not limited in this embodiment.
  • feature information can be extracted from the target vibration signal and/or the spectrum information of the target vibration signal.
  • the feature information extracted from the sample vibration signal and/or the spectral information of the sample vibration signal is of the same type as the feature information extracted from the target vibration signal and/or the spectral information of the target vibration signal.
  • the feature information extracted from the target vibration signal and/or the spectral information of the target vibration signal is sequentially compared with the rules corresponding to each material object.
  • the material of the touch object is the same as the material corresponding to the rule, and belongs to the preset material, that is, the user uses the touch object matched with the interactive tablet to trigger the touch. operate.
  • the material of the touched object is different from the materials corresponding to all the rules, and belongs to other materials than the preset materials, that is, the user uses the same Touch objects that are not compatible with the interactive tablet trigger touch operations.
  • the material of the touch object can be analyzed by comparing the vibration signals.
  • the comparison of the vibration signals can be widely used.
  • the vibration signal of the custom touch object can be collected as a sample. , enrich the types of touch objects, and the expansibility of touch objects is strong, thus enriching the diversification of writing.
  • the vibration signal generated when the marked material object moves on the surface of the display screen can be collected, and the vibration signal can be used as the sample vibration signal.
  • touch objects can be pre-configured for the interactive tablet, and the materials of different types of touch objects are different, for example, wood, plastic, rubber, and so on.
  • the same touch object may contain a single material or multiple materials at the same time, for example, one end of the touch object is made of plastic, the other end of the touch object is made of rubber, and so on.
  • One or more vibration sensors are arranged in the position where vibration can be transmitted in the interactive tablet, such as the display screen, the back of the interactive tablet, etc., and the vibration sensor can be used to detect vibration.
  • the vibration sensor is, for example, a piezoelectric sensor, a bone conduction sensor, an elastic wave sensors, etc.
  • the characteristics of the vibration generated when objects of different materials touch the surface of the display screen are different.
  • the vibration signals generated when objects of different materials move on the surface of the display screen can be collected in advance.
  • the vibration signal is called Vibration signal for the sample.
  • sample vibration signals can be stored in the local database of the interactive tablet.
  • the vibration signal generated when the marked material object moves on the surface of the display screen can be searched from the database as the sample vibration signal.
  • the materials of different types of touch objects are different, so that the characteristics of different types of touch objects when they vibrate are different. Therefore, features (such as spectrum) can be extracted from each sample vibration signal in advance, and the characteristics of the target vibration signal (such as spectrum), match the characteristics of the target vibration signal with the characteristics of each sample vibration signal in turn, so as to realize the matching of the target vibration signal and the sample vibration signal (such as calculating the similarity between the frequency spectra), if the target vibration signal is The feature is successfully matched with the feature of a sample vibration signal (for example, the similarity is the highest and greater than or equal to the threshold), then it can be determined that the target vibration signal and the sample vibration signal are successfully matched, if the feature of the target vibration signal matches the feature of a sample vibration signal If the matching fails (for example, the similarity is less than the threshold), it can be determined that the target vibration signal and the sample vibration signal fail to match.
  • features such as spectrum
  • the target vibration signal is successfully matched with a sample vibration signal, it can be determined that the touch object is of the same material as the object corresponding to the successfully matched sample vibration signal, and belongs to the preset material, that is, the user uses the touch object matched with the interactive tablet to trigger the touch. control operation.
  • the target vibration signal fails to match with all sample vibration signals, it can be determined that the material of the touch object is different from the preset object and belongs to other materials than the preset material, that is, the user uses a touch that is not compatible with the interactive tablet.
  • Objects trigger touch operations.
  • vibration sensors such as piezoelectric sensors and bone conduction sensors can be used to detect vibration signals.
  • the vibration sensor can transmit the target vibration signal to the processor of the interactive tablet. Determines the texture of the touch object in the processor of .
  • the vibration signals detected by vibration sensors are elastic wave signals, and the elastic wave signals triggered by objects of different materials are different. Therefore, elastic wave sensors can detect the material of the object based on the characteristics of the elastic wave signal.
  • the mechanical vibration below the audio frequency, the sound in the audio frequency range, and the ultrasonic wave beyond the audio frequency are all wave phenomena of gas, liquid, solid and other media. Compared with light and electromagnetic waves, this wave phenomenon is called elastic wave.
  • the material particles on the surface of the display screen leave the equilibrium position due to pressure, that is, when strain occurs, the particles are in the elastic force.
  • the vibration occurs under the action of the glass, and at the same time causes the strain and vibration of the particles around the glass.
  • the propagation process of the vibration formed in the elastic medium is called elastic wave. Inside the elastic wave sensor, the generated elastic wave passes through the contacting piezoelectric sensor. After the piezoelectric sensor is subjected to force, a charge is generated on the surface. After the charge is amplified and transformed by the amplifier and the measuring circuit, it becomes an electrical output proportional to the external force.
  • the charge signal is introduced into the touch controller, processed by the analog circuit in the touch controller and converted into a digital signal, and finally the final result is output through algorithm processing.
  • elastic wave sensors can also be used to detect the material of the touch object.
  • the elastic wave sensor provides an application programming interface (API), and the processor of the interactive tablet can call the elastic wave sensor according to the specification of the API.
  • the elastic wave sensor determines the material of the touching object according to the target vibration signal, and transmits it to the The processor of the interactive tablet.
  • the above method of determining the material of the touch object is only an example.
  • other methods of determining the material of the touch object may be set according to actual conditions, which are not limited in the embodiments of the present application.
  • those skilled in the art can also adopt other methods of determining the material of the touch object according to actual needs, which are not limited in the embodiments of the present application.
  • Step 105 configure an identifier for the touch object according to the material.
  • the interactive tablet may be configured with one or more touch objects, and these touch objects may be configured by a manufacturer producing the interactive tablet or configured by a user, which is not limited in this embodiment.
  • a corresponding identification (such as an identity document (ID)) can be configured, which is associated with the writing style.
  • ID an identity document
  • the writing style can be preset and represented by a specified identifier (such as ID). Therefore, if the material of the touch object is a preset material, the preset can be configured for the touch object. Material corresponding to the logo.
  • a default identifier such as ID
  • the material of the touch object is not the preset material, configure the default identifier for the touch object.
  • the default logo is not the same as the logo corresponding to the preset material, and the writing style associated with the default logo is generally different from the writing style associated with the logo corresponding to the preset material.
  • the writing style associated with the default logo and the writing style associated with the logo corresponding to the preset material are adjusted, which is not limited in this embodiment.
  • Step 106 on the writing interface, perform an operation related to writing along the touch track and according to the mark.
  • a touch data packet can be generated, and the touch point data included in the touch data packet includes at least one of the following items: state, touch ID, X coordinate, Y coordinate, width, height .
  • the upper-layer application after the upper-layer application receives the touch data packet, it can parse the touch data packet and read the X coordinate, Y coordinate and other data representing the touch track; on the other hand, after the upper-layer application receives the configuration information, it can Parse the writing style associated with the identifier, and perform writing-related operations according to the writing style during the process of moving along the touch track.
  • configuration information for writing can be preset, and the configuration information includes the writing style.
  • the configuration information can be set by default when the interactive tablet leaves the factory, or can be set by the user.
  • the configuration information can be used for the interactive tablet. All applications take effect, and can also take effect for a specified application of the interactive tablet, and can also take effect for a specified user (represented by a user ID), which is not limited in this embodiment.
  • the configuration information associated with the identification and used for writing is extracted, so as to execute operations related to writing along the touch track and according to the configuration information on the writing interface.
  • a user can use one touch object fixedly.
  • different forms of content can be written, and the content written by different users can be distinguished.
  • the writing tool and operation parameters can be recorded in the configuration information, so the writing tool and the operation parameters associated with the identification can be read from the configuration information.
  • the configuration information includes writing tools and operating parameters.
  • the writing tool may refer to a tool for writing, such as a pen, an eraser, etc.
  • the operation parameter may refer to a parameter of using the writing tool.
  • the operation parameters include at least one of the following: the color of the handwriting (eg, red, blue, black, green, etc.), and the width of the handwriting (eg, 1 pt, 2 pt, etc.).
  • the operation parameters include at least one of the following: width of erasure, type of erasure.
  • Types of erasure include erasing handwriting located in the area where the eraser passes, and erasing the entire handwriting.
  • writing tools and their operating parameters are only examples.
  • other writing tools and their operating parameters can be set according to actual conditions. Rounded corner size, transparency, etc., are not limited in this embodiment of the present application.
  • those skilled in the art may also adopt other writing instruments and their operating parameters according to actual needs, which are not limited in the embodiments of the present application.
  • the writing-related operations can be performed on the writing interface along the touch track, simulating the writing tool, and according to the operation parameters.
  • the writing tool can be simulated and the operations that can be presented by the writing tool can be performed according to the corresponding operation parameters.
  • the writing tool is a pen
  • handwriting is displayed on the writing interface along the touch track and according to the operation parameters.
  • the handwriting is erased on the writing interface along the touch track and according to the operation parameters.
  • the writing tool is a selection tool
  • elements such as handwriting, pictures, icons, tables, etc.
  • the above example may be applied to different touch objects independently, or may be applied to the same touch object, which is not limited in this embodiment.
  • one end of the touch object 201 is made of wood to simulate a pen
  • the other end of the touch object is made of rubber to simulate an eraser
  • one end of the touch object 202 is made of plastic. It is used to simulate a pen
  • the other end of the touch object is made of rubber to simulate an eraser.
  • the user can write according to the habit of using a pencil, and there is no need to additionally learn a shortcut for calling the eraser function, and the writing efficiency is high.
  • an interface for writing is displayed on the display screen, the touch trace generated when the touch object moves on the surface of the display screen is determined, the vibration signal generated when the touch object moves on the surface of the display screen is collected, and the vibration signal is collected.
  • the signal is used as the target vibration signal, the material of the touch object is determined according to the target vibration signal, the mark is configured for the touch object according to the material, and the writing-related operations are performed on the writing interface along the touch track and according to the mark, based on different touch objects on the display screen.
  • the vibration characteristics of the moving surface of the device are different. Therefore, the material of different touch objects can be identified through the target vibration signal, and the configuration of writing can be automatically switched by switching the touch objects of different materials.
  • FIG. 3 is a structural block diagram of a writing device provided in Embodiment 2 of the present application, which is applied to an interactive tablet.
  • the device may specifically include the following modules: a writing interface display module 301, configured to display an interface for writing on the display screen
  • the touch track determination module 302 is configured to determine the touch track generated when the touch object moves on the surface of the display screen;
  • the target vibration signal detection module 303 is configured to collect the movement of the touch object on the surface of the display screen
  • the vibration signal generated at the time of reading, the vibration signal is used as the target vibration signal;
  • the material identification module 304 is set to determine the material of the touch object according to the target vibration signal;
  • the identification configuration module 305 is set to be based on the material.
  • the writing operation execution module 306 is configured to execute a writing-related operation along the touch track and according to the identifier on the writing interface.
  • the material identification module 304 includes: a model determination module configured to determine a material identification model, where the material identification model is a machine learning model and/or a deep learning model, and is used to identify the material of an object a model identification module, configured to input the target vibration signal or the spectral information of the target vibration signal into the material identification model to output the material of the touch object.
  • a model determination module configured to determine a material identification model, where the material identification model is a machine learning model and/or a deep learning model, and is used to identify the material of an object
  • a model identification module configured to input the target vibration signal or the spectral information of the target vibration signal into the material identification model to output the material of the touch object.
  • the material identification module 304 includes: a feature information extraction module configured to extract feature information from the target vibration signal and/or spectrum information of the target vibration signal; the first material The determining module is configured to determine that the material of the touch object is the same as the material corresponding to the preset rule if the feature information conforms to the preset rule; the second material determining module is configured to determine if the feature information does not match the preset rule. If the preset rule is met, it is determined that the material of the touch object is different from the material corresponding to the preset rule.
  • the material identification module 304 includes: a sample vibration signal acquisition module, configured to collect vibration signals generated when an object marked with a material moves on the surface of the display screen, as a sample vibration signal , the object is represented by a designated identifier; the third material determination module is set to determine that the touch object is of the same material as the object if the target vibration signal is successfully matched with the sample vibration signal; the fourth material A determining module, configured to determine that the material of the touch object and the object are different if the target vibration signal fails to match the sample vibration signal.
  • the identification configuration module 305 includes: a first identification configuration module, configured to configure the touch object corresponding to the preset material if the touch object is a preset material
  • the second identification configuration module is configured to configure a default identification for the touched object if the touch object is not a preset material.
  • the writing operation execution module 306 includes: a configuration extraction module, configured to extract configuration information associated with the identifier and used for writing; a configuration writing module, configured to extract configuration information on the writing interface The operation related to writing is performed according to the configuration information along the touch track.
  • the writing operation execution module 307 includes: a configuration information reading module, configured to read the writing tool and operating parameters associated with the identification; a tool simulation module, configured to The touch track and simulating the writing tool perform operations related to writing according to the operation parameters.
  • the tool simulation module includes: a handwriting display module, configured to display the writing tool along the touch track and according to the operation parameters on the writing interface if the writing tool is a pen handwriting.
  • the operating parameters include at least one of the following: the color of the handwriting and the width of the handwriting.
  • the tool simulation module includes: a handwriting elimination module, which is configured to, if the writing tool is an eraser, follow the described operation along the touch track on the writing interface parameter to remove handwriting.
  • the operation parameters include at least one of the following: a width of elimination and a type of elimination.
  • the tool simulation module includes: an element selection module configured to select an element along the touch track on the writing interface if the writing tool is a selection tool.
  • the writing device provided by the embodiment of the present application can execute the writing method provided by any embodiment of the present application, and has functional modules corresponding to the execution method.
  • FIG. 4 is a schematic structural diagram of an interactive tablet provided in Embodiment 3 of the present application.
  • Figure 4 shows a block diagram of an exemplary interactive tablet 12 suitable for use in implementing embodiments of the present application.
  • the interactive tablet 12 shown in FIG. 4 is only an example, and should not impose any limitations on the functions and scope of use of the embodiments of the present application.
  • the interactive tablet 12 takes the form of a general-purpose computing device.
  • Components of the interactive tablet 12 may include, but are not limited to, one or more processors or processing units 16 , a system memory 28 , and a bus 18 that connects the various system components including the system memory 28 and the processing unit 16 .
  • Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of a variety of bus structures.
  • these architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, MicroChannel Architecture (MAC) bus, Enhanced ISA bus, Video Electronics Standards Association (Video Electronics Standards Association) , VESA) local bus and Peripheral Component Interconnect (PCI) bus.
  • Interactive tablet 12 includes a variety of computer system readable media. These media can be any available media that can be accessed by interactive tablet 12, including volatile and non-volatile media, removable and non-removable media.
  • System memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and/or cache memory 32 .
  • the interactive tablet 12 may further include other removable/non-removable, volatile/non-volatile computer system storage media.
  • storage system 34 may be used to read and write to non-removable, non-volatile magnetic media (not shown in FIG. 4, commonly referred to as a "hard drive").
  • a magnetic disk drive may be provided for reading and writing to removable non-volatile magnetic disks (eg "floppy disks"), as well as removable non-volatile optical disks (eg Compact Disc Read-Only Memory) Read-Only Memory, CD-ROM), digital video disc read-only memory (Digital Video Disc Read-Only Memory, DVD-ROM) or other optical media) CD-ROM drive for reading and writing.
  • each drive may be connected to bus 18 through one or more data media interfaces.
  • Memory 28 may include at least one program product having a set (eg, at least one) of program modules configured to perform the functions of various embodiments of the present application.
  • a program/utility 40 having a set (at least one) of program modules 42, which may be stored, for example, in memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data , each or some combination of these examples may include an implementation of a network environment.
  • Program modules 42 generally perform the functions and/or methods of the embodiments described herein.
  • the interactive tablet 12 may also communicate with one or more external devices 14 (eg, keyboard, pointing device, display 24, etc.), with one or more devices that enable a user to interact with the interactive tablet 12, and/or with Any device (eg, network card, modem, etc.) that enables the interactive tablet 12 to communicate with one or more other computing devices. Such communication may take place through an input/output (I/O) interface 22 .
  • the interactive tablet 12 can also communicate with one or more networks (eg, Local Area Network (LAN), Wide Area Network (WAN), and/or public networks such as the Internet) through the network adapter 20. As shown, network adapter 20 communicates with other modules of interactive tablet 12 via bus 18 .
  • network adapter 20 communicates with other modules of interactive tablet 12 via bus 18 .
  • the processing unit 16 executes various functional applications and data processing by running the programs stored in the system memory 28, for example, implementing the writing method provided by the embodiments of the present application.
  • the fifth embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, each process of the above-mentioned writing method can be realized, and the same technical effect can be achieved, In order to avoid repetition, details are not repeated here.
  • the computer-readable storage medium may include, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination of the above. More specific examples (non-exhaustive list) of computer readable storage media include: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read only memory (Read Only Memory) , ROM), Electrically Erasable Programmable read only memory (EPROM) or flash memory, optical fiber, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or the above any suitable combination.
  • a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

Abstract

本申请实施例提供了一种书写方法、装置、交互平板和存储介质，包括：在显示屏上显示用于书写的界面（S101），确定触摸物在显示屏的表面移动时产生的触控轨迹（S102），采集触摸物在显示屏的表面移动时产生的振动信号，将振动信号作为目标振动信号（S103），根据目标振动信号确定触摸物的材质（S104），依据材质为触摸物配置标识（S105），在书写界面上沿触控轨迹、按照标识执行与书写相关的操作（S106）。本发明的有益效果是：自动切换书写的配置，无需用户调出控制面板人为调整，提高了操作便利性。

Description

书写方法、装置、交互平板和存储介质
本申请要求在2021年04月22日提交中国专利局、申请号为202110438378.X的中国专利申请的优先权，该申请的全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及触摸控制的技术领域，例如涉及一种书写方法、装置、交互平板和存储介质。
背景技术
交互平板正在逐步革新教育和办公领域。使用触控方式书写能够以更高效的方式来突出或者备注重要内容，从而提升学习、工作的效率与质量。
交互平板支持多点触控的操作方式，即支持多个用户同时书写，为了区分不同用户书写的内容，通常是每个用户在书写之前，调出用于控制书写的面板，在该面板上设置与在先相同的配置。
然而，在多人轮流解答与实时批改习题的课堂、多人反复讨论与实时记录的会议等场景中，用户需要频繁地切换书写的配置，操作较为繁琐，阻碍用户之间的沟通，并且，配置设置容易出错，导致记录的内容容易发生混淆，对后期的内容整理带来困扰。
发明内容
本申请实施例提出了一种书写方法、装置、交互平板和存储介质，以解决在交互平板上频繁切换书写的配置较为繁琐的问题。
本申请实施例提供了一种书写方法，应用于交互平板，所述方法包括：
在显示屏上显示用于书写的界面；
确定触摸物在所述显示屏的表面移动时产生的触控轨迹；
采集所述触摸物在所述显示屏的表面移动时产生的振动信号，将所述振动信号作为目标振动信号；
根据所述目标振动信号确定所述触摸物的材质；
依据所述材质为所述触摸物配置标识；
在所述书写界面上沿所述触控轨迹、按照所述标识执行与书写相关的操作。
本申请实施例还提供了一种书写装置，应用于交互平板，所述装置包括：
书写界面显示模块，设置为在显示屏上显示用于书写的界面；
触控轨迹确定模块，设置为确定触摸物在所述显示屏的表面移动时产生的触控轨迹；
目标振动信号检测模块，设置为采集所述触摸物在所述显示屏的表面移动时产生的振动信号，将所述振动信号作为目标振动信号；
材质识别模块，设置为根据所述目标振动信号确定所述触摸物的材质；
标识配置模块，设置为依据所述材质为所述触摸物配置标识；
书写操作执行模块，设置为在所述书写界面上沿所述触控轨迹、按照所述标识执行与书写相关的操作。
本申请实施例还提供了一种交互平板，所述交互平板包括：
一个或多个处理器；
存储器，设置为存储一个或多个程序，当所述一个或多个程序被所述一个或多个处理器执行时，所述一个或多个处理器实现本申请任意实施例所述的书写方法。
本申请实施例还提供了一种计算机可读存储介质，所述计算机可读存储介质上存储计算机程序，所述计算机程序被处理器执行时实现本申请任意实施例所述的书写方法。
附图说明
图1为本申请实施例一提供的一种书写方法的流程图；
图2A为本申请实施例一提供的一种书写操作的示例图；
图2B为本申请实施例一提供的另一种书写操作的示例图；
图3为本申请实施例二提供的一种书写装置的结构示意图；
图4为本申请实施例三提供的一种交互平板的结构示意图。
具体实施方式
下面结合附图和实施例对本申请作说明。可以理解的是，此处所描述的具体实施例仅仅用于解释本申请，而非对本申请的限定。另外还需要说明的是，为了便于描述，附图中仅示出了与本申请相关的部分而非全部结构。
实施例一
图1为本申请实施例一提供的一种书写方法的流程图，本实施例可适用于 识别不同的触摸物、从而切换至相应的配置进行书写的情况，该方法可以由书写装置来执行，该书写装置可以由软件和/或硬件实现，可配置在交互平板中，所述书写方法包括如下步骤：
步骤101、在显示屏上显示用于书写的界面。
在交互平板中配置有显示屏，该显示屏包括发光二极管(Light Emitting Diode，LED)显示屏、有机发光二极管(Organic Light-Emitting Diode，OLED)显示屏、液晶显示屏(Liquid Crystal Display，LCD)，等等。
通过在显示屏表面的两侧设置光学触控传感器，可以构成触控显示屏。
光学触控传感器为使用光信号扫描触摸物的传感器，在本实施例中，光学触控传感器可用于在显示屏的表面使用光信号扫描触摸物，如用户的手指、触控笔等。从技术原理来区别触控显示屏，技术原理可以包括红外触摸技术、电荷耦合器件(charge coupled device，CCD)/互补金属氧化物半导体(Complementary Metal Oxide Semiconductor，CMOS)触摸技术、非全内反射触摸技术(Frustrated Total Internal Reflection，FITR)、激光平面触摸技术(Laser Light Plane，LLP)以及发光二极管平面多点触摸技术(Light emitting Diode Light Plane，LED-LP)，等等。
为了保护显示屏不被触摸物划伤，在显示屏中会设置玻璃盖板，因此，在本说明书的实施例中，显示屏的表面，可以指的是显示屏的玻璃盖板表面。
在交互平板中设置有图形处理器(Graphics Processing Unit，GPU)，GPU可提供视频处理功能，例如，接收来自主机控制器的信息，置入帧存储器，按分区驱动方式针对视频信号生成显示屏所需的串行显示数据和扫描控制时序，显示屏按照串行显示数据和扫描控制时序进行播放，从而在显示屏显示各种画面。
在交互平板中，用户触发书写模式，此时，在书写模式中，可在显示屏上显示一界面，用户可以在该界面中选择笔迹的配置参数，如颜色、宽度等，从而交互平板按照该配置参数在该界面上显示笔迹。
在实际应用中，用于书写的界面可以为独立的界面，示例性地，交互平板提供电子白板，用户在交互平板中触发显示该电子白板的控制操作，交互平板接收该控制操作，显示电子白板，作为书写的界面，此时，用户可在电子白板上触发触控操作，该触控操作以轨迹的形式表示，因此，可称之为触控轨迹，则交互平板可在该交互平板的屏幕上显示与该触控轨迹相应的笔迹。上述显示该电子白板的控制操作包括但不限于触控操作、键盘操作、鼠标操作以及物理按键操作。
此外，用于书写的界面也可以为具有背景的界面，示例性地，交互平板显示本地的课件、显示传屏设备(通用串行总线软件保护器(Universal Serial Bus Dongle，USB Dongle))传输的且属于源设备(如笔记本电脑等)的屏幕画面等数据，用户在交互平板中触发批注操作，交互平板接收该批注操作，冻结课件、屏幕画面等数据，使之成为背景，即维持交互平板中显示的课件、屏幕画面等数据的当前帧画面，并在课件、屏幕画面等数据之上生成蒙层，从而作为书写的界面。
课件，可以指是根据教学的要求，经过教学目标确定、教学内容和任务分析、教学活动结构及界面设计等环节，而加以制作的课程文档，例如，该课件可以为Word文档、演示文稿(PowerPoint，PPT)等公用格式的文件，也可以为文字、表格、图片等元素组合而成的自定义页面，本实施例对此不加以限制。
步骤102、确定触摸物在显示屏的表面移动时产生的触控轨迹。
用户可以使用手指、触摸笔等触摸物在交互平板的显示屏的表面触发触控轨迹，该触控轨迹可用于书写笔迹。在教育、会议等场景，可能会存在多人同时作答习题、多人同时记录会议纪要等情况，此时，多个(至少两个)触摸物在不同的位置同时触发用于书写的触控操作，该触控操作多以轨迹的形式表示，可称之为触控轨迹，因此，交互平板可接收每个触摸物在显示屏的表面移动时触发的触控轨迹。
在交互平板中分别设置有光学触控传感器以及触碰传感器(如压电传感器、骨传导传感器、弹性波传感器)。光学触控传感器在触摸物接近或触碰显示屏的表面并移动时、对触控轨迹产生触控信号，触碰传感器用于在触摸物触碰显示屏的表面并移动时、对触控轨迹产生触碰信号。
针对同一触摸物，由该触摸物在触碰显示屏的表面时所引发的触控信号与触碰信号应该在时间、位置等维度上是关联的，即同一触摸物触发的触控轨迹在同一时间点、同一位置引发的触控信号与触碰信号在时间和位置等维度上是关联的，因此，针对多个触摸物同时接近或触碰显示屏的表面时引起的触控信号与触碰信号，可以从时间、位置等维度上检测这些触控信号与触碰信号的关联性，从而区分不同触摸物触发的触控轨迹。
以触碰信号作为过滤的条件，在同一时间、同一地点同时检测到触控信号与触碰信号，则可以确定触摸物在显示屏的表面移动，从而记录其触控轨迹。
步骤103、采集触摸物在显示屏的表面移动时产生的振动信号，将所述振动信号作为目标振动信号。
在用户使用触摸物触发触控操作的过程中，可调用振动传感器采集触摸物 在显示屏的表面移动时产生的振动信号，为便于区分，可将触摸物在显示屏的表面移动时产生的振动信号作为目标振动信号。
步骤104、根据目标振动信号确定触摸物的材质。
不同类型的触摸物的材质有所不同，使得不同类型的触摸物振动时的特性有所不同，通过采集当前触摸物的目标振动信号，可分析出触摸物的材质。
在一种方式中，可通过机器学习或深度学习分析触摸物的材质，机器学习或深度学习的精确度高，在厂商配置标准的触摸物的情况下，通过机器学习或深度学习识别当前触摸物的材质可以获得较高的精确度。
在本方式中，可以预先设定机器学习模型或深度学习模型。机器学习模型为应用机器学习的分类模型，例如，支持向量机(Support Vector Machine，SVM)、逻辑回归(Logistic Regression，LR)，梯度提升树((Gradient Tree Boosting，GBTs)，如梯度提升决策树(Gradient Boosting Decison Tree，GBDT)、梯度提升回归树(Gradient Boosting Regression Tree，GBRT))、决策树等等，深度学习模型为应用深度学习的分类模型，例如，卷积神经网络(Convolutional Neural Networks，CNN)中的LeNet、AlexNet、视觉几何组(Visual Geometry Group，VGG)网络、Inception网络、残差网络(Residual Network，ResNet)、全连接网络(Dense Connected Network，DenseNet)，等等。
针对机器学习模型或深度学习模型，采集不同材质的物体在交互平板的显示屏的表面移动时产生的振动信号，作为样本振动信号，以样本振动信号和/或样本振动信号的频谱信息作为训练的样本，该物体的材质作为标注Tag，根据所述训练样本和Tag训练机器学习模型或深度学习模型中的参数，在模型训练完成时，将该机器学习模型或深度学习模型标记为材质识别模型，即，该材质识别模型为机器学习模型或深度学习模型，用于识别物体的材质。
若当前触摸物在交互平板的显示屏的表面移动，则可以确定材质识别模型，即，将机器学习模型或深度学习模型加载至内存，并应用在先训练的参数。
将目标振动信号和/或目标振动信号的频谱信息输入材质识别模型中，材质识别模型按照自身的逻辑对目标振动信号或目标振动信号的频谱信息进行处理，以输出触摸物的材质。
需要说明的是，若材质识别模型输出的材质为预设的材质，表示用户使用了与交互平板配套的触摸物触发触控操作，若材质识别模型输出的材质为除预设的材质之外的其他材质，表示用户使用了与交互平板不配套的触摸物触发触控操作。
在另一种方式中，可通过规则分析触摸物的材质，规则的运算较为简单， 在厂商配置标准的触摸物等情况下，通过规则分析触摸物的材质，可以在保持识别当前触摸物的材质的精确度的同时，降低运算的耗时。
在本方式中，采集不同材质的物体在交互平板的显示屏的表面移动时产生的振动信号，将所述振动信号作为样本振动信号，从样本振动信号和/或样本振动信号的频谱信息提取特征信息。
该特征信息可以包括基于时域的特征，也可以包括基于变换域的非线性特征，例如，峰值点、第i个峰值点与第i+1个峰值点之间的间隔、过零率、短时能量、短时自相关函数、短时平均幅度差、短时功率谱密度、谱熵、基频、共振峰，等等，本实施例对此不加以限制。
对不同材质的物体所对应的特征信息进行分析，在特征信息的维度下设置一个或多个可区分不同物体的材质的规则，例如，特征信息大于某个阈值、特征信息在某个范围内、特征信息之间的比值小于某个阈值，等等。
若当前触摸物在交互平板的显示屏的表面移动，则可以从目标振动信号和/或目标振动信号的频谱信息中提取特征信息。从样本振动信号和/或样本振动信号的频谱信息提取的特征信息，与，从目标振动信号和/或目标振动信号的频谱信息中提取的特征信息类型相同。
将从目标振动信号和/或目标振动信号的频谱信息中提取的特征信息依次与每种材质物体对应的规则进行比较。
若特征信息符合一种材质物体对应的预设的规则，则可以确定触摸物的材质与该规则对应的材质相同，属于预设的材质，即用户使用了与交互平板配套的触摸物触发触控操作。
若特征信息不符合预设的所有材质的物体的预设的规则，则确定触摸物的材质与所有的规则对应的材质不同，属于除预设的材质之外的其他材质，即用户使用了与交互平板不配套的触摸物触发触控操作。
在又一种方式中，可通过振动信号的对比分析触摸物的材质，振动信号的对比应用较为宽泛，在用户自定义触摸物等情况下，可以采集该自定义的触摸物的振动信号作为样本，丰富触摸物的类型，触摸物的扩展性强，从而丰富书写的多样化。
在本方式中，在交互平板出厂前、用户自定义触摸物等场合，可采集已标记材质的物体在显示屏的表面移动时产生的振动信号，将所述振动信号作为样本振动信号。
可以预先为交互平板配置不同类型的触摸物，不同类型的触摸物的材质有所不同，例如，木、塑料、橡胶，等等。
在同一触摸物中，可以包含单一的材质、也可以同时包含多个材质，例如，在触摸物的一端以塑料制作、在触摸物的另一端以橡胶制作，等等。
在交互平板中可传递振动的位置，如显示屏、交互平板的背面等，设置一个或多个振动传感器，该振动传感器可用于检测振动，振动传感器例如是压电传感器、骨传导传感器、弹性波传感器等。
不同材质的物体触碰显示屏的表面时产生的振动的特性有所不同，可以预先为不同材质的物体采集其在显示屏的表面移动时产生的振动信号，为便于区分，该振动信号称之为样本振动信号。
这些样本振动信号可存储在交互平板本地的数据库中，在触摸物触发触控操作时，可从数据库查找已标记材质的物体在显示屏的表面移动时产生的振动信号、作为样本振动信号。
不同类型的触摸物的材质有所不同，使得不同类型的触摸物振动时的特性有所不同，因此，可预先从各个样本振动信号提取特征(如频谱)，以及，提取目标振动信号的特征(如频谱)，依次将目标振动信号的特征与每个样本振动信号的特征进行匹配，从而实现将目标振动信号与样本振动信号进行匹配(如计算频谱之间的相似度)，如果目标振动信号的特征与一个样本振动信号的特征匹配成功(如相似度最高、且大于或等于阈值)，则可以确定目标振动信号与该样本振动信号匹配成功，如果目标振动信号的特征与一个样本振动信号的特征匹配失败(如相似度小于阈值)，则可以确定目标振动信号与该样本振动信号匹配失败。
若目标振动信号与一个样本振动信号匹配成功，则可以确定触摸物与匹配成功的样本振动信号对应的物体的材质相同，属于预设的材质，即用户使用了与交互平板配套的触摸物触发触控操作。
若目标振动信号与所有样本振动信号均匹配失败，则可以确定触摸物与预设的物体的材质不同，属于除预设的材质之外的其他材质，即用户使用了与交互平板不配套的触摸物触发触控操作。
在部分情况下，对于压电传感器、骨传导传感器等振动传感器，可用于检测振动信号，在用户触发触控操作时，振动传感器可将目标振动信号传输至交互平板的处理器，从而在交互平板的处理器中确定触摸物的材质。
在部分情况下，弹性波传感器等振动传感器检测的振动信号为弹性波信号，不同材质的物体触发的弹性波信号有所不同，因此，弹性波传感器可基于弹性波信号的特性检测物体的材质。
音频以下的机械振动，音频范围的声音，超过音频的超声波，这些都是气 体、液体、固体等介质的波动现象，相对于光和电磁波来说，这种波动现象叫做弹性波。
触摸物在接触到显示屏的表面(即玻璃盖板的表面)时，由于压力导致显示屏的表面(即玻璃盖板的表面)物质粒子离开平衡位置，即发生应变时，该粒子在弹性力的作用下发生振动，同时又引起玻璃周围粒子的应变和振动，这样形成的振动在弹性介质中的传播过程称为弹性波，在弹性波传感器内部，产生的弹性波通过接触的压电传感器，压电传感器受力后表面产生电荷，电荷经放大器和测量电路放大变换后，成为与外力成正比的电输出。电荷信号引入触碰控制器，由触碰控制器中的模拟电路处理后转换为数字信号，最后经过算法处理输出最终的结果。
因此，弹性波传感器除了可用于检测振动信号之外，还可用于检测触摸物的材质。
弹性波传感器提供应用程序接口(Application Programming Interface，API)，交互平板的处理器可按照该API的规范调用弹性波传感器，弹性波传感器根据目标振动信号确定触摸物的材质，并通过该API传输至交互平板的处理器。
当然，上述确定触摸物的材质的方式只是作为示例，在实施本申请实施例时，可以根据实际情况设置其它确定触摸物的材质的方式，本申请实施例对此不加以限制。另外，除了上述确定触摸物的材质的方式外，本领域技术人员还可以根据实际需要采用其它确定触摸物的材质的方式，本申请实施例对此也不加以限制。
步骤105、依据材质为触摸物配置标识。
在交互平板中，交互平板可配置一个或多个触摸物，这些触摸物可以是生产该交互平板的厂商配置的，也可以是用户配置的，本实施例对此不加以限制。
针对不同材质的触摸物，可以配置相应的标识(如身份标识(Identity document，ID))，该标识关联书写的样式，针对当前的触摸物，可检测其材质，从而对该材质的触摸物配置相应的标识。
对于作为触摸物样本的材质，可以预先设定书写的样式，并以指定的标识(如ID)表示，因此，若触摸物的材质为预设的材质，则可以为触摸物配置该预设的材质对应的标识。
对于作为触摸物样本的材质之外的其他材质，为了保证用户正常书写，可以统一以默认的标识(如ID)表示，若触摸物的材质并非预设的材质，则为触摸物配置默认的标识。
需要说明的是，默认的标识与预设的材质对应的标识并不相同，默认的标 识所关联的书写样式与预设的材质对应的标识所关联的书写样式一般并不相同，但用户可以对默认的标识所关联的书写样式与预设的材质对应的标识所关联的书写样式进行调整，本实施例对此不加以限制。
步骤106、在书写界面上沿触控轨迹、按照标识执行与书写相关的操作。
可以在检测触摸物触发的触控轨迹的过程中，生成触控数据包，触控数据包包括的触摸点数据至少有如下一项：状态、触控ID、X坐标、Y坐标、宽、高。
在本示例中，触控数据包的数据格式如表1所示：
表1
Figure PCTCN2022088060-appb-000001
一方面，在上层应用接收到触控数据包之后，可以解析触控数据包，读取表示触控轨迹的X坐标、Y坐标等数据，另一方面，在上层应用接收到配置信息之后，可以解析标识关联的书写样式，在沿触控轨迹移动的过程中、按照该书写样式执行与书写相关的操作。
针对该材质的触摸物可以预先设置用于书写的配置信息，该配置信息包括书写样式，配置信息可以在交互平板出厂时默认设置，也可以由用户设置，此外，该配置信息可以对交互平板的所有应用生效，也可以针对交互平板的一个指定的应用生效，还可以针对一个指定的用户(以用户ID表示)生效，本实施例对此不加以限制。
在触摸物书写时，提取与标识关联的、用于书写的配置信息，从而在书写界面上沿触控轨迹、按照配置信息执行与书写相关的操作。
一般情况下，在同一场课堂、会议等场景下，一个用户可固定使用一个触摸物，通过区分不同触摸物的配置信息，从而书写不同形式的内容，可以实现区分不同用户书写的内容。
在本申请的一个实施例中，在配置信息中可记录书写工具、操作参数，因此，可从配置信息中读取标识关联的书写工具、操作参数。
在本实施例中，配置信息包括书写工具、操作参数。书写工具可以指用来写字的工具，如笔、橡皮擦等，操作参数可以指使用书写工具的参数。
在一个示例中，若书写工具为笔，则操作参数包括如下的至少一种：笔迹的颜色(如红色、蓝色、黑色、绿色等)、笔迹的宽度(如1磅、2磅等)。
在另一个示例中，若书写工具为橡皮檫，则操作参数包括如下的至少一种： 消除的宽度、消除的类型。
消除的类型包括消除位于橡皮檫经过的区域中的笔迹，以及，消除整个笔迹。
当然，上述书写工具及其操作参数只是作为示例，在实施本申请实施例时，可以根据实际情况设置其它书写工具及其操作参数，例如，对于笔，其操作参数包括是否具有阴影、虚线类型、圆角大小、透明度，等等，本申请实施例对此不加以限制。另外，除了上述书写工具及其操作参数外，本领域技术人员还可以根据实际需要采用其它书写工具及其操作参数，本申请实施例对此也不加以限制。
此时，可在书写界面上沿触控轨迹、模拟书写工具并按照操作参数执行与书写相关的操作。
在沿触控轨迹移动的过程中、可以模拟书写工具并按照相应的操作参数执行该书写工具所能呈现的操作。
在一个示例中，若书写工具为笔，则在书写界面上沿触控轨迹、按照操作参数显示笔迹。
在另一个示例中，若书写工具为橡皮擦，则在书写界面上沿触控轨迹、按照操作参数消除笔迹。
在又一个示例中，若书写工具为选择工具，则在书写界面上沿触控轨迹选定元素(如笔迹、图片、图标、表格等)。
上述示例可以单独应用于不同的触摸物，也可以应用于同一个触摸物，本实施例对此不加以限制。
例如，如图2A和图2B所示，触摸物201的一端以木制作，用以模拟笔，在触摸物的另一端以橡胶制作，用以模拟橡皮檫，触摸物202的一端以塑料制作，用以模拟笔，在触摸物的另一端以橡胶制作，用以模拟橡皮檫。
假设用户A使用触摸物201中模拟笔的一端书写“123”，用户B使用触摸物202中模拟笔的一端书写“456”，“123”的颜色比“456”的颜色要深，“123”的宽度比“456”的宽度要小，可以明显区分用户A和用户B书写的内容。
若用户A想要修改“3”，则可以使用触摸物201中模拟橡皮檫的一端涂改“3”。
在本示例中，用户可以按照使用铅笔的习惯进行书写，无需额外学习调用橡皮檫功能的快捷方式，书写的效率高。
在本实施例中，在显示屏上显示用于书写的界面，确定触摸物在显示屏的 表面移动时产生的触控轨迹，采集触摸物在显示屏的表面移动时产生的振动信号，将振动信号作为目标振动信号，根据目标振动信号确定触摸物的材质，依据材质为触摸物配置标识，在书写界面上沿触控轨迹、按照标识执行与书写相关的操作，基于不同的触摸物在显示屏的表面移动时的振动特性不同，因此，通过目标振动信号可识别不同触摸物的材质，通过切换不同材质的触摸物书写可实现自动切换书写的配置，无需用户调出用于控制书写的面板、也无需在该面板上调整配置，大大提高了操作的简便性，在多人轮流解答与实时批改习题的课堂、多人反复讨论与实时记录的会议等场景中，尤为明显，方便了用户之间的沟通，并且，在一个用户固定使用一个触摸物的情况下，通过区分不同触摸物的配置信息，从而书写不同形式的内容，可以实现区分不同用户书写的内容，保证有序记录内容，方便后期的内容整理。
实施例二
图3为本申请实施例二提供的一种书写装置的结构框图，应用于交互平板，所述装置具体可以包括如下模块：书写界面显示模块301，设置为在显示屏上显示用于书写的界面；触控轨迹确定模块302，设置为确定触摸物在所述显示屏的表面移动时产生的触控轨迹；目标振动信号检测模块303，设置为采集所述触摸物在所述显示屏的表面移动时产生的振动信号，将所述振动信号作为目标振动信号；材质识别模块304，设置为根据所述目标振动信号确定所述触摸物的材质；标识配置模块305，设置为依据所述材质为所述触摸物配置标识；书写操作执行模块306，设置为在所述书写界面上沿所述触控轨迹、按照所述标识执行与书写相关的操作。
在本申请的一个实施例中，所述材质识别模块304包括：模型确定模块，设置为确定材质识别模型，所述材质识别模型为机器学习模型和/或深度学习模型，用于识别物体的材质；模型识别模块，设置为将所述目标振动信号或所述目标振动信号的频谱信息输入所述材质识别模型中，以输出所述触摸物的材质。
在本申请的又一个实施例中，所述材质识别模块304包括：特征信息提取模块，设置为从所述目标振动信号和/或所述目标振动信号的频谱信息中提取特征信息；第一材质确定模块，设置为若所述特征信息符合预设的规则，则确定所述触摸物的材质与所述预设的规则对应的材质相同；第二材质确定模块，设置为若所述特征信息不符合预设的规则，则确定所述触摸物的材质与所述预设的规则对应的材质不同。
在本申请的又一个实施例中，所述材质识别模块304包括：样本振动信号采集模块，设置为采集已标记材质的物体在所述显示屏的表面移动时产生的振 动信号、作为样本振动信号，所述物体以指定的标识表示；第三材质确定模块，设置为若所述目标振动信号与所述样本振动信号匹配成功，则确定所述触摸物与所述物体的材质相同；第四材质确定模块，设置为若所述目标振动信号与所述样本振动信号匹配失败，则确定所述触摸物与所述物体的材质不同。
在本申请的一个实施例中，所述标识配置模块305包括：第一标识配置模块，设置为若所述触摸物为预设的材质，则为所述触摸物配置所述预设的材质对应的标识；第二标识配置模块，设置为若所述触摸物并非预设的材质，则为所述触摸物配置默认的标识。
在本申请的一个实施例中，所述书写操作执行模块306包括：配置提取模块，设置为提取与所述标识关联的、用于书写的配置信息；配置书写模块，设置为在所述书写界面上沿所述触控轨迹、按照所述配置信息执行与书写相关的操作。
在本申请的一个实施例中，所述书写操作执行模块307包括：配置信息读取模块，设置为读取标识关联的书写工具、操作参数；工具模拟模块，设置为在所述书写界面上沿所述触控轨迹、模拟所述书写工具按照所述操作参数执行与书写相关的操作。
在本申请的一个实施例中，所述工具模拟模块包括：笔迹显示模块，设置为若所述书写工具为笔，则在所述书写界面上沿所述触控轨迹、按照所述操作参数显示笔迹。
所述操作参数包括如下的至少一种：笔迹的颜色、笔迹的宽度。
在本申请的另一个实施例中，所述工具模拟模块包括：笔迹消除模块，设置为若所述书写工具为橡皮擦，则在所述书写界面上沿所述触控轨迹、按照所述操作参数消除笔迹。
所述操作参数包括如下的至少一种：消除的宽度、消除的类型。
在本申请的又一个实施例中，所述工具模拟模块包括：元素选定模块，设置为若所述书写工具为选择工具，则在所述书写界面上沿所述触控轨迹选定元素。
本申请实施例所提供的书写装置可执行本申请任意实施例所提供的书写方法，具备执行方法相应的功能模块。
实施例三
图4为本申请实施例三提供的一种交互平板的结构示意图。图4示出了适 于用来实现本申请实施方式的示例性交互平板12的框图。图4显示的交互平板12仅仅是一个示例，不应对本申请实施例的功能和使用范围带来任何限制。
如图4所示，交互平板12以通用计算设备的形式表现。交互平板12的组件可以包括但不限于：一个或者多个处理器或者处理单元16，系统存储器28，连接不同系统组件(包括系统存储器28和处理单元16)的总线18。
总线18表示几类总线结构中的一种或多种，包括存储器总线或者存储器控制器，外围总线，图形加速端口，处理器或者使用多种总线结构中的任意总线结构的局域总线。举例来说，这些体系结构包括但不限于工业标准体系结构(Industry Standard Architecture，ISA)总线，微通道体系结构(MicroChannel Architecture，MAC)总线，增强型ISA总线、视频电子标准协会(Video Electronics Standards Association，VESA)局域总线以及外围组件互连(Peripheral Component Interconnect，PCI)总线。
交互平板12包括多种计算机系统可读介质。这些介质可以是任何能够被交互平板12访问的可用介质，包括易失性和非易失性介质，可移动的和不可移动的介质。
系统存储器28可以包括易失性存储器形式的计算机系统可读介质，例如随机存取存储器(Random Access Memory，RAM)30和/或高速缓存存储器32。交互平板12可以进一步包括其它可移动/不可移动的、易失性/非易失性计算机系统存储介质。仅作为举例，存储系统34可以用于读写不可移动的、非易失性磁介质(图4未显示，通常称为“硬盘驱动器”)。尽管图4中未示出，可以提供用于对可移动非易失性磁盘(例如“软盘”)读写的磁盘驱动器，以及对可移动非易失性光盘(例如光盘只读存储器(Compact Disc Read-Only Memory，CD-ROM),数字视频光盘只读存储器(Digital Video Disc Read-Only Memory，DVD-ROM)或者其它光介质)读写的光盘驱动器。在这些情况下，每个驱动器可以通过一个或者多个数据介质接口与总线18相连。存储器28可以包括至少一个程序产品，该程序产品具有一组(例如至少一个)程序模块，这些程序模块被配置以执行本申请各实施例的功能。
具有一组(至少一个)程序模块42的程序/实用工具40，可以存储在例如存储器28中，这样的程序模块42包括但不限于操作系统、一个或者多个应用程序、其它程序模块以及程序数据，这些示例中的每一个或某种组合中可能包括网络环境的实现。程序模块42通常执行本申请所描述的实施例中的功能和/或方法。
交互平板12也可以与一个或多个外部设备14(例如键盘、指向设备、显示器24等)通信，还可与一个或者多个使得用户能与该交互平板12交互的设备 通信，和/或与使得该交互平板12能与一个或多个其它计算设备进行通信的任何设备(例如网卡，调制解调器等等)通信。这种通信可以通过输入/输出(Input/Output，I/O)接口22进行。并且，交互平板12还可以通过网络适配器20与一个或者多个网络(例如局域网(Local Area Network，LAN)，广域网(Wide Area Network，WAN)和/或公共网络，例如因特网)通信。如图所示，网络适配器20通过总线18与交互平板12的其它模块通信。应当明白，尽管图中未示出，可以结合交互平板12使用其它硬件和/或软件模块，包括但不限于：微代码、设备驱动器、冗余处理单元、外部磁盘驱动阵列、磁盘阵列(Redundant Arrays of Independent Disks，RAID)系统、磁带驱动器以及数据备份存储系统等。
处理单元16通过运行存储在系统存储器28中的程序，从而执行各种功能应用以及数据处理，例如实现本申请实施例所提供的书写方法。
实施例五
本申请实施例五还提供一种计算机可读存储介质，计算机可读存储介质上存储有计算机程序，该计算机程序被处理器执行时实现上述书写方法的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
其中，计算机可读存储介质例如可以包括但不限于电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。计算机可读存储介质的更具体的例子(非穷举的列表)包括：具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机存取存储器(RAM)、只读存储器(Read Only Memory，ROM)、可擦式可编程只读存储器(Electrically Erasable Programmable read only memory，EPROM)或闪存、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本文件中，计算机可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。

Claims (10)

  1. 一种书写方法，应用于交互平板，包括：
    在显示屏上显示用于书写的界面；
    确定触摸物在所述显示屏的表面移动时产生的触控轨迹；
    采集所述触摸物在所述显示屏的表面移动时产生的振动信号，将所述振动信号作为目标振动信号；
    根据所述目标振动信号确定所述触摸物的材质；
    依据所述材质为所述触摸物配置标识；
    在所述书写界面上沿所述触控轨迹、按照所述标识执行与书写相关的操作。
  2. 根据权利要求1所述的方法，其中，所述根据所述目标振动信号确定所述触摸物的材质，包括：
    确定材质识别模型，所述材质识别模型为机器学习模型或深度学习模型，用于识别物体的材质；
    将所述目标振动信号和所述目标振动信号的频谱信息中的至少之一输入所述材质识别模型中，以输出所述触摸物的材质；
    或者，
    从所述目标振动信号和所述目标振动信号的频谱信息中的至少之一中提取特征信息；
    在所述特征信息符合预设的规则的情况下，确定所述触摸物的材质与所述预设的规则对应的材质相同；
    在所述特征信息不符合预设的规则的情况下，确定所述触摸物的材质与所述预设的规则对应的材质不同；
    或者，
    采集已标记材质的物体在所述显示屏的表面移动时产生的振动信号，将所 述振动信号作为样本振动信号；
    在所述目标振动信号与所述样本振动信号匹配成功的情况下，确定所述触摸物与所述物体的材质相同；
    在所述目标振动信号与所述样本振动信号匹配失败的情况下，确定所述触摸物与所述物体的材质不同。
  3. 根据权利要求1所述的方法，其中，所述依据所述材质为所述触摸物配置标识，包括：
    在所述触摸物为预设的材质的情况下，为所述触摸物配置所述预设的材质对应的标识；
    在所述触摸物不是预设的材质的情况下，为所述触摸物配置默认的标识。
  4. 根据权利要求1-3中任一项所述的方法，其中，所述在所述书写界面上沿所述触控轨迹、按照所述标识执行与书写相关的操作，包括：
    读取所述标识关联的书写工具、操作参数；
    在所述书写界面上沿所述触控轨迹、模拟所述书写工具按照所述操作参数执行与书写相关的操作。
  5. 根据权利要求4所述的方法，其中，所述在所述书写界面上沿所述触控轨迹、模拟所述书写工具按照所述操作参数执行与书写相关的操作，包括：
    在所述书写工具为笔的情况下，在所述书写界面上沿所述触控轨迹、按照所述操作参数显示笔迹；
    其中，所述操作参数包括如下的至少一种：
    笔迹的颜色、笔迹的宽度。
  6. 根据权利要求4所述的方法，其中，所述在所述书写界面上沿所述触控轨迹、模拟所述书写工具按照所述操作参数执行与书写相关的操作，包括：
    在所述书写工具为橡皮擦的情况下，在所述书写界面上沿所述触控轨迹、按照所述操作参数消除笔迹；
    其中，所述操作参数包括如下的至少一种：
    消除的宽度、消除的类型。
  7. 根据权利要求4所述的方法，其中，所述在所述书写界面上沿所述触控轨迹、模拟所述书写工具按照所述操作参数执行与书写相关的操作，包括：
    在所述书写工具为选择工具的情况下，在所述书写界面上沿所述触控轨迹选定元素。
  8. 一种书写装置，应用于交互平板，包括：
    书写界面显示模块，设置为在显示屏上显示用于书写的界面；
    触控轨迹确定模块，设置为确定触摸物在所述显示屏的表面移动时产生的触控轨迹；
    目标振动信号检测模块，设置为采集所述触摸物在所述显示屏的表面移动时产生的振动信号，将所述振动信号作为目标振动信号；
    材质识别模块，设置为根据所述目标振动信号确定所述触摸物的材质；
    标识配置模块，设置为依据所述材质为所述触摸物配置标识；
    书写操作执行模块，设置为在所述书写界面上沿所述触控轨迹、按照所述标识执行与书写相关的操作。
  9. 一种交互平板，包括：
    至少一个处理器；
    存储器，设置为存储至少一个程序，当所述至少一个程序被所述至少一个处理器执行时，所述至少一个处理器实现如权利要求1-7中任一项所述的书写方法。
  10. 一种计算机可读存储介质，存储计算机程序，所述计算机程序被处理器执行时实现如权利要求1-7中任一项所述的书写方法。
PCT/CN2022/088060 2021-04-22 2022-04-21 书写方法、装置、交互平板和存储介质 WO2022222979A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110438378.X 2021-04-22
CN202110438378 2021-04-22

Publications (1)

Publication Number Publication Date
WO2022222979A1 true WO2022222979A1 (zh) 2022-10-27

Family

ID=83721939

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/088060 WO2022222979A1 (zh) 2021-04-22 2022-04-21 书写方法、装置、交互平板和存储介质

Country Status (1)

Country Link
WO (1) WO2022222979A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117633276A (zh) * 2024-01-25 2024-03-01 江苏欧帝电子科技有限公司 一种书写轨迹录播方法、系统及终端

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004046391A (ja) * 2002-07-10 2004-02-12 Kokuyo Co Ltd 筆記具
US20050259322A1 (en) * 2004-05-20 2005-11-24 Boecker James A Touch-enabled projection screen incorporating vibration sensors
JP2009223839A (ja) * 2008-03-19 2009-10-01 Ricoh Co Ltd ペン型入力装置及び手書き入力方法
US20140104207A1 (en) * 2012-10-15 2014-04-17 Samsung Electronics Co., Ltd. Method of providing touch effect and electronic device therefor
US20160299615A1 (en) * 2014-09-25 2016-10-13 Qeexo, Co. Method and apparatus for classifying contacts with a touch sensitive device
US20160370887A1 (en) * 2015-06-19 2016-12-22 Beijing Lenovo Software Ltd. Apparatus and control method
JP2017004298A (ja) * 2015-06-11 2017-01-05 シャープ株式会社 文字入力システム、文字入力方法、及び、コンピュータプログラム
CN110941382A (zh) * 2019-10-09 2020-03-31 广州视源电子科技股份有限公司 智能交互平板的显示操作方法、装置、设备和存储介质
CN113608661A (zh) * 2021-05-12 2021-11-05 广州创知科技有限公司 一种人机交互方法及其交互平板、存储介质
CN113791700A (zh) * 2021-07-23 2021-12-14 广州创知科技有限公司 基于弹性波的交互方法、装置、交互平板和存储介质

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004046391A (ja) * 2002-07-10 2004-02-12 Kokuyo Co Ltd 筆記具
US20050259322A1 (en) * 2004-05-20 2005-11-24 Boecker James A Touch-enabled projection screen incorporating vibration sensors
JP2009223839A (ja) * 2008-03-19 2009-10-01 Ricoh Co Ltd ペン型入力装置及び手書き入力方法
US20140104207A1 (en) * 2012-10-15 2014-04-17 Samsung Electronics Co., Ltd. Method of providing touch effect and electronic device therefor
US20160299615A1 (en) * 2014-09-25 2016-10-13 Qeexo, Co. Method and apparatus for classifying contacts with a touch sensitive device
JP2017004298A (ja) * 2015-06-11 2017-01-05 シャープ株式会社 文字入力システム、文字入力方法、及び、コンピュータプログラム
US20160370887A1 (en) * 2015-06-19 2016-12-22 Beijing Lenovo Software Ltd. Apparatus and control method
CN110941382A (zh) * 2019-10-09 2020-03-31 广州视源电子科技股份有限公司 智能交互平板的显示操作方法、装置、设备和存储介质
CN113608661A (zh) * 2021-05-12 2021-11-05 广州创知科技有限公司 一种人机交互方法及其交互平板、存储介质
CN113791700A (zh) * 2021-07-23 2021-12-14 广州创知科技有限公司 基于弹性波的交互方法、装置、交互平板和存储介质

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117633276A (zh) * 2024-01-25 2024-03-01 江苏欧帝电子科技有限公司 一种书写轨迹录播方法、系统及终端

Similar Documents

Publication Publication Date Title
US9086798B2 (en) Associating information on a whiteboard with a user
US20200401831A1 (en) Content-aware selection
CN107273002B (zh) 手写输入答题方法、终端及计算机可读存储介质
JP5248696B1 (ja) 電子機器、手書き文書作成方法、及び手書き文書作成プログラム
CN102880360B (zh) 红外式多点交互电子白板系统及白板投影标定方法
US8595012B2 (en) Systems and methods for input device audio feedback
WO2017143860A1 (zh) 基于交互式电子白板的触摸操作方法及其系统
KR20100136529A (ko) 다중-양상 학습 시스템
US20130016126A1 (en) Drawing aid system for multi-touch devices
CN109634552A (zh) 一种应用于听写的报读控制方法及终端设备
WO2022222979A1 (zh) 书写方法、装置、交互平板和存储介质
CN110362217B (zh) 一种触摸交互式电子黑板板擦系统及擦除方法
US9031831B1 (en) Method and system for looking up words on a display screen by OCR comprising a set of base forms of recognized inflected words
CN101086693A (zh) 输入装置及其输入方法
CN113485570B (zh) 多人书写方法、装置、计算机可读存储介质及终端设备
CN104254815B (zh) 书写内容的空间上相关的注释的显示方法、装置和系统
US20170017632A1 (en) Methods and Systems of Annotating Local and Remote Display Screens
CN104951083A (zh) 一种远距离手势输入法及输入系统
CN104484078B (zh) 一种基于射频识别的人机交互系统及方法
Shilkrot et al. FingerReader: A finger-worn assistive augmentation
US11231850B1 (en) Hybrid digital and physical writing surface with transformational ink effects
Annett The fundamental issues of pen-based interaction with tablet devices
Kaaresoja Latency guidelines for touchscreen virtual button feedback
Habibi Detecting surface interactions via a wearable microphone to improve augmented reality text entry
KR20170092167A (ko) 시선 추적을 이용한 제어 장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22791085

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22791085

Country of ref document: EP

Kind code of ref document: A1