WO2024099087A1 - 触觉信号编码方法、触觉信号解码方法及相关设备 - Google Patents

触觉信号编码方法、触觉信号解码方法及相关设备 Download PDF

Info

Publication number
WO2024099087A1
WO2024099087A1 PCT/CN2023/126687 CN2023126687W WO2024099087A1 WO 2024099087 A1 WO2024099087 A1 WO 2024099087A1 CN 2023126687 W CN2023126687 W CN 2023126687W WO 2024099087 A1 WO2024099087 A1 WO 2024099087A1
Authority
WO
WIPO (PCT)
Prior art keywords
tactile signal
main
tactile
signal
encoded
Prior art date
Application number
PCT/CN2023/126687
Other languages
English (en)
French (fr)
Inventor
刘倩
蔺虎虎
吕卓逸
何大众
毕冉
Original Assignee
维沃移动通信有限公司
大连理工大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 维沃移动通信有限公司, 大连理工大学 filed Critical 维沃移动通信有限公司
Publication of WO2024099087A1 publication Critical patent/WO2024099087A1/zh

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties

Definitions

  • the present application belongs to the field of video coding and decoding technology, and specifically relates to a tactile signal encoding method, a tactile signal decoding method and related equipment.
  • the tactile signal also called texture tactile signal
  • multiple single-point video signals are encoded one by one to achieve the encoding of multi-point visual signals.
  • the encoded tactile signal has a certain redundancy. Therefore, there is a problem of low compression rate of tactile signals in the related art.
  • the embodiments of the present application provide a tactile signal encoding method, a tactile signal decoding method and related devices, which can solve the problem of low compression rate of tactile signals.
  • a tactile signal encoding method comprising:
  • the content to be encoded, the spatial information of the main tactile signal and the first mask corresponding to the main tactile signal are encoded to obtain a code stream of the tactile signal; wherein the content to be encoded includes a first object to be encoded for representing the main tactile signal and a second object to be encoded for representing the secondary tactile signal corresponding to the main tactile signal.
  • a tactile signal decoding method comprising:
  • the secondary haptic signal existing at a surrounding position of the main haptic signal is reconstructed based on the second to-be-decoded object and the existence of the secondary haptic signal at a surrounding position of the main haptic signal.
  • a tactile signal encoding device comprising:
  • a first determining module configured to determine a main tactile signal and spatial information of the main tactile signal among at least two tactile signals
  • a second determining module configured to determine a first model corresponding to the main tactile signal according to each of the main tactile signals and spatial information of the main tactile signal
  • a third determining module configured to determine, for each of the main tactile signals, a secondary tactile signal corresponding to the main tactile signal according to a first model corresponding to the main tactile signal, wherein the secondary tactile signal is a signal in a tactile signal at a position around the main tactile signal that is not completely blocked by the main tactile signal;
  • a generating module configured to generate a first mask corresponding to the main tactile signal based on spatial information of the secondary tactile signal corresponding to the main tactile signal, wherein the first mask is used to indicate the presence of the secondary tactile signal at a position around the main tactile signal;
  • An encoding module is used to encode the content to be encoded, the spatial information of the main tactile signal and the first mask corresponding to the main tactile signal to obtain a code stream of the tactile signal; wherein the content to be encoded includes a first object to be encoded for representing the main tactile signal and a second object to be encoded for representing a secondary tactile signal corresponding to the main tactile signal.
  • a tactile signal decoding device comprising:
  • a decoding module configured to decode a bit stream of a tactile signal to obtain content to be decoded, spatial information of a main tactile signal in the tactile signal, and a first mask corresponding to the main tactile signal, wherein the content to be decoded includes a first object to be decoded for representing the main tactile signal and a second object to be decoded for representing a secondary tactile signal in the tactile signal corresponding to the main tactile signal;
  • an acquisition module configured to obtain, based on the spatial information of the primary tactile signal and the first mask, whether a secondary tactile signal exists at a position around the primary tactile signal
  • a first reconstruction module configured to reconstruct the main tactile signal based on the first object to be decoded
  • the second reconstruction module is used to reconstruct the secondary tactile signal existing at a surrounding position of the main tactile signal based on the second to-be-decoded object and the existence of the secondary tactile signal at a surrounding position of the main tactile signal.
  • a terminal comprising a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the method described in the first aspect are implemented, or the steps of the method described in the second aspect are implemented.
  • a terminal including a processor and a communication interface, wherein:
  • the processor is used to perform the following operations: determine a main tactile signal and spatial information of the main tactile signal in at least two tactile signals; determine a first model corresponding to the main tactile signal according to each of the main tactile signals and the spatial information of the main tactile signal; for each of the main tactile signals, determine a secondary tactile signal corresponding to the main tactile signal according to the first model corresponding to the main tactile signal, wherein the secondary tactile signal is a signal in the tactile signal at a surrounding position of the main tactile signal that is not completely obscured by the main tactile signal; based on the spatial information of the secondary tactile signal corresponding to the main tactile signal, generate a first mask corresponding to the main tactile signal, wherein the first mask is used to indicate the presence of the secondary tactile signal at a surrounding position of the main tactile signal; encode the content to be encoded, the spatial information of the main tactile signal and the first mask corresponding to the main tactile signal to obtain a code stream of the tactile signal; wherein the content to be encoded includes a first object
  • the processor is used to perform the following operations: decode a code stream of a tactile signal to obtain content to be decoded, spatial information of a main tactile signal in the tactile signal, and a first mask corresponding to the main tactile signal, the content to be decoded including a first object to be decoded for representing the main tactile signal and a second object to be decoded for representing a secondary tactile signal in the tactile signal corresponding to the main tactile signal; obtain the existence of a secondary tactile signal at a surrounding position of the main tactile signal based on the spatial information of the main tactile signal and the first mask; reconstruct the main tactile signal based on the first object to be decoded; and reconstruct the secondary tactile signal at a surrounding position of the main tactile signal based on the second object to be decoded and the existence of the secondary tactile signal at a surrounding position of the main tactile signal.
  • a communication system comprising: an encoding end device and a decoding end device, wherein the encoding end device can be used to execute the steps of the tactile signal encoding method as described in the first aspect, and the decoding end device can be used to execute the steps of the tactile signal decoding method as described in the second aspect.
  • a readable storage medium on which a program or instruction is stored.
  • the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented, or the steps of the method described in the second aspect are implemented.
  • a chip comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instructions to implement the steps of the method described in the first aspect, or to implement the steps of the method described in the second aspect.
  • a computer program/program product is provided, wherein the computer program/program product is stored in a storage medium, and the computer program/program product is executed by at least one processor to implement the steps of the method described in the first aspect, or to implement the steps of the method described in the second aspect.
  • a main tactile signal and spatial information of the main tactile signal are determined in at least two tactile signals; a first model corresponding to the main tactile signal is determined according to each of the main tactile signals and the spatial information of the main tactile signal; for each of the main tactile signals, a secondary tactile signal corresponding to the main tactile signal is determined according to the first model corresponding to the main tactile signal, wherein the secondary tactile signal is a signal in the tactile signal at a surrounding position of the main tactile signal that is not completely obscured by the main tactile signal; based on the spatial information of the secondary tactile signal corresponding to the main tactile signal, Generate a first mask corresponding to the main tactile signal, the first mask is used to indicate the presence of secondary tactile signals at positions around the main tactile signal; encode the content to be encoded, the spatial information of the main tactile signal, and the first mask corresponding to the main tactile signal to obtain a code stream of the tactile signal; wherein the content to be encoded includes a first object to be encoded for representing the main tactile signal and a second object to be
  • the embodiment of the present application improves the compression efficiency of the tactile signal.
  • FIG1 is a schematic diagram of a flow chart of a tactile signal encoding method provided in an embodiment of the present application
  • FIGS. 2a to 2f are schematic diagrams of the structure of a first model in a tactile signal encoding method provided in an embodiment of the present application;
  • FIG3 is a schematic diagram of a flow chart of a tactile signal decoding method provided in an embodiment of the present application.
  • FIG4 is a structural diagram of a tactile signal encoding device provided in an embodiment of the present application.
  • FIG5 is a structural diagram of a tactile signal decoding device provided in an embodiment of the present application.
  • FIG6 is a structural diagram of a communication device provided in an embodiment of the present application.
  • FIG. 7 is a structural diagram of a terminal provided in an embodiment of the present application.
  • first, second, etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by “first” and “second” are generally of the same type, and the number of objects is not limited.
  • the first object can be one or more.
  • “and/or” in the specification and claims represents at least one of the connected objects, and the character “/" generally represents that the objects associated with each other are in an "or” relationship.
  • the encoding and decoding end corresponding to the tactile signal encoding and decoding method in the embodiment of the present application can be a terminal, which can also be called a terminal device or a user terminal (User Equipment, UE).
  • the terminal can be a mobile phone, a tablet computer (Tablet Personal Computer), a laptop computer (Laptop Computer) or a notebook computer, a personal digital assistant (Personal Digital Assistant, PDA), a handheld computer, a netbook, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a mobile Internet device (Mobile Internet Device, MID), a wearable device (Wearable Device) or a vehicle-mounted device (Vehicle User Equipment, VUE), a pedestrian terminal (Pedestrian User Equipment, PUE) and other terminal-side devices.
  • the wearable device includes: a smart watch, a bracelet, a headset, a pair of glasses, a pair of earphones ... It should be noted that the specific type of the terminal is not limited in the
  • Tactile information refers to the human body's perception of shape, position, surface texture, hardness, roughness and temperature of objects, etc. It is mainly divided into two categories: tactile information based on muscle movement perception (hereinafter referred to as kinesthetic information) and tactile information based on skin texture perception (hereinafter referred to as texture information).
  • tactile information based on muscle movement perception hereinafter referred to as kinesthetic information
  • texture information tactile information based on skin texture perception
  • the surface texture, friction, temperature, etc. of objects perceived by the mechanical stimulation receptors on the skin are all texture information.
  • the texture signal is reconstructed through a specific tactile reproduction device to transmit the combination of vibration or stimulation pulses perceived by the receptor to the user.
  • the new tactile feedback display screen experiences texture touch by sliding fingers on the touch screen;
  • the vibration wave tactile feedback disc adds vibration tactile perception to the audio-visual senses of virtual reality games in related technologies;
  • Google adds tactile game controllers to the game platform, etc.
  • the development of these tactile reconstruction systems is inseparable from texture coding technology, which is an important basis for the development of these devices.
  • Texture coding methods are mainly divided into three categories: coding methods based on statistics; coding methods based on perceptual models (Weber's theorem); and methods based on hybrid perceptual coding.
  • statistical texture coding uses quantization and prediction models to reduce data redundancy.
  • Coding methods based on perceptual models achieve data compression by setting difference thresholds (discrimination sensitivity).
  • Hybrid perceptual coding uses the absolute threshold of perception and masking phenomena to extract the necessary attributes of the input signal to achieve perceptual compression.
  • PVC-SLP Perceptual Vibrotactile-Signal Compression Based-on Sparse Linear Prediction
  • ASF acceleration sensitivity function
  • the tactile signal encoding method includes:
  • Step 101 determining a main tactile signal and spatial information of the main tactile signal among at least two tactile signals
  • the above-mentioned spatial information may include but is not limited to at least one of the following: body region information, and position information within the body region.
  • the main tactile signal may be understood as a main signal of at least two (or at least two) tactile signals, and the at least two tactile signals may include one or more main tactile signals.
  • the method for determining the main tactile signal may be set according to actual needs.
  • the method for determining the main tactile signal may include at least one of the following:
  • the main tactile signal is a tactile sensitive point according to the spatial information of the tactile signal, for example, the tactile signal of the tactile sensitive point is used as the main tactile signal;
  • the signal power (or signal strength) is defined
  • the primary and secondary tactile signals for example, all tactile signals are sorted in descending order according to factors such as amplitude and power, and a number of high-power signals are selected as primary tactile signals according to compression requirements.
  • the tactile sensitive points can be obtained based on subjective tests or defined according to specific equipment.
  • Step 102 determining a first model corresponding to the main tactile signal according to each of the main tactile signals and the spatial information of the main tactile signal.
  • the first model includes a masking effect threshold, where the masking effect threshold is used to indicate a threshold at which the main tactile signal completely masks the tactile signals at its surrounding positions;
  • Step 103 for each of the main tactile signals, determining a secondary tactile signal corresponding to the main tactile signal according to a first model corresponding to the main tactile signal, wherein the secondary tactile signal is a signal in a tactile signal at a position around the main tactile signal that is not completely blocked by the main tactile signal;
  • the first model may be a spatial psychological tactile model
  • the masking effect threshold may reflect the magnitude of the masking effect of the main tactile signal on the tactile signal at a specific position around it.
  • a person can subjectively perceive the threshold of the signal power at a position adjacent to the main signal.
  • a tactile signal greater than or equal to the masking effect threshold may indicate that the main tactile signal does not completely mask the tactile signal
  • a tactile signal less than the masking effect threshold may indicate that the main tactile signal completely masks the tactile signal.
  • the tactile signal that is not completely masked is used as a secondary tactile signal.
  • the main tactile signal and the first model are in a one-to-one correspondence.
  • the corresponding first models are different.
  • Figures 2a to 2f several possible example diagrams of the first model are given.
  • the "X" in the figure represents the main tactile signal or the position where the main tactile signal is located
  • the "O” in the figure represents the tactile signal existing in the surrounding position of the main tactile signal or the position where the tactile signal exists in the surrounding position of the main tactile signal.
  • the tactile signal receiving points can be numbered, the power of each tactile signal can be stored in a power matrix according to the spatial position, and then the surrounding positions of the main tactile signal can be determined based on the power matrix.
  • the size of the power matrix can change with the number of signals.
  • the matrix is filled with 0s to represent no signal.
  • the position around the main tactile signal can be understood to include 8 positions, that is, the position around the main tactile signal and the tactile signal at the surrounding position can be determined by using a spatial adjacent matrix.
  • the main tactile signal is the center position of the spatial adjacent matrix, and the remaining positions are the surrounding positions of the main tactile signal.
  • the secondary tactile signals and the spatial information of the secondary tactile signals existing at the surrounding positions of the main tactile signal can be determined. It should be understood that in the embodiment of the present application, only the tactile signals at the surrounding positions of the main tactile signal that are not completely blocked by the main tactile signal are determined as secondary tactile signals, and the signals completely blocked by the main tactile signal are regarded as redundant signals and are not encoded subsequently, thereby improving the compression efficiency and reducing the size of the encoded bitstream.
  • Step 104 generating a first mask corresponding to the main tactile signal based on spatial information of the secondary tactile signal corresponding to the main tactile signal, wherein the first mask is used to indicate the presence of secondary tactile signals at positions around the main tactile signal;
  • the first mask can be understood as a spatial modal mask.
  • the first mask is related to the main tactile signal. There is a one-to-one correspondence between them.
  • the first mask corresponding to each main tactile signal can be constructed in sequence according to the spatial information of the main tactile signal and the secondary tactile signal, and the first mask is used to identify whether there are secondary tactile signals at various positions around the main tactile signal.
  • a 3*3 coding matrix is used to construct the first mask, wherein the main tactile signal is located at the center of the coding matrix and is not encoded.
  • the remaining eight positions are encoded as 1-8, and each mode corresponds to an eight-bit binary code adjacent to position 1, corresponding to the first bit of the binary number, position 2 corresponds to the second bit of the binary number, and so on. If there is a secondary input signal at a certain position, the corresponding binary number is identified as 1, and the binary data corresponding to the position without a secondary tactile signal is identified as 0.
  • the first mask indicates the spatial proximity between the primary tactile signal and the secondary tactile signal, and can be used to select an optimization function, which can be used to optimize the secondary tactile signal before encoding, so as to further improve the compression efficiency of the secondary tactile signal.
  • Step 105 encode the content to be encoded, the spatial information of the main tactile signal, and the first mask corresponding to the main tactile signal to obtain a code stream of the tactile signal; wherein the content to be encoded includes a first object to be encoded for representing the main tactile signal and a second object to be encoded for representing the secondary tactile signal corresponding to the main tactile signal.
  • a main tactile signal and spatial information of the main tactile signal in at least two tactile signals are determined; a first model corresponding to the main tactile signal is determined according to each of the main tactile signals and the spatial information of the main tactile signal; for each of the main tactile signals, a secondary tactile signal corresponding to the main tactile signal is determined according to the first model corresponding to the main tactile signal, wherein the secondary tactile signal is a signal in the tactile signal at a surrounding position of the main tactile signal that is not completely obscured by the main tactile signal; based on the spatial information of the secondary tactile signal corresponding to the main tactile signal, a first mask corresponding to the main tactile signal is generated, wherein the first mask is used to indicate the presence of a secondary tactile signal at a surrounding position of the main tactile signal; a code stream of the tactile signal is obtained by encoding content to be encoded, the spatial information of the main tactile signal, and the first mask corresponding to the main tactile signal; wherein the content to be encoded includes a first object to be encoded for representing the main tactile signal
  • the embodiment of the present application improves the compression efficiency of the tactile signal.
  • the first object to be encoded includes any one of the following:
  • the adjacent encoded reconstructed main tactile signal can be understood as: a main tactile signal reconstructed from a main tactile signal adjacent to the main tactile signal to be encoded currently in the encoded main tactile signal.
  • the adjacent can be understood as a main tactile signal adjacent to the left side of the main tactile signal to be encoded currently or a main tactile signal adjacent to the upper side of the main tactile signal to be encoded currently.
  • the first object to be encoded includes the main tactile signal to be encoded
  • the original main tactile signal is directly encoded, which can reduce the difficulty of reconstructing the main tactile signal at the decoding end.
  • the first object to be encoded includes other items besides the main tactile signal to be encoded, it can be understood that the encoding information of the main tactile signal is optimized, the size of the encoding information of the main tactile signal is reduced, and thus the compression efficiency of the main tactile signal is improved.
  • the second object to be encoded includes any one of the following:
  • the sub-tactile signal to be encoded is a signal after normalization processing
  • the adjacent encoded reconstructed secondary tactile signal can be understood as: a secondary tactile signal reconstructed from a secondary tactile signal adjacent to the secondary tactile signal to be encoded currently among the encoded secondary tactile signals.
  • the adjacent can be understood as a secondary tactile signal adjacent to the left side of the secondary tactile signal to be encoded currently or a secondary tactile signal adjacent to the upper side of the secondary tactile signal to be encoded currently.
  • the second object to be encoded includes the secondary tactile signal to be encoded currently, it can be understood as directly encoding the original secondary tactile signal, which can reduce the difficulty of reconstructing the secondary tactile signal at the decoding end.
  • the first object to be encoded includes other items besides the secondary tactile signal to be encoded currently, it can be understood as optimizing the encoding information of the secondary tactile signal, reducing the size of the encoding information of the secondary tactile signal, thereby improving the compression efficiency of the secondary tactile signal.
  • the encoding end device can select a corresponding optimization processing strategy, optimize the secondary tactile signal through the optimization function corresponding to the optimization processing strategy, and obtain the optimized secondary tactile signal.
  • the optimization processing strategy may include at least one of the following: comparing the secondary tactile signal to be encoded with the masking effect threshold of the first model; The threshold is used for difference; the secondary tactile signal to be encoded is normalized; the secondary tactile signal to be encoded is differentiated from the corresponding encoded reconstructed primary tactile signal.
  • the process of selecting the optimization processing strategy can be understood as selecting the optimization function.
  • the normalization process includes:
  • the secondary tactile signal to be encoded is normalized based on the reconstructed secondary tactile signal with the largest power among the at least two encoded reconstructed secondary tactile signals.
  • determining the secondary tactile signal corresponding to the main tactile signal according to the first model corresponding to the main tactile signal includes:
  • the masking effect threshold of the first model includes the threshold of each first position in the first model corresponding to the main tactile signal, and the first position is the position where the tactile signal exists in the surrounding positions of the second position where the main tactile signal is located. For each of the first positions, when the first tactile signal at the first position is greater than or equal to the threshold of the first position, it is determined that the first tactile signal is not completely masked by the main tactile signal, and the first tactile signal is determined as the secondary tactile signal; when the first tactile signal at the first position is less than the threshold of the first position, it is determined that the first tactile signal is completely masked by the main tactile signal, and the first tactile signal is discarded.
  • the shielding effect threshold of the above-mentioned first model includes 4 thresholds, corresponding to the four positions of up, down, left and right respectively.
  • other threshold setting methods can also be used in other embodiments, such as using the same threshold for the four positions of up, down, left and right.
  • the method further includes:
  • the secondary tactile signals corresponding to the N main tactile signals all include the first tactile signal, discarding the first tactile signal in the secondary tactile signals corresponding to the N-1 main tactile signals;
  • the N is an integer greater than 1, and the N-1 main tactile signals are part of the N main tactile signals.
  • the fact that the secondary tactile signals corresponding to the N main tactile signals all include the first tactile signal can be understood as the first tactile signal in the secondary tactile signals being determined as the secondary tactile signal corresponding to the N main tactile signals.
  • the main tactile signal to which the secondary tactile signal ultimately belongs can be determined based on the power size, and other main tactile signals ignore the secondary tactile signal. In this way, it is avoided that a secondary tactile signal belongs to multiple main tactile signals at the same time, and the difficulty of encoding and decoding operations is reduced.
  • the method of determining the main tactile signal to which the secondary tactile signal belongs can be set according to actual needs.
  • the N-1 main tactile signals are the first N-1 main tactile signals of the N main tactile signals arranged in order of power from small to large.
  • the secondary tactile signal may be attributed to the primary tactile signal with the largest power.
  • the tactile signal receiving points are numbered, and the power of each tactile signal is stored in a power matrix according to the spatial position.
  • the size of the power matrix can change with the number of signals.
  • the matrix is filled with 0 to represent no signal.
  • the power values of the tactile signals are sorted, and the largest tactile signal is selected and defined as the first main tactile signal.
  • the surrounding tactile signals need to be determined using the spatial adjacent matrix of the corresponding position. After determining the surrounding signals of the first main tactile signal, each is judged whether it is higher than the masking effect threshold given by the spatial psychological tactile model corresponding to the main tactile signal; the tactile signal above the masking effect threshold is defined as a secondary tactile signal, and the tactile signal below the masking effect threshold is completely masked by the main tactile signal, so it is discarded. At the same time, the defined tactile signals are marked in the position matrix, marking them as main tactile signals or secondary tactile signals. In addition, in order to facilitate the construction of the spatial modal mask in the next step, it should also be recorded in the signal primary and secondary table. The recorded value can be: the main tactile signal number, and the secondary tactile signal number array corresponding to the main tactile signal.
  • the secondary tactile signal can be assigned to the main tactile signal with larger power (that is, the secondary tactile signal is added to the main and secondary table of the signal with the largest power, and other main tactile signals ignore this signal), or it can be selected to belong to multiple main tactile signals (the secondary tactile signal is added to the main and secondary table of multiple main tactile signals).
  • an embodiment of the present application further provides a tactile signal decoding method.
  • the tactile signal decoding method includes:
  • Step 301 decoding a bit stream of a tactile signal to obtain content to be decoded, spatial information of a main tactile signal in the tactile signal, and a first mask corresponding to the main tactile signal, wherein the content to be decoded includes a first object to be decoded for representing the main tactile signal and a second object to be decoded for representing a secondary tactile signal in the tactile signal corresponding to the main tactile signal;
  • Step 302 obtaining a situation where a secondary tactile signal exists at a surrounding position of the primary tactile signal based on the spatial information of the primary tactile signal and the first mask;
  • Step 303 reconstructing the main tactile signal based on the first object to be decoded
  • Step 304 reconstructing the secondary tactile signal existing at the surrounding position of the primary tactile signal based on the second to-be-decoded object and the existence of the secondary tactile signal at the surrounding position of the primary tactile signal.
  • the first object to be decoded includes any one of the following:
  • the second object to be decoded includes any one of the following:
  • the normalization process includes:
  • the secondary tactile signal to be decoded is normalized based on the reconstructed secondary tactile signal with the largest power among the at least two decoded reconstructed secondary tactile signals.
  • the tactile signal encoding method provided in the embodiment of the present application may be executed by a tactile signal encoding device.
  • the tactile signal encoding method executed by the tactile signal encoding device is taken as an example to illustrate the tactile signal encoding device provided in the embodiment of the present application.
  • the embodiment of the present application further provides a tactile signal encoding device.
  • the tactile signal encoding device 400 includes:
  • a first determining module 401 is used to determine a main tactile signal and spatial information of the main tactile signal among at least two tactile signals;
  • a second determining module 402 configured to determine a first model corresponding to the main tactile signal according to each of the main tactile signals and the spatial information of the main tactile signal;
  • the third determining module 403 is used to determine, for each of the main tactile signals, a secondary tactile signal corresponding to the main tactile signal according to the first model corresponding to the main tactile signal, wherein the secondary tactile signal is a peripheral position of the main tactile signal. a signal of the tactile signal disposed on the haptic signal that is not completely blocked by the main tactile signal;
  • a generating module 404 configured to generate a first mask corresponding to the primary tactile signal based on spatial information of the secondary tactile signal corresponding to the primary tactile signal, wherein the first mask is used to indicate the presence of secondary tactile signals at positions around the primary tactile signal;
  • the encoding module 405 is used to encode the content to be encoded, the spatial information of the main tactile signal and the first mask corresponding to the main tactile signal to obtain a code stream of the tactile signal; wherein the content to be encoded includes a first object to be encoded for representing the main tactile signal and a second object to be encoded for representing the secondary tactile signal corresponding to the main tactile signal.
  • the first object to be encoded includes any one of the following:
  • the second object to be encoded includes any one of the following:
  • the sub-tactile signal to be encoded is a signal after normalization processing
  • the normalization process includes:
  • the secondary tactile signal to be encoded is normalized based on the reconstructed secondary tactile signal with the largest power among the at least two encoded reconstructed secondary tactile signals.
  • the third determination module 403 is specifically configured to: for each of the primary tactile signals, determine a secondary tactile signal corresponding to the primary tactile signal according to a masking effect threshold of the first model corresponding to the primary tactile signal;
  • the masking effect threshold of the first model includes each of the first model corresponding to the main tactile signal A threshold value of a first position, wherein the first position is a position where the tactile signal exists in the surrounding positions of the second position where the main tactile signal is located. For each of the first positions, when the first tactile signal at the first position is greater than or equal to the threshold value of the first position, it is determined that the first tactile signal is not completely obscured by the main tactile signal, and the first tactile signal is determined as the secondary tactile signal; when the first tactile signal at the first position is less than the threshold value of the first position, it is determined that the first tactile signal is completely obscured by the main tactile signal, and the first tactile signal is discarded.
  • the tactile signal encoding device 400 further includes:
  • a processing module configured to discard the first tactile signal among the secondary tactile signals corresponding to N-1 primary tactile signals, when the first tactile signal among the secondary tactile signals is determined to be the secondary tactile signal corresponding to N primary tactile signals;
  • the N is an integer greater than 1, and the N-1 main tactile signals are part of the N main tactile signals.
  • the N-1 main tactile signals are first N-1 main tactile signals of the N main tactile signals arranged in ascending order of power.
  • the tactile signal decoding method provided in the embodiment of the present application may be executed by a tactile signal decoding device.
  • the tactile signal decoding device executing the tactile signal decoding method is taken as an example to illustrate the tactile signal decoding device provided in the embodiment of the present application.
  • the embodiment of the present application further provides a tactile signal decoding device.
  • the tactile signal decoding device 500 includes:
  • a decoding module 501 is used to decode a bit stream of a tactile signal to obtain content to be decoded, spatial information of a main tactile signal in the tactile signal, and a first mask corresponding to the main tactile signal, wherein the content to be decoded includes a first object to be decoded for representing the main tactile signal and a second object to be decoded for representing a secondary tactile signal in the tactile signal corresponding to the main tactile signal;
  • An acquisition module 502 is used to obtain the existence of secondary tactile signals at surrounding positions of the primary tactile signal based on the spatial information of the primary tactile signal and the first mask;
  • a first reconstruction module 503, configured to reconstruct the main tactile signal based on the first object to be decoded
  • the second reconstruction module 504 is configured to reconstruct the secondary tactile signal existing at a surrounding position of the primary tactile signal based on the second to-be-decoded object and the existence of the secondary tactile signal at a surrounding position of the primary tactile signal.
  • the first object to be decoded includes any one of the following:
  • the main tactile signal to be decoded and the reconstructed main tactile signal with the smallest power among at least two decoded reconstructed main tactile signals The difference of the signal;
  • the second object to be decoded includes any one of the following:
  • the normalization process includes:
  • the secondary tactile signal to be decoded is normalized based on the reconstructed secondary tactile signal with the largest power among the at least two decoded reconstructed secondary tactile signals.
  • the tactile signal encoding device and the tactile signal decoding device in the embodiment of the present application can be an electronic device, such as an electronic device with an operating system, or a component in an electronic device, such as an integrated circuit or a chip.
  • the electronic device can be a terminal, or it can be other devices other than a terminal.
  • the terminal can include but is not limited to the types of terminals 11 listed above, and other devices can be servers, network attached storage (NAS), etc., which are not specifically limited in the embodiment of the present application.
  • the tactile signal encoding device and the tactile signal decoding device provided in the embodiments of the present application can implement the various processes implemented in the method embodiments of Figures 1 to 3 and achieve the same technical effects. To avoid repetition, they will not be described here.
  • the embodiment of the present application further provides a communication device 600, including a processor 601 and a memory 602, wherein the memory 602 stores a program or instruction that can be run on the processor 601.
  • the communication device 600 is an encoding end device
  • the program or instruction is executed by the processor 601 to implement the various steps of the above-mentioned tactile signal encoding method embodiment, and can achieve the same technical effect.
  • the communication device 600 is a decoding end device
  • the program or instruction is executed by the processor 601 to implement the various steps of the above-mentioned tactile signal decoding method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
  • the embodiment of the present application also provides a terminal, including a processor and a communication interface, wherein:
  • the processor is configured to perform the following operations: determining at least two triggers
  • the method comprises the steps of: determining a main tactile signal and spatial information of the main tactile signal in a tactile signal; determining a first model corresponding to the main tactile signal according to each of the main tactile signal and the spatial information of the main tactile signal; determining, for each of the main tactile signal, a secondary tactile signal corresponding to the main tactile signal according to the first model corresponding to the main tactile signal, wherein the secondary tactile signal is a signal in the tactile signal at a surrounding position of the main tactile signal that is not completely blocked by the main tactile signal; generating a first mask corresponding to the main tactile signal based on the spatial information of the secondary tactile signal corresponding to the main tactile signal, wherein the first mask is used to indicate the presence of the secondary tactile signal at a surrounding position of the main tactile signal; encoding content to be encoded, the spatial information of the main tactile signal and the first mask corresponding to the main tactile signal to obtain a code stream of
  • the processor is used to perform the following operations: decode a code stream of a tactile signal to obtain content to be decoded, spatial information of a main tactile signal in the tactile signal, and a first mask corresponding to the main tactile signal, the content to be decoded including a first object to be decoded for representing the main tactile signal and a second object to be decoded for representing a secondary tactile signal in the tactile signal corresponding to the main tactile signal; obtain the existence of a secondary tactile signal at a surrounding position of the main tactile signal based on the spatial information of the main tactile signal and the first mask; reconstruct the main tactile signal based on the first object to be decoded; and reconstruct the secondary tactile signal at a surrounding position of the main tactile signal based on the second object to be decoded and the existence of the secondary tactile signal at a surrounding position of the main tactile signal.
  • the terminal embodiment corresponds to the above-mentioned terminal side method embodiment, and each implementation process and implementation mode of the above-mentioned method embodiment can be applied to the terminal embodiment and can achieve the same technical effect.
  • Figure 7 is a schematic diagram of the hardware structure of a terminal implementing the embodiment of the present application.
  • the terminal 700 includes but is not limited to: a radio frequency unit 701, a network module 702, an audio output unit 703, an input unit 704, a sensor 705, a display unit 706, a user input unit 707, an interface unit 708, a memory 709 and at least some of the components of a processor 710.
  • the terminal 700 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 710 through a power management system, so as to implement functions such as managing charging, discharging, and power consumption management through the power management system.
  • a power source such as a battery
  • the terminal structure shown in FIG7 does not constitute a limitation on the terminal, and the terminal may include more or fewer components than shown in the figure, or combine certain components, or arrange components differently, which will not be described in detail here.
  • the input unit 704 may include a graphics processor (GPU) 7041 and a microphone 7042, and the graphics processor 7041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode.
  • the display unit 706 may include a display panel 7061, and the display panel 7061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc.
  • the user input unit 707 includes a touch panel 7071 and at least one of other input devices 7072.
  • the touch panel 7071 is also called a touch screen.
  • the touch panel 7071 may include two parts: a touch detection device and a touch controller.
  • Other input devices 7072 may include, but are not limited to, a physical keyboard, function keys (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.
  • the RF unit 701 can transmit the data to the processor 710 for processing; in addition, the RF unit 701 can send uplink data to the network side device.
  • the RF unit 701 includes but is not limited to an antenna, an amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc.
  • the memory 709 can be used to store software programs or instructions and various data.
  • the memory 709 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instruction required for at least one function (such as a sound playback function, an image playback function, etc.), etc.
  • the memory 709 may include a volatile memory or a non-volatile memory, or the memory 709 may include both volatile and non-volatile memories.
  • the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory.
  • the volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM).
  • the memory 709 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
  • the processor 710 may include one or more processing units; optionally, the processor 710 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 710.
  • the processor 710 is used to perform the following operations: determine a main tactile signal and spatial information of the main tactile signal in at least two tactile signals; determine a first model corresponding to the main tactile signal according to each of the main tactile signals and the spatial information of the main tactile signal; for each of the main tactile signals, determine a secondary tactile signal corresponding to the main tactile signal according to the first model corresponding to the main tactile signal, wherein the secondary tactile signal is a signal in the tactile signal at a surrounding position of the main tactile signal that is not completely obscured by the main tactile signal; based on the spatial information of the secondary tactile signal corresponding to the main tactile signal, generate a first mask corresponding to the main tactile signal, wherein the first mask is used to indicate the presence of the secondary tactile signal at a surrounding position of the main tactile signal; encode the content to be encoded, the spatial information of the main tactile signal and the first mask corresponding to the main tactile signal to obtain a code stream of the tactile signal; wherein the content to be encoded
  • the processor 710 is used to perform the following operations: decode a bit stream of a tactile signal to obtain content to be decoded, spatial information of a main tactile signal in the tactile signal, and a first mask corresponding to the main tactile signal, wherein the content to be decoded includes a first object to be decoded for representing the main tactile signal and a second object to be decoded for representing a secondary tactile signal in the tactile signal corresponding to the main tactile signal;
  • the existence of secondary tactile signals at surrounding positions of the main tactile signal is obtained based on the spatial information of the main tactile signal and the first mask; the main tactile signal is reconstructed based on the first object to be decoded; and the secondary tactile signals at surrounding positions of the main tactile signal are reconstructed based on the second object to be decoded and the existence of secondary tactile signals at surrounding positions of the main tactile signal.
  • An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored.
  • a program or instruction is stored.
  • the program or instruction is executed by a processor, each process of the above-mentioned tactile signal encoding method and tactile signal decoding method embodiments is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
  • the processor is the processor in the terminal described in the above embodiment.
  • the readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
  • An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned tactile signal encoding method and tactile signal decoding method embodiments, and can achieve the same technical effect. To avoid repetition, they are not repeated here.
  • the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
  • An embodiment of the present application further provides a computer program/program product, which is stored in a storage medium.
  • the computer program/program product is executed by at least one processor to implement the various processes of the above-mentioned tactile signal encoding method and tactile signal decoding method embodiments, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
  • An embodiment of the present application also provides a communication system, including: an encoding end device and a decoding end device, the terminal is used to execute the various processes of the various method embodiments of the encoding end device as shown in Figure 1 and the above-mentioned encoding end device, and the decoding end device is used to execute the various processes of the various method embodiments of the decoding end device as shown in Figure 3 and the above-mentioned decoding end device, and can achieve the same technical effect. In order to avoid repetition, it will not be repeated here.
  • the disclosed part may be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), and includes a number of instructions for enabling a terminal (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of the present application.
  • a storage medium such as ROM/RAM, magnetic disk, optical disk

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请公开了一种触觉信号编码方法、触觉信号解码方法及相关设备，属于视频编解码领域，本申请实施例的触觉信号编码方法包括：确定至少两个触觉信号中的主触觉信号和主触觉信号的空间信息；根据每一主触觉信号和主触觉信号的空间信息确定第一模型；根据主触觉信号对应的第一模型确定主触觉信号对应的次触觉信号，次触觉信号为主触觉信号的周围位置上的触觉信号中未被主触觉信号完全遮蔽的信号；基于主触觉信号对应的次触觉信号的空间信息，生成第一掩码；对待编码内容、主触觉信号的空间信息和第一掩码进行编码获得触觉信号的码流；待编码内容包括用于表示主触觉信号的第一待编码对象和用于表示主触觉信号对应的次触觉信号的第二待编码对象。

Description

触觉信号编码方法、触觉信号解码方法及相关设备
相关申请的交叉引用
本申请主张在2022年11月08日在中国提交的中国专利申请No.202211394497.0的优先权，其全部内容通过引用包含于此。
技术领域
本申请属于视频编解码技术领域，具体涉及一种触觉信号编码方法、触觉信号解码方法及相关设备。
背景技术
在视频编码过程中，通常需要对触觉信号(也可以称之为纹理触觉信号)进行编码，通常采用对多个单点视频信号进行逐一编码以实现多点视觉信号的编码，但是在编码过程中由于相邻触觉信号之间具有遮蔽效应，因此编码后的触觉信号存在一定的冗余。因此，相关技术中存在触觉信号的压缩率较低的问题。
发明内容
本申请实施例提供一种触觉信号编码方法、触觉信号解码方法及相关设备，能够解决触觉信号的压缩率较低的问题。
第一方面，提供了一种触觉信号编码方法，包括：
确定至少两个触觉信号中的主触觉信号和主触觉信号的空间信息；
根据每一所述主触觉信号和所述主触觉信号的空间信息确定所述主触觉信号对应的第一模型；
针对每一所述主触觉信号，根据所述主触觉信号对应的第一模型确定所述主触觉信号对应的次触觉信号，所述次触觉信号为所述主触觉信号的周围位置上的触觉信号中未被所述主触觉信号完全遮蔽的信号；
基于所述主触觉信号对应的次触觉信号的空间信息，生成所述主触觉信号对应的第一掩码，所述第一掩码用于表示所述主触觉信号的周围位置上的存在次触觉信号的情况；
对待编码内容、所述主触觉信号的空间信息和所述主触觉信号对应的第一掩码进行编码获得所述触觉信号的码流；其中，所述待编码内容包括用于表示所述主触觉信号的第一待编码对象和用于表示所述主触觉信号对应的次触觉信号的第二待编码对象。
第二方面，提供了一种触觉信号解码方法，包括：
对触觉信号的码流进行解码，获得待解码内容、所述触觉信号中主触觉信号的空间信息和所述主触觉信号对应的第一掩码，所述待解码内容包括用于表示所述主触觉信号的第 一待解码对象和用于表示所述触觉信号中与所述主触觉信号对应的次触觉信号的第二待解码对象；
基于所述主触觉信号的空间信息和所述第一掩码获得所述主触觉信号的周围位置上的存在次触觉信号的情况；
基于所述第一待解码对象重建所述主触觉信号；
基于所述第二待解码对象和所述主触觉信号的周围位置上的存在次触觉信号的情况重建所述主触觉信号的周围位置上存在的次触觉信号。
第三方面，提供了一种触觉信号编码装置，包括：
第一确定模块，用于确定至少两个触觉信号中的主触觉信号和主触觉信号的空间信息；
第二确定模块，用于根据每一所述主触觉信号和所述主触觉信号的空间信息确定所述主触觉信号对应的第一模型；
第三确定模块，用于针对每一所述主触觉信号，根据所述主触觉信号对应的第一模型确定所述主触觉信号对应的次触觉信号，所述次触觉信号为所述主触觉信号的周围位置上的触觉信号中未被所述主触觉信号完全遮蔽的信号；
生成模块，用于基于所述主触觉信号对应的次触觉信号的空间信息，生成所述主触觉信号对应的第一掩码，所述第一掩码用于表示所述主触觉信号的周围位置上的存在次触觉信号的情况；
编码模块，用于对待编码内容、所述主触觉信号的空间信息和所述主触觉信号对应的第一掩码进行编码获得所述触觉信号的码流；其中，所述待编码内容包括用于表示所述主触觉信号的第一待编码对象和用于表示所述主触觉信号对应的次触觉信号的第二待编码对象。
第四方面，提供了一种触觉信号解码装置，包括：
解码模块，用于对触觉信号的码流进行解码，获得待解码内容、所述触觉信号中主触觉信号的空间信息和所述主触觉信号对应的第一掩码，所述待解码内容包括用于表示所述主触觉信号的第一待解码对象和用于表示所述触觉信号中与所述主触觉信号对应的次触觉信号的第二待解码对象；
获取模块，用于基于所述主触觉信号的空间信息和所述第一掩码获得所述主触觉信号的周围位置上的存在次触觉信号的情况；
第一重建模块，用于基于所述第一待解码对象重建所述主触觉信号；
第二重建模块，用于基于所述第二待解码对象和所述主触觉信号的周围位置上的存在次触觉信号的情况重建所述主触觉信号的周围位置上存在的次触觉信号。
第五方面，提供了一种终端，该终端包括处理器和存储器，所述存储器存储可在所述处理器上运行的程序或指令，所述程序或指令被所述处理器执行时实现如第一方面所述的方法的步骤，或者实现如第二方面所述的方法的步骤。
第六方面，提供了一种终端，包括处理器及通信接口，其中，
在所述终端为编码端设备的情况下，所述处理器用于执行以下操作：确定至少两个触觉信号中的主触觉信号和主触觉信号的空间信息；根据每一所述主触觉信号和所述主触觉信号的空间信息确定所述主触觉信号对应的第一模型；针对每一所述主触觉信号，根据所述主触觉信号对应的第一模型确定所述主触觉信号对应的次触觉信号，所述次触觉信号为所述主触觉信号的周围位置上的触觉信号中未被所述主触觉信号完全遮蔽的信号；基于所述主触觉信号对应的次触觉信号的空间信息，生成所述主触觉信号对应的第一掩码，所述第一掩码用于表示所述主触觉信号的周围位置上的存在次触觉信号的情况；对待编码内容、所述主触觉信号的空间信息和所述主触觉信号对应的第一掩码进行编码获得所述触觉信号的码流；其中，所述待编码内容包括用于表示所述主触觉信号的第一待编码对象和用于表示所述主触觉信号对应的次触觉信号的第二待编码对象；
或者，在所述终端为解码端设备的情况下，所述处理器用于执行以下操作：对触觉信号的码流进行解码，获得待解码内容、所述触觉信号中主触觉信号的空间信息和所述主触觉信号对应的第一掩码，所述待解码内容包括用于表示所述主触觉信号的第一待解码对象和用于表示所述触觉信号中与所述主触觉信号对应的次触觉信号的第二待解码对象；基于所述主触觉信号的空间信息和所述第一掩码获得所述主触觉信号的周围位置上的存在次触觉信号的情况；基于所述第一待解码对象重建所述主触觉信号；基于所述第二待解码对象和所述主触觉信号的周围位置上的存在次触觉信号的情况重建所述主触觉信号的周围位置上存在的次触觉信号。
第七方面，提供了一种通信系统，包括：编码端设备及解码端设备，所述编码端设备可用于执行如第一方面所述的触觉信号编码方法的步骤，所述解码端设备可用于执行如第二方面所述的触觉信号解码方法的步骤。
第八方面，提供了一种可读存储介质，所述可读存储介质上存储程序或指令，所述程序或指令被处理器执行时实现如第一方面所述的方法的步骤，或者实现如第二方面所述的方法的步骤。
第九方面，提供了一种芯片，所述芯片包括处理器和通信接口，所述通信接口和所述处理器耦合，所述处理器用于运行程序或指令，实现如第一方面所述的方法的步骤，或实现如第二方面所述的方法的步骤。
第十方面，提供了一种计算机程序/程序产品，所述计算机程序/程序产品被存储在存储介质中，所述计算机程序/程序产品被至少一个处理器执行以实现如第一方面所述的方法的步骤，或实现如第二方面所述的方法的步骤。
本申请实施例中，通过确定至少两个触觉信号中的主触觉信号和主触觉信号的空间信息；根据每一所述主触觉信号和所述主触觉信号的空间信息确定所述主触觉信号对应的第一模型；针对每一所述主触觉信号，根据所述主触觉信号对应的第一模型确定所述主触觉信号对应的次触觉信号，所述次触觉信号为所述主触觉信号的周围位置上的触觉信号中未被所述主触觉信号完全遮蔽的信号；基于所述主触觉信号对应的次触觉信号的空间信息， 生成所述主触觉信号对应的第一掩码，所述第一掩码用于表示所述主触觉信号的周围位置上的存在次触觉信号的情况；对待编码内容、所述主触觉信号的空间信息和所述主触觉信号对应的第一掩码进行编码获得所述触觉信号的码流；其中，所述待编码内容包括用于表示所述主触觉信号的第一待编码对象和用于表示所述主触觉信号对应的次触觉信号的第二待编码对象。这样，在编码过程中，考虑了相邻触觉信号之间的遮蔽效应，从而只需要对主触觉信号和未被主触觉信号完全遮蔽的触觉信号进行编码。因此，本申请实施例提高了触觉信号的压缩效率。
附图说明
图1是本申请实施例提供的触觉信号编码方法的流程示意图；
图2a至图2f是本申请实施例提供触觉信号编码方法中第一模型的结构示意图；
图3是本申请实施例提供的触觉信号解码方法的流程示意图；
图4是本申请实施例提供的触觉信号编码装置的结构图；
图5是本申请实施例提供的触觉信号解码装置的结构图；
图6是本申请实施例提供的通信设备的结构图；
图7是本申请实施例提供的终端的结构图。
具体实施方式
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚描述，显然，所描述的实施例是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员所获得的所有其他实施例，都属于本申请保护的范围。
本申请的说明书和权利要求书中的术语“第一”、“第二”等是用于区别类似的对象，而不用于描述特定的顺序或先后次序。应该理解这样使用的术语在适当情况下可以互换，以便本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施，且“第一”、“第二”所区别的对象通常为一类，并不限定对象的个数，例如第一对象可以是一个，也可以是多个。此外，说明书以及权利要求中“和/或”表示所连接对象的至少其中之一，字符“/”一般表示前后关联对象是一种“或”的关系。
本申请实施例中的触觉信号编解码方法对应的编解码端可以为终端，该终端也可以称作终端设备或者用户终端(User Equipment，UE)，终端可以是手机、平板电脑(Tablet Personal Computer)、膝上型电脑(Laptop Computer)或称为笔记本电脑、个人数字助理(Personal Digital Assistant，PDA)、掌上电脑、上网本、超级移动个人计算机(ultra-mobile personal computer，UMPC)、移动上网装置(Mobile Internet Device，MID)、可穿戴式设备(Wearable Device)或车载设备(Vehicle User Equipment，VUE)、行人终端(Pedestrian User Equipment，PUE)等终端侧设备，可穿戴式设备包括：智能手表、手环、耳机、眼 镜等。需要说明的是，在本申请实施例并不限定终端的具体类型。
为了方便理解，以下对本申请实施例涉及的一些内容进行说明：
触觉作为人体一种独特的感官通道，能够有效地获取难以被其他诸如视觉或听觉的感知形式所感知的复杂信息。触觉信息是指人体对于形状、位置、表面纹理、物体坚硬程度、粗糙程度和温度等的感知，主要分为两大类：基于肌肉运动知觉的触觉信息(下文简称为动觉信息)和基于皮肤纹理知觉的触觉信息(下文简称为纹理觉信息)。由皮肤上的机械性刺激感受器感知的物体表面纹理、摩擦力、温度等均属于纹理觉信息。经硬件系统采集和纹理觉编码后，纹理觉信号通过特定的触觉复现设备获得重建，向用户传递感受器感知到的振动或刺激脉冲的组合。例如新型触觉反馈显示屏通过手指在触摸屏上滑动体验纹理触感；振动波触觉反馈圆盘在相关技术中的虚拟现实游戏视听感官上增加振动触觉感知；谷歌(Google)在游戏平台增加触觉游戏手柄等。这些触觉重建系统的开发离不开纹理觉编码技术，纹理觉编码技术是开发这些设备的重要基础。
纹理觉编码方法主要分为3类：基于统计的编码方法；基于感知模型(韦伯定理)的编码方法；以混合感知编码的方法。其中，基于统计的纹理觉编码利用量化和预测模型来降低数据冗余度。基于感知模型的编码方法通过设置差别阈值(鉴别灵敏度)来实现数据压缩。混合感知编码利用感知的绝对阈值和掩蔽现象提取输入信号的必要属性实现感知压缩。基于稀疏线性预测的感知振动触觉信号压缩算法(Perceptual Vibrotactile-Signal Compression Based-on Sparse Linear Prediction，PVC-SLP)采用了加速敏感度函数(Acceleration Sensitivity Function，ASF)以构建触觉敏感度模型，目前被选为IEEEP1918.1.1触觉编解码标准的一部分。
下面结合附图，通过一些实施例及其应用场景对本申请实施例提供的触觉信号编码方法进行详细地说明。
参照图1，本申请实施例提供了一种触觉信号编码方法，如图1所示，该触觉信号编码方法包括：
步骤101，确定至少两个触觉信号中的主触觉信号和主触觉信号的空间信息；
本申请实施例中，上述空间信息可以包括但不限于以下至少一项：所属身体区域信息，在身体区域内的位置信息。
可选地，上述主触觉信号可以理解为至少两个(或者称为至少两路)触觉信号中的主信号，上述至少两个触觉信号中可以包括一个或者多个主触觉信号。其中，主触觉信号的确定方法可以根据实际需要进行设置，例如，在一些实施例中，主触觉信号的确定方法可以包括以下至少一项：
在信号功率(也可以称之为信号强度)大致相同的情况下，可以根据触觉信号的空间信息确定是否为触觉敏感点确定主触感信号，例如将触觉敏感点的触觉信号作为主触觉信号；
在信号功率有较大差值的情况下，根据信号功率大小(或者称之为信号的强弱)定义 主次触觉信号，例如，对所有触觉信号根据振幅、功率等因素进行降序排序，依据压缩要求选取若干大功率信号作为主触觉信号。
其中，触觉敏感点可以基于主观测试得出，也可以根据具体设备定义得到。
步骤102，根据每一所述主触觉信号和所述主触觉信号的空间信息确定所述主触觉信号对应的第一模型。
可选的，所述第一模型包括遮蔽效应阈值，所述遮蔽效应阈值用于表示所述主触觉信号对其周围位置上的触觉信号完全遮蔽的门限；
步骤103，针对每一所述主触觉信号，根据所述主触觉信号对应的第一模型确定所述主触觉信号对应的次触觉信号，所述次触觉信号为所述主触觉信号的周围位置上的触觉信号中未被所述主触觉信号完全遮蔽的信号；
本申请实施例中，上述第一模型可以为空间心理触觉模型，上述遮蔽效应阈值可以反映主触觉信号对其周围特定位置上触觉信号的遮蔽效应大小，换句话说就是在主触觉信号存在时，人主观上能够感知与主信号相邻位置上信号功率的阈值。例如大于或等于该遮蔽效应阈值的触觉信号可以表示主触觉信号对该触觉信号未完全遮蔽，对于小于该遮蔽效应阈值的触觉信号可以表示主触觉信号对该触觉信号完全遮蔽。将未完全遮蔽的触觉信号作为次触觉信号。
可选地，上述主触觉信号与第一模型为一一对应关系。基于主触觉信号的空间位置不同，对应的第一模型不同，具体如图2a至图2f，给出了几种可能的第一模型示例图。其中，图中的“X”表示主触觉信号或者主触觉信号所在的位置，图中的“O”表示主触觉信号周围位置存在的触觉信号或者表示主触觉信号的周围位置中存在触觉信号的位置。
可选地，在本申请实施例中，可以将触觉信号接收点进行标号，按照空间位置将每个触觉信号的功率存储在功率矩阵中，然后基于该功率矩阵确定主触觉信号的周围位置。其中，该功率矩阵的大小可随信号数目改变。此外为了便于处理，矩阵周围填充0，代表无信号。通常的，主触觉信号周围的位置可以理解为包括8个位置，即可以采用空间相邻矩阵确定主触觉信号周围的位置以及周围位置上的触觉信号，主触觉信号为空间相邻矩阵的中心位置，其余位置为主触觉信号的周围位置。
可选地，基于上述第一模型可以确定主触觉信号的周围位置上存在的次触觉信号和次触觉信号的空间信息。应理解，在本申请实施例中，仅将所述主触觉信号的周围位置上的触觉信号中未被所述主触觉信号完全遮蔽的触觉信号确定为次触觉信号，将被主触觉信号完全遮蔽的信号作为冗余信号，在后续不进行编码，从而提高了压缩效率，降低了编码的码流大小。
步骤104，基于所述主触觉信号对应的次触觉信号的空间信息，生成所述主触觉信号对应的第一掩码，所述第一掩码用于表示所述主触觉信号的周围位置上的存在次触觉信号的情况；
本申请实施例中，上述第一掩码可以理解为空间模态掩码，该第一掩码与主触觉信号 之间为一一对应关系。
可选地，当包括至少两个主触觉信号的情况下，可以根据主触觉信号和次触觉信号的空间信息依次构建每一主触觉信号对应的第一掩码，通过第一掩码标识主触觉信号周围各位置上是否有次触觉信号。例如，采用3*3的编码矩阵构建第一掩码，其中，主触觉信号位于编码矩阵的中心位置，不进行编码。其余八个位置编码为1-8，，每种模态对应一个八位二进制编码相邻，位置1对应二进制数第一为，位置2对应二进制数第二位，以此类推。若某一位置上有次输入信号，则对应的二进制数标识为1，没有次触觉信号的位置对应的二进制数据标识为0。
可选地，上述第一掩码表示主触觉信号和次触觉信号在空间上的相邻性，可用于优化函数的选择，该优化函数可以用于对次触觉信号编码前的优化处理。以进一步提高次触觉信号的压缩效率。
步骤105，对待编码内容、所述主触觉信号的空间信息和所述主触觉信号对应的第一掩码进行编码获得所述触觉信号的码流；其中，所述待编码内容包括用于表示所述主触觉信号的第一待编码对象和用于表示所述主触觉信号对应的次触觉信号的第二待编码对象。
本申请实施例中，通过确定至少两个触觉信号中的主触觉信号和主触觉信号的空间信息；根据每一所述主触觉信号和所述主触觉信号的空间信息确定所述主触觉信号对应的第一模型；针对每一所述主触觉信号，根据所述主触觉信号对应的第一模型确定所述主触觉信号对应的次触觉信号，所述次触觉信号为所述主触觉信号的周围位置上的触觉信号中未被所述主触觉信号完全遮蔽的信号；基于所述主触觉信号对应的次触觉信号的空间信息，生成所述主触觉信号对应的第一掩码，所述第一掩码用于表示所述主触觉信号的周围位置上的存在次触觉信号的情况；对待编码内容、所述主触觉信号的空间信息和所述主触觉信号对应的第一掩码进行编码获得所述触觉信号的码流；其中，所述待编码内容包括用于表示所述主触觉信号的第一待编码对象和用于表示所述主触觉信号对应的次触觉信号的第二待编码对象。这样，在编码过程中，考虑了相邻触觉信号之间的遮蔽效应，从而只需要对主触觉信号和未被主触觉信号完全遮蔽的触觉信号进行编码。因此，本申请实施例提高了触觉信号的压缩效率。
可选地，在一些实施例中，所述第一待编码对象包括以下任一项：
待编码的主触觉信号；
待编码的主触觉信号与相邻已编码的重建主触觉信号的差值；
待编码的主触觉信号与前一个已经编码的重建主触觉信号的差值；
待编码的主触觉信号与至少两个已编码的重建主触觉信号中功率最大的已编码的重建主触觉信号的差值；
待编码的主触觉信号与至少两个已编码的重建主触觉信号中功率最小的已编码的重建主触觉信号的差值；
待编码的主触觉信号与至少两个已编码的重建主触觉信号的平均值的差值。
本申请实施例中，上述相邻已编码的重建主触觉信号可以理解为：已经编码的主触觉信号中，与当前待编码的主触觉信号相邻的主触觉信号重建后的主触觉信号。可选地，该相邻可以理解为位于当前待编码的主触觉信号左侧相邻的主触觉信号或位于当前待编码的主触觉信号上侧相邻的主触觉信号。
可选地，在所述第一待编码对象包括待编码的主触觉信号时，可以理解为直接对原始的主触觉信号进行编码，这样可以降低解码端重建主触觉信号的难度。在所述第一待编码对象包括待编码的主触觉信号之外的其他项目时，可以理解为对主触觉信号的编码信息进行了优化，减少了主触觉信号的编码信息的大小，从而提高了主触觉信号的压缩效率。
可选地，在一些实施例中，所述第二待编码对象包括以下任一项：
待编码的次触觉信号；
待编码的次触觉信号与相邻已编码的重建次触觉信号的差值；
待编码的次触觉信号与前一个已经编码的重建次触觉信号的差值；
待编码的次触觉信号与至少已编码的重建两个次触觉信号中功率最大的次触觉信号的差值；
待编码的次触觉信号与至少已编码的重建两个次触觉信号中功率最小的次触觉信号的差值；
待编码的次触觉信号与至少已编码的重建两个次触觉信号的平均值的差值；
待编码的次触觉信号与所述第一模型的遮蔽效应阈值的差值；
待编码的次触觉信号经过归一化处理后的信号；
待编码的次触觉信号与对应的已编码的重建主触觉信号的差值。
本申请实施例中，上述相邻已编码的重建次触觉信号可以理解为：已经编码的次触觉信号中，与当前待编码的次触觉信号相邻的次触觉信号重建后的次触觉信号。可选地，该相邻可以理解为位于当前待编码的次触觉信号左侧相邻的次触觉信号或位于当前待编码的次触觉信号上侧相邻的次触觉信号。
可选地，在所述第二待编码对象包括当前待编码的次触觉信号时，可以理解为直接对原始的次触觉信号进行编码，这样可以降低解码端重建次触觉信号的难度。在所述第一待编码对象包括当前待编码的次触觉信号之外的其他项目时，可以理解为对次触觉信号的编码信息进行了优化，减少了次触觉信号的编码信息的大小，从而提高了次触觉信号的压缩效率。
需要说明的是，当上述第二待编码对象包括待编码的次触觉信号与所述第一模型的遮蔽效应阈值的差值、待编码的次触觉信号经过归一化处理后的信号和待编码的次触觉信号与对应的已编码的重建主触觉信号的差值中的任一项时，表示首先利用优化函数对次触觉信号进行优化处理。换句话说，编码端设备可以选择相应的优化处理策略，通过优化处理策略对应的优化函数对次触觉信号进行优化处理，得到优化处理后的次触觉信号。其中，优化处理策略可以包括以下至少一项：将待编码的次触觉信号与所述第一模型的遮蔽效应 阈值做差值；将待编码的次触觉信号经过归一化处理后；将待编码的次触觉信号与对应的已编码的重建主触觉信号做差值。其中选择优化处理策略的过程可以理解为进行优化函数的选择。
可选地，在一些实施例中，所述归一化处理包括：
以至少两个已编码的重建次触觉信号中功率最大的重建次触觉信号为基础，对待编码的次触觉信号进行归一化处理。
可选地，在一些实施例中，所述针对每一所述主触觉信号，根据所述主触觉信号对应的第一模型确定所述主触觉信号对应的次触觉信号包括：
针对每一所述主触觉信号，根据所述主触觉信号对应的所述第一模型的遮蔽效应阈值确定所述主触觉信号对应的次触觉信号；
其中，所述第一模型的遮蔽效应阈值包括所述主触觉信号对应的所述第一模型中每一第一位置的阈值，所述第一位置为所述主触觉信号所在的第二位置的周围位置中存在所述触觉信号的位置，针对每一所述第一位置，在所述第一位置上的第一触觉信号大于或等于所述第一位置的阈值的情况下，确定所述第一触觉信号未被所述主触觉信号完全遮蔽，并将所述第一触觉信号确定为所述次触觉信号；在所述第一位置上的第一触觉信号小于所述第一位置的阈值的情况下，确定所述第一触觉信号被所述主触觉信号完全遮蔽，并丢弃所述第一触觉信号。
应理解，丢弃第一触觉信号后，在编码过程中无需对第一触觉信号进行编码。也就是说在编码过程中取消了被主触觉信号完全遮蔽的触觉信号的编码，因此提高了触觉信号的压缩效率。
本申请实施例中，如图2a所示，上述第一模型的遮蔽效应阈值包括4个阈值，分别对应上下左右四个位置，当然在其他实施例中还可以采用其他阈值设置方式，例如上下左右四个位置采用相同的阈值。
可选地，在一些实施例中，所述针对每一所述主触觉信号，根据所述主触觉信号对应的第一模型确定所述主触觉信号对应的次触觉信号之后，所述方法还包括：
在N个主触觉信号对应的次触觉信号均包括第一次触觉信号的情况下，将N-1个主触觉信号对应的次触觉信号中的所述第一次触觉信号丢弃；
其中，所述N为大于1的整数，所述N-1个主触觉信号为所述N个主触觉信号中的部分主触觉信号。
本申请实施例中，在N个主触觉信号对应的次触觉信号均包括第一次触觉信号可以理解为所述次触觉信号中的第一次触觉信号被确定为N个主触觉信号对应的次触觉信号。可选地，如果遇到某一次触觉信号属于多个主触觉信号，则可以基于功率大小确定该次触觉信号最终所属的主触觉信号，其他主触觉信号忽略该次触觉信号，这样，避免了一个次触觉信号同时归属与多个主触觉信号，降低了编解码的操作难度。
需要说明的是，确定次触觉信号所归属的主触觉信号的方式可以根据实际需要进行设 置，例如，在一些实施例中，所述N-1个主触觉信号为所述N个主触觉信号按照功率从小到大的顺序排列的前N-1个主触觉信号。
也就是说，在本申请实施例中，可以将次触觉信号归属于功率最大的主触觉信号。
为了更好的理解本申请，以下通过一些实例对如何确定主触觉信号和次触觉信号的方式进行说明。
首先，将触觉信号接收点进行标号，按照空间位置将每个触觉信号的功率存储在功率矩阵中。可选地，该功率矩阵的大小可随信号数目改变。为了便于处理，矩阵周围填充0，代表无信号。
然后，对触觉信号的功率值进行排序，选择最大的触觉信号定义为第一个主触觉信号。
接着，确定该第一个主触觉信号的周围触觉信号，周围触觉信号需要使用相应位置的空间相邻矩阵进行确定。确定第一个主触觉信号周围信号后，各自判断其是否高于主触觉信号对应的空间心理触觉模型给出的遮蔽效应阈值；定义高于遮蔽效应阈值的触觉信号为次触觉信号，低于遮蔽效应阈值的触觉信号被主触觉信号完全遮蔽，故将其舍去。同时在位置矩阵中将已被定义的触觉信号进行标记，标记其为主触觉信号或次触觉信号。另外，为方便下一步构造空间模态掩码，还应当在信号主次表中进行记录，记录值可为：主触觉信号序号、与该主触觉信号对应的次触觉信号序号数组。
之后从未被标记中的触觉信号里选择最大的触觉信号重复上述步骤，直至所有触觉信号都被进行标记。如遇到次触觉信号属于多个主触觉信号，可选择将次触觉信号归属于功率较大的主触觉信号(即将该次触觉信号加入功率最大的信号主次表，其他主触觉信号忽略此信号)，也可选择从属于多个主触觉信号(将该次触觉信号加入多个主触觉信号的主次表)。
参照图3，本申请实施例还提供了一种触觉信号解码方法，如图3所示，该触觉信号解码方法包括：
步骤301，对触觉信号的码流进行解码，获得待解码内容、所述触觉信号中主触觉信号的空间信息和所述主触觉信号对应的第一掩码，所述待解码内容包括用于表示所述主触觉信号的第一待解码对象和用于表示所述触觉信号中与所述主触觉信号对应的次触觉信号的第二待解码对象；
步骤302，基于所述主触觉信号的空间信息和所述第一掩码获得所述主触觉信号的周围位置上的存在次触觉信号的情况；
步骤303，基于所述第一待解码对象重建所述主触觉信号；
步骤304，基于所述第二待解码对象和所述主触觉信号的周围位置上的存在次触觉信号的情况重建所述主触觉信号的周围位置上存在的次触觉信号。
可选地，所述第一待解码对象包括以下任一项：
待解码的主触觉信号；
待解码的主触觉信号与相邻已解码的重建主触觉信号的差值；
待解码的主触觉信号与前一个已经解码的重建主触觉信号的差值；
待解码的主触觉信号与至少两个已解码的重建主触觉信号中功率最大的重建主触觉信号的差值；
待解码的主触觉信号与至少两个已解码的重建主触觉信号中功率最小的重建主触觉信号的差值；
待解码的主触觉信号与至少两个已解码的重建主触觉信号中所有重建主触觉信号的平均值的差值。
可选地，所述第二待解码对象包括以下任一项：
待解码的次触觉信号；
待解码的次触觉信号与相邻已解码的重建次触觉信号的差值；
待解码的次触觉信号与前一个已解码的重建次触觉信号的差值；
待解码的次触觉信号与至少两个已解码的重建次触觉信号中功率最大的次触觉信号的差值；
待解码的次触觉信号与至少两个已解码的重建次触觉信号中功率最小的重建次触觉信号的差值；
待解码的次触觉信号与至少两个已解码的重建次触觉信号中所有重建次触觉信号的平均值的差值；
待解码的次触觉信号与所述主触觉信号对应的第一模型的遮蔽效应阈值的差值，所述遮蔽效应阈值用于表示所述主触觉信号对其周围位置上的触觉信号完全遮蔽的门限；
待解码的次触觉信号经过归一化处理后的信号；
待解码的次触觉信号与对应的已解码的主触觉信号的差值。
可选地，所述归一化处理包括：
以至少两个已解码的重建次触觉信号中功率最大的重建次触觉信号为基础，对待解码的次触觉信号进行归一化处理。
本申请实施例提供的触觉信号编码方法，执行主体可以为触觉信号编码装置。本申请实施例中以触觉信号编码装置执行触觉信号编码方法为例，说明本申请实施例提供的触觉信号编码装置。
参照图4，本申请实施例还提供了一种触觉信号编码装置，如图4所示，该触觉信号编码装置400包括：
第一确定模块401，用于确定至少两个触觉信号中的主触觉信号和主触觉信号的空间信息；
第二确定模块402，用于根据每一所述主触觉信号和所述主触觉信号的空间信息确定所述主触觉信号对应的第一模型；
第三确定模块403，用于针对每一所述主触觉信号，根据所述主触觉信号对应的第一模型确定所述主触觉信号对应的次触觉信号，所述次触觉信号为所述主触觉信号的周围位 置上的触觉信号中未被所述主触觉信号完全遮蔽的信号；
生成模块404，用于基于所述主触觉信号对应的次触觉信号的空间信息，生成所述主触觉信号对应的第一掩码，所述第一掩码用于表示所述主触觉信号的周围位置上的存在次触觉信号的情况；
编码模块405，用于对待编码内容、所述主触觉信号的空间信息和所述主触觉信号对应的第一掩码进行编码获得所述触觉信号的码流；其中，所述待编码内容包括用于表示所述主触觉信号的第一待编码对象和用于表示所述主触觉信号对应的次触觉信号的第二待编码对象。
可选地，所述第一待编码对象包括以下任一项：
待编码的主触觉信号；
待编码的主触觉信号与相邻已编码的重建主触觉信号的差值；
待编码的主触觉信号与前一个已经编码的重建主触觉信号的差值；
待编码的主触觉信号与至少两个已编码的重建主触觉信号中功率最大的已编码的重建主触觉信号的差值；
待编码的主触觉信号与至少两个已编码的重建主触觉信号中功率最小的已编码的重建主触觉信号的差值；
待编码的主触觉信号与至少两个已编码的重建主触觉信号的平均值的差值。
可选地，所述第二待编码对象包括以下任一项：
待编码的次触觉信号；
待编码的次触觉信号与相邻已编码的重建次触觉信号的差值；
待编码的次触觉信号与前一个已经编码的重建次触觉信号的差值；
待编码的次触觉信号与至少已编码的重建两个次触觉信号中功率最大的次触觉信号的差值；
待编码的次触觉信号与至少已编码的重建两个次触觉信号中功率最小的次触觉信号的差值；
待编码的次触觉信号与至少已编码的重建两个次触觉信号的平均值的差值；
待编码的次触觉信号与所述第一模型的遮蔽效应阈值的差值；
待编码的次触觉信号经过归一化处理后的信号；
待编码的次触觉信号与对应的已编码的重建主触觉信号的差值。
可选地，所述归一化处理包括：
以至少两个已编码的重建次触觉信号中功率最大的重建次触觉信号为基础，对待编码的次触觉信号进行归一化处理。
可选地，所述第三确定模块403具体用于：针对每一所述主触觉信号，根据所述主触觉信号对应的所述第一模型的遮蔽效应阈值确定所述主触觉信号对应的次触觉信号；
其中，所述第一模型的遮蔽效应阈值包括所述主触觉信号对应的所述第一模型中每一 第一位置的阈值，所述第一位置为所述主触觉信号所在的第二位置的周围位置中存在所述触觉信号的位置，针对每一所述第一位置，在所述第一位置上的第一触觉信号大于或等于所述第一位置的阈值的情况下，确定所述第一触觉信号未被所述主触觉信号完全遮蔽，并将所述第一触觉信号确定为所述次触觉信号；在所述第一位置上的第一触觉信号小于所述第一位置的阈值的情况下，确定所述第一触觉信号被所述主触觉信号完全遮蔽，并丢弃所述第一触觉信号。
可选地，所述触觉信号编码装置400还包括：
处理模块，用于在所述次触觉信号中的第一次触觉信号被确定为N个主触觉信号对应的次触觉信号的情况下，将N-1个主触觉信号对应的次触觉信号中的所述第一次触觉信号丢弃；
其中，所述N为大于1的整数，所述N-1个主触觉信号为所述N个主触觉信号中的部分主触觉信号。
可选地，所述N-1个主触觉信号为所述N个主触觉信号按照功率从小到大的顺序排列的前N-1个主触觉信号。
本申请实施例提供的触觉信号解码方法，执行主体可以为触觉信号解码装置。本申请实施例中以触觉信号解码装置执行触觉信号解码方法为例，说明本申请实施例提供的触觉信号解码装置。
参照图5，本申请实施例还提供了一种触觉信号解码装置，如图5所示，该触觉信号解码装置500包括：
解码模块501，用于对触觉信号的码流进行解码，获得待解码内容、所述触觉信号中主触觉信号的空间信息和所述主触觉信号对应的第一掩码，所述待解码内容包括用于表示所述主触觉信号的第一待解码对象和用于表示所述触觉信号中与所述主触觉信号对应的次触觉信号的第二待解码对象；
获取模块502，用于基于所述主触觉信号的空间信息和所述第一掩码获得所述主触觉信号的周围位置上的存在次触觉信号的情况；
第一重建模块503，用于基于所述第一待解码对象重建所述主触觉信号；
第二重建模块504，用于基于所述第二待解码对象和所述主触觉信号的周围位置上的存在次触觉信号的情况重建所述主触觉信号的周围位置上存在的次触觉信号。
可选地，所述第一待解码对象包括以下任一项：
待解码的主触觉信号；
待解码的主触觉信号与相邻已解码的重建主触觉信号的差值；
待解码的主触觉信号与前一个已经解码的重建主触觉信号的差值；
待解码的主触觉信号与至少两个已解码的重建主触觉信号中功率最大的重建主触觉信号的差值；
待解码的主触觉信号与至少两个已解码的重建主触觉信号中功率最小的重建主触觉 信号的差值；
待解码的主触觉信号与至少两个已解码的重建主触觉信号中所有重建主触觉信号的平均值的差值。
可选地，所述第二待解码对象包括以下任一项：
待解码的次触觉信号；
待解码的次触觉信号与相邻已解码的重建次触觉信号的差值；
待解码的次触觉信号与前一个已解码的重建次触觉信号的差值；
待解码的次触觉信号与至少两个已解码的重建次触觉信号中功率最大的次触觉信号的差值；
待解码的次触觉信号与至少两个已解码的重建次触觉信号中功率最小的重建次触觉信号的差值；
待解码的次触觉信号与至少两个已解码的重建次触觉信号中所有重建次触觉信号的平均值的差值；
待解码的次触觉信号与所述主触觉信号对应的第一模型的遮蔽效应阈值的差值，所述遮蔽效应阈值用于表示所述主触觉信号对其周围位置上的触觉信号完全遮蔽的门限；
待解码的次触觉信号经过归一化处理后的信号；
待解码的次触觉信号与对应的已解码的主触觉信号的差值。
可选地，所述归一化处理包括：
以至少两个已解码的重建次触觉信号中功率最大的重建次触觉信号为基础，对待解码的次触觉信号进行归一化处理。
本申请实施例中的触觉信号编码装置和触觉信号解码装置可以是电子设备，例如具有操作系统的电子设备，也可以是电子设备中的部件，例如集成电路或芯片。该电子设备可以是终端，也可以为除终端之外的其他设备。示例性的，终端可以包括但不限于上述所列举的终端11的类型，其他设备可以为服务器、网络附属存储器(Network Attached Storage，NAS)等，本申请实施例不作具体限定。
本申请实施例提供的触觉信号编码装置和触觉信号解码装置能够实现图1至图3的方法实施例实现的各个过程，并达到相同的技术效果，为避免重复，这里不再赘述。
可选的，如图6所示，本申请实施例还提供一种通信设备600，包括处理器601和存储器602，存储器602上存储有可在所述处理器601上运行的程序或指令，例如，该通信设备600为编码端设备时，该程序或指令被处理器601执行时实现上述触觉信号编码方法实施例的各个步骤，且能达到相同的技术效果。该通信设备600为解码端设备时，该程序或指令被处理器601执行时实现上述触觉信号解码方法实施例的各个步骤，且能达到相同的技术效果，为避免重复，这里不再赘述。
本申请实施例还提供一种终端，包括处理器和通信接口，其中，
在所述终端为编码端设备的情况下，所述处理器用于执行以下操作：确定至少两个触 觉信号中的主触觉信号和主触觉信号的空间信息；根据每一所述主触觉信号和所述主触觉信号的空间信息确定所述主触觉信号对应的第一模型；针对每一所述主触觉信号，根据所述主触觉信号对应的第一模型确定所述主触觉信号对应的次触觉信号，所述次触觉信号为所述主触觉信号的周围位置上的触觉信号中未被所述主触觉信号完全遮蔽的信号；基于所述主触觉信号对应的次触觉信号的空间信息，生成所述主触觉信号对应的第一掩码，所述第一掩码用于表示所述主触觉信号的周围位置上的存在次触觉信号的情况；对待编码内容、所述主触觉信号的空间信息和所述主触觉信号对应的第一掩码进行编码获得所述触觉信号的码流；其中，所述待编码内容包括用于表示所述主触觉信号的第一待编码对象和用于表示所述主触觉信号对应的次触觉信号的第二待编码对象；
或者，在所述终端为解码端设备的情况下，所述处理器用于执行以下操作：对触觉信号的码流进行解码，获得待解码内容、所述触觉信号中主触觉信号的空间信息和所述主触觉信号对应的第一掩码，所述待解码内容包括用于表示所述主触觉信号的第一待解码对象和用于表示所述触觉信号中与所述主触觉信号对应的次触觉信号的第二待解码对象；基于所述主触觉信号的空间信息和所述第一掩码获得所述主触觉信号的周围位置上的存在次触觉信号的情况；基于所述第一待解码对象重建所述主触觉信号；基于所述第二待解码对象和所述主触觉信号的周围位置上的存在次触觉信号的情况重建所述主触觉信号的周围位置上存在的次触觉信号。
该终端实施例与上述终端侧方法实施例对应，上述方法实施例的各个实施过程和实现方式均可适用于该终端实施例中，且能达到相同的技术效果。具体地，图7为实现本申请实施例的一种终端的硬件结构示意图。
该终端700包括但不限于：射频单元701、网络模块702、音频输出单元703、输入单元704、传感器705、显示单元706、用户输入单元707、接口单元708、存储器709以及处理器710等中的至少部分部件。
本领域技术人员可以理解，终端700还可以包括给各个部件供电的电源(比如电池)，电源可以通过电源管理系统与处理器710逻辑相连，从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。图7中示出的终端结构并不构成对终端的限定，终端可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置，在此不再赘述。
应理解的是，本申请实施例中，输入单元704可以包括图形处理器(Graphics Processing Unit，GPU)7041和麦克风7042，图形处理器7041对在视频捕获模式或图像捕获模式中由图像捕获装置(如摄像头)获得的静态图片或视频的图像数据进行处理。显示单元706可包括显示面板7061，可以采用液晶显示器、有机发光二极管等形式来配置显示面板7061。用户输入单元707包括触控面板7071以及其他输入设备7072中的至少一种。触控面板7071，也称为触摸屏。触控面板7071可包括触摸检测装置和触摸控制器两个部分。其他输入设备7072可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆，在此不再赘述。
本申请实施例中，射频单元701接收来自网络侧设备的下行数据后，可以传输给处理器710进行处理；另外，射频单元701可以向网络侧设备发送上行数据。通常，射频单元701包括但不限于天线、放大器、收发信机、耦合器、低噪声放大器、双工器等。
存储器709可用于存储软件程序或指令以及各种数据。存储器709可主要包括存储程序或指令的第一存储区和存储数据的第二存储区，其中，第一存储区可存储操作系统、至少一个功能所需的应用程序或指令(比如声音播放功能、图像播放功能等)等。此外，存储器709可以包括易失性存储器或非易失性存储器，或者，存储器709可以包括易失性和非易失性存储器两者。其中，非易失性存储器可以是只读存储器(Read-Only Memory，ROM)、可编程只读存储器(Programmable ROM，PROM)、可擦除可编程只读存储器(Erasable PROM，EPROM)、电可擦除可编程只读存储器(Electrically EPROM，EEPROM)或闪存。易失性存储器可以是随机存取存储器(Random Access Memory，RAM)，静态随机存取存储器(Static RAM，SRAM)、动态随机存取存储器(Dynamic RAM，DRAM)、同步动态随机存取存储器(Synchronous DRAM，SDRAM)、双倍数据速率同步动态随机存取存储器(Double Data Rate SDRAM，DDRSDRAM)、增强型同步动态随机存取存储器(Enhanced SDRAM，ESDRAM)、同步连接动态随机存取存储器(Synch link DRAM，SLDRAM)和直接内存总线随机存取存储器(Direct Rambus RAM，DRRAM)。本申请实施例中的存储器709包括但不限于这些和任意其它适合类型的存储器。
处理器710可包括一个或多个处理单元；可选的，处理器710集成应用处理器和调制解调处理器，其中，应用处理器主要处理涉及操作系统、用户界面和应用程序等的操作，调制解调处理器主要处理无线通信信号，如基带处理器。可以理解的是，上述调制解调处理器也可以不集成到处理器710中。
其中，在所述终端为编码端设备的情况下，所述处理器710用于执行以下操作：确定至少两个触觉信号中的主触觉信号和主触觉信号的空间信息；根据每一所述主触觉信号和所述主触觉信号的空间信息确定所述主触觉信号对应的第一模型；针对每一所述主触觉信号，根据所述主触觉信号对应的第一模型确定所述主触觉信号对应的次触觉信号，所述次触觉信号为所述主触觉信号的周围位置上的触觉信号中未被所述主触觉信号完全遮蔽的信号；基于所述主触觉信号对应的次触觉信号的空间信息，生成所述主触觉信号对应的第一掩码，所述第一掩码用于表示所述主触觉信号的周围位置上的存在次触觉信号的情况；对待编码内容、所述主触觉信号的空间信息和所述主触觉信号对应的第一掩码进行编码获得所述触觉信号的码流；其中，所述待编码内容包括用于表示所述主触觉信号的第一待编码对象和用于表示所述主触觉信号对应的次触觉信号的第二待编码对象；
或者，在所述终端为解码端设备的情况下，所述处理器710用于执行以下操作：对触觉信号的码流进行解码，获得待解码内容、所述触觉信号中主触觉信号的空间信息和所述主触觉信号对应的第一掩码，所述待解码内容包括用于表示所述主触觉信号的第一待解码对象和用于表示所述触觉信号中与所述主触觉信号对应的次触觉信号的第二待解码对象； 基于所述主触觉信号的空间信息和所述第一掩码获得所述主触觉信号的周围位置上的存在次触觉信号的情况；基于所述第一待解码对象重建所述主触觉信号；基于所述第二待解码对象和所述主触觉信号的周围位置上的存在次触觉信号的情况重建所述主触觉信号的周围位置上存在的次触觉信号。
本申请实施例还提供一种可读存储介质，所述可读存储介质上存储有程序或指令，该程序或指令被处理器执行时实现上述触觉信号编码方法和触觉信号解码方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
其中，所述处理器为上述实施例中所述的终端中的处理器。所述可读存储介质，包括计算机可读存储介质，如计算机只读存储器ROM、随机存取存储器RAM、磁碟或者光盘等。
本申请实施例另提供了一种芯片，所述芯片包括处理器和通信接口，所述通信接口和所述处理器耦合，所述处理器用于运行程序或指令，实现上述触觉信号编码方法和触觉信号解码方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
应理解，本申请实施例提到的芯片还可以称为系统级芯片，系统芯片，芯片系统或片上系统芯片等。
本申请实施例另提供了一种计算机程序/程序产品，所述计算机程序/程序产品被存储在存储介质中，所述计算机程序/程序产品被至少一个处理器执行以实现上述触觉信号编码方法和触觉信号解码方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
本申请实施例还提供了一种通信系统，包括：编码端设备及解码端设备，所述终端用于执行如图1及上述编码端设备各个方法实施例的各个过程，所述解码端设备用于执行如图3及上述解码端设备各个方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。此外，需要指出的是，本申请实施方式中的方法和装置的范围不限按示出或讨论的顺序来执行功能，还可包括根据所涉及的功能按基本同时的方式或按相反的顺序来执行功能，例如，可以按不同于所描述的次序来执行所描述的方法，并且还可以添加、省去、或组合各种步骤。另外，参照某些示例所描述的特征可在其他示例中被组合。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡 献的部分可以以计算机软件产品的形式体现出来，该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端(可以是手机，计算机，服务器，空调器，或者网络设备等)执行本申请各个实施例所述的方法。
上面结合附图对本申请的实施例进行了描述，但是本申请并不局限于上述的具体实施方式，上述的具体实施方式仅仅是示意性的，而不是限制性的，本领域的普通技术人员在本申请的启示下，在不脱离本申请宗旨和权利要求所保护的范围情况下，还可做出很多形式，均属于本申请的保护之内。

Claims (17)

  1. 一种触觉信号编码方法，包括：
    确定至少两个触觉信号中的主触觉信号和主触觉信号的空间信息；
    根据每一所述主触觉信号和所述主触觉信号的空间信息确定所述主触觉信号对应的第一模型；
    针对每一所述主触觉信号，根据所述主触觉信号对应的第一模型确定所述主触觉信号对应的次触觉信号，所述次触觉信号为所述主触觉信号的周围位置上的触觉信号中未被所述主触觉信号完全遮蔽的信号；
    基于所述主触觉信号对应的次触觉信号的空间信息，生成所述主触觉信号对应的第一掩码，所述第一掩码用于表示所述主触觉信号的周围位置上的存在次触觉信号的情况；
    对待编码内容、所述主触觉信号的空间信息和所述主触觉信号对应的第一掩码进行编码获得所述触觉信号的码流；其中，所述待编码内容包括用于表示所述主触觉信号的第一待编码对象和用于表示所述主触觉信号对应的次触觉信号的第二待编码对象。
  2. 根据权利要求1所述的方法，其中，所述第一待编码对象包括以下任一项：
    待编码的主触觉信号；
    待编码的主触觉信号与相邻已编码的重建主触觉信号的差值；
    待编码的主触觉信号与前一个已经编码的重建主触觉信号的差值；
    待编码的主触觉信号与至少两个已编码的重建主触觉信号中功率最大的已编码的重建主触觉信号的差值；
    待编码的主触觉信号与至少两个已编码的重建主触觉信号中功率最小的已编码的重建主触觉信号的差值；
    待编码的主触觉信号与至少两个已编码的重建主触觉信号的平均值的差值。
  3. 根据权利要求1或2所述的方法，其中，所述第二待编码对象包括以下任一项：
    待编码的次触觉信号；
    待编码的次触觉信号与相邻已编码的重建次触觉信号的差值；
    待编码的次触觉信号与前一个已经编码的重建次触觉信号的差值；
    待编码的次触觉信号与至少已编码的重建两个次触觉信号中功率最大的次触觉信号的差值；
    待编码的次触觉信号与至少已编码的重建两个次触觉信号中功率最小的次触觉信号的差值；
    待编码的次触觉信号与至少已编码的重建两个次触觉信号的平均值的差值；
    待编码的次触觉信号与所述第一模型的遮蔽效应阈值的差值，所述遮蔽效应阈值用于表示所述主触觉信号对其周围位置上的触觉信号完全遮蔽的门限；
    待编码的次触觉信号经过归一化处理后的信号；
    待编码的次触觉信号与对应的已编码的重建主触觉信号的差值。
  4. 根据权利要求3所述的方法，其中，所述归一化处理包括：
    以至少两个已编码的重建次触觉信号中功率最大的重建次触觉信号为基础，对待编码的次触觉信号进行归一化处理。
  5. 根据权利要求1至4中任一项所述的方法，其中，所述针对每一所述主触觉信号，根据所述主触觉信号对应的第一模型确定所述主触觉信号对应的次触觉信号包括：
    针对每一所述主触觉信号，根据所述主触觉信号对应的所述第一模型的遮蔽效应阈值确定所述主触觉信号对应的次触觉信号；
    其中，所述第一模型的遮蔽效应阈值包括所述主触觉信号对应的所述第一模型中每一第一位置的阈值，所述第一位置为所述主触觉信号所在的第二位置的周围位置中存在所述触觉信号的位置，针对每一所述第一位置，在所述第一位置上的第一触觉信号大于或等于所述第一位置的阈值的情况下，确定所述第一触觉信号未被所述主触觉信号完全遮蔽，并将所述第一触觉信号确定为所述次触觉信号；在所述第一位置上的第一触觉信号小于所述第一位置的阈值的情况下，确定所述第一触觉信号被所述主触觉信号完全遮蔽，并丢弃所述第一触觉信号。
  6. 根据权利要求1至5中任一项所述的方法，其中，所述针对每一所述主触觉信号，根据所述主触觉信号对应的第一模型确定所述主触觉信号对应的次触觉信号之后，所述方法还包括：
    在N个主触觉信号对应的次触觉信号均包括第一次触觉信号的情况下，将N-1个主触觉信号对应的次触觉信号中的所述第一次触觉信号丢弃；
    其中，所述N为大于1的整数，所述N-1个主触觉信号为所述N个主触觉信号中的部分主触觉信号。
  7. 根据权利要求6所述的方法，其中，所述N-1个主触觉信号为所述N个主触觉信号按照功率从小到大的顺序排列的前N-1个主触觉信号。
  8. 一种触觉信号解码方法，包括：
    对触觉信号的码流进行解码，获得待解码内容、所述触觉信号中主触觉信号的空间信息和所述主触觉信号对应的第一掩码，所述待解码内容包括用于表示所述主触觉信号的第一待解码对象和用于表示所述触觉信号中与所述主触觉信号对应的次触觉信号的第二待解码对象；
    基于所述主触觉信号的空间信息和所述第一掩码获得所述主触觉信号的周围位置上的存在次触觉信号的情况；
    基于所述第一待解码对象重建所述主触觉信号；
    基于所述第二待解码对象和所述主触觉信号的周围位置上的存在次触觉信号的情况重建所述主触觉信号的周围位置上存在的次触觉信号。
  9. 根据权利要求8所述的方法，其中，所述第一待解码对象包括以下任一项：
    待解码的主触觉信号；
    待解码的主触觉信号与相邻已解码的重建主触觉信号的差值；
    待解码的主触觉信号与前一个已经解码的重建主触觉信号的差值；
    待解码的主触觉信号与至少两个已解码的重建主触觉信号中功率最大的重建主触觉信号的差值；
    待解码的主触觉信号与至少两个已解码的重建主触觉信号中功率最小的重建主触觉信号的差值；
    待解码的主触觉信号与至少两个已解码的重建主触觉信号中所有重建主触觉信号的平均值的差值。
  10. 根据权利要求8或9所述的方法，其中，所述第二待解码对象包括以下任一项：
    待解码的次触觉信号；
    待解码的次触觉信号与相邻已解码的重建次触觉信号的差值；
    待解码的次触觉信号与前一个已解码的重建次触觉信号的差值；
    待解码的次触觉信号与至少两个已解码的重建次触觉信号中功率最大的次触觉信号的差值；
    待解码的次触觉信号与至少两个已解码的重建次触觉信号中功率最小的重建次触觉信号的差值；
    待解码的次触觉信号与至少两个已解码的重建次触觉信号中所有重建次触觉信号的平均值的差值；
    待解码的次触觉信号与所述主触觉信号对应的第一模型的遮蔽效应阈值的差值，所述遮蔽效应阈值用于表示所述主触觉信号对其周围位置上的触觉信号完全遮蔽的门限；
    待解码的次触觉信号经过归一化处理后的信号；
    待解码的次触觉信号与对应的已解码的主触觉信号的差值。
  11. 根据权利要求10所述的方法，其中，所述归一化处理包括：
    以至少两个已解码的重建次触觉信号中功率最大的重建次触觉信号为基础，对待解码的次触觉信号进行归一化处理。
  12. 一种触觉信号编码装置，包括：
    第一确定模块，用于确定至少两个触觉信号中的主触觉信号和主触觉信号的空间信息；
    第二确定模块，用于根据每一所述主触觉信号和所述主触觉信号的空间信息确定所述主触觉信号对应的第一模型；
    第三确定模块，用于针对每一所述主触觉信号，根据所述主触觉信号对应的第一模型确定所述主触觉信号对应的次触觉信号，所述次触觉信号为所述主触觉信号的周围位置上的触觉信号中未被所述主触觉信号完全遮蔽的信号；
    生成模块，用于基于所述主触觉信号对应的次触觉信号的空间信息，生成所述主触觉信号对应的第一掩码，所述第一掩码用于表示所述主触觉信号的周围位置上的存在次触觉 信号的情况；
    编码模块，用于对待编码内容、所述主触觉信号的空间信息和所述主触觉信号对应的第一掩码进行编码获得所述触觉信号的码流；其中，所述待编码内容包括用于表示所述主触觉信号的第一待编码对象和用于表示所述主触觉信号对应的次触觉信号的第二待编码对象。
  13. 一种触觉信号解码装置，包括：
    解码模块，用于对触觉信号的码流进行解码，获得待解码内容、所述触觉信号中主触觉信号的空间信息和所述主触觉信号对应的第一掩码，所述待解码内容包括用于表示所述主触觉信号的第一待解码对象和用于表示所述触觉信号中与所述主触觉信号对应的次触觉信号的第二待解码对象；
    获取模块，用于基于所述主触觉信号的空间信息和所述第一掩码获得所述主触觉信号的周围位置上的存在次触觉信号的情况；
    第一重建模块，用于基于所述第一待解码对象重建所述主触觉信号；
    第二重建模块，用于基于所述第二待解码对象和所述主触觉信号的周围位置上的存在次触觉信号的情况重建所述主触觉信号的周围位置上存在的次触觉信号。
  14. 一种终端，包括处理器和存储器，所述存储器存储可在所述处理器上运行的程序或指令，所述程序或指令被所述处理器执行时实现如权利要求1至7任一项所述的触觉信号编码方法的步骤，或者实现如权利要求8至11任一项所述的触觉信号解码方法的步骤。
  15. 一种可读存储介质，所述可读存储介质上存储程序或指令，所述程序或指令被处理器执行时实现如权利要求1至7任一项所述的触觉信号编码方法的步骤，或者实现如权利要求8至11任一项所述的触觉信号解码方法的步骤。
  16. 一种芯片，所述芯片包括处理器和通信接口，所述通信接口和所述处理器耦合，所述处理器用于运行程序或指令，实现如权利要求1至7任一项所述的触觉信号编码方法的步骤，或者实现如权利要求8至11任一项所述的触觉信号解码方法的步骤。
  17. 一种计算机程序/程序产品，所述计算机程序/程序产品被存储在存储介质中，所述计算机程序/程序产品被至少一个处理器执行以实现如如权利要求1至7任一项所述的触觉信号编码方法的步骤，或者实现如权利要求8至11任一项所述的触觉信号解码方法的步骤。
PCT/CN2023/126687 2022-11-08 2023-10-26 触觉信号编码方法、触觉信号解码方法及相关设备 WO2024099087A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202211394497.0A CN118042134A (zh) 2022-11-08 2022-11-08 触觉信号编码方法、触觉信号解码方法及相关设备
CN202211394497.0 2022-11-08

Publications (1)

Publication Number Publication Date
WO2024099087A1 true WO2024099087A1 (zh) 2024-05-16

Family

ID=90988091

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/126687 WO2024099087A1 (zh) 2022-11-08 2023-10-26 触觉信号编码方法、触觉信号解码方法及相关设备

Country Status (2)

Country Link
CN (1) CN118042134A (zh)
WO (1) WO2024099087A1 (zh)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190378385A1 (en) * 2015-09-16 2019-12-12 Taction Technology, Inc. Tactile transducer with digital signal processing for improved fidelity
US20200130193A1 (en) * 2018-01-16 2020-04-30 Preferred Networks, Inc. Tactile information estimation apparatus, tactile information estimation method, and program
CN111757127A (zh) * 2019-03-29 2020-10-09 慕尼黑工业大学 用于编码/解码振动触觉信号的编码/解码设备和方法
CN115209960A (zh) * 2020-03-04 2022-10-18 索尼集团公司 解码装置、解码方法、程序、编码装置和编码方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190378385A1 (en) * 2015-09-16 2019-12-12 Taction Technology, Inc. Tactile transducer with digital signal processing for improved fidelity
US20200130193A1 (en) * 2018-01-16 2020-04-30 Preferred Networks, Inc. Tactile information estimation apparatus, tactile information estimation method, and program
CN111757127A (zh) * 2019-03-29 2020-10-09 慕尼黑工业大学 用于编码/解码振动触觉信号的编码/解码设备和方法
CN115209960A (zh) * 2020-03-04 2022-10-18 索尼集团公司 解码装置、解码方法、程序、编码装置和编码方法

Also Published As

Publication number Publication date
CN118042134A (zh) 2024-05-14

Similar Documents

Publication Publication Date Title
CN106919918B (zh) 一种人脸跟踪方法和装置
CN106127673B (zh) 一种视频处理方法、装置及计算机设备
CN103632165B (zh) 一种图像处理的方法、装置及终端设备
WO2019047971A1 (zh) 图像识别方法、终端及存储介质
CN105426103B (zh) 一种移动设备上消息编辑方法和装置
CN109543200A (zh) 一种文本翻译方法及装置
CN110457235B (zh) 内存压缩方法、装置、终端及存储介质
CN104205161A (zh) 用于块压缩图象的解压缩的系统、方法和计算机程序产品
CN112084959B (zh) 一种人群图像处理方法及装置
EP3783906A1 (en) Method and device for selecting audio track from audio and video files
US20150109210A1 (en) Control method, and input device of touch screen terminal
CN108763350A (zh) 文本数据处理方法、装置、存储介质及终端
CN111507094B (zh) 基于深度学习的文本处理模型训练方法、装置及设备
CN110796147B (zh) 图像分割方法及相关产品
CN108665510A (zh) 连拍图像的渲染方法、装置、存储介质及终端
CN113852714A (zh) 一种用于电子设备的交互方法和电子设备
CN104915625B (zh) 一种人脸识别的方法及装置
CN109346102B (zh) 音频开头爆音的检测方法、装置及存储介质
WO2024099087A1 (zh) 触觉信号编码方法、触觉信号解码方法及相关设备
CN112888024B (zh) 数据处理方法、装置、存储介质及电子设备
CN107992378A (zh) 一种文件处理方法及移动终端
CN106302131B (zh) 一种聊天信息区别同步的方法及装置
CN109889660A (zh) 临时信息记录方法、存储介质和移动终端
CN110868497B (zh) 一种数据传输方法、装置及电子设备
CN111163533B (zh) 网络连接方法及相关产品