WO2024099100A1 - 触觉信号处理方法、装置及设备 - Google Patents

触觉信号处理方法、装置及设备 Download PDF

Info

Publication number
WO2024099100A1
WO2024099100A1 PCT/CN2023/126995 CN2023126995W WO2024099100A1 WO 2024099100 A1 WO2024099100 A1 WO 2024099100A1 CN 2023126995 W CN2023126995 W CN 2023126995W WO 2024099100 A1 WO2024099100 A1 WO 2024099100A1
Authority
WO
WIPO (PCT)
Prior art keywords
spatial position
tactile signal
spatial
block group
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2023/126995
Other languages
English (en)
French (fr)
Inventor
吕卓逸
蔺虎虎
何大众
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Publication of WO2024099100A1 publication Critical patent/WO2024099100A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer

Definitions

  • the present application belongs to the field of tactile coding technology, and specifically relates to a tactile signal processing method, device and equipment.
  • Tactile information is mainly divided into two categories: tactile information based on muscle movement perception, also known as kinesthetic information; and tactile information based on skin texture perception, also known as texture information.
  • tactile information is tactilely encoded to generate tactile signals, which are then transmitted to users by hardware devices, so that users feel vibrations or pulses, thereby increasing their tactile perception.
  • the human body is divided into multiple blocks, and tactile coding is implemented based on the tactile signals in each block.
  • tactile coding is implemented based on the tactile signals in each block.
  • the coding effect of this method is poor.
  • the embodiments of the present application provide a tactile signal processing method, device and apparatus, which can solve the problem of poor encoding effect of existing encoding of single-point tactile signals.
  • a tactile signal processing method comprising:
  • each block group For each block group, perform the following operations respectively until each spatial position in the block group is marked as a target spatial position:
  • the first spatial position is determined based on a tactile signal corresponding to an unmarked spatial position in the corresponding block group;
  • a mapping relationship between the spatial position of the primary haptic signal and the spatial position of the associated secondary haptic signal is generated, and processing is performed according to the mapping relationship.
  • a tactile signal processing device comprising:
  • the acquisition module is used to acquire the tactile signal corresponding to each spatial position in the block group of the target object.
  • the image includes at least one block group, each of the block groups includes a plurality of spatial locations;
  • the first processing module is used to perform the following operations for each block group, until each spatial position in the block group is marked as a target spatial position:
  • the first spatial position is determined based on a tactile signal corresponding to an unmarked spatial position in the corresponding block group;
  • the second processing module is used to generate a mapping relationship between the spatial position of the main tactile signal and the spatial position of the associated secondary tactile signal, and perform processing according to the mapping relationship.
  • a terminal comprising a processor and a memory, wherein the memory stores a program or instruction that can be executed on the processor, and when the program or instruction is executed by the processor, the steps of the method described in the first aspect are implemented.
  • a readable storage medium on which a program or instruction is stored.
  • the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.
  • a chip comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the steps of the method described in the first aspect.
  • a computer program/program product is provided, wherein the computer program/program product is stored in a storage medium and is executed by at least one processor to implement the steps of the method described in the first aspect.
  • the main tactile signal and the secondary tactile signal of the embodiment of the present application are determined based on the tactile signal corresponding to the first spatial position in the block group and the tactile signal corresponding to the second spatial position.
  • the second spatial position is determined by performing a spatial area selection operation on the first spatial position, that is, there is a spatial correlation between the first spatial position and the second spatial position.
  • subsequent processing is performed based on the mapping relationship between the spatial position of the main tactile signal and the spatial position of the associated secondary tactile signal.
  • the tactile signal is divided, and the mapping relationship between the main tactile signal and the secondary tactile signal is obtained, so that the subsequent processing can improve the encoding effect based on the mapping relationship.
  • FIG1 is one of the schematic diagrams of a human body block group provided in an embodiment of the present application.
  • FIG2 is a second schematic diagram of a human body block group provided in an embodiment of the present application.
  • FIG3 is a third schematic diagram of a human body block group provided in an embodiment of the present application.
  • FIG4 is a schematic diagram of a flow chart of a tactile signal processing method provided in an embodiment of the present application.
  • FIG5 is one of the schematic diagrams of the space matrix provided in the embodiment of the present application.
  • FIG6 is a second schematic diagram of a space matrix provided in an embodiment of the present application.
  • FIG7 is a third schematic diagram of a space matrix provided in an embodiment of the present application.
  • FIG8 is a fourth schematic diagram of a space matrix provided in an embodiment of the present application.
  • FIG9 is a schematic diagram of a mask matrix provided in an embodiment of the present application.
  • FIG10 is a structural diagram of a tactile signal processing device provided in an embodiment of the present application.
  • FIG11 is a structural diagram of a communication device provided in an embodiment of the present application.
  • FIG. 12 is a schematic diagram of the hardware structure of the terminal provided in an embodiment of the present application.
  • first, second, etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by “first” and “second” are generally of the same type, and the number of objects is not limited.
  • the first object can be one or more.
  • “and/or” in the specification and claims represents at least one of the connected objects, and the character “/" generally represents that the objects associated with each other are in an "or” relationship.
  • the various parts of the human body can be divided into 32 blocks, and each block is labeled.
  • number 1 front of the head; number 2: back of the head; number 3: right side of the head; number 4: left side of the head; number 5: right upper chest; number 6: left upper chest; number 7: abdomen; number 8: waist; number 9: upper back; number 10: lower back; number 11: right upper arm; number 12: left upper arm; number 13: right forearm; number 14: left forearm; number 15: right wrist; number 16: left wrist Wrist; Label 17: right palm; Label 18: left palm; Label 19: back of right hand; Label 20: back of left hand; Label 21: right fingers; Label 22: left fingers; Label 23: right thigh; Label 24: left thigh; Label 25: right calf; Label 26: left calf; Label 27: right sole; Label 28: left sole; Label 29: right instep; Label 30: left instep; Label 31: right toes; Label 32: left
  • a serial number may be used to represent each block, where the serial number is a 5-bit binary number corresponding to the number minus 1.
  • the serial number 1 represents the front of the head, and the serial number corresponding to the front of the head is 00000; the number 12 represents the left upper arm, and the serial number corresponding to the left upper arm is 01011; the number 32 represents the left toe, and the serial number corresponding to the left toe is 11111.
  • At least one block can be divided into a block group.
  • the right fingers and the right upper palm are divided into the same block group; as shown in Figure 2, the left forearm is divided into a block group; as shown in Figure 3, the right upper chest, left upper chest, abdomen and waist are divided into a block group.
  • each block includes multiple spatial positions, and each spatial position corresponds to a tactile signal, also known as a single-point tactile signal. As shown in Figure 2, the left forearm includes 10 spatial positions.
  • the embodiment of the present application provides a tactile signal processing method.
  • the tactile signal processing method provided by the embodiment of the present application is described in detail below through some embodiments and application scenarios in conjunction with the accompanying drawings.
  • FIG4 is a flow chart of a tactile signal processing method according to an embodiment of the present application.
  • the tactile signal processing method provided in this embodiment includes the following steps:
  • the block group is composed of at least one block, and each block includes multiple spatial positions, that is, the block group includes multiple spatial positions.
  • the target object includes at least one block group.
  • a tactile signal corresponding to each spatial position in the block group of the target object is obtained, wherein the tactile signal is determined based on the position of the spatial position in the block, the vibration amplitude received by the spatial position, and the vibration duration.
  • a first spatial position is selected from a plurality of spatial positions to perform a spatial region selection operation, and at least one second spatial position associated with the first spatial position is determined.
  • a main tactile signal and a secondary tactile signal associated with the main tactile signal are determined according to the tactile signal corresponding to the first spatial position and the tactile signal corresponding to the at least one second spatial position.
  • the first spatial position and the at least one second spatial position are marked as target spatial positions.
  • a first spatial position is determined based on a tactile signal corresponding to an unmarked spatial position in the block group, that is, the first spatial position is not marked as a target spatial position.
  • a spatial region selection operation is performed on the first spatial position to determine at least one second spatial position associated with the first spatial position, that is, the first spatial position and the second spatial position have spatial correlation.
  • S403 Generate a mapping relationship between the spatial position of the primary tactile signal and the spatial position of the associated secondary tactile signal, and perform processing according to the mapping relationship.
  • a tactile signal partition table corresponding to the block group can be generated based on the spatial position of the main tactile signal and the spatial position of the secondary tactile signal, and the tactile information partition table is used to characterize the partition result of the tactile signal corresponding to each spatial position in the block group.
  • An optional implementation is: storing the sequence number of the spatial position corresponding to the primary tactile signal and the sequence number of the spatial position corresponding to the secondary tactile signal in a tactile signal division table.
  • a tactile signal division table For the technical solution for determining the sequence number of the spatial position, please refer to the subsequent content.
  • Another optional implementation is: storing the power corresponding to the main tactile signal and the power corresponding to the secondary tactile signal in a tactile signal division table.
  • the main tactile signal and the secondary tactile signal of the embodiment of the present application are determined based on the tactile signal corresponding to the first spatial position in the block group and the tactile signal corresponding to the second spatial position.
  • the second spatial position is determined by performing a spatial area selection operation on the first spatial position, that is, there is a spatial correlation between the first spatial position and the second spatial position.
  • subsequent processing is performed based on the mapping relationship between the spatial position of the main tactile signal and the spatial position of the associated secondary tactile signal.
  • the tactile signal is divided, and the mapping relationship between the main tactile signal and the secondary tactile signal is obtained, so that the subsequent processing can improve the encoding effect based on the mapping relationship.
  • selecting a first spatial position from the multiple spatial positions to perform a spatial region selection operation, and determining at least one second spatial position associated with the first spatial position comprises:
  • At least one second spatial position associated with the first spatial position in the spatial matrix corresponding to the block group is determined.
  • a space matrix corresponding to each block group can be generated based on the distribution of the spatial positions corresponding to each block group, wherein the space matrix is used to characterize the positional relationship between each spatial position in the block group.
  • the block group shown in FIG1 includes right fingers and right upper palm, and the tactile signal corresponding to the spatial position included in the right finger block can be understood as a one-dimensional signal, and the tactile signal corresponding to the spatial position included in the right upper palm can be understood as a two-dimensional signal.
  • a spatial matrix as shown in FIG5 is generated, wherein the spatial matrix includes a serial number corresponding to each spatial position, and the serial number corresponding to the above spatial position can be customized. It should be understood that there is no tactile signal at the spatial position corresponding to the label 0 in the spatial matrix.
  • the block group shown in FIG2 includes the left forearm, and the tactile signal corresponding to the spatial position included in the left forearm block can be understood as a three-dimensional signal.
  • the three-dimensional signal is flattened into a two-dimensional signal to generate a spatial matrix as shown in FIG6, wherein the spatial matrix includes a sequence number corresponding to each spatial position.
  • the block group of the upper right chest, upper left chest, abdomen and waist shown in FIG3 generates a spatial matrix as shown in FIG7 based on the distribution of each spatial position in the block group shown in FIG3 , wherein the spatial matrix includes the serial number corresponding to each spatial position.
  • the unmarked spatial positions in the block group are traversed, and the spatial position corresponding to the tactile signal with the highest power is determined as the first spatial position, and then the preset target mask matrix corresponding to the first spatial position is determined.
  • At least one second spatial position associated with the first spatial position for the technical solution for determining the second spatial position, please refer to the subsequent embodiments.
  • the target matrix includes a serial number corresponding to each spatial position, a power of a tactile signal corresponding to each spatial position, and a power ranking of the tactile signal corresponding to each spatial position, wherein the power ranking is a ranking of the power of the tactile signal corresponding to each spatial position in the block group from large to small.
  • Figure 8 shows the correspondence between the spatial matrix and the block group shown in Figure 1.
  • the serial number corresponding to the spatial position is the value in the lower right corner of the rectangular box
  • the power of the tactile signal corresponding to the spatial position is the value in the rectangular box
  • the power ranking of the tactile signal corresponding to the spatial position is the value in the upper right corner of the rectangular box. The higher the value, the lower the power of the tactile signal corresponding to the spatial matrix.
  • the determining, based on a preset target mask matrix corresponding to the first spatial position, at least one second spatial position associated with the first spatial position in the spatial matrix corresponding to the block group comprises:
  • a spatial region selection operation is performed on the spatial matrix through a target mask matrix, and at least one spatial position associated with the first spatial position in the spatial matrix is determined as the at least one second spatial position.
  • mapping relationship is used to characterize the mapping between the spatial position and the mask matrix.
  • the first spatial position can be queried through the mapping relationship to determine the target mask matrix corresponding to the first spatial position, and then the spatial region selection operation is performed on the spatial matrix through the target mask matrix to determine at least one second spatial position.
  • the mask matrix shown in FIG. 9 is a 9*9 matrix, which specifically includes four mask matrices (a), (b), (c) and (d), wherein the position corresponding to the number 1 in the mask matrix indicates the spatial position where the tactile signal exists, and the position corresponding to the number 0 indicates the spatial position where the tactile signal does not exist.
  • Different spatial positions can correspond to different mask matrices. For example, for the palm, the mask matrix (a) corresponds to the finger block, and the mask matrix (d) corresponds to the palm block.
  • the first spatial position may be used as the center of the mask matrix, and the spatial region selection operation may be performed by the mask matrix to determine the second spatial position.
  • the target mask matrix is the mask matrix (a) shown in FIG. 9
  • the spatial position adjacent to the first spatial position above and the spatial position adjacent to the first spatial position below are determined as the second spatial position.
  • a spatial region selection operation is performed on the spatial matrix through a target mask matrix to determine a second spatial position that is spatially correlated with the first spatial position, and then a primary tactile signal is determined based on the tactile signal corresponding to the first spatial position, and a secondary tactile signal is determined based on the tactile signal corresponding to the second spatial position, thereby dividing the tactile signal corresponding to each spatial position in the block group.
  • determining a main tactile signal and a secondary tactile signal associated with the main tactile signal according to the tactile signal corresponding to the first spatial position and the tactile signal corresponding to the at least one second spatial position includes:
  • the tactile signal corresponding to each second spatial position in the at least one second spatial position is determined as a secondary tactile signal associated with the primary tactile signal.
  • the tactile signal corresponding to the first spatial position is determined as the primary tactile signal
  • the tactile signal corresponding to each second spatial position is determined as a secondary tactile signal associated with the primary tactile signal
  • the above-mentioned second spatial position is an unmarked spatial position, or a marked target spatial position. That is to say, one possible situation is that if the second spatial position is an unmarked spatial position, a secondary tactile signal is associated with only one main tactile signal. Another possible situation is that if the second spatial position is a marked target spatial position, a secondary tactile signal can be associated with multiple main tactile signals, that is, the second spatial position corresponding to a secondary tactile signal and the first spatial position corresponding to multiple main tactile signals have spatial correlation, and in the subsequent process of dividing the tactile signal corresponding to each spatial position in the block group, the secondary tactile signal and the associated multiple main tactile signals can be divided into one group.
  • the tactile signal corresponding to the first spatial position is determined to be the primary tactile signal, and there is no secondary tactile signal associated with the primary tactile signal.
  • processing according to the mapping relationship includes:
  • the main tactile signal and the secondary tactile signal associated with the main tactile signal are encoded to generate a target code stream.
  • the above-mentioned mapping relationship is used to characterize the mapping between the spatial position of the main tactile signal corresponding to each block group and the spatial position of the associated secondary tactile signal, and then based on the mapping relationship, the main tactile signal corresponding to each block group and the secondary tactile signal associated with the main tactile signal are determined, and the above-mentioned main tactile signal and the secondary tactile signal associated with the main tactile signal are encoded. Since the above-mentioned mapping relationship can reflect the spatial correlation between the spatial position corresponding to the main tactile signal and the spatial position corresponding to the secondary tactile signal in the block group, it can reduce the information redundancy existing in the code stream formed by encoding the tactile signal corresponding to each spatial position, thereby improving the encoding effect.
  • the tactile signal processing method provided in the embodiment of the present application may be executed by a tactile signal processing device.
  • the tactile signal processing device executing the tactile signal processing method is taken as an example to illustrate the tactile signal processing device provided in the embodiment of the present application.
  • the embodiment of the present application further provides a tactile signal processing device 1000, including:
  • An acquisition module 1001 is used to acquire a tactile signal corresponding to each spatial position in a block group of a target object, wherein the target object includes at least one block group, and each block group includes a plurality of spatial positions;
  • the first processing module 1002 is used to perform the following operations for each block group, until each spatial position in the block group is marked as a target spatial position:
  • the first spatial position is determined based on a tactile signal corresponding to an unmarked spatial position in the corresponding block group;
  • the second processing module 1003 is used to generate a mapping relationship between the spatial position of the primary tactile signal and the spatial position of the associated secondary tactile signal, and perform processing according to the mapping relationship.
  • the first processing module 1002 is specifically configured to:
  • At least one second spatial position associated with the first spatial position in the spatial matrix corresponding to the block group is determined; the spatial matrix is used to characterize the positional relationship between each spatial position in the block group.
  • the first processing module 1002 is further specifically configured to:
  • mapping relationship is used to characterize the mapping between the spatial position and the mask matrix
  • a spatial region selection operation is performed on the spatial matrix through a target mask matrix, and at least one spatial position associated with the first spatial position in the spatial matrix is determined as the at least one second spatial position.
  • the first processing module 1002 is further specifically configured to:
  • the second spatial position is an unmarked spatial position, or a marked target spatial position.
  • the second processing module 1002 is specifically configured to:
  • the primary tactile signal and the secondary tactile signal associated with the primary tactile signal are encoded to generate a target bit stream.
  • the main tactile signal and the secondary tactile signal of the embodiment of the present application are determined based on the tactile signal corresponding to the first spatial position in the block group and the tactile signal corresponding to the second spatial position.
  • the second spatial position is determined by performing a spatial area selection operation on the first spatial position, that is, there is a spatial correlation between the first spatial position and the second spatial position.
  • subsequent processing is performed based on the mapping relationship between the spatial position of the main tactile signal and the spatial position of the associated secondary tactile signal.
  • the tactile signal is divided, and the mapping relationship between the main tactile signal and the secondary tactile signal is obtained, so that the subsequent processing can improve the encoding effect based on the mapping relationship.
  • This device embodiment corresponds to the tactile signal processing method embodiment shown in FIG. 4 above.
  • Each implementation process and implementation method in the above method embodiment can be applied to this device embodiment and can achieve the same technical effect.
  • the tactile signal processing device in the embodiment of the present application may be an electronic device, such as an electronic device with an operating system, or a component in an electronic device, such as an integrated circuit or a chip.
  • the electronic device may be a terminal, or may be other devices other than a terminal.
  • the terminal may include but is not limited to the types of terminals listed above, and other devices may be servers, network attached storage (NAS), etc., which are not specifically limited in the embodiment of the present application.
  • an embodiment of the present application also provides a communication device 1100, including a processor 1101 and a memory 1102, and the memory 1102 stores programs or instructions that can be executed on the processor 1101.
  • the communication device 1100 is a terminal
  • the program or instructions are executed by the processor 1101 to implement the various steps of the above-mentioned tactile signal processing method embodiment and can achieve the same technical effect.
  • FIG. 12 is a schematic diagram of the hardware structure of a terminal implementing the embodiment of the present application.
  • the terminal 1200 includes but is not limited to: a radio frequency unit 1201, a network module 1202, an audio output unit 1203, an input unit 1204, a sensor 1205, a display unit 1206, a user input unit 1207, an interface unit 1208, a memory 1209, and a processor 1210 and other components.
  • the terminal 1200 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1210 through a power management system, so as to implement functions such as charging, discharging, and power consumption management through the power management system.
  • a power source such as a battery
  • the terminal structure shown in FIG12 does not constitute a limitation on the terminal, and the terminal may include more or fewer components than shown in the figure, or combine certain components, or arrange components differently, which will not be described in detail here.
  • the input unit 1204 may include a graphics processing unit (GPU) 12041 and a microphone 12042, and the graphics processor 12041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode.
  • the display unit 1206 may include a display panel 12061, and the display panel 12061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc.
  • the user input unit 1207 includes a touch panel 12071 and at least one of other input devices 12072.
  • the touch panel 12071 is also called a touch screen.
  • the touch panel 12071 may include two parts: a touch detection device and a touch controller.
  • Other input devices 12072 may include, but are not limited to, a physical keyboard, function keys (such as a volume control key, a switch key, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.
  • the RF unit 1201 after receiving downlink data from the network side device, the RF unit 1201 can transmit the data to the processor 1210 for processing; the RF unit 1201 can send uplink data to the network side device.
  • the RF unit 1201 includes but is not limited to an antenna, an amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc.
  • the memory 1209 can be used to store software programs or instructions and various data.
  • the memory 1209 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instruction required for at least one function (such as a sound playback function, an image playback function, etc.), etc.
  • the memory 1209 may include a volatile memory or a non-volatile memory, or the memory 1209 may include both volatile and non-volatile memories.
  • the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory.
  • the volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (DRAM), or a non-volatile memory.
  • the memory 1209 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
  • the processor 1210 may include one or more processing units; optionally, the processor 1210 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1210.
  • the processor 1210 is configured to perform the following operations:
  • each block group For each block group, perform the following operations respectively until each spatial position in the block group is marked as a target spatial position:
  • a mapping relationship between the spatial position of the primary haptic signal and the spatial position of the associated secondary haptic signal is generated, and processing is performed according to the mapping relationship.
  • An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored.
  • a program or instruction is stored.
  • the program or instruction is executed by a processor, each process of the above-mentioned tactile signal processing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
  • the processor is the processor in the terminal described in the above embodiment.
  • the readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
  • An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned tactile signal processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
  • the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
  • the embodiment of the present application further provides a computer program/program product, which is stored in a storage medium, and is executed by at least one processor to implement the various processes of the above-mentioned tactile signal processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
  • the technical solution of the present application can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present application.
  • a storage medium such as ROM/RAM, a magnetic disk, or an optical disk
  • a terminal which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请提供了一种触觉信号处理方法、装置及设备，属于触觉编码技术领域。上述方法包括：获取目标对象的区块组中每个空间位置对应的触觉信号；针对每个区块组，分别执行如下操作，直至所述区块组中的每个空间位置均被标记为目标空间位置：从多个空间位置中选取第一空间位置执行空间区域选择操作，确定与第一空间位置相关联的至少一个第二空间位置；根据第一空间位置对应的触觉信号以及至少一个第二空间位置对应的触觉信号，确定主触觉信号和主触觉信号相关联的次触觉信号；将第一空间位置和至少一个第二空间位置标记为目标空间位置；生成主触觉信号的空间位置与相关联的次触觉信号的空间位置之间的映射关系，并根据映射关系进行处理。

Description

触觉信号处理方法、装置及设备
相关申请的交叉引用
本申请主张在2022年11月8日在中国提交的中国专利申请No.202211394516.X的优先权，其全部内容通过引用包含于此。
技术领域
本申请属于触觉编码技术领域，具体涉及一种触觉信号处理方法、装置及设备。
背景技术
触觉信息主要分为两大类：基于肌肉运动知觉的触觉信息，又称为动觉信息；以及基于皮肤纹理知觉的触觉信息，又称为纹理觉信息。在一些技术领域，例如虚拟现实技术领域或自动驾驶技术领域，通过对触觉信息进行触觉编码，生成触觉信号，由硬件设备向用户传递触觉信号，使得用户感受到振动或脉冲，以增加用户的触觉感知。
相关技术中，将人体划分为多个区块，基于每个区块内的各个触觉信号，实现触觉编码。然而，这种方法编码效果较差。
发明内容
本申请实施例提供一种触觉信号处理方法、装置及设备，能够解决现有的编码单点触觉信号的编码效果较差的问题。
第一方面，提供了一种触觉信号处理方法，包括：
获取目标对象的区块组中每个空间位置对应的触觉信号，所述目标对象包括至少一个区块组，每个所述区块组包括多个空间位置；
针对每个区块组，分别执行如下操作，直至所述区块组中的每个空间位置均被标记为目标空间位置：
从所述多个空间位置中选取第一空间位置执行空间区域选择操作，确定与所述第一空间位置相关联的至少一个第二空间位置；所述第一空间位置基于对应区块组中未被标记的空间位置对应的触觉信号确定；
根据所述第一空间位置对应的触觉信号以及所述至少一个第二空间位置对应的触觉信号，确定主触觉信号和所述主触觉信号相关联的次触觉信号；
将所述第一空间位置和所述至少一个第二空间位置标记为目标空间位置；
生成所述主触觉信号的空间位置与相关联的次触觉信号的空间位置之间的映射关系，并根据所述映射关系进行处理。
第二方面，提供了一种触觉信号处理装置，包括：
获取模块，用于获取目标对象的区块组中每个空间位置对应的触觉信号，所述目标对 象包括至少一个区块组，每个所述区块组包括多个空间位置；
第一处理模块，用于针对每个区块组，分别执行如下操作，直至所述区块组中的每个空间位置均被标记为目标空间位置：
从所述多个空间位置中选取第一空间位置执行空间区域选择操作，确定与所述第一空间位置相关联的至少一个第二空间位置；所述第一空间位置基于对应区块组中未被标记的空间位置对应的触觉信号确定；
根据所述第一空间位置对应的触觉信号以及所述至少一个第二空间位置对应的触觉信号，确定主触觉信号和所述主触觉信号相关联的次触觉信号；
将所述第一空间位置和所述至少一个第二空间位置标记为目标空间位置，直至所述区块组中的每个空间位置均被标记为目标空间位置；
第二处理模块，用于生成所述主触觉信号的空间位置与相关联的次触觉信号的空间位置之间的映射关系，并根据所述映射关系进行处理。
第三方面，提供了一种终端，该终端包括处理器和存储器，所述存储器存储可在所述处理器上运行的程序或指令，所述程序或指令被所述处理器执行时实现如第一方面所述的方法的步骤。
第四方面，提供了一种可读存储介质，所述可读存储介质上存储程序或指令，所述程序或指令被处理器执行时实现如第一方面所述的方法的步骤。
第五方面，提供了一种芯片，所述芯片包括处理器和通信接口，所述通信接口和所述处理器耦合，所述处理器用于运行程序或指令，实现如第一方面所述的方法的步骤。
第六方面，提供了一种计算机程序/程序产品，所述计算机程序/程序产品被存储在存储介质中，所述计算机程序/程序产品被至少一个处理器执行以实现如第一方面所述的方法的步骤。
本申请实施例的主触觉信号和次触觉信号是基于区块组中的第一空间位置对应的触觉信号以及第二空间位置对应的触觉信号确定的，第二空间位置是对第一空间位置执行空间区域选择操作确定的，即第一空间位置和第二空间位置存在空间上的相关性。也就是说，在对区块组中每个空间位置对应的触觉信号进行划分后，根据所述主触觉信号的空间位置与相关联的次触觉信号的空间位置之间的映射关系进行后续处理。相较于相关技术中不对触觉信号进行划分的技术方案，对触觉信号进行划分，并得到主触觉信号和次触觉信号之间的映射关系，使得之后的处理能够基于该映射关系提高编码效果。
附图说明
图1是本申请实施例提供的人体区块组的示意图之一；
图2是本申请实施例提供的人体区块组的示意图之二；
图3是本申请实施例提供的人体区块组的示意图之三；
图4是本申请实施例提供的触觉信号处理方法的流程示意图；
图5是本申请实施例提供的空间矩阵示意图之一；
图6是本申请实施例提供的空间矩阵示意图之二；
图7是本申请实施例提供的空间矩阵示意图之三；
图8是本申请实施例提供的空间矩阵示意图之四；
图9是本申请实施例提供的掩码矩阵的示意图；
图10是本申请实施例提供的触觉信号处理装置的结构图；
图11是本申请实施例提供的通信设备的结构图；
图12是本申请实施例提供的终端的硬件结构示意图。
具体实施方式
下面将将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚描述，显然，所描述的实施例是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员所获得的所有其他实施例，都属于本申请保护的范围。
本申请的说明书和权利要求书中的术语“第一”、“第二”等是用于区别类似的对象，而不用于描述特定的顺序或先后次序。应该理解这样使用的术语在适当情况下可以互换，以便本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施，且“第一”、“第二”所区别的对象通常为一类，并不限定对象的个数，例如第一对象可以是一个，也可以是多个。此外，说明书以及权利要求中“和/或”表示所连接对象的至少其中之一，字符“/”一般表示前后关联对象是一种“或”的关系。
在相关技术中，可以将人体的各个部位划分为32个区块，并对每个区块进行标号。例如他，标号1：头部正面；标号2：头部后面；标号3：头部右侧；标号4：头部左侧；标号5：右上胸部；标号6：左上胸部；标号7：腹部；标号8：腰部；标号9：背部上侧；标号10：背部下侧；标号11：右上臂；标号12：左上臂；标号13：右侧小臂；标号14：左侧小臂；标号15：右手腕部；标号16：左手腕部；标号17：右手掌；标号18：左手掌；标号19：右手背；标号20：左手背；标号21：右手指；标号22：左手指；标号23：右大腿；标号24：左大腿；标号25：右小腿；标号26：左小腿；标号27：右脚掌；标号28：左脚掌；标号29：右脚背；标号30：左脚背；标号31：右脚趾；标号32：左脚趾。
可选地，可以使用序号表示每个区块，序号为标号减1所对应的5位二进制数。例如，标号1表示头部正面，头部正面对应的序号为00000；标号12表示左上臂，左上臂对应的序号为01011；标号32表示左脚趾，左脚趾对应的序号为11111。
本申请实施例中，可以将至少一个区块划分为一个区块组，如图1所示，将右手指和右上掌划分为同一区块组；如图2所示，将左小臂划分为一个区块组；如图3所示，将右上胸部、左上胸部、腹部和腰部划分为一个区块组。
应理解，每个区块包括多个空间位置，每个空间位置对应一个触觉信号又称单点触觉信号。如图2所示，左小臂包括10个空间位置。
本申请实施例提供了一种触觉信号处理方法。下面结合附图，通过一些实施例及其应用场景对本申请实施例提供的触觉信号处理方法进行详细地说明。
请参阅图4，图4是本申请实施例中触觉信号处理方法的流程图。本实施例提供的触觉信号处理方法包括以下步骤：
S401，获取目标对象的区块组中每个空间位置对应的触觉信号。
如上所述，区块组由至少一个区块构成，每个区块包括多个空间位置，即区块组包括多个空间位置。
上述目标对象包括至少一个区块组，本步骤中，获取目标对象的区块组中每个空间位置对应的触觉信号，其中，上述触觉信号基于空间位置在区块中的位置、空间位置接收到的振动幅度以及振动持续时间确定。
S402，针对每个区块组，分别执行如下操作，直至所述区块组中的每个空间位置均被标记为目标空间位置：
从多个空间位置中选取第一空间位置执行空间区域选择操作，确定与所述第一空间位置相关联的至少一个第二空间位置。
根据所述第一空间位置对应的触觉信号以及所述至少一个第二空间位置对应的触觉信号，确定主触觉信号和所述主触觉信号相关联的次触觉信号。
将所述第一空间位置和所述至少一个第二空间位置标记为目标空间位置。
本步骤中，对于目标对象中的每个区块组，分别执行以下操作：
从该区块组的多个空间位置中选取未被标记的第一空间位置，对该第一空间位置执行空间区域选择操作，确定该第一空间位置相关联的至少一个第二空间位置。基于上述第一空间位置对应的触觉信号和第二空间位置对应的触觉信号确定主触觉信号和次触觉信号，具体的如何确定主触觉信号和次触觉信号的技术方案，请参阅后续实施例。最后，将上述第一空间位置和第二空间位置标记为目标空间位置。
具体而言，在一次空间区域选择操作的执行过程中，基于区块组中未被标记的空间位置对应的触觉信号，确定第一空间位置，即第一空间位置未被标记为目标空间位置。对该第一空间位置执行空间区域选择操作，确定与第一空间位置相关联的至少一个第二空间位置，即第一空间位置和第二空间位置存在空间上的相关性，具体的技术方案请参阅后续实施例。
S403，生成所述主触觉信号的空间位置与相关联的次触觉信号的空间位置之间的映射关系，并根据所述映射关系进行处理。
应理解，通过上述步骤可以得到多个主触觉信号以及每个主触觉信号相关联的次触觉信号，进而生成主触觉信号的空间位置与相关联的次触觉信号的空间位置之间的映射关系。可选地，可以基于上述主触觉信号的空间位置和次触觉信号的空间位置生成该区块组对应的触觉信号划分表，该触觉信息划分表用于表征区块组中每个空间位置对应的触觉信号的划分结果。
一种可选地实施方式为：将主触觉信号对应的空间位置的序号，以及次触觉信号对应的空间位置的序号存储至触觉信号划分表。关于确定空间位置的序号的技术方案，请参阅后续内容。
另一种可选地实施方式为：将主触觉信号对应的功率，以及次触觉信号对应功率存储至触觉信号划分表。
具体的如何根据映射关系进行处理的技术方案，请参阅后续实施例。
本申请实施例的主触觉信号和次触觉信号是基于区块组中的第一空间位置对应的触觉信号以及第二空间位置对应的触觉信号确定的，第二空间位置是对第一空间位置执行空间区域选择操作确定的，即第一空间位置和第二空间位置存在空间上的相关性。也就是说，在对区块组中每个空间位置对应的触觉信号进行划分后，根据所述主触觉信号的空间位置与相关联的次触觉信号的空间位置之间的映射关系进行后续处理。相较于相关技术中不对触觉信号进行划分的技术方案，对触觉信号进行划分，并得到主触觉信号和次触觉信号之间的映射关系，使得之后的处理能够基于该映射关系提高编码效果。
可选地，所述从所述多个空间位置中选取第一空间位置执行空间区域选择操作，确定与所述第一空间位置相关联的至少一个第二空间位置包括：
将功率最高的触觉信号对应的未被标记的空间位置确定为第一空间位置；
基于所述第一空间位置对应的预设的目标掩码矩阵，确定所述区块组对应的空间矩阵中与所述第一空间位置相关联的至少一个第二空间位置。
需要说明的是，划分区块组之后，可以基于每个区块组对应的空间位置的分布情况，生成每个区块组对应的空间矩阵，其中，空间矩阵用于表征区块组中每个空间位置之间的位置关系。
例如，图1示出的区块组包括右手指和右上掌，可以将右手指区块包括的空间位置对应的触觉信号理解为一维信号，将右上掌包括的空间位置对应的触觉信号理解为二维信号。基于图1示出的区块组中各个空间位置的分布情况，生成如图5所示的空间矩阵，其中，空间矩阵包括每个空间位置对应的序号，上述空间位置对应的序号可以自定义设置，应理解，空间矩阵中标号0对应的空间位置不存在触觉信号。
例如，图2示出的区块组包括左小臂，可以将左小臂区块包括的空间位置对应的触觉信号理解为三维信号。基于图2示出的区块组中各个空间位置的分布情况，将三维信号展平为二维信号，生成如图6所示的空间矩阵，其中，空间矩阵包括每个空间位置对应的序号。
例如，图3示出的区块组右上胸部、左上胸部、腹部和腰部，基于图3示出的区块组中各个空间位置的分布情况，生成如图7所示的空间矩阵，其中，空间矩阵包括每个空间位置对应的序号。
本实施例中，遍历区块组中的未被标记的空间位置，将功率最高的触觉信号对应的空间位置确定为第一空间位置，进而通过该第一空间位置对应的预设的目标掩码矩阵，确定 该第一空间位置相关联的至少一个第二空间位置，关于确定第二空间位置的技术方案，请参阅后续实施例。在其他实施例中，目标矩阵包括每个空间位置对应的序号、每个空间位置对应的触觉信号的功率、以及每个空间位置对应的触觉信号的功率排序，上述功率排序为区块组中每个空间位置对应的触觉信号的功率从大到小的排序。
具体而言，请参阅图8，图8示出空间矩阵与图1示出的区块组对应。其中，空间位置对应的序号为矩形框右下角的数值，空间位置对应的触觉信号的功率为矩形框中的数值，空间位置对应的触觉信号的功率排序为矩形框右上角的数值，该数值越高，表示该空间矩阵对应的触觉信号的功率越低。
可选地，所述基于所述第一空间位置对应的预设的目标掩码矩阵，确定所述区块组对应的空间矩阵中与所述第一空间位置相关联的至少一个第二空间位置包括：
根据预设的映射关系，确定所述第一空间位置对应的目标掩码矩阵；
通过目标掩码矩阵对所述空间矩阵执行空间区域选择操作，将所述空间矩阵中与所述第一空间位置相关联的至少一个空间位置确定为所述至少一个第二空间位置。
上述映射关系用于表征空间位置和掩码矩阵之间的映射。本实施例中，可以通过映射关系对第一空间位置进行查询，确定第一空间位置对应的目标掩码矩阵，进而通过目标掩码矩阵对空间矩阵执行空间区域选择操作，确定至少一个第二空间位置。
具体而言，请参阅图9，图9示出的掩码矩阵为9*9的矩阵，具体包括(a)、(b)、(c)和(d)这4种掩码矩阵，其中，掩码矩阵中的数字1对应的位置表示存在触觉信号的空间位置，数字0对应的位置表示不存在触觉信号的空间位置。不同的空间位置可以对应不同的掩码矩阵。例如对于手掌而言，掩码矩阵(a)对应手指区块，掩码矩阵(d)对应手掌区块。
可选地，可以将第一空间位置作为掩码矩阵的中心，通过掩码矩阵执行空间区域选择操作，确定第二空间位置。例如，在目标掩码矩阵为图9示出的掩码矩阵(a)的情况下，将第一空间位置上方相邻的空间位置以及下方相邻的空间位置，确定为第二空间位置。
本实施例中，通过目标掩码矩阵对空间矩阵执行空间区域选择操作，确定与第一空间位置存在空间上的相关性的第二空间位置，进而基于第一空间位置对应的触觉信号确定主触觉信号，基于第二空间位置对应的触觉信号确定次触觉信号，以此对区块组中每个空间位置对应的触觉信号进行划分。
可选地，所述根据所述第一空间位置对应的触觉信号以及所述至少一个第二空间位置对应的触觉信号，确定主触觉信号和所述主触觉信号相关联的次触觉信号包括：
将所述第一空间位置对应的触觉信号，确定为所述主触觉信号；
将所述至少一个第二空间位置中每个第二空间位置对应的触觉信号，确定为所述主触觉信号相关联的次触觉信号。
本实施例中，将第一空间位置对应的触觉信号，确定为主触觉信号。将每个第二空间位置对应的触觉信号，确定为主触觉信号相关联的次触觉信号。
上述第二空间位置为未被标记的空间位置，或者为标记的目标空间位置。也就是说，一种可能存在的情况为，若第二空间位置为未被标记的空间位置，则一个次触觉信号只与一个主触觉信号相关联。另一种可能存在的情况为，若第二空间位置为标记的目标空间位置，一个次触觉信号可以与多个主触觉信号相关联，即一个次触觉信号对应的第二空间位置与多个主触觉信号对应的第一空间位置存在空间上的相关性，后续划分区块组中每个空间位置对应的触觉信号的过程中，可以将该次触觉信号与相关联的多个主触觉信号划分至一组。
需要说明的是，在第二空间位置为未被标记的空间位置的情况下，若除第一空间位置之外，其他空间位置均为被标记的空间位置，这种情况下，确定该第一空间位置对应的触觉信号为主触觉信号，不存在与该主触觉信号相关联的次触觉信号。
可选地，所述根据所述映射关系进行处理包括：
根据所述映射关系，确定每个区块组对应的主触觉信号以及所述主触觉信号相关联的次触觉信号；
对所述主触觉信号以及所述主触觉信号相关联的次触觉信号进行编码，生成目标码流。
本实施例中，上述映射关系用于表征每个区块组对应的主触觉信号的空间位置与相关联的次触觉信号的空间位置之间的映射，进而基于映射关系，确定每个区块组对应的主触觉信号以及主触觉信号相关联的次触觉信号，对上述主触觉信号以及主触觉信号相关联的次触觉信号进行编码，由于上述映射关系可以体现区块组中主触觉信号对应的空间位置和次触觉信号对应的空间位置在空间上的相关性，因此可以减少编码每个空间位置对应的触觉信号形成的码流中存在的信息冗余，进而提高编码效果。
本申请实施例提供的触觉信号处理方法，执行主体可以为触觉信号处理装置。本申请实施例中以触觉信号处理装置执行触觉信号处理方法为例，说明本申请实施例提供的触觉信号处理装置。
如图10所示，本申请实施例还提供了一种触觉信号处理装置1000，包括：
获取模块1001，用于获取目标对象的区块组中每个空间位置对应的触觉信号，所述目标对象包括至少一个区块组，每个所述区块组包括多个空间位置；
第一处理模块1002，用于针对每个区块组，分别执行如下操作，直至所述区块组中的每个空间位置均被标记为目标空间位置：
从所述多个空间位置中选取第一空间位置执行空间区域选择操作，确定与所述第一空间位置相关联的至少一个第二空间位置；所述第一空间位置基于对应区块组中未被标记的空间位置对应的触觉信号确定；
根据所述第一空间位置对应的触觉信号以及所述至少一个第二空间位置对应的触觉信号，确定主触觉信号和所述主触觉信号相关联的次触觉信号；
将所述第一空间位置和所述至少一个第二空间位置标记为目标空间位置，直至所述区块组中的每个空间位置均被标记为目标空间位置；
第二处理模块1003，用于生成所述主触觉信号的空间位置与相关联的次触觉信号的空间位置之间的映射关系，并根据所述映射关系进行处理。
可选地，所述第一处理模块1002，具体用于：
将功率最高的触觉信号对应的未被标记的空间位置确定为第一空间位置；
基于所述第一空间位置对应的预设的目标掩码矩阵，确定所述区块组对应的空间矩阵中与所述第一空间位置相关联的至少一个第二空间位置；所述空间矩阵用于表征所述区块组中每个空间位置之间的位置关系。
可选地，所述第一处理模块1002，还具体用于：
根据预设的映射关系，确定所述第一空间位置对应的目标掩码矩阵；所述映射关系用于表征空间位置和掩码矩阵之间的映射；
通过目标掩码矩阵对所述空间矩阵执行空间区域选择操作，将所述空间矩阵中与所述第一空间位置相关联的至少一个空间位置确定为所述至少一个第二空间位置。
可选地，所述第一处理模块1002，还具体用于：
将所述第一空间位置对应的触觉信号，确定为所述主触觉信号；
将所述至少一个第二空间位置中每个第二空间位置对应的触觉信号，确定为所述主触觉信号相关联的次触觉信号；
其中，所述第二空间位置为未被标记的空间位置，或者为标记的目标空间位置。
可选地，所述第二处理模块1002，具体用于：
根据所述映射关系，确定每个区块组对应的主触觉信号以及所述主触觉信号相关联的次触觉信号；
对所述主触觉信号以及所述主触觉信号相关联的次触觉信号进行编码，生成目标码流。
本申请实施例的主触觉信号和次触觉信号是基于区块组中的第一空间位置对应的触觉信号以及第二空间位置对应的触觉信号确定的，第二空间位置是对第一空间位置执行空间区域选择操作确定的，即第一空间位置和第二空间位置存在空间上的相关性。也就是说，在对区块组中每个空间位置对应的触觉信号进行划分后，根据所述主触觉信号的空间位置与相关联的次触觉信号的空间位置之间的映射关系进行后续处理。相较于相关技术中不对触觉信号进行划分的技术方案，对触觉信号进行划分，并得到主触觉信号和次触觉信号之间的映射关系，使得之后的处理能够基于该映射关系提高编码效果。
该装置实施例与上述图4所示的触觉信号处理方法实施例对应，上述方法实施例中的各个实施过程和实现方式均可适用于该装置实施例中，且能达到相同的技术效果。
本申请实施例中的触觉信号处理装置可以是电子设备，例如具有操作系统的电子设备，也可以是电子设备中的部件、例如集成电路或芯片。该电子设备可以是终端，也可以为除终端之外的其他设备。示例性的，终端可以包括但不限于上述所列举的终端的类型，其他设备可以为服务器、网络附属存储器(Network Attached Storage，NAS)等，本申请实施例不作具体限定。
可选地，如图11所示，本申请实施例还提供一种通信设备1100，包括处理器1101和存储器1102，存储器1102上存储有可在所述处理器1101上运行的程序或指令，例如，该通信设备1100为终端时，该程序或指令被处理器1101执行时实现上述触觉信号处理方法实施例的各个步骤，且能达到相同的技术效果。
本申请实施例还提供一种终端，该终端实施例与上述终端侧方法实施例对应，上述方法实施例的各个实施过程和实现方式均可适用于该终端实施例中，且能达到相同的技术效果。具体地，图12为实现本申请实施例的一种终端的硬件结构示意图。
该终端1200包括但不限于：射频单元1201、网络模块1202、音频输出单元1203、输入单元1204、传感器1205、显示单元1206、用户输入单元1207、接口单元1208、存储器1209、以及处理器1210等部件。
本领域技术人员可以理解，终端1200还可以包括给各个部件供电的电源(比如电池)，电源可以通过电源管理系统与处理器1210逻辑相连，从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。图12中示出的终端结构并不构成对终端的限定，终端可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置，在此不再赘述。
应理解的是，本申请实施例中，输入单元1204可以包括图形处理器(Graphics Processing Unit，GPU)12041和麦克风12042，图形处理器12041对在视频捕获模式或图像捕获模式中由图像捕获装置(如摄像头)获得的静态图片或视频的图像数据进行处理。显示单元1206可包括显示面板12061，可以采用液晶显示器、有机发光二极管等形式来配置显示面板12061。用户输入单元1207包括触控面板12071以及其他输入设备12072中的至少一种。触控面板12071，也称为触摸屏。触控面板12071可包括触摸检测装置和触摸控制器两个部分。其他输入设备12072可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆，在此不再赘述。
本申请实施例中，射频单元1201接收来自网络侧设备的下行数据后，可以传输给处理器1210进行处理；射频单元1201可以向网络侧设备发送上行数据。通常，射频单元1201包括但不限于天线、放大器、收发信机、耦合器、低噪声放大器、双工器等。
存储器1209可用于存储软件程序或指令以及各种数据。存储器1209可主要包括存储程序或指令的第一存储区和存储数据的第二存储区，其中，第一存储区可存储操作系统、至少一个功能所需的应用程序或指令(比如声音播放功能、图像播放功能等)等。此外，存储器1209可以包括易失性存储器或非易失性存储器，或者，存储器1209可以包括易失性和非易失性存储器两者。其中，非易失性存储器可以是只读存储器(Read-Only Memory，ROM)、可编程只读存储器(Programmable ROM，PROM)、可擦除可编程只读存储器(Erasable PROM，EPROM)、电可擦除可编程只读存储器(Electrically EPROM，EEPROM)或闪存。易失性存储器可以是随机存取存储器(Random Access Memory，RAM)，静态随机存取存储器(Static RAM，SRAM)、动态随机存取存储器(Dynamic RAM，DRAM)、同步动 态随机存取存储器(Synchronous DRAM，SDRAM)、双倍数据速率同步动态随机存取存储器(Double Data Rate SDRAM，DDRSDRAM)、增强型同步动态随机存取存储器(Enhanced SDRAM，ESDRAM)、同步连接动态随机存取存储器(Synch link DRAM，SLDRAM)和直接内存总线随机存取存储器(Direct Rambus RAM，DRRAM)。本申请实施例中的存储器1209包括但不限于这些和任意其它适合类型的存储器。
处理器1210可包括一个或多个处理单元；可选的，处理器1210集成应用处理器和调制解调处理器，其中，应用处理器主要处理涉及操作系统、用户界面和应用程序等的操作，调制解调处理器主要处理无线通信信号，如基带处理器。可以理解的是，上述调制解调处理器也可以不集成到处理器1210中。
其中，处理器1210用于执行以下操作：
获取目标对象的区块组中每个空间位置对应的触觉信号；
针对每个区块组，分别执行如下操作，直至所述区块组中的每个空间位置均被标记为目标空间位置：
从所述多个空间位置中选取第一空间位置执行空间区域选择操作，确定与所述第一空间位置相关联的至少一个第二空间位置；
根据所述第一空间位置对应的触觉信号以及所述至少一个第二空间位置对应的触觉信号，确定主触觉信号和所述主触觉信号相关联的次触觉信号；
将所述第一空间位置和所述至少一个第二空间位置标记为目标空间位置；
生成所述主触觉信号的空间位置与相关联的次触觉信号的空间位置之间的映射关系，并根据所述映射关系进行处理。
本申请实施例还提供一种可读存储介质，所述可读存储介质上存储有程序或指令，该程序或指令被处理器执行时实现上述触觉信号处理方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
其中，所述处理器为上述实施例中所述的终端中的处理器。所述可读存储介质，包括计算机可读存储介质，如计算机只读存储器ROM、随机存取存储器RAM、磁碟或者光盘等。
本申请实施例另提供了一种芯片，所述芯片包括处理器和通信接口，所述通信接口和所述处理器耦合，所述处理器用于运行程序或指令，实现上述触觉信号处理方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
应理解，本申请实施例提到的芯片还可以称为系统级芯片，系统芯片，芯片系统或片上系统芯片等。
本申请实施例另提供了一种计算机程序/程序产品，所述计算机程序/程序产品被存储在存储介质中，所述计算机程序/程序产品被至少一个处理器执行以实现上述触觉信号处理方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排 他性的包含，从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。此外，需要指出的是，本申请实施方式中的方法和装置的范围不限按示出或讨论的顺序来执行功能，还可包括根据所涉及的功能按基本同时的方式或按相反的顺序来执行功能，例如，可以按不同于所描述的次序来执行所描述的方法，并且还可以添加、省去、或组合各种步骤。另外，参照某些示例所描述的特征可在其他示例中被组合。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以计算机软件产品的形式体现出来，该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端(可以是手机，计算机，服务器，空调器，或者网络设备等)执行本申请各个实施例所述的方法。
上面结合附图对本申请的实施例进行了描述，但是本申请并不局限于上述的具体实施方式，上述的具体实施方式仅仅是示意性的，而不是限制性的，本领域的普通技术人员在本申请的启示下，在不脱离本申请宗旨和权利要求所保护的范围情况下，还可做出很多形式，均属于本申请的保护之内。

Claims (13)

  1. 一种触觉信号处理方法，包括：
    获取目标对象的区块组中每个空间位置对应的触觉信号，所述目标对象包括至少一个区块组，每个所述区块组包括多个空间位置；
    针对每个区块组，分别执行如下操作，直至所述区块组中的每个空间位置均被标记为目标空间位置：
    从所述多个空间位置中选取第一空间位置执行空间区域选择操作，确定与所述第一空间位置相关联的至少一个第二空间位置；所述第一空间位置基于对应区块组中未被标记的空间位置对应的触觉信号确定；
    根据所述第一空间位置对应的触觉信号以及所述至少一个第二空间位置对应的触觉信号，确定主触觉信号和所述主触觉信号相关联的次触觉信号；
    将所述第一空间位置和所述至少一个第二空间位置标记为目标空间位置；
    生成所述主触觉信号的空间位置与相关联的次触觉信号的空间位置之间的映射关系，并根据所述映射关系进行处理。
  2. 根据权利要求1所述的方法，其中，所述从所述多个空间位置中选取第一空间位置执行空间区域选择操作，确定与所述第一空间位置相关联的至少一个第二空间位置包括：
    将功率最高的触觉信号对应的未被标记的空间位置确定为第一空间位置；
    基于所述第一空间位置对应的预设的目标掩码矩阵，确定所述区块组对应的空间矩阵中与所述第一空间位置相关联的至少一个第二空间位置；所述空间矩阵用于表征所述区块组中每个空间位置之间的位置关系。
  3. 根据权利要求2所述的方法，其中，所述基于所述第一空间位置对应的预设的目标掩码矩阵，确定所述区块组对应的空间矩阵中与所述第一空间位置相关联的至少一个第二空间位置包括：
    根据预设的映射关系，确定所述第一空间位置对应的目标掩码矩阵；所述映射关系用于表征空间位置和掩码矩阵之间的映射；
    通过目标掩码矩阵对所述空间矩阵执行空间区域选择操作，将所述空间矩阵中与所述第一空间位置相关联的至少一个空间位置确定为所述至少一个第二空间位置。
  4. 根据权利要求1所述的方法，其中，所述根据所述第一空间位置对应的触觉信号以及所述至少一个第二空间位置对应的触觉信号，确定主触觉信号和所述主触觉信号相关联的次触觉信号包括：
    将所述第一空间位置对应的触觉信号，确定为所述主触觉信号；
    将所述至少一个第二空间位置中每个第二空间位置对应的触觉信号，确定为所述主触觉信号相关联的次触觉信号；
    其中，所述第二空间位置为未被标记的空间位置，或者为标记的目标空间位置。
  5. 根据权利要求1所述的方法，其中，所述根据所述映射关系进行处理包括：
    根据所述映射关系，确定每个区块组对应的主触觉信号以及所述主触觉信号相关联的次触觉信号；
    对所述主触觉信号以及所述主触觉信号相关联的次触觉信号进行编码，生成目标码流。
  6. 一种触觉信号处理装置，包括：
    获取模块，用于获取目标对象的区块组中每个空间位置对应的触觉信号，所述目标对象包括至少一个区块组，每个所述区块组包括多个空间位置；
    第一处理模块，用于针对每个区块组，分别执行如下操作，直至所述区块组中的每个空间位置均被标记为目标空间位置：
    从所述多个空间位置中选取第一空间位置执行空间区域选择操作，确定与所述第一空间位置相关联的至少一个第二空间位置；所述第一空间位置基于对应区块组中未被标记的空间位置对应的触觉信号确定；
    根据所述第一空间位置对应的触觉信号以及所述至少一个第二空间位置对应的触觉信号，确定主触觉信号和所述主触觉信号相关联的次触觉信号；
    将所述第一空间位置和所述至少一个第二空间位置标记为目标空间位置，直至所述区块组中的每个空间位置均被标记为目标空间位置；
    第二处理模块，用于生成所述主触觉信号的空间位置与相关联的次触觉信号的空间位置之间的映射关系，并根据所述映射关系进行处理。
  7. 根据权利要求6所述的装置，其中，所述第一处理模块，具体用于：
    将功率最高的触觉信号对应的未被标记的空间位置确定为第一空间位置；
    基于所述第一空间位置对应的预设的目标掩码矩阵，确定所述区块组对应的空间矩阵中与所述第一空间位置相关联的至少一个第二空间位置；所述空间矩阵用于表征所述区块组中每个空间位置之间的位置关系。
  8. 根据权利要求7所述的装置，其中，所述第一处理模块，还具体用于：
    根据预设的映射关系，确定所述第一空间位置对应的目标掩码矩阵；所述映射关系用于表征空间位置和掩码矩阵之间的映射；
    通过目标掩码矩阵对所述空间矩阵执行空间区域选择操作，将所述空间矩阵中与所述第一空间位置相关联的至少一个空间位置确定为所述至少一个第二空间位置。
  9. 根据权利要求6所述的装置，其中，所述第一处理模块，还具体用于：
    将所述第一空间位置对应的触觉信号，确定为所述主触觉信号；
    将所述至少一个第二空间位置中每个第二空间位置对应的触觉信号，确定为所述主触觉信号相关联的次触觉信号；
    其中，所述第二空间位置为未被标记的空间位置，或者为标记的目标空间位置。
  10. 根据权利要求6所述的装置，其中，所述第二处理模块，具体用于：
    根据所述映射关系，确定每个区块组对应的主触觉信号以及所述主触觉信号相关联的 次触觉信号；
    对所述主触觉信号以及所述主触觉信号相关联的次触觉信号进行编码，生成目标码流。
  11. 一种终端，包括处理器和存储器，所述存储器存储可在所述处理器上运行的程序或指令，所述程序或指令被所述处理器执行时实现如权利要求1-5中任一项所述的触觉信号处理方法的步骤。
  12. 一种可读存储介质，所述可读存储介质上存储程序或指令，所述程序或指令被处理器执行时实现如权利要求1-5中任一项所述的触觉信号处理方法的步骤。
  13. 一种芯片，所述芯片包括处理器和通信接口，所述通信接口和所述处理器耦合，所述处理器用于运行程序或指令，实现如权利要求1-5中任一项所述的触觉信号处理方法的步骤。
PCT/CN2023/126995 2022-11-08 2023-10-27 触觉信号处理方法、装置及设备 Ceased WO2024099100A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202211394516.XA CN118034485B (zh) 2022-11-08 2022-11-08 触觉信号处理方法、装置及设备
CN202211394516.X 2022-11-08

Publications (1)

Publication Number Publication Date
WO2024099100A1 true WO2024099100A1 (zh) 2024-05-16

Family

ID=91001008

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/126995 Ceased WO2024099100A1 (zh) 2022-11-08 2023-10-27 触觉信号处理方法、装置及设备

Country Status (2)

Country Link
CN (1) CN118034485B (zh)
WO (1) WO2024099100A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN121277381A (zh) * 2024-07-03 2026-01-06 维沃移动通信有限公司 触觉信号的处理方法、装置及相关设备
CN121455317A (zh) * 2024-08-01 2026-02-03 维沃移动通信有限公司 空间触觉信号处理方法、装置及设备

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190171289A1 (en) * 2017-12-01 2019-06-06 Yahoo Holdings, Inc. Tactile feedback array control
US20200333885A1 (en) * 2016-08-19 2020-10-22 Sony Corporation Haptic-feedback presenting apparatus, haptic-feedback presenting system, and haptic-feedback presenting method
CN114995638A (zh) * 2022-05-12 2022-09-02 北京有竹居网络技术有限公司 触觉信号生成方法、装置、可读介质及电子设备

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3099030A1 (en) * 2015-05-26 2016-11-30 Thomson Licensing Method and device for encoding/decoding a packet comprising data representative of a haptic effect
EP3112987A1 (en) * 2015-06-29 2017-01-04 Thomson Licensing Method and schemes for perceptually driven encoding of haptic effects
US10388186B2 (en) * 2017-04-17 2019-08-20 Facebook, Inc. Cutaneous actuators with dampening layers and end effectors to increase perceptibility of haptic signals

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200333885A1 (en) * 2016-08-19 2020-10-22 Sony Corporation Haptic-feedback presenting apparatus, haptic-feedback presenting system, and haptic-feedback presenting method
US20190171289A1 (en) * 2017-12-01 2019-06-06 Yahoo Holdings, Inc. Tactile feedback array control
CN114995638A (zh) * 2022-05-12 2022-09-02 北京有竹居网络技术有限公司 触觉信号生成方法、装置、可读介质及电子设备

Also Published As

Publication number Publication date
CN118034485B (zh) 2025-09-09
CN118034485A (zh) 2024-05-14

Similar Documents

Publication Publication Date Title
WO2024099100A1 (zh) 触觉信号处理方法、装置及设备
EP3888769B1 (en) Control method for game object, apparatus, device, and storage medium
CN107741820B (zh) 一种输入法键盘显示方法及移动终端
CN109145809B (zh) 一种记谱处理方法和装置以及计算机可读存储介质
CN113110815B (zh) 一种通过碰一碰实现传屏功能的方法、系统、电子设备及存储介质
CN109117062A (zh) 映射方法和装置以及移动设备和游戏装置
CN104699408A (zh) 触摸屏的操作方法、装置及触摸设备
CN114116086A (zh) 一种页面编辑方法、装置、设备及存储介质
CN112988913B (zh) 一种数据处理方法和相关装置
CN114860088A (zh) 输入方法、装置、设备和存储介质
CN117955732B (zh) 数据处理方法和相关装置
US20220111290A1 (en) Haptic engine for spatial computing
CN107463246A (zh) 一种信息处理方法及电子设备
CN116149488B (zh) 输入法启动方法、装置和电子设备
CN113961064B (zh) 基于工作站的设备交互控制方法、装置、设备及存储介质
CN109903395B (zh) 模型的处理方法、装置、存储介质及电子设备
CN103902215A (zh) 一种信息处理的方法及电子设备
EP4227782A1 (en) Interaction method and terminal device
CN115944908A (zh) 一种振动控制装置、系统以及掌机
EP4668072A1 (en) Haptic signal encoding method and apparatus, haptic signal decoding method and apparatus, and device
CN115145396B (zh) 手势控制方法、装置、计算机设备和存储介质
CN112418080A (zh) 一种激光扫描成像仪的手指动作识别方法
CN112188450A (zh) 一种基于输入外设进行输入的方法及相关装置
KR102929522B1 (ko) 태권도 검색 엔진을 이용한 태권도 교육 및 평가 방법 및 장치
CN118113185B (zh) 元宇宙交互方法、装置、设备、存储介质及程序产品

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23887790

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 23887790

Country of ref document: EP

Kind code of ref document: A1