KR101772320B1 - A flexible display device and a method for operating it - Google Patents

Abstract

A sensed information (tactile, touch, movement, and etc.) transfer device according to an embodiment of the present invention includes: a sensed information implementing unit for reproducing a sensed information transmitted to a receiver according to a time series driving signal; a communication unit for receiving driving information generated according to the movement of a transmitter at a remote place and environment information corresponding to the driving information; a control unit for generating a driving signal of the sensed information implementing unit for transmitting the sensed information according to the movement of the transmitter to a receiver from the driving information; and a correction processing unit for adjusting the driving signal so that the receiver can receive the sensed information within a predetermined suitable range based on the environment information. The present invention enables users to more comfortably interact with each other with a sense intended by the users by feedback and adjustment of the driving signal.

Description

TECHNICAL FIELD [0001] The present invention relates to a sensory transmitting device and a sensory transmitting method for providing sensory feedback,

The present invention relates to a sensory transmitting device and a sensory transmitting method, and more particularly, to a sensory transmitting device and a sensory transmitting method for providing sensory feedback according to an interaction between a recipient and a sender at a remote place.

And robots capable of mediating interaction between users located at remote sites have been developed, and a method of remotely providing motion information has been studied.

In particular, it is being developed to the extent that remote control is possible in the fields of telemedicine and robot surgery.

However, such a current motion transfer technology is merely a transfer of the physical external force applied to the robot, etc., but it is distant from transferring the similar senses between the actual users.

Particularly, since it is only transmitted in a state in which feedback on touch, touch, and sensation is excluded, there is a limitation in realizing interaction between users located at a remote location.

In addition, when a user at a remote site exchanges senses, there is a problem in that it is difficult to transmit the accurate sensation as intended by the user due to various variables such as the location and environment where each user is located. And an unpleasant sensation can be transmitted and received.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and it is an object of the present invention to provide a method and apparatus for generating a driving signal of a sensory implementation unit, The present invention provides a sensory transmitting device and a sensory transmitting method that provide sensory feedback that is more pleasant and can interact with each other in an intended sense among users.

According to an embodiment of the present invention, there is provided an apparatus for sensing a sensation, the apparatus comprising: a sensory processor for reproducing a sensation transmitted to a receiver according to a time-series driving signal; A communication unit for receiving driving information generated according to movement of a sender of a remote place and environment information corresponding to the driving information; From the driving information, a driving signal of the sensory unit for transmitting a sensation according to movement of the sender to the recipient; And a correction processing section that adjusts the drive signal so that the receiver can receive a sensation within a predetermined fit range based on the environment information.

According to another aspect of the present invention, there is provided a method for transmitting sensory information, the method including receiving driving information generated according to movement of a sender at a remote place, and environment information corresponding to the driving information, ; Generating a drive signal of the sensory implementer for conveying a sensation according to movement of the sender to the recipient from the drive information; Adjusting the drive signal based on the environmental information so that the receiver can receive a sensation within a predefined adaptation range; And, in accordance with the adjusted drive signal, reproducing the sensation transmitted to the receiver in a time series manner.

According to another aspect of the present invention, there is provided an apparatus for transmitting sensory information, comprising: a driving information collecting unit collecting driving information generated according to a movement of a sender; An environment information collecting unit for collecting environment information for adjusting the driving signal from the sender so that the sensory transmitting device on the receiver side can receive a sensation within a predetermined fitting range; A control unit for generating sensing information based on the driving information and the environment information; And a communication unit for transmitting the sensing information to the sensory transmitting device on the receiver side located at a remote place.

In order to solve the above problems, a method according to an embodiment of the present invention may be implemented by a computer-readable recording medium on which a program for execution by a computer is recorded or a program thereof.

According to the embodiment of the present invention, in generating the drive signal of the sensory implementation unit, the drive signal is fed back and adjusted in accordance with the environment information of the sender so that the recipient can receive the sense within a pre-set fit range, , And a sensory transmitting device and a sensory transmitting method that provide sensory feedback capable of mutually interacting with each other with an intended sensation among the users.

Further, the sensory transmitting apparatus can be applied to various technical fields such as a wearable device, and thus is highly applicable.

1 illustrates an overall system according to an embodiment of the present invention.
FIG. 2 is a block diagram showing a sender's side sensory transmitting apparatus according to an embodiment of the present invention in more detail.
FIG. 3 is a block diagram showing a receiver-side sensory transmitting device according to an embodiment of the present invention in more detail.
4 is a block diagram showing the correction processing unit according to the embodiment of the present invention in more detail.
FIG. 5 illustrates a physical depth variation method of sensory information according to an embodiment of the present invention.
6 and 7 are flowcharts for explaining a sensory transmitting method according to an embodiment of the present invention.
8 shows an application system according to an embodiment of the present invention.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail.

It is to be understood that the present invention is not intended to be limited to the specific embodiments but includes all changes, equivalents, and alternatives falling within the spirit and scope of the present invention. In describing the present invention, the terms first, second, etc. may be used to describe various components, but the components may not be limited by the terms. The terms may only be used for the purpose of distinguishing one element from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

When an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, but other elements may be present in between Can be understood. On the other hand, when it is mentioned that an element is "directly connected" or "directly connected" to another element, it can be understood that no other element exists in between.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The singular expressions may include plural expressions unless the context clearly dictates otherwise. As used herein, the terms "comprise", "having", and the like are used interchangeably to designate the presence of stated features, integers, steps, operations, elements, components, or combinations thereof, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, parts, or combinations thereof. Unless otherwise defined, all terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

Terms such as those defined in commonly used dictionaries can be interpreted as having a meaning consistent with the meaning in the context of the relevant art and are, unless expressly defined in the present application, interpreted in an ideal or overly formal sense . In addition, the following embodiments are provided to explain more fully to the average person skilled in the art. The shapes and sizes of the elements in the drawings and the like can be exaggerated for clarity.

Also, for example, it should be understood that the block diagrams herein illustrate conceptual aspects of exemplary circuits embodying the principles of the invention. The functions of the various elements shown in the figures, including the functional blocks depicted in the processor or similar concept, may be provided by use of dedicated hardware as well as hardware capable of executing software in connection with appropriate software. When provided by a processor, the functions may be provided by a single dedicated processor, a single shared processor, or a plurality of individual processors, some of which may be shared. Also, the explicit use of terms such as processor, control, or similar concepts should not be interpreted exclusively as hardware capable of running software, and may be used without limitation as a digital signal processor (DSP) (ROM), random access memory (RAM), and non-volatile memory. Other hardware may also be included.

In the claims hereof, the elements represented as means for performing the functions described in the detailed description include all types of software including, for example, a combination of circuit elements performing the function or firmware / microcode etc. , And is coupled with appropriate circuitry to execute the software to perform the function. It is to be understood that the invention defined by the appended claims is not to be construed as encompassing any means capable of providing such functionality, as the functions provided by the various listed means are combined and combined with the manner in which the claims require .

Hereinafter, a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 illustrates an overall system according to an embodiment of the present invention.

Referring to FIG. 1, an overall system according to an embodiment of the present invention includes a transmitting-side sensory transmitting device 100, a receiving-side sensory transmitting device 200, and a management server 300.

In the embodiment of the present invention, each of the sensory transmitters 100 and 200 may be connected to the management server 300 through a wired or wireless network and configured to be operable.

In addition, each of the sensory transmitters 100 and 200 may be described as a transmitting side and a receiving side, for example, but they may exchange roles according to a subject of transmission of sensory sensing data. Accordingly, when the receiving-side sensory transmitting apparatus 200 transmits sensory information, it can perform the same configuration and operation as the transmitting-side sensory transmitting apparatus 100, and the transmitting-side sensory transmitting apparatus 100 also receives sensory information The receiving-side sensory transmitting device 200 can perform the same configuration and operation as those of the receiving-

Then, the transmitting-side sensory transmitting apparatus 100 collects driving information generated according to the movement of the sender, and receives, from the sender, the driving signal of the receiving- Generates sensed information based on the driving information and the environment information, and transmits the sensed information directly to the sensory transmitting device 200 at the receiver located at a remote place or directly to the management server 300 Lt; / RTI >

Accordingly, the receiving-side sensory transducer 200 generates a sensed signal transmitted from the transmitting-side sensory transducer 100 or the management server 300 in response to a movement of a remote transmitter, And generates driving signals of the sensory processing unit for transmitting a sensation corresponding to the movement of the sender to the recipient from the driving information, Based on the information, the drive signal can be adjusted so that the receiver can receive a sensation within a pre-established fit range.

In addition, each of the sensory transmitters 100 and 200 may be implemented in various forms. Each of the sensory transmitters 100 and 200 may be implemented as a video call terminal that is located in a nursing facility or a silver town and can be used by a family member of a remote place or a relative or an acquaintance or a remote control robot such as a hospital or a nursing robot And may be embodied in a wearable device that further includes a wearable portion of a wearable form that is wearable on the body.

Meanwhile, the management server 300 can relay the mutual data between the sensory transmitters 100 and 200, and can perform learning and management of a database for each institution. For example, the management server 300 may be a medical institution server that performs the management function for the nursing facility or a hospital server.

Each of the sensory transmitters 100 and 200 can transmit and receive comprehensive sensory information such as tactile touch, touch, and movement, which can be felt practically between the users. In addition, it is possible to implement behavior control such as delicate hand movements, catching of objects, and contact with each other in a similar manner to that of a robot in the case of a robot.

More specifically, the transmitting-side sensory transmitting device 100 may be located at the sender side, and may include a sensor including a plurality of sensor cells to sense sensory information through each cell. The receiving-side sensory transmitting device 200 may generate and transmit control information (for example, electrical value: current, voltage, resistance, etc.) for each sensor cell to reproduce the sensory information with a real feel.

In addition, the receiving-side sensory transmitting device 2000 may include a sensory-performing unit including a plurality of cells for realizing the received sensory information, and each of the cells may include control information For example, an electrical value) to the sensory implementation unit so that the senses transmitted from the sender side can be reproduced at the receiver side.

The driving signal for the control is variable depending on the conductivity of each cell, the humidity between the cells and the skin, the skin temperature, the contact strength of the cells and the skin, and the sensor cell of the transmitting- Since the condition of the implementation cell of the device 200 will not match, the receiving-side sensory transducer 200 may further perform a process for correcting it.

The environment information may include conductivity, humidity, temperature, contact strength, etc. Also, the environmental information may be collected in the transmitting-side sensory transmitting device 100, May be transmitted along with sensory information. According to the embodiment of the present invention, as the drive signal for the sensory implementation control is corrected by using the variables such as the conductivity, the humidity, the temperature, the contact strength, and the like as variables, even if the same drive signal is applied, You can give.

For example, if the skin humidity at the time of sensing in the transmitting-side sensory transmitting device 100 is equal to the skin humidity at the time of sensory implementation of the receiving-side sensory transmitting device 200 for reproducing the sensation, The sense felt by the human body and the sense sensed by the sender can be matched.

More specifically, when the receiving-side sensory transmitting device 200, which is wet with moisture, receives and reproduces sensory information based on information sensed in a state where the skin humidity is low in the transmitting-side sensory transmitting device 100, Although the electrical value of the sensing signal sensed by the device 100 and the electrical signal of the driving signal for realization in the receiving-side sensory transducer 200 are actually the same, there is a problem that the sensory sensation of the sender may be felt as a painful pain .

Therefore, although the sensory transmitting apparatuses 100 and 200 according to the embodiment of the present invention must match the electrical signals sensed at the transmitter side and the receiver at the receiver side in principle, The sensed feeling of the human body will be different even if the same electrical signal is present depending on the temperature, humidity, temperature, contact strength, etc. Therefore, instead of transferring the electrical value for physical driving of the driving unit by bypass, It is possible to perform a correction process so that the senses become equal.

Hereinafter, detailed configurations for implementing this will be described in more detail.

FIG. 2 is a block diagram showing a sender's side sensory transmitting apparatus according to an embodiment of the present invention in more detail.

2, a transmitting-side sensory transmitting apparatus 100 according to an embodiment of the present invention includes a driving information collecting unit 121, an environment information collecting unit 122, a control unit 110, a feedback processing unit 130, An environment sensing unit 150, and a driving sensing unit 160. [

The control unit 110 may include one or more processors for controlling the overall operation of the transmitting-

The control unit 110 performs overall communication control and data processing between the related modules for various information processing. Although the control unit 110 is shown separately for the control of each component in FIG. 2, even if the control unit 110 is not included, the functions of all or a part of the control unit 110 are dispersed Deployed and synchronized.

In addition, the controller 111 may further include a storage unit for storing information input / output through each module. The storage unit may store control data for operation of the controller 110 and information managed by each component in a predetermined storage space.

The control unit 110 may generate a control signal for sensing environmental information and controlling the lead-in unit 162, and may apply the control signal to the drive sensing unit 160 and the environment sensing unit 150. The control unit 110 may comprise suitable devices and circuits for controlling the driving information collecting unit 121, the environment information collecting unit 122, the feedback processing unit 130, and the communication unit 140.

In addition, the driving sensing unit 160 may include one or more receiving means 162 for transmitting the movement of the sender to the drawing driving unit 161. For example, the user may apply an external force to the transmitting-side sensory transmitting device 100 to induce the movement of each of the incoming means 162, and the incoming drive 161 may move from the movement of each incoming means 162 And transmits the obtained motion information to the driving sensing unit 160.

The drive information collection unit 121 acquires the drive information corresponding to the physical movement or external force of the sender from the motion information sensed by the drive sensing unit 160 in a time series manner.

For example, each of the lead-in units 162 may be attached or closely connected to the environment sensing unit 150, and may correspond to the surface of the environment sensing unit 150 according to the physical pressure or electromagnetic force applied from the outside, It may be physically protruded or recessed.

The lead-in driving unit 161 may be realized as an actuator connected to the actuator and the actuator for physical motion sensing and driving, or an electromagnet system or a MEMS system for electromagnetic implementation.

For example, the lead-in driving unit 161 may be configured to cause the receiving-side sensory transmitting device 200 to receive a physical sensation by being pushed (pulled) or pulled (pulled) The motion information can be outputted.

In addition, for example, the lead-in unit 162 may be provided corresponding to a certain unit area, and one lead-in unit 162 may take charge of a certain area such as 10x10 or 25x25. Accordingly, it is possible to prevent a large difference in performance from that in which the lead-in unit 162 is provided for each position while inviting reduction in the manufacturing cost.

As described above, the lead-in driving unit 161 and the lead-in unit 162 may include various means for enabling various types of lead-in for each unit area of the surface of the environment sensing unit 150. In an embodiment of the present invention, Alternative is possible if there are other alternative technologies that can be mechanically introduced to a portion of the face, for example. For example, the lead-in unit 162 may be provided with an electromagnet, and the lead-in drive unit 161 may control the lead-in of the lead-in unit 162 through magnetic polarity control.

In addition, the lead-in driving unit 161 may apply a feedback signal to the lead-in means 162 for feedback-driving the lead-in means 162 according to the feedback information. For this, the lead-in unit 162 may be a stick or bar-shaped inelastic material connected to the actuator according to the characteristics of the lead-in drive unit 161, or may have a stick or bar-shaped metal material connected to the electromagnet system or the MEMS system .

Meanwhile, the environment sensing unit 150 may include a sensing surface for sensing the sender-side environment information, and may include at least one environmental sensor for sensing status information from the touch or touch of the sender. Here, the status information may include at least one of temperature, humidity, material, image, and sound information, and the status information sensed by the environment sensing unit 150 may be transmitted to the environment information collecting unit 122.

The environment information collecting unit 122 can collect the status information in a time-series manner and generate the sender-side environment information.

Here, the environment information may be used in the receiving-side sensory transmitting apparatus 200 as information for adjusting the driving signal so that the receiving-side sensory transmitting apparatus can receive a sensation within a predetermined fitting range, Will be described later.

When the environment information and the driving information are generated, the control unit 110 generates sensory sensing data by matching and synchronizing the respective pieces of information in a time series manner, and transmits the sensing sensed data to the remote sensing unit through the communication unit 140. [ To the receiving-side sensory transmitting device (200).

The feedback processor 130 controls the input driving unit 161 and the environment sensing unit 150 to feedback the response sensed from the environment information to the sender within a predetermined acceptance range when the environment information is collected .

This is for the convenience of the sender side separately from the receiver side. For example, if the sender side tries to transmit a sensation through the transmitter sensory transmitting device 100 in a very hot and humid environment, the feeling may not be pleasant have. Accordingly, the feedback processor 130 may transmit temperature and humidity reduction feedback information to the controller 110 to adjust the reaction sensation of the environment sensing unit and the inlet driving unit to a predetermined acceptable range from the environment information, 110 may apply the feedback driving signal to the environment sensing unit 150 and the lead-in driving unit 161 according to the feedback information, and feed back a comfortable response sensation to the sender.

The communication unit 140 may include one or more communication modules for directly transmitting the sensed data to the receiving-side sensory transmitting device 200 or transmitting the sensed data to the receiving-side sensory transmitting device 200 or the management server 300.

FIG. 3 is a block diagram showing a receiver-side sensory transmitting device according to an embodiment of the present invention in more detail.

3, the receiving-side sensory transmitting apparatus 200 according to the embodiment of the present invention includes a communication unit 220 including a control unit 210, a driving information receiving unit 221, and an environment information receiving unit 222, And a sense implementation unit including a correction processing unit 230, a database management unit 240, a feedback processing unit 270, an environment implementation unit 250, and a drive implementation unit 260.

Although the receiving-side sensory transmitting device 200 and the transmitting-side sensory transmitting device 100 include a slightly different configuration, the receiving-side sensory transmitting device 200 includes a transmitting- It is obvious that the device 100 may include one or more of the components of the transmitting-side sense-sensing device 100, and detailed descriptions thereof will be omitted because they are the same as those described with reference to FIG.

First, the environment implementing unit 250 and the driving implementing unit 260 may constitute a sensory implementing unit. In response to the time-series driving signal applied from the control unit 210, one or more driving units And an implementation element.

The communication unit 220 receives the sensory data including the driving information generated according to the movement of the sender of the remote place and the environment information corresponding to the driving information.

The communication unit 220 may include an environment information receiving unit 222 and a driving information receiving unit 221 for extracting each environment information and driving information.

The control unit 210 generates a driving signal of the sensory processing unit for transmitting a sensation corresponding to the motion of the sender to the recipient from the driving information.

Here, based on the environmental information, the correction processing unit 230 adjusts the drive signal so that the receiver can receive a sensation within a pre-set fit range.

In particular, in an embodiment of the present invention, the correction processing unit 230 generates an initial driving signal to be provided to the sensory implementation unit for an initial time based on the driving information and the environment information, According to the information, the initial driving signal can be corrected stepwise so as to be adjusted within the predetermined fitting range. This will be described later with reference to FIG.

The sensory implementation unit includes a drive implementation unit 260 for applying a signal for varying the physical depth of the lead-in units 262 corresponding to each unit area according to the drive signal through the lead-in drive unit 261, And an environment implementation unit 250 for electronically varying at least one of a contact force, a material, a temperature, and a humidity of a contact surface according to a driving signal.

Here, the environment implementing unit 250, the lead-in driving unit 261, and the like may include various means for enabling various lead-in and tactile reproduction per unit area, In the embodiment of the present invention, a motor or an actuator and the like are exemplified, but substitution is possible if there are other substitute technologies. For example, the lead-in unit 262 may be provided with an electromagnet, and the lead-in drive unit 261 may control the lead-in of the lead-in unit 262 through magnetic polarity control.

The feedback processor 270 receives feedback information for feedback to adjust the receiving senses of the environment implementing unit 250 and the lead driving unit 261 to within a certain acceptable range from the receiving environment information sensed through the environment implementing unit 250, The control unit 110 may apply the feedback driving signal to the environment implementing unit 250 and the lead-in driving unit 261 in accordance with the feedback information to provide a more pleasant reception Feedback can be sent so that the senses are transmitted.

On the other hand, when the correction processing is completed, the database management unit 240 uploads the learning information according to the correction processing to the database of the management server 300, and the management server 300 stores and manages the sensory database corresponding to the recipient . The sensory database may also be shared with other servers and used to determine an initial driving signal in a similar environment.

Accordingly, the sensory implementer can compensate for a substantial sensation, such as contact, material, temperature, or humidity, as well as a physical amount of change, so as to provide a pleasant sensation similar to that intended by the sender do.

4 is a block diagram showing the correction processing unit according to the embodiment of the present invention in more detail.

Referring to FIG. 4, the correction processing unit according to the embodiment of the present invention may include various correction modules for correcting a driving signal. More specifically, the correction processing unit 230 may include a user correction unit, a database correction unit, a humidity correction unit, a temperature correction unit, a material correction unit image correction unit, and an acoustic correction unit.

The user correction unit may set a suitable stimulus or a feeling range according to a user setting of a sender or a receiver, and may correct the drive signal according to a set stimulus or feeling range. This can be controlled by subjective judgment of the receiver or the like, such as when the sensation is inconvenient.

The database correction unit may acquire the learned correction data corresponding to the recipient from the database stored in advance through the database management unit 240 and correct the initial driving signal. Further, the database can be learned and updated in accordance with the correction result.

The humidity correction unit, the temperature correction unit, and the material correction unit may change the humidity, temperature, or material information obtained from the environment information, and the current receiver-side condition By comparing the information, a correction value can be generated to correct the driving signal.

For example, in the case of rainy season (hot and humid), it may be uncomfortable even in the case of microscopic contact, and as the humidity and temperature are high, the irritation may be high. On the other hand, in winter (low-temperature drying), there is a problem that the degree of skin roughness is felt more.

Accordingly, the correction processing unit 230 compares the sender-side status information obtained from the environment information with the receiver-side status information, and corrects the initial drive signal so as to be within a preset acceptance range, and the status information includes humidity information, Temperature information, and material information.

In addition, the material correction unit can correct the driving signal by reflecting the type of material of the environment implementing unit 250 that directly contacts the body or skin, and the degree of stimulation or feeling depending on the grain direction. For example, the correction processing unit 230 may reflect the difference in softness and roughness according to the material (cloth, leather, vinyl, etc.) used in the contact surface of the environment implementing unit 250, By changing the grain direction of the material, smoothness (grain direction) and roughness (reverse direction) degree can be reflected. The material grain direction and the like can be changed according to the electrical characteristics of the material contained in the environment implementing section 250. [

On the other hand, the correction processing unit 230 obtains the sender side status information based on the image information or the sound information extracted from the environment information, and adjusts the initial drive signal according to the status information, And the like. For example, since the stimulation or feeling is different depending on the expression (laughter, crying, frown), the mood state (joy, anguish, sadness, etc.), the correction processing unit 230 can obtain image information , And it can be reflected in the correction. In the different environments such as city and arboretum, the degree of stimulation or feeling for the same sound is different. In the same environment, the correction process for reflecting the stimulus or the degree of feeling differently depending on the voice or surrounding noise Can be performed.

According to the operation of each of the correction units, the correction processing unit 230 can determine the degree of correction for each correction step of the initial drive signal by using a lookup table corresponding to a preset feedback level.

Table 1 below shows a look-up table corresponding to the humidity information. In the feed-back level 1, it is possible to reflect the stimulus / feeling as it is according to the tactile / -back Level 2 can reflect the irritation / impression of unpleasant tactile / touch / sensory information. Accordingly, the correction of the driving signal for each step can be processed.

In addition, in the case of reflecting the feedback information of the correction processing unit 230, the correction processing may be performed together with the correction processing described above, and the drive signals of the transmission side and the reception side can be expressed by the following mathematical expression (1).

A is the initial touching information, A is the pre-transmission correction signal (feedback process), A 'is the tactile / touch / sensory information (sensory data) transmitted, A '' 'May be received tactile / touch / sensory information (sensory data), and' A 'may include post-transmission correction information. According to the stepwise and sequential correction, the signal A intended by the sender can be appropriately transmitted to the receiving side.

FIG. 5 illustrates a physical depth variation method of sensory information according to an embodiment of the present invention.

5, each of the sensory transmitting apparatuses 100 and 200 according to the embodiment of the present invention includes an inlet sensing unit 162 for varying the sense of physical depth on the surface of the environment sensing unit 150 or the environment implementing unit 250, 262. < / RTI >

The surface of the environment sensing unit 150 or the environment implementing unit 250 according to the embodiment of the present invention may include a lead-in unit 162 controlled by a panel driver for varying the physical depth of the flexible display panel, The physical height for a specific position can be varied according to the movement of the user.

To this end, each of the sensory transmitters 100, 200 may sense motion, provide feedback, or perform drive control on the lead-in means 162, 262.

The lead-in means 162 and 262 may have the form of a stick or a bar and each lead-in means 162 and 262 may be formed on the surface of the environment sensing unit 150 or the environment implementing unit 250, Or may be connected by one or more connecting means.

The lead-in means 162 and 262 are in contact with the environmental sensing unit 150 or the environment implementing unit 250 and are connected to the environment sensing unit 150 or the environment implementing unit 250 They can be arranged at regular intervals.

The lead-in units 162 and 262 are protruded or depressed with respect to the surface of the environment sensing unit 150 or the environment implementing unit 250 by means of an electromagnetically driven or electronically driven MEMS- The specific position of the environment sensing unit 150 or the environment implementing unit 250 may be protruded or depressed.

When the operation of the environment sensing unit 150 or the environment implementing unit 250 and the inputting unit 162 is performed, in the user side of the sender or the receiver, when the incoming unit 162 protrudes, A physical sensation effect due to a physical variable in which a specific region of the unit 150 or the environment implementing unit 250 is protruded forward or a specific region is backward can be received and the humidity of the environment implementing unit 250, It is possible to provide a more comfortable feel and feel that is corrected according to the change.

For example, the transmitting-side sensory transmitting apparatus 100 transmits motion sensor information generated by a MEMS / mechanical / electromagnetic actuator such as a stick / bar / electromagnet or the like to a database of the management server 300, And the management server 300 may generate sensor information update and feedback information from the database and transmit the generated sensor information to the receiving-side sensory transmitting device 200. [

Then, the receiving-side sensory transmitting device 200 moves the MEMS / mechanical / electromagnetic actuating device such as stick / bar / electromagnet according to the feedback information to stimulate the body to share touch / contact / sensory information such as the sender .

In addition, each implementer may have a haptic / tactic function, which allows the recipient to feel the touch / touch / sensation information felt by the sender.

6 and 7 are flowcharts for explaining a sensory transmitting method according to an embodiment of the present invention.

Referring to FIG. 6, first, the transmitting-side sensory transmitting apparatus 100 collects driving information according to the motion of the driving sensing unit 160 (S101).

Then, the transmitting-side sensory transmitting apparatus 100 collects environmental information from the environmental sensing unit 150 (S103).

Then, the transmission-side sensory transmitting apparatus 100 generates sensory information data to be transmitted and determines a transmission mode by matching and synchronizing the driving information and the environment information in a time-series manner through the control unit 110 (S105) .

Here, the transmission method may be selected from one-to-one transmission directly transmitted to the receiving-side sensory transmitting device 200 or transmission to the management server 300.

In case of one-to-one transmission, the transmitting-side sensory transmitting device 100 directly transmits sensory data to the receiving-side sensory transmitting device 200 through the communication unit 140 (S109).

Then, the transmitting-side sensory transmitting apparatus 100 provides the reaction information feedback to the sender through the feedback processing section 130 based on the environmental information (S111).

On the other hand, if the transmission is not a one-to-one transmission, the transmitting-side sensory transmitting apparatus 100 transmits the sensory data to the management server 300 through the communication unit 140 (S111).

Accordingly, the management server 300 performs database update according to sensory data and relays data to the receiving-side sensory transmitting device 200 (S113).

For example, the management server 300 compares and analyzes the received sensory data information with the data stored in the database, and transmits appropriate initial driving signal information corresponding to the sensed sensory data together with sensory data to the sensory transmitting device 200 . If there is no initial driving signal and feedback corresponding to received sensory data information, the user can add appropriate feedback information to the data center and process the database construction accordingly. When the user selects not to add, the initial driving signal according to the most similar feedback information can be transmitted to the receiving-side sensory transmitting device 200 together with sensory data.

7, the receiving-side sensory transmitting apparatus 200 receives the sensory information data through the communication unit 220 and receives environment information and driving information therefrom (S201).

Then, the receiving-side sensory transmitting apparatus 200 acquires a driving signal to be applied to the sensory implementing unit in the control unit 210 according to the received data analysis (S203).

Then, the receiving-side sensory transmitting apparatus 200 performs a stepwise correction process on the driving signal according to the environment information through the correction processing unit 230 (S205).

Here, the stepwise correction process may include a correction process using each of the modules as described in FIG.

When all the corrections are completed (S207), the receiving-side sensory transmitting apparatus 200 applies driving signals corrected to the sensory implementing unit through the control unit 210 and outputs the driving signals to the environment implementing unit 250 and the driving implementing unit 260 (S209). ≪ / RTI >

Then, the receiving-side sensory transmitting apparatus 200 generates reaction information for interaction, generates sensed data according to the generated sensed data, and transmits the sensed data to the transmitting-side sensory transmitting apparatus 100 (S211).

Since the sensory correction is performed in accordance with the respective sender and receiver environment information, more accurate and pleasant user interaction can be achieved.

8 shows an application system according to an embodiment of the present invention.

The application system according to the embodiment of the present invention may constitute an interaction system including a plurality of management servers 300. [ Each of the management servers 300 may include, for example, a relay server 310, a nursing home server 320, a hospital server 330, a silver town server 340, ) Can be implemented with various wearable devices to implement sensory interaction between users.

In the case of the existing remote motion transmission, unidirectional transmission is performed between the sender A and the receiver B, and thus there is a limit to the implementation of such a system. However, since the receiver- To the shared database of the management server together with the environmental information of the receiver, and the shared database can be provided to the management server of another organization, thereby configuring the application system.

Accordingly, in the case of 1) A → B, the environment correction for B can be performed at the time of transmitting tactile / touch / sensory information, 2) in case of A ← B, feedback for sensing A Feedback of the tactile / touch / sensory information and environment correction can be made so that both the sender A and the receiver B can satisfy both 1) and 2) since the correction can be made.

In addition, the shared database for this purpose is a touch / contact / sensory database that is as close as possible to the actual texture through comparison and updating of the sample data and the biometric database, which are basically constructed in consideration of climate, environment, Can be constructed.

A wearable device / terminal capable of transferring and implementing tactile / contact / sensory information in a similar environment (same space, age range, etc.) as the nursing home server 320, the silver town server 340 and the hospital server 330 The relay server 310 can process the sensory data in order to perform bi-directional correction based on the collected data.

Accordingly, the application system according to the embodiment of the present invention can construct big data based on data collected from wearable devices / terminals (for example, thousands to tens of thousands) used in the same environment or similar environment, Through learning and analysis, it is possible to calibrate tactile / contact / sensory information and build up correction data as much as possible.

The method according to the present invention may be implemented as a program for execution on a computer and stored in a computer-readable recording medium. Examples of the computer-readable recording medium include a ROM, a RAM, a CD- , A floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave (for example, transmission over the Internet).

The computer readable recording medium may be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. And, functional programs, codes and code segments for implementing the above method can be easily inferred by programmers of the technical field to which the present invention belongs.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It should be understood that various modifications may be made by those skilled in the art without departing from the spirit and scope of the present invention.

Claims (18)

In a sense transmitter,
A sensory implementation unit for reproducing a sensation transmitted to a receiver according to a time series driving signal;
A communication unit for receiving driving information generated according to movement of a sender of a remote place and environment information corresponding to the driving information;
From the driving information, a driving signal of the sensory unit for transmitting a sensation according to movement of the sender to the recipient; And
And a correction processing section that adjusts the drive signal so that the receiver can receive a sensation within a predetermined fit range based on the environment information,
Wherein,
Generating an initial drive signal to be provided to the sensory implementation unit for an initial time based on the drive information and the environment information,
The initial driving signal is corrected stepwise so as to be adjusted within the predetermined fitting range according to sensing information or set correction information corresponding to the recipient
Sensory transfer device. delete The method according to claim 1,
The correction processing unit
And a user correction unit for setting the fit range according to a user setting of the receiver
Sensory transfer device. The method according to claim 1,
The correction processing unit
Further comprising a database correcting unit for obtaining learned correction data corresponding to the recipient from a previously stored database and correcting the initial driving signal
Sensory transfer device. The method according to claim 1,
The correction processing unit
Side state information obtained from the environment information is compared with the receiver side state information to correct the initial driving signal so that the initial driving signal is within a preset accommodation range, and the state information includes at least one of humidity information, temperature information, Containing
Sensory transfer device. The method according to claim 1,
The correction processing unit
Acquires the sender side status information based on image information or sound information extracted from the environment information, and corrects the initial drive signal according to the status information
Sensory transfer device. The method according to claim 1,
The correction processing unit
A correction level for each correction step of the initial driving signal is determined using a lookup table corresponding to a preset feedback level
Sensory transfer device. The method according to claim 1,
The correction processing unit
When the correction processing is completed, uploads the correction processing result data corresponding to the receiver to the shared database of the management server together with the environment information of the receiver, and the shared database can be provided to the management server of another institution
Sensory transfer device. The method according to claim 1,
The sensory implementations
A drive implementation unit for varying a physical depth corresponding to each unit area in accordance with the drive signal; And
And an environment implementation unit that electronically changes at least one of contact force, material, temperature, and humidity of the contact surface according to the environment information
Sensory transfer device. In the sensory transfer method,
Receiving driving information generated according to movement of a sender of a remote place and environment information corresponding to the driving information;
Generating a drive signal of a sensory implement for transmitting a sensation according to movement of the sender to a recipient from the drive information;
Adjusting the drive signal based on the environmental information so that the receiver can receive a sensation within a predefined adaptation range; And
And in response to the adjusted drive signal, reproducing the sensation delivered to the receiver in a time series manner,
Wherein the adjusting comprises:
Generating an initial drive signal to be provided to the sensory implementer for an initial time based on the drive information and the environmental information; And
And stepwise correcting the initial driving signal so as to be adjusted within the predetermined fitting range according to sensing information or set correction information corresponding to the recipient
Sensory delivery method. delete 11. The method of claim 10,
Wherein the correcting comprises:
Obtaining corrected learning data corresponding to the receiver from a previously stored database and correcting the initial driving signal
Sensory delivery method. 11. The method of claim 10,
Wherein the correcting comprises:
Comparing the sender side status information obtained from the environment information with the recipient side status information and correcting the initial drive signal so as to be within a preset acceptance range,
Wherein the status information includes at least one of humidity information, temperature information, and material information
Sensory delivery method. 11. The method of claim 10,
Wherein the correcting comprises:
Acquiring the sender-side status information based on image information or sound information extracted from the environment information, and correcting the initial drive signal according to the status information
Sensory delivery method. 11. The method of claim 10,
Wherein the reproducing step comprises:
Varying a physical depth corresponding to each unit area according to the driving signal; And
And electronically varying at least one of contact force, material, temperature or humidity of the contact surface according to the environmental information
Sensory delivery method. In a sense transmitter,
A driving information collecting unit for collecting driving information generated according to movement of a sender;
An environment information collecting unit for collecting environment information for adjusting a driving signal from the sender so that the sensory transmitting device on the receiver side can receive a sensation within a pre-set fit range;
A control unit for generating sensory data based on the driving information and the environment information;
A feedback processor for feedbacking the reaction sensation transmitted to the sender within a predetermined acceptance range according to the environment information of the sender; And
And a communication unit for transmitting the sensory data to a sensory transmitting device on the receiver side at a remote place
Sensory transfer device. delete 17. The method of claim 1 or 16,
Wherein the sensory transmitting device is a wearable device further comprising a wearer for wearing the part or all of the body of the sender or the sender
Sensory transfer device.

Images