KR20220087204A - Immersive content reproduction control apparatus, method and system - Google Patents

Abstract

A sensory content reproduction control apparatus, method, and system are provided for controlling the screen reproduction speed of sensory content reproduced on a display based on a user's movement during rehabilitation training or gait training. The proposed device includes: a receiver for receiving a motion signal that is transmitted from the outside and corresponds to whether or not the user moves; a playback unit for playing the sensory content and outputting an image of the corresponding sensory content on a display; and a control unit that adjusts a playback speed of the image of the sensory content on a display based on the user's motion signal received by the receiver.

Description

Immersive content reproduction control apparatus, method and system

The present invention relates to an apparatus, method, and system for controlling reproduction of sensory content, and more particularly, to an apparatus, method, and system for controlling reproduction of sensory content based on a user's movement.

Looking at rehabilitation training or treatment, in a broad sense, it refers to any treatment performed in an effort to achieve and maintain the optimal physical, sensory, intellectual, psychological, and social level that a person with a disability can have. In addition, it refers to any treatment to restore a patient's quality of life, even if there is no disability, when the patient's quality of life is reduced due to pain, temporary disease, or trauma.

On the other hand, the narrow meaning of rehabilitation treatment can be considered separately from treatment-oriented medicine. While treatment-oriented medicine mainly uses drugs or surgical methods, rehabilitation treatment refers to treatment using physical stimuli and interventions on the patient's activities to restore and maintain body functions.

In such a conventional rehabilitation training or treatment, a gait rehabilitation device for performing only fragmentary and uniform gait training is also employed. For example, the conventional gait rehabilitation apparatus is implemented to perform only passively repeated gait training, so that rehabilitation trainers (or gait trainers) using it feel boredom, and there is a problem of lowering concentration. Although the gait rehabilitation apparatus according to the prior art is implemented to actively perform gait training, there is a problem in that it is insufficient to arouse the interest of a rehabilitation trainee or a gait trainee.

Prior Art 1: Republic of Korea Patent Publication No. 10-2011-0066264 (System for Rehabilitation Patient Using Mat) Prior art 2: Republic of Korea Patent Registration No. 10-1912320 (gait rehabilitation device for the severely disabled including a virtual reality platform)

The present invention has been proposed to solve the above-mentioned problems of the prior art. Sensory content reproduction capable of controlling the screen reproduction speed of sensory content reproduced on a display based on a user's movement during rehabilitation training or gait training An object of the present invention is to provide a control device, method and system.

In order to achieve the above object, there is provided a sensory content reproduction control apparatus according to a preferred embodiment of the present invention, comprising: a receiver for receiving a motion signal corresponding to whether or not a user moves, transmitted from the outside; a playback unit for playing the sensory content and outputting an image of the corresponding sensory content on a display; and a control unit that adjusts a playback speed of the image of the sensory content on a display based on the user's motion signal received by the receiver.

When the user's movement signal is received, the controller displays a screen of sensory content on the display, calculates a corresponding user's movement speed based on the received user's movement signal, and based on the calculated user's movement speed to adjust the playback speed of the image of the sensory content of the display.

The user's movement signal includes a first signal for the user's left foot and a second signal for the user's right foot, and is true meaning that the first signal is greater than or equal to a preset reference, and the second signal If is false, meaning that is less than the preset criterion, the controller may determine that the user is moving forward and move the image of the sensory content output on the display forward.

If the first signal is false and the second signal is true, the controller may determine that the user is moving forward and move the image of the sensory content output on the display forward.

If both the first signal and the second signal are true or false, the controller may determine that the user is currently paused and pause the image of the sensory content output to the display.

A preferred embodiment of the present invention may further include an input unit for setting the single-person mode and the multi-person mode.

When the 1 person mode is set, the control unit calculates in real time the current movement speed of the user based on the time value of the current movement signal and the time value of the immediately preceding movement signal, and calculates the current movement speed of the user calculated in real time. The reproduction speed of the image of the sensory content displayed on the display may be adjusted in real time based on the movement speed of the .

When the one-person mode is set, the control unit calculates a plurality of movement speeds for each time for the user based on the time values of the movement signals input a plurality of times, and calculates the average value of these for the final movement speed for the user. It is calculated as one, and the reproduction speed of the image of the sensory content displayed on the display may be adjusted based on the calculated final movement speed of the corresponding user.

When the Dyne mode is set, the control unit calculates in real time the current movement speed of each user based on the time value of each user's current movement signal and the time value of the immediately preceding movement signal, and based on this, calculates all Any one of the average value of the user's current movement speeds, the maximum and minimum speeds extracted from the current movement speeds of all users, and the average value, and the average value of the remaining movement speeds excluding the maximum and minimum speeds among the current movement speeds of all users , and the current playback speed of the image of the sensory content displayed on the display may be adjusted in real time based on the obtained average value.

When the Dyne mode is set, the control unit calculates the current movement speed of each user in real time based on the time value of each user's current movement signal and the time value of the immediately preceding movement signal, and calculates all the calculated users. The minimum speed may be extracted from among the current movement speeds of , and the current playback speed of the image of the sensory content displayed on the display may be adjusted in real time based on the extracted minimum movement speed.

When the Dyne mode is set, the control unit calculates a plurality of time-based movement speeds for each user based on the time value of each user's movement signal input a plurality of times, calculates an average movement speed for each user, and based on this The average value of the average movement speeds for all users, the maximum value and the minimum value among the average movement speeds for all users are extracted, and any one of these average values and the average value of the remaining values excluding the maximum value and the minimum value among the average movement speeds for all users is obtained, The reproduction speed of the image of the sensory content displayed on the display may be adjusted based on the obtained average value.

When the Dyne mode is set, the control unit calculates a plurality of time-based movement speeds for each user based on the time value of each user's movement signal input a plurality of times, calculates an average movement speed for each user, and based on this It is possible to extract an average movement speed having a minimum value among average movement speeds for all users, and adjust a reproduction speed of an image of a sensory content on the display based on the extracted average movement speed having the minimum value.

The controller may suggest a method for resolving a problem that may occur due to the difference in the foot pressure of the user's feet by identifying the foot pressure of the user's feet based on the movement signal from the outside.

The controller may determine the gait of the user based on a motion signal from the outside and output gait correction information corresponding thereto.

On the other hand, a sensory content reproduction control method according to a preferred embodiment of the present invention is a sensory content reproduction control method performed by a sensory content reproduction control apparatus, comprising: receiving a motion signal corresponding to whether a user moves or not transmitted from the outside; ; reproducing the sensory content and outputting an image of the corresponding sensory content to a display; and adjusting a reproduction speed of the image of the sensory content on a display based on the received user's motion signal.

Meanwhile, a sensory content reproduction control system according to a preferred embodiment of the present invention includes: a motion signal transmitter for transmitting a motion signal corresponding to whether or not a user moves; a receiver configured to receive a user's motion signal from the motion signal transmitter; a playback unit for playing the sensory content and outputting an image of the corresponding sensory content on a display; and a control unit that adjusts a playback speed of the image of the sensory content on a display based on the user's motion signal received by the receiver.

According to the present invention having such a configuration, the screen reproduction speed of the sensory content on the display can be controlled based on the user's movement during rehabilitation training or gait training. Rehabilitation training or gait training can be performed while viewing the screen.

During rehabilitation training or gait training, the user moves while watching a screen of realistic content with an appropriate playback speed reproduced on the display, thereby relieving boredom and decreased concentration due to a high sense of immersion.

In addition, the effect of rehabilitation training or gait training can be greatly improved by the voluntary and active participation of users in rehabilitation training or gait training.

1 is a block diagram of a sensory content reproduction control system according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating an example of the display shown in FIG. 1 .
3 is a flowchart illustrating a method for controlling reproduction of sensory content according to an embodiment of the present invention.
4 is a diagram for explaining movement and pause of a screen of sensory content in the sensory content reproduction control apparatus according to an embodiment of the present invention.

Since the present invention can have various changes and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail.

However, this is not intended to limit the present invention to specific embodiments, and it should be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention.

The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the accompanying drawings. In describing the present invention, in order to facilitate the overall understanding, the same reference numerals are used for the same components in the drawings, and duplicate descriptions of the same components are omitted.

1 is a block diagram of a sensory content reproduction control system according to an embodiment of the present invention, and FIG. 2 is a diagram illustrating an example of the display shown in FIG. 1 .

The sensory content reproduction control system according to an embodiment of the present invention includes a motion signal transmitter 10 , an input unit 20 , a receiver 30 , a sensory content storage unit 40 , a playback unit 50 , and an output unit 60 . , and a control unit 70 . Here, the input unit 20, the receiver 30, the sensory content storage unit 40, the playback unit 50, the output unit 60, and the control unit 70 are connected to the sensory content reproduction control apparatus according to an embodiment of the present invention. It can be said that The sensory content reproduction control apparatus according to an embodiment of the present invention may be an electronic device such as a PC or a notebook computer, or may be employed in an electronic device such as a PC or notebook computer.

The motion signal transmitter 10 may transmit a signal corresponding to the motion of the user (eg, a rehabilitation trainee, etc.).

For example, the moving signal transmitter 10 may be installed on the shoes worn by the user.

That is, the movement signal transmitter 10 wirelessly outputs a signal according to whether or not the user moves. In this case, the signal S1 of the left foot and the signal S2 of the right foot may be paired and wirelessly output. Here, S1 and S2 may be, for example, a pressure signal or an angle signal.

To this end, the motion signal transmitter 10 may include a sensor unit 12 and a transmitter 14 .

The sensor unit 12 may sense the user's movement.

For example, the sensor unit 12 may be installed in the lower portion of the user's shoes (eg, a portion in contact with the heel).

The sensor unit 12 includes a pressure sensor 12a that senses pressure in the left foot and the right foot according to whether the user moves, and an angle sensor 12b that senses the angle of the left foot and the right foot according to whether the user moves. It may include more than one.

Since the pressure sensor 12a senses pressure, it may sense the foot pressure in each of the user's left and right feet.

When the user walks, the pressure of the foot touching the floor and the pressure of the foot away from the floor are different from each other. Based on this, the controller 70 may determine whether the user is moving forward.

On the other hand, when the user walks, in order to move forward, the forefoot of either of the left foot and the right foot first touches the floor, the heel falls off the floor, and then the left foot and the right foot alternately perform the movement of the corresponding foot completely falling off the floor. . At this time, since the angle sensor 12b may sense the angle at which the heel of one foot is separated from the floor, the controller 70 may determine whether the user is moving forward based on this.

Of course, if necessary, the sensor unit 12 may further include other sensors in addition to the pressure sensor 12a and the angle sensor 12b.

The transmitter 14 may output motion signals S1 and S2 of the corresponding user sensed by the sensor unit 12 .

For example, the transmitter 14 may output unique identification information of the corresponding user when outputting the motion signals S1 and S2. Since there may be more than one user for receiving rehabilitation training or gait training, unique identification information for each user is required for later identification in the control unit 70 .

The input unit 20 may input the number of users receiving rehabilitation training or gait training. Of course, if necessary, the input unit 20 may select a single-person mode or a multi-person mode.

Meanwhile, the input unit 20 may select a sensory content to be reproduced.

The receiver 30 may receive a signal according to whether the user moves, which is wirelessly transmitted from the motion signal transmitter 10 .

The sensory content storage unit 40 stores images and audio of a plurality of sensory contents.

For example, a plurality of sensory content stored in the sensory content storage unit 40 is sensory content (eg, augmented reality content, virtual reality content) capable of resolving boredom and decreased concentration during user's rehabilitation training or gait training. ) can be

The playback unit 50 may reproduce the sensory content from among the plurality of sensory contents stored in the sensory content storage unit 40 under the control of the controller 70 .

In this case, the reproduction speed of the screen of the sensory content reproduced by the reproduction unit 50 is adjusted by the control unit 70 .

The output unit 60 may output images and audio of the sensory content reproduced by the reproduction unit 50 .

For example, the output unit 60 may include a plurality of large-sized displays 62 , as illustrated in FIG. 2 , and a speaker 64 .

The display 62 may display an image of the sensory content reproduced by the playback unit 50 .

For example, the display 62 may display the image of the sensory content reproduced by the playback unit 50 in a panoramic form. To this end, the display 62 is preferably configured in plurality.

The plurality of displays 62 are installed along a track of a predetermined size (eg, a donut-shaped track), and may be installed side by side at an appropriate height for a user to view.

In addition, the images of the sensory content displayed on the plurality of displays 62 may be mutually continuous images. In other words, the playback unit 50 may reproduce one sensory content, and the reproduced image of one sensory content may be spread out and displayed in the form of a panorama on the plurality of displays 62 .

The speaker 64 may output a voice of the sensory content displayed through the display 62 .

Here, although the image of the sensory content is displayed through the display 62 , the corresponding audio may not be output through the speaker 64 . That is, the video and audio of the sensory content are not always output together, but only the video of the sensory content may be output in some cases. Of course, the opposite case may be used if necessary.

The controller 70 controls the overall operation of the sensory content reproduction control apparatus according to the embodiment of the present invention.

In particular, when the receiving unit 30 receives the user's motion signal from the motion signal transmitting unit 10, the control unit 70 displays a screen of a predetermined sensory content on the display 62 and receives the user's motion signal. Based on the calculation of the user's movement speed, the playback speed of the image (screen) of the sensory content on the display 62 may be adjusted based on the calculated user's movement speed.

In other words, when the user undergoing rehabilitation training or gait training moves forward, the control unit 70 also moves the sensory content screen on the display 62 forward. 62), the screen of the sensory content can be moved forward. In this way, when the user moves, the image (screen) of the sensory content on the display 62 also moves, so the user will feel as if he or she directly enters and moves into the scenery in the image of the corresponding sensory content.

The control unit 70 may perform sensory content reproduction control based on the single-person mode or the multi-person mode according to the number of users input from the input unit 20 . In the case of the single-person mode, the controller 70 may calculate the movement speed of the corresponding user and adjust the playback speed of the screen of the sensory content on the display 62 to the corresponding screen playback speed. However, in the case of the multiplayer mode of two or more people, it is rather difficult for the controller 70 to perform sensory content reproduction control based on the movement speed of any one. can be done Of course, if necessary, in the case of the multi-mode, sensory content reproduction control may be performed by adopting another method instead of the average value theory.

The above-described screen refresh rate corresponding to the user's movement speed means that the user's movement speed (or average movement speed) may match 100% of the screen refresh rate, but there may be a slight difference.

Meanwhile, the control unit 70 may determine whether the user is currently moving or temporarily stopped based on the motion signal (pressure signal or angle signal) from the motion signal transmitter 10 .

For example, it is assumed that the motion signal includes signals S1 and S2 by the pressure sensor 12a or the angle sensor 12b. In the case of the pressure sensor 12a, since it senses the respective pressures of the left and right feet, a corresponding signal will be output, and in the case of the angle sensor 12b, the respective angles of the left and right feet are sensed, so a corresponding signal is provided. will print

If the received signal S1 is true and the received signal S2 is false, the control unit 70 considers that the current user has the left foot in contact with the floor and the right foot away from the floor, so that the current user It can be judged that it is moving forward.

Conversely, if the received signal S1 is false and the received signal S2 is true, the control unit 70 considers that the current user has the left foot off the floor and the right foot touching the floor. It can be determined that the user is moving forward.

On the other hand, if the received signal S1 and the signal S2 are both true, the control unit 70 considers that both the left and right feet of the current user are in contact with the floor, so that it can be determined that the current user is paused. have.

When the signals S1 and S2 are true, the pressure or angle sensed by the pressure sensor 12a or the angle sensor 12b may be greater than or equal to a preset pressure or angle. Conversely, when the signals S1 and S2 are false, the pressure or angle sensed by the pressure sensor 12a or the angle sensor 12b may be less than a preset pressure or angle.

As described above, when it is determined that the user is moving forward, the controller 70 may move the image of the sensory content displayed on the display 62 forward. In this case, the forward playback speed of the image of the sensory content may be based on the user's movement speed as described above.

In addition, if it is determined that the user is paused, the controller 70 may temporarily stop the image of the sensory content displayed on the display 62 .

On the other hand, if both the received signal S1 and the signal S2 are false, the controller 70 may consider that both the left and right feet of the current user are off the floor or out of the track. During rehabilitation or gait training, it is rare for both the user's left and right feet to be off the floor (eg, when jumping) or to deviate from the track. In this case, the controller 70 is displayed on the display 62. It is assumed that the video of the displayed sensory content is temporarily stopped.

Meanwhile, in calculating the user's movement speed, the controller 70 may calculate the user's movement speed based on the movement signals S1 and S2 from the movement signal transmitter 10 .

For example, when there is only one user receiving rehabilitation training or gait training, the controller 70 calculates the current movement speed of the corresponding user in real time based on the time value of the current movement signal and the time value of the immediately preceding movement signal. can be calculated In other words, the current movement speed of the corresponding user may be calculated based on the time values of the preceding and following movement signals input based on a specific distance. In this way, when the current movement speed of the user is calculated in real time, the controller 70 calculates the current playback speed of the image of the sensory content displayed on the display 62 in real time based on the user's current movement speed calculated in real time. can be adjusted with For example, the image (screen) of the sensory content on the display 62 may be moved forward at a playback speed corresponding to the user's current movement speed calculated in real time. As a result, the reproduction speed of the image (screen) of the sensory content can be corrected (updated, changed) in real time.

On the other hand, when there is only one user receiving rehabilitation training or gait training, the controller 70 calculates a plurality of movement speeds for each time for the user based on the time value of the motion signal input several times (that is, the above-described (similar to the method of calculating the current motion speed based on the time value of the current motion signal and the time value of the immediately preceding motion signal) can When the final movement speed of the user is calculated as described above, the controller 70 may adjust the reproduction speed of the image of the sensory content displayed on the display 62 based on the final movement speed of the user. For example, the image (screen) of the sensory content on the display 62 may be moved forward at a playback speed corresponding to the user's final movement speed. In this case, the reproduction speed of the image of the sensory content displayed on the display 62 is not adjusted in real time, but is uniformly adjusted for a predetermined time according to the average value.

Alternatively, when there are several users receiving rehabilitation training or gait training, as described above, the controller 70 controls each user based on the time value of each user's current motion signal and the time value of the immediately preceding motion signal. The user's current movement speed can be calculated in real time. In other words, the current movement speed of each user can be calculated in real time based on the time values of the preceding and following movement signals input based on a specific distance as in the example above. will be. Thereafter, the control unit 70 extracts the average value of the current movement speeds of all users, or the maximum and minimum speeds from among the current movement speeds of all users, and obtains the average value thereof, or the maximum and minimum speeds among the current movement speeds of all users. An average value of the remaining movement speeds may be obtained, and a current playback speed of an image of sensory content displayed on the display 62 may be adjusted in real time based on the obtained average value. That is, the image (screen) of the sensory content on the display 62 may be moved forward in real time at a playback speed corresponding to the obtained average value.

Alternatively, when there are several users receiving rehabilitation training or gait training, as described above, the controller 70 controls each user based on the time value of each user's current motion signal and the time value of the immediately preceding motion signal. The user's current movement speed can be calculated in real time. In other words, the current movement speed of each user can be calculated in real time based on the time values of the preceding and following movement signals input based on a specific distance as in the example above. will be. Thereafter, the control unit 70 extracts the minimum speed among the current movement speeds of all users, and based on the extracted minimum speed, the current playback speed of the image of the sensory content displayed on the display 62 in real time can be adjusted That is, the image (screen) of the sensory content on the display 62 may be moved forward in real time at a reproduction speed corresponding to the extracted minimum movement speed.

Alternatively, when there are several users receiving rehabilitation training or gait training, as described above, the control unit 70 determines a plurality of time-based movement speeds for each user based on the time value of each user's movement signal input several times. Calculation (that is, similar to the method of calculating the current motion speed based on the above-described time value of the current motion signal and the time value of the immediately preceding motion signal) and calculates the average motion speed for each user. Thereafter, the controller 70 extracts the average value of the average movement speeds for all users, or the maximum and minimum values from the average movement speeds for all users, and excludes the average value or the maximum and minimum values among the average movement speeds for all users. An average value of the values may be obtained, and a playback speed of an image of sensory content displayed on the display 62 may be adjusted based on the obtained average value. For example, the image (screen) of the sensory content on the display 62 may be moved forward at a playback speed corresponding to the obtained average value. In this case, the reproduction speed of the image of the sensory content displayed on the display 62 is not adjusted in real time, but is uniformly adjusted for a predetermined time according to the average value.

Alternatively, when there are several users receiving rehabilitation training or gait training, as described above, the control unit 70 determines a plurality of time-based movement speeds for each user based on the time value of each user's movement signal input several times. Calculation (that is, similar to the method of calculating the current motion speed based on the above-described time value of the current motion signal and the time value of the immediately preceding motion signal) and calculates the average motion speed for each user. Thereafter, the controller 70 extracts the average movement speed having the minimum value among the average movement speeds for all users, and displays an image (screen) of the sensory content on the display 62 based on the extracted average movement speed having the minimum value. can be moved forward. In this case, the reproduction speed of the image of the sensory content displayed on the display 62 is not adjusted in real time, but is uniformly adjusted for a predetermined time according to the average movement speed having the minimum value.

Meanwhile, the controller 70 may determine the foot pressure of the user's feet based on the signal from the pressure sensor 12a. Accordingly, the control unit 70 can suggest a method for solving a problem that may occur due to the difference in the foot pressure of the user's feet.

In addition, for the user's gait correction, the control unit 70 detects the gait of the user based on the motion signal (angle signal) from the angle sensor 12b and outputs corresponding gait correction information. have.

3 is a flowchart illustrating a method for controlling reproduction of sensory content according to an embodiment of the present invention.

First, if there is only one user who wants to receive rehabilitation training or gait training, input “1” through the input unit 20 or select a single mode, and if there are several users who want to receive rehabilitation training or gait training, corresponding Enter the number of people or select multiplayer mode.

And, when one or more users who want to perform rehabilitation training or gait training on the track move (ie, move forward), the motion signal transmitter 10 wirelessly transmits signals S1 and S2 corresponding to the movement of the user. print out At this time, when there are several users, the movement signals S1 and S2 of the corresponding users will be wirelessly output together with a unique identification number for each user.

Accordingly, the receiving unit 30 of the sensory content reproduction control apparatus according to the embodiment of the present invention receives the user's motion signals S1 and S2 (S10).

Then, the controller 70 of the sensory content reproduction control apparatus according to the embodiment of the present invention displays a screen of a predetermined sensory content on the display 62 (S12).

Of course, in the above description, after receiving the user's motion signals S1 and S2, an image (screen) of a predetermined sensory content is displayed on the display 62, but on the contrary, the user's motion signals S1 and S2 An image (screen) of a predetermined sensory content may be displayed first on the display 62 before receiving .

Next, the controller 70 calculates the user's movement speed based on the user's movement signals S1 and S2 from the movement signal transmitter 10 received by the receiver 30 ( S14 ).

Then, the controller 70 adjusts the playback speed of the image (screen) of the sensory content on the display 62 based on the calculated user's movement speed (S16).

The above-described steps S14 and S16 will be described in more detail below.

In the case of calculating the user's movement speed in step S14, the sensory content reproduction control apparatus according to an embodiment of the present invention calculates the user's movement speed based on the movement signals S1 and S2 from the movement signal transmitter 10. can be calculated

For example, if there is only one user (single-person mode) receiving rehabilitation training or gait training, the current movement speed of the user is calculated in real time based on the time value of the current movement signal and the time value of the immediately preceding movement signal. can be calculated as In other words, the current movement speed of the corresponding user may be calculated based on the time values of the preceding and following movement signals input based on a specific distance. In this way, when the current movement speed of the user is calculated in real time in step S14, in step S16, the sensory content reproduction control apparatus according to the embodiment of the present invention sets the reproduction speed corresponding to the user's current movement speed calculated in real time. The image of the sensory content on the display 62 is moved forward in real time.

On the other hand, when there is only one user (single-person mode) receiving rehabilitation training or gait training, a plurality of time-based movement speeds for the user are calculated based on the time value of the motion signal input several times, and the average value thereof can be calculated as the final movement speed for the user. When the final movement speed of the user is calculated in step S14 as described above, in step S16, the image of the sensory content on the display 62 is moved forward at a playback speed corresponding to the final movement speed of the user.

Alternatively, when there are multiple users (multi-person mode) receiving rehabilitation training or gait training, each user's current movement is based on the time value of each user's current movement signal and the time value of the immediately preceding movement signal. The speed can be calculated in real time. In other words, the current movement speed of each user may be calculated in real time based on time values of each user's movement signal input based on a specific distance. Thereafter, the average value of the current movement speeds of all users, or the maximum and minimum speeds from among the current movement speeds of all users are extracted, and the average value or the other movement speeds except for the maximum and minimum speeds among the current movement speeds of all users An average value is obtained (S14). Next, the image of the sensory content on the display 62 is moved forward at a playback speed corresponding to the obtained average value (S16).

Alternatively, when there are multiple users (multi-person mode) receiving rehabilitation training or gait training, each user's current movement is based on the time value of each user's current movement signal and the time value of the immediately preceding movement signal. The speed can be calculated in real time. In other words, the current movement speed of each user may be calculated in real time based on time values of preceding and following motion signals input based on a specific distance. Thereafter, the minimum speed among the current movement speeds of all users is extracted (S14). Next, the current playback speed of the image of the sensory content displayed on the display 62 is adjusted in real time based on the extracted minimum movement speed (S16). That is, the image (screen) of the sensory content on the display 62 is moved forward in real time at a reproduction speed corresponding to the extracted minimum movement speed.

Alternatively, when there are several users (multi-person mode) receiving rehabilitation training or gait training, a plurality of time-based movement speeds are calculated for each user based on the time value of each user's movement signal input several times, and each user Calculate the average movement speed. After that, the average value of the average movement speeds for all users, or the maximum and minimum values from the average movement speeds for all users are extracted, and the average value or the average value of the remaining values excluding the maximum and minimum values among the average movement speeds for all users is obtained. (S14). Then, the image of the sensory content on the display 62 is moved forward at the corresponding reproduction speed with the obtained average value (S16).

Alternatively, when there are several users receiving rehabilitation training or gait training, as described above, the control unit 70 determines a plurality of time-based movement speeds for each user based on the time value of each user's movement signal input several times. and calculates the average movement speed for each user. Thereafter, the average movement speed having the lowest value among the average movement speeds for all users is extracted (S14). Next, the image (screen) of the sensory content on the display 62 is moved forward based on the extracted average movement speed having the minimum value (S16). In this case, the reproduction speed of the image of the sensory content displayed on the display 62 is not adjusted in real time, but is uniformly adjusted for a predetermined time according to the average movement speed having the lowest value.

As described above, when the user moves along the track, the image (screen) of the sensory content on the display 62 also moves, so that the user feels as if he or she directly enters and moves into the scenery in the image of the corresponding sensory content. will be In addition, during rehabilitation training or gait training, the user moves (that is, moves) while watching the screen of sensory content with an appropriate moving speed reproduced on the display 62, thereby relieving boredom and reduced concentration due to a high sense of immersion. can do it

4 is a diagram for explaining moving and temporarily stopping a screen of sensory content in the sensory content reproduction control apparatus according to an embodiment of the present invention.

The sensory content reproduction control apparatus according to an embodiment of the present invention determines whether the user is currently moving or pauses based on a motion signal (pressure signal or angle signal) from the motion signal transmitter 10, and accordingly The screen of the sensory content on the display 62 may be moved forward or paused. This will be described in more detail below.

Since the multiplayer mode is performed in the same way as the sensory content screen moving method in the single-person mode, it is assumed that the single-person mode is selected and described below.

First, the user's motion signal will include signals S1 and S2 by the pressure sensor 12a or the angle sensor 12b. In the case of the pressure sensor 12a, since it senses the respective pressures of the left and right feet, a corresponding signal will be output, and in the case of the angle sensor 12b, the respective angles of the left and right feet are sensed, so a corresponding signal is provided. will print

After the sensory content reproduction control apparatus according to an embodiment of the present invention receives the user's motion signals S1 and S2 from the motion signal transmitter 10 (S20), it goes through a process of determining the signals S1 and S2.

For example, if the received signal S1 and signal S2 are both true (“Yes” in S22 and “Yes” in S24), the sensory content reproduction control apparatus according to the embodiment of the present invention provides the current user It is considered that both the left and right feet of the user are in contact with the floor, and it is determined that the current user is paused.

As described above, when it is determined that the current user is paused, the sensory content reproduction control apparatus according to the embodiment of the present invention temporarily stops the image (screen) of the sensory content displayed on the display 62 ( S28 ).

In addition, if the received signal S1 and signal S2 are both false (“No” in S22 and “No” in S26), the sensory content reproduction control apparatus according to the embodiment of the present invention provides the current user's left foot. and the right foot are both off the floor or off the track.

As described above, when it is considered that both the user's left and right feet are away from the floor or deviated from the track, the sensory content reproduction control apparatus according to the embodiment of the present invention controls the image (screen) of the sensory content displayed on the display 62 . Temporarily stop (S28).

Unlike the above example, either the signal S1 is true and the received signal S2 is false (“Yes” in S22 and “No” in S24), or the signal S1 is false ( false) and the received signal S2 is true (“No” in S22 and “Yes” in S26), the sensory content reproduction control apparatus according to the embodiment of the present invention indicates that the current user is moving forward. judge

As such, when it is determined that the current user is moving forward, the sensory content reproduction control apparatus according to the embodiment of the present invention moves the sensory content image (screen) displayed on the display 62 forward (S30).

In the multi-mode, if even one user moves along the track (ie, moves forward), the image (screen) of the sensory content on the display 62 will move forward. In addition, if it is determined that all users have paused on the track, the image (screen) of the sensory content displayed on the display 62 will be paused.

In addition, the above-described sensory content reproduction control method of the present invention can be implemented as computer-readable codes on a computer-readable recording medium. The computer-readable recording medium includes all types of recording devices in which data readable by a computer system is stored. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage device. In addition, the computer-readable recording medium is distributed in a computer system connected through a network, so that the computer-readable code can be stored and executed in a distributed manner. In addition, functional programs, codes, and code segments for implementing the method can be easily inferred by programmers in the art to which the present invention pertains.

As described above, the best embodiment has been disclosed in the drawings and the specification. Although specific terms are used herein, they are used only for the purpose of describing the present invention, and are not used to limit the meaning or scope of the present invention described in the claims. Therefore, it will be understood by those skilled in the art that various modifications and equivalent other embodiments are possible therefrom. Accordingly, the true technical protection scope of the present invention should be defined by the technical spirit of the appended claims.

10: motion signal transmitter 12: sensor unit
14: transmitter 20: input unit
30: receiving unit 40: realistic content storage unit
50: playback unit 60: output unit
62: display 64: speaker
70: control unit

Claims (20)

a receiver for receiving a motion signal corresponding to whether the user moves or not, transmitted from the outside;
a playback unit for playing the sensory content and outputting an image of the corresponding sensory content on a display; and
A control unit for adjusting a reproduction speed of the image of the sensory content on a display based on the user's motion signal received by the receiving unit;
Realistic content playback control device. The method of claim 1,
The control unit is
When the user's movement signal is received, a screen of sensory content is displayed on the display, the corresponding user's movement speed is calculated based on the received user's movement signal, and the display is displayed on the basis of the calculated user's movement speed. Adjusting the playback speed of immersive content video,
Realistic content playback control device. The method of claim 1,
The user's movement signal includes a first signal for the user's left foot and a second signal for the user's right foot,
If the first signal is true meaning that the first signal is greater than or equal to the preset reference and false meaning that the second signal is less than the preset reference, the controller determines that the current user is moving forward and is output to the display Moving the video of realistic content forward,
Realistic content playback control device. 4. The method of claim 3,
If the first signal is false and the second signal is true, the controller determines that the current user is moving forward and moves the image of the sensory content output on the display forward.
Realistic content playback control device. 4. The method of claim 3,
When both the first signal and the second signal are true or false, the controller determines that the user is currently paused and temporarily stops the image of the sensory content output to the display,
Realistic content playback control device. The method of claim 1,
An input unit for setting a single-person mode and a multi-person mode; further comprising,
Realistic content playback control device. 7. The method of claim 6,
When the 1 person mode is set,
The control unit calculates the current movement speed of the user in real time based on the time value of the current movement signal and the time value of the immediately preceding movement signal, and displays the display based on the current movement speed of the user calculated in real time Real-time control of the video playback speed of immersive content
Realistic content playback control device. 7. The method of claim 6,
When the 1 person mode is set,
The control unit calculates a plurality of movement speeds for each time of the user based on the time values of the movement signals input a plurality of times, calculates an average value thereof as the final movement speed for the user, and calculates the calculated corresponding Adjusting the playback speed of the image of the sensory content of the display based on the user's final movement speed,
Realistic content playback control device. 7. The method of claim 6,
When the Dyne mode is set,
The control unit calculates the current movement speed of each user in real time based on the time value of each user's current movement signal and the time value of the immediately preceding movement signal, and based on this, the average value of the current movement speeds of all users , extracting the maximum and minimum speeds from among the current movement speeds of all users, and finding any one of the average values and the average values of the remaining movement speeds excluding the maximum and minimum speeds among the current movement speeds of all users, based on the obtained average value to adjust the current playback speed of the image of the sensory content of the display in real time,
Realistic content playback control device. 7. The method of claim 6,
When the Dyne mode is set,
The control unit calculates the current movement speed of each user in real time based on the time value of each user's current movement signal and the time value of the immediately preceding movement signal, and is the smallest among the calculated current movement speeds of all users. extracting the speed of and adjusting the current playback speed of the image of the sensory content of the display in real time based on the extracted minimum movement speed,
Realistic content playback control device. 7. The method of claim 6,
When the Dyne mode is set,
The control unit calculates an average movement speed for each user by calculating a plurality of hourly movement speeds for each user based on the time value of each user's movement signal input a plurality of times, and based on this, calculates the average movement speed for each user. The average value and the maximum value and the minimum value are extracted from the average movement speed for each user, and any one of the average values excluding the maximum value and the minimum value among the average value and the average movement speed for all users is obtained, and the display is based on the obtained average value to adjust the video playback speed of immersive content
Realistic content playback control device. 7. The method of claim 6,
When the Dyne mode is set,
The control unit calculates an average movement speed for each user by calculating a plurality of hourly movement speeds for each user based on the time value of each user's movement signal input a plurality of times, and based on this, calculates the average movement speeds for all users extracting an average motion speed having the smallest value among them, and adjusting the playback speed of the image of the sensory content of the display based on the extracted average motion speed having the lowest value,
Realistic content playback control device. The method of claim 1,
The control unit is
Based on the movement signal from the outside, the foot pressure of the user's feet is identified, and a method to solve problems that may occur due to the difference in the foot pressure of the user's feet is suggested.
Realistic content playback control device. The method of claim 1,
The control unit is
Detects the user's gait based on a movement signal from the outside and outputs corresponding gait correction information.
Realistic content playback control device. A sensory content reproduction control method performed by a sensory content reproduction control apparatus, comprising:
receiving a motion signal corresponding to whether a user moves or not, transmitted from the outside;
reproducing the sensory content and outputting an image of the corresponding sensory content to a display; and
adjusting a playback speed of the image of the sensory content on a display based on the received user's motion signal;
A method for controlling the reproduction of realistic content. a motion signal transmitter for transmitting a motion signal corresponding to whether the user is moving;
a receiver configured to receive a user's motion signal from the motion signal transmitter;
a playback unit for playing the sensory content and outputting an image of the corresponding sensory content on a display; and
A control unit for adjusting a reproduction speed of the image of the sensory content on a display based on the user's motion signal received by the receiving unit;
Realistic content playback control system. 17. The method of claim 16,
The motion signal transmitter,
a sensor unit for sensing a user's movement; and
Including; a transmitter for wirelessly outputting the motion signal of the user sensed by the sensor unit
Realistic content playback control system. 18. The method of claim 17,
The sensor unit,
Containing at least one of a pressure sensor for respectively sensing the pressure of the left foot and the right foot according to whether the user moves, and an angle sensor for respectively sensing the angle of the left foot and the right foot according to whether the user moves,
Realistic content playback control system. 17. The method of claim 16,
The control unit is
Based on the motion signal from the motion signal transmitter, the foot pressure of the user's feet is identified, and a method for solving a problem that may occur due to the difference in the foot pressure of the user's feet is suggested.
Realistic content playback control system. 17. The method of claim 16,
The control unit is
detecting the gait of the user based on the movement signal from the movement signal transmitter and outputting gait correction information corresponding thereto;
Realistic content playback control system.

Images