KR101909791B1 - Data processing apparatus and method - Google Patents

Abstract

There is provided a user terminal for receiving low data from a paired walking aid and providing a screen including a rendered graphic object. Wherein the user terminal comprises: a calculation unit for calculating at least one of a pressure movement and a pressure distribution based on a plurality of sensing positions from the row data, when receiving raw data including positional pressure information regarding a user; And an image processing unit for rendering and outputting a graphic object corresponding to the pressure distribution.

Description

DATA PROCESSING APPARATUS AND METHOD BACKGROUND OF THE INVENTION 1. Field of the Invention [0001]

The present invention relates to a data processing apparatus and method, and more particularly to a data processing apparatus and method for outputting a graphic object corresponding to walking information of a user or supporting a paired terminal to implement an interaction with a user.

Augmented Reality (AR) is a technology that renders a virtual image on a realistic image or background and displays it as a single image. Augmented reality technologies provide users with various functions based on their combination with wearable devices that are widely used today in multiple domains.

Illustratively, in an e-book providing an augmented reality, a 3D image or an image corresponding to an ongoing story is provided to the user, and the user can enjoy a higher immersion feeling. In addition, the game that catches and trains monsters existing in a specific position through a combination with GPS (Global Positioning System) information and plays against other users has attracted worldwide attention.

KR 10-2016-0118859 KR 10-1546654

According to one aspect, there is provided a walking assistance device for transmitting measured pressure values and motion information to a paired user terminal. The walking assist device includes a first sensing unit disposed at a plurality of positions corresponding to respective portions of both feet of the user and acquiring first row data relating to the pressure of the user's foot, A second sensing unit for acquiring second row data related to the first row data and at least one of the first row data and the second row data to the paired user terminal to transmit an interaction with the program to which the user terminal is related And a communication unit for controlling the communication unit to perform the communication.

According to an embodiment, the first sensing unit may be implemented by a plurality of pressure sensors, and the second sensing unit may be implemented by a plurality of inertial sensors.

According to another embodiment, the walking assist device further includes a processor for selecting one of the feet that determines the operation mode of both feet based on the amount of change in the pressure of the user's part using the first row data can do.

According to yet another embodiment, the processor generates an identification value for any one foot selected to determine the operation mode, and the communication unit can transmit the identification value to the paired user terminal.

According to yet another embodiment, the processor calculates movement corresponding to the stride and stance of the user using the second row data, and the communication unit transmits an identification value indicating the movement to the paired user terminal .

According to another aspect there is provided a user terminal for receiving raw data from a paired walking aids and providing a screen containing rendered graphic objects. Wherein the user terminal comprises: a calculation unit for calculating at least one of a pressure movement and a pressure distribution based on a plurality of sensing positions from the row data, when receiving raw data including positional pressure information regarding a user; And an image processing unit for rendering and outputting a graphic object corresponding to the pressure distribution.

According to one embodiment, the user terminal is paired with a walking aid device including a plurality of pressure sensors at different positions, and receives the pressure of each part and the amount of pressure of each part of the user as the raw data And a communication unit. More specifically, the calculation unit may select any one of the feet for determining the operation mode of both feet based on the amount of change in the pressure of each site.

According to another embodiment, the calculation unit may select any one of the feet that exceeds the threshold value of the both of the feet in advance, depending on whether or not the sum of the amounts of change in pressure of the respective regions is equal to or greater than a predetermined threshold value.

According to another embodiment, when the right foot of the user is selected to determine an operation mode, the image processing unit may render and output a first graphic object for a first operation mode corresponding to the right foot, When the foot is selected to determine the operation mode, the image processing unit may render and output the second graphic object for the second operation mode corresponding to the left foot.

According to another embodiment, the image processing unit generates a first graphic object in which a vehicle in augmented reality-based screen moves when the first operation mode is selected, and when the second operation mode is selected The second graphic object in which the vehicle body is stopped can be generated.

According to another embodiment of the present invention, the communication unit is paired with the walking aid device including the inertial sensor disposed at each of the two feet of the user, and receives the stride and the stance about each of the two feet of the user as the raw data can do. More specifically, the image processing unit may generate the graphic object in which the movement corresponding to the stride and the stance related to each foot is reflected.

According to another aspect, a method of providing an augmented reality is provided. Wherein the augmented reality providing method comprises receiving raw data relating to a user from a paired walking aids device, calculating at least one of a pressure movement and a pressure distribution with respect to the user from the raw data, Generating a graphic object corresponding to the calculated result, and outputting an augmented reality (AR) -based screen generated using the generated graphic object to the user .

According to another aspect of the present invention, there is provided a user terminal for receiving low data from a paired walking aiding device and implementing the interaction on a running program corresponding to input raw data. Wherein the user terminal comprises: a calculation unit for calculating at least one of a pressure movement and a pressure distribution based on a plurality of sensing positions from the row data, when receiving raw data including positional pressure information regarding a user; And a data processor for generating a command signal corresponding to the pressure distribution and performing an interaction with the associated program.

According to an embodiment, the data processing unit may determine any one of the interactions corresponding to the command signal generated based on the plurality of state values stored in advance in the program.

According to another embodiment, the plurality of status values are each associated with a predefined motion of a plurality of graphic objects output to the user in association with the program.

1 is a block diagram of a walking assistance apparatus according to an embodiment.
Figs. 2A to 2D are exemplary diagrams of raw data obtained by the walking aid. Fig.
Fig. 3 is an example of another row data obtained by the walking aid; Fig.
4A is a block diagram of a user terminal according to one embodiment.
4B is a block diagram of a user terminal according to another embodiment.
5 is a flowchart of an augmented reality providing method according to an embodiment.
6A and 6B are exemplary views of an augmented reality provided to a user according to an embodiment.

Specific structural or functional descriptions of embodiments are set forth for illustration purposes only and may be embodied with various changes and modifications. Accordingly, the embodiments are not intended to be limited to the specific forms disclosed, and the scope of the disclosure includes changes, equivalents, or alternatives included in the technical idea.

The terms first or second, etc. may be used to describe various elements, but such terms should be interpreted solely for the purpose of distinguishing one element from another. For example, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

It is to be understood that when an element is referred to as being "connected" to another element, it may be directly connected or connected to the other element, although other elements may be present in between.

The singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, the terms "comprises ", or" having ", and the like, are used to specify one or more of the features, numbers, steps, operations, elements, But do not preclude the presence or addition of steps, operations, elements, parts, or combinations thereof.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the meaning of the context in the relevant art and, unless explicitly defined herein, are to be interpreted as ideal or overly formal Do not.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In the following description of the present invention with reference to the accompanying drawings, the same components are denoted by the same reference numerals regardless of the reference numerals, and a duplicate description thereof will be omitted.

1 is a block diagram of a walking assistance apparatus according to an embodiment. Referring to FIG. 1, the walking assistance apparatus 100 may include a first sensing unit 110, a second sensing unit 120, and a communication unit 130. The walking aiding device 100 can analyze the walking information of the user. In one embodiment, the walking aiding device 100 may be implemented as a wearable device attached to a user. For example, the walking aid device 100 may be implemented in the form of an insole, an insole, or the like, which is inserted into smart shoes or shoes to be worn by a user.

The walking aiding apparatus 100 can measure various types of raw data related to the user's walking from the first sensing unit 110 and the second sensing unit 120. [ In one embodiment, the first sensing unit 110 may be implemented with at least one pressure sensor. More specifically, the first sensing unit 110 may be disposed at a plurality of positions corresponding to respective portions of the user's feet. Illustratively, the first sensing unit 110 may be implemented with a plurality of pressure sensors disposed on each of the toe of the foot, the right side of the sole, the left side of the sole, and the heel of the foot. The description of the pressure sensor included in the first sensing unit 110 is merely an exemplary description for facilitating understanding of the invention and should not be construed as limiting or limiting the scope of other embodiments. For example, the first sensing unit 110 may be implemented by arranging a plurality of pressure sensors in a lattice shape based on a predetermined interval. The first sensing unit 110 may acquire first raw data related to pressure movement and pressure distribution with respect to the user.

The second sensing unit 120 may acquire the second row data related to the stride and the stance corresponding to both feet. The second sensing unit 120 may be implemented as at least one of an acceleration sensor, a geomagnetic sensor, and a gyro sensor. The second sensing unit 120 may analyze the movement of the user's walking and generate second row data related to the user's stride and stance.

The communication unit 130 may transmit at least one of the acquired first row data and second row data to the paired user terminal. The user terminal may provide the augmented reality-based screen for the user using at least one of the received first row data and the second row data. The communication unit 130 may transmit at least one of the first row data and the second row data obtained using the communication interface to the user terminal. The communication interface may be a wireless interface such as a wireless LAN (WLAN), a wireless fidelity (WiFi) direct, a DLNA (Digital Living Network Alliance), a Wibro (Wireless broadband), a Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) May include an Internet interface and a short range communication interface such as Bluetooth (TM), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, NFC . In addition, the communication interface may represent any interface (e.g., a wired interface) capable of communicating with the outside.

Illustratively, the walking aiding device 100 may be pre-paired with any one of the specific user terminals via the communication unit 130. Accordingly, it is possible to cause the graphical object related to the real-time raw data measured by the walking aiding apparatus 100 to be outputted to the user terminal. The graphic object provided in the present embodiment may be implemented through various graphic rendering techniques and output to the user terminal. For example, the user terminal may provide graphical objects constituting a virtual reality (VR) to the user using the real-time raw data measured by the walking assistant 100, thereby enhancing the sense of reality felt by the user. In addition, graphical objects constituting Augmented Reality (AR) may be provided to a user by using the raw data measured by the walking aiding device 100, and the immersion feeling of various applications combined with the augmented reality may be increased today . The foregoing examples of graphical rendering techniques are illustrative only for purposes of understanding and should not be construed as limiting or limiting the scope of other embodiments.

2A to 2D are exemplary diagrams of row data of an embodiment obtained by a walking aid. Referring to Figure 2a, an embodiment of the raw data obtained by the walking aid is shown. The walking aid may generate a centering line for the user based on an average of the pressure values measured at both feet of the user. More specifically, the walking assist device can generate the center moving line in such a manner that the average points of the pressure values of both feet of the user are continuously marked.

Referring to FIG. 2B, left and right up and down balance maps based on pressure values measured from both feet are shown as raw data acquired by the walking aid. The walking aiding device can calculate the distribution of the center of gravity associated with the user's walking as raw data of the form shown in FIG. 2B. Referring to FIG. 2C, accumulated data of the moving line regarding the user's walking as row data obtained by the walking aiding device is shown.

Referring to FIG. 2D, the change in pressure value with time of each of the plurality of pressure sensors 210, 220, 230, 240, 250, 260 is shown as row data obtained by the walking aid. The walking aid can continuously calculate the change in the pressure value measured by each of the pressure sensors at a predetermined time interval.

Fig. 3 is an example of row data of another embodiment obtained by the walking aid; Fig. Referring to FIG. 3, the variation data of the swing width and the stance with respect to the right foot are shown as row data obtained by the walking aid. In the present embodiment, the swing width and the stance change amount with respect to the right foot are shown, but it is obvious to a person skilled in the art that the left foot can be applied as it is.

The walking aid can acquire motion information of a user from a sensing unit implemented by an acceleration sensor, a geomagnetic sensor, a gyro sensor, and a piezoelectric sensor. The motion information may include a parameter for implementing augmented reality-based graphic object and an identification value for the parameter. Specific examples of the parameters include, for example, an angle of both feet based on a direction in which the user moves, a pressure of both feet, a landing point of both feet in walking of the user, a center of gravity of both feet, a stance of both feet, And the number of steps of walking. In addition, the walking aiding device may acquire various motion information of the user as raw data. The walking aid will be able to acquire various motion information such as running or jumping of the user as well as walking information via the inertial sensor.

4A is a block diagram of a user terminal according to one embodiment. Referring to FIG. 4A, the user terminal 410 may include a calculation unit 411 and an image processing unit 412. When the user terminal 410 receives the row data including the positional pressure information regarding the user, the calculation unit 411 can calculate at least one of the pressure movement and the pressure distribution based on the plurality of sensing positions from the row data have. The calculation unit 411 can select any one of the feet based on the change amount of the pressure of each of the parts. The selected foot may be used to control the motion of the graphic object rendered by the image processing unit 412 and determine the operation mode.

The calculation unit 411 can select any one of the feet that exceeds the threshold of both feet first, depending on whether or not the sum of the amount of change in pressure of each site becomes equal to or greater than a predetermined threshold value. There may be a case where, for example, a user wearing the walking aid pushes the ground surface through one of the feet. In this case, the user can adjust the graphical object of the user terminal in such a manner that the user presses the ground surface through either the right foot or the left foot. Illustratively, the calculation unit 411 can use any of the obtained raw data to select any one of the feet whose average of the change amounts in the both directions is 10N or more.

The image processing unit 412 may render and output a graphic object corresponding to the pressure movement and the pressure distribution calculated by the calculation unit 411. [ The calculation unit 411 can select any one of the feet as in the embodiment described above. When the right foot of the user is selected to determine the operation mode, the image processing unit 412 may render and output the first graphic object for the first operation mode corresponding to the right foot. Similarly, when the left foot of the user is selected to determine the operation mode, the image processing unit 412 may render and output the second graphic object for the second operation mode corresponding to the left foot of the user.

The user terminal 410 may be a first operation mode corresponding to the right foot and may previously match the operation of the accelerator pedal of the graphic object output to the screen. In addition, the user terminal 410 may be a second operation mode corresponding to the left foot, and may match the operation of the brake pedal of the graphic object output on the screen in advance.

Illustratively, there may be a case where the right foot is selected by the calculation unit 411. The calculation unit 411 can calculate the sum of the pressure change amounts corresponding to the selected right foot. The image processing unit 412 may render and output the first graphic object corresponding to the sum of the pressure change amounts calculated by the calculation unit 411. [ In one embodiment, the first graphic object may represent an image or an image in which a vehicle shown in augmented reality-based screen moves forward.

Likewise, there may be a case where the left foot is selected by the calculation unit 411. The calculation unit 411 can calculate the sum of the pressure change amounts corresponding to the selected left foot. The image processing unit 412 may render and output a second graphic object corresponding to the sum of the pressure change amounts calculated by the calculation unit 411. [ In one embodiment, the second graphical object may represent an image or an image that causes the moving speed of the vehicle body displayed on the augmented reality-based screen to gradually decrease.

4B is a block diagram of a user terminal according to another embodiment. Referring to FIG. 4B, the user terminal 420 may include a calculation unit 421 and a data processing unit 422. As for the calculation unit 421, the description regarding the calculation unit 411 described above with reference to FIG. 4A may be applied as it is, and a duplicated description will be omitted.

The data processing unit 422 may generate a command signal corresponding to the row data input to the user terminal 420 and may perform an interaction with the associated program. Illustratively, the raw data may include at least one of pressure movement data based on a plurality of sensing positions, pressure distribution data, acceleration data relating to a user's motion, velocity data, and movement distance data.

More specifically, the data processing unit 422 can generate a command signal based on a plurality of state values stored in advance in the program. As an example, there may be a case where the program is implemented in the form of a soccer game program executed in the user terminal 420. In this case, the program may include a first state value in which the goalkeeper and the striker face each other in a one-to-one manner, a second state value to be defeated by the defender, and a third state value Predefined, and stored in the user terminal 420.

The data processing unit 422 may calculate the user's intention corresponding to each of the plurality of status values through the row data and generate a corresponding command signal. In one embodiment, if the movement speed of the user exceeds a predetermined first threshold speed, the data processing unit 422 provides a one-to-one chance with the goalkeeper to the user within the soccer game program executed by the user terminal 420 It is possible to generate the first command signal relating to the first state value. In another embodiment, when the moving speed of the user is measured to be less than the predetermined second threshold speed, the data processing unit 422 determines that the user's attack right passes to the defender in the soccer game program executed in the user terminal 420 It is possible to generate the second command signal relating to the second state value. In another embodiment, the data processing unit 422 may provide a free kick opportunity to the user in the soccer game program executed by the user terminal 420, when the pressure change amount for one foot of the user is equal to or greater than the threshold value To the third state value that gives the third state value.

The data processing unit 422 can determine any one of the interactions corresponding to the command signal generated based on the plurality of state values stored in advance in the program. Interaction can be implemented not only in the execution, termination, and termination of a program, but also in the movement of graphics objects output through the program, state changes, and the like. Illustratively, the plurality of status values may each be associated with a predefined motion of a plurality of graphical objects associated with the program and output to the user.

The description of the soccer game program described above is merely an exemplary description for facilitating understanding of the idea of the invention, and should not be construed as limiting the scope of other embodiments. The user terminal 420 according to the present exemplary embodiment may perform operations such as operation, control, command, and control for various programs or applications executed in the user terminal 420, ). ≪ / RTI > For example, the program or the application may be implemented as a golf game program, a basketball game program, or the like, and may be implemented by various programs in various fields such as a music playing program, a musical instrument playing program, and a healthcare program, There will be. Accordingly, the user can perform the interaction with the application or the program executed in the user terminal 420 based on the Smart Insole installed in the user, thereby providing a higher realism to the user.

5 is a flowchart of an augmented reality providing method according to an embodiment. Referring to Figure 5, an augmented reality providing method 500 includes obtaining 510 (step 510) user-related raw data from a paired walking aids device, generating at least one of a pressure movement and a pressure distribution for the user from the raw data A step 530 of generating a graphic object corresponding to the calculated result, and a step 540 of outputting the augmented reality-based screen generated using the generated graphic object to the user .

In step 510, the user terminal may receive raw data regarding the user from the paired walking aids. By way of example, the raw data may represent a parameter relating to the user's walking. Wherein the parameter includes at least one of an angle of two feet based on a direction in which the user moves, a pressure of both feet, a landing point of both feet in walking of the user, a center of gravity of both feet, a step width of both feet, . ≪ / RTI >

In step 520, the user terminal may calculate at least one of the pressure transfer and pressure distribution for the user from the raw data. Also, the user terminal may calculate at least one of the moving distance, the moving direction, and the moving angle of the user's foot from the raw data.

In step 530, the user terminal may generate a graphical object corresponding to the calculated result. In one embodiment, the user terminal may generate a first graphical object whose shape, size, and shape are adjusted to correspond to a user's pressure movement and pressure distribution. The first graphic object may be a moving object, and may represent various moving means, such as a car, a plane, and a drone, which are controlled by a user wirelessly. In addition, the user terminal may generate graphical objects in which the moving object moves to correspond to pressure and pressure distributions controlled by the user.

In another embodiment, the user terminal may generate a second graphics object whose motion is adjusted to correspond to the moving distance, the moving direction, and the moving angle of the user's two feet. Illustratively, the second graphical object may represent various types of exercise devices used in a sporting event. In one embodiment, the second graphical object may represent a bicycle moving within augmented reality-based screen according to the movement of the user's pedal. In another embodiment, the second graphical object may represent a ball moving within an augmented reality-based screen to correspond to a movement distance, a movement speed, a movement angle, and a movement direction of the user's foot.

In yet another embodiment, the user terminal may generate a third graphic object whose playing notes are adjusted to correspond to a user's pressure, pressure, two-way movement distance, movement direction, and movement angle. Illustratively, the third graphic object may be implemented in augmented reality-based screen as various types of musical instruments such as a piano, drum, and a base that can be played based on the pressure and motion of both feet of the user.

In step 540, the user terminal may output the augmented reality-based screen generated using the generated graphic object to the user. The user terminal may overlay the generated graphic object to generate an augmented reality image. In addition, the user terminal can convert the state of the overlaid graphic object according to the movement related to the user's walking. The status may be an identification value such as a size, a shape, a color, a motion, etc. of the graphic object, and may indicate a parameter that defines the status of the graphic object. The augmented reality technology that combines virtual graphic objects with actual images or images is straightforward to the experts in the technical field, so a detailed description will be omitted.

The user can interact with the 3D graphic object through his or her physical movement as well as receive the augmented reality based service using the walking aid and the user terminal according to the present embodiment. Through the graphical objects output from the augmented reality environment, it is possible to experience an experience such as walking on a plane or driving on an airplane, which is difficult to experience in reality, and also can expect the effect of performing a ball game such as football.

6A and 6B are exemplary views of an augmented reality provided to a user according to an embodiment. Referring to FIG. 6A, a tree 611 and a road 612 present in a real world are shown. In addition, a tree 621 and a road 622 output from augmented reality-based display screen and a vehicle instrument panel 623 as a virtual graphic object are shown. The user can interact with the vehicle including the vehicle dashboard 623 output from the user terminal using the walking aid device described in this embodiment.

In one embodiment, the user can advance the automobile output from the augmented reality-based display screen by applying a pressure equal to or greater than a predetermined threshold value to his or her right foot. The user terminal may perform a zoom-in function of the image acquisition device in response to a user's input regarding the advancement of the automobile, thereby outputting a real environment in which a distant object approaches.

In another embodiment, the user may reduce the moving speed of the automobile output from the augmented reality-based display screen by applying a pressure equal to or greater than a predetermined threshold value to the left foot of the user. The user terminal can provide the user with the effect of stopping the car in the augmented reality by executing the zoom-out function of the image acquisition device in response to the input of the user regarding the advance of the car.

6B, a soccer goalpost 631 present in the real environment is shown. Also shown are a soccer goalpost 641 output from the augmented reality-based display screen and a soccer ball 642 which is a virtual graphic object. Similarly, the user can interact with the soccer ball 642 output from the user terminal using the walking aid device described in this embodiment.

In one embodiment, the user wears a walking aid to measure walking information, and can shoot a soccer ball 642, which is a virtual graphic object, in a manner that performs appropriate movement. The user terminal may be rendered to move in the soccer ball 642 at a speed and direction corresponding to the movement of the user to provide the effect of the user practicing the soccer kick through the virtual graphic object.

The embodiments described above may be implemented in hardware components, software components, and / or a combination of hardware components and software components. For example, the devices, methods, and components described in the embodiments may be implemented within a computer system, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, such as an array, a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device , Or may be permanently or temporarily embodied in a transmitted signal wave. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer readable medium may include program instructions, data files, data structures, and the like, alone or in combination. Program instructions to be recorded on a computer-readable medium may be those specially designed and constructed for an embodiment or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Although the embodiments have been described with reference to the drawings, various technical modifications and variations may be applied to those skilled in the art. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Claims (17)

delete delete delete delete delete A calculation unit for calculating at least one of a pressure movement and a pressure distribution based on the plurality of sensing positions from the row data when the row data including the pressure information per position for the user is input;
An image processor for rendering and outputting a graphic object corresponding to the calculated pressure movement and pressure distribution; And
A communication unit which is paired with a walking aid device including a plurality of pressure sensors at different positions and receives as a raw data the pressure of each part of the user's foot and the amount of change of pressure of each part,
Lt; / RTI >
Wherein the calculation unit selects any one of the feet for determining the operation mode of both feet based on the change amount of the pressure for each site,
When the right foot of the user is selected to determine the operation mode, the image processing unit renders and outputs the first graphic object for the first operation mode corresponding to the right foot,
When the left foot of the user is selected to determine an operation mode, the image processing unit renders a second graphic object for a second operation mode corresponding to the left foot and outputs the second graphic object.
delete delete The method according to claim 6,
Wherein the calculation unit selects any one of the feet that exceeds the threshold value in the first step in accordance with whether or not the sum of the amounts of change in pressure of the respective regions is equal to or greater than a predetermined threshold value.
delete The method according to claim 6,
Wherein the image processing unit generates a first graphic object in which a vehicle in augmented reality-based screen moves when the first operation mode is selected, and a second graphic object in which a vehicle is stopped when the second operation mode is selected, And generates a graphical object.
The method according to claim 6,
Wherein the communication unit is paired with the walking aid device including an inertial sensor disposed on each of the two feet of the user and receives the pace and stance of each of the feet of the user as the row data.
13. The method of claim 12,
Wherein the image processing unit generates the graphic object reflecting a movement corresponding to a stance and a stance with respect to each of the two feet.
delete delete delete delete

Images