KR102148165B1 - page turner operated acoording to movement of eyeball or voice and method at the same - Google Patents

Abstract

The present invention relates to an automatic bookshelf turning device that operates according to the movement or voice of the eyeball. To this end, a mechanism unit for inserting a rod into the bookshelf and flipping the bookshelf in the state where the book is mounted; A mechanism driving unit for driving the mechanism unit; A switch for selecting eye movement or voice; EOG sensor module for sensing the movement of the eyeball; An audio input device for receiving voice input; And when the movement of the eyeball is selected through the switch, a sensing value from the EOG sensor module is input to generate an event state value indicating the state of the eyeball, and the instrument driving unit is controlled to correspond to the event state value, When a voice is selected through the switch and the voice is selected through the switch, a voice input through the audio input device is recognized, and the instrument driver is controlled to correspond to the recognized voice, and the instrument part is driven to turn the bookshelf. It provides an automatic bookshelf turning device including;

Description

Automatic bookshelf turning device and method that operates according to eye movement or voice {page turner operated acoording to movement of eyeball or voice and method at the same}

The present invention relates to an automatic book turning device, and more particularly, a user who is difficult to turn over the bookshelf due to a physical disability or temporary motor function difficulty can turn the bookshelf with eye movement or voice, so that a user with a physical discomfort can freely read. It relates to an automatic bookshelf turning device and method that operates according to the movement or voice of the eyeball to enable enjoyment.

1 shows the status of registered disabled persons by disability type in 2017 posted on the national statistics portal. Referring to FIG. 1, the number of people with physical disabilities is about 1.25 million, which is considerably larger than the total population of Korea. These physical disorders are severely restricted in movement and movement of the body due to diseases, damage, function and development of the skeletal, muscular, and nervous systems. This is due to a series of motor impairments, and some people with physical disabilities may have only mild walking difficulties, or may have difficulties in all areas related to motor functions such as speaking, eating, and walking.

As described above, the physical disability causes difficulty in motor function, so it is difficult to flip the bookshelf for reading, so there is a hassle that requires the help of others.

Accordingly, in the related art, products capable of turning over a bookshelf have been developed and commercialized for users who have difficulty turning over the bookshelf due to a physical disability or temporary difficulty in motor function. Such reading aids include Page Turner Readable and Book Time.

The reading aid products such as page turner readable and book time are products that allow the bookshelf to be turned over using a remote control and various switches without the help of a guardian, but they are bulky and heavy and have difficulty in installation. In addition, it was difficult to be widely commercialized because it was an expensive product. In addition, as the above-described reading aid product employs a push button as an input device, the user in a physically handicapped state still has inherent inconvenience in use.

In addition, there is Utility Model Registration Publication No. 201999024144, which has been disclosed as a utility model registration at the Korean Intellectual Property Office, under the name of an electric bookshelf flipping device for handicapped persons, which has one end inserted into the bracket and the other end has a groove and a fixed part in the center. A protruding fixed plate, a semi-elliptical book stand located on both sides of the fixed plate, a first electric motor installed under one side of the desk and equipped with a rotating rod, a moving rod fixed to the rotating rod of the first electric motor, Tongs attached to the end of the moving rod, a contact member fixed to the movable rod, a circular guide ring to support the lower center of the movable rod, and a part of this guide ring is extended downwardly and fixed to the fixing member, A rotating plate configured to rotate the fixing member, a left/right limit switch configured to limit the rotation range of the rotating plate, a second electric motor coupled with the rotating plate to provide rotational force, and controlling the first and second electric motors Disclosed is an electric bookshelf flipping device for the handicapped person comprising a controller and a foot switch for generating an electrical signal to the controller.

In addition, there is Patent Publication No. 1020020079231 issued to the Korean Intellectual Property Office under the name of the bookshelf turning device, which is installed above and/or below the book stand on which books or sheet music can be placed, and inside the right side as a friction roller. A bookshelf lifting device that can bulge out the bookshelf side, a bookcase hanging that can hang a bookshelf that has been bulging out or turned over, two central arms that hang and rotate the bookshelf with fingers, and drive and drive for the above mechanical components After installing components such as a control device that can properly control the device, driving the bookshelf popping device to make the bookshelf pop, and then hanging the bookshelf on the popped bookshelf while waiting for the user’s command to turn the bookshelf while the finger is hanging , When the command to turn over the bookshelf is input, the center arm on the side corresponding to the command is rotated to turn over the bookshelf that was hanging, and the next page is opened again, and the user is controlled by hanging the bookshelf and waiting for the next command. Discloses a technology that allows books to be passed to the end without the need to prepare.

In addition, there is Patent Publication No. 10-2015-0026152, which has been disclosed to the Korean Intellectual Property Office under the name of a music stand capable of turning pages automatically, which includes a book stand integrally equipped with a support piece having elasticity in the right front part; A roller unit installed on the right side of the book stand to push the bookcase to be turned toward the center so that the center of the bookcase is bent to form a space of a predetermined size between the bookcase to be turned over and the next bookcase; A turning bar installed in the lower portion of the space formed by the roller unit to move up/down; A transfer means for reciprocating the turning bar left/right; A fixing bar for fixing the left side of the book placed on the book stand; A fixed bar driving means for moving the fixed bar to fix the book when the bookshelf is turned without interfering with the movement of the bookshelf when the fixed bar is turned over; A switch unit allowing a user to select various operation modes for turning over the bookshelf; The operation of the devices is controlled based on a signal output from the switch unit, but when a bookshelf turn signal is input from the switch unit, the roller unit rotates a predetermined number of times so that a space of a predetermined size is formed at the center of the bookcase to be turned over, and the After inserting the transfer bar into the space, drive the transfer means to move the transfer bar to the left while moving the fixed bar from the top of the book to flip the bookshelf. Disclosed is a technology composed of a control unit that lets you.

As such, conventional reading aid products are configured to be controlled through switches or buttons, so there is still a need to develop a technology that enables users who are difficult to turn over the bookshelf due to physical disabilities or temporary difficulty in motor function to conveniently turn over the bookshelf. Became.

Korean Utility Model Registration Publication No. 2019990024144 Korean Patent Publication No. 1020090022441 Korean Patent Publication No. 1020020079231

The present invention allows a user who is difficult to turn over the bookshelf due to a physical disability or temporary difficulty in motor function to turn over the bookshelf with eye movement or voice, so that even a user with a physical discomfort can freely enjoy reading according to the movement or voice of the eyeball. It is an object of the present invention to provide an automatic bookshelf turning device that operates.

To this end, according to an embodiment of the present invention, after opening the bookshelf in a state where the book is mounted, a mechanism unit for inserting a rod into the floating bookshelf and turning over; A mechanism driving unit for driving the mechanism unit; EOG sensor module for sensing the movement of the eyeball; A control device for receiving a sensing value from the EOG sensor module, generating an event state value indicating the state of the eyeball, and controlling the instrument driving unit in correspondence with the event state value to drive the instrument unit to turn over the bookshelf; It provides an automatic bookshelf turning device.

According to another embodiment, after the book is mounted in a state where the book is mounted, a mechanism unit for inserting a rod into the raised bookshelf and turning it over; A mechanism driving unit for driving the mechanism unit; A switch for selecting eye movement or voice; EOG sensor module for sensing the movement of the eyeball; An audio input device for receiving voice input; When the movement of the eyeball is selected through the switch, a sensing value from the EOG sensor module is input to generate an event state value indicating the state of the eyeball, and the instrument driving unit is controlled to correspond to the event state value, A control device that drives the bookshelf to turn over the bookshelf, and when a voice is selected through the switch, recognizes the voice input through the audio input device, controls the instrument drive unit to correspond to the recognized voice, and drives the instrument unit to turn the bookshelf It provides an automatic bookshelf turning device including;

In addition, the mechanism unit, a book fixing mechanism device including a flat plate for fixing the back of the book and a lever for fixing the right and left bookshelf of the book; A bookshelf opening device including a wheel that rotates clockwise or counterclockwise while being placed on the right or left bookshelf to float the right or left bookshelf; And a bookshelf turning mechanism device including a rod for pushing the bookshelf floated by the bookshelf floating mechanism device to the left or right.

In addition, the control device, after releasing the lever of the book fixing mechanism device with respect to the bookshelf to be turned over by controlling the mechanism driving unit, in a state in which the bookcase to be turned over is opened through the bookshelf floating mechanism device, the bookshelf It is characterized by flipping the bookshelf by pushing it in the direction you want to flip by inserting a rod into the bookshelf that is floated through the flipping mechanism device.

In addition, the control device, in a state in which the bookshelf is restricted from being restored to its original position by moving the wheel to the bookshelf that has been pushed in the direction to be inserted and flipped over by controlling the mechanism driving unit. It is characterized by pushing the lever of the fixing mechanism device back to the bookshelf to fix the bookshelf.

According to another aspect of the present invention, in the automatic bookshelf turning method, (a) when the movement of the eyeball is selected, a sensing value from a sensor module is input to generate an event state value indicating the state of the eyeball, and the event state Controlling the device driving part to correspond to the value to drive the mechanical part to turn over the bookshelf; And (b) when the voice is selected, recognizing the voice input through the audio input device, and driving the instrument unit to turn the bookshelf by controlling the instrument driving unit corresponding to the recognized voice. It provides an automatic bookshelf turning method that works accordingly.

In addition, in step (a), if the reading value read from the sensor module is different from the last reading value, the reading value is multiplied by a predetermined value and converted into an int form to generate an event state value. It may further include the step of turning over the bookshelf by driving the mechanism unit by controlling the instrument driving unit corresponding to the event state value.

In addition, in step (a), (a-1) reading the sensing value of the sensor module according to the timer interrupt, checking whether the last reading value and the current reading value stored in advance are the same, and the last reading value and the current reading value If the reading values are not the same, the step of changing the change time of the last reading value to the current time may be further included.

In addition, in step (a-1), (a-2) it is checked whether the first time has passed from the last eyeball direction detection time, and if the first time has passed from the last eyeball direction detection time, the last reading value changes It may further include checking whether a second time has passed from the time, and if the second time has passed from the change time of the last reading value, checking whether the last reading value is different from the event state value.

In addition, in step (a-2), (a-3) the event state value is read, and if the read event state value is the'action value to the next page', the last eye detection time is converted to the current time. And, it may further include the step of calling and executing the pass to the next bookshelf function.

In addition, in the step (a-3), (a-4) if the read event state value is the'operation value to the previous page', the last eyeball detection time is converted to the current time, and a function to return to the previous bookshelf It may further include the step of calling and executing.

In addition, in step (a), if the event value indicating the state of the eyeball is less than a predetermined time, turning over the bookshelf is not performed.

The present invention can provide convenience when reading by a user by implementing automatic book turning through eye movement or voice recognition.

In particular, there is an advantage of allowing a user who is difficult to turn over the bookshelf due to a physical disability or temporary difficulty in motor function to turn the bookshelf with an eye movement or voice, so that even a user with a physical discomfort can freely enjoy reading.

1 is a diagram showing the status of registered disabled persons by disability type in 2017.
Figure 2 is an external view of the automatic bookshelf turning device that operates according to the movement or voice of the eye according to a preferred embodiment of the present invention.
3 is a block diagram of an automatic bookshelf turning device that operates according to eye movement or voice according to a preferred embodiment of the present invention.
Figure 4 is a view illustrating a configuration process of a mechanism for automatic bookshelf turning according to a preferred embodiment of the present invention.
5 to 7 are processing procedures of the automatic bookshelf turning device operating according to the movement or voice of the eyeball according to a preferred embodiment of the present invention.
8 is a diagram illustrating an EOG sensing signal according to a preferred embodiment of the present invention.

The present invention allows a user who is difficult to turn over the bookshelf due to a physical disability or temporary difficulty in motor function to turn over the bookshelf with eye movement or voice, so that a user with a physical discomfort can freely enjoy reading.

The configuration and operation of the automatic bookshelf turning device that operates according to the movement or voice of the eye according to the preferred embodiment of the present invention will be described in detail with reference to the drawings.

<Configuration of automatic bookshelf turning device that operates according to eye movement or voice>

2 is a diagram showing the appearance of an automatic bookshelf turning device that operates according to eye movement or voice according to a preferred embodiment of the present invention, and FIG. 3 is a diagram showing the appearance of the eyeball movement or voice according to a preferred embodiment of the present invention. It shows a block diagram of the automatic bookshelf turning device in operation, and Figure 4 shows the construction process of the mechanism unit according to a preferred embodiment of the present invention. Now, the appearance and configuration of the automatic bookshelf turning device will be described with reference to FIGS. 2 to 4.

The bookshelf turning device includes a mechanism unit 100, a control unit 110, a memory unit 112, an instrument driving unit 114, an external device interface unit 116, an EOG sensor module 118, a button unit 120, and a display unit. (128), an audio input device 132, and a power supply device not shown.

The mechanism unit 100 performs a role of stably mounting the book and turning the bookshelf of the mounted book in the left or right direction under the control of the control device 110. The mechanism unit 100 has a book fixing mechanism device 102 including a flat plate for fixing the back of the book and a lever for fixing the right and left bookshelf of the book, and a state mounted on the right or left bookshelf A bookshelf floating mechanism device 104 including a wheel that rotates clockwise or counterclockwise to float the right bookshelf or the left bookshelf, and the bookshelf floated by the bookshelf floating mechanism 104 to the left or right With a bookshelf turning mechanism device 106 including a push rod, and a length adjusting device 108 that is installed between the bookcase turning mechanism device 104 and the bookshelf turning mechanism device 106 to adjust the length according to the size of the book. Is composed.

Here, the book fixing mechanism device 102 is a flat plate supporting the back side of the book by a mechanism driving unit 114 driven under the control of the control device 110 and levers that push the lower portion of the book with a predetermined tension It consists of a book to be fixed in a state sandwiched between the support plate and the levers. The bookshelf floating mechanism 104 pushes up the top of the bookshelf fixed to the book fixing mechanism 102 by a mechanism driving unit 114 that is driven under the control of the control device 110 to lift the bookshelf. Perform the floating operation. The length adjusting device 108 is composed of extension bars that adjust the length between the support plate of the book fixing device 102 and the book shelf turning device 106, so that the length can be adjusted according to the size of the book. The bookshelf turning mechanism 106 is inserted into the bookshelf floated by the bookshelf floating mechanism 104 by a mechanism driving unit 114 that is driven under the control of the control device 110 and moves to the right or left. It is equipped with a bar that goes over the bookshelf.

The control device 110 generally controls each part of the bookshelf turning device, and according to a preferred embodiment of the present invention, the user with a physical discomfort can conveniently be turned over the bookshelf of the mounted book according to the user's eye movement or voice. Make it possible to read.

The memory unit 112 stores various information including a control program of the control device 110, and in particular, according to a preferred embodiment of the present invention, reference data for eye movement determination and voice data for speech recognition, etc. Save it.

The mechanism driving unit 114 is composed of a motor and a gear, etc., and according to the control of the control device 100, the book fixing mechanism device 102, the bookshelf floating mechanism device 104, and the bookshelf turning mechanism device ( 106) to fix the book and allow the bookshelf to be turned over after the bookshelf is opened. The above-described mechanism driver 114 uses a total of 10 servo motors at the same time to perform the operation of turning over the bookshelf, employs an external 9V/1A power supply, and adds a capacitor because a large amount of current is consumed instantaneously when the motor is operating. To increase stability. Also, in the case of a servo motor that fixes the book, a low power of 3V is applied to prevent too much force from being applied to the motor.

The external device interface unit 116 is in charge of an interface between the EOG sensor module 118 and the audio input device 132 and the control device 110 attached to the user's head.

The EOG (electrooculogram) sensor module 118 is attached to the user's head and senses the user's safety latitude, generates a digital sensing value according to it, and provides it to the control device 110.

The audio input device 132 receives a user's voice and provides it to the control device 110.

The button unit 120 is composed of a left/right turn button 122, an eye/voice selection switch 124, and a voice registration button 126, and provides various information input by a user to the control device 110 do. The left/right turn button 122 is a button for instructing to turn the bookshelf in the left or right direction using a push button. The eye/voice selection button 124 is composed of a voice recognition on/open switch and an eye movement on/off switch, and the voice recognition on/off switch is a switch for instructing to turn over the bookshelf by voice recognition. In addition, the eye movement on/off switch is a switch for instructing to turn over the bookshelf by detecting the direction of movement of the eyeball. The voice registration button 126 is a button for commanding a user to register his/her voice and use it for voice recognition by receiving voice information and registering it in the memory unit 112 or removing already registered voice information. .

The display unit 128 is composed of an EOG stabilization display LED 130, and the EOG stabilization display LED 130 displays an EOG stabilization state under control of the control device 110.

<Mechanism configuration and operation>

Now, the configuration and operation of the mechanism of the bookshelf turning device that operates according to the movement of the eyeball or the voice according to the preferred embodiment of the present invention will be described in more detail.

In the present invention, in the case of a function that moves a book to the next or previous chapter by controlling a servo motor, it is initially operated within the timer interrupt service routine of the MSTimer2 library. Here, in the case of sensing or emergency stop while the servo motor is operating, instability such as overlapping or continuous operation may appear, so that the operation of the servo motor is sequentially processed. Inserts or stops what is sensed as an input value in the timer service routine. In addition, after initialization, once it is operated, when it returns to the initial position, the signal is disconnected with the detach() function to remove the standby current. Also, in the case of a servo motor that fixes the book, if the force to press the book is continuously applied, the motor may be overwhelmed, so a low voltage of 3V is applied.

<initial state>

When the power of the bookshelf turning device operating according to the movement of the eyeball or the voice is turned on, the control device 110 drives the device driving unit 114 to the book fixing device 102, the bookshelf floating device 104, the bookshelf The turn over mechanism device 106 is initialized and moves to an initial position to enter an initial preparation state.

<Action to the next page>

And the control device 110, when the next page turn function is called and executed, drives the mechanism driving unit 114 to seat the wheel provided in the bookshelf floating mechanism device 104 on the lower right side of the book and As the book fixing mechanism device 102 is opened (released), the right bookshelf is released.

Thereafter, the control device 110 rotates the wheel of the bookshelf floating mechanism 104 in a forward direction through the mechanism driving unit 114 to open the bookshelf and at the same time rotate the bar provided in the bookshelf turning mechanism 106 in a clockwise direction. Turn over the bookshelf. Thereafter, the control device 110 moves the wheel of the bookshelf floating mechanism 104 to the left bookshelf and presses the flipped bookshelf so that it does not fall back. Thereafter, the control device 110 drives the book fixing device 102 again to fix both bookshelves of the book, and moves the bookcase floating device 104 and the book fixing device 102 to the initial position. To return to the ready state.

<Action to the previous page>

And the control device 110, when the turn to the previous page function is called and executed, drives the mechanism driving unit 114 to seat the wheel provided in the bookshelf floating mechanism device 104 on the lower left side of the book and The book holding mechanism 102 is released (released) and the left bookshelf is released.

Thereafter, the control device 110 rotates the wheel of the bookshelf floating device 104 in the reverse direction through the device driving unit 114 to open the left bookshelf and at the same time watch the rod provided in the bookshelf flipping device 106 Turn it in the opposite direction and turn over the left bookshelf. Thereafter, the control device 110 moves the wheel of the bookshelf floating mechanism 104 to the right bookshelf and presses the flipped bookshelf so that it does not cross over again. Thereafter, the control device 110 drives the book fixing device 102 again to fix both bookshelves of the book, and moves the bookcase floating device 104 and the book fixing device 102 to the initial position. To return to the ready state.

This mechanism unit 100 is implemented through the following process. First, a device for raising a book by rotating a wheel in a fixed device is implemented, and this is illustrated in FIG. 4A. The device for lifting the book is provided with wheels to provide mobility, and the wheel is lowered when the book is raised and the wheel is raised when the book is turned over, and this is illustrated in (d) of FIG. 4. Thereafter, the volume of the bookshelf turning device was reduced and the left and right pages were all turned with a single driving device so as to operate efficiently, and FIG. 4(b) illustrates this. In addition, in order to stabilize the operation and increase durability so that it is clean in appearance and can be used for a long time, the frame part of the hardware is manufactured using 3D printing, and this is illustrated in (e) of FIG. 4. In addition, by adding a length adjusting device 108 according to the size of the book, the user's convenience and utilization are improved, and this is illustrated in (c) of FIG. 4.

<Processing procedure of automatic bookshelf turning device that operates according to eye movement or voice>

Now, the processing procedure and operation of the bookshelf turning device operating according to the movement of the eyeball or voice as described above will be described in detail with reference to the drawings. 5 to 7 are diagrams illustrating a processing procedure of a bookshelf turning device operating according to an eye movement or voice according to a preferred embodiment of the present invention.

Explaining the overall operation of the bookshelf turning device described above, when the power is turned on, the initial setup process is performed, such as port setting for using the servo motor and LED, and preparation for library use, and after confirming that the left/right turn button is pressed, the eyeball It checks whether there is a change in movement and goes through the process of checking whether there is a recognized voice.

The left/right flip button can be used at any time, and in the case of eye movement and voice recognition, it is possible to select whether to use it with a switch. When a specific event occurs in each process, the operation function to control the servo motor is called, and while the operation function is called, only the operation function is sequentially executed to prevent other inputs from entering continuously. In the case of speech recognition, since it is a function built into the MCU board, it operates in parallel with the programmed functions. However, there is a problem of continuous operation because it is stacked in a queue format each time a speech is recognized. When it comes in, it reads the first input, terminates the serial, and initializes it, and it is recognized while the operation function is executing, so that it does not operate continuously.

In addition, if the eye selection switch is on, the bookshelf turning device uses the MSTimer2 library to execute a timer interrupt and starts EOG sensing after turning on the red LED. When the EOG sensing starts, it takes about 10 seconds for the eye conduction sensing value to rise unstable and gradually stabilize as shown in FIG. 8A. When the stabilization is completed, the green LED is turned on and the bookshelf flipping operation is performed according to the eye movement.

This overall process will be described in more detail with reference to FIG. 5. When the power is turned on (step 200), the control device 110 of the bookshelf turning device performs initialization for each part of the bookcase turning device (step 202). Thereafter, the control device 110 checks whether the user commands the left or right turn based on the operation state of the left/right turn button 122 of the button unit 120 (steps 204 and 206).

When a left turn or right turn is commanded, the control device 110 performs a left or right turn of the bookshelf by calling and executing an operation function corresponding thereto (step 208). Since the process of turning over the bookshelf has already been described above, a detailed description thereof will be omitted.

On the contrary, when the user selects to turn the bookshelf by eye movement through the eye/voice selection switch 124 (step 210), it is checked whether the eyeball flag is in a TRUE state (step 212). Here, when the eye flag is in a TRUE state, it indicates that the eye movement sensing is stabilized.

If the eye flag is not in the TRUE state, the control device 110 starts a timer interrupt and receives digital sensing values from the EOG sensor module 118 and stabilizes the EOG to guide the EOG sensing unstable state. The red LED of the display LED 130 is driven (steps 214 and 216).

Then, the control device 110 checks whether the digital sensing value from the EOG sensor module 118 follows a predetermined stabilization state within a predetermined time (step 218). When the digital sensing value from the EOG sensor module 118 follows the stabilization state, the control device 110 drives the green LED of the EOG stabilization display LED 130 to guide the EOG sensing stabilization state, and sets the eye flag to TRUE. It converts to a state (steps 220 and 222).

Thereafter, when the eyeball/voice selection switch 124 instructs the selection of turning over the bookshelf by eye movement in a state in which the eyeball flag is TRUE, the control device 110 performs an algorithm for calling and executing an action function according to the eye movement Do (steps 224 and 226).

On the contrary, if the eye/voice selection switch 124 does not instruct the selection of the bookshelf turn by eye movement, the timer interrupt is terminated and the LED driving is terminated, and then the eye flag is converted to FALSE (steps 228 and 230).

In addition, if the digital sensing value from the EOG sensor module 118 does not follow a predetermined stabilization state within a predetermined time, the control device 110 converts the eyeball flag to FASLE (step 232).

Unlike the above, when the user selects to turn the bookshelf by voice recognition through the eye/voice selection switch 124 (step 234), serial communication starts (step 238), and the voice flag is converted to TRUE. Thereafter, when the user maintains the state of turning over the bookshelf by voice recognition through the eye/voice selection switch 124, the voice recognition algorithm is performed to recognize the input voice, and an operation function corresponding to the recognized voice is called and executed ( 242,244,246,248 steps). On the other hand, if the eye/voice selection switch 124 does not select to turn the bookshelf by voice recognition, it is converted into a voice flag FLASE and serial communication is terminated.

<Bookshelf turning algorithm according to eye movement>

Prior to the description of the bookshelf turning algorithm according to the eye movement according to the present invention, the EOG signal will be described. The analog value sensed by the PSL-iEOG2 (eye conduction board) is connected to the Arduino A2 and A3 ports, and this value is read every 0.05 seconds. At this time, the analog value output from PSL-iEOG2 has a value between 0 and 750. For the convenience of sensing, the read value has three values of 0, 1, and 3 when the read value is multiplied by 5/1023 and converted into an int. Here, in order to check whether the corresponding sensing value is stabilized, a method of checking whether the sensing value is maintained at 1 for 10 seconds is applied.

Above 1 means a stable state without eye movement, 0 means that the pupil of the eyeball is directed downward, and 3 means that the pupil of the eyeball is facing upward. In (b) of FIG. 8, red is a waveform when the pupil of the eyeball is upward, and green is a waveform when the pupil of the eyeball is downward. At this time, when the eye blinks or the pupil is temporarily moved up and down, the value changes instantaneously, so in the present invention, sensing is performed only when the same value is maintained for 0.7 seconds to prepare for a bouncing value. In addition, in the present invention, it is checked whether 3 seconds have elapsed from the last motion so that when the pupil of the eyeball comes down in order to see the front again after executing the operation of turning the book toward the pupil upward, it is not sensed as if it is directed downward.

The bookshelf turning algorithm according to the eye movement according to the present invention will be described in detail with reference to FIGS. 6 and 7.

The control device 110 of the bookshelf turning device reads the digital sensing value of the EOG sensor module 118 according to a timer interrupt. The timer interrupt for this reads the digital sensing value of the EOG sensor module 118 every time 0.05 seconds elapses as shown in FIG. 6 (steps 300 and 302).

An algorithm for turning the bookshelf according to eye movements executed according to the timer interrupt will be described with reference to FIG. 7.

The control device 110 of the bookshelf turning device reads the digital sensing value of the EOG sensor module 118 according to the timer interrupt (step 400), and checks whether the last reading value stored in advance and the current reading value are the same (step 402). ), if the last reading value and the current reading value are not the same, the change time of the last reading value is changed to the current time (step 404).

Thereafter, the control device 100 checks whether 3 seconds have passed from the last eyeball direction detection time (step 406), and if 3 seconds have passed from the last eyeball direction detection time, the control device 100 is 0.7 from the last reading value change time. It is checked whether the seconds have passed (step 408).

When 0.7 seconds have passed from the last reading value change time, the control device 100 checks whether the reading value is different from the event state value (step 410). The event status value is read (step 412).

The control device 110 checks whether the read event state value is 3 (step 414). If the event state value is 3, the control device 110 converts the last eyeball detection time to the current time, calls and executes a function to pass to the next bookshelf (steps 416 and 418).

If the event state value is not 3, the control device 110 checks whether the event state value is 0 (step 420). If the event state value is 0, the control device 110 converts the last eyeball detection time to the current time, calls and executes a return to the previous bookshelf function.

As described above, the technical ideas described in the embodiments of the present invention may be implemented independently, respectively, and may be implemented in combination with each other. In addition, the present invention has been described through the embodiments described in the drawings and the detailed description of the invention, but this is only illustrative, and various modifications and equivalent other embodiments from those of ordinary skill in the art to which the present invention pertains It is possible. Therefore, the technical scope of the present invention should be determined by the appended claims.

100: mechanism part
102: book fixing mechanism device
104: bookshelf floating mechanism device
106: Bookshelf turning mechanism device
108: length adjustment mechanism device
110: control device
112: memory unit
114: mechanism driving part
116: external device interface unit
118: EOG sensor module
120: button part
122: left/right flip button
124: eye/voice selection switch
126: Voice registration button
128: display
130: EOG stabilization indicator LED
132: audio input device

Claims (12)

A mechanism unit that inserts a rod into the bookshelf and turns it over after the bookshelf is opened while the book is mounted;
A mechanism driving unit for driving the mechanism unit;
A switch for selecting eye movement or voice;
EOG sensor module for sensing the movement of the eyeball;
An audio input device for receiving voice input;
When the movement of the eyeball is selected through the switch, a sensing value from the EOG sensor module is input to generate an event state value indicating the state of the eyeball, and the instrument driving unit is controlled to correspond to the event state value, Drive to turn over the bookshelf, and if the event value indicating the state of the eye is less than a predetermined time, the turnover of the bookshelf is not performed,
And a control device for recognizing a voice input through the audio input device when a voice is selected through the switch, and controlling the instrument driving unit to correspond to the recognized voice to drive the instrument unit to turn over the bookshelf; Automatic bookshelf turning device. The method of claim 1,
The mechanism part,
A book fixing mechanism device including a flat plate fixing the back of the book and a lever fixing the right and left bookshelves of the book;
A bookshelf opening device including a wheel that rotates clockwise or counterclockwise while being placed on the right or left bookshelf to float the right or left bookshelf; And
Automatic bookshelf turning device comprising; a bookshelf turning mechanism device including a rod for pushing the bookcase left or right by the bookshelf floating mechanism device. The method of claim 2,
Automatic bookcase turning device, characterized in that it further comprises a length adjusting device installed between the bookshelf floating mechanism device and the bookshelf turning mechanism device to adjust the length according to the size of the book. The method of claim 2,
The control device,
By controlling the mechanism driving unit,
After releasing the lever of the book fixing mechanism device for the bookshelf to be turned over, in a state that the bookcase to be turned over is opened through the bookshelf floating mechanism device, insert a rod into the bookshelf floated through the bookshelf turning mechanism device Automatic bookshelf flipping device characterized by pushing the bookshelf in the desired direction. The method of claim 2,
The control device,
By controlling the mechanism driving unit,
The bookshelf is fixed by pushing the lever of the book fixing device back to the bookshelf in a state in which the wheel is moved to the bookshelf that is pushed in the direction in which the rod is inserted and the bookshelf is not restored to its original position again. Automatic bookshelf turning device, characterized in that. In the automatic bookshelf turning method,
(a) When the movement of the eyeball is selected, a sensing value from the sensor module is input to generate an event state value indicating the state of the eyeball, and the instrument driving unit is controlled to correspond to the event state value to drive the instrument unit to open the bookshelf. Turning over; And
(b) when the voice is selected, recognizing the voice input through the audio input device, and controlling the instrument driving unit to correspond to the recognized voice to drive the instrument unit to turn the bookshelf,
In step (a),
When the event value indicating the state of the eyeball is less than a predetermined time, the bookshelf flipping is not performed. The method of claim 6,
In step (a),
If the reading value that reads the sensing value from the sensor module is different from the last reading value, the reading value is multiplied by a predetermined value and converted into an int form to generate an event state value, and a mechanism corresponding to the event state value Automatic bookshelf turning method that operates according to eye movement or voice, further comprising the step of controlling the driving unit to drive the mechanism unit to turn over the bookshelf. The method of claim 6,
In step (a),
(a-1) Read the sensing value of the sensor module according to the timer interrupt, check whether the last reading value stored in advance and the current reading value are the same, and if the last reading value and the current reading value are not the same, the last reading value Automatic bookshelf turning method operating according to the movement of the eyeball or voice, further comprising the step of changing the change time to the current time. The method of claim 8,
In step (a-1),
(a-2) Check whether the first time has passed from the last eyeball direction detection time, and if the first time has passed from the last eyeball direction detection time, check whether the second time has passed from the last reading value change time ,
If the second time has elapsed from the change time of the last reading value, the step of checking whether the last reading value is different from the event state value, characterized in that it further comprises: Way. The method of claim 9,
In step (a-2),
(a-3) reading the event status value,
If the read event state value is the'action value to the next page', converting the last eye detection time to the current time, and calling and executing a turn to the next bookshelf function. Or the automatic bookshelf turning method that operates according to the voice. The method of claim 10,
In step (a-3),
(a-4) If the read event status value is'operation value to previous page',
Converting the last eyeball detection time to the current time, and calling and executing a flip to a previous bookshelf function. The automatic bookshelf flipping method that operates according to eye movements or voices. delete

Images