CN107643824A - One kind horizontally slips gesture sense of touch braille touching reading system and method - Google Patents
One kind horizontally slips gesture sense of touch braille touching reading system and method Download PDFInfo
- Publication number
- CN107643824A CN107643824A CN201710726752.XA CN201710726752A CN107643824A CN 107643824 A CN107643824 A CN 107643824A CN 201710726752 A CN201710726752 A CN 201710726752A CN 107643824 A CN107643824 A CN 107643824A
- Authority
- CN
- China
- Prior art keywords
- braille
- touch
- finger
- touching reading
- touching
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
Horizontally slipped gesture sense of touch braille touching reading system and method the invention discloses one kind.The different directions slided on touch screen according to finger set different vibrotactile feedback, by the continuously slipping finger in left and right six times, successively in one braille of touching reading six sags and crests information, realize touching reading braille；System includes touch screen, braille modular converter, control module and vibration module.The present invention solves the technical problem of touch-screen equipment touching reading sense of touch word, has that touching reading speed is fast, simple to operate, the advantages of being easy to learn and use, moreover it is possible to convenient to be realized on various touch-screen equipments such as smart mobile phone, tablet personal computer.
Description
Technical field
Horizontally slipped gesture sense of touch braille touching reading system and method the present invention relates to one kind, belong to the friendship of touch-screen equipment sense of touch
Mutual technical field.
Background technology
The vibration tactile feedback of Intelligent mobile equipment be realize non-visual information obtain with the blind key technology that interacts of use it
One.Tactile feedback can provide such as：Prompting message, emotional conveyance, non-vision interaction, and text is read in the case of blind use
The functions such as word.For blind userses, sense of touch interaction is even more its crucial hand using touch screen mobile devices such as mobile phones
Section；And realize the most important method of braille electronic reading.
How on touch screen mobile device by being designed to vibration sense of touch, allow blind person also to use smart mobile phone etc.
Touch screen mobile device, it is the important research direction of current man-machine interaction.Also blind community is to aid in incorporate normal society, enjoy letter
One of breath technology development result, the key issue improved the quality of living.
The main method that sense of touch word read is currently realized on touch screen mobile device is that vibrotactile feedback is compiled
Code, the bumps or this code of rubbing for simulating six-dot braille are realized.According to finger interactive mode and the difference of vibrational feedback pattern,
The method of sense of touch touching reading can be divided into three classes.
First kind method is the different touch feedback patterns perceived with reference to finger on touch screen in sliding process, successively table
Up to the concavo-convex information of 6 braille points；Braille of the user further according to sequence touching reading to identify of tactile feedback.Such method will be blind
6 points of text, which are split, to be come, then obtains the concavo-convex information of each braille point successively to realize the reading purpose of braille, reached compared with
Good effect.However, the limitation of such method is that it needs finger to slide a longer distance on touch screen, and according to cunning
Dynamic distance perceives the concavo-convex information of six braille points successively.User needs significant attention during use, in order to avoid
Miss the concavo-convex information of a certain braille point in touch feedback sequence.This make it that the speed of this kind of method often touching reading is slower, generally
Need to carry out within more than 5 seconds one braille of touching reading.
Second class method is to be encoded by the vibration rhythm to touch screen mobile device to express text information.Such as
The on and off of vibration is encoded to express the bumps of six points of braille successively in sequential；Or pass through vibration time and interval
The different drops for simulating this code that rubs of time, answer coding etc..The advantages of such method is by being compiled in sequential to vibration
Code, it is expressed, and the time of each alphabetic character is shorter, and code efficiency is higher.The presentation speed highest of usual word sense of touch coding can
Up to every 855 milliseconds of character.However, because the sense of touch pattern of rhythm coding is very brief, often the difficulty of accurate discrimination is larger.So that should
The reading accuracy rate of class method is often relatively low, and only 71% or so.And the method based on the rhythm is passive type tactilely-perceptible, behaviour
Poor controllability, study and memory burden are larger during work, and Consumer's Experience is often bad.
3rd class method encodes for space sense of touch.By carrying out region division to the screen of touch screen mobile device, with 6 points
The locus of braille corresponds.Finger touches different zones and the recessed of corresponding braille point is judged according to the difference of vibrational feedback
It is convex, and then read the purpose of braille.The advantages of being corresponded due to designed space sense of touch position and six-dot braille point,
So that the program is easy to learning and mastering.But the problem of this method maximum is to need finger to slide into six different regions point
Other touching reading sense of touch pattern so that character reading is less efficient, averagely needs the 4-26 seconds to read a character.
The content of the invention
In order to solve problem present in background technology, the present invention proposes one kind and horizontally slipped gesture sense of touch braille touching reading
System and method.Gesture is slided on combination application touch screen of the present invention and the vibrotactile feedback of equipment carrys out touching reading braille, is solved
The blind technical problem with word touching reading in background technology, intelligent touch screen equipment and the braille electronics such as mobile phone are used for blind userses
Change reading and provide solution.
The method that the present invention solves this problem is the gesture to be horizontally slipped on intelligent touch screen equipment using finger, sliding every time
The change in dynamic direction switches the semantic information of six sags and crests in braille successively.Therefore, each Braille of touching reading needs finger
Continuously slipping six times of left and right on touch screen, every time according to touch feedback with or without the convex or recessed of the braille point for judging to read.
Concrete technical scheme is：
First, a kind of sense of touch braille touching reading system：
Including touch screen, touch screen detection finger touch position, and finger touch position and its timing variations information are sent to
Control module；
Including braille modular converter, braille modular converter reading characters information and converts text information from smart machine
For six-dot braille, then the concavo-convex information of six-dot braille is converted into braille signal and is sent to control module.
Described six-dot braille is six sags and crests of standard braille.
Including control module, control module is sentenced according to the finger touch position and its timing variations information that are received from touch screen
Cut off the hands and refer to glide direction, according to finger glide direction and the braille signal generation vibration control received from braille modular converter
Signal, and oscillation control signal is sent to vibration module and produces vibration to control；
Including vibration module, vibration module is connected to touch screen or is directly connected to finger, passes through vibrational feedback to finger.
The finger glide direction is divided into left direction and right direction along touch screen surface, and control module is touched according to finger
Touch the change information of position and finger touch position in sequential and judge that finger glide direction is left direction or to the right
To.
The control module is according to the convex-concave surface information that braille point is currently presented in finger glide direction and braille signal
Oscillation control signal is produced, and being sent to vibration module vibrates its opponent's fingering row, feeds back corresponding in vertical bar sense of touch region
Braille convex-concave sense of touch.
In the touch screen, braille modular converter, control module and vibration module being integrated in one equipment.
2nd, a kind of sense of touch braille touching reading method：
Finger slides on touch screen, and touch screen provides vibration according to the braille information presented, by finger in whole touch screen
Upper perception vibration acquisition feedback of sliding carrys out touching reading braille.
Finger is unidirectional on touch screen to slide the touching reading for once representing a braille point in six-dot braille, and touch screen carries out vibration pair
The braille point that touching reading should be represented is nonreentrant surface, and touch screen is concave surface without the corresponding braille point for representing touching reading of vibration.
One braille process of touching reading is：Touched from the lateral edges of touch screen one to another lateral edges and slide finger, it is sliding through touch screen root
According to the concavo-convex information of vibrational feedback touching reading one braille point into six-dot braille, unidirectional six completion touching readings one of slide are repeated
All six braille points in individual six-dot braille.
During the unidirectional slide of the repetition six times, glide direction and last glide direction next time
Conversely.Be specifically as follows, one braille of touching reading slips off the beginning from a left side, horizontally slip successively six times (be followed successively by it is left and right, left and right, left,
It is right) six braille points of one braille of touching reading.
During one braille of touching reading, the presentation order of six braille points be by row from top to bottom, in often going from left to right
Touching reading, i.e., since the first row is from left to right, by often row starts touching reading successively from left to right from top to bottom.
The detailed process of the touching reading that horizontally slipped on touch screen braille is that it is right to press finger for arbitrfary point position first on screen
Slide to the left afterwards, if first corresponding to the braille that current device is presented blind spot is convex, mobile phone has vibrating tactile anti-
Feedback；If corresponding blind spot is recessed, feedback vibration, now user's operation are not designated as (a) to mobile phone, and perceived first it is blind
The information of point.
Then, finger slides (to the right (b)) the concavo-convex information of second blind spot of touching reading round about.It is if corresponding blind
For text point to be convex, mobile phone has vibrotactile feedback；If corresponding blind spot be the not feedback vibration of mobile phone if recessed, so as to which touching reading arrives
The information of second braille point.The like, finger is on screen or so slidably reciprocate 6 (left (a), right (b), left (c), the right sides
(d), left (e), right (f)) touching reading of a braille can be completed.
Wherein, hand is pointed in different directions the distance threshold of slip and is set as n pixel (n >=4), i.e. finger during touching reading
It is the gesture for being judged to sliding to the direction to continuously slipping more than the n pixel in same direction, mobile phone makes an immediate response to vibrate and touched
The presence or absence of sense feeds back to user.Therefore, user can slide finger to perceive sense of touch with short distance, and quickly left and right slidably reciprocates
Finger carrys out the sense of touch of touching reading braille.
The offer vibrational feedback is that vibration is provided in a manner of intermittent, and feature is that noise is small.Specifically set of short duration
Time of vibration and vibration interval time, time of vibration and vibration interval time alternate.The vibration mode of formation is：Time of vibration
W1, vibration interval time w2, time of vibration w1, vibration interval time w2 ... ..., with this continuous repetitive vibrations time w1 and vibration
Interval time w2 provides intermittent vibration.
The beneficial effects of the invention are as follows：
1) present invention realizes the touching reading of braille using touch screen slip gesture and vibrotactile feedback.
It is simple and quick as long as 2) horizontally slip six touching readings that can complete a braille of finger in interaction.
3) technology of the invention can be realized easily in various be equipped with the touch-screen equipment of vibrating sensor：Such as intelligent hand
Machine, tablet personal computer etc..
The inventive method can optional position starts to slide finger in addition to left hand edge on touch screen, and overcoming conventional method needs
The problem of perceiving locus on touch screen.The left and right in a shorter scope is only needed to slidably reciprocate hand during touching reading
Refer to, therefore required touch screen space can be with very little, as long as the screen space that can accommodate two forefinger width can be used.
The inventive method can greatly improve touching reading efficiency, switch glide direction system every time and feed back the slip side immediately
Upward sense of touch can be switched fast direction that finger horizontally slips to complete touching reading with or without, skilled user with quick sensing.
The effective efficiency and ease of use issues for solving braille touching reading on the intelligent touch screen equipments such as mobile phone.
The present invention by being found to the actual test of 8 users, touching reading it is fastest up to 1.5 seconds, pass through 2 minutes
Exercise can skillfully use this method.
Brief description of the drawings
Fig. 1 is the numbering schematic diagram of six sags and crests of braille in the present invention.
Fig. 2 is that finger horizontally slips the sequential schematic of six sags and crests information of touching reading braille successively in the present invention.
Fig. 3 is the touching reading process schematic for introducing the braille in the present invention by example of Braille r.
Fig. 4 is the touching reading process schematic of touching reading Braille r in the present invention.
Embodiment
It is right below in conjunction with real drawings and Examples for the object, technical solutions and advantages of the present invention are more clearly understood
The present invention is further elaborated.
Present invention specific implementation includes：
1) when finger clicks on screen and slides, equipment provides vibrational feedback, equipment according to currently presented braille information
Touch screen on any Figure and Image need not be presented.
2) when the braille point information corresponding to the finger braille that equipment is currently presented into left or right sliding process is convex, then
Equipment can provide the vibrational feedback of batch (-type)；If the braille point information corresponding to the braille that opposite system is presented is recessed, set
The standby vibrational feedback that batch (-type) can be provided.The tactile feedback pattern of wherein vibrational feedback is：Time of vibration w1, vibration interval time
W2, time of vibration w1, constantly vibration interval time w2 ... ..., repetition w1 and w2 vibration and vibration interval time.
The w1 drawn by user test span can between 10-30ms any number, w2 span can
Any number between 50-150ms, caused noise are small.The vibration mode is only held equipment and can perceived, and can not
It is enough to pass through range estimation or hear vibrational feedback.
Specific implementation one braille of touching reading process be：
1) optional position starts touching reading braille on finger click screen.The position for starting to click on can not be screen Far Left side
Edge, because screen Far Left can not slide finger to the left again；
2) finger slides first braille point of touching reading braille to the left.If now equipment has vibrational feedback, representing should
First braille point of braille is convex；, whereas if now equipment feedback without friction, then first braille point of the braille is represented
To be recessed；
3) after the information of first braille point is perceived, finger slides to the right the concavo-convex letter of second braille point of touching reading again
Breath.If now providing vibrational feedback to touch screen by vibration module, second braille point of the braille is represented to be convex；Instead
It, if now not providing vibrational feedback to touch screen by vibration module, represents second braille point of the braille to be recessed；
4) above 2 is repeated) and 3) step twice, completes the concavo-convex information of six braille points in a braille.
Fig. 1 is the serial number of six braille points of braille, is 1,2 from left to right from the first row；Second row is 3,4 from left to right；3rd
Row is 5,6 from left to right.
Fig. 2 is the touching reading order of six braille points of braille, the order of the finger that horizontally slips be denoted as respectively (a), (b), (c),
(d)、(e)、(f)。
The touching reading of co-continuous finger six completions, one braille that horizontally slips successively.Needed after one braille of touching reading by finger
Lifted from screen, then again tap on screen slip finger and carry out the next braille of touching reading.
When finger frames out, the braille state of current touching reading can be reset.Screen is again tapped on to slide to the left again
Start first braille point of the touching reading braille.The method that touching reading state is reset can provide again the work(of the current braille of touching reading
Energy.I.e. during touching reading if to when currently the braille point information of touching reading is uncertain, lift finger click on slip again can be with
Again the current braille of touching reading.
Hand is pointed in different directions the distance threshold of slip and is set as n pixel (n >=4) during touching reading, i.e. finger is to same
Continuously slipping more than the n pixel in one direction is the gesture for being judged to sliding to the direction, and mobile phone, which makes an immediate response, vibrates sense of touch
Whether there is and feed back to user.Therefore, user can slide finger to perceive sense of touch, and quick or so the finger that slidably reciprocates with short distance
Carry out touching reading braille.
Fig. 4 is one Braille r institutes application method of touching reading.The concavo-convex information of wherein Braille r six braille points
As shown in figure 3, its 1st, 3,4,5 braille point is convex；2nd, 6 braille point is recessed.First, click on screen and slide finger to the left
The concavo-convex information of first braille point of touching reading, Braille r first braille point is convex, then now by vibration module to touching
Screen provides vibrational feedback, as shown in Fig. 4 (a).After the concavo-convex information of first braille point has been perceived, then finger sense is slided to the right
Know the concavo-convex information of second braille point, now corresponding second braille point is recessed, then is not carried by vibration module to touch screen
For vibrational feedback, as shown in Fig. 4 (b).Then finger the 3rd braille point information of touching reading to the left is slided again, now the corresponding 3rd
Individual braille point is convex, then vibrational feedback is provided to touch screen by vibration module, as shown in Fig. 4 (c).Finger is slided again to the right successively
The 4th braille point information of touching reading, now corresponding 4th braille point are convex, then provide vibration to touch screen by vibration module
Feedback, as shown in Fig. 4 (d).Finger the 5th braille point information of touching reading to the left is slided again, and now corresponding 5th braille point is
It is convex, then vibrational feedback is provided to touch screen by vibration module, as shown in Fig. 4 (e).Finally, then to the right finger touching reading the 6th is slided
The information of individual braille point, now corresponding 6th braille point are recessed, then do not provide vibrational feedback to touch screen by vibration module,
As shown in Fig. 4 (f).
The present invention by being found to the actual test of 8 users, touching reading it is fastest up to 1.5 seconds, pass through 2 minutes
Exercise can skillfully use this method, it is seen that and the inventive method improves 3 times compared to original 4-5 seconds read access time, and efficiency is very high,
The mode for changing blind person's touching reading adds blind person user's touching reading efficiency.
Claims (10)
- The gesture sense of touch braille touching reading system 1. one kind horizontally slips, it is characterised in that：Including touch screen, touch screen detection finger touch position, and finger touch position and its timing variations information are sent to control Module；Including braille modular converter, text information is converted into six-dot braille, then the bumps by six-dot braille by braille modular converter Information is converted into braille signal and is sent to control module.Including control module, control module judges hand according to the finger touch position and its timing variations information that are received from touch screen Refer to glide direction, believed according to finger glide direction and the braille signal generation vibration control received from braille modular converter Number, and oscillation control signal is sent to vibration module and produces vibration to control；Including vibration module, vibration module is connected to touch screen or is directly connected to finger, passes through vibrational feedback to finger.
- The gesture sense of touch braille touching reading system 2. one kind according to claim 1 horizontally slips, it is characterised in that：The finger Glide direction is divided into left direction and right direction along touch screen surface, and control module is touched according to finger touch position and finger Touch change information of the position in sequential and judge that finger glide direction is left direction or right direction.
- The gesture sense of touch braille touching reading system 3. one kind according to claim 1 horizontally slips, it is characterised in that：The control Module produces oscillation control signal according to the convex-concave surface information that braille point is currently presented in finger glide direction and braille signal, And being sent to vibration module vibrates its opponent's fingering row, feeds back in Braille convex-concave sense of touch corresponding to vertical bar sense of touch region.
- The gesture sense of touch braille touching reading system 4. one kind according to claim 1 horizontally slips, it is characterised in that：It is described to touch In screen, braille modular converter, control module and vibration module being integrated in one equipment.
- The gesture sense of touch braille touching reading method 5. one kind horizontally slips, it is characterised in that：Finger slides on touch screen, and touch screen provides vibration according to the braille information presented, is slided by finger on whole touch screen Innervation knows that vibration obtains feedback and carrys out touching reading braille.
- The gesture sense of touch braille touching reading method 6. one kind according to claim 5 horizontally slips, it is characterised in that：Finger is touching Unidirectional on screen to slide the touching reading for once representing a braille point in six-dot braille, touch screen carries out vibrating the corresponding braille for representing touching reading Point is nonreentrant surface, and touch screen is concave surface without the corresponding braille point for representing touching reading of vibration.
- The gesture sense of touch braille touching reading method 7. one kind according to claim 5 horizontally slips, it is characterised in that：Touching reading one Braille process is：Touched from the lateral edges of touch screen one to another lateral edges and slide finger, cunning arrives through touch screen according to vibrational feedback touching reading The concavo-convex information of a braille point in six-dot braille, repeat to own in unidirectional six completion one six-dot brailles of touching reading of slide Six braille points.
- The gesture sense of touch braille touching reading method 8. one kind according to claim 7 horizontally slips, it is characterised in that：Described heavy During multiple unidirectional slide six times, glide direction and last glide direction next time is opposite.
- The gesture sense of touch braille touching reading method 9. one kind according to claim 5 horizontally slips, it is characterised in that：Touching reading one During braille, the presentation order of six braille points be by row from top to bottom, touching reading from left to right in often going is that is, left from the first row Rise to start, by often row starts touching reading successively from left to right from top to bottom.
- The gesture sense of touch braille touching reading method 10. one kind according to claim 5 horizontally slips, it is characterised in that：It is described to shake Dynamic is that vibration is provided in a manner of intermittent.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710726752.XA CN107643824B (en) | 2017-08-22 | 2017-08-22 | System and method for braille touch reading by left-right sliding gesture |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710726752.XA CN107643824B (en) | 2017-08-22 | 2017-08-22 | System and method for braille touch reading by left-right sliding gesture |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107643824A true CN107643824A (en) | 2018-01-30 |
| CN107643824B CN107643824B (en) | 2021-07-09 |
Family
ID=61110601
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710726752.XA Active CN107643824B (en) | 2017-08-22 | 2017-08-22 | System and method for braille touch reading by left-right sliding gesture |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107643824B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024087433A1 (en) * | 2022-10-26 | 2024-05-02 | 瑞声开泰声学科技(上海)有限公司 | Tactile feedback method and apparatus |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101521857A (en) * | 2008-12-22 | 2009-09-02 | 康佳集团股份有限公司 | Method and terminal for helping blind people read short messages |
| CN102520822A (en) * | 2011-12-09 | 2012-06-27 | 无锡知谷网络科技有限公司 | Touch-recognizable touch screen for mobile phone for the visually impaired and response manner thereof |
| CN106598242A (en) * | 2016-12-07 | 2017-04-26 | 浙江传媒学院 | Mobile smart phone touch texture coding and sensing interaction method specific to digits |
-
2017
- 2017-08-22 CN CN201710726752.XA patent/CN107643824B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101521857A (en) * | 2008-12-22 | 2009-09-02 | 康佳集团股份有限公司 | Method and terminal for helping blind people read short messages |
| CN102520822A (en) * | 2011-12-09 | 2012-06-27 | 无锡知谷网络科技有限公司 | Touch-recognizable touch screen for mobile phone for the visually impaired and response manner thereof |
| CN106598242A (en) * | 2016-12-07 | 2017-04-26 | 浙江传媒学院 | Mobile smart phone touch texture coding and sensing interaction method specific to digits |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024087433A1 (en) * | 2022-10-26 | 2024-05-02 | 瑞声开泰声学科技(上海)有限公司 | Tactile feedback method and apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107643824B (en) | 2021-07-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107562196B (en) | System and method for braille touch reading through unidirectional sliding gesture | |
| CN106462283B (en) | Calculate the character recognition in equipment | |
| Rantala et al. | Methods for presenting braille characters on a mobile device with a touchscreen and tactile feedback | |
| US10209885B2 (en) | Method and device for building virtual keyboard | |
| Alnfiai et al. | SingleTapBraille: Developing a text entry method based on braille patterns using a single tap | |
| CN104869204A (en) | Blind person tactile representation intelligent touch screen terminal and dialing method | |
| CN101739149B (en) | Touch pen and method for controlling same | |
| CN107272881A (en) | A kind of data inputting method and device, entering method keyboard and electronic equipment | |
| CN105892919A (en) | Methods for recognizing key positions and feeding back input values on keyboard of touch screen | |
| TW201020876A (en) | Electronic apparatus and touch input method thereof | |
| CN107643824A (en) | One kind horizontally slips gesture sense of touch braille touching reading system and method | |
| JP2014134571A (en) | Computer device, reproduction system, and program | |
| CN206097069U (en) | A braille input device for touch equipment | |
| CN201255931Y (en) | Learning machine for the blind children | |
| Shabnam et al. | Braille-coded gesture patterns for touch-screens: a character input method for differently enabled persons using mobile devices | |
| CN206339933U (en) | Data performs device | |
| CN104199602B (en) | A kind of information processing method and electronic equipment | |
| CN106020520B (en) | A kind of information processing method and electronic equipment | |
| CN104049772B (en) | A kind of input method, device and system | |
| CN104111730B (en) | A kind of control method and electronic equipment | |
| Tamer et al. | A low duration vibro-tactile representation of Braille characters | |
| CN104461329B (en) | A kind of data inputting method and device | |
| KR101610714B1 (en) | Apparatus for braille input/output and method using the same | |
| EA035821B1 (en) | Method and data entry device for the entry of data in electrical form | |
| Misra et al. | Novel user interface for text entry on touch screen mobile device for visually impaired users |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |