CN102591446A - Gesture control display system and control method thereof - Google Patents
Gesture control display system and control method thereof Download PDFInfo
- Publication number
- CN102591446A CN102591446A CN2011100035295A CN201110003529A CN102591446A CN 102591446 A CN102591446 A CN 102591446A CN 2011100035295 A CN2011100035295 A CN 2011100035295A CN 201110003529 A CN201110003529 A CN 201110003529A CN 102591446 A CN102591446 A CN 102591446A
- Authority
- CN
- China
- Prior art keywords
- control
- gesture
- display apparatus
- control display
- identification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention relates to a gesture control display system and a control method thereof. The gesture control display system comprises a touch display device, an image capture device and a recognition control module. The image capture device is used for capturing gestures of users and transmitting the gestures to the recognition control module. The recognition control module is used for recognizing and judging the gestures captured by the image capture device, generating corresponding control signals and transmitting the control signals to the touch display device. The recognition control module comprises a starting recognition unit, a general gesture unit and a control distribution unit, wherein the starting recognition unit is used for recognizing and judging starting gestures of the users and generating the control signals for starting up the touch display device, the control distribution unit is used for recognizing and confirming identities of the users to distribute gesture control rights, and the general gesture unit is used for recognizing and judging control gestures of the users and generating image control signals for changing display pictures of the touch display device. The gesture control display system can improve controllability.
Description
Technical field
The present invention relates to a kind of display system and control method thereof, especially a kind of display system and control method thereof that adopts gesture control.
Background technology
The Along with people's growth in the living standard, very general to the use of various display device.With the televisor is example, and all there is televisor in nearly all family.Televisor comprises display device and telepilot, and telepilot can be controlled in long-range display frame to televisor.Telepilot mainly is made up of with the button that is used for producing different information surface-mounted integrated circuit.The corresponding Different control function of different buttons can realize changing difference in functionalitys such as platform, volume control, menu control, game control through pressing button.
Yet the interactivity of prior remote controller is more single, can't a kind of shirtsleeve operation process directly perceived be provided to the user; In the process of using, user (especially children and the elderly) is often confused by button complicated on the telepilot easily, thereby makes troubles for the use of telepilot.
The display device of controlling with gesture has appearred in intuitive and simplification control procedure for increasing remote control.Existing gesture control display system generally comprises display device, video camera and identification control module.Wherein video camera is used to catch user's gesture and is transferred to the identification control module; The identification control module is used to discern to be judged the gesture that this image capturing device is caught and produces control signal corresponding; Control signal is transferred to display device, and display device changes display frame according to control signal.
Yet, the gesture identification poor-performing of existing gesture control display system, the accuracy of its control procedure is not high, therefore influences the controllability of gesture control display system easily.
Summary of the invention
In view of the foregoing, the present invention proposes a kind of gesture control display system, and it can improve controllability.
The present invention proposes a kind of control method of gesture control display system, and it can improve the accuracy of control procedure.
The present invention provides a kind of gesture control display system, and it comprises touch control display apparatus, image capturing device and identification control module.The image capturing device is used to catch user's gesture and is transferred to the identification control module.The identification control module is used to discern judges the gesture that the image capturing device is caught and produces control signal corresponding that control signal is transferred to touch control display apparatus.The identification control module comprises opens recognition unit, general gesture unit and Control Allocation unit.Opening recognition unit is used to discern the unlatching gesture of judging the user and produces the control signal of opening touch control display apparatus.The Control Allocation unit is used for recognition and verification user's identity to distribute the gesture control.General gesture unit is used to discern the control gesture of judging the user and produces the image control signal of the display frame of change touch control display apparatus.
The present invention also provides a kind of control method of gesture control display system; It comprises with opening gesture opens touch control display apparatus; Wherein open gesture and catch and be transferred to the identification control module by the image capturing device; The unlatching recognition unit identification of identification control module judges that opening gesture also produces the control signal of opening touch control display apparatus, and touch control display apparatus is opened according to opening control signal; And the display frame that changes touch control display apparatus with the Different control gesture; Wherein control gesture and catch and be transferred to the identification control module by the image capturing device; After the Control Allocation unit of identification control module recognition and verification user's identity; The general gesture unit identification of identification control module is judged the control gesture and produces corresponding image control signal that touch control display apparatus is according to image control signal change display frame.(revising) according to claims are corresponding
The identification control module of above-mentioned gesture control display system comprises opens recognition unit, general gesture unit and Control Allocation unit; During use; Opening recognition unit, general gesture unit can cooperate with the Control Allocation unit user's identity and gesture are carried out corresponding affirmation and identification; Therefore improve the accuracy of identification control module easily, thereby promote the controllability of gesture control display system and the accuracy of control procedure thereof gesture identification.
Description of drawings
Below in conjunction with accompanying drawing and embodiment the present invention is further specified.
Fig. 1 is connection side's block diagram of the gesture control display system of the embodiment of the invention one.
Fig. 2 is connection side's block diagram of the gesture control display system of the embodiment of the invention two.
Embodiment
Fig. 1 is connection side's block diagram of the gesture control display system of the embodiment of the invention one.See also Fig. 1, the gesture control display system 100 of the embodiment of the invention one comprises touch control display apparatus 12, image capturing device 14 and identification control module 16.Touch control display apparatus 12 is used to catch user's gesture and is transferred to identification control module 16.Identification control module 16 is used to discern judges that the gesture that image capturing device 14 captures produces control signal corresponding.Control signal is transferred to touch control display apparatus 12, and touch control display apparatus 12 then changes show state or display frame according to this control signal.Wherein, identification control module 16 comprises unlatching recognition unit 162, general gesture unit 164 and Control Allocation unit 166.Opening recognition unit 162 is used to discern the unlatching gesture of judging the user and produces the control signal of opening touch control display apparatus 12.Control Allocation unit 166 is used for recognition and verification user's identity to distribute the gesture control.General gesture unit 164 is used to discern the control gesture of judging the user and produces the image control signal of the display frame of change touch control display apparatus 12.
Hold above-mentionedly, touch control display apparatus 12 can be tea table, televisor, computer or the mobile phone etc. with display panel.Touch control display apparatus 12 can comprise display panel and be located at the Trackpad on the display panel.Wherein, display panel can be display panels, organic electroluminescence display panel, Plasmia indicating panel or electrophoretic display panel; Trackpad can be resistor type touch control plate, capacitive touch control plate or infrared touch control plate, is preferably the infrared touch control plate, but the present invention is not as limit.
Image capturing device 14 can be video camera, does not receive the influence of day ordinary ray for making it, be preferably infrared camera, but the present invention is not as limit.
Above-mentioned gesture control display system 100 is in the process of using, and touch control display apparatus 12 can be in closed condition, dormant state or holding state earlier; When first user provided the unlatching gesture, image capturing device 14 can be caught this and opened gestures and it is transferred to identification control module 16; Unlatching recognition unit 162 identification of identification control module 16 judges whether this opens gesture correct, if correctly then produce and open control information and be transferred to touch control display apparatus 12,12 of touch control display apparatus are opened control information unlatching according to this; Meanwhile, first user is distributed to the gesture control in Control Allocation unit 166.After touch control display apparatus 12 gets into opening; First user with gesture control can provide other Different control gestures; To change the display frame of touch control display apparatus 12; Meanwhile, this image capturing device 14 can be caught the body region that falls into first user in the catching range, can be first zone of health in the present embodiment; Also can be the whole body zone, the purpose that image capturing device 14 is caught first user's body region be to shift to an earlier date canned data for the body play program that possibly carry out afterwards.That is to say that this image capturing device 14 is caught this first user body region and is transferred to identification control module 16.Be in opening and first user still when having the gesture control at touch control display apparatus 12, if there is second user to get into image capturing device 14, Control Allocation unit 166 will be discerned first user's gesture and ignore second user's gesture.If but first user do not provide the control gesture or shift out the capture region of image capturing device 14 in the time in expectant control in expectant control in the time, Control Allocation unit 166 can be cancelled first user's control automatically; And at this moment if there is the 3rd user to provide when controlling gesture, Control Allocation unit 166 can shift control to this 3rd user automatically.Certainly; For the distribution of user's control, the present invention is not exceeded with above-mentioned, for example in other embodiments; First user also can initiatively shift the control gesture through specific gesture in expectant control in the time, makes Control Allocation unit 166 cancellation first users' control.
Specifically in the present embodiment, when first user provided the unlatching gesture, it opened the action that gesture can comprise pushing hands, and both hands push away, one hand pushes away and all can; When touch control display apparatus 12 was in opening, the available control gesture of first user with gesture control can comprise that arm is brandished action or arms swing is moved.But the present invention is not as limit, and for example in other embodiments, gesture motion also can be furnished with user's body action.In addition; When touch control display apparatus 12 is in opening; The display frame of the touch control display apparatus 12 that changes can be video file picture, picture file picture, document files picture or Control-Menu picture etc.; And the layout of these pictures or design can be set according to actual needs, the present invention and as limit.
The identification control module 16 of above-mentioned gesture control display system 100 comprises opens recognition unit 162, general gesture unit 164 and Control Allocation unit 166; During use; Opening recognition unit 162, general gesture unit 164 can cooperate with Control Allocation unit 166 user's identity and gesture are carried out corresponding affirmation and identification; Therefore improve the accuracy of 16 pairs of gesture identification of identification control module easily, thereby promote the controllability of gesture control display system 100 and the accuracy of control procedure thereof.
Fig. 2 is connection side's block diagram of the gesture control display system of the embodiment of the invention two.See also Fig. 2; The gesture of the embodiment of the invention two control display system 200 is similar with gesture control display system 100, and it comprises first touch control display apparatus 22, second touch control display apparatus 23, image capturing device 24, identification control module 26, router two 8 and server 29.Wherein, Router two 8 is connected between the server 29 and first touch control display apparatus 22 and between the server 29 and second touch control display apparatus 23; Picture displayed can show in second touch control display apparatus 23 with the processing of server 29 through router two 8 in the touch control display apparatus 22 of winning thereby make; Picture displayed in second touch control display apparatus 23 can be shown with the processing of server 29 and in first touch control display apparatus 22 through router two 8, and then promote the interaction effect of picture in first touch control display apparatus 22 and second touch control display apparatus 23.Further, for promoting the processing travelling speed and the combination property of gesture control display system 200, server 29 also can comprise allocation unit 292.Allocation unit 292 can be first touch control display apparatus 22 and second touch control display apparatus 23 distributes different address; The protocol address that for example interconnects between the network (IP address); Thereby the file data that lets first touch control display apparatus 22 and second touch control display apparatus 23 shown all is stored in the server 29, promotes the processing speed and the combination property of gesture control display system 200.
Specifically, this first touch control display apparatus 22 of the embodiment of the invention two can comprise gesture control TV, and this second touch control display apparatus 23 can comprise one or more in computer, mobile phone, the multi-point touch tea table.This gesture control TV has the multi-point touch function; And be provided with different icons corresponding to computer, mobile phone, multi-point touch tea table in the menu of the display screen of this gesture control TV, so that realize gesture is controlled the file in the TV or data message is transferred in computer, mobile phone, the multi-point touch tea table one or more arbitrarily through gesture operation.
The above only is preferred embodiment of the present invention, is not the present invention is done any pro forma restriction; Though the present invention discloses as above with preferred embodiment; Yet be not in order to limiting the present invention, anyly be familiar with the professional and technical personnel, in not breaking away from technical scheme scope of the present invention; When the technology contents of above-mentioned announcement capable of using is made a little change or is modified to the equivalent embodiment of equivalent variations; In every case be not break away from technical scheme content of the present invention, to any simple modification, equivalent variations and modification that above embodiment did, all still belong in the scope of technical scheme of the present invention according to technical spirit of the present invention.
Claims (10)
1. a gesture is controlled display system; It comprises touch control display apparatus, image capturing device and identification control module; This image capturing device is used to catch user's gesture and is transferred to this identification control module; This identification control module is used to discern to be judged the gesture that this image capturing device is caught and produces control signal corresponding; This control signal is transferred to this touch control display apparatus; It is characterized in that: this identification control module comprises opens recognition unit, general gesture unit and Control Allocation unit; This unlatching recognition unit is used to discern the unlatching gesture of judging the user and produces the control signal of opening this touch control display apparatus, and this Control Allocation unit is used for recognition and verification user's identity to distribute the gesture control, and this general gesture unit is used to discern the control gesture of judging the user and produces the image control signal of the display frame of this touch control display apparatus of change.
2. gesture control display system according to claim 1, it is characterized in that: the Trackpad of this touch control display apparatus is the infrared touch control plate.
3. gesture control display system according to claim 1, it is characterized in that: this image capturing device comprises infrared camera, this infrared camera carries out image capturing to user's gesture.
4. gesture control display system according to claim 3, it is characterized in that: this infrared camera carries out image capturing to user's body region.
5. gesture control display system according to claim 1; It is characterized in that: this gesture control display system also comprises router, server and another touch control display apparatus, this router be connected between this server and this touch control display apparatus and this server and this another touch control display apparatus between.
6. gesture control display system according to claim 5, it is characterized in that: this server has allocation unit, and it is given between this touch control display apparatus and this second touch control display apparatus and distributes different address.
7. the control method of gesture control display system; This gesture control display system comprises touch control display apparatus, image capturing device and identification control module; This identification control module comprises opens recognition unit, Control Allocation unit and general gesture unit, and its control method comprises:
Open gesture and open this touch control display apparatus; Wherein this identification control module is caught and be transferred to this unlatching gesture by this image capturing device; This of this identification control module opened recognition unit identification and judged this unlatching gesture and produce the control signal of opening this touch control display apparatus that this touch control display apparatus is opened the control signal unlatching according to this; And
Change the display frame of this touch control display apparatus through the Different control gesture; Wherein the identification control module is caught and be transferred to this control gesture by the image capturing device; After the Control Allocation unit of this identification control module recognition and verification user's identity; The general gesture unit identification of this identification control module is judged this control gesture and produces corresponding image control signal that this touch control display apparatus is according to this image control signal change display frame.
8. the control method of gesture control display system according to claim 7, it is characterized in that: this unlatching gesture comprises the action of pushing hands, this control gesture comprises that arm is brandished action or arms swing is moved.
9. the control method of gesture control display system according to claim 7; Whether it is characterized in that: the process of recognition and verification user's identity comprises: judge that whether the user is first user that control gesture is provided, judge user that expectant control was possessed of control power in the time still in the capture region of image capturing device or judge whether the user who is possessed of control power in the time in expectant control provides the gesture that shifts control.
10. the control method of gesture control display system according to claim 7 is characterized in that: after this touch control display apparatus got into opening, this image capturing device was caught this first user body region and is transferred to this identification control module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011100035295A CN102591446A (en) | 2011-01-10 | 2011-01-10 | Gesture control display system and control method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011100035295A CN102591446A (en) | 2011-01-10 | 2011-01-10 | Gesture control display system and control method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102591446A true CN102591446A (en) | 2012-07-18 |
Family
ID=46480253
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011100035295A Pending CN102591446A (en) | 2011-01-10 | 2011-01-10 | Gesture control display system and control method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102591446A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103164127A (en) * | 2013-02-26 | 2013-06-19 | 三星半导体(中国)研究开发有限公司 | Method for controlling demonstration of electronic manuscript |
| CN103295029A (en) * | 2013-05-21 | 2013-09-11 | 深圳Tcl新技术有限公司 | Interaction method and device of gesture control terminal |
| CN103366159A (en) * | 2013-06-28 | 2013-10-23 | 京东方科技集团股份有限公司 | Hand gesture recognition method and device |
| CN103530060A (en) * | 2013-10-31 | 2014-01-22 | 京东方科技集团股份有限公司 | Display device and control method thereof and gesture recognition method |
| CN103677235A (en) * | 2012-08-28 | 2014-03-26 | 华宝通讯股份有限公司 | Interactive augmented reality system, portable communication device and interaction method |
| CN104333793A (en) * | 2014-10-17 | 2015-02-04 | 宝鸡文理学院 | Gesture remote control system |
| CN105260021A (en) * | 2015-10-15 | 2016-01-20 | 深圳市祈锦通信技术有限公司 | Intelligent interactive projection system |
| WO2017115117A1 (en) * | 2015-12-31 | 2017-07-06 | Pismo Labs Technology Ltd. | Methods and systems to perform at least one action according to user's gesture and identity |
| CN110069137A (en) * | 2019-04-30 | 2019-07-30 | 徐州重型机械有限公司 | Gestural control method, control device and control system |
| CN111142660A (en) * | 2019-12-10 | 2020-05-12 | 广东中兴新支点技术有限公司 | Display device, picture display method and storage medium |
| CN112596607A (en) * | 2020-12-18 | 2021-04-02 | 珠海格力电器股份有限公司 | Gesture recognition method and device and electronic equipment |
| WO2022036966A1 (en) * | 2020-08-19 | 2022-02-24 | 安徽鸿程光电有限公司 | Control right distributing method, apparatus, and device, and medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH08315154A (en) * | 1995-02-21 | 1996-11-29 | Mitsubishi Electric Res Lab Inc | Gesture recognition system |
| US20080019589A1 (en) * | 2006-07-19 | 2008-01-24 | Ho Sub Yoon | Method and apparatus for recognizing gesture in image processing system |
| CN101604205A (en) * | 2008-06-10 | 2009-12-16 | 联发科技股份有限公司 | Electronic equipment and be used for the method for remotely controlling electronic devices |
| CN101710948A (en) * | 2009-09-01 | 2010-05-19 | 俞吉 | Gesture motion remote control device |
| CN101872236A (en) * | 2009-04-24 | 2010-10-27 | 范文胜 | Touchless hand image processing control system |
| CN101874234A (en) * | 2008-09-29 | 2010-10-27 | 松下电器产业株式会社 | User interface device, user interface method, and recording medium |
-
2011
- 2011-01-10 CN CN2011100035295A patent/CN102591446A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH08315154A (en) * | 1995-02-21 | 1996-11-29 | Mitsubishi Electric Res Lab Inc | Gesture recognition system |
| US20080019589A1 (en) * | 2006-07-19 | 2008-01-24 | Ho Sub Yoon | Method and apparatus for recognizing gesture in image processing system |
| CN101604205A (en) * | 2008-06-10 | 2009-12-16 | 联发科技股份有限公司 | Electronic equipment and be used for the method for remotely controlling electronic devices |
| CN101874234A (en) * | 2008-09-29 | 2010-10-27 | 松下电器产业株式会社 | User interface device, user interface method, and recording medium |
| CN101872236A (en) * | 2009-04-24 | 2010-10-27 | 范文胜 | Touchless hand image processing control system |
| CN101710948A (en) * | 2009-09-01 | 2010-05-19 | 俞吉 | Gesture motion remote control device |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103677235A (en) * | 2012-08-28 | 2014-03-26 | 华宝通讯股份有限公司 | Interactive augmented reality system, portable communication device and interaction method |
| CN103164127A (en) * | 2013-02-26 | 2013-06-19 | 三星半导体(中国)研究开发有限公司 | Method for controlling demonstration of electronic manuscript |
| CN103295029A (en) * | 2013-05-21 | 2013-09-11 | 深圳Tcl新技术有限公司 | Interaction method and device of gesture control terminal |
| CN103366159A (en) * | 2013-06-28 | 2013-10-23 | 京东方科技集团股份有限公司 | Hand gesture recognition method and device |
| WO2014205927A1 (en) * | 2013-06-28 | 2014-12-31 | 京东方科技集团股份有限公司 | Gesture recognition method and apparatus |
| CN103530060A (en) * | 2013-10-31 | 2014-01-22 | 京东方科技集团股份有限公司 | Display device and control method thereof and gesture recognition method |
| CN104333793A (en) * | 2014-10-17 | 2015-02-04 | 宝鸡文理学院 | Gesture remote control system |
| CN105260021A (en) * | 2015-10-15 | 2016-01-20 | 深圳市祈锦通信技术有限公司 | Intelligent interactive projection system |
| WO2017115117A1 (en) * | 2015-12-31 | 2017-07-06 | Pismo Labs Technology Ltd. | Methods and systems to perform at least one action according to user's gesture and identity |
| GB2549414A (en) * | 2015-12-31 | 2017-10-18 | Pismo Labs Technology Ltd | Methods and systems to perform at least one action according to users gesture and identity |
| US10194317B2 (en) | 2015-12-31 | 2019-01-29 | Pismo Labs Technology Limited | Methods and systems to perform at least one action according to a user's gesture and identity |
| GB2549414B (en) * | 2015-12-31 | 2021-12-01 | Pismo Labs Technology Ltd | Methods and systems to perform at least one action according to a user's gesture and identity |
| CN110069137A (en) * | 2019-04-30 | 2019-07-30 | 徐州重型机械有限公司 | Gestural control method, control device and control system |
| CN110069137B (en) * | 2019-04-30 | 2022-07-08 | 徐州重型机械有限公司 | Gesture control method, control device and control system |
| CN111142660A (en) * | 2019-12-10 | 2020-05-12 | 广东中兴新支点技术有限公司 | Display device, picture display method and storage medium |
| WO2022036966A1 (en) * | 2020-08-19 | 2022-02-24 | 安徽鸿程光电有限公司 | Control right distributing method, apparatus, and device, and medium |
| CN112596607A (en) * | 2020-12-18 | 2021-04-02 | 珠海格力电器股份有限公司 | Gesture recognition method and device and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102591446A (en) | Gesture control display system and control method thereof | |
| JP6353603B2 (en) | Smart home device control method, apparatus, electronic device, program, and storage medium | |
| CN112351302B (en) | Live broadcast interaction method and device based on cloud game and storage medium | |
| CN105187930B (en) | Interactive approach and device based on net cast | |
| WO2019105227A1 (en) | Application icon display method, terminal, and computer readable storage medium | |
| CN107908382B (en) | Split screen display method and mobile terminal | |
| CN103955275B (en) | Application control method and apparatus | |
| CN109495711A (en) | Video calling processing method sends terminal, receives terminal and electronic equipment | |
| WO2015154356A1 (en) | Remote smart control method and device | |
| CN107371044A (en) | Electronic equipment interactive method, electronic equipment, user terminal and server | |
| CN104301610B (en) | Image taking control metho and device | |
| EP2429188A2 (en) | Information processing device, information processing method, computer program, and content display system | |
| CN109407917A (en) | A kind of method and apparatus that Application Status is set | |
| CN109002340A (en) | A kind of screen locking method and electronic equipment | |
| CN104903844B (en) | For method, mobile device and the network equipment of the data in network to be presented | |
| CN108833709A (en) | A kind of the starting method and mobile terminal of camera | |
| CN105165020A (en) | Display apparatus and searching method | |
| WO2021238933A1 (en) | Control method applied to electronic device, and electronic device | |
| CN110087149A (en) | A kind of video image sharing method, device and mobile terminal | |
| CN106341382A (en) | Multi-device screen sharing system between conference devices | |
| CN104750498A (en) | Method for controlling mouse module and electronic device | |
| CN108536366A (en) | A kind of application window method of adjustment and terminal | |
| CN104036167A (en) | Information processing method and electronic device | |
| CN106909234A (en) | Method, control device, terminal and the device being marked to display screen | |
| CN109922294A (en) | A kind of method for processing video frequency and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| AD01 | Patent right deemed abandoned |
Effective date of abandoning: 20161102 |
|
| C20 | Patent right or utility model deemed to be abandoned or is abandoned |