KR101339005B1 - Vehicle monitor device and method for controlling the same - Google Patents
Vehicle monitor device and method for controlling the same Download PDFInfo
- Publication number
- KR101339005B1 KR101339005B1 KR1020120145137A KR20120145137A KR101339005B1 KR 101339005 B1 KR101339005 B1 KR 101339005B1 KR 1020120145137 A KR1020120145137 A KR 1020120145137A KR 20120145137 A KR20120145137 A KR 20120145137A KR 101339005 B1 KR101339005 B1 KR 101339005B1
- Authority
- KR
- South Korea
- Prior art keywords
- unit
- input
- signal
- communication
- vehicle
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/14—Handling requests for interconnection or transfer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
Abstract
Description
The present invention relates to a vehicular monitor device and a control method thereof, and a vehicular monitor device which can easily control and drive a corresponding device through communication and communication with an external electronic device as well as an external digital device of the vehicle, and an image thereof It relates to a control method.
Recently, as the electronic devices inside the vehicle are diversified, the method of controlling them is also very diverse. As such, the electronic device is manufactured in an independent module form to perform each function.
Conventional electronic devices have various disadvantages, such as different operations and control methods, because they perform various tasks such as support for safe driving of a vehicle, detection of dangers inside and outside, and error detection of an internal device of a vehicle. This made it difficult for the driver to directly control all electronic devices.
SUMMARY OF THE INVENTION The present invention has been made to solve the above-described problems, and provides a vehicle monitor apparatus and a method of controlling the same, which are capable of video communication with various electronic devices inside and outside the vehicle, and which can be easily and conveniently controlled through a touch type input. .
A touch display unit for displaying a screen according to the present invention and receiving a user input, an input / output control board unit for communicating with and controlling a device mounted on a vehicle, a trip control unit for communicating with and controlling an internal device of the vehicle, and the trip An input selector for selecting an input of at least one of the devices communicating with the controller and the input / output control board, and an input signal selected by the input selector, and analyzing the input signal and displaying the image on the touch display. A signal converting unit for converting a signal, converting an input signal of a user's touch of the touch display unit into a control signal of the corresponding device, and controlling the operation of each unit, and controlling the screen of each device provided to the touch display unit according to the state of the vehicle It provides a vehicle monitor device comprising a control unit for controlling the.
The input / output control board unit CVBS communication unit for connecting to the electronic device to perform the CVBS communication, MHL / HDMI communication unit for performing the HML / HDMI communication with the external smart phone, and the device for providing the image information through the RGB cable RGB communication unit in charge of communication, DVI communication unit in communication with a device providing image information via a DVI cable, audio communication unit in charge of audio communication with an electronic device, and radio corresponding to wireless communication of an external wireless communication device. And a power applying unit for supplying power to the electronic device connected to each communication unit.
The CVBS communication unit may include a first CVBS communication unit communicating with cameras (including front and rear cameras) mounted on a vehicle, and a second CVBS communication unit communicating with an AVM system.
The trip control unit includes an OBD communication unit which communicates with an internal system, a sensor, and inspection devices for vehicle inspection, a K-Line communication unit which receives inputs of various sensors of a diagnostic device and an output value of an actuator through can communication, and an external chipset. A GPIO communication unit for communicating with a vehicle, a navigation communication unit for communicating with a navigation device mounted on a vehicle, receiving information collected from the navigation and providing a signal for navigation control, and a touch by the touch display unit. Between the touch signal communication unit receiving the received coordinate values, the external memory communication unit connected to an external memory (including an SD card) to store information in the memory, or reading information stored in the memory, and a trip computer mounted in the vehicle. Trip communication unit performing communication and diagnostic USB communication unit performing USB communication for vehicle diagnosis It characterized in that it comprises.
The input selector selects and transmits at least one signal of an input signal of an electronic device input through the trip controller and the input / output control board, and a switch or a mux is used.
The signal converter converts a signal input through the input / output control board unit and the trip control unit into a video image form and provides it to the touch display unit so that a user can check the corresponding signal in the form of an image. And an image format converting unit converting the image signals provided through the trip control unit into an image that can be displayed on the touch display unit, an image table corresponding to the input signal, and including the input / output control board unit and the trip control unit. Image information and other control of the text converter and the external device with the smart phone to add or change the result of the signal input by the control unit to the corresponding image table to provide the user with the imaged information through the touch display unit Mirror information to the touch display And in that it comprises mirroring unit according to claim.
The controller analyzes the signals provided through the input / output control board unit and the trip control unit, determines whether the corresponding signal is valid according to the analyzed signal result, and if there is an effective range, separate notification and limit signals are provided. It is characterized by generating.
The control unit divides the display section of the touch display unit into two or more sections, and displays images corresponding to different input signals for each section.
In addition, in the control method of a vehicle monitor device connected to the internal and external electronic devices of the vehicle according to the present invention, the step of displaying an initial selection screen for selecting a device connected to the monitor device, and at least one of the devices connected through the screen selection Selecting the device, displaying the information provided from the selected device as an image in the form of an image, and when the screen is touched, comparing the information of the corresponding touch coordinates with the image or image information. Determining whether there is information for device control, and if there is control information, providing a control signal to a selected device.
The displaying of the information provided from the selected corresponding device as an image in the form of an image may include controlling the corresponding video, information about a device photographing the video, and operation of the corresponding device when the provided information is video related information. Control information is displayed on the touch display unit, and if the provided information is information other than a video, description information about the device corresponding to the image displayed on the current screen, current status information of the device, and operation of the device are displayed. Information for controlling and information on whether the device is in normal operation are displayed.
In this way, the present invention can display the communication and video images between various digital devices interlocked with the information acquired through the trip control unit and the input / output control board unit through a general touch type monitor. In addition, it may be possible to easily control, drive, and manipulate the screen on the monitor shown in the linked device (smartphone, pad or other information device) by touching.
1 is a block diagram of a vehicular monitor device according to an embodiment of the present invention;
2 is a block diagram of an input / output control board unit according to an exemplary embodiment.
3 is a block diagram of a trip controller according to an exemplary embodiment.
4 is a block diagram of a signal converter according to an exemplary embodiment.
5 to 7 are views for explaining the control and operation of the vehicle monitor device according to an embodiment.
8 is a flowchart illustrating a control method of a vehicle monitor apparatus according to an embodiment of the present invention.
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. It will be apparent to those skilled in the art that the present invention may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, It is provided to let you know. Wherein like reference numerals refer to like elements throughout.
It is to be clarified that the division of components in this specification is merely a division by main function which each component is responsible for. That is, two or more constituent parts to be described below may be combined into one constituent part, or one constituent part may be divided into two or more functions according to functions that are more subdivided. In addition, each of the constituent units described below may additionally perform some or all of the functions of other constituent units in addition to the main functions of the constituent units themselves, and that some of the main functions, And may be carried out in a dedicated manner. Accordingly, the presence or absence of each component described in this specification should be interpreted as a function. For this reason, it is apparent that the configuration of the components of the vehicular monitor device of the present invention and its control method may be different within the limits to achieve the object of the present invention.
1 is a block diagram of a vehicular monitor device according to an embodiment of the present invention. 2 is a block diagram of an input / output control board according to an embodiment, FIG. 3 is a block diagram of a trip controller according to an embodiment, and FIG. 4 is a block diagram of a signal converter according to an embodiment. 5 to 7 are views for explaining the control and operation of the vehicle monitor apparatus according to an embodiment.
As shown in FIGS. 1 to 7, the vehicle monitor apparatus according to the present embodiment displays an screen, and input / output control for communicating with and controlling a
Through the smart monitor device of the present embodiment, the user can check the state of all devices in the vehicle as a video image, and the user can perform commands for operating the corresponding device only by touching the screen. This has the advantage of improving the performance and eliminating the need for a separate operation panel for each device operation.
The
The input /
The CVBS
The CVBS
In this embodiment, each of the first CVBS communication unit for communication with the camera and the second CVBS communication unit for communication with the AVM system can be provided.
The MHL /
The
The
The
The
The
The
The
The K-
The
The
The touch
The external
The
The diagnostic
Through the
The
Of course, the present invention is not limited thereto, and the signal input through the input / output
As such, the
The
In addition, the
The
In this case, the
The
The
That is, a video image corresponding to an input signal provided through the input / output
For example, in the case of sensor input, the video image includes the definition area of the value measured by the sensor, the state area of the current measurement value, the area indicating whether the sensor value is normal, the sensor control (including on / off) area, the sensor It may include a display area having a malfunction or not. Through this, when the user wants to see the sensor input, the
The
The
Through this, the user can display the desired signal information (including image information) to the user in the form of an image. Through this, the user can easily acquire not only the current state of the vehicle but also the information desired by the user in the form of imaged information, and can easily operate the devices mounted inside and outside the vehicle by directly touching the image information. .
In addition, the
Of course, when the vehicle driving related signal and the check result signal input through the
In addition, the
In addition, the
Hereinafter, a control method of a vehicular monitor device having the above-described configuration will be described with reference to the drawings.
8 is a flowchart illustrating a control method of a vehicle monitor apparatus according to an embodiment of the present invention.
Before describing a control method of a vehicle monitor apparatus, a vehicle monitor apparatus including a touch display unit, an input / output control board unit, a trip controller, an input selector, a signal storage unit, a signal converter, and a controller is installed in a vehicle. Subsequently, the device mounted on the vehicle and the device externally installed and the external device are connected through the input / output control board unit and the trip control unit.
As shown in FIG. 8, when power is applied to the monitor apparatus through a vehicle, the monitor apparatus is driven. Through this, the monitor apparatus checks the connection between the vehicle internal device and the mounted device and checks whether the external device is connected (S110).
Next, the monitor device displays an initial selection screen (S120).
The initial selection screen is a screen for selecting a connected device. The device connected through the input / output control board unit and the trip control unit is displayed in the form of an icon. Of course, it may be arranged in a structure for the convenience of user operation in the form of a separate list.
Of course, if the user does not make any selection on the initial selection screen, the default screen may be displayed.
The basic setting screen is effectively a screen related to vehicle driving. Of course, the present invention is not limited thereto, and the user may directly display the basic setting screen. For example, the navigation screen may be a basic setting screen.
Subsequently, when a device is selected according to the user's selection, information provided through the selected device (device) is displayed on the screen as an image in the form of an image (S130).
In this case, when the image is video-related information provided from the outside, the video, the device information of the video, and control information for controlling the operation of the device are displayed together on the touch display unit. In addition, in case of non-video information, description information of the device corresponding to the image displayed on the current screen, current status information of the device, information for controlling the operation of the device, and information on whether the device is in normal operation are displayed. . Through this, the user can determine whether the normal operation of various devices and whether there is an abnormality through the touch display unit. In addition, in the case of a device related to vehicle driving and inspection, in addition to the above information, driving status information and inspection notification information may be further displayed.
In addition, in order for the information of the selected device to be displayed on the screen in the form of an image, only at least one input signal selected by the user is displayed on the screen among information input from the device connected to the monitor device of the present embodiment. In this case, when the input signal needs to be converted, it is preferable to process the corresponding input signal information so that it can be displayed on the touch display unit. In this case, it is preferable to convert the image format in the case of the image information, and to display the image on the screen by describing a value obtained by analyzing the input signal in an image table corresponding to the input signal in the case of information other than the image information.
Here, if the user touches the current screen, information on the area corresponding to the touch coordinate is provided to the controller, and the controller compares the touch coordinates with the image or image information to provide information for controlling the device in the touch coordinate region. Determine if there is (S140). If there is no control information, a separate operation is not performed (S150). If the control information is located, an operation corresponding to the control information is performed (S160). To this end, the controller generates a separate control signal and provides it to a device connected through an input / output control board or a trip controller (S170). As described above, in the present exemplary embodiment, two-way communication with devices inside and outside the vehicle may be performed through a single monitor device.
In addition, the monitor apparatus of the present exemplary embodiment may change a device displayed on a screen according to a user's selection, or may drive a multi-screen by splitting a screen.
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention.
100: touch display unit 200: input and output control board unit
300: trip control unit 400: input selection unit
500: signal storage unit 600: signal conversion unit
700:
Claims (10)
An input / output control board unit for communicating with and controlling the device mounted on the vehicle;
A trip control unit communicating with and controlling the in-vehicle device;
An input selector configured to select an input of at least one of the devices communicating with the trip controller and the input / output control board;
Analyzing an input signal selected by the input selector, converting it into an image signal to display an image on the touch display unit, and converting a signal converted by the user's touch on the touch display unit into a control signal of the corresponding device part; And
A control unit for controlling the operation of each unit and controlling a control screen of each device provided to the touch display unit according to the state of the vehicle,
The signal converter converts a signal input through the input / output control board unit and the trip controller into an image image form and provides the same to the touch display unit so that a user can check the signal in the form of an image.
And an image format converting unit for converting image signals provided through the input / output control board unit and the trip control unit into an image that can be displayed on the touch display unit, and an image table corresponding to an input signal. The text conversion unit and the external device of the smart phone which adds or changes the result of the signal inputted through the unit and the trip control unit to the corresponding image table and provides the image information to the user through the touch display unit. And a mirroring unit configured to mirror image information and other control information on the touch display unit.
The input / output control board unit CVBS communication unit for connecting to the electronic device to perform the CVBS communication, MHL / HDMI communication unit for performing the HML / HDMI communication with the external smart phone, and the device for providing the image information through the RGB cable RGB communication unit in charge of communication, DVI communication unit in communication with a device providing image information via a DVI cable, audio communication unit in charge of audio communication with an electronic device, and radio corresponding to wireless communication of an external wireless communication device. And a power supply unit for supplying power to an electronic device connected to each of the communication units.
The CVBS communication unit includes a first CVBS communication unit for communicating with cameras (including front and rear cameras) mounted in a vehicle, and a second CVBS communication unit for communicating with an around view monitor system. Vehicle monitor device.
The trip control unit includes an OBD communication unit which communicates with an internal system, a sensor, and inspection devices for vehicle inspection, a K-Line communication unit which receives inputs of various sensors of a diagnostic device and an output value of an actuator through can communication, and an external chipset. A GPIO communication unit for communicating with a vehicle, a navigation communication unit for communicating with a navigation device mounted on a vehicle, receiving information collected from the navigation and providing a signal for navigation control, and a touch by the touch display unit. Between the touch signal communication unit receiving the received coordinate values, the external memory communication unit connected to an external memory (including an SD card) to store information in the memory, or reading information stored in the memory, and a trip computer mounted in the vehicle. Trip communication unit performing communication and diagnostic USB communication unit performing USB communication for vehicle diagnosis A vehicle monitor apparatus comprising:.
And the input selector selects and transmits at least one signal of an input signal of an electronic device input through the trip control unit and the input / output control board unit, wherein a switch or a mux is used.
The controller analyzes the signals provided through the input / output control board unit and the trip control unit, determines whether the corresponding signal is valid according to the analyzed signal result, and if there is an effective range, separate notification and limit signals are provided. Vehicle monitor device characterized in that the generation.
And the control unit divides the display section of the touch display unit into two or more sections, and displays images corresponding to different input signals for each section.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020120145137A KR101339005B1 (en) | 2012-12-13 | 2012-12-13 | Vehicle monitor device and method for controlling the same |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020120145137A KR101339005B1 (en) | 2012-12-13 | 2012-12-13 | Vehicle monitor device and method for controlling the same |
Publications (1)
Publication Number | Publication Date |
---|---|
KR101339005B1 true KR101339005B1 (en) | 2013-12-10 |
Family
ID=49987728
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020120145137A KR101339005B1 (en) | 2012-12-13 | 2012-12-13 | Vehicle monitor device and method for controlling the same |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR101339005B1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105320429A (en) * | 2014-08-01 | 2016-02-10 | 大众汽车有限公司 | Mirroring deep links |
KR101599626B1 (en) * | 2014-08-26 | 2016-03-03 | (주) 비앤디 | Apparatus and method for controlling smart device |
US9731651B2 (en) | 2015-02-12 | 2017-08-15 | Hyundai Motor Company | Method and apparatus for outputting vehicle alarm information using mobile devices |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100839670B1 (en) * | 2007-08-07 | 2008-06-19 | 최현정 | Car control system using integration type car ad board |
-
2012
- 2012-12-13 KR KR1020120145137A patent/KR101339005B1/en active IP Right Grant
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100839670B1 (en) * | 2007-08-07 | 2008-06-19 | 최현정 | Car control system using integration type car ad board |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105320429A (en) * | 2014-08-01 | 2016-02-10 | 大众汽车有限公司 | Mirroring deep links |
KR101747527B1 (en) * | 2014-08-01 | 2017-06-27 | 폭스바겐 악티엔 게젤샤프트 | Mirroring deeplinks |
US10089053B2 (en) | 2014-08-01 | 2018-10-02 | Volkswagen Ag | Mirroring deeplinks |
CN105320429B (en) * | 2014-08-01 | 2018-10-19 | 大众汽车有限公司 | Mirror depth links |
KR101599626B1 (en) * | 2014-08-26 | 2016-03-03 | (주) 비앤디 | Apparatus and method for controlling smart device |
US9731651B2 (en) | 2015-02-12 | 2017-08-15 | Hyundai Motor Company | Method and apparatus for outputting vehicle alarm information using mobile devices |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20190092345A1 (en) | Driving method, vehicle-mounted driving control terminal, remote driving terminal, and storage medium | |
US20150205396A1 (en) | Information processing device, information terminal, information processing system and calibration method | |
KR102500666B1 (en) | Method for configuring input interface and electronic device using the same | |
KR20190047790A (en) | Electronic device for recognizing fingerprint using display | |
US20200356255A1 (en) | Monitor and display screen switching method therefor | |
CN108303969B (en) | Automatic testing device for vehicle-mounted ECU | |
US10082997B2 (en) | Display system, display apparatus and adjustment method | |
KR20190074776A (en) | Electronic device and method for controlling touch sensor controller | |
KR101339005B1 (en) | Vehicle monitor device and method for controlling the same | |
US8407375B2 (en) | Information processing apparatus and information processing method | |
WO2013115516A1 (en) | Engine control unit for construction machinery | |
CN107526703B (en) | Inter-integrated circuit device in inter-integrated circuit system and control method thereof | |
KR20200119143A (en) | Electronic device including touch sensor and method for driving touch sensor included in electronic device | |
CN106358063A (en) | Touch television, control method and control device of touch television | |
KR20200122945A (en) | Electronic device for displaying execution screens of a plurality of applications and method for operating thereof | |
JP2006085708A (en) | Control device and control method for console | |
US10676026B2 (en) | Image signal processing apparatus and image signal processing program product | |
US9600088B2 (en) | Method and apparatus for displaying a pointer on an external display | |
US20230009510A1 (en) | System for Evaluating Built-in Video Recording Device for Vehicle | |
US20210303248A1 (en) | Display device and control method for display device | |
EP2639687A2 (en) | Display apparatus and control method thereof | |
KR20220139506A (en) | Automatic evaluating apparatus for built-in video recording device of vehicle, system having the same, and method thereof | |
US10728487B2 (en) | Image display apparatus, external device, image display method, and image display system | |
US20150029344A1 (en) | Video output supervisor | |
KR101697644B1 (en) | Vehicle Cluster Diagnosis System and Method using Smartphone |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A201 | Request for examination | ||
A302 | Request for accelerated examination | ||
E902 | Notification of reason for refusal | ||
E90F | Notification of reason for final refusal | ||
E701 | Decision to grant or registration of patent right | ||
GRNT | Written decision to grant | ||
FPAY | Annual fee payment |
Payment date: 20161110 Year of fee payment: 4 |
|
FPAY | Annual fee payment |
Payment date: 20171201 Year of fee payment: 5 |
|
FPAY | Annual fee payment |
Payment date: 20191202 Year of fee payment: 7 |