New! View global litigation for patent families

CN102186011A - Digital high-definition camera based on full hardware - Google Patents

Digital high-definition camera based on full hardware Download PDF

Info

Publication number
CN102186011A
CN102186011A CN 201110124515 CN201110124515A CN102186011A CN 102186011 A CN102186011 A CN 102186011A CN 201110124515 CN201110124515 CN 201110124515 CN 201110124515 A CN201110124515 A CN 201110124515A CN 102186011 A CN102186011 A CN 102186011A
Authority
CN
Grant status
Application
Patent type
Prior art keywords
module
digital
network
camera
high
Prior art date
Application number
CN 201110124515
Other languages
Chinese (zh)
Inventor
董宁
唐世悦
唐麟
Original Assignee
合肥埃科光电科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Abstract

The invention discloses a digital high-definition camera based on full hardware, comprising a charge coupling module, a variable gain amplifying module, an analogue digital conversion module, an FPGA (field programmable gate array) module, a random access memory module, a network cache module and a network controller module, wherein the charge coupling module is connected with the variable gain amplifying module; the variable gain amplifying module sends signals to the FPGA module by the analogue digital conversion module; the random access memory module and the network cache module both are connected with the FPGA module; the FPGA module sends data to the network controller module for output after analyzing image data; and the network cache module is used for temporarily storing data to be sent when the network is used. The FPGA module is taken as the core of the digital high-definition camera, thus controlling the whole camera system and processing the signals. Compared with a high-definition camera system adopting a DSP (digital signal processor), the digital high-definition camera provided by the invention has the advantages of low cost and high reliability.

Description

一种基于全硬件的数字高清摄像机 Hardware-based full-HD digital camcorder

[技术领域] [Technical Field]

[0001] 本发明涉及数字摄像机,尤其涉及一种基于全硬件的数字高清摄像机。 [0001] The present invention relates to a digital camera, particularly to a hardware-based all-digital high-definition video camera. [背景技术] [Background technique]

[0002] 现目前,国内市场对于安防监控产品高清晰度和数字化的需求是十分迫切的,特别在一些民用市场和政府市场领域对于数字百万高清都有着非常强烈的渴望。 [0002] now present, the domestic market for security monitoring products and high-definition digital needs are very urgent, especially in some of the civilian market and government market segments for digital Megapixel have a very strong desire. 现在的安防产品中,绝大多数的模拟摄像设备均不能满足使用环境的需要,导致大量的监控都是无效监控、形同虚设,每当事件发生时都起不到提供重要线索的关键作用。 Now security products, the vast majority of analog video devices can not meet the needs of the environment, resulting in a large number of surveillance monitoring are invalid, ineffective, a key role whenever an event occurs will not achieve all provide important clues. 在交通系统中也存在相同的问题,交通部门必须采用清晰度较高的视频监控产品,而目前国内缺乏性能优秀的产品,进口产品价格又很高,急需性价比高的产品。 In transportation systems also exist the same problems, the transport sector must adopt high-definition video surveillance products, and lack of good performance of domestic products, imported products prices very high, much-needed cost-effective products.

[0003] 在线检测领域,由于检测质量的要求不断提高,对相机的分辨率要求也不断提高。 [0003]-line detection field, since the detection of the quality requirements continue to increase, the resolution of the camera is also rising. 相机是检测中信息获取的关键设备,无论后端处理多么强大,没有足够的信息也无法实现良好的检测,这就对相机的分辨率提出了越来越高的要求。 The camera is the key equipment detection information obtained, no matter how powerful back-end processing, there is not enough information can not achieve good detection, which the camera resolution put forward higher requirements. 因此,相机也随之由几十万像素不断发展到几百万像素的高清相机。 Therefore, the camera also will be growing by the hundreds of thousands of pixels to several megapixels HD camera.

[0004] 虽然高清相机的优势明显,但其昂贵的价格使得应用受到巨大的限制。 [0004] Although high-definition cameras have obvious advantages, but its high price makes the application subject to great restrictions. 目前主流的产品均采用DSP作为相机中的信号处理器件,高清摄像机中的高速大容量数据流必然要求功能强大的DSP,而对应的DSP价格很贵,这就导致了高清相机的成本无法得到合理的控制。 The current mainstream products using DSP as the camera signal processing devices, high-speed large-capacity data stream high-definition video camera in the inevitable requirement of powerful DSP, DSP and the corresponding price is very expensive, which leads to a high-definition camera costs can not be reasonably control.

[发明内容] [SUMMARY]

[0005] 本发明要解决的技术问题是提供一种基于全硬件的数字高清摄像机,其以现场可编程门阵列模块为系统核心来实现整个相机的控制和信号处理。 [0005] The present invention is to solve the technical problem of providing a full hardware-based high-definition digital video camera, which is a field programmable gate array module for the system to implement the entire core of the camera control and signal processing.

[0006] 为了解决上述技术问题,本发明采用的技术方案是:一种基于全硬件的高清数字摄像机,包括电荷耦合模块、可变增益放大模块、模拟数字转换模块、现场可编程门阵列模块、随机存取存储模块、网络缓存模块和网络控制器模块。 [0006] In order to solve the above problems, the present invention adopts the technical solution is: A full hardware-based high-definition digital video camera, a charge-coupled module includes a variable gain amplifier module, an analog to digital conversion module, a field programmable gate array module, random access memory modules, network buffer module and network controller module. 电荷耦合模块与可变增益放大模块连接,可变增益放大模块与模拟数字转换模块连接,模拟数字转换模块与现场可编程门阵列模块连接,现场可编程门阵列模块与随机存储模块连接。 CCD module is connected with the variable gain amplifier module, a variable gain amplification module connected to the analog-digital converter module, an analog to digital conversion module connected to a field programmable gate array module, a field programmable gate array module is connected to the random memory module. 现场可编程门阵列模块对图像流数据分析处理后,根据网络控制器的状态将数据发送到网络控制器模块输出,当网络传输出现占用时,现场可编程门阵列模块将经分析处理后的图像流数据通过网络缓存模块适当缓存后再输出到网络控制器,以防止数据丢失。 After a field programmable gate array module of image analysis processing stream data, according to the state of the network controller transmits data to the network controller module output, transmission occurs when the network occupancy, a field programmable gate array module after evaluation by image output data stream over the network to the network controller after the cache module suitable buffer, to prevent data loss. 网络控制器除了实现数据流的输出功能,还能够将外部的配置参数输入到现场可编程门阵列模块,实现对摄像机的参数配置,以控制摄像机的工作方式。 In addition to the network controller to achieve the output flow of data, but also can be inputted to the external configuration parameters field programmable gate array module, the configuration parameters to the camera to control the operating mode of the camera.

[0007] 上述的现场可编程门阵列模块为系统控制模块。 [0007] The field programmable gate array module for the system control module.

[0008] 上述的现场可编程门阵列模块为电荷耦合模块提供时序控制信号,为随机存取存储模块提供读出和写入控制信号,为网络缓存模块提供读出和写入控制信号;所述的现场可编程门阵列模块通过串口控制可变增益放大模块,通过串口控制模拟数字转换模块,通过串口控制网络控制器模块。 [0008] The field programmable gate array module to module CCD timing control signals, to provide read and write control signal is a random access memory module, provides the read and write control signals to the network buffer module; the field programmable gate array module variable gain amplifier control module through the serial port, the serial port by controlling an analog-digital converter module, the network controller through the serial port control module.

[0009] 上述的现场可编程门阵列模块对图像流数据实时处理和压缩编码。 [0009] The field programmable gate array module and a real-time processing of the image compression-encoded data stream.

[0010] 上述的现场可编程门阵列模块采用JPEG标准对图像流数据压缩编码。 [0010] The field programmable gate array module using the JPEG standard image compression-encoded data stream.

[0011] 上述的现场可编程门阵列模块采用MPEG标准对图像流数据进行压缩编码。 [0011] The field programmable gate array module using the MPEG standard compression-encoded image data stream.

[0012] 上述的现场可编程门阵列模块采用H. 264标准对图像流数据压缩编码。 [0012] The field programmable gate array module using the H. 264 standard for compression encoding image data stream.

[0013] 本发明的有益效果是,采用全硬件体系实现高清摄像机系统,以现场可编程门阵列为系统核心,实现整个相机的控制和信号处理。 [0013] Advantageous effects of the present invention is implemented with full HD camera system hardware architecture, field programmable gate array is a system of the core, the entire camera control and signal processing. 相对于采用DSP的高清摄像机系统,具有低成本,高可靠性的优点。 Relative to the HD camera system DSP, low cost, high reliability advantages.

[附图说明] [BRIEF DESCRIPTION]

[0014] 下面结合附图和具体实施方式对本发明作进一步详细的说明。 [0014] The present invention will be further described in detail in conjunction with accompanying drawings and specific embodiments.

[0015] 图1是本发明一种基于全硬件的高清数字摄像机实施例方框图。 [0015] FIG. 1 is a block diagram of an embodiment of the present invention, one kind of an entirely hardware-based high definition digital video camera.

[0016] 图2是本发明一种基于全硬件的高清数字摄像机实施例现场可编程门阵列(FPGA)模块的控制线路连接方框图。 [0016] FIG. 2 is a block diagram showing the connection site INVENTION An embodiment of a control line gate array (FPGA) modules, programmable hardware embodiment based on the full high-definition digital video camera.

[具体实施方式] [detailed description]

[0017] 在图1中,一种基于全硬件的高清数字摄像机,包括电荷耦合模块(CXD)、可变增益放大模块(VGA)、模拟数字转换模块(ADC)、现场可编程门阵列模块(FPGA)、随机存取存储模块(RAM)、网络缓存模块和网络控制器模块;电荷耦合模块(CCD)与可变增益放大模块(VGA)连接,可变增益放大模块(VGA)与模拟数字转换模块(ADC)连接,模拟数字转换模块(ADC)与现场可编程门阵列模块(FPGA)连接,随机存取存储模块(RAM)和网络缓存模块与现场可编程门阵列模块(FPGA)连接,由其控制图像数据的读写和分析处理,并根据网络控制器的状态输出数据。 [0017] In FIG. 1, based on full hardware definition digital video cameras, including a charge-coupled module (CXD), the variable gain amplifying modules (VGA), analog to digital conversion module (the ADC), a field programmable gate array module ( the FPGA), a random access memory modules (RAM), the network and the network controller module cache module; module charge-coupled (CCD) and the variable gain amplifier modules (VGA) connector, module variable gain amplifier (VGA) and digital analog conversion module (ADC) connected to an analog to digital converter module (ADC) connected to the field programmable gate array module (FPGA), a random access memory modules (RAM) and network cache module and field programmable gate array module (FPGA) connected by a which controls the read and write data and image analysis processing, and outputs the data according to the state of the network controller. 当需要对摄像机进行参数配置时,外部命令通过网络控制器作为外界控制信号发往现场可编程门阵列模块,对摄像机参数进行配置。 When the required configuration parameters for the camera, external command signal sent to the external control field programmable gate array module, camera parameters are configured as a network controller.

[0018] 如图2所示,现场可编程门阵列(FPGA)模块为系统控制模块,其具体控制方式如下: [0018] As shown, a field programmable gate array (FPGA) control module for the system module 2, the specific control as follows:

[0019] 现场可编程门阵列模块(FPGA)给电荷耦合模块(CCD)提供时序控制; [0019] Field Programmable Gate Array module (FPGA) modules to a charge-coupled (CCD) providing a timing control;

[0020] 现场可编程门阵列模块(FPGA)控制随机存取存储模块(RAM)的读出和写入; [0020] Field Programmable Gate Array module (FPGA) control read and write random access memory modules (RAM),;

[0021] 现场可编程门阵列模块(FPGA)控制网络缓存的读出和写入; [0021] Field Programmable Gate Array module (FPGA) control network buffer read and write;

[0022] 现场可编程门阵列模块(FPGA)通过串口控制可变增益放大模块(VGA); [0022] Field Programmable Gate Array module (FPGA) module variable gain amplifier (VGA) controlling through the serial port;

[0023] 现场可编程门阵列模块(FPGA)通过串口控制模拟数字转换模块(ADC); [0023] Field Programmable Gate Array module (FPGA) converter module (ADC) via an analog to digital serial control;

[0024] 现场可编程门阵列模块(FPGA)通过串口控制网络控制器。 [0024] Field Programmable Gate Array module (FPGA) controls the network controller through the serial port.

[0025] 现场可编程门阵列模块(FPGA)对图像数据实时处理和压缩编码。 [0025] Field Programmable Gate Array module (FPGA) and real-time processing of the image data compression-encoded.

[0026] 压缩编码方式为JPEG压缩编码方式。 [0026] The compression encoding method for the JPEG compression encoding. 本实例所采用的压缩编码方式还可以是MPEG或H264压缩编码方式。 Compression encoding method employed in the present example may also be H264 or MPEG compression encoding method.

[0027] 本实施例中所采用的装有电荷耦合模块(CCD)的数字摄像机是灰度摄像机或彩色摄像机。 [0027] This digital camera module equipped with a charge-coupled (CCD) employed in Example embodiments are grayscale cameras or color cameras.

[0028] 工作原理: [0028] How it works:

[0029] 电荷耦合模块(CCD)首先将镜头成像的光信号转换为模拟电信号,然后通过可变增益放大模块(VGA)对模拟电信号进行预处理,然后再通过模拟数字转换模块(ADC)将模拟电信号转换为数字信号。 [0029] Charge Coupled module (CCD) first converting the optical signal of the imaging lens is an analog electrical signal is then amplified by the variable gain modules (VGA) analog electrical signal preprocessing, and then through an analog to digital converter module (ADC) the analog electrical signal into a digital signal. 转换后的数字信号存入内存,现场可编程门阵列模块(FPGA)再读取内存中的数据进行图像处理和JPEG(或MPEG或H264)压缩编码,最后通过网络控制器传出。 Converted digital signal into memory, Field Programmable Gate Array module (FPGA) and then read data in memory for image processing and JPEG (or the H264 or MPEG) compression encoding, and finally spread through the network controller. 当网络传输出现占用时,现场可编程门阵列模块之(FPGA)能够通过网络缓存模块进行适当的缓存,避免数据丢失。 Network transmission occurs when occupied, modules, field programmable gate arrays (FPGA) can be an appropriate buffer cache module through the network, to avoid data loss. 当需要对摄像机进行参数配置时,外部命令通过网络控制器发往可编程门阵列模块,对摄像机参数进行配置。 When the required configuration parameters for the camera, external commands sent to the FPGA module through the network controller, the configuration parameters of the camera.

Claims (7)

1. 一种基于全硬件的高清数字摄像机,其特征在于,包括电荷耦合模块、可变增益放大模块、模拟数字转换模块、现场可编程门阵列模块、随机存取存储模块、网络缓存模块和网络控制器模块;电荷耦合模块与可变增益放大模块连接,可变增益放大模块与模拟数字转换模块连接,模拟数字转换模块与现场可编程门阵列模块连接,现场可编程门阵列模块与随机存储模块连接;现场可编程门阵列模块将经分析处理后的图像流数据输出到网络控制器,当网络传输出现占用时,现场可编程门阵列模块将经分析处理后的图像流数据通过网络缓存模块适当缓存后再输出到网络控制器。 A full hardware-based high definition digital video camera, characterized in that it comprises a charge-coupled module, a variable gain amplifier module, an analog to digital conversion module, a field programmable gate array module, a random access memory modules, network caching and network module the controller module; charge-coupled module is connected with the variable gain amplifier module, a variable gain amplification module connected to the analog-digital conversion module, an analog to digital conversion module connected to a field programmable gate array module, a field programmable gate array module with the random memory module connection; field programmable gate array module outputs the image data by the stream analysis processing to the network controller, the transmission occurs when the network occupancy, a field programmable gate array module image stream data analysis through the network by the appropriate cache module cache and then output to the network controller.
2.根据权利要求1所述的一种基于全硬件的高清数字摄像机,其特征在于,所述的现场可编程门阵列模块为系统控制模块。 According to one of the claims 1 full hardware-based high-definition digital video camera, wherein said field programmable gate array module for the system control module.
3.根据权利要求2所述的一种基于全硬件的高清数字摄像机,其特征在于,所述的现场可编程门阵列模块为电荷耦合模块提供时序控制信号,为随机存取存储模块提供读出和写入控制信号,为网络缓存模块提供读出和写入控制信号;所述的现场可编程门阵列模块通过串口控制可变增益放大模块,通过串口控制模拟数字转换模块,通过串口控制网络控制器模块。 3. Read according to one of claim 2 to claim full hardware-based high-definition digital video camera, wherein said field programmable gate array module provides timing control signals for the CCD module to provide a random access memory module and a write control signal for providing the read and write control signals to the network buffer module; said field programmable gate array module amplifies the variable gain control module through the serial port, the serial port by controlling an analog-digital converter module, through the serial port control network control module.
4.根据权利要求1所述的一种基于全硬件的高清数字摄像机,其特征在于,所述的现场可编程门阵列模块对图像流数据实时处理和压缩编码。 According to one of the claims 1 full hardware-based high-definition digital video camera, wherein said field programmable gate array module and a real-time processing of the image compression-encoded data stream.
5.根据权利要求4所述的一种基于全硬件的高清数字摄像机,其特征在于,所述的现场可编程门阵列模块采用JPEG标准对图像流数据压缩编码。 5. According to one claim 4, wherein the hardware-based full high definition digital video camera, wherein said field programmable gate array module using the JPEG standard image compression-encoded data stream.
6.根据权利要求4所述的一种基于全硬件的高清数字摄像机,其特征在于,所述的现场可编程门阵列模块采用MPEG标准对图像流数据进行压缩编码。 6. According to one of claim 4 full hardware-based high definition digital video camera, wherein said field programmable gate array module using the MPEG standard for compression encoding image data stream.
7.根据权利要求4所述的一种基于全硬件的高清数字摄像机,其特征在于,所述的现场可编程门阵列模块采用H. 264标准对图像流数据压缩编码。 7. According to one of claim 4 full hardware-based high-definition digital video camera, wherein said field programmable gate array module using standard H. 264 compression-encoded image data stream.
CN 201110124515 2011-05-13 2011-05-13 Digital high-definition camera based on full hardware CN102186011A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201110124515 CN102186011A (en) 2011-05-13 2011-05-13 Digital high-definition camera based on full hardware

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201110124515 CN102186011A (en) 2011-05-13 2011-05-13 Digital high-definition camera based on full hardware

Publications (1)

Publication Number Publication Date
CN102186011A true true CN102186011A (en) 2011-09-14

Family

ID=44572074

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201110124515 CN102186011A (en) 2011-05-13 2011-05-13 Digital high-definition camera based on full hardware

Country Status (1)

Country Link
CN (1) CN102186011A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104506815A (en) * 2014-12-30 2015-04-08 黑龙江大学 Remote image monitoring device and monitoring method based on FPGA

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080144185A1 (en) * 2006-12-15 2008-06-19 Hand Held Products, Inc. Apparatus and method comprising deformable lens element
CN101227625A (en) * 2008-02-04 2008-07-23 长春理工大学 Stereoscopic picture processing equipment using FPGA
CN101478670A (en) * 2008-12-30 2009-07-08 西安交通大学 Network real-time video collecting apparatus developed based on FPGA chip and DSP chip
CN101543396A (en) * 2008-03-25 2009-09-30 奥林巴斯医疗株式会社 Image pickup system and method for maintaining the same
CN101577050A (en) * 2008-12-25 2009-11-11 四川川大智胜软件股份有限公司 Intelligent traffic digital monitor and application thereof
CN201467278U (en) * 2009-08-07 2010-05-12 安防制造(中国)有限公司;广东响石数码科技有限公司 Digital high-definition camera
CN201548484U (en) * 2009-10-20 2010-08-11 西安瑞日电子发展有限公司 Universal multi-path digital image simulating source
CN201682557U (en) * 2009-12-11 2010-12-22 四川川大智胜软件股份有限公司 CCD camera device for resisting longitudinal halo
CN102006420A (en) * 2010-12-17 2011-04-06 四川川大智胜软件股份有限公司 Design method capable of using external synchronous for cameral with various data output formats
CN102044155A (en) * 2009-10-20 2011-05-04 西安费斯达自动化工程有限公司 Vehicle configuration dimension image detection and analysis device based on field programmable gate array (FPGA)
CN202059481U (en) * 2011-05-13 2011-11-30 合肥埃科光电科技有限公司 Digital high definition video camera based on general hardware

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080144185A1 (en) * 2006-12-15 2008-06-19 Hand Held Products, Inc. Apparatus and method comprising deformable lens element
CN101227625A (en) * 2008-02-04 2008-07-23 长春理工大学 Stereoscopic picture processing equipment using FPGA
CN101543396A (en) * 2008-03-25 2009-09-30 奥林巴斯医疗株式会社 Image pickup system and method for maintaining the same
CN101577050A (en) * 2008-12-25 2009-11-11 四川川大智胜软件股份有限公司 Intelligent traffic digital monitor and application thereof
CN101478670A (en) * 2008-12-30 2009-07-08 西安交通大学 Network real-time video collecting apparatus developed based on FPGA chip and DSP chip
CN201467278U (en) * 2009-08-07 2010-05-12 安防制造(中国)有限公司;广东响石数码科技有限公司 Digital high-definition camera
CN201548484U (en) * 2009-10-20 2010-08-11 西安瑞日电子发展有限公司 Universal multi-path digital image simulating source
CN102044155A (en) * 2009-10-20 2011-05-04 西安费斯达自动化工程有限公司 Vehicle configuration dimension image detection and analysis device based on field programmable gate array (FPGA)
CN201682557U (en) * 2009-12-11 2010-12-22 四川川大智胜软件股份有限公司 CCD camera device for resisting longitudinal halo
CN102006420A (en) * 2010-12-17 2011-04-06 四川川大智胜软件股份有限公司 Design method capable of using external synchronous for cameral with various data output formats
CN202059481U (en) * 2011-05-13 2011-11-30 合肥埃科光电科技有限公司 Digital high definition video camera based on general hardware

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104506815A (en) * 2014-12-30 2015-04-08 黑龙江大学 Remote image monitoring device and monitoring method based on FPGA

Similar Documents

Publication Publication Date Title
US6680748B1 (en) Multi-mode camera and method therefor
US20020145669A1 (en) Solid state image sensor and video system using the same
US20030007564A1 (en) Method and devices for digital video signal compression and multi-screen process by multi-thread scaling
US20080013846A1 (en) Wavelet transformation device and method, wavelet inverse transformation device and method, program, and recording medium
Posch et al. A QVGA 143dB dynamic range asynchronous address-event PWM dynamic image sensor with lossless pixel-level video compression
US9521416B1 (en) Systems and methods for image data compression
US8879858B1 (en) Multi-channel bit packing engine
US8830367B1 (en) Frame manipulation to reduce rolling shutter artifacts
US20090228620A1 (en) Digital Adapter
US20040046880A1 (en) Image signal processing apparatus
CN102611869A (en) Output-oriented network transmission technique of multi-screen splicing system
Matsuo et al. A very low column FPN and row temporal noise 8.9 M-pixel, 60 fps CMOS image sensor with 14bit column parallel SA-ADC
US8970718B2 (en) Image capture accelerator
JP2002064750A (en) High-speed image pickup device
US20150156387A1 (en) Image sensor, image sensor operation method, and imaging apparatus
CN201830392U (en) Safety monitoring system
CN1960480A (en) TV monitor system and implement method
CN101957982A (en) Real-time infrared image processing system suitable for high frame rate and large array infrared detector
CN101395901B (en) The image sensor includes a superimposed image output time
US20070097239A1 (en) CMOS image sensor apparatus with on-chip real-time pipelined JPEG compression module
CN101867791A (en) Video monitoring system and monitoring method based on smart phone
CN201153302Y (en) Digital network camera
US20130322552A1 (en) Capturing Multiple Video Channels for Video Analytics and Encoding
CN103297668A (en) Panoramic video image recording system and method
US20070008325A1 (en) Method and apparatus providing for high efficiency data capture for compression encoding

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)