WO2012163112A1 - 跳帧扫描识别装置和方法 - Google Patents

跳帧扫描识别装置和方法 Download PDF

Info

Publication number
WO2012163112A1
WO2012163112A1 PCT/CN2012/071518 CN2012071518W WO2012163112A1 WO 2012163112 A1 WO2012163112 A1 WO 2012163112A1 CN 2012071518 W CN2012071518 W CN 2012071518W WO 2012163112 A1 WO2012163112 A1 WO 2012163112A1
Authority
WO
WIPO (PCT)
Prior art keywords
frame
image
sample
frames
splicing
Prior art date
Application number
PCT/CN2012/071518
Other languages
English (en)
French (fr)
Inventor
李永彬
Original Assignee
汉王科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 汉王科技股份有限公司 filed Critical 汉王科技股份有限公司
Publication of WO2012163112A1 publication Critical patent/WO2012163112A1/zh

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/14—Image acquisition
    • G06V30/142—Image acquisition using hand-held instruments; Constructional details of the instruments

Definitions

  • the invention belongs to the field of computer peripheral devices, and relates to a frame skipping scanning identification device and method, and particularly to an apparatus and method for scanning and identifying a selected character sequence. Background technique
  • An electronic scanning pen (referred to as a scanning pen) is one of the important applications of OCR.
  • the optical camera of the scanning pen continuously photographs the scanned data according to a certain frequency, obtains a sequence of image frames of the scanned data, and then splices the image frame sequence into a panoramic image and performs OCR processing.
  • the frequency of the optical sensor used by the scanning pen is higher and higher, such as collecting 120 image frames per second or even higher.
  • the frequency of the optical sensor of the scanning pen is increased, the probability that the current image frame has a certain overlap with one or more image frames before the previous frame at the same scanning speed is compared to the lower sampling frequency. higher.
  • CN1160657C discloses a method and a device for recording characters, which scans the sequence of characters, and the optical sensor synchronously records a plurality of images whose contents are partially overlapped by means of a two-dimensional sensor, and the images are combined horizontally and vertically into a single panorama.
  • the image, and the characters in the panoramic image are recognized and stored in the device.
  • the signal control unit of the invention can only vertically and horizontally combine each image frame with the previous image frame by overlapping content, so that the image frames adjacent to each two frames are necessarily combined, when the scanning pen is sampled.
  • the technical problem to be solved by the present invention is to provide a frame skipping scanning recognition device and method, which improves the image frame to be stitched by splicing the image frame in the sequence of image frames collected by the image.
  • the stitching speed of the entire image frame sequence discloses a frame skipping scanning recognition device, which comprises an optical sensor for capturing an image and a control module for image processing and recognizing characters.
  • the optical sensor continuously takes a scanned character to obtain an image frame containing the scanned character. a sequence, wherein the content of the two image frames at least one frame overlaps in the image frame sequence partially overlaps; the control module performs a sample on the image frame sequence, and the image frame to be sampled is used as a sample frame, and is not squatted.
  • the image frame is used as a skip frame, and the number of skip frames adjacent to the sample frame is greater than 0; each of the sample frames obtained after the sample is spliced, and the spliced panoramic image is subjected to character recognition and stored. Get the character encoding of the scanned character.
  • the control module includes:
  • the initialization unit sets the image of the Nth frame of the image frame sequence as the first sample frame, and sets the image frame that skips the frame number from the first sample frame to the second sample frame, where N is greater than or equal to 1 a natural number; a splicing unit, calculating splicing information of the second sample frame and the first sample frame, splicing the second sample frame with the first sample frame according to the splicing information, and then updating the second sample frame to the first a sample frame;
  • the stitching information includes a stitching direction, a horizontal stitching displacement, and a vertical stitching displacement;
  • the sampling unit calculates the sampling rate of the next squatting sample according to the splicing information and the set minimum overlapping ratio, obtains the second swatching frame, and returns to the splicing unit; until all the image frames in the image frame sequence are finished.
  • the invention also discloses a method for recognizing a frame skipping scan, comprising the following steps: Step 1: Perform continuous shooting on the scanned characters to obtain an image frame sequence containing the scanned characters, wherein the image frame sequence is separated by at least one frame. The image frame content is partially overlapped; Step 2: The control module in the device performs a sample sequence on the image frame, and the image frame to be sampled is used as a sample frame, and the image frame that is not downloaded is used as a skip frame, and The number of skip frames adjacent to the sample frame is greater than 0, and the spliced frames obtained after the sputum sample are spliced; Step 3, the spliced panoramic image is subjected to character recognition and stored, and the scanned characters are obtained. Character Encoding.
  • the image of the Nth frame of the image frame sequence may be set as the first sample frame, where N is an integer greater than or equal to 1, and the image of the number of frames is skipped from the first sample frame.
  • the frame is set to the second frame.
  • the first frame image in the sequence of image frames is used as the first sample frame, and the sampling rate is two.
  • the number of skip frames is 1, and the image frame after skipping the frame is the second frame.
  • the second step includes:
  • Step a calculating splicing information of the second sample frame and the first sample frame, splicing the second sample frame with the first sample frame according to the splicing information, and then updating the second sample frame to the first sample frame frame;
  • Step b Calculate the sampling rate of the next squat sample according to the splicing information and the set minimum overlap ratio, obtain the second swatch frame, and return to step a; until all the image frames in the image frame sequence are finished.
  • the second step further includes using the last frame image in the image frame sequence as the second sample frame.
  • the splicing information includes a splicing direction, a horizontal splicing displacement, and a vertical splicing displacement.
  • the character recognizes the panoramic image obtained by tilting the previous correction so that each character in the panoramic image forms a horizontal character line.
  • the apparatus and method for detecting frame skipping scanning disclosed by the present invention, the image frame in the image frame sequence collected by the optical sensor is filtered by the control module, and the splicing is performed according to the overlapping content in the obtained image frame to be stitched, thereby improving The stitching speed of the entire image frame sequence.
  • FIG. 1 is a schematic diagram of a frame skip scan identification device of the present invention
  • FIG. 2 is a structural block diagram of a frame skipping scanning recognition apparatus according to the present invention.
  • FIG. 3 is a flowchart of a method for recognizing a frame skipping scan according to the present invention.
  • step 2 is a flowchart of step 2 in the frame skipping scanning identification method of the present invention.
  • FIG. 5 is a schematic diagram of a sample frame and a skip frame in the frame skip scan identification method of the present invention
  • FIG. 6 is a schematic diagram of each image frame and related data in the embodiment of the frame skip scan identification method according to the present invention
  • FIG. 7 is a panoramic binary image in an embodiment of a frame skipping scanning recognition method according to the present invention
  • FIG. 8 is a panoramic binary image after tilt correction in an embodiment of a frame skipping scanning recognition method according to the present invention.
  • the invention discloses a frame skipping scanning and recognizing device.
  • the invention comprises the following components: a casing 1 for encapsulating and fixing a device component, a control module 2 for image processing and character recognition, a circuit board 3 for integrating components, a battery 4 for powering various components of the device, an optical sensor 5 for imaging characters, a button 6 for triggering a collection operation, and a memory 7 for loading the character recognition engine.
  • a liquid crystal panel 8 for displaying output information, a USB module 9 for connecting to a computer, a display unit 10 for driving the liquid crystal panel 8, and a TTS module 11 for outputting voice.
  • the circuit board 3 integrates a control module 2, an optical sensor 5, a memory 7, a display unit 10, a TTS module 1 1 and a USB module 9.
  • the housing 1 encloses the liquid crystal panel 8, the battery 4, the button 6 and the circuit board 3.
  • the button 6 is connected to the optical sensor 5 on the board 3, and sends a control signal to the optical sensor 5.
  • the optical sensor 5 performs continuous high-speed shooting on the scanned characters to obtain a sequence of image frames containing the scanned characters, wherein the two image frame contents at least one frame apart in the image frame sequence partially overlap; the control module 2 pairs the image frames according to the scanning speed.
  • the image is taken as a sample frame, and the image frame that is not sampled is used as a skip frame, and each sample frame obtained after the sample is spliced, and the mosaic is obtained. After the image is tilt corrected, character recognition is performed to obtain the character encoding of the scanned character.
  • the circuit board 3 integrates a control module 2, an optical sensor 5, a memory 7, a display unit 10, a TTS module 11 and a USB module 9.
  • the control module 2 is connected to the memory 7, the optical sensor 5, the display unit 10 and the TTS module 11 respectively.
  • the user triggers the collection operation through the button 6, sends a control signal to the optical sensor 5, and the optical sensor 5 performs image information collection to obtain an image frame sequence, and the control module 2 pairs the image frame according to the scanning speed.
  • the image is taken as a sample frame, and the image frame that is not sampled is used as a skip frame, and each sample frame obtained after the sample is spliced, and the mosaic is obtained.
  • the recognition engine in the memory 7 is called to perform character recognition, and the character of the scanned character formed after the recognition is encoded in the memory 7 for storage.
  • the unit 10 can call the character to be scanned stored in the memory 7 to be displayed on the liquid crystal screen 8.
  • the control module 2 can send the character code of the scanned character to the TTS module 1 1 according to the control signal, and the TTS module 1 1 Output voice.
  • the present invention further includes a lens group 12 for taking in image information, and a lighting unit 13 for illuminating characters to be scanned.
  • the focal length of the lens group 12 is 5 to 7 mm, and the aperture is 10 or more, which ensures that the depth of field of the lens group 12 is 30 to 50 mm, which can effectively scan the text information to ensure a good application effect.
  • the illumination unit 13 is in an on state, the illumination unit 13 emits a light beam and forms a spot on the scanned character, and the lens group 12 ingests the image information of the illumination unit 13 to be integrated on the circuit board 3.
  • the optical sensor 5 continuously captures the scanned characters to obtain a sequence of image frames containing the scanned characters, wherein the contents of the two image frames at least one frame overlap in the image frame sequence partially overlap; the control module 2 according to the scanning
  • the speed of the image frame sequence is sampled, and the image frame to be sampled is used as a sample frame, and the image frame that is not downloaded is used as a skip frame, and each sample frame obtained after the sample is spliced.
  • the spliced panoramic image is obliquely corrected and subjected to character recognition, and the character code of the scanned character is obtained and stored in the memory 7.
  • the invention also discloses a frame skip scan identification method, as shown in FIG. 3, comprising the following steps:
  • Step 1 Perform continuous shooting on the scanned characters to obtain a sequence of image frames containing the scanned characters, wherein the contents of the two image frames at least one frame apart in the sequence of image frames are partially overlapped; and the selected characters are selected by the device of the present invention.
  • the control module 2 sends a control signal to the optical sensor 5.
  • the optical sensor 5 synchronously photographs the scanned characters in the text page continuously to obtain a sequence of image frames containing the scanned characters. Since the sampling rate of the optical sensor 5 reaches 120 frames/second, in the sequence of image frames collected by the optical sensor 5, the contents of the two image frames spaced apart by at least one frame partially overlap.
  • Step 2 The control module in the device performs a sample sequence on the image frame, and the image frame to be sampled is used as a sample frame, and the image frame that is not downloaded is used as a skip frame, which is obtained after the sample is downloaded. Each sample frame is spliced.
  • step two includes the following steps:
  • Step a calculating splicing information of the second sample frame and the first sample frame, splicing the second sample frame with the first sample frame according to the splicing information, and then updating the second sample frame to the first frame IP110277A
  • the splicing information includes a splicing direction, a horizontal splicing displacement, and a vertical splicing displacement; performing special processing on the Nth frame image of the image frame sequence, for example, performing special processing on the first frame image, that is, first of the image frame sequence
  • the frame property of the frame is set to a frame.
  • the image frame whose image frame number is 1 as shown in FIG. 6 is the first frame of the image frame sequence in this embodiment.
  • the first frame image in the image frame sequence is used as the first sample frame, and the sampling rate is one-half, that is, the number of skip frames is 1, and the image frame after skipping the frame is the second frame.
  • the first frame image in the image frame sequence that is, the image frame with the sequence number 1 is used as the first sample frame, and the sampling rate is one-half, that is, the number of skip frames is one.
  • the image frame with the sequence number 1 is skipped, and the second sample frame of the sequence number 3 is matched with the first sample frame number of the sequence number 1, and the stitching information of the two is calculated, including the horizontal stitching displacement Vx, vertical The splicing displacement Vy and the splicing direction are obtained, and the horizontal splicing displacement Vx is 2, the vertical splicing displacement Vy is 1, and the splicing direction is the lower right.
  • the second ⁇ frame of sequence number 3 and the number 1 are A sample frame is spliced, and the second sample frame of sequence number 3 is updated to the first sample frame.
  • Step b Calculate the sampling rate of the next squat sample according to the splicing information and the set minimum overlap ratio, obtain the second swatch frame, and return to step a; until all the image frames in the image frame sequence are finished.
  • the remaining image frames are divided into skip frames and sample frames. That is, the Nth frame is initialized to the first sample frame, the (M-1) frame is skipped (M > 1), and the (N+M) frame is initialized to the second sample frame.
  • the first frame is a first frame
  • the skip frame corresponding to the first frame the number of skip frames is determined according to the stitching information corresponding to the sample frame and the set minimum overlap ratio. Can be 1 or multiple frames.
  • the image frames associated with this embodiment are as shown in FIG. 6, and specifically include image frame number, image frame, overlap ratio, horizontal stitching displacement, vertical stitching displacement, stitching direction, and frame attributes.
  • the overlap ratio is a ratio of the number of pixel overlaps between the current sample frame and the previous sample frame to the total number of pixels in the sample frame, and the overlap ratio is too small, and the stitching accuracy is deteriorated, which may even cause the stitching to fail, and the stitching direction
  • the frame attribute has two values, which are the sample frame and the skip frame.
  • each image frame has a size of 120 x 80 and a lower sample frequency of 120 frames/second.
  • image frames IP110277A IP110277A
  • the image frame numbered X is called the X-th image frame.
  • the number of skip frames corresponding to the current sample frame is n
  • the number of skip frames corresponding to the previous sample frame of the current sample frame is t
  • the current sample frame is compared with the previous sample frame of the current sample frame.
  • the horizontal stitching displacement of the previous image frame is ⁇ ⁇ .
  • the current sample frame is relative to its previous image.
  • the vertical stitching displacement of the image frame is ⁇ ⁇
  • the height of each image frame is H
  • the width is W
  • the minimum overlap rate is T
  • Vx The displacement of an image frame in the X direction, and the scanning pen moves at a hook speed, then (n+1). Indicates the relative displacement of the next sample frame of the current sample frame and the current sample frame in the X direction.
  • the skip frame corresponding to the next sample frame of the current sample frame and the current sample frame may be obtained.
  • the number n of the number of skip frames of the current frame is not excessive.
  • the upper limit of the number n of skip frames is 3, in order to ensure that the existence of the skip frame does not reduce the splicing accuracy.
  • the minimum overlap ratio T is 0.5
  • the size of the image frame is I OxSO
  • the horizontal stitching displacement Vx of the third image frame relative to the first image frame is 2
  • the third image frame is relative to the vertical of the first image frame.
  • the second sample frame of sequence number 7 is matched with the first sample frame number of sequence number 3, and the splicing information of the two is calculated, and the horizontal splicing displacement Vx of the two image frames is 4, and the vertical splicing displacement Vy is 1.
  • the splicing direction is the lower right, and the second sample frame of sequence number 7 is spliced with the first sample frame of sequence number 3 according to the obtained splicing information, and the second frame frame of sequence number 7 is updated to the first frame. Sample frame.
  • the minimum overlap ratio T is 0.5
  • the number of skip frames corresponding to the first sample frame numbered 7 is 3
  • the size of the image frame is I OxSO
  • the horizontal stitching displacement of the 7th image frame relative to the third image frame is Vx. 4
  • the 116 image frames are stitched, since the size of the image frame is I O x SO , the horizontal stitching displacement Vx of the 120th image frame relative to the 116th image frame is 44, and the 120th image frame is relative to the 1st 16th.
  • Step 3 Perform character recognition on the spliced panoramic image and obtain the character encoding of the scanned character.
  • the control module calls the character recognition bow in the memory to identify the panoramic image obtained by the stitching, and firstly performs tilt correction on the stitched panoramic image before the character recognition, as shown in FIG. 8, the characters in the panoramic image are leveled.
  • the character recognition engine is called to recognize, and the character code of the scanned character is obtained.
  • the character code of the scanned character formed after recognition is stored in the memory.
  • the display unit can call the character to be scanned stored in the memory to be displayed on the liquid crystal screen, and the control module can transmit the character code of the scanned character to the TTS module according to the control signal, and the TTS module outputs the voice.
  • the invention discloses a frame skipping scanning recognition device and method for splicing a sequence of image frames acquired by a scanning pen.
  • the invention splicing the image frames in the image frame sequence collected by the optical sensor by the control module, and splicing the overlapping content in the obtained image frame to be spliced, thereby improving the splicing speed of the entire image frame sequence.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Character Input (AREA)
  • Studio Devices (AREA)

Abstract

本发明公开了一种跳帧扫描识别装置和方法，属于计算机外围设备领域。装置包括：用于拍摄图像的光学传感器和用于图像处理及识别字符的控制模块，光学传感器对被扫描字符进行连续拍摄以得到含有被扫描字符的图像帧序列；控制模块对图像帧序列进行下釆样，将被下釆样的图像帧作为釆样帧，未被下釆样的图像帧作为跳过帧，与所述釆样帧相邻的跳过帧的数量大于0；对下釆样后得到的各釆样帧进行拼接，对拼接得到的全景图像进行字符识别后存储,得到被扫描字符的字符编码。本发明通过控制模块对光学传感器釆集到的图像帧序列中的图像帧进行筛选，将得到的待拼接图像帧根据重叠内容进行拼接，提高了整个图像帧序列的拼接速度。

Description

跳帧扫描识别装置和方法 技术领域
本发明属于计算机外围设备领域， 涉及一种跳帧扫描识别装置和方 法， 具体涉及一种扫描识别所选择的字符序列的装置和方法。 背景技术
电子扫描笔（简称扫描笔）是 OCR的重要应用之一。 扫描笔的光学 摄像头按照一定频率对被扫描资料进行连续拍照， 获取被扫描资料的图 像帧序列， 然后将图像帧序列拼接成一幅全景图像后进行 OCR处理。
随着硬件技术的提高， 为了提高扫描笔支持的扫描速度峰值， 提高 用户的使用感受， 扫描笔使用的光学传感器的釆样频率越来越高， 比如 每秒釆集 120图像帧或者甚至更高， 当扫描笔的光学传感器釆样频率提 高时， 相比于较低的釆样频率， 在相同扫描速度下当前图像帧与其前一 帧之前的一个或多个图像帧有一定的重叠内容的概率更高。
CN1160657C公开了一种文字的记录方法和装置，该装置扫过该字符 序列， 光学传感器借助于一个二维传感器同步记录多个其内容部分重叠 的图像， 这些图像水平、 垂直地组合成为一幅全景图像， 并将全景图像 中的字符识别后存储在装置中。 但该发明的信号控制单元只能通过重叠 内容将每个图像帧与前一个图像帧垂直地和水平地组合， 这样每两帧相 邻的图像帧就必然进行组合， 当扫描笔的釆样率过高时， 相邻两图像帧 的内容重叠的比例就很大， 信号控制单元就没有必要将光学传感器釆集 到的所有图像帧均以两两组合的方式进行图像拼接， 这样不但使控制模 块的负荷大大加重， 占用了硬件资源， 而且也降低了整个图像帧序列的 拼接速度。 发明内容
本发明所要解决的技术问题为提供了一种跳帧扫描识别装置和方 法， 通过对釆集到的图像帧序列中的图像帧进行下釆样， 对得到的待拼 接图像帧进行拼接， 提高了整个图像帧序列的拼接速度。 本发明公开了一种跳帧扫描识别装置， 包括用于拍摄图像的光学传 感器和用于图像处理及识别字符的控制模块， 光学传感器对被扫描字符 进行连续拍摄以得到含有被扫描字符的图像帧序列， 所述图像帧序列中 间隔至少一帧的两图像帧内容部分重叠； 控制模块对图像帧序列进行下 釆样， 将被下釆样的图像帧作为釆样帧， 未被下釆样的图像帧作为跳过 帧， 与所述釆样帧相邻的跳过帧的数量大于 0; 对下釆样后得到的各釆 样帧进行拼接， 对拼接得到的全景图像进行字符识别后存储， 得到被扫 描字符的字符编码。
所述控制模块包括：
初始化单元， 将图像帧序列的第 N帧图像设置为第一釆样帧， 将与 第一釆样帧间隔跳过帧个数的图像帧设为第二釆样帧， 其中 N为大于等 于 1的自然数； 拼接单元， 计算第二釆样帧与第一釆样帧的拼接信息， 根据拼接信息将第二釆样帧与第一釆样帧进行拼接， 然后将第二釆样帧 更新为第一釆样帧； 所述拼接信息包括拼接方向、 水平拼接位移和竖直 拼接位移；
釆样单元， 根据拼接信息及设定的最小重叠率计算下一次下釆样的 釆样率， 得到第二釆样帧， 返回拼接单元； 直至图像帧序列中所有图像 帧下釆样完毕。
本发明还公开了一种跳帧扫描识别方法， 包括如下步骤： 步骤一， 对被扫描字符进行连续拍摄以得到含有被扫描字符的图像 帧序列， 所述图像帧序列中间隔至少一帧的两图像帧内容部分重叠； 步骤二， 装置中的控制模块对图像帧序列进行下釆样， 将被下釆样 的图像帧作为釆样帧， 未被下釆样的图像帧作为跳过帧， 与所述釆样帧 相邻的跳过帧的数量大于 0 , 对下釆样后得到的各釆样帧进行拼接； 步骤三， 对拼接得到的全景图像进行字符识别后存储， 得到被扫描 字符的字符编码。
在所述步骤二之前， 还可以将图像帧序列的第 N帧图像设为第一釆 样帧， 其中 N为大于等于 1的整数， 将与第一釆样帧间隔跳过帧个数的 图像帧设为第二釆样帧。
例如， 将图像帧序列中首帧图像作为第一釆样帧， 釆样率为二分之 一， 即跳过帧数为 1 , 跳过帧之后的图像帧为第二釆样帧。
所述步骤二包括：
步骤 a , 计算第二釆样帧与第一釆样帧的拼接信息， 根据拼接信息 将第二釆样帧与第一釆样帧进行拼接， 然后将第二釆样帧更新为第一釆 样帧；
步骤 b , 根据拼接信息及设定的最小重叠率计算下一次下釆样的釆 样率， 得到第二釆样帧， 返回步骤 a ; 直至图像帧序列中所有图像帧下 釆样完毕。
所述步骤二还包括将图像帧序列中末帧图像作为第二釆样帧。 所述拼接信息包括拼接方向、 水平拼接位移和竖直拼接位移。 所述字符识别之前倾斜校正得到的全景图像， 使全景图像中的各字 符形成水平文字行。
本发明公开的一种跳帧扫描识别装置和方法， 通过控制模块对光学 传感器釆集到的图像帧序列中的图像帧进行筛选， 根据得到的待拼接图 像帧中的重叠内容进行拼接， 提高了整个图像帧序列的拼接速度。 附图说明
图 1为本发明跳帧扫描识别装置的示意图；
图 2为本发明跳帧扫描识别装置的结构框图；
图 3为本发明跳帧扫描识别方法的流程图；
图 4为本发明跳帧扫描识别方法中步骤二的流程图；
图 5为本发明跳帧扫描识别方法中釆样帧和跳过帧的示意图； 图 6为本发明跳帧扫描识别方法实施例中各图像帧及相关数据的示 意图；
图 7为本发明跳帧扫描识别方法的实施例中全景二值图像； 图 8为本发明跳帧扫描识别方法的实施例中倾斜校正后的全景二值 图像。
图中： 1、 壳体 2、 控制模块 3、 电路板 4、 电池 5、 光学传感器 6、 按键 7、 存储器 8、 液晶屏 9、 USB模块 10、 显示单元 11、 TTS模块 12、 镜头组 1 3、 照明单元 IP110277A 具体实施方式
下面将结合本发明实施例中的附图， 对本发明实施例中的技术方案 进行清楚、 完整地描述， 显然， 所描述的实施例仅仅是本发明一部分实 施例， 而不是全部的实施例。 基于本发明中的实施例， 本领域普通技术 人员所获得的所有其他实施例， 都属于本发明保护的范围。
本发明公开了一种跳帧扫描识别装置， 如图 1、 图 2所示， 包括如 下组件： 用于封装并固定装置组件的壳体 1 , 用于图像处理及文字识别 的控制模块 2 ,用于集成组件的电路板 3 ,用于为装置各组件供电的电池 4 , 用于使字符成像的光学传感器 5 , 用于触发釆集操作的按键 6 , 用于 装载字符识别引擎的存储器 7 ,用于显示输出信息的液晶屏 8 ,用于连接 计算机的 USB模块 9 , 用于驱动液晶屏 8的显示单元 1 0和用于输出语音 的 TTS模块 1 1。 电路板 3集成了控制模块 2、 光学传感器 5、 存储器 7、 显示单元 1 0、 TTS模块 1 1和 USB模块 9。 壳体 1封装液晶屏 8、 电池 4、 按键 6和电路板 3。 按键 6与电路板 3上的光学传感器 5连接， 将控制 信号发送到光学传感器 5。 光学传感器 5对被扫描字符进行连续高速拍 摄以得到含有被扫描字符的图像帧序列， 所述图像帧序列中间隔至少一 帧的两图像帧内容部分重叠； 控制模块 2根据扫描速度对图像帧序列进 行下釆样， 将被下釆样的图像帧作为釆样帧， 未被下釆样的图像帧作为 跳过帧， 对下釆样后得到的各釆样帧进行拼接， 对拼接得到的全景图像 倾斜校正后进行字符识别， 得到被扫描字符的字符编码。
如图 2所示， 电路板 3集成了控制模块 2、光学传感器 5、存储器 7、 显示单元 1 0、 TTS模块 1 1和 USB模块 9。控制模块 2分别连接存储器 7、 光学传感器 5、显示单元 1 0和 TTS模块 1 1。 在控制模块 2的控制下， 用 户通过按键 6触发釆集操作， 将控制信号发送到光学传感器 5 , 光学传 感器 5进行图像信息釆集， 得到图像帧序列， 控制模块 2根据扫描速度 对图像帧序列进行下釆样， 将被下釆样的图像帧作为釆样帧， 未被下釆 样的图像帧作为跳过帧， 对下釆样后得到的各釆样帧进行拼接， 对拼接 得到的全景图像倾斜校正后调用存储器 7中的识别引擎进行字符识别， 并将识别后形成的被扫描字符的字符编码在存储器 7中进行存储。 显示 IP110277A
单元 1 0可调用存储在存储器 7中识别出的待扫描字符在液晶屏 8上进行 显示， 控制模块 2可根据控制信号将被扫描字符的字符编码发送到 TTS 模块 1 1 , 由 TTS模块 1 1输出语音。
如图 1所示， 本发明还包括， 用于摄取图像信息的镜头组 12 ; 用于 照明待扫描字符的照明单元 1 3。所述镜头组 12的焦距为 5至 7mm,光圈 1 0以上，保证了镜头组 12达到的景深为 30至 50mm, 可以有效地将文字 信息进行扫描， 保证了良好的应用效果。 当用户进行扫描时， 照明单元 1 3处于开启状态， 照明单元 1 3发出光束并在被扫描字符上形成光斑， 同时镜头组 12将照明单元 1 3定位的图像信息摄取到集成于电路板 3上 的光学传感器 5上， 光学传感器 5对被扫描字符进行连续拍摄， 得到含 有被扫描字符的图像帧序列， 所述图像帧序列中间隔至少一帧的两图像 帧内容部分重叠； 控制模块 2根据扫描速度对图像帧序列进行下釆样， 将被下釆样的图像帧作为釆样帧， 未被下釆样的图像帧作为跳过帧， 对 下釆样后得到的各釆样帧进行拼接， 将拼接得到的全景图像倾斜校正后 进行字符识别， 得到被扫描字符的字符编码并存储到存储器 7中。
本发明还公开了一种跳帧扫描识别方法， 如图 3所示， 包括如下步 骤：
步骤一， 对被扫描字符进行连续拍摄以得到含有被扫描字符的图像 帧序列， 所述图像帧序列中间隔至少一帧的两图像帧内容部分重叠； 釆用本发明所述装置选择被扫描字符时， 控制模块 2将控制信号发 送到光学传感器 5 , 在选择被扫描字符时， 光学传感器 5 同步地对文本 页中的被扫描字符进行连续拍摄，以得到含有被扫描字符的图像帧序列。 由于光学传感器 5的釆样率达到了 120帧 /秒，所以在光学传感器 5釆集 到的图像帧序列中， 间隔至少一帧的两图像帧的内容部分重叠。
步骤二， 装置中的控制模块对图像帧序列进行下釆样， 将被下釆样 的图像帧作为釆样帧， 未被下釆样的图像帧作为跳过帧， 对下釆样后得 到的各釆样帧进行拼接。
如图 4所示， 步骤二包括如下步骤：
步骤 a , 计算第二釆样帧与第一釆样帧的拼接信息， 根据拼接信息 将第二釆样帧与第一釆样帧进行拼接， 然后将第二釆样帧更新为第一釆 IP110277A
样帧； 所述拼接信息包括拼接方向、 水平拼接位移和竖直拼接位移； 对图像帧序列的第 N帧图像进行特殊处理， 例如对第一帧图像进行 特殊处理， 即将图像帧序列的第一帧的帧属性设为釆样帧。本实施例中， 如图 6所示的图像帧序号为 1的图像帧为本实施例中图像帧序列的第一 帧。 将图像帧序列中首帧图像作为第一釆样帧， 釆样率为二分之一， 即 跳过帧数为 1 , 跳过帧之后的图像帧为第二釆样帧。
本实施例中， 如图 6所示， 将图像帧序列中首帧图像， 即序号为 1 的图像帧作为第一釆样帧， 釆样率为二分之一， 即跳过帧数为 1 , 则将 序号为 1的图像帧跳过， 将序号为 3的第二釆样帧与序号为 1的第一釆 样帧进行匹配， 计算两者的拼接信息， 包括水平拼接位移 Vx、 竖直拼接 位移 Vy及拼接方向，得到水平拼接位移 Vx为 2 , 竖直拼接位移 Vy为 1 , 拼接方向为右下， 根据得到的拼接信息将序号为 3的第二釆样帧与序号 为 1的第一釆样帧进行拼接， 并将序号为 3的第二釆样帧更新为第一釆 样帧。
步骤 b , 根据拼接信息及设定的最小重叠率计算下一次下釆样的釆 样率， 得到第二釆样帧， 返回步骤 a ; 直至图像帧序列中所有图像帧下 釆样完毕。
扫描笔获取的整个图像帧序列中除前（N+M ) 帧用作初始化之外， 剩余图像帧被划分为跳过帧和釆样帧。即将第 N帧初始化为第一釆样帧， 跳过（M-1 )帧（M > 1 ),将第（N+M)帧初始化为第二釆样帧。如图 5所示， 其第一帧为第一釆样帧， 与第一釆样帧对应的跳过帧， 跳过帧的数目根 据釆样帧对应的拼接信息及设定的最小重叠率确定， 可以为 1 , 也可以 为多帧。
本实施例中相关的各图像帧如图 6所示， 具体包括图像帧序号、 图 像帧、 重叠率、 水平拼接位移、 竖直拼接位移、 拼接方向及帧属性。 其 中， 重叠率为当前釆样帧与上一釆样帧之间的像素重叠数与釆样帧内总 像素数的比值， 重叠率过小时， 拼接准确性变差甚至会导致拼接失败， 拼接方向共有四个取值， 分别为右下、 右上、 左下、 左上， 帧属性有两 个取值， 分别为釆样帧和跳过帧。 在本实施例中， 各图像帧的大小为 120 x 80 , 下釆样频率为 120帧 /秒。 在本实施例中， 为方便叙述， 图像帧 IP110277A
序号为 X的图像帧称为第 X图像帧。
在本实施例中， 假设扫描笔在以当前时刻为中心的小时间段内作匀 速运动， 实际中扫描笔的速度在该时间段内可能会有一定变化， 但是并 不影响该假设的计算有效性。 各釆样帧对应的跳过帧数目的计算方法如 下：
设当前釆样帧对应的跳过帧的数目为 n , 当前釆样帧的上一釆样帧 对应的跳过帧数目为 t , 当前釆样帧相对于当前釆样帧的上一釆样帧的 水平拼接位移 Vx , 由于 4叚设扫描笔作勾速运动， 则当前釆样帧相对于其
Vx
前一图像帧的水平拼接位移为^ Ϊ , 同理， 当前釆样帧相对于其前一图
Vy
像帧的竖直拼接位移为^ Ϊ , 各图像帧的高度为 H , 宽度为 W, 最小重叠 率为 T, 则有： T
Figure imgf000009_0001
Vx
在公式中， 由于 ^ + 1表示为当前釆样帧相对于当前釆样帧紧邻的前
Vx 一图像帧在 X方向上的位移， 且扫描笔作勾速运动， 则 （n+1 ) . 表 示当前釆样帧的下一釆样帧与当前釆样帧在 X 方向上的相对位移， （W-
Vx
( n+1 ) · l )即表示当前釆样帧的下一釆样帧与当前釆样帧在 X方向上
Vy
的重叠长度， 同理， （H- ( n+1 ) · )表示当前釆样帧的下一釆样帧与
( Vx V Vy
W- (n+D— ^ H- (n+1 )-^- 当前釆样帧在 Y方向上的重叠高度 Λ ί + 1八 则表示 当前釆样帧的下一釆样帧与 当前釆样帧的重叠面积， 在 IP110277A
Figure imgf000010_0001
, 即当前釆样帧的下一釆样帧与当前釆 样帧的重叠率大于最小重叠率时， 可得到当前釆样帧的下一釆样帧与当 前釆样帧之间对应的跳过帧的数目 n, 为了保证跳过帧的存在不降低拼 接准确性， 当前釆样帧对应的跳过帧数目不能过多， 本实施例中， 设跳 过帧的数目 n的上限为 3。
本实施例中， 最小重叠率 T为 0.5, 图像帧的大小为 I OxSO, 第 3 图像帧相对于第 1图像帧的水平拼接位移 Vx为 2, 第 3图像帧相对于第 1 图 像 帧 的 竖 直 拼 接 位 移 Vy 为 0 , 则 根 据
Figure imgf000010_0002
, 计算得到整数 n约为 39, 大于跳过帧 的数目的上限 3, 则取 n=3,对应的釆样率为 1/4, 则取第 7图像帧作为 第二釆样帧； 返回步骤&。
将序号为 7的第二釆样帧与序号为 3的第一釆样帧进行匹配， 计算 两者的拼接信息， 得到两图像帧的水平拼接位移 Vx为 4, 竖直拼接位移 Vy为 1, 拼接方向为右下， 根据得到的拼接信息将序号为 7的第二釆样 帧与序号为 3的第一釆样帧进行拼接， 并将序号为 7的第二釆样帧更新 为第一釆样帧。
由于最小重叠率 T为 0.5, 序号为 7的第一釆样帧对应的跳过帧数 目 t为 3, 图像帧的大小为 I OxSO, 第 7图像帧相对于第 3图像帧的水 平拼接位移 Vx为 4, 第 7图像帧相对于第 3图像帧的竖直拼接位移 Vy
为 1，
Figure imgf000010_0003
,计算得到整数 n约为 35, 大于跳过帧的数目的上限 3, 则取 n=3,对应的釆样率为 1/4, 则以第 11 图像帧为起始， 取第 11图像帧作为第二釆样帧； 返回步骤 a, 将序号为 11的第二釆样帧与序号为 Ί的第一釆样帧进行拼接， 依次类推， 当序号 为 120的第一釆样帧对应的跳过帧数目 t为 3时， 第 120图像帧已与第 IP110277A
116 图像帧进行拼接， 由于图像帧的大小为 I O x SO , 第 120图像帧相对 于第 116图像帧的水平拼接位移 Vx为 44 , 第 120图像帧相对于第 1 16
T
图像帧的竖直拼接位移 Vy为 2 ,则根据
Figure imgf000011_0001
, 计算得到整数 n约为 2 , 小于跳过帧的数目的上限 3 , 则取 n=2,对应的 釆样率为 1 / 3 , 则取第 123图像帧作为第二釆样帧； 返回步骤 a , 将序号 为 123的第二釆样帧与序号为 120的第一釆样帧进行拼接， 如此处理， 以迭代的方式对跳过帧的数目进行计算， 并对计算得到的釆样帧进行拼 接， 直至图像帧序列中所有图像帧下釆样完毕， 即可获取全景图像， 本 实施例中， 最终获取的全景二值图像如图 7所示。
步骤三， 对拼接得到的全景图像进行字符识别后存储， 得到被扫描 字符的字符编码。
控制模块调用存储器中的字符识别弓 )擎对拼接得到的全景图像进 行识别， 在字符识别之前首先对拼接得到的全景图像进行倾斜校正， 如 图 8所示， 将全景图像中的各字符形成水平文字行后再调用字符识别引 擎进行识别， 得到被扫描字符的字符编码。 识别后形成的被扫描字符的 字符编码在存储器中进行存储。 显示单元可调用存储在存储器中识别出 的待扫描字符在液晶屏上进行显示， 控制模块可根据控制信号将被扫描 字符的字符编码发送到 TTS模块， 由 TTS模块输出语音。
本发明公开了一种跳帧扫描识别装置和方法， 针对扫描笔获取的图 像帧序列进行拼接。 本发明通过控制模块对光学传感器釆集到的图像帧 序列中的图像帧进行下釆样， 对得到的待拼接图像帧中的重叠内容进行 拼接， 提高了整个图像帧序列的拼接速度。
以上对本发明所提供的一种跳帧扫描识别装置和方法， 进行了详细 以上实施例的说明只是用于帮助理解本发明的方法及其核心思想；同时， 对于本领域的一般技术人员， 依据本发明的思想， 在具体实施方式及应 用范围上均会有改变之处。 综上所述， 本说明书内容不应理解为对本发 明的限制。

Claims

1. 一种跳帧扫描识别装置， 包括用于拍摄图像的光学传感器和用 于图像处理及识别字符的控制模块， 其特征在于： 光学传感器对被扫描 字符进行连续拍摄以得到含有被扫描字符的图像帧序列 , 所述图像帧序 列中间隔至少一帧的两图像帧内容部分重叠； 控制模块对图像帧序列进 行下釆样， 将被下釆样的图像帧作为釆样帧， 未被下釆样的图像帧作为 跳过帧， 与所述釆样帧相邻的跳过帧的数量大于 0; 对下釆样后得到的 各釆样帧进行拼接， 对拼接得到的全景图像进行字符识别后存储， 得到 被扫描字符的字符编码。
2. 根据权利要求 1 所述的装置， 其特征在于： 还包括照明单元， 用于照明待扫描字符。
3. 根据权利要求 1所述的装置， 其特征在于：
所述控制模块包括：
初始化单元， 将图像帧序列的第 N帧图像设为第一釆样帧， 将与第 一釆样帧间隔跳过帧个数的图像帧设为第二釆样帧， 其中 N为大于等于 1的自然数；
拼接单元， 计算第二釆样帧与第一釆样帧的拼接信息， 根据拼接信 息将第二釆样帧与第一釆样帧进行拼接， 然后将第二釆样帧更新为第一 釆样帧； 所述拼接信息包括拼接方向、 水平拼接位移和竖直拼接位移； 釆样单元， 根据拼接信息及设定的最小重叠率计算下一次下釆样的 釆样率， 得到第二釆样帧， 返回拼接单元； 直至图像帧序列中所有图像 帧下釆样完毕。
4. 根据权利要求 1或 3所述的装置， 其特征在于： 还包括显示单 元， 用于显示识别出的待扫描字符。
5. 一种应用于权利要求 1 所述装置的跳帧扫描识别方法， 其特征 在于， 包括如下步骤：
步骤一， 对被扫描字符进行连续拍摄以得到含有被扫描字符的图像 帧序列， 所述图像帧序列中间隔至少一帧的两图像帧内容部分重叠； 步骤二， 对图像帧序列进行下釆样， 将被下釆样的图像帧作为釆样 帧， 未被下釆样的图像帧作为跳过帧， 与所述釆样帧相邻的跳过帧的数 量大于 0 , 对下釆样后得到的各釆样帧进行拼接；
步骤三， 对拼接得到的全景图像进行字符识别后存储， 得到被扫描 字符的字符编码。
6. 根据权利要求 5 所述的方法， 其特征在于， 所述对被扫描字符 进行同步拍摄时， 釆用照明单元对被扫描字符进行照明。
7.根据权利要求 5所述的方法， 其特征在于， 在所述步骤二之前， 将图像帧序列的第 N帧图像设为第一釆样帧， 将与第一釆样帧间隔跳过 帧个数的图像帧设为第二釆样帧， 其中 N为大于等于 1的自然数。
8.根据权利要求 7所述的方法， 其特征在于， 将图像帧序列中首帧 图像作为第一釆样帧， 釆样率为二分之一， 即跳过帧数为 1 , 跳过帧之 后的图像帧为第二釆样帧。
9. 根据权利要求 7所述的方法， 其特征在于， 所述步骤二包括： 步骤 a , 计算第二釆样帧与第一釆样帧的拼接信息， 根据拼接信息 将第二釆样帧与第一釆样帧进行拼接， 然后将第二釆样帧更新为第一釆 样帧；
步骤 b , 根据拼接信息及设定的最小重叠率计算下一次下釆样的釆 样率， 得到第二釆样帧， 返回步骤 a ; 直至图像帧序列中所有图像帧下 釆样完毕。
10. 根据权利要求 9所述的方法， 其特征在于： 所述步骤二还包括， 将图像帧序列中末帧图像作为第二釆样帧。
11 . 根据权利要求 9所述的方法， 其特征在于： 所述拼接信息包括 拼接方向、 水平拼接位移和竖直拼接位移。
12. 根据权利要求 5所述的方法， 其特征在于： 所述字符识别之前 对拼接得到的全景图像进行倾斜校正， 使全景图像中的各字符形成水平 文字行。
PCT/CN2012/071518 2011-05-27 2012-02-23 跳帧扫描识别装置和方法 WO2012163112A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN2011101413510A CN102222222A (zh) 2011-05-27 2011-05-27 跳帧扫描识别装置和方法
CN201110141351.0 2011-05-27

Publications (1)

Publication Number Publication Date
WO2012163112A1 true WO2012163112A1 (zh) 2012-12-06

Family

ID=44778770

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/071518 WO2012163112A1 (zh) 2011-05-27 2012-02-23 跳帧扫描识别装置和方法

Country Status (2)

Country Link
CN (1) CN102222222A (zh)
WO (1) WO2012163112A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113628113A (zh) * 2021-08-11 2021-11-09 科大讯飞股份有限公司 一种图像拼接方法及其相关设备

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102222222A (zh) * 2011-05-27 2011-10-19 汉王科技股份有限公司 跳帧扫描识别装置和方法
CN102622826A (zh) * 2011-12-21 2012-08-01 福建联迪商用设备有限公司 一种手持扫描设备
CN106204420B (zh) * 2016-06-29 2019-01-29 深圳市优象计算技术有限公司 一种笔式图像扫描拼接方法与装置
CN107147624B (zh) * 2017-04-24 2019-11-22 珠海全志科技股份有限公司 全景图像处理方法、显示装置及播放设备
CN111950463B (zh) * 2020-08-13 2023-03-10 安徽淘云科技股份有限公司 扫描方法、装置、扫描笔和存储介质
CN112383671B (zh) * 2020-11-03 2022-10-04 安徽淘云科技股份有限公司 扫描方法、装置、扫描笔和存储介质
CN114429636B (zh) * 2022-04-06 2022-07-12 中国科学院自动化研究所 图像扫描识别方法、装置及电子设备
CN117424968A (zh) * 2023-12-15 2024-01-19 深圳市贝铂智能科技有限公司 智能扫描的数据安全传输方法、装置以及智能扫描笔

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100517371C (zh) * 2007-06-04 2009-07-22 北京航空航天大学 基于波形匹配的指纹图像帧序列的拼接方法
WO2009114967A1 (zh) * 2008-03-19 2009-09-24 东莞市步步高教育电子产品有限公司 基于移动扫描的图像处理方法及装置
CN201662767U (zh) * 2010-04-26 2010-12-01 汉王科技股份有限公司 图像采集装置
CN102073847A (zh) * 2010-12-24 2011-05-25 汉王科技股份有限公司 一种扫描装置和扫描方法
CN102222222A (zh) * 2011-05-27 2011-10-19 汉王科技股份有限公司 跳帧扫描识别装置和方法

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SE509327C2 (sv) * 1996-11-01 1999-01-11 C Technologies Ab Sätt och anordning för registrering av tecken med hjälp av en penna
US8259806B2 (en) * 2006-11-30 2012-09-04 Dolby Laboratories Licensing Corporation Extracting features of video and audio signal content to provide reliable identification of the signals
CN101827264A (zh) * 2009-03-06 2010-09-08 刘永 分层式自适应的视频帧采样方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100517371C (zh) * 2007-06-04 2009-07-22 北京航空航天大学 基于波形匹配的指纹图像帧序列的拼接方法
WO2009114967A1 (zh) * 2008-03-19 2009-09-24 东莞市步步高教育电子产品有限公司 基于移动扫描的图像处理方法及装置
CN201662767U (zh) * 2010-04-26 2010-12-01 汉王科技股份有限公司 图像采集装置
CN102073847A (zh) * 2010-12-24 2011-05-25 汉王科技股份有限公司 一种扫描装置和扫描方法
CN102222222A (zh) * 2011-05-27 2011-10-19 汉王科技股份有限公司 跳帧扫描识别装置和方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113628113A (zh) * 2021-08-11 2021-11-09 科大讯飞股份有限公司 一种图像拼接方法及其相关设备

Also Published As

Publication number Publication date
CN102222222A (zh) 2011-10-19

Similar Documents

Publication Publication Date Title
WO2012163112A1 (zh) 跳帧扫描识别装置和方法
JP4715888B2 (ja) 画像処理装置及びコンピュータプログラム
US8619120B2 (en) Imaging apparatus, imaging method and recording medium with program recorded therein
US9007429B2 (en) Image processing device capable of generating wide-range image
US20110228123A1 (en) Imaging apparatus and recording medium with program recorded therein
CN1604620A (zh) 图像捕获设备、图像显示方法和程序
US8963993B2 (en) Image processing device capable of generating wide-range image
CN110290320B (zh) 视频预览图生成方法和装置、电子设备、计算机可读存储介质
CN110636216B (zh) 图像处理方法和装置、电子设备、计算机可读存储介质
CN108513069B (zh) 图像处理方法、装置、存储介质及电子设备
CN108012073B (zh) 一种实现全景拍摄的方法及装置
JP4894708B2 (ja) 撮像装置
CN102324027B (zh) 扫描识别装置和方法
KR101265613B1 (ko) 영상 촬영 장치 및 영상 촬영 장치의 파노라마 이미지 제작방법
US8860844B2 (en) Image processing that generates high definition and general definition video at the same time
CN113287295A (zh) 摄像元件、摄像装置、摄像元件的工作方法及程序
US9565358B2 (en) Apparatus and method for scanning and recognizing
KR100810344B1 (ko) 디지털 촬영 장치와 이를 이용한 스미어 현상 검출 및 보정방법
WO2020196384A1 (ja) 画像処理装置、画像処理方法及びプログラム、撮影装置
JP6569015B2 (ja) 撮像装置、撮像方法、及び、撮像プログラム
JP2008098739A (ja) 撮像装置、撮像装置に用いられる画像処理方法および当該画像処理方法をコンピュータに実行させるプログラム
JP2006186930A (ja) 撮像装置、画像処理方法及びプログラム
JP6979799B2 (ja) カメラおよび動画の撮影方法
JP4803315B2 (ja) 画像処理装置及びコンピュータプログラム
JP2008172501A (ja) 撮像装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12792099

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 14/03/2014)

122 Ep: pct application non-entry in european phase

Ref document number: 12792099

Country of ref document: EP

Kind code of ref document: A1