JP3931651B2 - Image processing device - Google Patents

Description

【００５４】
次いで、注目エッジ間線分に位置する総画素数Ｎ１と所定の定数Ｔ１との比率Ｒ１（＝Ｎ１／Ｔ１）が、算出される（ステップＳ４０５）。定数Ｔ１は、写真領域と図形領域とを分離するための第１のパラメータである。続いて、閾値である比率Ｒ１と特徴量とが比較される（ステップＳ４０６）。特徴量が、比率Ｒ１より大きいと判断される場合（ステップＳ４０６：ＮＯ）、第１方向に関するエッジ間線分に位置する画素の全ては、図形領域に属しているとみなされ、番号を割り当てる処理であるラベリングが実行され、ラベリングデータが生成される（ステップＳ４０７）。すなわち、各画素に対して領域判定の結果をラベリングする。具体的には、領域判定の結果が画素位置と対応して保存される。一方、特徴量が、比率Ｒ１以下であると判断される場合（ステップＳ４０６：ＹＥＳ）、第１方向に関するエッジ間線分に位置する画素の全ては、写真領域に属しているとみなされ、ラベリングデータが生成される（ステップＳ４０８）。続いて、注目エッジ間線分が、第１方向に関する最終エッジ間線分であるか否かが判断される（ステップＳ４０８）。注目エッジ間線分が、最終エッジ間線分でないと判断される場合（ステップＳ４０８：ＮＯ）、ステップＳ４０２に戻って、上記処理が繰り返される。
【００５５】
次に、図１５のエッジ画像に基づいて、第１方向と直交する方向である第２方向、たとえば副走査方向に関するエッジ間線分の位置が検出される（ステップＳ４１０）。そして、ステップＳ４０７およびＳ４０８で作成されたラベリングデータに基づいて、注目エッジ間線分に位置する総画素数Ｎ２と写真領域に属する画素数Ｎ３との比率Ｒ２（＝Ｎ３／Ｎ２）が、算出される（ステップＳ４１１）。続いて、比率Ｒ２と閾値である所定の定数Ｔ２とが比較される（ステップＳ４１２）。定数Ｔ２は、写真領域と図形領域とを分離するための第２のパラメータである。比率Ｒ２が、定数Ｔ２よりも小さいと判断される場合（ステップＳ４１２：ＮＯ）、第２方向に関する注目エッジ間線分に存在している画素の全てが、図形領域に属するとみなされ、ラベリングし直される（ステップＳ４１３）。一方、比率Ｒ２が、定数Ｔ２以上と判断される場合（ステップＳ４１２：ＹＥＳ）、第２方向に関する注目エッジ間線分に位置する画素の全てが、写真領域に属すると見なされ、ラベリングし直される（ステップＳ４１４）。続いて、注目エッジ間線分が、第２方向に関する最終エッジ間線分であるか否かが判断される（ステップＳ４１５）。注目エッジ間線分が、最終エッジ間線分でないと判断される場合（ステップＳ４１５：ＮＯ）、ステップＳ４１１に戻って、上記処理が繰り返される。
【００５６】
次に、２値化による領域分割により得られた一つの領域内で、写真領域に属するとラベリングされた画素の数Ｎ５と図形領域に属するとラベリングされた画素の数Ｎ４とが比較される（ステップＳ４１６）。Ｎ５＜Ｎ４と判断される場合（ステップＳ４１６：ＮＯ）、当該領域は図形領域と判定される（ステップＳ４１７）。一方、Ｎ５≧Ｎ４と判断される場合（ステップＳ４１６：ＹＥＳ）、当該領域は写真領域と判定される（ステップＳ４１８）。そして、写真領域または図形領域のうち優先度が高い方の領域の判定が確定されるとともに、当該領域内の画素の全てが、優先度が高い方の領域に属するとみなされ、ラベリングし直されて、画像データから抽出される（ステップＳ４１９）。ここで、位置データに基づいて領域の輪郭を追跡することによって領域の外接矩形が算出され、外接矩形内の座標位置に対応していて当該領域に属するとラベリングされた画素を含む矩形領域が、画像データから抽出される。
【００５７】
このように第１写真／図形領域抽出においては、２値化による領域分割が行われて得られた領域に対して、領域の境界であるエッジの間の画像特徴量を算出することにより、当該領域が写真領域であるか図形領域であるかが判定される。そして、写真領域の方が図形領域よりも優先度が高い場合（第１、第２、および第５モード）、写真領域が確定され、当該領域が矩形領域の形で抽出される。一方、図形領域の方が写真領域よりも優先度が高い場合（第３、第４、および第６モード）、図形領域が確定され、当該領域が矩形領域の形で抽出される。
【００５８】
本実施形態では、上記のように、図形領域の明度分布はある程度均一である一方で、写真領域の明度分布は分散しているという特徴に基づいて、写真領域であるかまたは図形領域であるかが判定される。ただし、領域の判定方法は、これに限定されるものではなく、たとえば明度画像から抽出される周波数成分を特徴量として用いて領域の判定を行ってもよい。
【００５９】
（エッジによる領域分割）
次に、図２０を参照して、エッジによる領域分割の手順について説明する。
【００６０】
エッジによる領域分割は、第１写真／図形領域抽出によって写真領域または図形領域のうち優先度が高い方の領域が抽出されて残ったデータに対して、実行される。
【００６１】
まず、画像データにおけるＲ成分画像、Ｇ成分画像、およびＢ成分画像のそれぞれに対して、たとえばラプラシアンフィルタなどのエッジ検出フィルタを使用することにより、エッジ検出が行われる（ステップＳ５０１〜Ｓ５０３）。続いて、検出されたＲ成分画像、Ｇ成分画像、およびＢ成分画像の各エッジの和集合を得るためのＯＲ処理が行われ（ステップＳ５０４）、さらにエッジの途切れをなくすために、クロージング処理が行われる（ステップＳ５０５）。ここで、第１〜第４モードの場合、文字領域の抽出がまだ行われていない段階であるため、文字画像のエッジも検出されてしまう。しかし、たとえば、領域の外接矩形の大きさ（縦および横寸法）が所定の閾値より小さく、外接矩形の大きさに対する領域内部の有効画素数の割合が所定の閾値より小さい場合、当該領域は、エッジによる領域分割の対象から除外される。これにより、文字画像のエッジは、領域の境界とはみなされなくなる。
【００６２】
図２１は、エッジによる領域分割によって得られた領域の一例を模式的に示す図であって、（Ａ）は、第１、第２、または第５モードの場合、（ｂ）は、第３、第４、または第６モードの場合を示す。ここで、図２１（Ａ）では、第１写真／図形領域抽出によって、図形領域よりも先に写真領域が既に抽出されている。つまり、図２１（Ｂ）に示す領域Ｐ１（領域Ｇ３を含む）、および領域Ｐ２は、図２１（Ａ）においては写真領域として抽出済みである。また、図２１（Ｂ）では、第１写真／図形領域抽出によって、写真領域よりも先に図形領域が既に抽出されている。つまり、図２１（Ａ）に示す領域Ｇ１、および領域Ｇ２（領域Ｐ３、Ｐ４を含む）は、図２１（Ｂ）においては写真領域として抽出済みである。
【００６３】
このようにエッジによる領域分割は、第１写真／図形領域抽出によって写真領域または図形領域のうち優先度の高い方の領域が抽出されて残ったデータの中に、優先度の高い方の領域が優先度の低い方の領域上に重なった状態でまだ残っている場合、あるいは優先度が高い方の領域が優先度の低い方の領域の内部に含まれた状態でまだ残っている場合に、当該優先度が高い方の領域をさらに抽出するために行われる。つまり、上記エッジを検出することによって、より細かい領域分割が行われる。
【００６４】
（第２写真／図形領域抽出）
次に、第２写真／図形領域抽出の手順について説明する。第２写真／図形領域抽出は、図２１に示されるエッジによる領域分割によって得られた領域に対して、前述した第１写真／図形領域抽出と同様の処理が再度行われる。これにより、第１、第２、および第５モードの場合、第１写真／図形領域抽出によっては写真領域として抽出されなかった図形領域中の写真領域が抽出される。たとえば図２１（Ａ）では、領域Ｐ３、Ｐ４が写真領域として追加的に抽出される。また、第３、第４、および第６モードの場合、第１写真／図形領域抽出によっては図形領域として抽出されなかった写真領域中の図形領域が抽出される。たとえば図２１（Ｂ）では、領域Ｇ３が図形領域として追加的に抽出される。
【００６５】
なお、図７〜図１２に示される第２写真／図形領域抽出の終了後に行われる写真／図形領域抽出においては、図２１に示されるエッジによる領域分割によって得られた領域のうち、第２写真／図形領域抽出によって抽出されずに残った領域が抽出される。
【００６６】
（文字領域抽出）
次に、図２２を参照して、文字領域抽出の手順について説明する。
【００６７】
ここでは、説明を簡単にするため、たとえば図２３に示される画像データに対して、文字領域抽出に関する処理が行われる場合について説明する。
【００６８】
まず、画像データに対して、領域統合処理が行われる（ステップＳ６０１）。この処理は、たとえば背景画像上の文字画像、あるいは画素値が異なる文字画像を含む文字領域をも抽出するための処理である。具体的には、まず、画像データのうち明度画像に対して、スムージング処理が施された後、変動閾値による２値化を行うことにより、エッジ画像が作成される。変動閾値による２値化処理とは、具体的には、たとえば図２４に示すように、５×５ブロック内の四隅に位置する画素の階調値の最大値からオフセット値を減算した値を閾値として注目画素を２値化する処理である。続いて、得られたエッジ画像の主走査方向の黒画素の間隔を計測し、所定間隔以下である黒画素間の白画素を全て黒画素で置換して主走査方向に黒画素を連結した連結エッジ画像を作成する。さらに、得られた連結エッジ画像の副走査方向に対しても、同様の処理が繰り返され、主副走査方向に黒画素を連結した連結エッジ画像が得られる。このようにして、画像処理装置１は、近隣の黒画素を連結し、画像データ中で孤立している個々の文字画像を１つの領域として統合することにより、ある程度まとまった文字列ごとに１つの領域として抽出することが可能となるものである。
【００６９】
次に、領域抽出処理が行われる（ステップＳ６０２）。この処理は、連結した黒画素のまとまりを１領域として別々に抽出する処理である。具体的には、まず、得られた連結エッジ画像に対し、連結した黒画素ごとにラベリングが施される。ラベリングと同時に、同一ラベルの連結した黒画素ごとの外接矩形の位置情報（幅、高さ、および座標）が検出され、ラベリング画像が作成される。続いて、ラベリング時に検出された外接矩形とラベル番号とに基づいて、ラベリング画像から当該外接矩形で囲まれる領域が局所領域として抽出される。ここで、同一ラベル番号の画素だけを含む外接矩形を抽出することにより、外接矩形同士が重なり合ったレイアウトの画像も分離して抽出することが可能となる。図２５は、変動閾値による２値化処理および黒画素の連結処理を施して得られた連結エッジ画像と、連結エッジ画像データから得られたラベリング画像において同一ラベルの連結した黒画素ごとに求めた外接矩形とを示す図である。
【００７０】
次に、ステップＳ６０２において抽出された各局所領域に属する画像の斜め方向エッジ成分が特徴量として抽出され（Ｓ６０３）、斜め方向エッジ成分の含有率が所定範囲内にある局所領域が、文字領域と判別される（Ｓ６０４）。文字領域は、図形、写真、罫線等の他の領域と比較して、小さい領域内に斜め方向エッジ成分を多く含んでいる。したがって、文字領域特有の周波数成分として斜め方向エッジ成分を抽出し局所領域における含有率を求めることにより、当該局所領域が文字領域であるか否かが判定され得る。かかる斜め方向エッジ成分の抽出は、２×２ＤＣＴ（離散コサイン変換）によって得られた周波数成分のうち高周波成分を抽出する処理と同等である。すなわち、局所領域内の画像に対して２×２マトリクスによるＤＣＴを施し、得られた周波数成分のうちの高周波成分を「０」として逆ＤＣＴ変換を行うことにより、高周波成分を除去した復元画像が得られる。そして、原画像と復元画像との差分を取り出すことにより、原画像の高周波成分のみが抽出され得る。ここで、図２６に示すフィルタ処理を施すことにより高速な処理が可能である。図２７は、抽出された高周波成分を２値化して得られた斜め方向エッジ成分画像の一例を示す図である。所領局域は、大体において単語単位となっている。このため、所領局域が文字領域である場合、局所領域内の斜め方向エッジ成分の含有率、すなわち、局所領域の面積に対する当該局所領域に属する図２７の黒画素総数の比率は所定範囲内となる（約０．２〜２０％）。したがって、当該比率が上記範囲内である局所領域が文字領域と判別される。
【００７１】
次に、文字画像作成処理が行われる（ステップＳ６０５）。すなわち、ステップＳ６０４において文字領域と判別された局所領域内における元の画像データ（スキャナ２から受信した画像データ）を２値化することによって文字部とその背景部とが区別され、文字部のみからなる文字画像が作成される。２値化する際に使用される閾値は、文字領域ごとに設定される。文字領域ごとの閾値の設定方法としては、例えば以下の方法を用いることができる。まず、文字領域ごとに、当該文字領域内の画像データの明度画像を用いて、図２８（Ａ）に示すような明度ヒストグラムを作成する。続いて、明度ヒストグラムを当該文字領域内の画素数に対する百分率に変換して二次微分を行い、二次微分の結果が所定値以上であれば「１」、それ以外は「０」を出力することによって、図２８（Ｂ）に示すようなピーク検出用ヒストグラムを作成し、ピークを検出する。そして、検出されたピーク数が２以上のときは両端のピークの中心値、ピーク数が１のときは当該ピークと前記明度ヒストグラムの左右立ち上がり値（図２８（Ａ）における「Ｌｅｆｔ」および「Ｒｉｇｈｔ」の値）の平均値、ピーク数が０のときは前記明度ヒストグラムの前記左右立ち上がり値の中心値を閾値と決定する。このように、文字領域内の明度ヒストグラムのピーク数によって異なる２値化閾値を用いるため、たとえば背景画像上の文字画像や反転文字画像等も、画像が欠けることなく２値化可能となる。
【００７２】
次に、画像補間処理が行われる（ステップＳ６０６）。すなわち、元の画像データから、文字部のみからなる文字画像が除去され、除去後の部分が、その文字画像の背景画素で補間される。ここで、文字画像の背景画素は、ステップＳ６０５において文字領域ごとに２値化して得られた画像から特定することができる。補間に使用される背景画素の値は、元のＲＧＢ画像データにおける文字画像の背景に相当する画素のＲＧＢごとの平均値を算出することにより与えられる。
【００７３】
このように、画像処理装置１は、近隣の黒画素を連結することにより近接する領域を統合して、統合された領域を抽出し、文字らしさを表す特徴量を算出して、この特徴量を用いて抽出された各領域が文字領域であるか否かを判別し、続いて、文字領域と判別された領域内の画像データから文字部のみからなる文字画像を作成する。そして、文字部のみからなる文字画像を除去した後の部分を背景画素で補間する。
【００７４】
この文字領域抽出においては、文字画像が写真画像または図形画像の上に重なっている場合であっても、文字領域の確実な抽出が可能である。ただし、文字領域よりも写真領域または図形領域が優先される原稿モードが設定されている場合、写真画像または図形画像の上に重なっている文字画像は、写真領域または図形領域の一部として先に抽出されることになる。
【００７５】
上述のようにして、図７〜図１２に示す設定された原稿モードに応じた領域抽出順序で、スキャナから受信した画像データから、写真領域、図形領域、および文字領域が分離される。
【００７６】
本実施形態によれば、画像データから写真領域、図形領域、および文字領域を分離する際に、各領域の抽出順を設定することができ、これにより、どの領域を優先して抽出するかを制御することが可能となる。したがって、優先度の高い領域は、その中に他の領域を含んでいても当該他の領域を包含した状態で優先的に抽出され、また、他の領域の中に含まれていても優先的に抽出される。このように、優先度の高い領域は、他の領域よりも先に抽出されるため他の領域と誤判別されて抽出されることがなくなり、当該領域に対して不適切な処理が施されて画像が劣化することが防止される。
【００７７】
図２９〜図３４は、図５の画像データから、それぞれ第１〜第６モードの領域分離処理によって分離された写真領域、図形領域、および文字領域を示す図であって、（Ａ）は最先に抽出された領域、（Ｂ）は２番目に抽出された領域、（Ｃ）は３番目に抽出された領域を示す。
【００７８】
第１優先領域が写真領域である場合（第１および第２モード）、図２９（Ａ）および図３０（Ａ）に示すように、受信した画像データから、写真領域が最先に抽出された後に、残ったデータから図形領域と文字領域とが分離されるため、写真領域は、他の領域の分離処理の影響を受けて当該他の領域に付随して抽出されることがなくなる。これにより、写真領域は、他の領域と誤判別されることなく確実に抽出され得る。したがって、写真領域を高画質で再現することを主目的とする場合、より多くの写真領域を確実に抽出して、当該領域に対して適切な処理を実行することができる。換言すれば、たとえば写真領域内のある部分が文字領域と誤判別され、後工程において文字領域に適応した２値化処理が行われてしまうことを防止することができる。また、たとえば写真領域内のある部分が図形領域と誤判別され、後工程において図形領域に適応した減色処理が行われて単一色で塗り潰されてしまうことを防止することができる。つまり、写真領域に対して不適切な処理が施されて写真画像が劣化することが防止される。また、写真領域を優先して抽出することにより、元の画像データの内容が維持される利点がある。すなわち、図形領域または文字領域であるにもかかわらず当該領域を写真領域と誤判別したとしても、画像として再現できるため当該領域の内容が維持される。
【００７９】
さらに、写真領域抽出後の画像データから、文字領域よりも先に図形領域を抽出する場合（第１モード）、図形領域内のある部分が文字領域と誤判別され、後工程において文字領域に適応した処理が行われてしまうことを防止することができる。したがって、写真画像および図形画像に対する劣化が少なくなる。また、写真領域抽出後の画像データから、図形領域よりも先に文字領域を抽出する場合（第２モード）、図形領域内の文字画像を抽出することが可能となる。したがって、写真画像および文字画像に対する劣化が少なくなる。
【００８０】
第１優先領域が図形領域である場合（第３および第４モード）、図３１（Ａ）および図３２（Ａ）に示すように、受信した画像データから、図形領域が最先に抽出された後に、残ったデータから写真領域と文字領域とが分離されるため、図形領域は、他の領域の分離処理の影響を受けて当該他の領域に付随して抽出されることがなくなる。これにより、図形領域は、他の領域と誤判別されることなく確実に抽出され得る。したがって、ベクタ変換処理などの図形領域に適応した処理を施すことを主目的とする場合、より多くの図形領域を確実に抽出して、当該領域に対して適切な処理を実行することができる。換言すれば、たとえば写真領域の中に図形領域が重なって配置されている場合、全体が写真領域と誤判別されＪＰＥＧ圧縮されてしまってノイズが発生することを防止することができる。また、たとえば文字画像と間違いやすい図形画像を含む領域が文字領域と誤判別されてしまって当該領域に対して文字領域に適応した処理である２値化処理、さらには文字認識処理が実行されることを防止することができる。つまり、図形領域に対して不適切な処理が施されて図形画像が劣化することが防止される。
【００８１】
さらに、図形領域抽出後の画像データから、文字領域よりも先に写真領域を抽出する場合（第３モード）、写真領域内のある部分が文字領域と誤判別され、後工程において文字領域に適応した処理が行われてしまうことを防止することができる。したがって、図形画像および写真画像に対する劣化が少なくなる。また、図形領域抽出後の画像データから、写真領域よりも先に文字領域を抽出する場合（第４モード）、写真領域内の文字画像を抽出することが可能となる。したがって、図形画像および文字画像を劣化させることなく、写真画像に対して非可逆の圧縮処理を行うことができる。
【００８２】
第１優先領域が文字領域である場合（第５および第６モード）、図３３（Ａ）および図３４（Ａ）に示すように、受信した画像データから、文字領域が最先に抽出された後に、残ったデータから写真領域と図形領域とが分離されるため、文字領域は、他の領域の分離処理の影響を受けて当該他の領域に付随して抽出されることがなくなる。これにより、文字領域は、他の領域と誤判別されることなく確実に抽出され得る。したがって、文字認識処理などの文字領域に適応した処理を施すことを主目的とする場合、より多くの文字領域を確実に抽出して、当該領域に対して適切な処理を実行することができる。換言すれば、たとえば画像データ中で文字画像が写真画像または図形画像の上に重なっている場合、文字領域が判別されないで全体が写真領域または図形領域と判別されて抽出されてしまって、文字画像に対する文字認識処理を十分に実行できないばかりか、文字画像に対して不適切な処理が施されることを防止することができる。
【００８３】
さらに、文字領域抽出後の画像データから、図形領域よりも先に写真領域を抽出する場合（第５モード）、たとえば図形領域に内包されている写真領域を抽出することが可能である。したがって、文字画像および写真画像に対する劣化が少なくなる。また、文字領域抽出後の画像データから、写真領域よりも先に図形領域を抽出する場合（第６モード）、たとえば写真領域に内包されている図形領域を抽出することが可能である。したがって、文字画像および図形画像を劣化させることなく、写真画像に対して非可逆の圧縮処理を行うことができる。
【００８４】
本発明は、上述した実施の形態のみに限定されるものではなく、特許請求の範囲内において、種々改変することができる。
【００８５】
本発明の画像処理装置は、上記実施形態で示した態様以外に、スキャナ、パソコン、ワークステーション、サーバ等のコンピュータ、デジタル複写機、ファクシミリ装置、およびＭＦＰ（multi-function peripheral）等の機器にも応用することができる。
【００８６】
また、上記実施形態では、ファイルサーバ３が、画像処理装置１から受信したファイルから文字画像および図形画像を展開して、それぞれ文字認識処理およびベクタ変換処理を施す構成とされているが、これらの処理は画像処理装置１により行われてもよい。また、図７〜図１２の各領域分離処理における個々の処理ブロックの内容は適宜変更が可能である。
【００８７】
また、上記実施形態では、画像処理装置１は、写真領域、図形領域、および文字領域のうちで画像データの内容に応じて優先的に抽出される領域を設定する構成とされているが、本発明はこれに限定されない。本発明による画像処理装置では、あらかじめ最先に抽出される領域が固定されていてもよく、たとえば文字領域が最先に抽出される領域として固定され得る。また、本発明による画像処理装置では、あらかじめ領域の抽出順が固定されていてもよく、たとえば文字領域、写真領域および図形領域の順、あるいは文字領域、図形領域および写真領域の順が領域の抽出順として固定され得る。
【００８８】
本発明による画像処理装置および画像処理方法は、上記各手順を実行するための専用のハードウエア回路によっても、また、上記各手順を記述した所定のプログラムをＣＰＵが実行することによっても実現することができる。後者により本発明を実現する場合、画像処理装置を動作させる上記所定のプログラムは、フレキシブルディスクやＣＤ−ＲＯＭ等のコンピュータ読取可能な記録媒体によって提供されてもよいし、インターネット等のネットワークを介してオンラインで提供されてもよい。この場合、コンピュータ読取可能な記録媒体に記録されたプログラムは、通常、ハードディスク等に転送され記憶される。また、このプログラムは、たとえば、単独のアプリケーションソフトとして提供されてもよいし、画像処理装置の一機能としてその装置のソフトウエアに組み込んでもよい。
【００９６】
【発明の効果】
上述したように、本発明の画像処理装置によれば、処理しようとする画像データから、文字領域が最先に抽出された後に、残ったデータから写真領域と図形領域とが分離され得る。このため、文字領域は、他の領域の分離処理の影響を受けて当該他の領域に付随して抽出されることがなくなる。これにより、文字領域は、他の領域と誤判別されることなく確実に抽出され得る。したがって、文字認識処理などの文字領域に適応した処理を施すことを主目的とする場合、より多くの文字領域を確実に抽出して、当該領域に対して適切な処理を実行することができる。
【図面の簡単な説明】
【図１】 本発明の実施形態にかかる画像処理装置を含む画像処理システムの全体構成を示すブロック図である。
【図２】 画像処理装置の構成の一例を示すブロック図である。
【図３】 操作部における原稿モード設定画面の一例を示す図である。
【図４】 画像処理装置における処理の手順を示すフローチャートである。
【図５】 スキャナから受信した画像データの一例を模式的に示す図である。
【図６】 領域の合成を説明するための図であって、（Ａ）は合成後の状態を示す図、（Ｂ）は合成前の状態を示す図である。
【図７】 第１モードの領域分離処理の手順を示すフローチャートである。
【図８】 第２モードの領域分離処理の手順を示すフローチャートである。
【図９】 第３モードの領域分離処理の手順を示すフローチャートである。
【図１０】 第４モードの領域分離処理の手順を示すフローチャートである。
【図１１】 第５モードの領域分離処理の手順を示すフローチャートである。
【図１２】 第６モードの領域分離処理の手順を示すフローチャートである。
【図１３】 ２値化による領域分割の手順を示すフローチャートである。
【図１４】 図５の下地以外の領域を黒く塗り潰した２値画像を示す図である。
【図１５】 図１４のエッジから構成される画像を示す図である。
【図１６】 第１写真／図形領域抽出の手順を示すフローチャートである。
【図１７】 図１６から続く第１写真／図形領域抽出の手順を示すフローチャートである。
【図１８】 第１ヒストグラムを示す図である。
【図１９】 第２ヒストグラムを示す図である。
【図２０】 エッジによる領域分割の手順を示すフローチャートである。
【図２１】 エッジによる領域分割によって得られた領域の一例を模式的に示す図であって、（Ａ）は第１、第２、または第５モードの場合、（ｂ）は第３、第４、または第６モードの場合を示す。
【図２２】 文字領域抽出の手順を示すフローチャートである。
【図２３】 文字領域抽出の説明のために用いられる画像データを示す図である。
【図２４】 変動閾値による２値化処理を説明するための図である。
【図２５】 変動閾値による２値化処理および黒画素の連結処理を施して得られた連結エッジ画像と、連結エッジ画像データから得られたラベリング画像において同一ラベルの連結した黒画素ごとに求めた外接矩形とを示す図である。
【図２６】 画像データの特徴周波数成分から高周波成分を除去する際に用いられるフィルタ処理を説明するための図である。
【図２７】 抽出された高周波成分を２値化して得られた斜め方向エッジ成分画像の一例を示す図である。
【図２８】 文字領域内の画像データの明度画像から作成した（Ａ）明度ヒストグラムと、（Ｂ）ピーク検出用ヒストグラムとの一例を示す図である。
【図２９】 第１モードの領域分離処理において、図５の画像データから、（Ａ）最先に抽出された写真領域、（Ｂ）２番目に抽出された図形領域、および（Ｃ）３番目に抽出された文字領域を示す図である。
【図３０】 第２モードの領域分離処理において、図５の画像データから、（Ａ）最先に抽出された写真領域、（Ｂ）２番目に抽出された文字領域、および（Ｃ）３番目に抽出された図形領域を示す図である。
【図３１】 第３モードの領域分離処理において、図５の画像データから、（Ａ）最先に抽出された図形領域、（Ｂ）２番目に抽出された写真領域、および（Ｃ）３番目に抽出された文字領域を示す図である。
【図３２】 第４モードの領域分離処理において、図５の画像データから、（Ａ）最先に抽出された図形領域、（Ｂ）２番目に抽出された文字領域、および（Ｃ）３番目に抽出された写真領域を示す図である。
【図３３】 第５モードの領域分離処理において、図５の画像データから、（Ａ）最先に抽出された文字領域、（Ｂ）２番目に抽出された写真領域、および（Ｃ）３番目に抽出された図形領域を示す図である。
【図３４】 第６モードの領域分離処理において、図５の画像データから、（Ａ）最先に抽出された文字領域、（Ｂ）２番目に抽出された図形領域、および（Ｃ）３番目に抽出された写真領域を示す図である。
【符号の説明】
１…画像処理装置、
１０１…制御部、
１０２…記憶部、
１０３…操作部、
１０４…入力インタフェース部、
１０５…出力インタフェース部、
１０６…領域分離部、
１０８…画像処理部、
１０８ａ…写真領域処理部、
１０８ｂ…図形領域処理部、
１０８ｃ…文字領域処理部、
１０９…文書ファイル作成部、
１１０…ファイル形式変換部、
１１１…バス、
２…スキャナ、
３…ファイルサーバ、
４…コンピュータネットワーク。[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image processing apparatus, and more particularly to an image processing apparatus that performs an area separation process for separating a photographic area, a graphic area, and a character area from image data to be processed.
[0002]
[Prior art]
Image processing technology that distinguishes photographic regions, graphic regions, and character regions from image data obtained by reading a document, performs processing adapted to each region, and then outputs image data that combines the regions. Is known (for example, see JP-A-5-342408).
[0003]
[Problems to be solved by the invention]
However, in the above prior art, it may be difficult to determine the type of each area in the image data without error. For example, when a plurality of different types of areas are arranged in a complicated layout in the image data, or are arranged so as to overlap each other, there is a high possibility that the type of the area is erroneously determined.
[0004]
For example, when a character image is superimposed on a photographic image or a graphic image in the image data, there is a possibility that the entire character region is determined as a photographic region or a graphic region without being determined. In addition, if JPEG compression processing adapted to, for example, a photograph area is performed on an area including an extracted character image, the image becomes difficult to read when the character image in the photograph area deteriorates and is restored. There is also a fear.
[0005]
In this way, even when it is desired to extract a character region including a character image from image data and to execute processing adapted to the character region, such as character recognition processing, on the extracted region. Since the area cannot be extracted with certainty, the character recognition process for the character image cannot be sufficiently performed, and the character image may be inappropriately processed.
[0006]
The present invention has been made in view of the above-described problems of the prior art, and an object of the present invention is to perform an appropriate process on a character area in read image data from the image data. It is to extract the character area reliably.
[0007]
[Means for Solving the Problems]
The above object of the present invention is achieved by the following means.
[0008]
  (1) An image processing apparatus having area separation means for separating a photographic area, a graphic area, and a character area from image data to be processed, wherein the area separating means is configured to extract a photographic area and a graphic from the image data. Character area first extraction means for extracting a character area before an areaAnd a photo area preceding extraction means for extracting a photo area before the graphic area from the data remaining after the character area is extracted from the image data,WithThe photographic area preceding extraction means performs a first area dividing process that can be divided into a plurality of predetermined areas on the data remaining after the character area is extracted from the image data, and among the divided areas, the photographic area A first photographic area extracting means for extracting a specified area, and a character area is extracted from the image data, and an area specified as a photographic area by the first photographic area extracting means is further extracted from the remaining data. A second photographic region extraction is performed on the remaining data by performing a second region dividing process that can be divided into a plurality of regions smaller than the predetermined region, and extracting a region identified as a photographic region among the divided regions Having means,An image processing apparatus.
[0009]
  (2)The first area dividing process detects edges of a binary image in which a character area is extracted from the image data and a portion of a photographic area or a graphic area in the remaining data is distinguished from a background portion other than these. The second region dividing process is configured to extract a character region from the image data and further extract a region identified as a photographic region from the remaining data, and then remove an edge of the remaining data. By detecting, it can be divided into a plurality of areas smaller than the predetermined areaThe image processing apparatus according to (1), characterized in that:
[0010]
  (3)An image processing apparatus having an area separating unit that separates a photographic area, a graphic area, and a character area from image data to be processed, wherein the area separating unit is more than a photographic area and a graphic area from the image data. Character area first extraction means for extracting a character area first, and graphic area preceding extraction means for extracting a graphic area ahead of a photo area from the data remaining after the character area is extracted from the image data. The graphic area preceding extraction means performs a first area dividing process on the data remaining after the character area is extracted from the image data, and the graphic area is divided into a plurality of predetermined areas. A first graphic area extracting means for extracting an area identified as an area, and a graphic area by extracting the character area from the image data by the first graphic area extracting means from the remaining data A second area dividing process that can be divided into a plurality of areas smaller than the predetermined area is performed on the data that remains after the specified area is further extracted, and is identified as a graphic area among the divided areas An image processing apparatus comprising: a second graphic area extracting unit for extracting an area.
[0011]
  (4)The first area dividing process detects edges of a binary image in which a character area is extracted from the image data and a portion of a photographic area or a graphic area in the remaining data is distinguished from a background portion other than these. The second area dividing process is configured to extract a character area from the image data and further extract an area identified as a graphic area from the remaining data, and then remove the edge of the remaining data. By detecting, it can be divided into a plurality of areas smaller than the predetermined areaCharacterized by the above (3).
[0012]
  (5)Any one of (1) to (4) above, further comprising reading means for obtaining image data by reading a document, wherein the image data to be processed is obtained by the reading means. The image processing apparatus described.
(6) An image processing method including an area separation step of separating a photographic region, a graphic region, and a character region from image data to be processed, wherein the region separation step includes a photographic region and a graphic from the image data. A character region first extraction step for extracting a character region before a region; and a photo region preceding extraction step for extracting a photo region prior to a graphic region from data remaining after the character region is extracted from the image data; In the photographic area preceding extraction step, a first area dividing process that can be divided into a plurality of predetermined areas is performed on the data remaining after the character area is extracted from the image data. A first photographic region extracting step for extracting a region identified as a photographic region, and a first photographic region extracting means for extracting a character region from the image data and remaining data. A second region dividing process that can be divided into a plurality of regions smaller than the predetermined region is performed on the data remaining after the region identified as the region is further extracted, and the photo region is identified among the divided regions And a second photographic area extracting step for extracting the extracted area.
(7) An image processing method having area separating means for separating a photographic area, a graphic area, and a character area from image data to be processed, wherein the area separating step includes a photographic area and a graphic from the image data. A character region first extraction step for extracting a character region prior to a region; and a graphic region preceding extraction step for extracting a graphic region prior to a photo region from data left after the character region is extracted from the image data; In the graphic region preceding extraction step, the first region dividing process that can be divided into a plurality of predetermined regions is performed on the data remaining after the character region is extracted from the image data, and the divided region A first graphic region extracting step for extracting a region identified as a graphic region, and a first graphic region extracting means for extracting the character region from the image data by the first graphic region extracting means. A second area dividing process that can be divided into a plurality of areas smaller than the predetermined area is performed on the data remaining after the area identified as the area is further extracted, and the figure area is identified among the divided areas. And a second graphic region extracting step for extracting the region obtained.
(8) An image processing program for causing an image processing apparatus to execute a region separation procedure for separating a photographic region, a graphic region, and a character region from image data to be processed. Extract the character area from the data, extract the character area first before the picture area and the graphic area, and extract the photo area before the graphic area from the remaining data after extracting the character area from the image data A photographic region preceding extraction procedure, wherein the photographic region preceding extraction procedure includes a first region dividing process that can divide the data remaining after the character region is extracted from the image data into a plurality of predetermined regions. And a first photographic region extraction procedure for extracting a region identified as a photographic region among the divided regions, and a character region is extracted from the image data and the previous data is extracted from the remaining data. The area identified as the photographic area by the first photographic area extracting means is further extracted and subjected to a second area dividing process that can be divided into a plurality of areas smaller than the predetermined area, and the data is divided. An image processing program comprising: a second photographic area extracting procedure for extracting a photographic area and a specified area from among the areas.
(9) An image processing program for causing an image processing apparatus to execute a region separation procedure for separating a photographic region, a graphic region, and a character region from image data to be processed. Extract the character area from the data and extract the character area first before the picture area and the graphic area, and extract the graphic area before the photo area from the remaining data after extracting the character area from the image data. A graphic region preceding extraction procedure, wherein the graphic region preceding extraction procedure performs a first region dividing process that can divide the data remaining after the character region is extracted from the image data into a plurality of predetermined regions. And a first graphic region extraction procedure for extracting a region identified as a graphic region from among the divided regions, and a character region is extracted from the image data and the previous data is extracted. Against the remaining data area identified as graphic region is further extracted by the first graphic area extracting means, into a plurality of regions is smaller than the predetermined area An image processing program comprising: a second graphic area extraction procedure for performing a second area dividing process and extracting a graphic area and an identified area from among the divided areas.
(10) A computer-readable recording medium on which the image processing program according to (8) or (9) is recorded.
[0013]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[0014]
FIG. 1 is a block diagram showing the overall configuration of an image processing system including an image processing apparatus according to an embodiment of the present invention. The image processing system includes an image processing apparatus 1, a scanner 2, and a file server 3, which are connected to each other via a computer network 4 so as to communicate with each other. The type and number of devices connected to the computer network are not limited to the example shown in FIG.
[0015]
FIG. 2 is a block diagram illustrating a configuration of the image processing apparatus 1 according to the present embodiment. 2, the image processing apparatus 1 includes a control unit 101, a storage unit 102, an operation unit 103, an input interface unit 104, an output interface unit 105, an area separation unit 106, an image processing unit 108, a document file creation unit 109, and a file format. A conversion unit 110 is provided, which are connected to each other via a bus 111 for exchanging signals.
[0016]
The control unit 101 is a CPU, and controls the above-described units and performs various arithmetic processes according to a program. The storage unit 102 stores a variety of programs and parameters in advance, a ROM that temporarily stores programs and data as a work area, stores various programs and parameters, or stores image data obtained by image processing, and the like. Consists of a hard disk or the like used for temporary storage.
[0017]
The operation unit 103 includes keys, an operation panel, and the like for setting various items or instructing operation start. As shown in FIG. 3, items that can be set include a destination of image data, an output file format, a document mode, scan conditions, post-scan processing, and the like.
[0018]
The input interface unit 104 is an interface for receiving data such as image data and instructions, and the output interface unit 105 is an interface for transmitting data such as output files and instructions.
[0019]
The area separation unit 106 separates a photographic area, a graphic area, and a character area from the image data. The image processing unit 108 includes a photographic region processing unit 108a, a graphic region processing unit 108b, and a character region processing unit 108c. Each of the area processing units 108a to 108c performs appropriate image processing corresponding to the type of the area on the character area, the graphic area, and the photo area extracted by the area separation unit 106, respectively.
[0020]
The document file creation unit 109 synthesizes the regions including the processed images sent from the photo region processing unit 108a, the graphic region processing unit 108b, and the character region processing unit 108c, and generates a document file in the internal file format. create. The file format conversion unit 110 converts a document file created in the internal file format into a set output file format. Examples of the output file format include document formats of various document creation software and general-purpose formats such as Postscript (registered trademark), PDF, JPEG, and TIFF.
[0021]
The scanner 2 reads a document, acquires image data, and transmits the obtained image data to the image processing apparatus.
[0022]
The file server 3 is a computer, which stores a file received via the computer network 4 and transfers the stored file to another device on the computer network in response to a transfer request.
[0023]
The computer network 4 includes a LAN in which computers, peripheral devices, network devices, and the like are connected according to standards such as Ethernet (registered trademark), token ring, and FDDI, and a WAN in which LANs are connected by a dedicated line.
[0024]
Next, a processing procedure in the image processing apparatus 1 of the present embodiment will be described with reference to FIG. Note that the algorithm shown in the flowchart of FIG. 4 is stored as a program in the storage unit 102 of the image processing apparatus 1 and executed by the control unit 101.
[0025]
First, in step S101, various items are set. That is, settings are made for the destination of image data, the output file format, the document mode, the scan conditions, and the post-scan processing. Here, the transmission destination of the image data is set by inputting the IP address, host name, mail address, etc. of the image output destination device. The output file format is set by selecting the file format of the output file to be transmitted to the image output destination device.
[0026]
The document mode is set by selecting which area of the image is to be given priority among a photo area including a photographic image, a graphic area including a graphic image, and a character area including a character image. . Here, the photographic image refers to an image having gradation that continuously changes, such as a photograph or a picture. The graphic image refers to an image created by a personal computer such as a line or a solid picture.
[0027]
As shown in FIG. 3, in this embodiment, the user wants to process the area with the highest priority (first priority area) and the second priority according to the content of the document through the operation unit 103. An area (second priority area) can be selected. When the user does not select the first priority area and / or the second priority area, the priority order of the areas is determined according to a predetermined default value.
[0028]
The scan condition is set by specifying a scan area, scan resolution, color / monochrome, and the like. Setting of post-scan processing is performed by designating character recognition processing, vector conversion processing, image compression method, color reduction method, output resolution, and the like.
[0029]
In step S102, the process waits for an image processing start command. The start command is issued when the user operates, for example, a start key of the operation unit 103.
[0030]
In step S <b> 103, a document reading command is transmitted to the scanner 2 via the output interface unit 105. Here, when receiving a document reading command from the image processing apparatus 1, the scanner 2 reads the document set at a predetermined position to acquire image data, and transmits the obtained image data to the image processing apparatus 1.
[0031]
In step S104, the process waits until image data is received from the scanner 2 via the input interface unit 104. Here, when image data is received from the scanner 2, the received image data (RGB image data) is stored in the storage unit 102.
[0032]
FIG. 5 is a diagram schematically illustrating an example of received image data. The image data shown in FIG. 5 includes photographic images PI1 to PI4, graphic images GI1 to GI3, character images CI1 to CI6, and background U. As shown in the figure, a graphic image GI3 and character images CI1 and CI3 are arranged in the photographic image PI1, and a photographic image PI3 and PI4 and character images CI5 and CI6 are arranged in the graphic image GI2. . Here, the background means a part other than the photo area, graphic area, and character area in the image data. For example, the part of the image data corresponding to the part of the original document where the color of the unprinted paper remains. Say.
[0033]
Note that an image processing start command may be input from another device on the computer network 4 or from the scanner 2.
[0034]
In step S105, the region separation unit 106 separates the photo region, the graphic region, and the character region from the image data received from the scanner 2, that is, the image data to be processed. In the present embodiment, the area separation unit 106 extracts the first priority area first from the image data according to the document mode set by the user's selection through the operation unit 103, and first priority from the image data. The remaining two regions are separated from the remaining data after the region is extracted. Further, when the second priority area is selected, the remaining two areas are separated by first extracting the second priority area from the data remaining after the first priority area is extracted from the image data. . Here, each image is created for each of the three types of regions, and each region is extracted as a region including each image. Details of the procedure of the region separation process will be described later.
[0035]
In step S106, processing adapted to the photographic area is performed on the photographic area separated in step S105. That is, the photographic image in the photographic area is subjected to, for example, resolution conversion and then irreversible compression processing of the color image by the photographic area processing unit 108a, and is stored in the storage unit 102 together with the position information.
[0036]
In step S107, processing adapted to the graphic area is performed on the graphic area separated in step S105. That is, the graphic image in the graphic area is subjected to, for example, smoothing processing, color reduction processing, and the like by the graphic image processing unit 108b, and then reversible compression processing of the color image is performed and stored in the storage unit 102 together with the position information. Is done.
[0037]
In step S108, processing adapted to the character area is performed on the character area separated in step S105. That is, the character image in the character area is binarized by the character image processing unit 108c, for example, and then subjected to lossless compression processing of 1-bit data and stored in the storage unit 102 together with the color information and the position information. The
[0038]
In step S109, the document file creation unit 109 combines the above three regions including the processed images sent from the photo region processing unit 108a, the graphic region processing unit 108b, and the character region processing unit 108c, respectively, A file is created.
[0039]
For example, as shown in FIG. 6A, the areas are synthesized by outputting a photo area 600, a graphic area 700, and a character area 800 on the memory. Here, as shown in FIG. 6B, a portion other than the photographic image 600a in the photographic region 600, a portion other than the graphic image 700a in the graphic region 700, and a portion other than the character image 800a in the character region 800, respectively. It is specified in the mask parts 600b to 800b. Each region 600 to 800 is given by a circumscribed rectangle for the images 600a to 800a. The mask portion is a portion where mask processing for validating information previously stored in the memory is performed. First, the photographic area 600 and the graphic area 700 are arranged after being masked, and then the character area 800 is arranged after being masked. The reason for performing the mask process for all the regions is that not only the image in each region is a rectangle but also the case where the image in another region has a shape that goes in. In this way, as shown in FIG. 6A, the images in the three regions are output onto the memory without any loss, and the composition of the regions is completed.
[0040]
The reason for arranging the character area after other areas is that, as will be described later, after extracting the character area during the area separation process, the part where the character image existed is used as the background part of the original image data. This is because interpolation processing for interpolation is performed. That is, if the character area is arranged before other areas, the character image is prevented from being hidden by the interpolated portion in the area arranged later. In addition, after the graphic area is extracted, when the interpolation process is also performed on the part where the graphic image exists, the photographic area, the graphic area, and the character area are output on the memory in the order.
[0041]
In step S110, the file format conversion unit 110 converts the document file created in step S109 into the set output file format.
[0042]
In step S111, the output file obtained in step S110 is transmitted to the file server 3 via the output interface unit 105 and the computer network 4.
[0043]
In this embodiment, when the file server 3 receives the output file from the image processing apparatus 1 via the computer network 4, the file server 3 develops a character image and a graphic image from the received file, and performs character recognition processing on the character image. Obtained by converting the data into character code data, performing vector conversion processing on the graphic image to vector data, recombining the converted data together with the photo image, and converting it into a predetermined file format. The document file is stored in a predetermined directory of a storage device such as a hard disk. When there is a transfer request for the file from another device on the computer network 4, the stored file is transferred to the other device via the computer network 4.
[0044]
Next, the procedure of the region separation process in step S105 shown in FIG. 4 which is a feature of the image processing of the image processing apparatus 1 in the present embodiment will be described in more detail.
[0045]
7 to 12 are flowcharts showing the procedure of the region separation process corresponding to the document mode. There are a total of six document modes set in step S101 in FIG. That is, the document mode includes a first mode (see FIG. 7) in which the first priority area and the second priority area are a photographic area and a graphic area, respectively, and a second mode (see FIG. 8) in which the photographic area and a character area are respectively. ), A third mode (see FIG. 9) that is a graphic region and a photo region, respectively, a fourth mode (see FIG. 10) that is a graphic region and a character region, respectively, and a fifth mode that is a character region and a photo region, respectively. (See FIG. 11) and a sixth mode (see FIG. 12) which is a character area and a graphic area, respectively.
[0046]
Each of the region separation processes of FIGS. 7 to 12 includes region division by binarization, first photo / graphic region extraction, region division by edge, second photo / graphic region extraction, photo / graphic region extraction, and character region extraction. It includes a processing block whose contents are common in each mode. In other words, each area separation process has a different priority area according to the document mode, and the extraction order of the areas differs according to the priority of the areas. For example, in the case of the first mode, the priority of the areas is from the highest to the photographic area, the graphic area, and the character area, and the extraction order of the areas is the same.
[0047]
Hereinafter, the contents of each processing block in the region separation processing will be described in detail. Here, as an example, the content of each processing block will be specifically described in the same order as the processing order of the first mode in FIG.
[0048]
(Division by binarization)
First, with reference to FIG. 13, the procedure of area division by binarization will be described.
[0049]
For example, based on the received image data shown in FIG. 5, an image composed of brightness, that is, a brightness image is created (step S301). Next, the background is removed from the brightness image (step S302), and a smoothing process using a smoothing filter is performed (step S303). The brightness image from which the background and noise are removed is binarized at the background brightness level (hereinafter referred to as “background level”) (step S304). As a result, as shown in FIG. 14, a binary image in which the area other than the background is blacked out is obtained. Edge detection is performed on the binary image by using, for example, a Laplacian filter that is a secondary differential filter (step S305). Subsequently, by performing a closing (expansion / erosion) process, which is a type of morphology process, an edge is interpolated to obtain an image composed of the edge, that is, an edge image (see step S306, FIG. 15). The edge image in FIG. 15 corresponds to the contour line of the binary image in FIG.
[0050]
By detecting the contour line of the binary image obtained by binarization at the background level in this way, when there are a plurality of regions that are in contact with each other, these regions are combined into one, Splitting is performed. In the first to fourth modes, four large areas and character areas as shown in FIGS. 14 and 15 are obtained. However, in the fifth and sixth modes in which the character area is prioritized, since the character area is extracted before the area division by binarization, only four large areas are obtained.
[0051]
(First photo / graphic region extraction)
Next, the procedure for extracting the first photograph / graphic region will be described with reference to FIGS.
[0052]
The processing relating to the extraction of the first photograph / graphic region is executed for each region (region surrounded by the closed curve in FIG. 15) partitioned by the contour line of the binary image obtained by binarization at the background level. The First, based on the position of the edge of the edge image in FIG. 15, the position of the line segment between the edges in the first direction, for example, the main scanning direction is detected (step S401). Then, using a pixel of the brightness image corresponding to the position of the line segment between the target edges, for example, a histogram (first histogram) as shown in FIG. 18 is created (step S402). Further, by performing a smoothing process using the average value filter (| 1 | 0 | 1 |) on the first histogram, for example, a second histogram as shown in FIG. 19 is created (step S403). Subsequently, according to the following formula, the difference between the first histogram Hist1 and the second histogram Hist2 is calculated for each gradation, and the sum is used as the feature amount (step S404). The lightness is represented by 8-bit data and has 256 gradations.
[0053]
[Expression 1]

[0054]
Next, a ratio R1 (= N1 / T1) between the total number of pixels N1 located in the line segment between the target edges and a predetermined constant T1 is calculated (step S405). The constant T1 is a first parameter for separating a photographic area and a graphic area. Subsequently, the ratio R1 as a threshold value is compared with the feature amount (step S406). When it is determined that the feature amount is larger than the ratio R1 (step S406: NO), all of the pixels located in the line segment between the edges in the first direction are considered to belong to the graphic region, and a process of assigning a number is performed. Is executed, and labeling data is generated (step S407). That is, the result of area determination is labeled for each pixel. Specifically, the result of area determination is stored in correspondence with the pixel position. On the other hand, when it is determined that the feature amount is equal to or less than the ratio R1 (step S406: YES), all of the pixels located in the line segment between the edges in the first direction are considered to belong to the photographic region and are labeled. Data is generated (step S408). Subsequently, it is determined whether or not the line segment between the target edges is the final line segment between the edges in the first direction (step S408). When it is determined that the line segment between the edges of interest is not the line segment between the last edges (step S408: NO), the process returns to step S402 and the above process is repeated.
[0055]
Next, based on the edge image of FIG. 15, the position of the line segment between the edges in the second direction, for example, the sub-scanning direction, which is a direction orthogonal to the first direction is detected (step S410). Based on the labeling data created in steps S407 and S408, the ratio R2 (= N3 / N2) of the total number of pixels N2 located in the line segment between the target edges and the number of pixels N3 belonging to the photo area is calculated. (Step S411). Subsequently, the ratio R2 is compared with a predetermined constant T2 that is a threshold value (step S412). The constant T2 is a second parameter for separating the photographic area and the graphic area. When it is determined that the ratio R2 is smaller than the constant T2 (step S412: NO), all the pixels existing in the line segment between the edges of interest in the second direction are regarded as belonging to the graphic area and are labeled. It is corrected (step S413). On the other hand, when it is determined that the ratio R2 is equal to or greater than the constant T2 (step S412: YES), all the pixels located in the line segment between the edges of interest in the second direction are regarded as belonging to the photo area and are relabeled. (Step S414). Subsequently, it is determined whether or not the line segment between the target edges is the final line segment between the edges in the second direction (step S415). When it is determined that the line segment between the edges of interest is not the line segment between the last edges (step S415: NO), the process returns to step S411 and the above process is repeated.
[0056]
Next, the number N5 of pixels labeled as belonging to the photographic area and the number N4 of labeled pixels belonging to the graphic area are compared in one area obtained by area division by binarization ( Step S416). When it is determined that N5 <N4 (step S416: NO), the area is determined as a graphic area (step S417). On the other hand, when it is determined that N5 ≧ N4 (step S416: YES), the area is determined to be a photograph area (step S418). Then, the determination of the higher priority region of the photo region or the graphic region is confirmed, and all the pixels in the region are regarded as belonging to the higher priority region and are relabeled. And extracted from the image data (step S419). Here, the circumscribed rectangle of the region is calculated by tracking the outline of the region based on the position data, and a rectangular region including pixels labeled as belonging to the region corresponding to the coordinate position in the circumscribed rectangle, Extracted from image data.
[0057]
As described above, in the first photo / graphic region extraction, by calculating the image feature amount between the edges that are the boundaries of the region with respect to the region obtained by performing the region division by binarization, It is determined whether the area is a photographic area or a graphic area. If the priority of the photo area is higher than that of the graphic area (first, second, and fifth modes), the photo area is determined and the area is extracted in the form of a rectangular area. On the other hand, when the priority of the graphic area is higher than that of the photo area (third, fourth, and sixth modes), the graphic area is fixed and the area is extracted in the form of a rectangular area.
[0058]
In this embodiment, as described above, based on the feature that the brightness distribution of the graphic area is uniform to some extent while the brightness distribution of the photo area is dispersed, it is a photographic area or a graphic area. Is determined. However, the region determination method is not limited to this. For example, the region may be determined using a frequency component extracted from the brightness image as a feature amount.
[0059]
(Area division by edge)
Next, with reference to FIG. 20, the procedure of area division by edges will be described.
[0060]
The area division based on the edge is performed on the data remaining after the higher priority area of the photo area or the graphic area is extracted by the first photo / graphic area extraction.
[0061]
First, edge detection is performed on each of the R component image, the G component image, and the B component image in the image data by using an edge detection filter such as a Laplacian filter (steps S501 to S503). Subsequently, an OR process is performed to obtain the union of each edge of the detected R component image, G component image, and B component image (step S504), and a closing process is performed in order to eliminate edge breaks. This is performed (step S505). Here, in the first to fourth modes, since the character area is not yet extracted, the edge of the character image is also detected. However, for example, when the size (vertical and horizontal dimensions) of the circumscribed rectangle of the region is smaller than a predetermined threshold and the ratio of the number of effective pixels inside the region to the size of the circumscribed rectangle is smaller than the predetermined threshold, the region is It is excluded from the area division target by the edge. As a result, the edge of the character image is not regarded as the boundary of the region.
[0062]
FIG. 21 is a diagram schematically illustrating an example of a region obtained by region division using edges, where (A) is in the first, second, or fifth mode, and (b) is the third , 4th, or 6th mode is shown. Here, in FIG. 21A, the photo area has already been extracted before the graphic area by the first photo / graphic area extraction. That is, the region P1 (including the region G3) and the region P2 shown in FIG. 21B have already been extracted as photographic regions in FIG. In FIG. 21B, the graphic area is already extracted before the photo area by the first photo / graphic area extraction. That is, the region G1 and the region G2 (including the regions P3 and P4) shown in FIG. 21A have already been extracted as photographic regions in FIG.
[0063]
As described above, the edge segmentation is performed by extracting the higher priority area of the photographic area or the graphic area by the first photo / graphic area extraction, and adding the higher priority area to the remaining data. If it is still overlaid on the lower priority area, or if the higher priority area is still contained within the lower priority area, This is performed in order to further extract a region having a higher priority. That is, by detecting the edge, finer region division is performed.
[0064]
(Second photo / graphic region extraction)
Next, the procedure for extracting the second photograph / graphic area will be described. In the second photo / graphic region extraction, the same process as the first photo / graphic region extraction described above is performed again on the region obtained by the region division by the edge shown in FIG. As a result, in the first, second, and fifth modes, a photo area in the graphic area that is not extracted as the photo area by the first photo / graphic area extraction is extracted. For example, in FIG. 21A, regions P3 and P4 are additionally extracted as photo regions. In the third, fourth, and sixth modes, graphic areas in the photo area that are not extracted as graphic areas by the first photo / graphic area extraction are extracted. For example, in FIG. 21B, a region G3 is additionally extracted as a graphic region.
[0065]
In the photo / graphic region extraction performed after the second photo / graphic region extraction shown in FIGS. 7 to 12 is completed, the second photo is selected from the regions obtained by the region division by the edge shown in FIG. / A remaining region is extracted without being extracted by the graphic region extraction.
[0066]
(Character area extraction)
Next, a procedure for extracting a character area will be described with reference to FIG.
[0067]
Here, for the sake of simplicity, a case will be described in which processing relating to character area extraction is performed on the image data shown in FIG. 23, for example.
[0068]
First, region integration processing is performed on image data (step S601). This process is a process for extracting a character image including a character image on a background image or a character image having a different pixel value, for example. Specifically, first, after a smoothing process is performed on a lightness image in the image data, an edge image is created by performing binarization using a variation threshold. Specifically, the binarization processing based on the variation threshold is, for example, as shown in FIG. 24, a value obtained by subtracting the offset value from the maximum value of the gradation values of the pixels located at the four corners in the 5 × 5 block. As a process of binarizing the target pixel. Subsequently, a black pixel interval in the main scanning direction of the obtained edge image is measured, and all white pixels between black pixels that are equal to or smaller than a predetermined interval are replaced with black pixels, and the black pixels are connected in the main scanning direction. Create an edge image. Further, similar processing is repeated in the sub-scanning direction of the obtained connected edge image, and a connected edge image in which black pixels are connected in the main sub-scanning direction is obtained. In this way, the image processing apparatus 1 connects neighboring black pixels and integrates individual character images isolated in the image data as one region, so that one character string is collected to some extent. It can be extracted as a region.
[0069]
Next, a region extraction process is performed (step S602). This process is a process of separately extracting a group of connected black pixels as one area. Specifically, first, the obtained connected edge image is labeled for each connected black pixel. Simultaneously with the labeling, position information (width, height, and coordinates) of the circumscribed rectangle for each black pixel connected with the same label is detected, and a labeling image is created. Subsequently, based on the circumscribed rectangle and the label number detected at the time of labeling, a region surrounded by the circumscribed rectangle is extracted as a local region from the labeling image. Here, by extracting a circumscribed rectangle including only pixels having the same label number, it is possible to separate and extract an image of a layout in which the circumscribed rectangles overlap each other. FIG. 25 is obtained for each connected black pixel of the same label in the connected edge image obtained by performing the binarization processing by the variation threshold and the black pixel connecting process and the labeling image obtained from the connected edge image data. It is a figure which shows a circumscribed rectangle.
[0070]
Next, the oblique edge component of the image belonging to each local area extracted in step S602 is extracted as a feature amount (S603), and the local area where the content rate of the oblique edge component is within a predetermined range is defined as a character area. It is determined (S604). The character area includes a large amount of diagonal edge components in a small area as compared to other areas such as graphics, photographs, and ruled lines. Therefore, it is possible to determine whether or not the local region is a character region by extracting a diagonal edge component as a frequency component peculiar to the character region and obtaining the content rate in the local region. The extraction of the edge component in the oblique direction is equivalent to the process of extracting the high frequency component from the frequency components obtained by 2 × 2 DCT (discrete cosine transform). That is, by performing DCT using a 2 × 2 matrix on the image in the local region and performing inverse DCT transform with the high frequency component of the obtained frequency components set to “0”, a restored image from which the high frequency component has been removed is obtained. can get. Then, by extracting the difference between the original image and the restored image, only the high frequency component of the original image can be extracted. Here, high-speed processing is possible by performing the filter processing shown in FIG. FIG. 27 is a diagram illustrating an example of an oblique direction edge component image obtained by binarizing the extracted high frequency component. The territory is generally in units of words. Therefore, when the local region is a character region, the content ratio of the oblique edge component in the local region, that is, the ratio of the total number of black pixels in FIG. 27 belonging to the local region to the area of the local region is within a predetermined range. (Approximately 0.2 to 20%). Therefore, a local region whose ratio is within the above range is determined as a character region.
[0071]
Next, a character image creation process is performed (step S605). That is, by binarizing the original image data (image data received from the scanner 2) in the local area determined as the character area in step S604, the character part and its background part are distinguished, and only from the character part. A character image is created. A threshold value used for binarization is set for each character area. As a threshold value setting method for each character area, for example, the following method can be used. First, for each character region, a brightness histogram as shown in FIG. 28A is created using the brightness image of the image data in the character region. Subsequently, the lightness histogram is converted into a percentage with respect to the number of pixels in the character area, and second order differentiation is performed. If the result of the second order differentiation is equal to or greater than a predetermined value, “1” is output, otherwise “0” is output. Thus, a peak detection histogram as shown in FIG. 28B is created, and the peak is detected. When the number of detected peaks is 2 or more, the center value of the peaks at both ends, and when the number of peaks is 1, the peak and the left and right rising values of the brightness histogram (“Left” and “Right” in FIG. 28A). When the average value and the number of peaks are 0, the center value of the left and right rising values of the brightness histogram is determined as a threshold value. As described above, since a binarization threshold value that differs depending on the number of peaks in the brightness histogram in the character area is used, for example, a character image on a background image, a reversed character image, or the like can be binarized without any missing image.
[0072]
Next, an image interpolation process is performed (step S606). That is, the character image consisting only of the character portion is removed from the original image data, and the removed portion is interpolated with the background pixels of the character image. Here, the background pixel of the character image can be specified from the image obtained by binarization for each character area in step S605. The value of the background pixel used for the interpolation is given by calculating the average value for each RGB of the pixels corresponding to the background of the character image in the original RGB image data.
[0073]
As described above, the image processing apparatus 1 integrates adjacent regions by connecting neighboring black pixels, extracts the integrated region, calculates a feature amount that represents character, and calculates the feature amount. It is determined whether or not each extracted region is a character region, and then a character image consisting only of a character portion is created from image data in the region determined to be a character region. Then, the portion after removing the character image consisting only of the character portion is interpolated with the background pixels.
[0074]
In this character region extraction, the character region can be reliably extracted even when the character image is superimposed on the photo image or the graphic image. However, if the document mode is set in which the photo area or graphic area is prioritized over the text area, the character image overlying the photo image or graphic image will be displayed as a part of the photo area or graphic area first. Will be extracted.
[0075]
As described above, the photographic area, the graphic area, and the character area are separated from the image data received from the scanner in the area extraction order corresponding to the set document mode shown in FIGS.
[0076]
According to this embodiment, when separating a photo area, a graphic area, and a character area from image data, it is possible to set the extraction order of each area, thereby determining which area is preferentially extracted. It becomes possible to control. Therefore, a high priority area is preferentially extracted in a state including the other area even if it includes another area, and is preferential even if included in another area. Extracted into In this way, the high priority area is extracted before the other area, so that it is not mistakenly extracted as the other area, and the area is inappropriately processed. It is possible to prevent the image from deteriorating.
[0077]
FIGS. 29 to 34 are diagrams showing a photographic region, a graphic region, and a character region separated from the image data of FIG. 5 by the region separation processing in the first to sixth modes, respectively. The previously extracted area, (B) indicates the second extracted area, and (C) indicates the third extracted area.
[0078]
When the first priority area is a photograph area (first and second modes), as shown in FIGS. 29A and 30A, the photograph area is extracted first from the received image data. Later, since the graphic area and the character area are separated from the remaining data, the photograph area is not extracted along with the other area under the influence of the separation process of the other area. As a result, the photograph area can be reliably extracted without being erroneously determined as another area. Therefore, when the main purpose is to reproduce a photographic area with high image quality, more photographic areas can be reliably extracted and appropriate processing can be performed on the area. In other words, for example, it can be prevented that a certain part in the photographic region is erroneously determined as a character region and a binarization process adapted to the character region is performed in a later process. Further, for example, it can be prevented that a certain part in the photographic area is erroneously determined as a graphic area, and color-reduction processing adapted to the graphic area is performed in a later process and is painted with a single color. That is, the photographic image is prevented from being deteriorated due to inappropriate processing on the photographic area. Moreover, there is an advantage that the contents of the original image data are maintained by extracting the photo area with priority. That is, even if it is a graphic region or a character region, even if the region is misidentified as a photographic region, it can be reproduced as an image, so the content of the region is maintained.
[0079]
Furthermore, when a graphic area is extracted before the character area from the image data after extraction of the photographic area (first mode), a certain part in the graphic area is misidentified as a character area, and is applied to the character area in a later process. It is possible to prevent the performed processing from being performed. Accordingly, the deterioration of the photographic image and the graphic image is reduced. Further, when a character area is extracted from the image data after extraction of the photographic area before the graphic area (second mode), it is possible to extract a character image in the graphic area. Accordingly, the deterioration of the photographic image and the character image is reduced.
[0080]
When the first priority area is a graphic area (third and fourth modes), as shown in FIGS. 31A and 32A, the graphic area is extracted first from the received image data. Later, since the photo area and the character area are separated from the remaining data, the graphic area is not extracted along with the other area under the influence of the separation process of the other area. As a result, the graphic area can be reliably extracted without being misidentified as another area. Therefore, when the main purpose is to apply a process adapted to a graphic area such as a vector conversion process, it is possible to reliably extract more graphic areas and execute an appropriate process on the area. In other words, for example, when a graphic area is arranged so as to overlap in a photographic area, it is possible to prevent the entire image from being erroneously determined as a photographic area and compressed by JPEG and generating noise. Further, for example, an area including a character image that is likely to be mistaken for a character image is misidentified as a character area, and binarization processing, which is processing adapted to the character area, and character recognition processing are executed. This can be prevented. That is, it is possible to prevent the graphic image from being deteriorated due to inappropriate processing on the graphic region.
[0081]
Furthermore, when a photo area is extracted before the character area from the image data after the graphic area is extracted (third mode), a certain part in the photo area is erroneously determined as a character area, and is applied to the character area in a later process. It is possible to prevent the performed processing from being performed. Accordingly, the deterioration of the graphic image and the photographic image is reduced. In addition, when a character area is extracted prior to a photographic area from the image data after extraction of the graphic area (fourth mode), it is possible to extract a character image in the photographic area. Therefore, irreversible compression processing can be performed on a photographic image without degrading the graphic image and the character image.
[0082]
When the first priority area is a character area (fifth and sixth modes), as shown in FIGS. 33 (A) and 34 (A), the character area is extracted first from the received image data. Later, since the photo area and the graphic area are separated from the remaining data, the character area is not extracted along with the other area under the influence of the separation process of the other area. As a result, the character area can be reliably extracted without being misidentified as another area. Therefore, when the main purpose is to perform processing adapted to a character region such as character recognition processing, more character regions can be reliably extracted and appropriate processing can be executed on the region. In other words, for example, when a character image is superimposed on a photographic image or a graphic image in the image data, the entire character region is determined as a photographic region or a graphic region without being determined, and the character image is extracted. In addition to not being able to sufficiently execute the character recognition process for the character image, it is possible to prevent the character image from being inappropriately processed.
[0083]
Further, when a photographic area is extracted from the image data after extracting the character area before the graphic area (fifth mode), for example, a photographic area included in the graphic area can be extracted. Therefore, the deterioration with respect to the character image and the photographic image is reduced. Further, when a graphic area is extracted before the photographic area from the image data after the character area is extracted (sixth mode), for example, a graphic area included in the photographic area can be extracted. Therefore, irreversible compression processing can be performed on a photographic image without degrading the character image and graphic image.
[0084]
The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope of the claims.
[0085]
The image processing apparatus of the present invention can be applied to devices such as computers such as scanners, personal computers, workstations, and servers, digital copiers, facsimile apparatuses, and MFPs (multi-function peripherals) in addition to the aspects described in the above embodiments. Can be applied.
[0086]
In the above-described embodiment, the file server 3 is configured to expand the character image and the graphic image from the file received from the image processing apparatus 1 and perform the character recognition process and the vector conversion process, respectively. The processing may be performed by the image processing apparatus 1. In addition, the contents of individual processing blocks in each region separation process of FIGS. 7 to 12 can be changed as appropriate.
[0087]
In the above-described embodiment, the image processing apparatus 1 is configured to set an area preferentially extracted according to the content of the image data among the photo area, the graphic area, and the character area. The invention is not limited to this. In the image processing apparatus according to the present invention, the area extracted first may be fixed in advance, and for example, the character area may be fixed as the area extracted first. Further, in the image processing apparatus according to the present invention, the extraction order of the areas may be fixed in advance, for example, the order of the character area, the photographic area, and the graphic area, or the order of the character area, the graphic area, and the photographic area. Can be fixed as order.
[0088]
The image processing apparatus and the image processing method according to the present invention can be realized by a dedicated hardware circuit for executing each of the above procedures, or by a CPU executing a predetermined program describing the above each procedure. Can do. When the present invention is realized by the latter, the predetermined program for operating the image processing apparatus may be provided by a computer-readable recording medium such as a flexible disk or a CD-ROM, or via a network such as the Internet. It may be provided online. In this case, the program recorded on the computer-readable recording medium is usually transferred and stored in a hard disk or the like. Further, this program may be provided as, for example, a single application software, or may be incorporated in the software of the apparatus as one function of the image processing apparatus.
[0096]
【The invention's effect】
As described above, according to the image processing apparatus of the present invention, after a character area is first extracted from image data to be processed, a photographic area and a graphic area can be separated from the remaining data. For this reason, the character area is not extracted accompanying the other area under the influence of the separation process of the other area. As a result, the character area can be reliably extracted without being misidentified as another area. Therefore, when the main purpose is to perform processing adapted to a character region such as character recognition processing, more character regions can be reliably extracted and appropriate processing can be executed on the region.
[Brief description of the drawings]
FIG. 1 is a block diagram showing an overall configuration of an image processing system including an image processing apparatus according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating an example of a configuration of an image processing apparatus.
FIG. 3 is a diagram illustrating an example of a document mode setting screen in an operation unit.
FIG. 4 is a flowchart illustrating a processing procedure in the image processing apparatus.
FIG. 5 is a diagram schematically illustrating an example of image data received from a scanner.
6A and 6B are diagrams for explaining composition of regions, in which FIG. 6A shows a state after composition, and FIG. 6B shows a state before composition.
FIG. 7 is a flowchart showing a procedure of region separation processing in a first mode.
FIG. 8 is a flowchart showing a procedure of region separation processing in a second mode.
FIG. 9 is a flowchart showing a procedure of region separation processing in a third mode.
FIG. 10 is a flowchart illustrating a procedure of region separation processing in a fourth mode.
FIG. 11 is a flowchart illustrating a procedure of region separation processing in a fifth mode.
FIG. 12 is a flowchart illustrating a procedure of region separation processing in a sixth mode.
FIG. 13 is a flowchart showing a procedure of region division by binarization.
14 is a diagram illustrating a binary image in which an area other than the background in FIG. 5 is painted black.
15 is a diagram showing an image composed of the edges of FIG.
FIG. 16 is a flowchart showing a procedure for extracting a first photograph / graphic region.
FIG. 17 is a flowchart showing a procedure for extracting a first photograph / graphic region continued from FIG. 16;
FIG. 18 is a diagram showing a first histogram.
FIG. 19 is a diagram showing a second histogram.
FIG. 20 is a flowchart showing a procedure for dividing an area by edges.
FIG. 21 is a diagram schematically showing an example of a region obtained by region division by edge, where (A) is in the first, second, or fifth mode, and (b) is in the third, The case of the 4th or 6th mode is shown.
FIG. 22 is a flowchart showing a procedure for extracting a character area;
FIG. 23 is a diagram showing image data used for explaining character region extraction.
FIG. 24 is a diagram for explaining binarization processing based on a variation threshold.
FIG. 25 is obtained for each connected black pixel of the same label in a connected edge image obtained by performing binarization processing using a variation threshold and a black pixel connecting process and a labeling image obtained from the connected edge image data. It is a figure which shows a circumscribed rectangle.
FIG. 26 is a diagram for explaining a filter process used when a high frequency component is removed from a characteristic frequency component of image data.
FIG. 27 is a diagram illustrating an example of an oblique direction edge component image obtained by binarizing an extracted high frequency component.
FIG. 28 is a diagram illustrating an example of (A) a brightness histogram created from a brightness image of image data in a character region, and (B) a peak detection histogram.
29 shows (A) a photograph area extracted first, (B) a second extracted graphic area, and (C) a third one from the image data of FIG. 5 in the area separation processing in the first mode. It is a figure which shows the character area extracted by.
30 shows (A) the first extracted photo area, (B) the second extracted character area, and (C) the third one from the image data shown in FIG. 5 in the second mode area separation processing. It is a figure which shows the figure area | region extracted.
31 is a diagram showing (A) the first extracted graphic region, (B) the second extracted photo region, and (C) the third one from the image data of FIG. 5 in the region separation processing in the third mode. It is a figure which shows the character area extracted by.
32 shows (A) a graphic area extracted first, (B) a second extracted character area, and (C) a third one from the image data of FIG. 5 in the area separation processing in the fourth mode. It is a figure which shows the photograph area | region extracted by (b).
33 shows (A) a character region extracted first, (B) a second extracted photo region, and (C) a third one from the image data of FIG. 5 in the region separation processing in the fifth mode. It is a figure which shows the figure area | region extracted.
34 shows (A) the character region extracted first, (B) the second extracted graphic region, and (C) the third one from the image data of FIG. 5 in the region separation processing in the sixth mode. It is a figure which shows the photograph area | region extracted by (b).
[Explanation of symbols]
1 ... Image processing device,
101 ... control unit,
102 ... storage part,
103 ... operation unit,
104 ... input interface part,
105 ... output interface part,
106 ... area separation unit,
108: Image processing unit,
108a ... Photo region processing unit,
108b ... a graphics area processing unit,
108c ... character area processing unit,
109 ... Document file creation unit,
110 ... file format conversion unit,
111 ... Bus
2 ... Scanner,
3 ... File server,
4 Computer network.

Claims (10)

An image processing apparatus having an area separation means for separating a photographic area, a graphic area, and a character area from image data to be processed,
The region separating means includes
From the image data, and character region earliest extracting means for extracting a character region before the photographic region and the graphics region,
Photo area preceding extraction means for extracting a photo area before the graphic area from the data remaining after the character area is extracted from the image data;
With
The photograph area preceding extraction means is
A first area division process that can be divided into a plurality of predetermined areas is performed on the data remaining after the character area is extracted from the image data, and an area identified as a photo area is extracted from the divided areas. First photo area extraction means;
A plurality of areas smaller than the predetermined area with respect to data obtained by further extracting an area identified as a photographic area by the first photographic area extracting means from data remaining after extracting a character area from the image data A second photographic area extracting means for performing a second area dividing process that can be divided into two areas, and extracting a photographic area and a specified area among the divided areas;
An image processing apparatus. The first area dividing process detects edges of a binary image in which a character area is extracted from the image data and a portion of a photographic area or a graphic area in the remaining data is distinguished from a background portion other than these. The second area dividing process is configured to extract a character area from the image data and further extract an area identified as a photographic area from the remaining data to extract the edges of the remaining data. The image processing apparatus according to claim 1, wherein the image processing apparatus can be divided into a plurality of areas smaller than the predetermined area by detection .   An image processing apparatus having an area separating means for separating a photograph area, a graphic area, and a character area from image data to be processed,
  The region separating means includes
  A character area first extraction means for extracting a character area from the image data prior to the photograph area and the graphic area;
  A graphic area preceding extraction means for extracting a graphic area from the data remaining after the character area is extracted from the image data;
  With
  The graphic area preceding extraction means
  A first area dividing process that can be divided into a plurality of predetermined areas is performed on the data remaining after the character area is extracted from the image data, and an area identified as a graphic area is extracted from the divided areas. First graphic region extraction means;
  A plurality of areas smaller than the predetermined area with respect to data obtained by further extracting the area specified as the graphic area by the first graphic area extracting means from the data remaining after the character area is extracted from the image data A second graphic area extracting means for performing a second area dividing process that can be divided into two areas and extracting a graphic area and a specified area among the divided areas;
  An image processing apparatus.   The first area dividing process detects edges of a binary image in which a character area is extracted from the image data and a portion of a photographic area or a graphic area in the remaining data is distinguished from a background portion other than these. The second area dividing process is configured to extract a character area from the image data and further extract an area identified as a graphic area from the remaining data, and then remove the edge of the remaining data. The image processing apparatus according to claim 3, wherein the image processing apparatus can be divided into a plurality of areas smaller than the predetermined area by detection.   Further comprising reading means for obtaining image data by reading a document The image processing apparatus according to claim 1, wherein the image data to be processed is obtained by the reading unit.   An image processing method having a region separation step of separating a photo region, a graphic region, and a character region from image data to be processed,
  The region separation step includes:
  From the image data, a character area first extraction step for extracting a character area before a photo area and a graphic area,
  A photographic area preceding extraction step for extracting a photographic area before a graphic area from the data remaining after the character area is extracted from the image data;
  With
  The photographic area preceding extraction step includes:
  A first area dividing process that can be divided into a plurality of predetermined areas is performed on the data remaining after the character area is extracted from the image data, and an area identified as a photo area is extracted from the divided areas. A first photo region extraction stage;
  A plurality of areas smaller than the predetermined area with respect to the data remaining after the area specified as the photographic area is further extracted from the data remaining after the character area is extracted from the image data A second photo area extraction step of performing a second area dividing process that can be divided into two areas and extracting a photo area and a specified area among the divided areas.
  An image processing method.   An image processing method having area separation means for separating a photographic area, a graphic area, and a character area from image data to be processed,
  The region separation step includes:
  From the image data, a character area first extraction step for extracting a character area before a photo area and a graphic area,
  A graphic area preceding extraction step for extracting a graphic area from the image data prior to the photo area from the data remaining after the character area is extracted from the image data;
  With
  The graphic region preceding extraction step includes:
  A first area dividing process that can be divided into a plurality of predetermined areas is performed on the data remaining after the character area is extracted from the image data, and an area identified as a graphic area is extracted from the divided areas. A first graphic region extraction stage;
  A plurality of areas smaller than the predetermined area with respect to data obtained by further extracting the area specified as the graphic area by the first graphic area extracting means from the data remaining after the character area is extracted from the image data A second graphic region extracting step of performing a second region dividing process that can be divided into two regions and extracting a graphic region and a region identified among the divided regions;
  An image processing method.   An image processing program for causing an image processing apparatus to execute a region separation procedure for separating a photograph region, a graphic region, and a character region from image data to be processed,
  The region separation procedure includes:
  From the image data, a character region first extraction procedure for extracting a character region prior to a photo region and a graphic region,
  A photo area preceding extraction procedure for extracting a photo area ahead of a graphic area from the data remaining after the character area is extracted from the image data;
  With
  The photographic area preceding extraction procedure is:
  A first area dividing process that can be divided into a plurality of predetermined areas is performed on the data remaining after the character area is extracted from the image data, and an area identified as a photo area is extracted from the divided areas. A first photo region extraction procedure;
  The first photograph area extracting means from the data remaining after the character area is extracted from the image data The second region dividing process that can be divided into a plurality of regions smaller than the predetermined region is performed on the data remaining after the region identified as the photographic region is further extracted, and among the divided regions, the photographic region And a second photo area extraction procedure for extracting the specified area,
  An image processing program characterized by that.   An image processing program for causing an image processing apparatus to execute a region separation procedure for separating a photograph region, a graphic region, and a character region from image data to be processed,
  The region separation procedure includes:
  From the image data, a character region first extraction procedure for extracting a character region prior to a photo region and a graphic region,
  A graphic area preceding extraction procedure for extracting a graphic area before a photographic area from the data remaining after the character area is extracted from the image data;
  With
  The graphic region preceding extraction procedure is:
  A first area dividing process that can be divided into a plurality of predetermined areas is performed on the data remaining after the character area is extracted from the image data, and an area identified as a graphic area is extracted from the divided areas. A first graphic region extraction procedure;
  A plurality of areas smaller than the predetermined area with respect to data obtained by further extracting the area specified as the graphic area by the first graphic area extracting means from the data remaining after the character area is extracted from the image data A second graphic area extraction procedure for performing a second area division process that can be divided into two areas and extracting a graphic area and an area identified from among the divided areas;
  An image processing program characterized by that.   A computer-readable recording medium on which the image processing program according to claim 8 or 9 is recorded.

Images