JP4808850B2 - Method and system for computer control from physical / electronic objects, ie linking to Internet resources - Google Patents

Description

【０３８０】
本システムは、この例を一般化することで、どのようなベンダーからのいかなる製品をもサポートし、予想される要求フォーマット（例えば、製品コード、メッセージタイプ、識別子）に合致したメッセージを、インターネットを介して送ることができ、また、対応する応答フォーマットでメッセージを受信できる。このようなシステムでの使用に適したメッセージフォーマットの組を、以下に詳述する。
【０３８１】
【透かし登録−プロセスの第１のステップ】
本システムが、オブジェクト識別子（例えば、透かし）に対応する応答（例えば、ＵＲＬ）を識別するため、このデータを、そのデータが対応する透かしに関連させて、最初にデータベース１７内において関連づけを行う必要がある。この透かし登録プロセスは、後に使用する基本識別情報を捕捉して入力メッセージの妥当性を確認し、関連する情報／アクションを識別する。ここで示す例では、識別情報は：
・顧客アカウント
・オブジェクトおよび関連する属性（名前、記述、期限切れ等）
・アクション
・（登録更新のための）登録済シリアル番号
を含む。
【０３８２】
顧客アカウントによって透かし登録者を識別する。ほとんどの場合、この者に対してサービスの課金がなされる。妥当性の確認およびセキュリティ上の理由から、顧客アカウントは、公知かつ現存するアカウントでなければならない。アカウントのパスワードを含めたアカウント情報は、アカウント管理システムで保守される。
【０３８３】
オブジェクトおよび関連する属性によって、透かしを入れるべきオブジェクトを識別する。オブジェクト属性は、一般的にはオブジェクトの名前と記述、およびオブジェクト登録にアクセス権があるアカウントのリストを含む。これらアクセス権を有する「支援」アカウントとは、一般的には、広告代理店、プリプレスハウス等であり、ここで考慮している、印刷広告例における透かし埋め込みプロセスに関与している。
【０３８４】
アクションは、透かしが検出されたときに顧客が望む応答を規定している。それは製品によって様々であるが、ここで説明する例では、透かしの入ったオブジェクトに関する付加情報を返却することを含む。例示するシステムでのアクションは、透かしの入ったオブジェクトに関連したホームページの表示に使用するＵＲＬあるいはＨＴＭＬの返却である。他の製品に対する所望の応答には、オブジェクトの所有者および所有権情報の表示、ソフトウエア／データのダウンロード、ストリーム化されたオーディオあるいはビデオの配信、広告の発表、オブジェクトに基づくアクションの開始等がある。
【０３８５】
登録済シリアル番号は、登録の一番終わりにある構成要素である。それは、このように割り当てられたベンダーおよび製品に一意の識別子であり、それによって本システムが、当該オブジェクトに対する特定情報／アクションを要求できる。
【０３８６】
いくつかの主要な製品登録概念として、以下のものがある。
【０３８７】
透かし登録は、製品固有のプロセスである。
【０３８８】
他の製品機能あるいはスケジュールに影響を与えることなく、各製品が、自由にその性能を更新できるようにするため、登録プロセスを製品固有のものとしている。
【０３８９】
透かし登録は、ウェブ動作可能である。
【０３９０】
典型的な登録としてウェブ動作可能なプロセスがあり、そのプロセスは、オブジェクトの所有者（出版社、広告代理店、スタジオ等）より基本的な識別情報を要求し、オブジェクトに埋め込まれる一意の識別子を持つパケットを登録者へ返却する。透かし埋め込みアプリケーション（すなわち、ソフトウエア）は、このパケットを使用して、クライアントのオブジェクト内に透かしタイプとシリアル番号を埋め込む。例示したシステムでは、単一のオブジェクトにただ１つの透かしを埋め込む。他の実施例では、単一のオブジェクトに多数の透かしが埋め込まれる。
【０３９１】
顧客が透かしを登録するとき、本システムは、透かしのシリアル番号と、登録プロセスの間に顧客によって与えられた情報とを関連づける。この関連情報は、製品が異なれば変わるものである。以下の表は、典型的な雑誌の広告オブジェクトについて一組の関連情報を示している：
【表２】

【０３９２】
透かし登録が失効する。
【０３９３】
製品によっては、透かしの有効期間が限定されている。これらの透かしに対して、登録プロセスは、割り振られたシリアル番号に対する失効日を使用している。システムが、失効したシリアル番号に対してアクションを要求するメッセージを受けた場合、エラーが返される。登録者は、失効日を更新して、透かしシリアル番号の失効を延長する。失効の延長は、顧客への課金となる。
【０３９４】
透かし登録は一つ以上のウェブセッションで完了できる。
【０３９５】
登録は、単一ステップあるいは多段ステップのプロセスとすることができる。プロセスの開始の際、メディア所有者が、要求された情報をすべて有している場合、本システムは、オンラインで透かしシリアル番号を要求するための簡単なウェブ動作可能な方法を提供する。与えられた全情報によって、その登録は、「アクティブ」とみなされる。すなわち、顧客は直接それを使用できる。登録者が、最初のセッションで利用できる要求情報をすべて持っていない場合には、最小セットの情報（例えば、名前、および／または組織名と製品）を提供することで、その登録者が埋め込みプロセスで使用できるように製品の透かしシリアル番号を依然として発行する。透かしが入れられるメディア（例えば、ＵＲＬ等）に関連したアクションが公知になっていないとき、この部分的な登録が最も一般的に使用される。部分的に登録されたシリアル番号は、要求された登録情報のすべてが完了するまで、「非アクティブ」とされる。「非アクティブ」のシリアル番号の処理が要求された場合、本システムは、エラーメッセージを発する。アクティブであろうと非アクティブであろうと、これらの登録は、適用しうる契約の期間と条件に従う、支払い請求可能な項目とみなされる。
【０３９６】
顧客は登録を更新して、新たな情報を反映させ、および／または、前の登録セッションを完了する。例えば、登録された顧客は、その顧客をリダイレクトするのに使用されるＵＲＬを特定せずに、透かしシリアル番号を要求できる。本システムがシリアル番号を割り当てることで、顧客は、埋め込みプロセスを継続できるが、顧客が、ＵＲＬと、このシリアル番号に関連する他の必須の情報とによって登録を完了するまでは、登録は完了したとはみなされない。
【０３９７】
透かし登録は安全である。
【０３９８】
登録者と、その登録者が認証したアカウントだけが、特定の透かし登録を利用できる。
【０３９９】
図示したシステムにおいて、透かしを登録する顧客アカウントは、特定の広告代理店、および／またはプリプレスハウスに許可を与えて、通常の作業の一部として登録内のあるフィールドを変更できるようにする。顧客アカウントは、契約プロセスの一部として設定される。広告代理店やプリプレスハウスに対しては、顧客が利用できる管理ウェブサイトを通じて、必要に応じてアカウントが設定される。
【０４００】
全製品に同じ基本原理が適用され、明確に許可されたアカウントだけが登録情報を利用できるように制限されている。アカウントは、パスワードで保護されている。広告代理店やプリプレスハウスは、単一のパスワードを共有している。他の実施例では、それぞれに独自のパスワードが割り当てられている。
【０４０１】
透かし登録の変更が記録される。
【０４０２】
すべての登録アクション、つまり、生成、変更、および削除が監査記録に記録される。認証済みのユーザ名、アクションの日／時間、およびアクションそのものがすべて格納されて、完全な監査証跡を提供する。
【０４０３】
図６は、登録に関連したプロセスおよびデータの流れを示している。
【０４０４】
【登録データベースへのデータ入力】
メディアオブジェクトにより検知された透かし情報との関連において、クライアントアプリケーション、ルータ、および製品ハンドラを最初に説明したが、同じ構想基盤をプロセスの初期段階に使用して、登録データベース１７にデータを入力する。すなわち、出版社、広告代理店、プリプレスハウス等が、アプリケーション２８ｃの適当に設定された変数を使用して、（ａ）初期データをデータベースに与え、（ｂ）そのデータを更新し、（ｃ）データベースに現在の値を問い合わせる。あるいは、専用の登録サーバ１９（図２）を使用する。
【０４０５】
ファイル内の特定の透かしに対して、データベースの記録内容をカプセル化することで、登録プロセスに複数の者が容易に関与できる。そのファイルには、様々なエンティティによって情報が連続して追加（あるいは、更新）され、そのファイルを使ってデータベース１７と記載されたエンティティ間でデータ伝送をする。
【０４０６】
ナイキがワイヤード誌に広告を掲載した場合を想定する。ワイヤードの広告部門は、ナイキのメディアバイヤーからの要求に応じて紙面を売ることに同意する。ワイヤードは、システム１０のオペレータによって特定の透かし識別子を入れることで、関連する透かし作業を開始する。（この工程と、以降のほとんどの工程はコンピュータによって行うことができ、そのコンピュータは、様々な加入者が使用する適当なソフトウエアによる指示に従って通信できるコンピュータである。このソフトウエアとは、以降の議論では登録サーバ１９であるが、既に述べたように、製品ハンドラ１６をアレンジして、このような機能を実行するようにしてもよい。）ワイヤードは、オペレータに発行識別子（例えば、２０００年７月号のサンフランシスコ版）と、雑誌で使用する内部トラッキング情報を与える。登録サーバ１９は、ワイヤードに確認ファイルを電子メールで送ることで応答する。このファイルは、それまでの情報（すなわち、透かし識別子、発行ＩＤ、雑誌のトラッキング情報）をカプセル化するものである。サーバ１９は、新たなデータベース記録を生成し、その記録の対応フィールドにある受信情報を解析する。
【０４０７】
ワイヤードは、登録サーバより受信したファイルをナイキのメディアバイヤーへ転送する。ナイキは、その情報に、広告名や内部トラッキング情報を含む付加データを付け足す。更新されたファイルは、サーバ１９へ転送される。サーバは、再びファイルを処理し、新たな情報によってデータベース記録を更新する。確認ファイルは、ナイキとワイヤードの両方に電子メールで送られるため、各々が最新の情報を有する。
【０４０８】
このように処理が行われ、各エンティティは、電子メールされたカプセルファイルによって、登録サーバ１９へ新たなデータを提供する。サーバは、対応するデータベース記録を更新し、識別した加入者宛てに、更新されたカプセルファイルを送るので、各加入者は最新情報を持つことになる。
【０４０９】
このプロセスによって、一旦、ナイキがデータを入力すると、外部の広告代理店にカプセルファイルが転送される。広告代理店は、そのファイルを同様に扱い、特定情報を付加して、サーバへ転送する。その結果、サーバは、データベース記録を更新し、ファイルのカプセル化のため、メール配信リストに広告代理店を追加して、ファイルの最新版をワイヤード、ナイキ、および広告代理店へ発送する。
【０４１０】
次に関与するのがプリプレスハウス等である。
【０４１１】
透かしＩＤが対応するＵＲＬの認識と、それ従って行われるデータベース記録の更新は、プロセスの終わり近くになるまで行われない。
【０４１２】
同じプロセスによって、いつでも、誰もがデータベースに付加情報を提供でき、他の者とその情報を共有できる。（加入者全員への配信に適さない情報もあり、それに従って、それらにしるしをつけることができる。）
【０４１３】
サーバ１９は、常時、すべての通信がそれを介して行われるハブである必要はない。例えば、ナイキが更新したファイルは、ナイキによって直接、広告代理店へ転送される。広告代理店は、その情報を追加した後、２度の更新を行ったファイルをサーバ等に提供する。
【０４１４】
配信されたファイルを、実際のデータベース記録の代用として使用することで、多くの利点が生まれる。その１つが、インターネット接続の必要なしに、全加入者が最新情報をローカルに入手できることである。従って、創造的な管理者が浜辺で仕事をしたい場合、あるいはネットからの接続が断たれたときでも、必要な情報を手に入れることができる。他の利点は、遠隔データベースとインタフェースをとったり、アテンダント認証とセキュリティ上の障害をナビゲートするといった、アーキテクチャ上、困難なことが要求されるのではなく、それぞれの加入者のところでソフトウエアツールと、特定の広告に固有のローカルデータとの一体化が容易になることである。
【０４１５】
上述した議論では、電子メールファイルに言及したが、一般的な電子メールプログラムを普通に使用することはできない。その代わり、アテンダントの業務（ロジスティックス）を良好に管理するため、各加入者は特別のファイル管理／メールプログラムを使用する。そのプログラムは、各広告に対する最新ファイルを追跡し、それを要求通り直ぐに更新できるようにして、様々なコンテントフィールドによってファイルにインデックスを付ける。従って、ユーザインタフェースは、データベースフィールドでグループ化あるいは分類されたファイルリストを提示するので、所定フィールドあるいはタブをクリックするだけで情報の編集あるいは付加ができるようになる。
【０４１６】
言うまでもなく、上記のファイル配信システムは、本システムに必要不可欠なものではない。当然ながら、多種多様な他の構成も使用できる。その１つに、必要に応じて各加入者がサーバ１９にログオンして、適切な許可を受けたデータベースフィールドを検査したり、更新するものがある。
【０４１７】
【番号付け方式】
オブジェクト内において（例えば、透かしによって）符号化されたペイロード情報は、複数の形式と大きさを取り得る。以下に、典型的な分類を示す：
（ａ）領域ベースのペイロードの区分化
（ｂ）顧客／使用ベースのペイロードの区分化
（ｃ）非セグメントペイロード
（ｄ）固有ＩＤ
【０４１８】
【領域ベースのペイロード区分化】
領域ベースのペイロードの区分化アプローチによって、ペイロードをフィールドに分割する。各フィールドは、個別の意味を持っている。上述したＣＬＡＳＳ／ＤＮＳ／ＵＩＤ構成は、このタイプのアプローチの例である。
【０４１９】
６０ビットのペイロードを考える。１２ビットがクラスＩＤを構成し、それらが最重要領域の識別子として機能する。他のビットの内、２４ビットは、ＤＮＳＩＤを構成し、それらが中間レベルの領域を識別する。クラスＩＤとＤＮＳＩＤとが一緒になって、データ発信元となるオブジェクトのクラスと、顧客と、ペイロードに応答するサーバとを完全に識別する。（応答の中には、遠隔サーバに送られるというよりも、クライアントコンピュータで処理されるものがある。）
【０４２０】
残りの２４ビットは、ユーザＩＤであり、最も粒度の高い識別子として機能して、ペイロードの特定ソースを示す。応答するサーバは、このＩＤに基づいて、どの応答が提供されるのかを正確に知る。
【０４２１】
このペイロードは、その全体が顧客オブジェクトに埋め込まれている。クライアントコンピュータがペイロードを検知すると、アプリケーション２８ｃは、そのペイロードをクラスＩＤフィールド、ＤＮＳＩＤフィールド、ユーザＩＤフィールドに分けて解析（暗号解読）する。クラスＩＤを使用して、一つ以上のクライアント側あるいはサーバ側のプログラムを起動する。一旦、「立ち上がる」と、これらの製品は、ＤＮＳＩＤとユーザＩＤとともにクラスＩＤを使用し、所望のアクションを完了する。
【０４２２】
クラスＩＤの１つは、オブジェクトが雑誌のページであることを示している。これに基づいて、アプリケーション２８ｃは、応答を目的として、ペイロードが上述したルータ／ハンドラへ向かうようにする。他のクラスＩＤは、オブジェクトが音楽であることを示している。アプリケーションは、再びペイロードが同一ルータに向かうようにする。すなわち、アプリケーションは、応答のため、ペイロードが音楽産業協会によって保守されるサービスに向かうようにする。他のクラスＩＤはまた、オブジェクトが食料品の包装であることを示しており、応答のため、ペイロードをオンライン食料品店に向ける。さらに他のクラスＩＤは、オブジェクトが名刺であることを示しており、ペイロードは、クライアントの機械でローカルに処理される。クラスＩＤ間のマッピングと、アプリケーション２８ｃによってペイロードが向けられた対応応答メカニズムは、上述したように、クライアントコンピュータのオペレーティングシステム（例えば、ウインドウズレジストリ）と関連したデータベースによって保守される。
【０４２３】
一旦、適切な応答先にペイロードが送られたならば、そのエンティティは、ＤＮＳＩＤを調べて、正しい応答エンティティをさらに区別する。例えば、ツリー状のサーバ内では、様々なＩＤが様々なクラスのサーバに対応している。
【０４２４】
ペイロードが、一旦、正しいクラスのサーバに向けられれば、ユーザＩＤは、ツリー内の末端の「葉」を規定し（例えば、データベース記録）、それが最終的に応答を示すことになる。
【０４２５】
【顧客／使用ベースのペイロード区分化】
第２のアプローチもまた、ペイロードの区分化技術を使用している。しかし、この構成では、最初のフィールドが、それに続くビットの解釈を規定している（例えば、区分化された様々なフィールド）。
【０４２６】
この場合においても、ペイロードが６０ビットであるとする。１２ビットをバージョンＩＤとすることができる。これらのビットは、後続するビットの解析および解釈の方法を示すとともに、（前述したアプローチにおけるクラスＩＤのように）、使用すべき特定のアプリケーションプログラム２８ｃを示している。よって、バージョンＩＤのビットは、ペイロードタイプを示す役割を果たす。明示した実施例では、それらのタイプの１つが、そのペイロードの出所が雑誌のページであり、それに従って取り扱うべき旨を示している。その場合、残りの４８ビットを、所有者ＩＤ（１５ビット）、出版物ＩＤ（１５ビット）、およびメディアＩＤ（１８ビット）の３つのフィールドに分けて解析することができる。
【０４２７】
所有者ＩＤは、透かしの登録をする顧客（例えば、ナイキ）を示している。これは、広告効果の分析や課金の目的に使用される。出版物ＩＤは、特定の出版物（例えば、２０００年７月のワイヤード誌のサンフランシスコ版）を示す。メディアＩＤは、その出版物内の特定のページ位置を示している。
【０４２８】
既に述べたように、ペイロードは、その全体が顧客のオブジェクト内に埋め込まれている。そのペイロードは、最初にバージョンＩＤを判断すべく解析される。ユーザ装置１２が、そのようなオブジェクトをローカルに扱うようプログラムされていれば、そのバージョンＩＤに対応するデータに従って、さらなる解析が行われるとともに、解析されたデータの関連処理も実行される。その装置が、サービスのため遠隔地へペイロードを送るよう指示されていれば、対応する遠隔サービスを行うエンティティを正確に識別するよう要求された詳細な解析だけをした（少しでもあれば）、完全なペイロードを送信できる。
【０４２９】
【非区分化ペイロード】
非区分化ペイロードは、（上述した）バージョンＩＤとオブジェクトＩＤという２つの部分のみからなる。具体的な例では、６０ビットのペイロードを再度、使用する。それらの内、１２ビットはバージョンＩＤとして、また、残りの４８ビットはオブジェクトＩＤとしての役割を果たす。
【０４３０】
このアプローチでは、所有者／顧客、出版、発行、メディアの関係は、オブジェクト識別子内において何らかの方法でそのまま示すというよりも、それらすべてをデータベース１７において保守する。
【０４３１】
【固有ＩＤ】
これは非区分化ペイロードに似ているが、固有識別子という単一フィールドからなる。同じアプリケーション２８ｃを常に使用し、ペイロードの内容とは無関係に（例えば、ローカルに処理したり、あるいは、所定の宛先へ送って）、そのペイロードデータに対して一貫した扱いをしている。
【０４３２】
上述したアプローチを結合したり、組み合わせたものも当然、使用できる。また、６０ビットのペイロード長は、一例に過ぎず、さらに長いペイロード（例えば、最長１０２４ビット）、あるいは短いペイロード（８ビット）も当然のことながら使用できる。
【０４３３】
特定の実施例では、１０ビットのペイロードタイプと、２２ビットの透かしシリアル番号とからなる、３２ビットの非区分化ペイロードを使用している。材料（例えば、複合グラフィックスを含む広告）の中には、、数個のシリアル番号で符号化できるものもある。このペイロードと所有者／出版等とのマッピングは、データベース１７に保守されている。
【０４３４】
（上述したように、アプリケーション２８ｃから送られてきたデータは、通常、識別子ペイロード以外の情報を含んでいる。例えば、アプリケーション２８ｃのタイプおよびバージョン番号、送信アプリケーションの電子アドレス等である。）
【０４３５】
【ルータ】
ルータ１４は、しるし検出およびレスポンスモデルによって様々な製品をいくつでも使用できるようにする。この機能を別々にし、汎用のままにしておくことで、既存の製品あるいはプロダクトハンドラ１６の設計変更をしないで、新製品を追加できる。このアプローチを成功させる２つの鍵は、速さと柔軟性である。標準化され、公開されたインタフェースを使用することで、ルータは、これら２つの目標の両方を可能にする。
【０４３６】
典型的なインタフェースの前提となるものが包囲技術であり、それによって、ルータは、外部トランザクションの封を「開く」ことができ、また、トランザクション（メッセージ）の残りの部分の暗号を解読せずに、ベンダーおよびアプリケーションＩＤを抽出することができる。これら２つの情報が与えられると、ルータは、簡単なルックアップテーブルを使用して、製品ハンドラが、そのトランザクションを完了するのに適しているかを判断する。その後、ルータは、ベンダー、アプリケーション、トランザクションの残り、およびインターネットの「返信」アドレスを適切な製品ハンドラに渡す。この取扱いが簡単であることからルーティングの遅延は最小になるが、ベンダー／製品固有のハンドラに対する実際の応答処理は遅延する。製品ハンドラに渡されるデータに「返信」アドレスを含めることで、ルータは、製品の応答に対する戻りのルーティングの負担から開放される。
【０４３７】
ルータについて概観すると：
１．顧客製品より受けた要求パケットの暗号解読をして、パケットの基本構成要素であるベンダーＩＤ、アプリケーションＩＤ、メッセージにする；
２．既知で正しい値のリストに対して要求パケットの基本構成要素を検証する；
３．要求パケットの要素は無効であることが判明した場合、無効の要素を知らせるメッセージを発行し、それを発信セッション（例えば、製品）に戻す；
４．暗号解読された要求パケットの内容と発信セッションについての認識結果を適切な製品ハンドラへ送る；
５．受信した無効パケットを含む、遭遇したエラーは何でもシステムモニタに報告する。
【０４３８】
図５は、ルータに関連するデータの流れを示す。
【０４３９】
【製品ハンドラ】
例示した製品ハンドラ１６の主な機能は、インターネットとルータ１４を介して、アプリケーション２８ｃより受信した要求を処理し、発信側装置１２へ要求情報／アクションを返すことである。特定の実施例において、要求された情報は、アプリケーションより送られてきた透かしペイロードに関連するＵＲＬである。他の実施例では、他のアクションおよび／または情報が要求される。
【０４４０】
受信した透かしペイロード各々は、データベース１７内の情報を使用して検証される。透かしペイロードＩＤが見つかり、それがアクティブであれば、要求されたアクションが実行される。透かしペイロードＩＤが見つからず、あるいは、それが非アクティブであれば、要求アプリケーションにエラーメッセージを返す。
【０４４１】
トラッキングと課金を行う目的で、すべての要求をトランザクションログに記録する。これは、アプリケーション２８ｃが渡した第２のペイロード情報（例えば、郵便番号、人口統計世帯ＩＤ等）を含む。
【０４４２】
システムの応答を速くするため、製品ハンドラ１６は、ハンドラが予測する透かしペイロードの到来に対応させて、先を見越してＵＲＬをアプリケーションへ送る。これらのＵＲＬは、アプリケーション２８ｃに関連したメモリに格納され、アプリケーションが必要とするときは直ちに呼び出される。
【０４４３】
例えば、透かし入りの広告を含む雑誌を考える。ユーザが最初の広告を装置１２に渡すと、透かしの解読が行われ、製品ハンドラ１６へ転送される。これは、その広告に対応するＵＲＬに応じるものである。そして、アプリケーション２８ｃは、受信したＵＲＬを装置１２上のウェブブラウザ２８ｂに渡す。これによって、そのインターネットアドレスにリンクが張られる。しかし、ここでハンドラは、ユーザが読んでいる雑誌を知る。ハンドラは、最初に受信した透かしを参照して、例えば、ユーザが、タイム誌の２０００年３月１４日のサンフランシスコ版を読んでいて、ちょうど８５ページを見ていることを認識する。この情報をもとに、ハンドラは、その号の中の、他の広告に関連したＵＲＬについてデータベース１７に問い合わせることができる。（データベースのインデックスは、所定雑誌の号あるいは他の総合データソース内の全広告を認識する高速照会ができるように構成される。）これらのＵＲＬは、アプリケーション２８ｃに返され、格納される。次に、ユーザが１１０ページの広告を装置１２に示した場合、アプリケーション２８ｃは、その広告が、ローカルに格納された対応ＵＲＬを既に有していることが分かる。そして、アプリケーションは、その対応ＵＲＬをウェブブラウザに渡す。ウェブブラウザは直ちにリンクを張って、アプリケーションと遠隔システム間をデータが往復してしまうのを回避する。
【０４４４】
キャッシュの最適化は、様々な方法でできる。その１つとして、次に見ると思われるページに対応するＵＲＬを最初に送ってしまう方法がある。例えば、ユーザがセンサ２２に８５ページをちょうど示していて、そのページに対するＵＲＬを送信した後、ハンドラ１６が次に、ページ８６，８７等に関連するＵＲＬを送る。その雑誌の最後のページ（通常は裏表紙）に対するＵＲＬを送ると、ハンドラは、最初（通常、表表紙）から始めて、８４ページまでのＵＲＬをさらに送信する。他の最適化方法としては、主だった広告のＵＲＬを最初に格納する、例えば、２ページにまたがる広告のＵＲＬを最初に送ってから、各全面広告のＵＲＬを送り、その後、逐次、ページの一部を占める小広告各々のＵＲＬを送る。他のアプローチとして、ハンドラ１６が装置１２にＵＲＬを送って、契約により同意した優先順に格納するものがある。例えば、ある広告主が、割増金を払わない他の広告主よりも前にキャッシュされる代わりに割増広告料を払う。他のキャッシュ優先順や、それらの順序の組み合わせも当然、使用できる。
【０４４５】
システムの中には、リンクを張るためにシステムが提供するＵＲＬの数をもとに、広告主あるいは出版者が、そのシステムの使用料を払うものがある。ＵＲＬのキャッシュをローカルに（例えば、装置１２において）行う場合、実際にローカルキャッシュから取り出し、リンクを張るのに使用したＵＲＬを、装置１２がルータ１４（あるいは、ハンドラ１６）に通知するのが望ましい。そうすることで、遠隔システムが同じＵＲＬを記録できる。よって、対応ＵＲＬが既にキャッシュされているセンサ２２に対して、ユーザがオブジェクトを提示する度に、アプリケーション２８ｃがルータ１４にメッセージを送って、イベントを報告する（通常は、特定のＵＲＬが関与している）。その後、このイベントは、トランザクションログに記録される。
【０４４６】
このように先を見越してＵＲＬを送ることは、製品ハンドラが実行する１つの選択的な機能である。他には、アプリケーション２８ｃが製品ハンドラに問い合わせて、アプリケーションの、より最近のバージョンをダウンロードできるかどうかを判断する機能がある。それが可能であれば、アプリケーションは、ユーザとのやり取りを通して、製品ハンドラがソフトウエアのダウンロードに対応するよう要求する。
【０４４７】
より詳しくは、アプリケーション２８ｃが、アプリケーション２８ｃの最新バージョンについて定期的に（例えば、その日にアプリケーションが最初に使用されたとき）、製品ハンドラに問い合わせができるようにする。装置１２のバージョンが３．０４であり、遠隔システムは、バージョン３．０７が最新バージョンであるとして対応するような場合、アプリケーション２８ｃは、ユーザに対して、適当なテキスト、グラフィックス、あるいは他の手段で、より最新バージョンのプログラムが入手可能である旨の警告をし、そのような最新バージョンのものを入手したかどうかを問い合わせる。ユーザに対して、そのような指示があれば、ハンドラ１６は、装置１２に最新バージョンのプログラム（あるいは、現時点でインストールされているバージョンを更新できるパッチ）を提供する。
【０４４８】
アプリケーションのバージョンを更新する必要がないときもある。遠隔システムからのデータによって、アプリケーション２８ｃ内の一つ以上のパラメータだけを変更する妥当性あるいは必要性を示すようにしてもよい。例えば、ハンドラ１６が、新たなセキュリティキーを定期的に装置１２へ送り、そのキーを使用してアプリケーションのセキュリティ構成を変えるようにしてもよい。あるいは、アプリケーション２８ｃに指示を与え、次の時間、日まで、あるいは他の指示があるまで、別々のルータ１４に対して、さらに発信透かしトラヒックを送るようにしてもよい。このような指示を使用することによって、システムの性能を最適化でき、例えば、ルータの負荷のバランスをとるために、低速と判明したインターネットの経路を避けることができる。
【０４４９】
要約すれば、ハンドラの詳細は以下のようになる：
１．アクティブ識別子のリストに対する受信識別子（例えば、透かしのシリアル番号）の妥当性を判断し、シリアル番号が見つからない場合は、発信側セッションにエラーメッセージを返し、そのエラーをエラー取扱いルーチンに記録する；
２．受信した有効透かしシリアル番号各々に対して、データベースより、対応するアクティブ主アクションを見つける；
３．受信した有効透かしシリアル番号各々に対して、対応する主アクションが現在、アクティブでないことがハンドラによって検知された場合、ハンドラは、それに代えて、「デフォルト」のアクションを実行する；
４．ハンドラが、受信した有効透かしシリアル番号に関連するアクティブな主アクションを検知した場合、ハンドラは、リダイレクションにおけるアプリケーション用にＵＲＬを返すか（往復アプローチ）、あるいは、発信側セッションに検知したＨＴＭＬページを提供する；
５．ハンドラが、受信した有効透かしシリアル番号に関連するアクティブな主アクションを検知しないが、関連するデフォルトアクションを検知した場合には、ハンドラは、リダイレクションにおけるアプリケーション用にＵＲＬを返すか（往復アプローチ）、あるいは、発信側セッションに検知したＨＴＭＬページを提供する；
６．ハンドラが、透かしシリアル番号に関連する、有効でアクティブな主アクションあるいはデフォルトアクションを検知できなければ、ハンドラは、発信側セッションにエラーメッセージを返し、そのエラーをエラー取扱ルーチンに記録する；
７．課金と分析を目的として、結果的にエラーメッセージとなるものも含めて、各トランザクションを記録する（他の実施例では、ルータがこの機能を実行する）；
８．最新の入手可能なアプリケーションソフトウエアのバージョン番号を発信側セッションに返すことで、「ソフトウエアバージョン要求」に対応する；
９．発信側セッションに、最新の入手可能なアプリケーションソフトウエアのファイル転送を開始することで、「ソフトウエアダウンロード要求」に対応する；
１０．与えられた透かしシリアル番号に対する現在の登録パケットを返すことで、有効な登録パケットアップロード要求（適正なフォーマット、現存するシリアル番号、アカウントＩＤ、有効な対応アカウントパスワード）に対応する；
１１．失敗を示すエラーメッセージを発信側セッションに返すことで、無効な登録パケット要求に対応する；
１２．ローカルにキャッシュされたトランザクションをトランザクションログに書き込むことで、ローカルトランザクションキャッシュフラッシュ要求に対応する；
１３．最初に、提供されたシリアル番号に関連するＵＲＬを返すことで、複数のＵＲＬ要求に対応し、その後、提供された他のすべてのアクティブシリアル番号と出版、発行、地域コード（オプション）に対するＵＲＬによって対応する。
【０４５０】
図６は、製品ハンドラに関連する上述したプロセスの一部を示している。
【０４５１】
【ＵＲＬ性能モニタリング】
システムの動作に戻ると、データベースにおいて認識されたＵＲＬは、遠隔ウェブサイトでの機器上の問題、あるいは別の問題により、時々、動作不能になったり故障したりする。必要ならば、ハンドラ１６（あるいは、システムの他の構成要素）をプログラムして、データベース内にアクティブであると登録されたリンク各々を定期的に（１日１回）試験し、そして、関連するホームページのロード時間を測定する。そのホームページをロードできなかったり、通常よりもロード時間がかかる場合には（再試験により、状態に異常はないと確認されている）、これらの状態は、対応するデータベース記録の中で特記できる。そのようなＵＲＬを装置１２へ提供するようハンドラに要求があった場合、ハンドラは、ＵＲＬとともに、あるいはＵＲＬなしのメッセージを送り、そのＵＲＬが不正な振る舞いをしていることを装置に示す。
【０４５２】
ＵＲＬは動作しているが、（その過去の性能に比べて、あるいは他のＵＲＬに比べて）ロードが極端に遅い場合には、ハンドラ１６は、装置１２に対して一時的な迂回路を設定する。例えば、ハンドラが装置に対して第２のブラウザウインドウを立ち上げるよう指示し、そのブラウザを代替となる宛先に向けることで、意図したページのロードをユーザが待っている間、ユーザを楽しませることができる。最終的に意図したページがロードされたならば、最初のブラウザウインドウを表示する。その際、第２の、注意をそらすためのウインドウを閉じるか、あるいは、背後において第２のウインドウを生かしておきながら、最初のウインドウを前面に持ってくる。
【０４５３】
この代替となる宛先は、低帯域幅のページであることが望ましく、そうであれば、所望のＵＲＬをロードするのに、許容しがたい程、さらに遅くなることはない。この代替ページは、ハンドラによって選択され、所望のＵＲＬの後にＵＲＬが送られる。ハンドラよりＵＲＬを提供する代わりに、ハンドラが装置１２に対して直接、ＨＴＭＬあるいは他のページを提供できる。あるいは、代替ＵＲＬを装置１２に格納し、ハンドラ１６からのデータ受信があれば、代替ＵＲＬを使用して第２のブラウザウインドウ呼び出すことで、所望の内容が来るのが遅いことを示す。実施例によっては、ユーザがいくつかの代替ＵＲＬ（例えば、天気、株情報、ジョーク）を認識し、その中から、ハンドラあるいはアプリケーション２８ｃが任意に、あるいは他の方法で選び出すことができる。または、ハンドラ１６からの「待ち準備」表示に応じて、ＨＴＭＬページあるいは他のアプリケーションを装置１２においてローカルにロードすることもできる。
【０４５４】
データベース１７において、ＵＲＬが遅いあるいは動作不能と印されている場合、スキャン動作によって定期的にＵＲＬを再チェックして、データベース内でのそのステータスが変化したか（例えば、非アクティブからアクティブへ変化したか）どうかを見る。非アクティブのＵＲＬは、電子メールで登録者に報告され、所定期間内にアクション状態に戻らない場合には、手動のフォローアップに対してしるしをつける。
【０４５５】
【製品ハンドラによる具体的な応答】
上記のパート１は、例示したシステム１０によって可能となる様々なアプリケーションのサンプルを提供した。それらの詳細を以下に説明する。
【０４５６】
システム１０を使用して手作りの挨拶状を作る場合を考える。挨拶状を作る会社は、そのカードあるいは他の書簡と一緒に使用する透かし入りプレスオンステッカーを用意する。客は、そのステッカーを、（小売店、家庭、あるいは、その他の場所で）カメラが搭載されたコンピュータに見せる。コンピュータは、透かしを解読して、それを、ルータ１４を介して、対応する製品ハンドラ１６に送る。ハンドラは、その透かしを未登録の挨拶状のステッカーであると認識して、客に対して、その客の個人ホームページ等の宛先ＵＲＬを入力させる。この情報は、客によって入力され、登録データベース１７への入力のため遠隔システムへ転送される。その後、適当に動作可能なシステム（例えば、カード受取機）にステッカーを見せたときはいつでも、ブラウザウインドウが自動的に立ち上がり、買い物客が特定したホームページへと案内される。（言うまでもなく、ステッカーを使用しなくても、例えば、挨拶状そのものを符号化することで、同様の効果が得られる。）
【０４５７】
いくつかのアプリケーションでは、製品ハンドラが様々な応答のライブラリを持っており、それらは、ユーザのさらなる選択によって決まる、特別の状況下でユーザに提供できる。適当に透かしの入った大学のＩＤカードを持つ大学生を考える。このカードが装置１２に提示されると、製品ハンドラは、ＨＴＭＬ命令で応答し、その命令によって、装置のスクリーン上にオプションメニューが現れる。例えば、以下のものがある：
１．今度の大学行事の日程表を再検討せよ
２．今度のスポーツ行事の日程表を再検討せよ
３．現在の授業の時間割を再検討せよ
４．来学期のコースを選択せよ
５．成績を再検討せよ
学生が（例えば、マウスで、あるいは指定された方法でＩＤカードを動かして）選択をすると、アプリケーション２８ｃは、選択されたオプションに対応するデータを製品ハンドラに送り、それが要求データに応答する。
【０４５８】
場合によっては（例えば、現在の授業時間割の再検討、来学期のコース選択、成績の再検討において）、紛失したり盗難に遭ったＩＤを使ってアクセスしようとする者から、そのような情報を保護するための注意が必要である。従って、どのオプションが選択されても、ハンドラ１６は、最初にパスワードあるいはＰＩＮを照会して装置１２に応答する。正しいパスワード／ＰＩＮの入力後においてのみ、要求されたアクションが実行される。（安全上の理由から、大学は、製品ハンドラ１６によるよりも、専用の学内サーバによってパスワードの認証処理が行われることの方を選ぶ。当然のことながら、状況に最も合致したものとして、ハンドラ１６以外のプロセッサに、このタスクと他のタスクを任せることができる。）
【０４５９】
別の場合では、オプションメニューの提示が不要となり、状況あるいは周囲から正しい応答が推測される。持ち主の識別番号で透かしが入れられた運転免許証を考える。空港にある電子メールキオクス１２に提示されると、解読した透かしを使用して、その個人対応の電子メールアカウントを探し、新たなメールをダウンロードする。それと同じ運転免許証がチェックインキオスクに提示された場合は、解読した透かしを使用して、その個人の便予約を調べ、座席割当てを発行する。いずれの場合も、キオスクは基本的に同じである。しかし、ある場合は、ルータ／製品ハンドラに対して電子メールキオクスであると称し、他の場合は、チェックインキオスクと称する。それに応じて、ルータ／製品ハンドラによる応答は変化する。
【０４６０】
大学の例に戻ると、学生がそそのかされて学生ＩＤの写真を入れ替え、例えば、替え玉が、無資格の学生に代わって大学院の資格認定試験を受けるような場合がありうる。通常の場合、このような写真の入れ替えは、検知が難しい。この問題には、各学生に対して装置１２にＩＤを提示させる手順を含む、試験チェックイン手順によって対抗できる。このタスクに特化したアプリケーション２８ｃは、ＩＤの写真より解読した透かしをハンドラ１６に転送し、これに応答して、認識された学生の映像が装置１２に表示される。（大学は、ＩＤカード発行の際に、学生の映像についての必要なデータベースを作り上げることができる。）試験監督が、ＩＤカード上の映像と一致しない映像が装置上にあることが分かれば、適切な行動をとることができる。（この構成は、空港のチェックイン、税関、入国管理等を含む、写真ＩＤ文書を使用するところであればどこでも適用できる。）
【０４６１】
図示したシステムの他のアプリケーションとして、しるしを付けたオブジェクトに関連するメタデータを見つける、あるいは、それに作用するものがある。ユーザがインターネットからダウンロードする画像、ビデオ、あるいはオーディオファイルを考える。マイクロソフト社のウインドウズエクスプローラ（インターネットエクスプローラを含む）のような、よく知られたアプリケーションは、透かしデコーダによって構成されており、そのデコーダは、（例えば、ファイルのアイコンあるいはファイル名を右クリックし、「プロパティ」を選択してアクセスされる）、例えば、プロパティパネルから起動できる。ファイル内の透かしが検知されると、エクスプローラアプリケーションは、遠隔システム（例えば、上述したルータ／製品ハンドラ／データベース）へ対応パケットを送信できる。遠隔システムは、そのパケットがウインドウズエクスプローラのプロパティパネルを介して発生したものと認識し、データベース１７内の透かしＩＤを検索する。ファイルに対応するメタデータ（例えば、所有者、作成日、許可期間、露出データ、対象等）は、データベース１７（あるいは、ルータ、ハンドラ、あるいはデータベースによって認識された他のデータベース）よりアプリケーション２８ｃへ戻され、プロパティパネル内の（適当な「タブ」の下に選択的に）表示される。
【０４６２】
（譲受人は、情報センターの役割を果たす「マークセンタ」サービスを長い間、提供し、それによって、写真等の中から見つかった透かし識別子を使用して、所有者や、オブジェクトに対応する関連情報を識別する。）このサービスを使用している本実施例では、ルータ１４がマークセンタサービス（この例では、製品ハンドラ）に要求を渡し、それが発信側アプリケーションへ応答型の情報を返す。譲受人のマークスパイダサービスは、メディアコマース製品によって提供されるサービスを補足する。マークスパイダサービスは、常時、インターネットサイトを検索し、遭遇する各グラフィックの検討を行って、それが透かしを含んでいるかどうかを判断する。（オーディオおよびビデオも同様に解析できる。）マークスパイダサービスは、検知した各透かしを使って、グラフィックファイル名、大きさ、フォーマット、日／時間、およびグラフィックが見つかったＵＲＬを記録する。その後、この情報は、報告形式でマークスパイダの顧客が利用できるようになる。
【０４６３】
単にメタデータを表示するのではなく、アプリケーションおよび／または遠隔システムは、それを利用することもできる。例えば、透かし入り画像の所有者がコービスであり、その画像が特定の期間における特定の使用に対して許可できることを、メタデータが示している場合、遠隔システムはライセンスサーバとして使用できる。すなわち、ユーザから支払い情報を受け、ライセンスを供与し、トランザクションの詳細をコービスに転送するのに使用できる。
【０４６４】
他のアプリケーションとして、インターネット上における音楽あるいはビデオの販売あるいは宣伝がある。音楽に例をとると、アーティストは、忠実度の低い（あるいは改竄ないし簡略化された）バージョンの音楽を無料で配信できる。忠実度が低くなるのは、帯域幅の制限（例えば、５００Ｈｚ〜２．５ｋＨｚ）や（ステレオに対する）モノラルであること、あるいは他の理由があることによる。アーティストは、低忠実度版をできるだけ広帯域で配信し、そのアーティストの他の作品のマーケティングエージェントの役割を果たそうとする。（学生がインターネットを介して無料音楽を積極的に転送しているような大学が直面するネットワーク帯域の問題のいくつかが、狭帯域オーディオの無料配信のおかげで緩和される。）
【０４６５】
低忠実度版各々を処理して、識別子（例えば、ステガノグラフィを使用したインバンド透かし、数字によるＩＤあるいはファイルヘッダ内の音楽／アーティスト名フィールド、音楽データにハッシュアルゴリズムを適用して得た１２８ビットのハッシュ値、音楽ファイルのヘッダデータ、その部分等）を抽出できる。聴取者が、作品の完全忠実版を手にしたいとすると、その聴取者は、適度にプログラムされたコンピュータあるいは音楽機器を操作する。それらは、その作品から識別子を抽出して、それを遠隔システムに渡す。遠隔システムは、様々な方法で応答できる。例えば、（例えば、ＭＰ３ダウンロードのように）同じ作品の完全忠実版をユーザに提供して、そのユーザのクレジットカードに料金（例えば、０．９９ドル）を請求したり、ユーザのコンピュータのウェブブラウザを、その音楽に関連する電子商取引／ファンのウェブサイトに仕向ける等がある。このような機能は、マイクロソフト社のインターネットエクスプローラのような汎用プログラムにおいて提供でき、例えば、ファイル上で右クリックして、この機能および関連機能を含むメニューを得る。
【０４６６】
図８〜図１０は、このような実施例における一連の画面ショットを示している。図８において、ユーザが、ディレクトリリスト２００内のＭＰ３ファイルアイコンを右クリックしたことで、第２のオプションである「ＭＰ３ブリッジ」を含むプロパティメニュー２０２が現れる。
【０４６７】
図９は、ユーザがＭＰ３ブリッジオプションを選択するとどうなるかを示している。ＭＰ３プレーヤ２０４が立ち上がり、ダイアログボックス２０６が現れる。ダイアログボックスは、ユーザに「アーティストについてもっと知りたいですか？はい いいえ」と問い合わせる。
【０４６８】
図１０は、ユーザが「はい」と答えたときにどうなるかを示している。ソフトウエアは、ＭＰ３ファイルから抽出された識別子を遠隔システムへ送る。遠隔システムは、関連するホームページのアドレスで応答し、ユーザのコンピュータに対して、そのページへと導く新たなブラウザウインドウを立ち上げるよう指示する。
【０４６９】
言うまでもなく、ＭＰ３プレーヤ、（あるいは、インターネットエクスプローラを介するよりも、ウインドウズメディアプレーヤ等）のユーザインタフェースを介して、同様の機能を立ち上げることができる。音楽アプリケーションは、ウインドウを分割したり、あるいは、既存のウインドウ内にオプションと関連データを提示する。
【０４７０】
遠隔システムについての他のアプリケーションとして、「ネットナニィ」フィルタがある。システムを介して要求されるリンクのチェックが、キーワード、成人向けを示す特記、内容の評価、あるいは、他の年齢相応性のしるしに関して行われ、先に選択した特定の基準に合致したときのみ、要求したコンピュータ１０へリンクが張られる。
【０４７１】
上記の例は、詳細なシステムで可能となる無数のアプリケーションの内のわずかな例である、ということを理解されたい。
【０４７２】
【報告】
システムソフトウエアにより、顧客がアクセス可能な（インターネットを介してアクセス可能な）報告が提供され、その報告は、日付、顧客、出版、発行日、地域、製品／版数等によって、詳細かつ概略的な使用情報を示している。これらは、定期的な報告とすることも、また、臨時の報告とすることもできる。報告の内容、関係、タイミングの指定については、顧客がオンラインで規定できる。
【０４７３】
報告の詳細を例示すると、以下のようになる：
（ａ）顧客ごと広告ごとのヒット率／トランザクション
（ｂ）顧客ごと出版ごと広告ごとのヒット率／トランザクション
（ｃ）顧客ごと出版ごと号数ごと広告ごとのヒット率／トランザクション
（ｄ）顧客ごと出版ごと号数ごと地域ごと広告ごとのヒット率／トランザクション
（ｅ）発信側アプリケーション（２８ｃ）別のヒット率／トランザクション率
（ｆ）発信側アプリケーションベンダー別のヒット率／トランザクション
（ｇ）発信側ウェブドメイン（例えば、ａｏｌ.ｃｏｍ）別のヒット率／トランザクション率
（ｈ）郵便番号別のヒット率／トランザクション率
（ｉ）国別のヒット率／トランザクション。
【０４７４】
サービスプロバイダによる内部分析、および他のエンティティへの販売に対して、さらにマーケッティング／市場報告を作成できる。これらの報告は、通常、システムの効果と利用についての、より国際的な視野を提供する。利用パターンと併せて、人口統計データベースに格納された情報を使用することで、システムは顧客と調査機関に対して、システムの利用と有効性に関する、より詳細な人口統計／統計データを提供できる。
【０４７５】
例示するシステムでは、ある種のサービス（例えば、無料カメラ、バーコード読取りペン、あるいは他の道具等）を考慮に入れて、ある程度詳細に行動を追跡記録されることに同意したユーザのサンプルからとった統計量を使って、人口統計データベースの統計量を作成している。これらのユーザは、人口統計世帯と呼ばれている。このシステムに含まれるソフトウエアプログラムは、ウェブ動作するインタフェースにより、これらのユーザから、インターネットを介して、以下のテーブルに詳細に示す情報を集める。これらのユーザは、関連するプログラムによって、前もって入力したユーザ／世帯情報を更新／編集できる。各セッションは、安全のためパスワードによる認証が行われる。
【表３】

【０４７６】
【オーディオおよびビデオ】
新聞広告と同様、例示したシステムは、ウェブに接続されたＰＣあるいは他の機器のユーザに、情報、コンテンツ、関連製品、あるいは、上述したのと同じ原則に立つ関連サービスの入手方法を提供する。
【０４７７】
例えば、アプリケーション２８は、記録装置（ノートレコーダ、ＰＣに接続されたマイクロフォン、ＭＰ３プレーヤ等）を使用して、音楽あるいは他のオーディオを「取り込み」、このように取り込んだオーディオを分析して、埋め込まれた透かしを検知することができる。一旦、検知されると、アプリケーションは、透かしペイロード情報の一部あるいは全部を、アプリケーションの識別番号とそのベンダーとともにルータに渡す。ルータは、そのペイロード情報を、アプリケーションに対応するハンドラへ転送する。製品ハンドラの応答は、データのコンテキストと性質によって変化する。例えば、ハンドラは、ユーザにアーティスト、題名、トラック、アルバム、ウェブのＵＲＬ、および購入情報を返す。記録されたニュースと娯楽のセグメントには、他の関連ウェブサイトの情報とともに、そのセグメントの記録（オーディオ、ビデオ、および／またはテキスト）が含まれる。ハンドラは、音楽を購入できる音楽取引ウェブサイトに向けられたブラウザウインドウが、装置１２によって立ち上げられるようにするだけである。
【０４７８】
【セキュリティ】
システムの基本的な安全思想は、顧客によって認定されたユーザにだけ、各顧客情報へのアクセスを認めることである。そのため、本システムは、好ましくは、以下のようになっている：
１．公認ユーザ（アカウント）のリストを作成し管理する
２．非公認ユーザへのアクセスを拒絶するための安全策を採用する
３．ユーザがアクセスを認められたオブジェクトにのみアクセスするよう制限する（一般的には、そのオブジェクトは顧客に属する）
４．非公認アクセスが試みられたものすべてを報告し記録する
５．公認ユーザのログイン（セッション）すべての記録を保守する
６．透かし登録者に（広告代理店やプリプレスハウスのような）他のアカウントへのアクセス権を認める権能を与える
７．各アカウントにイニシャルパスワードを設定する
８．各公認ユーザ／アカウントにパスワードを変更する権能を与える
９．現在のパスワードを紛失したときに認証済みのユーザ／アカウントのパスワードをリセットする権能を与える
１０．すべてのパスワードを、暗号化された値のまま格納して、（パスワードの盗難を防止する）
１１．公認ユーザにアカウント情報の生成、変更、抹消、リスト化／閲覧を制限する権能を与える。
【０４７９】
【監査証跡】
システム動作の財政的な意味あいから、登録あるいは顧客データに対する変更はすべて記録しておく必要がある。この監査証跡によって、オペレータおよびその顧客に、データの現在および前のステータスに対する正確なアカウントが提供される。
【０４８０】
監査用プログラムは、登録および顧客データすべての生成、変更、および抹消を記録するのが望ましい。監査用プログラムはまた、ユーザ名、記録の生成／変更／抹消の日／時間、および、変更に対しては、データが変更された前後の画像を記録する。
【０４８１】
【アプリケーションと製品ハンドラのインタフェース規定】
アプリケーション２８ｃとハンドラ１６間のインタフェースの基本原理は、（ａ）適応性のある要求および応答パッケージ構造と、（ｂ）業界基準に基づく明確な接続方法である。この例示したメッセージングでは、ｈｔｔｐおよび／またはｈｔｔｐｓプロトコルを採用して、システムの構成要素間でメッセージの送受信を行う。図４に、その概略を示す。
【０４８２】
メッセージフォーマット：
メッセージフォーマットは、ＸＭＬ準拠であり、以下のＸＭＬＤＴＤにより規定される：
＜！ＤＯＣＴＹＰＥ ｌｉｓｔ ［
＜！ＥＬＥＭＥＮＴ Ｃｏｎｔｅｎｔ （ｖｅｎｄｏｒ， ａｐｐｌ， ｐｒｏｄ）＞
＜！ＥＬＥＭＥＮＴ ｖｅｎｄｏｒ （＃ＰＣＤＡＴＡ）＞
＜！ＥＬＥＭＥＮＴ ａｐｐｌ （＃ＰＣＤＡＴＡ）＞
＜！ＥＬＥＭＥＮＴ ｐｒｏｄ （＃ＦＣＤＡＴＡ）＞
］＞
【０４８３】
アプリケーション２８ｃは、製品ハンドラ１６への送信のため、このヘッダにデータを付加する。メッセージと製品ハンドラの応答の典型例については、以下のセクションにおいて詳述する。
【０４８４】
アプリケーションメッセージの規定：
アプリケーションメッセージの規定は、要求コード、一次情報および二次情報に分けることができる。
【０４８５】
「要求コード」は、製品ハンドラ１６が特定のアクションを行うよう指示する。
【０４８６】
「一次情報」部は、アプリケーションの要求に対して適切にサービスを提供することが必要とされるデータを含んでいる。一次情報は、要求コードに基づいて変化する。
【０４８７】
「二次情報」は、分析および報告ツールでの使用を対象としており、ユーザの要求に対してサービスを提供する際に製品ハンドラに指示を与えたり、支援することはない。二次情報の内容は、要求コードに基づいて変化するが、すべての要求コードが、関連する二次情報を持つことは要求されない。さらには、二次情報のほとんどが、その収集に顧客が明白な承諾を与えることを要求する。承諾が得られない場合は、アプリケーションは二次情報を送信しない。選択されたものに対しては特別な場合が存在し、需要者が人口統計データベースの一部となることを承諾する。
【０４８８】
一次および二次情報は、要求の形式によって変わるが、一般的には、以下の規定に従う。製品ハンドラに対する一般のフォーマットも、以下に規定されている。
【０４８９】
「一次情報」は、アプリケーションのバージョン、透かしのタイプ、透かしのシリアル番号、コンテキストおよび環境を含む：
●アプリケーションのバージョン：製品ハンドラによって、そのアクショ
ンの変更に使用され、通常、下位互換性に対して使用される
●透かしのタイプ：例示した透かしペイロードの上位９ビットであり、透
かしのシリアル番号を処理する際に製品ハンドラによって使用される
●透かしのシリアル番号：透かしペイロードの残り部分である。製品ハン
ドラにより使用されるインデックスを提供して、登録データベース内の
透かしにアクセスする
●コンテキスト：製品ハンドラに指示を与えて、顧客要求のコンテキスト
に基づいてアクションを変更／改良する
●環境：製品ハンドラに指示を与えて、顧客要求の環境に基づいてアクシ
ョンを変更／改良する（環境は、例えば、家庭、オフィス、車、ポータ
ブル機器等として指定される）。
【０４９０】
言うまでもなく、他の要求コードも使用できる。各々が、必須およびオプション一次情報フィールドについて、それ自身のリストを有している。オプションのフィールドは、関連する値がないときには、一次情報から除外される。
【０４９１】
二次情報：人口統計世帯ＩＤ：選ばれた人口統計グループの識別子である。これは、実際の人口統計のインデックスとして使用される
●入力機器：透かしを検知するのに使用する、その機器の製造メーカ、型
、およびバージョンである（例えば、ＴＷＡＩＮドライバストリング）
●オペレーティングシステム：需要者のＰＣで使用されているオペレーテ
ィングシステムである
●プロセッサ：需要者のＰＣのプロセッサタイプ／クラスである
●プロセッサの速度：需要者ＰＣのプロセッサのＭＨｚで示すクロック速
度である（ユーザによって入力されるか、自動的に検出される）
●言語：需要者が話す言語のことである
●国：需要者のＰＣが存在している国である
●郵便番号：（国とともに使用して、需要者の居場所を正確に特定する）
需要者の郵便番号である
（これらの明示的なデータに加えて、装置１２から送られるパケットは、（ｈｔｔｐプロトコルの使用に固有の）ＩＰアドレスをも伝達するので、遠隔装置（例えば、ルータ／ハンドラ）は、それに応答できるアドレスを持っている。
【０４９２】
製品ハンドラからの応答：

【０４９３】
ＵＲＬ要求：
要求入力：
ヘッダ（ＸＭＬフォーマット）
Ｖｅｎｄｏｒ （例えば、デジマーク）
Ａｐｐｌ （例えば、ＭＢ）
データ
要求情報−
Ｒｅｑ ＝ＲＦＵ
Ｖｅｒ ＝アプリケーションバージョン番号
Ｔｙｐｅ ＝透かしタイプ番号
Ｓｅｒ ＝透かしシリアル番号
Ｃｘｔ ＝コンテキスト
Ｅｎｖ ＝環境
オプション情報−
Ｃｔｒｙ ＝ユーザの国名
Ｌａｎｇ ＝ユーザの好みの言語
ＨＨＩＤ ＝人口統計世帯の識別子
Ｄｅｔ ＝検出／検知器のＴＷＡＩＮストリング
ＯＳ ＝ユーザＰＣのオペレーティングシステムス
トリング
Ｐｒｏｃ ＝ユーザＰＣのプロセッサタイプおよびクラス
Ｓｐｅｅｄ ＝ユーザのプロセッサ速度
Ｚｉｐ ＝ユーザの郵便番号
例：
＜？ｘｍｌ ｖｅｒｓｉｏｎ＝”１．０”？＞
＜Ｃｏｎｔｅｎｔ＞
＜ｖｅｎｄｏｒ＞Ｄｉｇｉｍａｒｃ＜／ｖｅｎｄｏｒ＞
＜ａｐｐｌ＞ＭＢ＜／ａｐｐＩ＞
＜／Ｃｏｎｔｅｎｔ＞
Ｒｅｑ＝ＲＦＵ
Ｔｙｐｅ＝１
Ｓｅｒ＝１０００１
Ｖｅｒ＝１．０
Ｃｘｔ＝Ａ
Ｅｎｖ＝Ｑ
Ｃｔｒｙ＝ＵＳＡ
Ｌａｎｇ＝Ｅｎｇｌｉｓｈ
ＨＨＩＤ＝１２３４５６７
Ｄｅｔ＝ＴＷＡＩＮ ｓｔｒｉｎｇ
ＯＳ＝Ｗｉｎ９８
Ｐｒｏｃ＝Ｐｅｎｔｉｕｍ ＩＩＩ
Ｓｐｅｅｄ＝５００
ｚｉｐ＝７４００８−１２３４
【０４９４】
製品ハンドラからの応答
ＲｔｎＣｏｄｅ＝成功／エラー番号（成功 ＝ １）
ＵＲＬ＝特定の透かしタイプとシリアル番号に関係するＵＲＬ
Ｅｘｐ＝キャッシュ目的の失効日／時間（ＧＭＴ）− ｍｍ／ｄｄ／ｙｙｙｙ ｈｈ：ｍｍ：ｓｓのフォーマットを持つ
もしくは
ＲｔｎＣｏｄｅ＝成功／エラー番号（エラー ＜０）
ＭｓｇＴｅｘｔ＝メッセージテキスト
【０４９５】
エラーの理由：
−１ タイプとシリアル番号はＯＫであるが、データベースにＵＲＬがない（一次およびデフォルトＵＲＬの両方が見当たらない）
−２ タイプとシリアル番号はＯＫであるが、ＵＲＬが非アクティブと印されている（一次およびデフォルトのいずれもアクティブでない）
−３ タイプとシリアル番号に合致する記録がデータベースにない
−４ 要求フォーマットエラー：不完全データ。
【０４９６】
コンフィギュレーション要求：
要求入力：
ヘッダ（ＸＭＬフォーマット）
Ｖｅｎｄｏｒ （例えば、デジマーク）
Ａｐｐｌ （例えば、ＭＢ）
データ
要求情報
Ｒｅｑ ＝ＲＦＣ
ＯＳ ＝ユーザＰＣのオペレーティングシス
テム
例：
＜？ｘｍｌ ｖｅｒｓｉｏｎ＝”１．０”？＞
＜Ｃｏｎｔｅｎｔ＞
＜ｖｅｎｄｏｒ＞Ｄｉｇｉｍａｒｃ＜／ｖｅｎｄｏｒ＞
＜ａｐｐｌ＞ＭＢ＜／ａｐｐＩ＞
＜／Ｃｏｎｔｅｎｔ＞
Ｒｅｑ＝ＲＦＣ
ＯＳ＝Ｗｉｎ９８
【０４９７】
製品ハンドラからの応答
ＲｔｎＣｏｄｅ＝成功／エラー番号（成功 ＝ １）
Ｖｅｒ＝ダウンロードに使用できる最新アプリケーションバージョン
ｈｔｔｐｓ＝はい（もしくは いいえ）
ＧＣＵＲＬ＝次のアプリケーション要求のルーティングに使用するＵＲＬ
もしくは
ＲｔｎＣｏｄｅ＝成功／エラー番号（エラー ＜０）
ＭｓｇＴｅｘｔ＝メッセージテキスト
【０４９８】
エラーの理由：
−５ 不明オペレーティングシステム
−４ 要求フォーマットエラー：不完全データ。
【０４９９】
関連ＵＲＬ要求：
要求入力：
ヘッダ（ＸＭＬフォーマット）
Ｖｅｎｄｏｒ ＝デジマーク
Ａｐｐｌ ＝ＭＢ
データ
要求情報−
Ｒｅｑ ＝ＲＦＡ
Ｖｅｒ ＝アプリケーションバージョン番号
Ｔｙｐｅ ＝透かしタイプ番号
Ｓｅｒ ＝透かしシリアル番号
Ｃｘｔ ＝コンテキスト
Ｅｎｖ ＝環境
例：
＜？ｘｍｌ ｖｅｒｓｉｏｎ＝”１．０”？＞
＜Ｃｏｎｔｅｎｔ＞
＜ｖｅｎｄｏｒ＞Ｄｉｇｉｍａｒｃ＜／ｖｅｎｄｏｒ＞
＜ａｐｐｌ＞ＭＢ＜／ａｐｐＩ＞
＜／Ｃｏｎｔｅｎｔ＞
Ｒｅｑ＝ＲＦＡ
Ｔｙｐｅ＝１
Ｓｅｒ＝１０００１
Ｖｅｒ＝１．０
【０５００】
製品ハンドラからの応答
ＲｔｎＣｏｄｅ＝成功／エラー番号（成功 ＝ １）
Ｓｅｒｌ＝透かしシリアル番号
Ｔｙｐｅｌ＝透かしタイプ番号
ＵＲＬ１＝特定の透かしタイプとシリアル番号に関係するＵＲＬ
Ｅｘｐ１＝失効日／時間（ＧＭＴ）
Ｓｅｒ２＝透かしシリアル番号
Ｔｙｐｅ２＝透かしタイプ番号
ＵＲＬ２＝特定の透かしタイプとシリアル番号に関係するＵＲＬ
Ｅｘｐ２＝失効日／時間（ＧＭＴ）
……
Ｓｅｒ’ｎ’＝透かしシリアル番号
Ｔｙｐｅ’ｎ’＝透かしタイプ番号
ＵＲＬ’ｎ’＝特定の透かしタイプとシリアル番号に関係するＵＲＬ
Ｅｘｐ’ｎ’＝失効日／時間（ＧＭＴ）
もしくは
ＲｔｎＣｏｄｅ＝成功／エラー番号（エラー ＜０）
ＭｓｇＴｅｘｔ＝メッセージテキスト
【０５０１】
エラーの理由
−８ タイプとシリアル番号はＯＫであるが、関連する透かしあるいはＵＲＬがデータベースにない
−９ タイプとシリアル番号はＯＫであるが、すべてのＵＲＬが非アクティブと印されている
−３ タイプとシリアル番号に合致する記録がデータベースにない
−４ 要求フォーマットエラー：不完全データ。
【０５０２】
トランザクションダウンロード要求
（ローカルにキャッシュされたリダイレクションのアカウントに必要。ローカルリダイレクションごとに１つの要求）。
要求入力：
ヘッダ（ＸＭＬフォーマット）
Ｖｅｎｄｏｒ ＝デジマーク
Ａｐｐｌ ＝ＭＢ
データ
要求情報
Ｒｅｑ ＝ＲＦＴ
Ｖｅｒ ＝アプリケーションバージョン番号
Ｔｙｐｅ ＝透かしタイプ番号
Ｓｅｒ ＝透かしシリアル番号
Ｃｘｔ ＝コンテキスト
Ｅｎｖ ＝環境
オプション情報
Ｃｔｒｙ ＝ユーザの国名
Ｌａｎｇ ＝ユーザの好みの言語
ＨＨＩＤ ＝人口統計世帯の識別子
Ｄｅｔ ＝検出器のＴＷＡＩＮストリング
ＯＳ ＝ユーザＰＣのオペレーティングシステムス
トリング
Ｐｒｏｃ ＝ユーザＰＣのプロセッサタイプおよびクラス
Ｓｐｅｅｄ ＝ユーザのプロセッサ速度
Ｚｉｐ ＝ユーザの郵便番号
例：
＜？ｘｍｌ ｖｅｒｓｉｏｎ＝”１．０”？＞
＜Ｃｏｎｔｅｎｔ＞
＜ｖｅｎｄｏｒ＞Ｄｉｇｉｍａｒｃ＜／ｖｅｎｄｏｒ＞
＜ａｐｐｌ＞ＭＢ＜／ａｐｐＩ＞
＜／Ｃｏｎｔｅｎｔ＞
Ｒｅｑ＝ＲＦＴ
Ｔｙｐｅ＝１
Ｓｅｒ＝１０００１
Ｖｅｒ＝１．０
Ｃｘｔ＝Ａ
Ｅｎｖ＝Ｑ
Ｃｔｒｙ＝ＵＳＡ
Ｌａｎｇ＝Ｅｎｇｌｉｓｈ
ＨＨＩＤ＝１２３４５６７
Ｄｅｔ＝ＴＷＡＩＮ ｓｔｒｉｎｇ
ＯＳ＝Ｗｉｎ９８
Ｐｒｏｃ＝Ｐｅｎｔｉｕｍ ＩＩＩ
Ｓｐｅｅｄ＝５００
ｚｉｐ＝７４００８−１２３４
【０５０３】
製品ハンドラからの応答
ＲｔｎＣｏｄｅ＝成功／エラー番号（成功 ＝ １）
もしくは
ＲｔｎＣｏｄｅ＝成功／エラー番号（エラー ＜０）
【０５０４】
ＭｓｇＴｅｘｔ＝メッセージテキスト
エラーの理由：
−４ 要求フォーマットエラー：不完全データ
【０５０５】
最速のシステム応答を提供するには、発信側の装置１２と遠隔システム間で交換されるデータは、できるだけ短いことが望ましい。好ましくは、単一のインターネットデータパケットで伝送できる大きさ（例えば、約５３６ビット以下）である。このような構成とすることで、送信側でのデータ分配、および受信側での再組み立てに関係するオーバーヘッドを回避できる。
【０５０６】
一般的に言えば、単一の要求に対するシステムサービスの総合経過時間（例えば、アプリケーション２８ｃによる透かし認識、ルータへのパケット配信、ルータによる解読、製品ハンドラによる取扱い、およびアプリケーションへの応答返却）は、要求に対して送信された、第１バイトの要求の受信から計測すると、平均して３秒たらずである。代表的な速度は、１秒以下の多数の要求があったとしても、２秒以下である。
【０５０７】
以下の議論は、上記の議論を十分検討しているが、異なる優先度の場合であり、詳細事項が補足されている。
【０５０８】
メディアブリッジデジタルメッセージは、２つのコードからなり、両方ともメディアブリッジ強調された画像に埋め込まれている。メディア所有者コードは、システム管理者（例えば、デジマーク）により割り当てられ、画像へのメディアブリッジ強調の付加が許諾されたエンティティを識別するものである。ルーティングコードは、メディア所有者（広告主、出版社、製造メーカ等）により割り当てられ、クライアントアプリケーションがメディアブリッジコードを読むときにエンドユーザをどこに向かわせるかを判断する。同一コードが埋め込まれた２つの異なる広告は、エンドユーザを同じホームページへと案内することができるが、他方において、異なるコードを使用している別の出版物における同一の広告は、別のホームページに行くことができ、それを使って、どの広告あるいは雑誌が、エンドユーザをメディア所有者のウェブサイトへ至らせるのに最も効果的であるかを追跡することができる。
【０５０９】
メディアブリッジシステムには、主な構成要素が３つある。クライアントアプリケーションは、需要者（メディアブリッジエンドユーザ）によって家庭および業務で使用され、通常はインターネット上において、画像あるいはオブジェクトから付加情報へと自動的にナビゲートが行われる。メディアブリッジルータは、所定の画像あるいはオブジェクトに対する適切なインターネットアドレスをクライアントアプリケーションに提供する。埋め込みシステムは、メディア所有者により、印刷前にメディアブリッジコードを画像に埋め込むのに使用される。
【０５１０】
【メディアブリッジ・クライアント・アプリケーション】
クライアントアプリケーションは、ロジステック、スリーコム、クリエーティブラボのような、つながりデジタルカメラ製造メーカとのＯＥＭ関係を通して流通させることができる。アプリケーションは、カメラメーカのインストールＣＤからのカメラドライバおよび支援ソフトウエアと一緒にエンドユーザがインストールする。
【０５１１】
メディアブリッジ・クライアント・アプリケーションは、ウインドウズ９５／９８／ＮＴ４．０およびマッキントッシュＯＳ８．６オペレーティングシステム下において、つながりビデオカメラとともに組み込まれた、２００ＭＨｚあるいはそれより高速のペンティアムあるいはパワーＰＣコンピュータ上で動作する。
【０５１２】
メディアブリッジクライアントアプリケーションは、最初に、メディアブリッジ強調された画像を使用することに専念して、インターネットウェブサイト上の付加情報に直接、ブラウジングするようにしている。よって、アプリケーションは、ダイヤルアップモデムあるいは永久接続を介したインターネット接続を要求する。しかし、クライアントアプリケーションは、例えば、ＣＤ上のローカルデータのブラウジング、および他のアプリケーションへのリンクをサポートする拡張可能アーキテクチャを有することが望ましい。
【０５１３】
メディアブリッジシステムは、ほとんどの場所で使用でき、ビデオカメラは、鮮明で焦点の合った高品質の画像を見せることができる。システムは、薄暗い状態（約４０ルクス）から明るい状態（３９００ルクス）の範囲で変化する照明状態で動作する。また、システムは、非常に暗い所では補助光源を用いて動作し、まばゆいばかりに明るいところでは、像あるいはオブジェクトが光源から遮蔽されていれば動作する。
【０５１４】
【エンドユーザ・クライアント・アプリケーションの動作】
クライアントアプリケーションが最初に動作するときには、ユーザにウイザードを示すことが望ましく、そのウイザードは、ビデオカメラを介して、クライアントアプリケーションにメディアブリッジ動作可能な画像を提供する最良の技術を教えるものである。ウイザードは、各カメラに合わせられており、サンプル画像あるいは実際に撮った画像のいずれかを使用できる。
【０５１５】
インストールディスク（例えば、ＣＤ）の形で出荷したものは、ユーザにクライアントアプリケーションの最良の使用方法を教える、一つ以上のゲームになりうる。例えば、カメラの焦点を合わせたり、符号化されたオブジェクトの位置合わせをカメラの焦点域において行ったり、ちょっとの間、オブジェクトを動かないように、あるいは解読に必要なために保持したりする方法や、許容される照明条件等がある。カメラボックス、あるいはボックス内に挿入される物はメディアブリッジ符号化ができ、カメラのベンダーあるいはシステムの管理者がホストとなっている対応紹介ページへ、ブラウザを介してリンクできる。ランダムに、あるいはメディアブリッジ操作のある局面における熟達度を見せることで、ウェブサイトを通して、Ｔシャツや他の景品を与えるようにしてもよい。
【０５１６】
例示した構成では、メディアブリッジアプリケーションが常に動作しており、アクティブあるいは非アクティブのいずれかの状態にある。アクティブのときは、メディアブリッジビデオカメラのウインドウがいつも、他のどのウインドウよりも前面にあって完全に見え、クライアントアプリケーションが常時、メディアブリッジ強調された画像のビデオをチェックしている。メディアブリッジ強調された画像が見つかれば、適切な情報が表示され（ほとんどの場合、ホームページとして）、クライアントアプリケーションが選択的に非アクティブになる。クライアントアプリケーションが非アクティブのときは、ビデオウインドウを隠し、他のアプリケーションが利用できるようにカメラを解除して、ほとんどメモリやコンピュータリソースを使わないようにする。
【０５１７】
ある実施例では、クライアントがカメラをシリアルに再利用できる機器として扱っている。すなわち、クライアントアプリケーションがアクティブであり、ビデオをチェックしているときは、他のどのアプリケーションもビデオカメラにアクセスできない。同様に、他のアプリケーションがカメラを使用しているときには、クライアントアプリケーションは、ビデオにアクセスできない。
【０５１８】
メディアブリッジ・クライアント・アプリケーションは、以下の機能を含んでいる：
【０５１９】
（１）ブラウザ／アプリケーションの立ち上げ
メディアブリッジ強調された画像が見つかったとき、クライアントは、ユーザのウェブブラウザあるいは他のアプリケーションを立ち上げる。インターネットのウェブサイトをブラウジングしているとき、クライアントは、可能ならば、そのサイトに画像の同一性とエンドユーザの郵便番号を与える。この情報によってメディア所有者のウェブサイトは、ユーザに特定の地域で使用できるように変更されたホームページを表示できる。他のアプリケーションを立ち上げるとき、クライアントは、アプリケーションに画像所有者コードとルーティングコードを与える。
（２）宛先メニュー
ルーティングコードに対して多数のＵＲＬが指定されていれば、クライアントアプリケーションは、ブラウザに基づくメニューを表示する。その表示によって、エンドユーザは、ホームページへ直接ナビゲートされるのではなく、どのページを表示するかを選択できる。
（３）ブランド設定
ホームページを表示するための情報を検索している間、クライアントアプリケーションは、あらかじめ格納されたブランド（例えば、デジマーク）とともにローカルホームページを表示し、所望の情報が検索されていることを説明する。このブランド設定ページは、ユーザに対して応答遅延時間を生じさせずに、メディア所有者のページと置き換えられる（ブランド設定ページの内容は、自動ソフトウエア更新の間に更新される）。
（４）フレキシブルアクティベーション
クライアントアプリケーションが非アクティブであるときには、ユーザは、以下の方法でアクティブにすることができる
（ａ）アプリケーションのアイコンをクリックする
（ｂ）ホットキーの組み合わせを押下する
（ｃ）トレイアイコンをクリックする（ウインドウズ）
（ｄ）ブラウザのツールバー上のボタンをクリックする
（ｅ）最小化されているメディアブリッジクライアントのビデオカメラウインドウをもとに戻す（ウインドウズ）。
（５）ステータス表示
アクティブの間、クライアントアプリケーションは、ステータス表示枠を介して、ユーザにフィードバックを行う。それは、カメラから見た眺めの隣に位置する、ビデオカメラウインドウ内に表示される。ステータスは、周囲の照明状態のフィードバック、カメラからの距離（可能ならば）、焦点、および、（画像関連の情報を表示する準備をし、画像を読もうとし、あるいは、メディアブリッジ強調された画像がカメラに提示されるのを待っている）現在のステータスを含んでいる。
（６）多数のカメラサポート
例示したメディアブリッジクライアントアプリケーションは、同時に１台のカメラを使用するが、インストールされた、メディアブリッジ動作可能なカメラはどれでも使用できる。コンピュータがカメラを１台だけ持っている場合、自動的にそのカメラが選択される。カメラが２台以上あれば、どのカメラを使用するかをユーザが選択でき、クライアントが動作している間、その選択を変えることができる。
（７）自動ソフトウエア更新
ユーザは、簡単なメニュー選択により、クライアントアプリケーションへの更新を自動的にインストールできる。クライアントは、インターネットに接続して、利用できるどんな更新をもダウンロードし、インストールする。さらに、クライアントは、（例えば、メディアブリッジデータとともに符号化されたバージョンのしるしを参照して）、新たなプロトコルを使用しているメディアブリッジ強調された画像が見つかれば、更新のチェックを提示する。
（８）ユーザオプションコンフィギュレーション
クライアントアプリケーションにある、ほとんどすべてがユーザによって設定できる
（ａ）コンピュータが動き始めると、いつでも自動的にクライアントをスタートさせる（デフォルト）
（ｂ）ホットキーによるアクティベーション
（ｃ）システムトレー上へのアクティベーションアイコンの表示（ウインドウ）
（ｄ）インターネットウェブブラウザへのボタン付加（インターネットエクスプローラ４あるいはそれ以降、およびネットスケープ４あるいはそれ以降）
（ｅ）多数のカメラがインストールされているとき、立ち上げに使用した最後のカメラを選択する
（ｆ）定期的にソフトウエアの更新をチェックするよう注意を喚起する
（ｇ）立ち上げ時にウイザードを動作させる（デフォルト）
（ｈ）メディアブリッジ強調された画像を読むときの自動デアクティベーション
（ｉ）特定の期間、何もカメラに提示されないときの自動デアクティベーション
（ｊ）メディアブリッジ強調された画像を読んだ時点における呼出し音の鳴動あるいは音ファイルの動作
（ｋ）ＲＳＡＣｉ評価に基づくサイトの遮断。各メディア所有者は、言葉、裸体、性描写、および暴力のカテゴリに対するＲＳＡＣｉ指標を使用して、サイトの自己評価を行うことが求められている。どのカテゴリに対するＲＳＡＣｉ評価もがエンドユーザの許容度を越えているときは、ルータは、サイトからエンドユーザを遮断する。（ルータは、もっぱらメディア所有者の自己評価に依存し、実質的にＲＳＡＣｉコードに対するホームページのチェックは行わない。）このオプションの選択により、ウェブブラウザ内における内容制限に関するＲＳＡＣｉ（ｈｔｔｐ：／／ｗｗｗ．ｒｓａｃ．ｏｒｇ／ｒａｔｉｎｇｓｖ０１．ｈｔｍｌ）についての情報が表示される
（ｌ）既存のダイヤルアップ（モデム）接続を介したインターネットへの自動接続
（ｍ）起動時のパスワードによる保護
（ｎ）ユーザ登録情報（ユーザには、全情報がオプションであり、特定のアイテムが第三者に与えられることがある旨が通知される）
（ｏ）ユーザに提供が要求されないエンドユーザの郵便番号は、エンドユーザが自主的に提供した場合、メディア所有者に伝えられる基本的な人口統計情報として使用される。
（９）ウイザード
このウイザードは、特定のカメラをセットアップしてメディアブリッジにより最良の結果を得るとともに、もっと情報を得るためのポータルとしてメディアブリッジを利用する最良の技術を得るためのガイダンスを提供する。デフォルトとして、クライアントアプリケーションが開始される度にウイザードが動作する。ウイザードは、ユーザが新たなカメラを最初に選択したときにも動作する。
（１０）カメラの照合
メディアブリッジクライアントの入力として新たなカメラが選択されると、クライアントは、そのカメラがメディアブリッジ動作可能であるかの照合をする。そうでなければ、カメラはサポートされず、クライアントアプリケーションでは正確に動作しないことをユーザに警告する。
（１１）拡張可能アーキテクチャ
メディアブリッジクライアントは、通常、ブラウザウインドウにインターネットあるいはローカルのホームページを表示することで、メディアブリッジ強調された画像を読み、所望の情報に結合する。その機能は、特定データを扱うための登録を行う、メディアブリッジ動作可能なアプリケーションによって拡張できる。例えば、メディアブリッジ強調された名刺が提示されると、メディアブリッジクライアントは、メディアブリッジ動作可能なアプリケーションを動作させて、それにより、ウェブサイトから名刺情報をダウンロードし、ユーザの接触リストを新たな情報で更新する。他の例として、メディアブリッジ強調された子供向けの本のページがあり、それによって、そのページに対してオーディオファイルが動作するようになる。
（１２）埋め込み支援
メディア所有者がクライアントアプリケーションを使用して、画像が、そこに埋め込まれた正しいメディアブリッジコードを持っているかを照合する場合、クライアントはメディア所有者の名前、ルーティング情報、および、メディアブリッジ画像が読まれたときのメディアブリッジ透かしの相対的な強さを表示する。各メディア所有者のプライバシーを守るため、この情報が与えられるのは、ユーザが、有効な埋め込みユーザ名とメディア所有者のパスワードが提供できるときだけである。
【０５２０】
【メディアブリッジルータ】
ルータは、本質的にエンドユーザに対してトランスペアレントである。クライアントアプリケーションは、インターネット上の情報にリンクされた、メディアブリッジ強調された画像を検知すると、ルータと通信を行って、表示すべきホームページのインターネットアドレス情報を得る。
ルータは、以下の機能も含んでいる：
【０５２１】
（１）ルーティング情報の保守
ルータ内には、一意のメディアブリッジコード各々を一つ以上の関連インターネットアドレスにリンクさせる情報がある。１つの例として、システム管理者（例えば、デジマーク）が、広告会社の顧客が提供する情報を使用してルーティング情報を保守する。他の実施例では、メディア所有者が、ルータに接続された確実なインターネットを使用して情報そのものを更新する。
（２）問題の取扱い
ルーティング要求が満たされない場合は、エンドユーザへの影響を最小限にする方法で、ルータが応答する。例えば、メディアブリッジコードが未知であれば、クライアントアプリケーションには、メディア所有者のホームページに対するＵＲＬが与えられる。さらには、エラーが発生する日ごとに、ルータがメディア所有者に電子メールでエラーの発生を通知する。
（３）内容の評価
メディア所有者が画像あるいはそのサイトに対するＲＳＡＣｉ評価情報を供与し、エンドユーザが、そのサイトが遮断されるとするＲＳＡＣｉ評価を特定した場合、ルータは、そのサイトが不適当な内容を含んでおり、メディア所有者のサイトへは接続できないことを示すホームページをユーザに返す。
（４）妥当性の確認
定期的に（例えば、毎日）、ルータがデータベース内のすべてのアクティブ情報の妥当性を確認する。何らかのエラーが見つかれば、メディア所有者へは、電子メールで通知される。エラーが１日で修復しない場合は、デジマークが通知される。以下に、チェックされる条件を示す：
（ａ）アクティブリンク上にＵＲＬが見当たらない
（ｂ）ＵＲＬが、存在しないページを参照している
（ｃ）ページが、デジマークの要求する許容ダウンロード時間を超えている。
（５）トラッキング
ルータは、マーケティング情報を作成するため、クライアントアプリケーション要求を記録する。そのようなトラッキング記録は、以下のものを含む：
（ａ）要求の日および時間
（ｂ）メディア所有者および画像
（ｃ）可能ならば、エンドユーザの郵便番号
（ｄ）要求を出したＩＰアドレス
（６）報告
報告トラッキング情報を使用して、ルータは、デジマークが使用する以下の報告を提供する：
（ａ）特定の日の範囲に対するＵＲＬ要求の数
（ｂ）特定の日の範囲に対するメディア所有者によるＵＲＬ要求の数
（ｃ）特定の日の範囲に対するメディアブリッジ強調された画像によるＵＲＬ要求の数
（トラッキングと報告は、好ましくは、メディア所有者がルータからオンラインでトラフィックおよびマーケティング報告を入手できるよう構成されている）。
【０５２２】
【メディアブリッジ埋め込みシステム】
埋め込みシステムは、以下のものを含む：
●メディアブリッジコードを埋め込むための写真店対応エンベダプラグイ
ン
●メディアブリッジ強調されたデジタル画像を照合するための写真店対応
リーダプラグイン
●メディアブリッジ強調されたプルーフとプレスプリントの照合のための
クライアントアプリケーション
●メディアブリッジコードを得てメディアブリッジコードにＵＲＬを割り
当てるための、インターネットに基づくルータ保守アプリケーション。
【０５２３】
プラグインは、認証のためだけのインターネット接続と新たなメディアブリッジルーティングコードの割り当てを要求する。ルータ保守アプリケーションは、常にインターネット接続を要求する。
【０５２４】
【ルータ保守アプリケーション】
ルータ保守アプリケーションの主目的は、メディアブリッジコードにルーティング情報を割り当てることで、クライアントアプリケーションが画像を読み込んだときに、エンドユーザに適切なホームページを提示することである。
【０５２５】
ルータ保守アプリケーションは、以下の機能を含む：
（１）マルチロケーション
単一のメディア所有者アカウントは、様々な場所において様々な人によってアクセスできる。広告主やその広告代理店のような様々な団体に属する人もアクセスできる。
（２）アクセス制限
各メディア所有者は、誰がルータ情報にアクセスできるかを制限し、また、誰が新たなメディアブリッジコードを生成したり、既存のメディアブリッジコードを使用したり、あるいはルーティングコードに対する情報を変更することができるかを特定する権能を有する。メディア所有者は、いつでもアクセスの付加、変更、あるいは取り消しができる。
（３）確実なアクセス
ルータへのインターネットアクセスはすべて、確実な接続を介して行われる。
（４）ルーティングコード
新たなルーティングコードの割り当て、既存のルーティングの変更、および古いルーティングコードの消去あるいは再使用。
（５）時間をもとにしたルーティング
各ルーティングコードには、複数のＵＲＬを割り当てることができ、それら各々が、オプションとして、何時ルーティングに使用できるかを定める有効日と満了日を持っている。期限切れのＵＲＬは、３０日後に自動的にルータによって消去される。
（６）マルチルーティング
ルーティングコードに複数のＵＲＬが指定されている場合、ルータは、エンドユーザへブラウザに基づくメニューを返し、それによって、エンドユーザは、ホームページへ直接ナビゲートされるのではなく、どのページを表示するかを選択できる。ある実施例では、単一のルーティングコードが、最大４つの期限未満了のＵＲＬを持つことができる。各ＵＲＬは、ＵＲＬにブラウザリンクする簡単な説明と、最大５００文字の長い説明と、メニューに表示するアイコンに対するＵＲＬとを有している。このアイコンは、せいぜい高さ方向が５０画素、幅方向が３００画素の大きさである。
（７）記録
ルーティング情報に対する変更はすべて記録され、メディア所有者によって検討される。
【０５２６】
【プラグインの概要】
メディア所有者に対して、コンピュータにおいて埋め込みが最初に行われると、エンベダは、メディア所有者のアカウント番号と、有効なユーザ名およびメディア所有者が規定したパスワードとを要求する。エンベダは、インターネットを介してルータに接続され、ユーザが認証されているかの照合を行い、メディア所有者についての情報をダウンロードする。メディア所有者に対するさらなる埋め込みは、ルータに接続せずに行える。しかし、ユーザがルータに接続して埋め込みのためのルーティング情報を得る度に、ルータは、現在有効な名前とパスワードに対する、ユーザ名とパスワードの検証を行う。以前使用していた名前とパスワードが既に有効ではない場合、ユーザは、メディア所有者に対する埋め込みを継続するため、有効な名前とパスワードを提供する必要がある。
【０５２７】
メディア所有者のアカウント番号は、最初の認証でのみ必要となる。それは、将来のどの認証も、エンベダによって保守されているメディア所有者の名前を使用して行われるからである。広告代理店のグラフィックスアーティストは、２あるいはそれ以上のメディア所有者のプロジェクトに従事できるため、一人のグラフィックスアーティストが、各メディア所有者に対して様々なユーザ名とパスワードを持つことができる。
【０５２８】
リーダプラグインは、主として埋め込み後の画像照合に使用される。リーダプラグインは、エンベダプラグインと同様の方法でアクセスの制限を行い、さらには、ユーザが、メディア所有者の有効なユーザ名とパスワードを用意できた場合のみ、画像についての情報を提供するよう制限を行う。現在のコンピュータでメディア所有者の情報が入手できない場合は、リーダは、照合のためルータに接続する。
【０５２９】
プラグインは、以下の機能を共有している：
（１）複数のメディア所有者
ユーザは、複数のメディア所有者に対して埋め込みあるいは読み出しを行うことができる。ユーザは、各メディア所有者の有効なユーザ名とパスワードを有していなければならない。
（２）複数のユーザ
数人で１台のコンピュータを使用できる。これらの者は、同一のユーザ名とパスワードを使用しない限り、情報を共有できない。
（３）自動ソフトウエア更新
ユーザは、簡単なメニュー選択により、プラグインへの更新を自動的にインストールできる。プラグインはインターネットに接続して、利用できるどんな更新をもダウンロードし、インストールする。
（４）確実なアクセス
インターネットアクセスはすべて、確実な接続を介して行われる。
【０５３０】
【エンベダプラグイン】
エンベダプラグインはまた、以下の機能を含む：
１．ルーティングコード割り当て
ユーザは、インターネット接続を介してルータによって提供された既存コードのリストより、埋め込むルーティングコードを選択する。各ルーティングコードは、一意のルーティング番号と記述によって識別される。一旦、ルータを介した選択が行われると、ルーティングコードについての情報は、ユーザが除去するまでローカルコンピュータ上に保持される。
２．新たなルーティングコード
認証されれば、ユーザは、エンベダを介してルータに接続して、新たなルーティングコードを生成する。ルーティングコードは、ＵＲＬ情報とともに、あるいはＵＲＬ情報なしで生成でき、それは後で付加できる。
３．ルーティングコードの更新
エンベダは、ルータに接続されたときはいつでも、ローカルにキャッシュされたルーティングコードに対して行われた、どの更新をもダウンロードする。
４．マスク埋め込み
ユーザは、画像の一部を遮蔽することで、メディアブリッジコードがその遮蔽領域にのみ埋め込まれるようにすることができる。１つの実施例では、様々な遮蔽領域に様々なコードを用いる。一般的には、ユーザは、画像の同一部分に異なるメディアブリッジコードを埋め込むことはできない。
５．可変輝度
ユーザは、軽度からかなりの程度まで、メディアブリッジ透かしの輝度（従って、視認性）を全体的に変えることができ、画像の様々な領域の輝度を局所的に変えることもできる（すなわち、輝度は、局所画像の特性に適合している）。
６．記録
ユーザが画像に埋め込みを行う度に、エンベダは、ログの日付、時間、埋め込まれた情報、埋め込み設定（例えば、輝度）、ユーザ名、コンピュータ名、および入力画像ファイル名を記録する。このログは、各ユーザのコンピュータ上ではテキストファイルであり、どのテキストエディタでも閲覧できる。
【０５３１】
【リーダプラグイン】
リーダプラグインはまた、以下の機能を含んでいる：
（１）読み込み
スキャンされたデジタル画像を読み込み、そのユーザが認証されていれば、メディア所有者、ルーティング情報、およびメディアブリッジ透かしの強度単位を表示する。
（２）マスク読み込み
ユーザは、画像の一部を遮蔽して、その部分からのみメディアブリッジ情報を読み込むことができる。
【０５３２】
【パート３】
【発明の組み合わせ】
上で詳述された本発明の態様によれば、プライオリティケース（ｐｒｉｏｒｉｔｙ ｃａｓｅｓ）で請求された本発明の組み合わせの一部には、以下のものが含まれる。
【０５３３】
Ａ１．個人のビジネスカードを光センサに与え、前記光センサは出力データを生成し；
センサ出力データから、ステガノグラフィック符号化された複数ビットデータを復号化し；
前記複数ビットデータを用いて、前記ビジネスカードの所有者に関するデータを有するインターネットアドレスに対するリンクを確立することを備える方法。
【０５３４】
Ａ２．前記インターネットサイトから、個人の特定の活動を詳述したカレンダーデータを獲得することを含む請求項Ａ１の方法。
【０５３５】
Ａ３．獲得されたカレンダーデータの量は、認証レベルに基づく請求項Ａ１の方法。
【０５３６】
Ａ４．認証レベルは、個人のビジネスカード内で符号化された複数ビットデータで示され、個人は別々に符号化されたカードを異なる受取人に送って、前記カレンダーデータに対する様々なアクセス権を受取人に与えることができる、請求項Ａ３の方法。
【０５３７】
Ａ５．前記光センサは、ビジネスカードのテキスト情報を個人情報マネージャに与えるようにも機能するビジネスカードリーダである、請求項Ａ１の方法。
【０５３８】
Ａ６．複数ビットデータから判別されるインターネットアドレスを前記個人情報マネージャに格納することを含む、請求項Ａ５の方法。
【０５３９】
Ａ７．光センサはデジタルカメラである、請求項Ａ１の方法。
【０５４０】
Ａ８．前記デジタルカメラはコンピュータディスプレイにマウントされる、請求項Ａ７の方法。
【０５４１】
Ａ９．前記デジタルカメラは、そのユーザにヘッドマウントされる、請求項Ａ７の方法。
【０５４２】
Ａ１０．販売促進製品の印刷物を第１のサイトの光センサに与え、前記光センサは出力データを生成し；
前記センサの出力データからのステガノグラフィック符号化された複数ビットデータを復号化し；
前記データを用いて、前記販売促進製品の印刷物によって販売促進されるサービスや製品や会社に関連するインターネットサイトに対するリンクを確立し；
前記インターネットサイトから前記第１のサイトに、前記サービスや製品や会社に関連するさらに別の情報を送ることを備える方法。
【０５４３】
Ａ１１．印刷された識別バッジを光センサに与え、前記光センサは前記バッジの表面の光特性に対応する出力データを生成し；
前記センサの出力データから、ステガノグラフィック符号化された複数ビットデータを複合化し；
前記複数ビットデータをチェックして、それが有効なアクセスカードに対応するかどうか決定し、上述のチェックオペレーションの結果に基づいて錠を開けることを備える方法。
【０５４４】
Ｂ１．デジタル符号化されたオブジェクトを光センサに与え、前記光センサは出力データを生成し；
前記センサの出力データから複数ビットデータを復号化し；
前記複数ビットデータを用いて、前記オブジェクトに関連するデータを有するインターネットアドレスに対するリンクを確立することを備える方法。
【０５４５】
Ｂ２．前記複数ビットデータを用いて、前記オブジェクトがステガノグラフィック符号化される、請求項Ｂの方法。
【０５４６】
Ｂ５．冷蔵庫と；
前記冷蔵庫に関連する光センサであって、センサの正面で固定されたオブジェクトに対応する画像データを提供するように調整された、当該センサと；
前記画像データを処理し、その中から複数ビット２進データを抽出する画像プロセッサを備え、食料雑貨類のリストを編集するために役立つ装置。
【０５４７】
Ｂ６．コンピュータを動作させる方法であって、前記コンピュータは、レジストリデータベースを有するオペレーティングシステムを含み、前記レジストリデータベースは、特定のデータタイプと、それに特に対応する特定のソフトウエアプログラムを関連づけ、改良点は：
１フレームの画像データを提供し、
画像データからの複数ビットの識別データを復号化し；
前記レジストリデータベースで調べて、前記識別データに対応するソフトウエアプログラムを識別し；
識別されたソフトウエアプログラムを呼び出すことを備えたことである。
【０５４８】
Ｂ７．前記画像データからの複数フィールドデータをステガノグラフィック復号化し、前記複数フィールドのうちの１つは前記識別データを備え；
前記複数フィールドデータの別の１つを、それを使用する識別されたソフトウエアプログラムに提供することを備える、請求項Ｂ６の方法。
【０５４９】
Ｂ８．複数ビットの補助データを運ぶために符号化されたオブジェクトに対応するシステムであって：
視野に対応する画像データを生成する光捕捉デバイスであって、前記視野にはオブジェクトのみならず可視クラッターも含まれる、当該デバイスと；
画像データ内の可視クラッターからオブジェクトを識別する可視の手がかりベースのサブシステムと；
前記サブシステムによって識別されたオブジェクトから複数ビットの補助データを抽出し、抽出された補助データを応答システムに適用するプロセッサを備えるシステム。
【０５５０】
Ｂ９．前記可視の手がかりベースのサブシステムは、スペクトル属性に基づいて前記可視クラッターからオブジェクトを識別する、請求項Ｂ８のシステム。
【０５５１】
Ｂ１０．前記オブジェクトには反射器が含まれ、前記システムには、反射器で反射され、光捕捉デバイスによって検出されるスペクトル特性の照明源が含まれる、請求項Ｂ８のシステム。
【０５５２】
Ｂ１１．前記可視の手がかりベースのサブシステムは、時間属性に基づいて前記可視クラッターからオブジェクトを識別する、請求項Ｂ８のシステム。
【０５５３】
Ｂ１４．第１の場所に入る人を認証するためにカスタマイズされたオブジェクトを生成する方法であって：
人にアクセスコードを提供し；
前記アクセスコードがステガノグラフィック符号化された、印刷可能なデータを生成し、第１の場所から離れた第２の場所にあるプリンタを用いて前記印刷可能なデータを印刷することを備える方法。
【０５５４】
Ｂ１５．前記アクセスコードはネットワークコンピュータを介して前記の人に提供され、第１の場所は映画館である、請求項Ｂ１４の方法。
【０５５５】
Ｂ１６．プリンタドライバソフトウエアからのコマンドに応答するプリンタであって、前記プリンタドライバソフトウエアは、２つの種類の入力データに対応するものとして特徴づけられる。そのうちの１つはテキストデータを備えるものであって、その他のものは電子透かしデータを備えるものであって、その２つの種類のものは、プリンタドライバソフトウエアに適用する前にまとめられるのではなく、個々にプリンタドライバソフトウエアに適用される。
【０５５６】
Ｂ１７．コンピュータを用いてプリントアウトを生成する方法であって、プリントアウトにはテキストが含まれ、コンピュータにはソフトウエアが含まれ、そのソフトウエアは、ユーザの制御に対応して印刷ダイアログボックスを提供し、改良点は、印刷ダイアログボックスがグラフィックユーザインターファイスを備え、これによって、印刷出力のステガノグラフィック符号化をユーザが選択できることである。
【０５５７】
Ｂ１８．複数ビットデータをステガノグラフィックに符号化して空白の頁上に与えるようにそれらの頁を処理して；
次に、処理された頁上にテキストや画像を印刷して、符号化され印刷された雑誌の頁を作り；
前記ステガノグラフィック符号化され印刷された雑誌の頁のうちの少なくとも１頁を束ねて複数の雑誌の各々を作ることを備える、雑誌の印刷方法。
【０５５８】
Ｂ１９． 旅行写真をステガノグラフィック符号化して、その中の複数ビットデータを隠し；
旅行写真を処理して、それから複数ビットデータを抽出し；
抽出された複数ビットデータの少なくとも一部を使って、写真で描写された場所を訪問したい消費者に役立つ旅行情報を提供するウェブサイトにインターネットウェブブラウザを割り当てることを備える旅行促進方法。
【０５５９】
Ｂ２１．入力情報をシステムに提供する身振りの方法であって：
ユーザの手にオブジェクトを保ち；
光スキャンデバイスの視野の少なくとも一部にオブジェクトを位置付け；
前記オブジェクトを手動で動かし；
スキャンデバイスを用いて、１秒間に複数回、複数の画像データフレームを取りこみ；
複数の画像データフレームを処理して、そこで表現されるオブジェクトを識別し；
複数の画像データフレーム内のオブジェクト表現を分析して、回転状態とスケール状態とデファレンシャルスケール状態とＸ−Ｙオフセットから成るリストから選択された少なくとも１つのパラメータの時間に関する変化を検出し；
検出された前記変化に基づいて、本システムのある態様を制御することを備えるシステム。
【０５６０】
Ｂ２２．オブジェクトはデジタル符号化され：
当該方法には、オブジェクトからの複数ビットデジタルデータを復号化することが含まれ、また、当該システムは、前記復号化されたデジタルデータの少なくとも一部に応答する、請求項Ｂ２１の方法。
【０５６１】
Ｂ２３．当該システムは、システム−ユーザ相互作用の複雑レベルを設定することによって前記復号化されたデジタルデータの少なくとも一部に応答する請求項Ｂ２１の方法。
【０５６２】
Ｂ２４．複数の画像データフレーム内のオブジェクト表現を分析して、回転状態の時間に関する変化を検出し、前記検出された変化に基づいて当該システムの一部の態様を制御することを含む、請求項Ｂ２１の方法。
【０５６３】
Ｂ２５．複数の画像データフレーム内のオブジェクト表現を分析して、スケール状態での時間に関する変化を検出し、前記検出された変化に基づいてシステムのある態様を制御することを含む、請求項Ｂ２１の方法。
【０５６４】
Ｂ２６．複数の画像データフレーム内のオブジェクト表現を分析して、デファレンシャルスケール状態の時間に関する変化を検出し、前記検出された変化に基づいてシステムのある態様を制御することを含む、請求項Ｂ２１の方法。
【０５６５】
Ｂ２７．複数の画像データフレーム内のオブジェクト表現を分析して、Ｘ−Ｙオフセットでの時間に関する変化を検出し、前記検出された変化に基づいてシステムのある態様を制御することを含む、請求項Ｂ２１の方法。
【０５６６】
Ｂ２８．複数の画像データフレーム内のオブジェクト表現を分析して、前記パラメータのうちの１つの時間に関する第１の変化を検出した後で、前記パラメータのうちの１つの時間に関する第２の変化を検出し、前記検出された変化に基づいて当該システムのある態様を制御する、請求項Ｂ２１の方法。
【０５６７】
Ｂ２９．第１と第２の変化は両方ともに同じパラメータに関係する、請求項Ｂ２１の方法。
【０５６８】
Ｂ３０．発信者と受取人の間に音声回路を確立する電話のような器具を動作させる方法であって、改良点は、基板の上にしるしのある当該基板を光センサに与え、基板の少なくとも一部を含む視野を撮像してそれに対応する画像データを生成し、画像データからの複数ビットデジタルデータをステガノグラフィック復号化して、前記複数ビットデジタルデータの少なくとも一部に基づいて音声回路を確立することを備えたことである。
【０５６９】
Ｂ３１．前記しるしは、受取人を描写した写真画像を備える、請求項Ｂ３０の方法。
【０５７０】
Ｂ３２．光スキャンデバイスの視野内の少なくとも一部領域に固有のオブジェクトを配置し、前記固有のオブジェクトは、運転免許と政府による身元証明付文書とバンクカードと印章付ジュエリー項目から成るリストから選択され；
スキャンデバイスを用いて、１フレームの画像データを取りこみ；
前記画像データを処理してそれからの複数ビットデータをステガノグラフィック復号化し；
前記ステガノグラフィック復号化したデータの少なくとも一部をコンピュータシステムに与えることを備える方法。
【０５７１】
Ｂ３３．固有のオブジェクトによって識別される人に対応するＥメールのアカウントからＥメールデータを得て、コンピュータシステムのユーザにそれを提供することをさらに含む、請求項Ｂ３２の方法。
【０５７２】
Ｂ３４．公共の場所で使用されるＥメールデータ端末であって、前記端末は入力部と出力部を備え、前記出力部はＥメールデータをそのユーザに提供するものであって、改良点は、固有のオブジェクトに対応するスキャンデータを生成する光スキャンデバイスを前記入力部が含み、固有のオブジェクトは運転免許と政府による身元証明付文書とバンクカードから成るリストから選択されることである。
【０５７３】
Ｂ３５．光センサデバイスの視野内にオブジェクトを与え、前記オブジェクトは小売り製品や小売り製品を包むものから成るリストから選択され、
前記オブジェクトに対応する光データを得て；
光データからの複数ビットデジタルデータを復号化して；
前記復号化されたデータの少なくとも一部を遠隔のコンピュータに送り；
前記遠隔のコンピュータで、前記復号化されたデータが送られたことに応答して、ほうびを与えるべきかどうかを決めることを備える、販売促進方法。
【０５７４】
Ｂ３６．ユーザの好みを確認するように、第１のコンピュータのディスクトップコンピュータを調整する方法であって：
前記第１のコンピュータに関連する光センサに固有のオブジェクトを与え；
前記光センサから生成された画像データを分析して、それからの複数ビットデータを復号化し；
前記復号化されたデータに基づいて前記コンピュータのディスクトップコンピュータを調整する方法。
【０５７５】
Ｂ３７．前記第１のコンピュータから遠隔のコンピュータへ通信する際に、前記復号化されたデータの少なくとも一部を用い、前記遠隔のコンピュータはユーザが好むディスクトップコンピュータ構成に関するプロファイルデータを備え：
前記遠隔のコンピュータから前記第１のコンピュータに前記プロファイルデータを送り；
前記プロファイルデータに基づいて、前記第１のコンピュータ上にディスクトップコンピュータを構成することをさらに含む、請求項Ｂ３６の方法。
【０５７６】
Ｂ３８．第１のベンダーから製品やサービスを購入し、
前記購入の証を受け取り、
光スキャンデバイスに前記証を与えて、画像データを生成し、
画像データからの複数ビットデータを復号化し、
前記復号化された複数ビットデータを用いて、第１のベンダーに無関係の第２のベンダーから値を得る方法。
【０５７７】
Ｂ３９． 前記値は、第２のベンダーから、ただか、もしくは割り引かれた製品やサービスを提供するものである、請求項Ｂ３８の方法。
【０５７８】
Ｂ４０． 光スキャンデバイスに旅行文書を与え、前記旅行文書は符号化された複数ビットデータを備え、前記光スキャンデバイスはそれに対応する画像データを提供し、
前記画像データから前記複数ビットデータを識別し、
前記複数ビットデータに基づいて遠隔のコンピュータに対するリンクを確立し、前記コンピュータを用いて旅行プランを変更することを備える方法。
【０５７９】
Ｂ４１． 光センサにビジネスカードを与え、前記光センサは画像データを生成し、前記ビジネスカードは人に対応するものであり、
前記画像データから複数ビットデジタル情報を識別し、
前記識別されたデジタル情報を用いて、遠隔のデータ格納域をアクセスし、
前記データ格納域から前記人に関して更新されたコンタクト情報を得て、
前記更新されたコンタクト情報を使って、前記人との通信を確立することを備え、
前記人の活動によって、様々な時間で様々なコンタクト情報を適切なものなる日に、前記遠隔のデータ格納域の前記コンタクト情報は更新される通信方法。
【０５８０】
Ｂ４２． ビジネスカード上の前記複数ビットデジタル情報は ステガノグラフィックに符号化される、請求項Ｂ４１の方法。
【０５８１】
Ｂ４４． 第１のコンピュータに関連する光センサの視野内に物理オブジェクトを与え、前記光センサは画像データを提供し、
前記画像データ内の物理オブジェクト表現からの複数ビットデジタルデータを復号化し、
前記複数ビットデジタルデータの第１の部分を用いて、前記第１のコンピュータと遠隔コンピュータ間にリンクを確立し、
前記遠隔コンピュータに前記複数ビットデジタルデータの第２の部分を与え、
前記遠隔コンピュータから前記第１のコンピュータに情報を与え、前記情報は前記物理オブジェクトに対応することを備える方法。
【０５８２】
Ｂ４５． 前記複数ビットデジタルデータの第１の部分を用いて、複数のサーバコンピュータのネットワークをトラバースすることによって前記遠隔コンピュータを識別する、請求項Ｂ４４の方法。
【０５８３】
Ｂ４６． 前記オブジェクトは、人に関連するビジネスカードであって、前記遠隔コンピュータから提供される情報には前記人に関連するコンタクト情報が含まれる、請求項Ｂ４４の方法。
【０５８４】
Ｂ４７． 補助データを用いて印刷広告をステガノグラフィックに符号化し、
前記広告を発行し、
広告主に前記発行かかる料金を課し、
ステガノグラフィック符号化を用いて前記広告主に改善値を提供する技術を提供し、
前記料金の一部を前記技術の提供者と分けることを備える方法。
【０５８５】
Ｂ４８． 写真に複数ビットデジタル識別子をステガノグラフィックに組み込み、
前記識別子に関するデータベースに注釈を格納し、
前記写真を光センサに与え、前記光センサは画像データを提供して、前記画像データから前記識別子を復号化し、
前記復号化された識別子を用いて、前記データベースに格納された前記注釈をアクセスし、
前記アクセスされた注釈を提供することを備える方法。
【０５８６】
Ｂ４９． コンピュータを用いてインターネットアドレスにリンクして、前記アドレスから前記コンピュータのユーザに情報を与え、
前記コンピュータに関連する光センサにオブジェクトを与え、前記センサは視野に対応する画像データを生成し、
前記視野内でオブジェクトを物理的に操作し、
前記画像データから前記オブジェクトの操作を識別し、
それに対応する出力データを生成し、
前記出力データに基づいてインターネットアドレスを変えることによって、ユーザに与えられる情報を変える、インターネットナビゲーション方法。
【０５８７】
Ｂ５０． 粘着性物質によって一つのエッジで取り外し可能に互いにつながれた複数のシートを備え、各シートの複数ビットデジタルデータは符号化されることを特徴とするノートパッド。
【０５８８】
Ｂ５１． 各シートの複数ビットデジタルデータはステガノグラフィック符号化される、請求項Ｂ５０のノートパッド。
【０５８９】
Ｂ５２． 前記パッドのほかのシートと同じ各シートの複数ビットデジタルデータが符号化される、請求項Ｂ５０のノートパッド。
【０５９０】
Ｂ５３． オブジェクトを光センサに与え、前記光センサは画像データを生成し、前記オブジェクトの複数ビットのデジタルデータはステガノグラフィック符号化され、
前記画像データからの前記デジタルデータを復号化し、
前記デジタルデータに応答して、前記オブジェクトを描写する前記センサからの画像データを格納することを備える方法。
【０５９１】
Ｂ５４。 前記オブジェクトは紙シートであって、当該方法には、前記光センサからの複数フレームの画像データを獲得し、
前記オブジェクトの適切な表現を有する前記複数のフレームのうちの１つを識別し、
識別されたフレーム内のその他の画像データから、前記シートに対応する画像データをマスクし、
前記シートに対応する画像データを処理してその幾何学的属性を変えて、それから復号化された前記デジタルデータのうちにいくつかから前記シートのサイズと色を識別し、
前記マスクされ処理された、前記シートのサイズと色とともに画像が格納された日付と時間を示すデータに関する前記シートに対応する画像データを格納することが含まれる、請求項Ｂ５３の方法。
【０５９２】
Ｂ５５． オブジェクトを光センサに与え、前記光センサは画像データを生成し、前記オブジェクトの複数ビットデジタルデータはステガノグラフィック符号化され、
前記画像データからの前記デジタルデータを復号化し、
前記デジタルデータに応答して、類似のオブジェクトの画像を表示する方法。
【０５９３】
Ｂ５６． 前記オブジェクトは紙シートであって、当該方法は、前もって記憶された時間順に対応する表示順序で前に格納された複数の紙シートの画像を表示することを含む、請求項Ｂ５５の方法。
【０５９４】
Ｂ５７．コンピュータオペレーティングシステムで、連続フレームの２次元画像データに対応し、それから身振りデータを抽出し、前記身振りデータにはＸ−Ｙ位置データと回転状態とスケール状態とデファレンシャルスケール状態からなるリストから少なくとも２つのデータを含むソフトウエアモジュール。
【０５９５】
Ｃｌ． ビジネスカードを光センサに与え、前記光センサは画像データを生成し、前記ビジネスカードは人に対応し、
前記画像データから複数ビットデジタル情報を識別し、
前記識別されたデジタル情報を用いて、遠隔のデータ格納域をアクセスし、
前記データ格納域から更新された対人コンタクト情報を獲得し、
前記更新されたコンタクト情報を用いて、前記人との通信を確立することを備え、
当該人の活動によって様々な時間に様々なコンタクト情報を適切なものにする日に、前記遠隔データ格納域の前記コンタクト情報を更新することを備える通信方法。
【０５９６】
Ｃ２． ビジネスカードの複数ビットデジタル情報はステガノグラフィック符号化される、請求項Ｃ１の方法。
【０５９７】
Ｃ３． 第１のコンピュータに関連する光センサの視野内に物理オブジェクトを与え、前記光センサは画像データを生成し、
前記画像データ内の前記物理オブジェクトの表現からの複数ビットデジタルデータを復号化し、
前記複数ビットデジタルデータの第１の部分を用いて、第１のコンピュータと遠隔のコンピュータ間にリンクを確立し、
前記複数ビットデジタルデータの第２の部分を前記遠隔のコンピュータに与え、
前記遠隔のコンピュータから前記第１のコンピュータに情報を与え、前記情報は前記物理オブジェクトに対応することを備える方法。
【０５９８】
Ｃ４． 前記複数ビットデジタルデータの第１の部分を用いて複数のサーバコンピュータのネットワークをトラバースすることによって、前記遠隔のコンピュータを識別することを含む、請求項Ｃ３の方法。
【０５９９】
Ｃ５． 前記オブジェクトは、人に関連するビジネスカードであって、前記遠隔のコンピュータから与えられる情報には、前記人に関連するコンタクト情報が含まれる、請求項Ｃ３の方法。
【０６００】
Ｄｌ． デジタル符号化されたオブジェクトを光センサに与え、前記光センサは出力データを生成し、
前記センサの出力データからの複数ビットデータを復号化し、
前記複数ビットデータを用いて、前記オブジェクトに関連するデータを有するインターネットアドレスに対するリンクを確立することを備える方法。
【０６０１】
Ｄ２． 前記オブジェクトの前記複数ビットデータはステガノグラフィックに符号化される、請求項Ｄｌの方法。
【０６０２】
Ｅｌ． 印刷広告をステガノグラフィックに符号化して、その中の複数ビットデータを隠し、
前記印刷広告を処理して、そこから複数ビットデータを抽出し、
抽出された複数ビットデータの少なくとも一部を用いて、前記印刷広告によって販売促進される製品やサービスに関連する消費者情報を提供するインターネットウェブブラウザをウェブサイトに割り当てる販売促進方法。
【０６０３】
Ｅ２． 印刷広告に反応する消費者を決定する方法であって、
第１のデータを含む第１の印刷広告をステガノグラフィックに符号化し、
第２のデータを含む第２の印刷広告をステガノグラフィックに符号化し、
消費者が第１と第２の広告を光センサに与えるときに前記第１と第２のデータを復号化し、
復号化された第１と第２のデータの数をそれぞれ計算して、前記広告に反応する消費者を決定することを備える方法。
【０６０４】
Ｅ４． 旅行写真をステガノグラフィックに符号化して、その中の複数ビットデータを隠し、
前記旅行写真を処理して、そこから複数ビットデータを抽出し、
抽出された複数ビットデータの少なくとも一部を用いて、前記写真で描写された場所を訪問したい消費者に役立つ旅行情報を提供するウェブサイトにインターネットウェブブラウザを割り当てることを備える、旅行促進方法。
【０６０５】
Ｆｌ． Ｘ位置符号化器とＹ位置符号化器と、それに応答してＸ方向移動データとＹ方向移動データを生成してそれに関連するコンピュータにそれを提供する回路を有するマウスであって、改良点は、前記マウスに配置された光センサと、それに応答してグレイスケールの光画像データを生成し、それに関連するコンピュータにそれを提供する回路を備えたことであって、前記マウスはポインティングデバイスと光入力デバイスの両方として機能することであるマウス。
【０６０６】
Ｆ２． 半導体に接して形成される基板と、
センサ信号を生成する２次元画像センサと、
前記センサ信号に応答してそれに対応する画像データを生成し、前記画像データを前記半導体の画像データ出力部に与える第１の回路と、
前記センサ信号、即ち、前記画像データに応答して、それの複数ビットデジタルデータをステガノグラフィックに符号化し、それを前記半導体のステガノグラフィック復号化出力部に与える第２の回路を備える半導体。
【０６０７】
Ｆ３． インターネットウェブブラウザを含むコンピュータシステムを動作させる方法であって、改良点は、
センサを備える周辺デバイスを提供し、
第１のオブジェクトの近傍に前記周辺デバイスを位置付けて、第１のアドレスに前記ウェブブラウザを割り当て、
第２のオブジェクトの近傍に前記周辺デバイスを位置付けて、第２のアドレスに前記ウェブブラウザを割り当てることを備える方法。
【０６０８】
Ｇ１． コンピュータシステムの周辺デバイスであって、
ユーザの手のひら内にフィットするように調整されて、媒体上を滑るハウジングと、
複数の検知要素を備えて、画像信号を生成する光センサと、
前記媒体を前記センサ上に撮像させるレンズと、
前記センサに接続され、前記センサからの信号を処理して出力データフレームと同様にフォーマット化する前記ハウジング内に配置された回路と、
前記周辺デバイスからコンピュータシステムに前記出力データを中継する伝送手段を備える周辺デバイス。
【０６０９】
Ｇ２． 前記伝送手段はケーブルである、請求項Ｇ１のデバイス。
【０６１０】
Ｇ３． 前記伝送手段は無線リンクである、請求項Ｇ１のデバイス。
【０６１１】
Ｇ４． 前記回路は、前記センサによって検知された画像内でステガノグラフィックに 符号化された複数ビット２進データを復号化し、前記伝送手段は、復号化されたデータを前記コンピュータシステムに中継する、請求項Ｇ１のデバイス。
【０６１２】
Ｇ５． 業者から売出される品物の画像を含む印刷されたカタログを提供し、前記画像の複数ビット２進データはステガノグラフィック符号化され、
画像を光学的に検知して、それに対応する画像データを生成し、前記画像データからステガノグラフィック符号化されたデータを復号化し、
前記復号化されたデータを用いて業者からの品物を電子的に注文し、前記注文では前もって格納された顧客プロファイル情報が利用されることを備える電子商取引方法。
【０６１３】
Ｇ６． 前記顧客プロファイル情報には衣料品サイズデータが含まれる、請求項Ｇ５の方法。
【０６１４】
Ｇ７． 遠隔の業者のコンピュータに送るために、復号化されたデータを処理し、前記処理には、前記顧客に対応する補足データで復号化されたデータを補うことが含まれ、
処理されたデータを前記遠隔の業者のコンピュータに送り、
処理され送られたデータに応答して、前記遠隔の業者のコンピュータから第１の注文データを受け取り、
前記第１の注文データを顧客に与え、
ユーザからさらに別の入力情報を受け取って、前記第１の注文データに含まれるオプションから選択し、
前記さらに別の入力情報を遠隔の業者のコンピュータに送ることをさらに備える、請求項Ｇ５の方法。
【０６１５】
Ｇ８． 前記補足データには顧客プロファイル情報が含まれる、請求項Ｇ７の方法。
【０６１６】
Ｇ９． 前記補足データには顧客識別データが含まれる、請求項Ｇ７の方法。
【０６１７】
Ｇ１０． バッジと、
前記バッジ上の写真を備え、
前記写真は、その中に隠された複数ビット補助データを備え、前記補助データは前記バッジの認可された使者に対応し、
前記バッジはさらに別の使者識別情報をさらに備え、前記さらに別の情報は機械によって検出可能である、アクセス制御デバイス。
【０６１８】
Ｇ１１． 前記バッジを用いて構成されたＲＦプロキシミティ回路によって、前記さらに別の情報は符号化される、請求項Ｇ１０のデバイス。
【０６１９】
Ｇ１２． 前記さらに別の情報は、前記バッジにバーコード形式で符号化される、請求項Ｇ１０のデバイス。
【０６２０】
Ｇ１３． 前記さらに別の情報は、前記バッジ上の磁気ストライプ形式で符号化される、請求項Ｇ１０のデバイス。
【０６２１】
Ｇ１４． 確実な不動産をアクセスする方法であって、
バッジをセンサステーションに与え、
前記バッジ上の写真に対応する光データを生成し、
前記光データを処理して、符号化された複数ビット補助データを抽出し、
前記写真で符号化されなかったデータから前記バッジのＩＤを機械的に検知し、
機械的に検知されたＩＤと前記写真から抽出された補助データ間の通信をチェックして、確実な不動産に対するアクセスが認証されるかどうかを決定することを備える方法。
【０６２２】
Ｉ１． 光入力デバイスと、
画像内で符号化されたデジタルデータに対応する顧客のアプリケーションと、
前記デジタルデータの少なくとも一部に対応するルータを備える、画像ベースのナビゲーションシステム。
【０６２３】
Ｉ２． カメラベースのインターネットナビゲーションシステムのオペレーションにユーザを精通させるためにカメラ装備のコンピュータシステムをユーザのトレーニング業務に従事させるインストラクションを備える、コンピュータ記憶媒体。
【０６２４】
Ｉ３． インターネットナビゲーションデバイスであって、画像が印刷された基板と、それを用いて符号化された第１と第２のデータを備える画像を備え、第１のデータはオーナコードを備え、第２のデータはルータコードを備え、カメラ装備のコンピュータシステムをインターネットアドレスにリンクする際に役立つデバイス。
【０６２５】
Ｉ４． 前記画像の前記オーナコードとルータコードはステガノグラフィック符号化される、請求項Ｉ３のデバイス。
【０６２６】
Ｉ６． ユーザが遠隔のコンピュータにリンクすることを可能にする、画像ベースのネットワークナビゲーション方法であって、
印刷画像から符号化されたデータを検出し、
前記符号化されたデータに基づいてネットワークを介して遠隔のコンピュータにリンクを張り、前記遠隔のコンピュータに前記画像の識別情報を提供することを備える方法。
【０６２７】
Ｉ７． 遠隔のルータと通信する顧客アプリケーションを備えるインターネットナビゲーションシステムで、
顧客アプリケーションからルータに第１のデータを提供し、
前記ルータから前記顧客アプリケーションに複数のデータを提供し、
前記顧客アプリケーションでは、前記複数のデータに対応するメニューを提供し、
前記複数のデータの１つに対応するユーザ入力情報を受け入れることを備える方法。
【０６２８】
Ｉ８． 光入力デバイスから提供された画像データから第１のデータを獲得することを含む、請求項Ｉ７の方法。
【０６２９】
Ｉ９． 受け入れられたユーザ入力情報に対応するウェブページに顧客アプリケーションをリンクすることを含む、請求項Ｉ８の方法。
【０６３０】
Ｉ１０． リンクされたウェブページが表示されるのを待っているときに、顧客アプリケーションでローカルに記憶されたブランド品表示をユーザに提供することを含む請求項Ｉ９の方法。
【０６３１】
Ｉｌｌ． ルーティングコードを受け入れてそれに対応するＵＲＬを用いて応答し、少なくとも１つのルーティングコードが複数のＵＲＬに対応し、その各々はＵＲＬがいつ使われるかの詳細な時間情報を含むことを特徴とするルータ。
【０６３２】
Ｊ２． 複数のデータフィールドを含むデータベースレコードを生成し、
前記データベースレコードに対応し、前記フィールドの少なくとも幾つかからのデータを含むファイルを生成し、
複数の受取人の各人に前記ファイルのコピーを電子的に送り、
前記受取人のうちの一人がデータを前記ファイルのコピーに加えたり、前記ファイルのコピーの中のデータを変更したりして、前記ファイルを前記データベースに送り、
前記変更されたファイルに基づいて前記データベースレコードを更新し、
更新されたデータベースレコードに対応する新しいファイルを生成し、前記フィールドの少なくとも幾つかからのデータを含み、
前記複数の受取人の各人に新しいファイルのコピーを電子的に送ることを備える、データベースの方法。
【０６３３】
Ｊ３． 物理オブジェクトやデジタルオブジェクトから対応するデジタルリソースへリンクを張るシステムであって、
オブジェクトの識別情報とオーナ情報を含むそのオブジェクトに関連するデータを受け取って、データベース内のそれと、対応する応答に関連するデータを関連づける登録手段と、
入力オブジェクトからデータを検知して、それを処理して、それをルーティング手段に転送する開始デバイス手段と、
前記開始デバイス手段で処理されたデータを処理し、その情報を記録し、前記処理されたデータのうちの少なくとも幾つかを製品ハンドラ手段に転送するルーティング手段と、
前記ルーティング手段によって提供された情報に基づいて、前記開始デバイス手段に応答する製品ハンドラ手段を備えるシステム。
【０６３４】
Ｊ４． ルーティング手段にはデータベースの情報をチェックする手段が含まれる、請求項Ｊ３のシステム。
【０６３５】
Ｊ５． 前記登録手段には、カプセル化ファイルを生成する手段と前記ファイルを所定の相手に送る手段が含まれる、請求項Ｊ３のシステム。
【０６３６】
Ｊ１３． 遠隔の顧客アプリケーションから送られた電子透かしデータに応答して、音声データやビデオデータの発送を開始するネットワークコンピュータシステム。
【０６３７】
Ｊ１４． 遠隔のコンピュータのソフトウエアプログラムから送られた電子透かしデータに応答して、前記遠隔のコンピュータに音声データやビデオデータの発送を開始する、請求項Ｊ１３のネットワークコンピュータシステム。
【０６３８】
Ｊ１６． 遠隔のコンピュータのソフトウエアプログラムから送られた電子透かしデータに応答して、更新されたソフトウエアの前記遠隔のコンピュータへの発送を開始する、ネットワークコンピュータシステム。
【０６３９】
Ｋ１． 動き符号化器として機能する第１と第２の間隔の２ＤセンサアレイとリニアセンサアレイとメモリとＣＰＵを含むスキャナーであって、前記ＣＰＵは、前記２Ｄセンサから与えられたスキャナーの動きデータに基づいて、撮像されたオブジェクトからリニアセンサアレイによって収集された未処理のスキャンデータを処理して最終的なスキャンデータを得るように機能し、改良点は、スキャナーに前記オブジェクトから得られたスキャンデータから機械読出し可能な識別子を識別させるソフトウエアインストラクションをメモリ内に備えることを備える。
【０６４０】
Ｋ２． 無線インターフェイスとディスプレイをさらに備え、前記ソフトウエアインストラクションによって、前記スキャナーに識別子を無線インターフェイスを介して遠隔のサーバへ送らせて、前記ディスプレイに表示するために前記無線インターフェイスを介して戻された情報を処理する、請求項Ｋ１のスキャナー。
【０６４１】
Ｋ３． 前記ソフトウエアインストラクションに基づいて、前記ＣＰＵは、スキャナーの動きを検知することに加えて特定の目的のために２Ｄセンサアレイからのデータを処理する、請求項Ｋ１のスキャナー。
【０６４２】
Ｋ４． 前記目的には、リニアセンサアレイからのデータが最終的に処理される前に、電子透かし検出プロセスを開始させることが含まれる、請求項Ｋ３のスキャナー。
【０６４３】
Ｋ５． 前記目的には、電子透かし校正信号を検知することを開始させる、請求項Ｋ４のスキャナー。
【０６４４】
Ｋ６． 前記目的には、検出可能な識別データが比較的含まれるであろう、リニアセンサアレイによって収集されたデータの位置を識別することが含まれる、請求項Ｋ３のスキャナー。
【０６４５】
Ｋ７． 前記目的はオブジェクト表面の特徴量を求めることであって、それに基づいてフィルタをスキャンデータに適用することができる、請求項Ｋ３のスキャナー。
【０６４６】
Ｋ８． 前記目的は、前記スキャナーの様々な位置から前記オブジェクトの相対位置をアクセスすることである、請求項Ｋ３のスキャナー。
【０６４７】
Ｋ９． 前記目的はスキャンデータのアフィン変換歪み量を求めることによって、補償することができる、請求項Ｋ３のスキャナー。
【０６４８】
Ｋ１０． 前記識別子は、電子透かしとしてステガノグラフィックに 符号化される、請求項Ｋ１のスキャナー。
【０６４９】
Ｋ１１． 前記識別子はバーコードとして符号化される、請求項Ｋｌのスキャナー。
【０６５０】
Ｋ１２． リニアセンサアレイとＣＰＵと、インターネットに接続するためのインターフェイスと、ディスプレイスクリーンとユーザ制御部を含むユーザインターフェイスを備えるスキャナーであって、スキャンされたオブジェクトから検知されたマシン読出し可能なデータをインターネットに送るように調整され、インターネットから返されたＨＴＭＬ情報をユーザに提供するスキャナー。
【０６５１】
Ｌ１． オブジェクト上の光学的に検知可能なパターンを変えることも含まれる画像ウォーターマーキング技術であって、改良点は、オブジェクトは非平面性の表面をもち、前記表面に適用された電子透かしを前もって歪ませられて、前記非平面性を前もって補償することである。
【０６５２】
Ｌ２． 前記電子透かしは前もって歪ませられる、Ｌ１の方法。
【０６５３】
Ｌ３． 前記オブジェクトは円筒状の表面をもつ、Ｌ１の方法。
【０６５４】
Ｌ４． 前記オブジェクトは消費者の製品のためのコンテナである、Ｌ３の方法。
【０６５５】
Ｌ５． 前記オブジェクトはソフトドリンク缶である、Ｌ４の方法。
【０６５６】
Ｌ６． 前記電子透かしは変換領域で前もって歪ませられている、Ｌ１の方法。
【０６５７】
Ｌ７． 前記電子透かしはウェーブレット領域で前もって歪ませられている、請求項Ｌ６の方法。
【０６５８】
Ｌ８． 前記電子透かしはＤＣＴ領域で前もって歪ませられる、請求項Ｌ６の方法。
【０６５９】
Ｌ９． 前記電子透かしは、明らかに湾曲によって誘引された幾何学的歪みを考慮して、前もって歪ませられる、請求項Ｌ１の方法。
【０６６０】
Ｌ１０． 前記表面は、明らかに湾曲によって誘引された幾何学的歪みを考慮して、前もって歪ませられる、請求項Ｌ１の方法。
【０６６１】
Ｌ１１． 前記電子透かしは、明らかに湾曲によって誘引された幾何学的歪みを香料考慮して、前もって歪ませられる、請求項Ｌ１０の方法。
【０６６２】
Ｌ１２． １フレームの画像データを分析して、符号化された電子透かしを復号化する電子透かし復号化技術であって、改良点は、前記電子透かしを復号化する前に、歪み修正機能を画像データに適用することを備えることである。
【０６６３】
Ｌ１３． 様々な歪み修正機能を画像データに成功裡に適用して、そこから有効な電子透かしデータを復号化する、請求項Ｌ１２の方法。
【０６６４】
Ｌ１４． ユーザによって提供された情報に基づいて、適用する１つ以上の歪み修正機能を選択することを含む、請求項Ｌ１２の方法。
【０６６５】
Ｌ１５． 特定のオブジェクトの形状を具体的に識別することなく、前記情報によってオブジェクトが属するオブジェクトの一般的なクラスが識別される、請求項Ｌ１４の方法。
【０６６６】
【結論】
図示した実施形態を引用して我々の技術の原理について説明し図示したが、本発明はそれに限定されないことを理解すべきである。
【０６６７】
例えば、インターネットベースのシステムを引用して実施形態の中の幾つかが示されているが、同様に、その他のコンピュータベースのシステムに同じ技術を適用することもできる。これらには、アメリカオンラインアンドコンピュサーブ（Ａｍｅｒｉｃａ Ｏｎｌｉｎｅ ａｎｄ Ｃｏｍｐｕｓｅｒｖｅ）やダイヤルアップ掲示板システム等の非インターネットベースのサービスが含まれる。同様に、インターネットベースの実施形態では、ウェブブラウザとウェブページを利用することは基本的なことではなく、その他のデジタルナビゲーションデバイスとその他のオンラインデータ保管部も同様にアクセスすることができる。
【０６６８】
同様に、実例のシステムについて特に詳述したが、その他の多数の態様でその基礎原理を用いてもよい。
【０６６９】
例えば、その他の態様では、デジタルオブジェクト識別子（ＤＯＩ）をもつ物理オブジェクトをステガノグラフィック符号化する。ザセンターフォーナショナルリサーチイニチアチブズデジタルオブジェクトアイデンティファイヤファウンデーション（Ｔｈｅ Ｃｅｎｔｅｒ ｆｏｒ Ｎａｔｉｏｎａｌ Ｒｅｓｅａｒｃｈ Ｉｎｉｔｉａｔｉｖｅｓ ａｎｄ ｔｈｅ Ｄｉｇｉｔａｌ Ｏｂｊｅｃｔ Ｉｄｅｎｔｉｆｉｅｒ Ｆｏｕｎｄａｔｉｏｎ）（ｗｗｗ．ｄｏｉ．ｏｒｇ）は、デジタルオブジェクトの配給、追跡、管理を可能とするインフラを確立する際に大きな功績を上げた。上述の教唆に基づいて新しい機能を物理オブジェクトに関連づけるために、この同じインフラと技術の一部を調整してもよい。
【０６７０】
別の形態では、オブジェクトに組み込まれたデータによって、遠隔のデータ保管部に対して参照事項を付けることはないが、その代わりに、オブジェクト上の最終データを直接符号化する。例えば、電話番号を用いて、実際に写真を符号化することができる。電話の光センサに写真を示すと、外部的なデータを必要とせずに、電話によって光情報が分析され、電話番号が抽出されて、その番号をダイヤルすることができる。同様に、対応する電子ファイルのパス名とファイル名を利用して、オフィス印刷文書（例えば、スプレッドシート）を符号化して、（例えば、ＵＩＤをコンピュータアドレスに関連づける遠隔のデータベースに対する）間接的なリンクの必要性をなくすことができる。人のビジネスカードでは、人のＥメールやウェブアドレスを直接符号化することができる。上述の実施形態のほとんどが、関連データを直接符号化するのに適している。
【０６７１】
上述のビジネスカードの例で詳述された技術は、既存の光文字認識技術を補うことができる。即ち、光センサからの画像データをベドゥープデコーダとＯＣＲシステムの両方に適用することができる。ＯＣＲシステムによって識別されるテキスト文字をコンタクトマネージャ個人のデータベースに直接入力させることができる。符号化されたオブジェクトを探し出して可視の歪み（例えば、スケールしたり回転させたりする等が原因の可視のアーチファクト）を扱うベドゥープシステムで利用される技術を、ＯＣＲでの検出にも有効に利用することができるので、カードを注意深く配置することなく、ＯＣＲ情報を抽出することができる。
【０６７２】
上述の実施形態の幾つかはインクジェット印刷に言及したが、その他の印刷技術、例えば、レーザ／ゼログラフィ印刷やオフセット印刷等を利用してもしばしば同様のメリットがある。
【０６７３】
一般的に、物理オブジェクトから得られた画像データから、上述の実施形態のベドゥープ復号化が始まる。しかしながら、特定の状況では、例えば、インターネットから電子的に提供された画像データをベドゥープ復号化することはメリットがある。
【０６７４】
同様に、前述の実施形態は、一般的に、期待地点でオブジェクトを求めて凝視するベドゥープ画像センサに頼っていたが、別の実施形態のセンサは、（エレベータの例に関して上述したように）凝視ではなく探索することができた。
【０６７５】
同様に、示された実施形態では、一般的に、複数フレームの画像データを繰返し獲得するセンサを利用したが、これが本当に必要なわけではない。ＴＷＡＩＮインターフェイスを用いて、もしくは、用いないで、フラットベッド型スキャナー等の単一フレームシステム、あるいは、単一フレームを獲得するように構成されたビデオシステムを用いることができる。
【０６７６】
上述したように、好適な実施形態では、デジタルデータをステガノグラフィック符号化処理を使って、美的な観点について許されれば、バーコード等の可視形態のデジタル符号を使えることは勿論である。
【０６７７】
実施形態の幾つかでは、光以外の手段によって送られるデジタルデータを用いることができる。（例えば、プロキシミティベースのカードアクセスシステムで使われる種類の）電磁気的検出部を構成して、デジタルデータを復号化することで、ちょうど上述の実施形態のように物理オブジェクトからデータを離れた位置から読むことができる。
【０６７８】
一般的に、ベドゥープ画像センサは複数フレームのデータを獲得するので、デジタルデータの抽出は１枚以上の画像フレームに基づいて行われる。この結果に信頼をおけば、複数フレームで復号化されたデータを蓄積することが可能になる。さらに、センサの視野内にあるオブジェクトの動きは、システムがその他の観点から情報を獲得する等を可能にするので、システムのオペレーションを改良することができる。
【０６７９】
好適な実施形態では２Ｄ画像センサ（例えば、ＣＣＤ）を利用するが、その代わりに、その他の光検出技術を利用してもよい。例えば、スーパーマーケットのレーザスキャナーは、バーコードデータを読むことができる。このようなシステムのレーザスキャンによって、（ビットマップ形式か、グレイスケールのいずれか一方の）２Ｄデータを獲得することが可能になる。
【０６８０】
幾つかの実施形態では、テクスチャベースのベドゥープ符号化をオブジェクトに施すことにメリットがある。ベドゥープテクスチャリングは、様々な手段から影響を受ける可能性がある。これには、プレッシャーローラーや化学エッチングやレーザエッチング等が含まれる。
【０６８１】
電子透かしによってトリガされる応答が時間で変化することがあることを注意されたい。このことによって、符号化されたオブジェクトの有効寿命が延びる。例えば、新モデル年の自動車のマーケティングを開始するときに、１９９９年フォードイクスプローラ（Ｆｏｒｄ Ｅｘｐｌｏｒｅｒ）に関するフォード（Ｆｏｒｄ）ＵＲＬをポイントする１９９９年版フォードイクスプローラ（Ｆｏｒｄ Ｅｘｐｌｏｒｅｒ）のために雑誌の広告内で符号化されたリンクを、２０００年モデル版のためのＵＲＬをポイントするように更新することができる。
【０６８２】
勿論、その他の実施形態では、ＵＲＬという文字を符号化することができ、また、それを使って、ブラウザやその他の情報器具をそのアドレスに割り当てることができる。さらに、ＵＲＬという文字を符号化することができるが、必ずしもそれを使う必要はない。その代わりに、データベースによって、符号化されたＵＲＬを実際のＵＲＬ（即ち、ブラウザに割り当てられたか、さもなくば、メディアブリッジ（ＭｅｄｉａＢｒｉｄｇｅ）オブジェクトに対する応答が入力されたＵＲＬ）にマップすることができる。このような一実施形態のＵＲＬは、将来の日付と共にオブジェクト内に符号化される。オブジェクトを「読む」とすぐに、ローカル（顧客）コンピュータは、関連する日付をチェックする。もし、日付が認められなければ、ＵＲＬという文字が実際のＵＲＬとして使われる。もし日付が認められると、顧客コンピュータは、遠隔のデータベース（例えば、ルータで）に対するコードを参照して、実際のＵＲＬ（もし、更新が要求されなかったならば同じか、もしくは、新しくてもよい）を獲得する。次に、メディアブリッジオブジェクトに対する応答を提供する際に、実際のＵＲＬを利用する。
【０６８３】
本分野の職人にとって電子透かし符号化／復号化システムを用いることは簡単なことであるので、ここでは過度に説明しない。従来、この技術は、長期記憶（例えば、ディスクやＲＯＭ等）に格納された適切なソフトウェアによって実施され、関連のＣＰＵ上で実行するために、一時記憶（例えば、ＲＡＭ）に転送される。その他の実施形態では、その機能は、専用ハードウェアによってか、ハードウェアとソフトウエアの組み合わせによって達成される。特定の実施形態では、ＦＰＧＡを含む再プログラマブル論理を有効に使うことができる。
【０６８４】
一般的に、上述の実施形態では平面的なオブジェクトを使って、デジタル符号を送ったが、これが本当に必要なわけではない。同様に、その他の形状のオブジェクトも使うことができる。一部の形状には比較的簡単な画像処理タスクを必要とするものもある。上述したように、既知の幾何学変換を用いて、ソフトドリンク缶のデータ画像、即ち、その他の円筒状の表面を再マップ化して、缶から印刷を基本的に「解く」ことができる。その他の幾何学様式では、より複雑な再マッピングが必要となるが、これは、職人の能力でも一般的には同じである。（データ内にサブリミナルの網目印等の特定の参照マーキングを符号化することによって、このような再マッピングが容易になる。撮像される未知のオブジェクトの３Ｄ形状は、通常、スキャナーによって生成された２Ｄ画像データ内の参照マーキングの明らかな歪みから推定可能である。一旦歪みが特徴づけられると、一般的に、歪みをなくして、復号化用の画像データを生成することは簡単である。）
【０６８５】
紙の文書が電子的媒体に取って換わるであろうと予測することは、かつては一般的であった。あと知恵で電子媒体が紙に対する貧弱な代替物であると見なされる可能性がある。電子媒体は、傷つけることなく情報を送るが、経験上の特質を欠いている。我々は、紙を持ったり、それを積み重ねたり、それを所有したり、それを与えたり、それを保護したりする。それは、電子媒体には全く欠けている物理的な所有の機会を提供するものである。
【０６８６】
上述の議論から、紙を電子媒体に置き換えるのではなく、恐らく、将来は、紙の物理的な経験的技術とデジタル媒体の技術的メリットを混在させたデジタル特性を紙に与えることになると考えられている。この構成によって、「コンピュータ入力周辺装置」によるのではなく、親しみ易い紙のアイテムを介してアクセス可能な非常に豊富な新機能が利用可能になる。
【０６８７】
本明細書を過度に長くすることなく包括的に開示するために、出願人は上で確認された特許とアプリケーションと出版物を援用文献とする。
【０６８８】
上述された詳細な原理が適用可能な多くの実施形態の観点で、詳細な実施形態は説明目的だけのものであって、本発明の範囲を限定するものとして捉えられるべきでないことを理解すべきである。むしろ、我々は、以下の請求項とその等価物の範囲と精神の中に我々の発明の全実施形態が包含されることを請求するものである。
【図面の簡単な説明】
【図１】 本技術を用いたシステムの実例の原理的処理要素を示す図である。
【図２】 図１の応答処理を実行するシステムの実例を示すブロック図である。
【図３】 図２のシステムで使われる発信側装置を特に詳述するブロック図である。
【図４】 図２のシステムの特定のトップレベルのデータフローを示す。
【図５】 図２のルータに関連する特定のデータフローを示す。
【図６】 図２の登録処理に関連する特定のデータフローを示す。
【図７】 図２の製品ハンドラに関連する特定のデータフローを示す。
【図８】 システムの実例での一連のスクリーンショットを示す。
【図９】 システムの実例での一連のスクリーンショットを示す。
【図１０】 システムの実例での一連のスクリーンショットを示す。
【図１１】 本技術の別の実施形態を示すブロック図である。
【図１２】 本技術の別の実施形態を示すブロック図である。
【図１３】 従来のスキャナーのブロック図である。
【図１４】 孤形のパスに添ってスキャンされるオブジェクトを示す。
【図１５】 オブジェクトの歪みがどのように検出されるかを示す。
【図１６】 特定のオブジェクトの属性を求める両眼処理の使用法を示す。
【図１７】 透かしグリッドを示す。
【図１８】 前もって歪ませられた透かしグリッドを示す。
【図１９】 前もって歪ませられた別の透かしグリッドを示す。
【符号の説明】
１２ 発信側装置
１４ ルータ／サーバ
１５ ログ
１６ 製品ハンドラ
１７ 登録データベース
１８ａ，１８ｂ，１８ｃ リソース
１９ 登録サーバ
２０ オブジェクト[0001]
[Background and Summary of the Invention]
“Vedoop” may be the sound you hear when someone randomly places a magazine ad in front of a desktop camera. Strangely, the marketing and sales website associated with the advertisement is displayed on the person's computer. Want to know more? Do you want to buy it immediately? Do you want to see the entire product lineup? Simple.
[0002]
"Vedoop" may be the sound that the same person can hear when placing a credit card in front of a desktop camera. The product shown on the web page is purchased instantly. Behind the scenes, you can start a secure purchase link and all the information you need is sent to the vendor. When the purchaser turns the credit card clockwise, the late night flight is selected.
[0003]
Hereinafter, exemplary embodiments will be described. This example is quite specific, but also mentions many applications that can be run when an input device, such as a digital camera, becomes a general-purpose user interface device with a power comparable to a mouse or keyboard. .
[0004]
In one aspect of certain embodiments, the so-scanned object or paper product includes digital information that is quickly read and performed by a properly configured device, computer, or appliance. In such an embodiment, it is assumed that the digital information is hidden in the object from an aesthetic point of view. These objects are marked in advance and proactively with digital information using various data encoding techniques such as, for example, digital watermarking.
[0005]
This aspect of the technology focuses on planar object applications where digital information is embedded in the object so that it is often not noticed, but is not intended to be so limited. An object may actually be three-dimensional and its information may be clearly visible or pre-existing (ie it may not be “proactively” incorporated, or it may be “digital” in itself. It doesn't even have to be). Various studies have been conducted to realize these modified examples. Similarly, much of the present disclosure focuses on objects with digital messages, but some aspects of the technology also apply to objects that do not have such, There are some that realize a wide range of applications by combining conventional techniques such as pattern recognition and gesture input with this technique.
[0006]
As will become apparent below, the present technology is not limited to systems that target optical inputs or encoded images. The corresponding technology can also be adopted for the encoded speech. In fact, any physical or electronic “object” can use the principles detailed herein.
[0007]
“Vedoop” may be the sound of a refrigerator. This refrigerator is equipped with a simple camera / processor unit / network connection function, and when a 10-year-old child shows an empty milk pack, it will beep at a local grocery store and the item will be added to the collection list. It is done. This sound may be heard when a person who has always been afraid of computers in the Internet cafe, suspiciously taking the first step on the World Wide Web (WWW). This sound is a sandwich at the fast food counter where a regular customer checks the last meal, hoping to hear a siren sounding a $ 500 prize for the lucky guest of the week. May be heard when showing a card.
[0008]
Thus, such aspects of the technology relate to powerful new user interfaces to computers. These new user interfaces spread into the everyday world in ways that were never possible with a mouse or keyboard. By allowing everyday object identities and their functions to be communicated to accompanying devices, not only gives the World Wide Web a whole new dimension, but also basic home and company computing. It will be able to respond to general progress.
[0009]
According to one aspect, the present invention includes a data processing method in a computer system, (a) creating an electronic version of a text-based document using an application program, and (b) printing the document on paper. The printing includes encoding a plurality of bits of auxiliary data by marking with a machine-readable indicia, and (c) in association with data identifying a location for storing an electronic version of the document, Storing multi-bit auxiliary data is provided.
[0010]
According to another aspect, the present invention includes a data processing method in a computer system, (a) showing a printed document to a light acquisition device, and (b) processing image data generated by the device. Then, the encoded multi-bit data is decoded, and (c) a software application corresponding to the print document is started based on the decoded multi-bit data, and (d) using the software application , Opening an electronic version of the document.
[0011]
According to another aspect, the invention includes a method of operating a computer including an operating system comprising a registry database, the registry database associating a particular data type with a particular corresponding software program. The method includes (a) providing one frame of image data, (b) encoding multi-bit identification data from the image data, and (c) examining a registry database to correspond to the identification data. And (d) invoking the identified software program.
[0012]
According to another aspect, the present invention includes a greeting card comprising a substrate with a visible indicia printed on the substrate, decodable by an image processing device, and the computer on a website. The greeting card is encoded using the multi-bit binary data used for assignment, and an image representation, a video representation, and an audio representation corresponding to the greeting card are provided.
[0013]
According to another aspect, the present invention includes a method for providing a customized greeting, comprising: (a) providing a greeting card having multi-bit data encoded therein; Customize the website expression corresponding to the greeting card, (c) provide the greeting card to the recipient, (d) decode the multi-bit data encoded from the greeting card, and (e) the decoded Responsive to multi-bit data, the website representation is provided to the recipient.
[0014]
According to another aspect, the present invention includes a method for printing a magazine, comprising: (a) processing an electronic representation of an advertisement with a digital watermark and encoding multi-bit data therein into steganographic; (B) printing an advertisement page based on the electronic representation to generate a steganographically encoded advertisement page; and (c) binding the page into a magazine, the multi-bit data comprising: , Functioning to identify an entry in the database, the database entry comprising an internet address of a web page associated with the advertisement stored therein.
[0015]
According to another aspect, the present invention includes (a) encoding a print advertisement to conceal multi-bit data therein, and (b) processing the print advertisement to extract multi-bit data therefrom. (C) using at least a portion of the extracted multi-bit data to allocate an Internet web browser to a website that provides consumer information related to products and services promoted and sold by the print advertisement. Promotional methods that are included.
[0016]
According to another aspect, the present invention includes a method for examining a consumer's response to a print advertisement, comprising: (a) encoding the first print advertisement using the first data; and (b) the first Encoding a second print advertisement using second data different from that of the first one, and (c) the first and second data comprise an identifier, whereby the consumer device has a web associated with the advertisement. A link to the page can be established, and (d) examining a consumer response to the advertisement by monitoring traffic links for each of the identifiers.
[0017]
According to another aspect, the present invention provides: (a) providing an object within the field of view of the optical sensor device, wherein the object is selected from a list comprising a retail product, a retail product package, or a printed advertisement; Acquiring optical data corresponding to the object; (c) decoding a plurality of bits of digital data from the optical data; (d) sending at least a portion of the decoded data to a remote computer; (e) A promotional method is included comprising determining whether to give a reward at the remote computer in response to the decrypted data being sent.
[0018]
According to another aspect, the present invention includes a method for interacting with a magazine utilizing a computer, the computer including an Internet web browser, the method comprising: (a) a peripheral device having a sensor (B) placing the peripheral device in the vicinity of the first advertisement in the magazine and assigning a first internet address to the web browser; and (c) placing the peripheral device in the magazine And in the vicinity of the second advertisement, the web browser is provided with a second internet address.
[0019]
According to another aspect, the present invention includes a computer peripheral device and a method of using the same, the peripheral device being used with the computer system having an internet browser associated with the computer system. (A) a housing adapted to fit within the user's palm and slide over the medium; (b) an optical sensor having at least one detection element to generate optical data; and (c). A lens for imaging the medium on the sensor, the method comprising: (a) sliding a peripheral device over a portion of a printed advertisement; and (b) processing the optical data and encoding it on the advertisement. (C) using the multi-bit information, the Internet browser is connected to the Internet web page associated with the advertisement. Comprising assigning a di.
[0020]
According to another aspect, the present invention provides (a) a print catalog containing images of goods sold by a merchant, wherein the images are encoded using multi-bit binary data; (b) Optically detecting the image to generate optical data corresponding to the image, (c) decoding data encoded from the optical data, and (d) from the vendor using the decoded data An electronic commerce method comprising electronically ordering the item is included. In the order, previously stored customer profile information (for example, clothing size data) is used.
[0021]
According to another aspect, the present invention comprises a radiotelephone handset including a microphone, a modulator, and an RF amplifier, the device receiving an audio signal and carrying an RF signal for carrying the modulated audio The handset demodulates a multi-bit identification data conveyed by a bar code or digital watermark on the object, an optical sensor that generates optical data, a lens that images on the sensor, and a barcode on the object. It further includes a decoder.
[0022]
According to another aspect, the invention includes an image-based network navigation method that allows a user to link to a remote computer, (a) detecting encoded data from a print object, and (b) Linking a remote computer via a network based on the encoded data, and (c) providing a user zip code to the remote computer.
[0023]
According to another aspect, the present invention (a) detects an object identifier from a first object, (b) sends the first object identifier from a first device to a second device, (c Responsively, the second device identifies address information corresponding to the first object identifier and sends it to the first device; (d) based on the address information, Starting a link from a first device; (e) the second device identifies yet another object associated with the first object; and further address information corresponding to the further object. Identifying, sending the further address information to the first device, and (f) storing the further address information in a memory of the first device. When an object included in the further identified object is detected by the first device, there is no communication delay with the second device, and corresponding address information is stored in the first device. Can be extracted from memory.
[0024]
According to another aspect, the present invention comprises a machine readable data operable to send a data packet to a remote system and a software program detector used with the machine readable data. The data packet comprises (a) an identifier of the software program and (b) at least part of the detected machine-readable data.
[0025]
According to another aspect, the present invention comprises a machine readable data operable to send a data packet to a remote system and a software program detector used with the machine readable data. The data packet includes (a) a content identifier and an environment identifier, and (b) at least a part of the detected machine-readable data.
[0026]
According to another aspect, the present invention includes a network computer system that initiates distribution of advertising data to a remote computer in response to watermark data sent from a remote computer software program.
[0027]
In the configuration described above, encoding can be performed sterographically (eg, with a digital watermark), and other machine-readable data (eg, barcodes, etc.) may be utilized. Generally, there are similar configurations that have been generally reviewed, and these can be implemented using something other than optical data or image data (for example, audio data or magnetic stripe information). is there.
[0028]
In the above description, only a few of the many new aspects of the technology detailed below are mentioned. These and other features of the present technology will be readily apparent from the following detailed description, which proceeds with reference to the accompanying drawings.
[0029]
[Detailed explanation]
Basically, the technology disclosed in detail herein can be viewed as an enhanced system that allows multiple users to interact with a computer-based device. Because these systems are inherently simple and can be applied to everyday use (eg, milk cartons), the techniques disclosed herein are advantageous for a myriad of applications.
[0030]
The subject matter detailed in this disclosure is extensive and diverse and difficult to describe in order. Since there is no other suitable configuration, this specification is divided into two main parts. In the first part, various methods, applications and systems are detailed and the diversity of the technology is clarified. The second part focuses on print-Internet applications in particular. A simple summary is shown as part III.
[0031]
As will become apparent later, many of the subject sections shown below are based on and are the basis for other sections. Because there is no other suitable theoretical explanation, the order of explanation of the sections of the first part is somewhat irregular. It should be recognized that both the general principles and specific details in each section will find the application in other sections.
[0032]
In order to summarize the situation, the specification collects a number of priority applications filed in about a year. Thus, the same concept may appear over and over, each reflecting a different concept, depending on the date and background of the first application found.
[0033]
The term “bedoop” has been replaced by the term Digimark MediaBridge in the commercialization of this technology by the applicant. In this specification, both terms are used, but refer to the same technique.
[0034]
In order to prevent this disclosure from becoming unmanageable, various permutations and combinations of features of different sections are not exhaustively detailed. The inventor aims to explicitly teach these permutations / combinations, but what is actually sought is for those who ultimately implement the system according to these teachings for the detailed combinations. ,That's what it means.
[0035]
[Part I]
[Introduction of digital watermarking and other encoding technologies]
There are almost as many techniques in digital watermarking (a type of steganographic data coding) as there are applications. The reader is assumed to be familiar with this vast variety of methods. Some examples are shown below.
[0036]
09 / 127,502, which was filed on July 31, 1998 and is now published as WO0007356, which is a prior application by the present assignee, printed fine lines on a medium, and the apparent color of the medium. It describes a technology that changes digital data and transmits digital data. Joint application 09 / 074,034, filed May 6, 1998 and now published as WO9953428, details how to adjust the contours of printed images for digital data transmission. Yes. (The technique can be applied to printed characters as well as specially thought line images.) Assignee's patent 5,850,481 conveys optically detectable binary data. For this reason, it is described in detail how to texture the surface of paper and other media. The assignee's patents 5,862,260 and 5,841,886 and 5,809,160 detail various techniques for encoding photographs and other images using steganography. .
[0037]
Some watermark techniques are based on changes in the spatial domain and others are based on changes in the transform domain (eg, DCT or weblet).
[0038]
The printed character watermark can be realized by slightly changing the character shape, kerning, line spacing, and the like. This is illustrated in various writings by Brassil et al., “Marking and Identification Techniques to Disclosure Document Copying” (INFOCOME 1994 Conference on Computers). Newsletter, IEEE Communication Society Conference, June 12-16, 1994, pp. 1278-1287), “Hiding Information in Document Images” (29th Annual on Information Science and Systems) Conference Bulletin, 1995, pages 482-489), and "Documents using both lines and words Kingu and identification (Document marking and identification using both line and word shifting) "(IEEE INFOCOM '95
, Conference on Computer Communications, Bulletin of the 14th Annual Joint Conference of IEEE Computer and Communications Society, Information Provision to People (Cat. No. 95CH35759), pages 853-860, Vol. 2, 1995) .
[0039]
What has been described above is only a part of the enormous writing about watermarks. Artisans can be considered familiar with such techniques, and in general, all such techniques are suitable for integrated use with the novel concepts detailed below.
[0040]
The following specification focuses on applications that use digital watermarks, but some of these applications can instead employ other data encoding techniques as required by specific applications. There are also things. Other data encoding techniques include 1D and 2D barcodes, magnetic ink character recognition (MICR), optical character recognition (OCR), optical mark recognition (OMR), radio frequency identification (RF / ID), UVIR identification Technology, data glyphs, organic transistors, magnetic stripes, etc. are included.
[0041]
[Basic Principle-Refrigerator and desktop clutter]
Referring to FIG. 11, a basic embodiment 110 of the present technology includes a light sensor 112, a computer 114, and a network connection 116 to the Internet 118. The illustrated optical sensor 112 is a digital camera that stares at a resolution of 320 × 200 pixels (color or black and white), captures a frame of image data five times per second, and stores it in one or more frame buffers. To do. These frames of image data are analyzed by computer 114 for the presence of bedoop data. (Vedoop data is essentially encoded multi-bit data recognized by the system 110, and in many embodiments is data that causes some action.) The system can then use the detected bedoop data (for example, launching a local action or communicating with a remote computer, for example, via the Internet, an online service such as AOL, or electronic presentation Respond using point-to-point dial-up communication (like a board system).
[0042]
For example, consider a milk pack. The artwork on the milk pack can be modified to convey bedoop data. In the preferred embodiment, the bedoop data is encoded on the milk pack using steganographic techniques (eg, digitally watermarked). Many watermarking techniques are known, but in all of them, data is transmitted in a concealed form (i.e., digitally encoded data is present even when examined by humans). I do not understand). Typical techniques are to slightly change the brightness or outline of selected points on artwork or text printed on the pack, or to disperse ink splashes on the pack in a random pattern on the appearance. Works by. Each of these techniques has the effect of changing the local brightness in the region across the pack. This change in brightness can be detected by the computer 114 and decoded to extract the encoded digital data. In the case of a milk pack, this data serves to identify the object as, for example, a half-gallon pack of skim milk with an Alpenrose mark.
[0043]
The device of FIG. 11 can be incorporated into the refrigerator door and used to edit the shopping list. A milk pack or other vedoop encoded package can be held over the light sensor. When the computer 114 detects the presence of bedoop data and decodes it, the computer emits a confirmation sound ("be-doop" sound) from a speaker or other audio transducer 112. The computer adds data identifying the object just detected to the grocery list. This list can be stored locally (disk storage or non-volatile RAM 124, or in a refrigerator or somewhere in the house) or remotely (eg, a server computer located in a user-selected grocery store). , Or other places). In either case, the list is displayed on the display screen of the user's home (for example, the LCD screen 126 built in the front of the device). Using the conventional user interface technology, the user can perform scrolling of the display list, cancellation of items, and the like as desired.
[0044]
Periodically, it is possible to purchase a grocery product listed and erase the list. In one embodiment, the user prints the list (either at home or at a store) and walks through the store aisle to buy items from the list, as is conventional. In another embodiment, the items on the list are pulled from the merchandise shelf by the store clerk (depending on the user's order via the internet, telephone, or gesture detailed below). Once all the items on the list are available, the store clerk can inform the user that they are ready to pick up (again, for example, via Internet or telephone message). Alternatively, the items can be delivered directly to the user's home. Of course, you can use an online payment system if you wish.
[0045]
Think of a Bedoop application that has nothing to do with it. Microsoft Excel (Excel) was printed on paper, but the paper was buried in a pile of things on the desk of an office worker. Dig up from the mountains. I have to make changes to my data, but I forgot the file name long ago. The clerk puts out the printed page just in front of the camera that supports the desktop computer. Immediately, an electronic version of the file is displayed on the clerk's computer screen.
[0046]
When the page was originally printed, the ink or toner splash was spread over the paper in a pattern that was subtly unnoticeable, so that a binary number of multiple bits (eg, 24 to 128 bits) The page was steganographically encoded. A database (for example, maintained by an operating system, an Excel program, a printer driver, etc.) stores a part of this number (eg, 20 bits called Universal Identifier or UID) in an electronic version of the file The file is stored in association with the path, file name, page number in the document, and other valid information (for example, file creator and creation date).
[0047]
Software applications (eg, Excel) can perform steganographic encoding of documents and database updates. Once selected by the user, this option can then be applied to all printed documents (eg, by user selection on the “Options” drop-down menu) or printed (Print ) It may be shown to the user as part of the dialog window so that it can (cannot) be selected for each print job.
[0048]
Later, when such a printed page is presented to the camera, the computer automatically detects the presence of the encoded data on the page, decodes it, and downloads the file corresponding to the 20-bit UID data. Browse the database to identify the name / location / page and open the exact page of the identified file (eg after launching Excel). This application is one of the many “paper-in” applications in the vedoop technology.
[0049]
What have been described above are two of the myriad applications of the technology detailed herein. The following discussion will disclose a great many other applications. However, regardless of the length of this specification, it is possible to begin exploring some of the wide variety derived from this technology.
[0050]
Before going into other applications, the more detailed description of the basic embodiment described above may be helpful.
[0051]
[Optics]
Any system that decodes steganographically encoded data from an object must properly focus the object's image on a digital camera CCD (or other, eg, CMOS) sensor. In a non-cost embodiment, the camera has a fixed nominal focal length in the range of, for example, 2 to 24 inches (of course, longer or shorter distances can also be used). As the camera continuously captures and analyzes frames of data, the user moves the object closer to the sensor until the decoder decodes the well-steganographically encoded data and emits a “veedoup” audio signal for confirmation. And can be released.
[0052]
In more complex embodiments, well known autofocus techniques may be employed.
[0053]
In still other embodiments, the camera (or other sensor) can be equipped with one or more auxiliary fixed focus lenses that can be selectively used according to the particular application. Some such embodiments have a first fixed focus lens that always covers the sensor, which includes one or more auxiliary lenses optically (eg, by a hinge or slide configuration). Can be connected. For example, such a configuration is desirable when the camera performs not only a dedicated bedoop sensor but also other image processing. If the camera is to be used in a vedoop, the auxiliary lens is positioned (eg, flipped) and the first (which may be set at an inappropriate distance for vedoop, eg, infinite length) Change the focal length of the lens to an appropriate Bedoupe image range (eg, 1 foot).
[0054]
Other embodiments with lens replacement do not employ a fixed lens that always covers the sensor, but instead employs two or more lenses that can be moved and placed over the sensor. By selecting various lenses, it is possible to select focal lengths such as infinite length, 6 feet, and 1 foot.
[0055]
In all such configurations, it is desirable (although not absolutely necessary) that the steganographically encoded portion of the object being imaged occupies a significant portion of the image frame. Objects come in various sizes, such as a 10x12 inch front panel of a cereal box and a 1 inch square purchase certificate. To meet this requirement, small objects must be placed closer to the camera than large ones. For example, the optical part of the system can be used to accurately capture images of objects of various sizes within the focal length by selecting appropriate aperture correction and supplemental illumination (if necessary). Can be designed.
[0056]
In some embodiments, the size and position of the object are limited, thereby avoiding the problem of identifying the focal length and the target object. One example is a business card reader, which is designed for one purpose of capturing business card images. Various devices of this type are known.
[0057]
[Decoding / Encoding]
The analysis of the image data can be realized by various known methods. At present, most steganographic decoding relies on a general purpose microprocessor programmed with a plurality of software instructions suitable for performing the necessary analysis. Other configurations are of course possible, such as the use of dedicated hardware, reprogrammable gate arrays and other technologies.
[0058]
The steganographic decoding process requires three steps. In the first step, the object is placed, and in the second step, the orientation of the object is identified. In the third step, vedoop data is extracted from the image data corresponding to the vedoop object.
[0059]
The first step of object placement can be supported by various hints. One of them is the location of the object, but usually the center of the image field is a point on the object, and the surrounding data is analyzed to try to identify the boundary of the object.
[0060]
Another placement technique is by slight movement. Typically, the user tries to make the object stationary, but generally within the image frame, some shaking occurs in the bedoop object (eg, some pixels move back and forth). In contrast, scatterers visible in the background are usually stationary. Therefore, such a movement is sensed and used to identify the vedoop object from the image data.
[0061]
Another hint for object placement is the shape of the object. Many vedoop objects are rectangular (or trapezoids when viewed with a camera). Therefore, an area of what seems to be bedoop data is defined by using a straight edge boundary line.
[0062]
Color is a further hint for object identification and is useful in some contexts.
[0063]
In addition, spatial frequency is another hint for object placement. In an image capture system with a well-defined focal range, undesirable visual clutter may be at the focal position, which may cause blurring. On the other hand, vedoop objects are in focus and are characterized by details. By analyzing the image data for high frequencies associated with details, the intended object can be distinguished from others.
[0064]
The characteristic markings on the object can be sensed and used to position the object (as described below in connection with determining the orientation of the object).
[0065]
Once a bed object is placed in the image data, it can be masked (if desired) to exclude image data that does not correspond to the intended object.
[0066]
The next step in the decoding process is the determination of the orientation of the bedoop data, but it can likewise be identified by referring to visual hints. For example, some objects include subliminal graticule data encoded steganographically with bedoop data, or other calibration data to assist in determining orientation. For other objects, use clear markings that are placed for a single purpose (eg, a baseline or origin) or serve another purpose (eg, a line of text) to identify orientation Can do. An edge detection algorithm can also be employed to infer the orientation of an object by referring to the edge of the object.
[0067]
In some embodiments, the image data is filtered at some point in the process to aid in the extraction of the final bedoop data. One application of this filtering process is to reduce the influence of image data caused by a specific optical sensor. For example, CCD arrays have regularly spaced sensors that sample optical images at discrete points that are evenly spaced. This individual sampling is effective for the transformation of the image data, but leads to an artificial influence on a certain kind of image. A properly configured filter can mitigate some of these effects.
[0068]
(Some configurations allow the orientation determination step to be omitted. For example, a business card reader does not have human artifacts and generates data of a known size. For example, currently preferred encoding schemes are based on a 2D grid with rows and columns of data points. Although it operates, the encoding can alternatively be based on another (for example, encoding is performed axially symmetrical so that the rotation state of the image data can be ignored). In this embodiment, since the decoding can be easily performed without this information, the step of determining the orientation may be omitted, for example, Fourier-Mellin transform. The decoding by the data ignoring size and rotation occurs.)
[0069]
Once the orientation of the object is identified, the image data is effectively re-registered and effectively mapped to another perspective (eg, on a straight image plane). In this mapping, a well-known image processing technique can be used to correct, for example, the rotation state, size state, state different from that, and XY offset of the original bedoop image data. The resulting frame of data is processed more quickly to extract steganographically encoded bedoop data.
[0070]
In an exemplary embodiment, after the image data is re-mapped into a linear plane, the subliminal graticule data is sensed to identify the location in the image data where the binary data was encoded. . For example, it is preferable to encode the binary data redundantly for each 8 × 8 patch block. Each patch is made up of one or more pixels. (Patches are usually square and therefore contain pixels such as 1, 4, 9, 16, etc.) Slightly increase or decrease the nominal brightness of each patch before encoding (eg, artwork on the object from the front) Then, binary “1” or “0” is encoded. Since the change is slight, it is generally not perceived by humans, but can be detected from the image data statistically, especially when several blocks are available for analysis. Preferably, the degree of change is matched to the characteristics of the underlying image, and relatively large changes are made in areas where the human eye is not likely to notice them. Each block encoded in this way has multiple bits (for example,
16 to 128 bits) of data can be transmitted. By encoding these blocks, which are tiled across the object, data can be transmitted robustly.
[0071]
Needless to say, the Bedoop sensor has been staring for many hours and capturing image frames without Bedoop data. It is desirable to include one or more check functions in the detection process to prevent false identification of bedoop data from non-bedoop image data. Various techniques can be employed for verifying the decrypted data. For example, an error detection code can be included in a bedoop payload and a check can be made to see if it corresponds to another bedoop payload. Similarly, the system can confirm that the same bedoop data is also present in another tiled excerpt.
[0072]
Details of specific encoding and decoding techniques are described in US Pat. No. 5,862,260 and US application 09 / 503,881. As described above, data can be encoded in a tile shape, and each tile is composed of 64 to 256 elements on one side. Individual elements can be 0.01 inches square. In order to fill the tiled blocks, the vedoop payload data can be represented redundantly by various error-resistant coding techniques (eg, convolution coding, trellis coding, turbo coding, etc.). Each bit is encoded in such a manner as described above. At this time, “1” indicates an increase in a certain pixel and decreases in another pixel. The increase or decrease can be measured according to the visual masking attribute of the image to be encoded. The calibration signal is combined with the tiled data signal, and a signal adjusted to have 12 to 64 spectral impulses per quadrant in the frequency domain can be configured in a known pattern. During detection, rotation and scaling of these impulses from known frequency domain coordinates allows rotation and scaling of the recognized and corrected image.
[0073]
[Data structure, format, protocol, structure infrastructure]
In a typical system, the payload of the bed data is 64 bits. This payload is divided into three fields: CLASS (12 bits), DNS (24 bits), and UID (24 bits). (Other payload lengths, fields, and divisions are of course possible, for example, error check bits and error correction bits can be provided.)
[0074]
In summary, the CLASS ID is the most basic part of the vedoop data, and the number of top-level domains with a limited number in the well-known Internet field (eg, .com, .net, .org, .org). mi, .edu, .jp, .de, .uk, etc.). This is basically an indicator of the object type. The DNS ID is an intermediate level of data and is similar to an Internet server address (for example, biz.yahoo or interactive.wsj). The UID is the finest level of granularity, and is roughly similar to an Internet page on a specific server (for example, edition / current / summaries / front.htm, daily / home / default.hts, etc.).
[0075]
In general, the CLASS ID and DNS ID collectively indicate to the system what kind of bed data exists on the object. In the case of a vedoop system that relies on a remote server, the CLASS and DNS IDs are used to identify the server computer that responds to the vedoop data. The UID determines exactly what response should be made.
[0076]
In the case of a refrigerator bedoop system, what happens if you encounter an object with unfamiliar CLASS / DNS ID data? You can program the system to not respond to anything, or respond with a roaring sound (or other feedback) indicating that I can see the Vedoop object but don't know what to do You can also program the system to do so.
[0077]
Most systems will be able to respond to several classes of bedoop objects. In a simple system based on software, CLASS / DNS ID (optionally UID) can be compared with a fixed value and execution of the program can be branched into the corresponding subroutine. Similarly, in a hardware based system, different circuits can be activated according to the detected CLASS / DNS ID.
[0078]
For computers with Bedoop input devices (for example, a Sony laptop VAIO picture book with a built-in camera or a desktop computer with a connected camera), the operating system registry database can be used to Application programs can be associated with various CLASS / DNS IDs (for example, file extensions such as .XLS and .DOC usually correspond to registries of current operating systems, respectively, and Microsoft Excel and Word software applications respectively. Start). When a new Bedoop application is installed, it records an entry in the registry database that indicates the CLASS / DNS ID that it intends to handle. Thereafter, when an object with such a CLASS / DNS ID is found, the operating system automatically launches the corresponding application and provides its bed data in an appropriate manner.
[0079]
From time to time, the computer system may encounter a bedoop object that does not have a registered application program, in which case it can launch a defaulted bedoop application. This default application, for example, builds an Internet link (or network of such computers) to a remote server computer and sends vedoop data (or a portion of vedoop data) to that remote computer. Can do. In the remote server, a response itself can be performed, a correct response method can be instructed to the originating computer, or a combination of the two can be performed. (These configurations are considered below.)
[0080]
FIG. 12 shows an example of a structure employing the above configuration.
[0081]
In the local bed system 128 (which can be implemented using, for example, a conventional personal computer 129), the camera, scanner, or other optical sensor 130 can process the image data as a decoder 132 (which can be implemented as a software component of the operating system 133). Send to. The decoder 132 analyzes the image data and identifies multiple bits of bedoop data. The CLASS ID of the vedoop data is provided to the vedoop registry 134. The registry responds by identifying and launching a local bedoop application 136 that is configured to provide the identified bedup data.
[0082]
The system 128 may sometimes encounter a bedoop object that can apply several different responses. For example, in the case of a printed company document, one response is to present an editable electronic file to the computer, for example as described above. However, as another response, it may be desirable, for example, to write an email message to the author of the printed document with the author's email address already specified in the message address field.
[0083]
Such different responses can be handled by different bedoop applications, but both may be options provided by a single bedoop application. In the former case, when the CLASS / DNS ID is decrypted and provided to the operating system, the registry indicates that two (or more) programs may be launched. The operating system then displays a dialog box to the user so that the user can specify which form of response he wants. As an option, if the user does not specify within a short set time (for example, 3 seconds), a default selection can be made. The operating system can then launch a bedoop application corresponding to the selected response.
[0084]
A similar configuration can be employed when both responses can be provided by a single bedoop application. In this case, the operating system launches the single bedoop application (since there is no ambiguity to resolve) and presents the selection to the user via that application. Again, the user can make a selection or automatically perform a default selection.
[0085]
In the situation just described, the user can select using a keyboard or mouse, just as in a conventional dialog box. However, Vedoop usually provides another way of interaction that is even easier. The user can make a selection using the optical sensor input. For example, if the object is moved to the right, the UI button on the right side of the dialog box can be selected. If you move the object to the left, you can select the UI button on the left side of the dialog box. When the object is brought closer to the camera, the selected button can be activated. Many other techniques are possible, as described below.
[0086]
If the registry 134 does not recognize, or if it does not know how to respond to specific CLASS / DNS vedoop data, the registry launches a default vedoop client application. This client application in turn instructs the web browser 40 on the local bed system 128 to communicate with the remote master registration server computer 42. The local computer transfers bedoop data to this master server. The master server 42 examines the CLASS ID and transfers the vedoop data to the corresponding CLASS server 44 (directly or via a relay server). (A single server may handle several classes of vedup data, but more generally there is a dedicated server for each CLASS.)
[0087]
Each CLASS server 44 functions as the root of a distributed DNS server tree 46. For example, in the first layer 50 of the DNS server tree, the DNS server 48a handles bedoop data having a DNS ID starting with “000”. Similarly, the DNS server 48b can handle bedoop data having a DNS ID starting with “001” or the like.
[0088]
Each DNS server in the first tier 50, in turn, routes the vedoop data to one of the eight servers in the second tier of the tree according to the fourth to sixth bits of the DNS data. The tree thus continues to the final level of the DNS leaf node server 56.
[0089]
The vedoop data routed to this network eventually reaches the DNS leaf node server 56. The leaf node server 56 may handle vedoop data, but may also reroute the local vedoop system to a further server 58 that performs such operations. The final server, whether it is a DNS leaf node server or a subsequent server, can query the local bed system for more detailed information if necessary. Then, the response method can be instructed to the local bed system, or a part or all of the response itself can be performed, and appropriate data can be simply sent back to the local bed system.
[0090]
In a configuration where the local vedoop system is re-routed by the DNS leaf node server so that the earlier server actually handles the response, port 59 (eg, a special URL) tuned to receive vedoop data. It is also possible to access to the server beyond that.
[0091]
In a typical embodiment, most or all servers have the same data written or duplicated / duplicated so that individual computer failures will not affect system operation. It has become.
[0092]
To speed up the response, a cache is used throughout the server tree. That is, the response by the leaf node to the CLASS / DNS ID that is surely met frequently can be temporarily stored in the tree in advance. When there is a hit cache, bedoop data is propagated through the server network, and a response from an intermediate server can be prompted.
[0093]
If required, demographic and statistical information can be gathered, such as which systems are sending what kind of vedup data, by monitoring the vedoop traffic through the aforementioned server tree. Examples of how to use such information include dynamically reconfiguring a DNS network and effectively relocating DNS resources near a frequently used area in order to improve server load balance. . Another way of using such information is for marketing purposes. For example, such information is promoted in a user group (for example, an Internet domain) who does not use a certain function or application.
[0094]
For example, inside a certain user network linked to the Internet such as a corporate network, vedoop data not handled by the originating vedoop system is first sent to a vedoop name server in the corporate network. The server recognizes certain types of bed data and knows about resources in the corporate network that are suitable for handling it. If possible, a query within the corporate network is made for such resources. These resources (eg, corporate servers) respond to vedoop data in a manner customized to company preferences. If the corporate name server does not know the resources in the corporate network that can respond to the vedoop data, the corporate name server sends the data to the public vedoop network described above. (Such references can be made to the master registration server, to the limit that the company name server knows the address of the appropriate server in the DNS server tree, or to certain bedoop data. To the limit of knowing the address of the further server indicated by the DNS server, and the local vedoop system can be redirected accordingly.)
[0095]
In a typical rich bedoop example, a local system can have a library of bedoop provisions and applications and protocols. Some of them are unique to the computer. Others can be used in common on all computers. Some are also highly protected and can use encryption and / or anti-hacking measures, or generally unrecognized data protocols. Others may be the result of shareware or open source programming.
[0096]
In the configuration just described, the 12/24/24 bit protocol is used for CLASS / DNS / UID data, but other configurations are of course possible. For some applications, it is advantageous for the protocol to closely match the protocol commonly used in Internet communications. For example, the IP address for the Internet domain name server (DNS) is currently 32 bits, but is expected to be expanded to 64 or 128 bits in the near future. The DNS field of the Bedoop system can follow Internet standards.
[0097]
[Greeting cards, birthday cards, etc.]
To further illustrate some of the basic principles of this technology, consider, for example, greeting cards and the like encoded using, for example, bedoop data (eg, by texture or printing). Upon receipt of such a card, the recipient holds it over an image capture device on a laptop or other computer. In response, the computer displays an Internet home page that includes an inventory presentation or a customized presentation (image, video, video / audio, etc.) to complement what is shown in the greeting.
[0098]
At the point of sale of the card or at some point after the card purchase, the sender can make the display of the website unique (eg, in a message text, recent family photo, etc.). For example, after purchasing a card, a serial number can be attached to the card. The buyer takes the card home, opens the card vendor's home page, and enters the card's serial number with the appropriate user interface. Therefore, the purchaser is presented with various simple editing tools for smoothly customizing the web greeting. When the sender finishes designing the web greeting, the completed home page data is stored (by software on the vendor's website) at the site corresponding to the serial number.
[0099]
When the card reaches the recipient and the recipient holds it in front of the bedoop sensor, the CLASS, DNS, and UID data is decrypted from the card. CLASS and DNS data are used to navigate the server network described above (possibly maintained by the Hallmark greeting card company) so that it can reach the corresponding DNS leaf node server. The leaf node server heads a table, database, or other data structure with a UID from Bedoop data, and from that data structure, the final website address, that is, the web greeting customized by the sender, is obtained. Get the same address that is stored. This address is returned to the local computer by the DNS leaf node server, along with instructions to load and display the home page for that address (eg, by HTML redirection). The local computer responds by presenting the customized web greeting to the recipient.
[0100]
In the embodiment just described, the sender purchases a pre-encoded card, customizes the web display, and the website address is typically determined by the card vendor. But it doesn't always have to be. Similarly, it is not necessary to “purchase” the card in a general card shop system.
[0101]
To illustrate the other options described above, consider, for example, online capture of a greeting card by accessing a website dedicated to greeting cards. With appropriate user selection (and optional customization), the desired card can be printed using an inkjet or other printer at the sender's home. In this case as well, the card bedoop data can be customized. Instead of navigating to a site determined by the card vendor, the data can lead to the sender's personal home page or another arbitrary web address.
[0102]
In order to enable such a configuration, the sender needs to be prepared to respond to a specific set of bedoop data by the DNS leaf node server specifying the desired home page. Typically, DNS servers are not privately owned but are shared by Internet service providers. Just as AOL provides a simple tool that allows subscribers to manage their subscriber's own discreet homepage, the Internet service provider provides a simple tool that allows subscribers to use DNS leaf node servers. Can be utilized. Each subscriber is assigned up to 20 UIDs. With these tools, the user can define a web address corresponding to each UID. Each time a Bedoop application is directed to its DNS leaf node server and one of those UIDs is presented, the server loads and displays the home page at the corresponding web address for the originating computer. To instruct.
[0103]
Prior to customizing the greeting, the sender uses a tool provided by the Internet service provider to save the desired destination web address corresponding to one of the sender's valid UIDs. When customizing a greeting card, the sender specifies the vedoop data to be encoded, including the UID just referenced. The greeting application encodes this data into artwork and prints the resulting card. Thereafter, when the recipient presents the card to the bedoop system, the recipient's system loads and displays the home page specified by the sender.
[0104]
[Trade in Vedoop Resources]
In the arrangement just described, each subscriber can use a limited number of UIDs on the DNS server maintained by the service provider. A company typically requires more vedoop resources, such as its own DNS ID (or its own CLASS ID).
[0105]
In essence, even though a Bedoop system variant can be extended to provide an unlimited number of CLASS IDs and DNS IDs, these resources are limited in the illustrated system. Public services, non-profit and academic applications should be able to provide relatively generous access to vedoop resources for free or for a nominal fee. Conversely, companies are expected to pay a fee to mitigate the company's potentially endless demand for this resource. A small business can also lease a pair of UIDs under a given CLASS / DNS ID. Large companies can acquire all DNS ID and all CLASS ID rights (for a reasonable amount).
[0106]
Web-based systems for assigning DNS IDs (and CLASS IDs) may be modeled on systems that are used well by Internet.com, now also Networkssolutions.com, to register Internet domains. it can. The user writes the name, address and payment information in a web-based form. The system makes necessary changes to all of the concealed system infrastructure (infrastructure), for example, updates of databases and routing tables, etc. with servers all over the world.
[0107]
[Controlled access ID]
The same principle can be applied to access management objects such as photographic IDs as well, as in the embodiment described above that uses an inkjet printer to create a customized bed greeting card.
[0108]
Think about a job seeker trying to get an interview with a new employer. The job seeker is scheduled to visit, but the building guards are not acquainted with her. In such an application, or in many other applications, the following configuration can be used.
[0109]
The employer sends the access code to the job seeker by email or other means. (The code is encoded for transmission.) The code is valid only for a certain time period on the specified date (eg, June 28, 1999, 9 am to 11 am). .
[0110]
When the job seeker receives the access code, it downloads the latest copy of her driver's license photo from the state's driver's license testing laboratory website. The driver's license laboratory has already encoded this photo with vedoop data. This data is sent to the state-owned DNS leaf node server 56. When the server shows the UID decrypted from the picture, the server accesses the database and returns a character string indicating the name of the person shown in the picture to the inquiring computer.
[0111]
Job seekers incorporate this photo into the access badge. By using a software application (eg, supplied for the purpose of becoming part of packaged software that increases productivity in the office, such as Microsoft Office, for example), the photo is a template for an access badge. Be drawn into. An access code sent by email from the employer is also provided to the application. When “Print” is selected, the inkjet printer connected to the job seeker's computer is steganographically encoded with her photo of the driver's license laboratory and her name, and based on the access code given by the employer Print the access badge.
[0112]
In response to the vedoop data extracted from the photo, the name printed on the badge is retrieved (by the job seeker's computer) from the DNS server of the driver's license laboratory. (This application, unlike others, does not scan a photo as part of the beedop process. Instead, the photo is already available in digital form. Therefore, beedop decoding can be done directly from the digital representation. , Done.)
[0113]
For security reasons, standard vedoop technology is not used for embedding access codes. Instead, a non-standard format (generally a steganographic format) is employed. This access code can be incorporated over the entire surface of the card or limited to a certain area (for example, excluding a portion occupied by a photograph).
[0114]
When a job applicant appears in the employer's building on the date of the appointment, and the job applicant presents a badge on the light sensor device at an external door lock, the device reads the access code for the built building, and the badge Appraisal of authenticity. If the job seeker arrives within the permitted time, the door is unlocked.
[0115]
Job seekers in the building may meet security guards. The security guard looks at an unfamiliar person and compares the badge photo with her face. In addition, the security guard can present the batch to a portable bed equipment or one of a number of bedoop systems widely scattered throughout the building (eg, each phone). The vedoop system extracts the vedoop data from the card (ie, from the photo of the driver's license lab), queries the driver's license lab's DNS server for this vedoop data, and responds with a photo. Receive the name of the person (If the Bedoop system is a phone, its name is displayed on a small LCD screen typically attached to the phone.)
[0116]
The guard checks the name returned from the Bedoop system and the name printed on the badge. When it is found that the printed name and the vedoop-decoded name match (and optionally check the entrance record to see if a person with this name has entered the venue) The security guard can pass the job applicant first.
[0117]
It will be appreciated that the configuration just described provides a fairly high level of security. Furthermore, to achieve this security, job seekers do not need to visit the employer in advance, the employer does not need to know the job applicant's appearance, and an access badge created by the job seeker himself is used. It can be done by using it.
[0118]
A myriad of applications can be found from variations of embodiments of such badges printed at home. Think about buying tickets for movies and events over the web. The user can print the access ticket in which the entry code is embedded. When arriving at a movie theater or event venue and presenting a ticket to the optical scanning device, the device decrypts the entry code, verifies its validity, and permits entry. Then, the entry code is marked as used (to prevent a ticket printed with the same code from being used multiple times).
[0119]
[Other controlled access IDs]
By using this technology, various access management systems can be realized. The foregoing is merely an example.
[0120]
Other applications utilize ID cards, bedoop technology, and proximity detection technology (commonly known as RFID).
[0121]
As an ID card, a steganographically encoded badge with a photograph of the owner can be used. Further, the card incorporates a proximity ID device such as an electronic circuit with low power consumption. The circuit is triggered and detected by a radiation field from a connected proximity detector and produces a unique signature signal that identifies a particular individual.
[0122]
An image sensor (such as a video camera), a connected bedoop detection system, and a proximity detector can be installed in the building. As the user wearing the badge approaches, the proximity detector signals the camera to capture image data. Vedoop detection system recognizes the photo of the badge, captures the optical data, decodes the optical data, and hides it (eg, with hints from previous applications or without such assistance) Extract data embedded with steganographic technology. Therefore, the access management system checks whether the badge ID identified by the proximity sensor correctly corresponds to the bedoop data extracted from the badge photograph. If it corresponds correctly, access is granted, otherwise the data is recorded and a warning tone is sounded.
[0123]
Such a configuration improves security on the premises. It is no longer possible to modify a proximity-based access badge to replace someone else's photo. If the photo is switched, the proximity system ID and the embedded photo data do not match, and a warning is given that unauthorized access is being attempted.
[0124]
In addition, the same principle can be applied in many situations, not limited to the proximity detection system based on RF. For example, data decrypted from a photo can be compared to other forms of machine-sensing personal identification associated with the badge. These formats include, but are not limited to, barcode IDs, magnetic stripe ID cards, smart cards, and the like. Or it can be compared to recognition criteria that are unrelated to the badge (eg, retinal scan, voiceprint, or other biometric data).
[0125]
[Inkjet printing]
In the above description, reference has been made to the use of ink jet printing as a means of applying a steganographic encoded indicia to a substrate. In the following, the operating principle will be described in more detail.
[0126]
The basic physics of ink jet printers (also known as bubble jet printers), as well as a much lower level of analog electronic operation, is best suited to support slight tint watermarks on any substrate. (Watermarks that clearly color the background are described in published specification WO0007356, corresponding to US patent application 09 / 127,502.) In general, “if it can be printed with an inkjet printer The description “watermarks are possible” is generally accurate, even if it is just a written document (perhaps especially for such a document). There is some flexibility and control in the field of inkjet printing, which is generally not possible with conventional printing technologies such as commercial offset printing and other plate-based technologies. (It goes without saying that inkjet printing is of a higher quality than printing based on a printing plate, more than anything else, it has a lot to do with ink splash statistics.) It is also possible to have a dark background. It looks like a “white paper” for ordinary viewers, a very light background tint, an overall darkly inked background, the photo itself, and everything in between, It changes continuously.
[0127]
In some embodiments, the ink jet driver software has been modified to manage the release of each splash at a lower level than existing printer drivers, which are natural for text and graphics. Optimized. Some such embodiments include a “watermark” print mode as another option that the user can select (eg, in addition to High Quality, Econo-Fast, etc.) Some application software performs the selection automatically by printing.
[0128]
In a more complex embodiment, watermark data is used in the printer driver software independently of other image / character data. The printer driver is set to splash image / character data at a normal print density, but for more precise management, a finer density is used for separately used watermark data. To do. (The latter is achieved with a slight modulation signal relative to the former.) This arrangement provides essentially transparent integration with the existing printer environment. No one needs to worry about the performance of the watermark except for software applications that specifically use it.
[0129]
[Consumer marking of web-based materials]
Various types of print media come from the web and can be printed at home. Examples include movie tickets, coupons, car brochures and the like. Further, at the time of printing, it is possible to add or change vedoop data using a software application or a printer driver. (Alternatively, before downloading the data to the user system for printing, the data can be customized for the user.)
[0130]
One advantage of using a local dope encoding of a print image over a dope encoding of an image file before downloading for local printing is that the encoding is tailored to the unique characteristics of the local printer. (E.g., can improve robustness or reduce visibility), which is a property that is not generally known to remote servers.
[0131]
In one particular example, a value that serves as an index into the user profile database can be written to the UID field in the bedoop data, resulting in the provision of a printed material, and subsequent systems may use profile data. You can make your own response based on
[0132]
In another example, the UID field serves an authentication purpose, for example, whether the print media was actually printed at a specific location, printed by a specific person, or printed at a specific time Confirm.
[0133]
[Coffee mug]
In retail coffee chain stores, customers usually order the same drink every day (“half-duff, short, skinny latte”). Some customers take their coffee mugs to the cashier and enjoy the feeling of ceramic and metal rather than paper, avoiding garbage / recycling board shears.
[0134]
The “ordinary” order of the drinker can be vedoop encoded on the mug itself or, more generally, on an adhesive label attached to the mug. In addition to other aesthetic images (e.g. artwork and photographs), encoding can be performed, or the marking can be pure data. A postage stamp size label can be used.
[0135]
When a customer gives a mug to a cashier, the customer can only say "regularly". The cashier passes the mug in front of the optical scanning device of the bedoop system connected to the cash register. The system steganographically decodes the data and places a corresponding order ("half decuff, short, skinny latte") on a cashier or varistor with letters or speech (eg, speech synthesizer). The cash register system also knows the current price of the ordered drink and records the price accordingly.
[0136]
The label of the type described above, like other adhesive stickers, is pre-printed in roll form and available to cashiers and can be printed on demand. (In the latter case, where the retail store has limited space, a small label printer is the best choice.) Customers who order drinks in their own mugs are required to receive a label for the drink they just ordered And paste it into a mug for future use.
[0137]
As a variation on this basic theme, the mug label is further encoded with electronic payment information such as the customer's credit card number or debit account number maintained by the coffee store for that customer. (Alternatively, an auxiliary label can be provided to encode the label). When a mug is scanned for a drink order, the system also detects payment information and charges the appropriate account for the corresponding fee. (For safety reasons, the mug may be used to arrange the system so that, for example, you are not authorized to buy coffee for more than $ 5 a day.)
[0138]
In another variation on this theme, if the system maintains an electronic record of the customer's coffee purchases and purchases, for example, 8 or 12 drinks according to the most prominent marketing conditions at the time, the following 1 Give the customer a reward such as a free cup.
[0139]
In yet another variation on this theme, regular customers using vedup-labeled mugs can participate in regular promotions. That is, for example, every Nth customer wins cash or merchandise. The bell rings when the Nth mug is scanned. (N may be a fixed number such as 500 or a random number, usually within a well-known range or a well-known average value.)
[0140]
[Distortion and focus problems]
A coffee cup is an example of a non-planar object. Another example is a soft drink can. Special problems arise when encoding and decoding markings on such objects. For example, when such an object is sensed by a camera or the like, a portion of the image is out of focus because the distance between the various parts of the can surface and the camera is different.
[0141]
Even if the perceived image is defocused by a non-planar object such as a can, valid image data is transmitted. The defocus range is exactly blurred as if it were filtered through a low pass filter. However, to make use of this information, the more troublesome distortion problem must first be addressed.
[0142]
Looking at the planar artwork wrapped around the can from the camera, it is distorted. The part closest to the camera appears at nominal full scale. On the other hand, a continuous region around the curved portion of the can (viewed from the camera) is gradually compressed spatially. Regardless of the watermarking technique used, the physical distortion of the can surface appears in the same way as the distortion of the encoded watermark data.
[0143]
One solution to this problem is to distort the watermark pattern in advance to cancel out the optical distortion.
[0144]
A watermarking technique that works directly on luminance values pre-distorts the grid to apply the watermark to offset the optical distortions that result from the artwork as seen on a cylindrical can. be able to. Think of Pepsi and Coca-Cola cans. A virtual centerline that passes through the center of the logo artwork (the “front” of the can) serves as one centerline for the watermark grid tile. A grid extends continuously on either side of the center line. By calculating this extension, the watermark grid looks evenly linear when viewed from the camera. Otherwise, the grid is continuously compressed in the direction of the apparent end of the can.
[0145]
Such an approach is shown in several drawings. FIG. 17 illustrates a distortion-free grid commonly used in planar object watermarks. FIG. 18 also represents the same grid, but is distorted in advance to resolve the optical distortion due to can bending. The center line of the artwork (eg, label) is indicated by a dotted line.
[0146]
More specifically, the grid is square rather than rectangular. Further, the illustrated strain is considered so that the drawn grid is in the range of +/− 90 degrees from the front of the can. Also, the grids are generally small (eg, 1 inch on a side), so that some grids are tiled so that they are adjacent to each other within a range of +/− 90 degrees. Furthermore, the pre-distortion approach shown is based on infinite projection (ie, the surface of the can viewed from an infinite distance surrounds all +/− 90 degrees from the center line). More specifically, distortion is calculated based on a finite projection method using a typical lens-object distance (for example, 2 to 24 inches). As a result, the field of view covers a smaller range than the full range of +/− 90 degrees from the center line.
[0147]
The grid shown is pre-distorted only in the horizontal direction and is distorted only based on the geometric distortion caused by the curvature. There is another obvious geometric distortion. The distortion is due to different parts of the can further away from the camera. The farther away, the smaller it looks. Therefore, in order to correct in advance the geometric distortion caused by the distance, the grid elements that should be located away from the camera should be enlarged on the same basis. The geometric distortion caused by such distance appears equally in both the horizontal and vertical directions. Therefore, in order to cancel out the phenomenon that appears smaller as the distance increases, the grid cells gradually swell both in the horizontal direction and in the vertical direction as the distance from the center line increases. FIG. 19 shows the basic features of such a predistortion approach.
[0148]
The degree of pre-distortion in the latter largely depends on the distance from the camera lens to the front of the can. If the distance is approximately 2 inches, the phenomenon of becoming smaller as the distance is longer becomes more prominent than when the distance is 1 foot or more. In the latter case, the distance to the farthest part of the image object is 110% of the nearest part. In the former case, the ratio is approximately 200% or more.
[0149]
A typical example of what is used when applying a watermark to a pixel region using a grid pattern is the illustrated predistortion technique. This is a technique for geometrically predistorting in the spatial domain. Other watermarking methods naturally require other types of pre-distortion techniques that correspond to methods that distort the display of watermark data in anticipation of the results. For example, the watermark technique based on the image deformation coefficient in the transform area requires different adjustments. Theoretically, any adjustment is the same (resulting in a clear image with the intended watermark information), but it is not easy to represent it in the diagrams as shown in FIGS. (In other words, since the conversion rate changes instead of the grid layout, the distortion in the conversion region is required rather than the spatial region.)
[0150]
While the above discussion has focused on pre-distorting the image, other methods can solve the problem. When a linear watermark that has not been distorted in advance is applied to a cylindrical can, the watermark detector can counteract the appropriate distortion by a process that does not distort. That is, the detector effectively remaps the raw pixel data, effectively stretching the pixels from the centerline and returning them to the proper linear relationship.
[0151]
In one embodiment, assuming that the image object is planar, the detected image data is first tentatively decoded while being distorted. If a watermark is not detected, the same data (or the next frame of image data) is subjected to a test-free distortion process to see if the data yields a readable watermark. Trying the process without distortion with various features several times in succession. In some embodiments, the detector can continuously repeat several different undistorted functions (including no distortion processing) to recognize the watermark from the image data. Some are trying to find a process that doesn't distort.
[0152]
With the permission of the application, the user can specify the shape of the object so that a single or limited range of undistorted functions can be applied. Alternatively, the user can simply give a rough indication to the detector (eg, by selecting “magazine” or “groceries” in the user interface connected to the watermark detector). In the former case, it is assumed that the medium is flexible and has an irregular and simple curvature other than a plane. In this case, if the detector assumes that the imaged page is planar, it will spend most of its time decoding the watermark, and if the magazine page is slightly folded in various directions Sometimes one tries to apply one of four or eight different undistorted functions that are suitable for. In the latter case, the food product is generally less elastic and therefore has a relatively predictable shape, most commonly planar or cylindrical. In such cases, the detector assumes that the object is planar and uses half of the time for decoding and the other half of the time for non-distorting functions on various cylinders. Repeat between.
[0153]
In the above description, the image watermark has been described in particular. However, the corresponding part of this principle can be applied to the audio watermark as well.
[0154]
[Smart elevator]
According to another embodiment, one or more light capture devices are provided in a building elevator. For example, each device looks inside the elevator room for a vedoop encoded object such as an ID badge.
[0155]
Upon sensing a vedoop encoded object, the elevator can determine the floor where the badger's office is located among other data. The system then automatically directs the elevator to the floor without the need for the person to press a button. (The elevator button panel has a new override button that functions to not select the recently selected floor. These can be used, for example, when the user wants to go to another floor. )
[0156]
To aid in identification, add a prominent color to the beedop object (eg, badge) to allow the system to more easily identify candidate objects among other objects within the field of view of the light capture device. . Alternatively, the object may be retro-reflective coated to provide one or more illumination sources in the elevator with known spectral or temporal characteristics (eg, constant infrared or single or multiple) An illumination with a constant line spectrum, or a pulsed light source with a known periodicity, an LED or a semiconductor laser, each with an associated diffuser, can be used for each of the above, and images Can be combined with capture device). In addition, this type of hint can be used for supporting the position of an object. In all such cases, the light capture device can sense this type of hint due to the wide field of view of the visual sensor. The device is manipulated and / or adjusted physically or electronically to capture a high resolution image of a digitally encoded object suitable for decoding.
[0157]
【magazine】
Magazines (and newspapers) can be steganographically encoded with bedoop data to experience another “paper-in” experience. As with the office documents previously described, the encoded data provides the location of a computer (eg, a home page) having the same or related content.
[0158]
In one exemplary embodiment, inventory of blank pages of magazines is vedoop encoded before printing. Watermarking can be performed by a high-speed inkjet device. This device basically spreads a minute pattern of ink droplets that cannot be sensed over each page. Since different watermarks can be applied to each page, it is possible to distinguish between 21 pages of a magazine and 22 pages of the same magazine at the time of decoding (as well as 106 pages of the June 21, 1999 issue). 106 pages of the June 28, 1999 issue can be distinguished). If necessary, each page can be further divided into a plurality of regions based on the actual boundaries of articles that are subsequently printed on the page, or, for example, in a grid pattern of 3 rows x 5 rows. Each region can carry a clear vedoop code so that different parts of the page lead to different web data.
[0159]
After watermarking and printing, the pages created in this way are bound together with others in the usual way to become a finished magazine. (It is not necessary to put a watermark on all pages of the magazine.)
[0160]
Of course, a watermark can also be put in processes other than inkjet printing. For example, the method of applying a texture with a pressure roller is another option, and is suitable for processing a large amount of paper. Also, watermarks can be added to artwork described in advertisements using commercially available watermarking software (e.g., available with Adobe Photoshop and Corel image editing products).
[0161]
When a certain magazine is presented to the optical scanning device of the vedoop-compatible computer, the computer senses the vedoop data, decrypts it, and activates a web browser having an internet address corresponding to the vedoop data. If the magazine page is an advertisement, the Internet address can provide complementary information for the advertisement. For example, if the magazine page is a grocery advertisement, the homepage on which the recipe using the advertisement item is posted can be identified by the bedoop data. If the magazine page contains a picture of a tropical seaside, the bedoop data should be directed to a travel-related homepage (eg, hosted by Expedia or another travel agency). Can do. It provides fares and accommodation information useful to readers who want to spend their vacation on the listed beach. (You can customize fare information for your home airport by referring to a user profile that is stored on the user's computer and communicated to the website so that the displayed page can be customized.)
[0162]
The data that leads to bedoop data does not have to be fixed and can be updated weekly, daily, or otherwise. In this way, when a magazine page that appeared several months ago is presented on the bedoop device, the resulting data can be updated. The linked data can include audio and / or video representations.
[0163]
In the case of an advertisement, since the value of the advertisement increases for the advertiser by inserting bedoop data, the publisher of the magazine can charge the advertiser for a higher fee. This increase can be shared by companies that provide value-added bedoop technology and infrastructure.
[0164]
[Business card application]
For example, a conventional business card can be steganographically encoded with bedoop data by texture, watermark coloring, ink jet scattering, character steganography, and the like. Similar to many of the embodiments described above, steganographic encoding is adjusted to facilitate decoding when the orientation of the card captured during the scan is indefinite and the dimensions are distorted. . (Some of these techniques are shown, for example, in the applicant's patents and publications mentioned above. There are various other techniques known to craftsmen.)
[0165]
When the person who receives the business card holds it in front of the bedoop sensor, the operating system on the local system launches the local bedoop application. This local bedoop application in turn establishes an external Internet connection to the remote business card server. The local bedoop application already knows the address of the server (eg, saved from previous use). Alternatively, the local bed system can reach the business card server beyond the public network of the DNS server described above.
[0166]
A name card name server maintains a large amount of business card data and has one database record for each UID. When the server receives vedoop data from the local vedoop system, it parses the UID and accesses the corresponding database record. This record typically contains more information than would normally be printed on a conventional business card. Sample fields from the record include, for example, name, title, company phone, company fax, mobile phone, email address, company name, company homepage address, personal homepage address, secretary name, spouse name , Birthday is included. This record is sent back to the originating bedoop system.
[0167]
The local bed system will now have the data, but further instructions from the user are required on how to process it. For example, do you dial a phone number? Is the information entered into a personal contact management database (eg, Outlook)? Etc.
[0168]
In an exemplary embodiment, the local system presents available options to the user, such as by a text prompt or synthesized speech. The user operates the business card in the manner indicated by the system (for example, move down when calling the company, move up when calling the house, move right when accessing the company homepage, personal Move to the left when accessing the homepage, enter specific elements from the database records into the personal contact management database (rotate to the left when filtered according to the template, etc.), response To do. In response, the local bed system responds.
[0169]
Some persons presenting business cards make additional information available to the business card recipient, for example, more information than is known in conventional contact management software applications. For example, as one of the options from the local bed system shown for the presentation of a business card, a personal itinerary of the person who issued the business card may be examined. (Business card senders can maintain their personal itinerary on a computer with web access.) With this configuration, business card senders can be given a date and time when they are in the office or likely to make a reservation. The person who received can know.
[0170]
Usually, a regular web browser cannot access this web itinerary, but only by responding to bedoop data (which is considered authentication or password data).
[0171]
Some users carry several business cards encoded with different levels of access authentication (eg, different UIDs). In this way, some cards access the personal name data page without any schedule information, while others access the same page or another page and access only the current day or weekly schedule. In yet another card (eg, a “spouse card”), the same page or another page can be accessed to access the full schedule of the name card sender. Users can distribute such various business cards to various people according to the amount of personal information they want to share.
[0172]
According to a related embodiment, a “current” telephone number field can be included in the database record corresponding to the business card data of Bedoupe. In this field, the optimal communication channel for the business card sender can be continuously updated throughout the day. This data field can be updated accordingly when the business card sender leaves the house and goes to the office, or when driving out of the office, or when working in a different town office for a week. (Carrying a pocket-type GPS receiver with a wireless uplink to assist in switching from the various known possibilities to the “current” number, depending on the person's location at the moment. If there is a request for a “current” phone number in this database record, the latest information at that time will be provided.
[0173]
For example, consider a public telephone that can be bedded. Hold a business card in front of the Bedoop sensor (or slide the optical scanner track) to make a call. The phone queries the database of the business card server for the “current” phone number and dials that number.
[0174]
To update any field stored in the database record, the business card sender can use a special card with write permission privileges. The special card may be a specially encoded version of the business card or another object unique to the business card sender (eg, the business card sender's driver's license).
[0175]
References to business cards and personal dates are just examples. A century ago, "telephone cards" were used by people who had strictly social interests rather than business. The principle just described can be applied as well. Teenagers can carry small cards and exchange them with new acquaintances to allow access to personal research documents such as personal information, favorite music, artistic activities, and video clips. The card can be decorated with art or other markings that serve purposes that have nothing to do with steganographically encoded beddupe data.
[0176]
[Input by gesture]
By referring to the embedded calibration data or by other techniques, the bedoop system can determine the dimensional state, rotational state, XY offset, and other dimensional state of the object. If the scanning device operates at a suitable high frame rate (eg 5 or 10 frames per second), any or all of these four variables can be tracked for a long time and function as an additional input. Fulfill.
[0177]
In the example described above, the left button or right button in the dialog box is selected by moving the object left or right in front of the Bedoop scanner. This is a change in the XY offset of the scanned object. In the example described above, the selected button is activated by moving the object inward and approaching the camera. This is a change in the dimensional state of the scanned object.
[0178]
Similarly, twisting an object to the left or right can give instructions to one of two more responses in a properly programmed bedoop application. (This is a change in the rotation state.) Similarly, tilting a portion of an object closer to or away from the camera can give an indication to one of two additional responses in the application. (This is a change in different dimensional conditions.)
[0179]
In the case of the business card just described, for example, the business card can be held in front of a computer bedoop scanner. When the business card is twisted to the left, the computer opens a website browser at the home page address corresponding to the vedoop data on the business card. When the business card is twisted to the right, the computer opens an e-mail template that is pre-addressed to the e-mail address indicated by the business card.
[0180]
In other examples, the right edge of the object can be used to perform a mouse right click input by twisting it toward the scanner, and the right edge of the object can be used to perform a mouse left click input by twisting it away from the scanner.
[0181]
By changing two of these four positioning variables simultaneously, one of four different inputs to the computer can be made. (For example, (a) Twist to the left while approaching, (b) Twist to the left while keeping away, (c) Twist to the right while approaching (d) Twist to the right while keeping away.) A simultaneous change of three, or all four of these variables can also make one of eight or sixteen different inputs to the computer.
[0182]
It is generally difficult to operate an object in two or more of these modes at the same time, and the simple and intuitive feeling that characterizes the object operation in one mode is impaired. However, a similar effect can be achieved by operating the business cards in different modes continuously instead of simultaneously (eg, approaching after twisting to the left). Furthermore, the same mode can be used twice in succession (for example, approached and then moved away) by continuous operation. Arbitrary and complicated input can be sent to the bedoop system through such continuous manipulation of objects.
[0183]
(It can be seen that the input application by gesture described above does not require a digitally encoded object. An object (talisman) that can be distinguished in image data can be operated by the user in the manner described above. Appropriate systems recognize the movement of the object and respond accordingly, setting digital data on the object further expands the range of functionality (eg, according to the digital encoding of the object being manipulated) The same gesture has different meanings), but this is not essential.
[0184]
Furthermore, steganographic coding is not essential even within the scope of a digitally encoded gesture talisman. Any other well-known method for optically recognizable digital encoding (eg, 1D and 2D barcodes) can be readily utilized.
[0185]
In the illustrated embodiment, a business card or a photograph is used as a talisman, but the range of what can be used as a talisman is basically infinite.
[0186]
Dynamic gestures are not the only communication that can be achieved with such a talisman, instead a static arrangement (eg presenting the talisman in different directions) can also be employed.
[0187]
Think about magazine advertising. The first response can be activated by presenting the sensor with the top of the page facing up. When the page is rotated 90 degrees and presented, the second response is activated. The same applies to a 180 degree rotation (ie, upside down) and a 270 degree rotation. By referring to the attributes of the watermark signal identified from the pages of the magazine (eg, by referring to the rotational state identified in the subliminal grid signal detailed in the applicant's earlier patent), Can detect such various rotational states.
[0188]
[Decryption module by gesture]
Various methods can be used to decode the vedoop system based on gesture input. Some Bedoop systems provide this functionality as part of their Bedoop application. However, in general, raw frame data must be provided to the application in order to identify gesture movement. Since this feature is typically used in many Bedoupe applications, a single gesture interpretation software function (common at the operating system level) is provided to analyze the frame data and apply to all Bedoupe applications. It is desirable to provide gesture output data in a standard format.
[0189]
In such a system, a gesture encoding module tracks the encoded object in a series of image data frames and outputs various parameters that characterize the position of the object and its operation over time. Two of these parameters represent the XY position of the object within the current frame of image data. The module can identify one (or more) reference points on the object and output two corresponding position data (X and Y). The first parameter represents the horizontal offset of the reference point as a percentage of the frame width as seen from the center of the image frame. If the reference point is to the right of the center frame, using two's complement representation, or other representations that can represent positive or negative numbers, this parameter has a positive value and the reference point is in the center frame If it is to the left of, it can have a negative value. Similarly, the second parameter Y represents the feature of whether the position of the reference point is above or below the center frame (a positive value is indicated by setting it to the top). Each of these two parameters can be represented by a 7-bit byte. Each time a new frame of image data is processed, a new pair of X and Y parameters is output from the gesture decoding module.
[0190]
In many applications, the absolute XY position of the object is not important. Rather, what is important is the frame-to-frame movement of the object in X and Y that affects the way the system responds. The Bedoop application can identify such movement by monitoring the changes in the two parameters described above on a frame-to-frame basis. More generally, however, a gesture decoding module implements this function and outputs two additional parameters X ′ and Y ′. The first parameter represents the right / left movement of the reference point since the last frame as a percentage of the total frame width. Again, this parameter is represented in two's complement format, with positive values representing rightward movement and negative numbers representing leftward movement. Similarly, the latter parameter represents the vertical movement of the reference point after the last frame.
[0191]
Depending on the parameters output from the gesture decoding module, the dimensions of the object, dimensions different from it, and the rotation state are similarly analyzed and presented.
[0192]
By referring to two (or more) reference points on the object (eg, on the diagonal of the card), the dimensional state can be identified. The distance between the two points (or the region surrounded by three or more points) is recognized and expressed as a percentage of the diagonal size of the image frame (or the region). A single output parameter A is output in a 7-bit binary representation.
[0193]
Similar to the case of using XY data, the gesture-based decoding module can monitor the change in the dimensional state parameter after the last frame and generate the corresponding output parameter A ′. This parameter can also be expressed in two's complement format, with a positive value indicating the movement of the object closer to the sensor after the last frame and a negative value indicating movement away.
[0194]
Different dimensional states B can be identified by referring to four reference points on the object (for example, the center point of each of the four sides of the card). Two points on the side of the card define a horizontal line, and two points on the top and bottom sides of the card define a vertical line. The ratio of the lengths of the two lines is a measure of the different dimensions. This ratio can be expressed as a percentage of the length of the short line to the length of the long line (ie the ratio is always between 0 and 1). Also, using a two's complement 7-bit representation, a positive value indicates that the vertical line is short and a negative value indicates that the horizontal line is short. (Similar to the above, the dynamic parameter B ′ can also be identified, and the change in the different dimensional parameter B after the last frame is also represented by 2's complement in 7-bit format.)
[0195]
The rotation parameter C can be identified by the direction of the angle of the line defined by two reference points on the object (eg, the center point on the two sides of the card). This parameter can be encoded as a 7-bit binary value and represents the percentage of the rotational offset clockwise from the reference direction (eg, horizontal). (These two reference points must be distinguishable from each other regardless of their position with respect to the angle of the object when representing the entire range of 0 to 360 degrees. (Only data in the range of 180 degrees can be represented.) As described above, the dynamic parameter C ′ is also identified to indicate that the rotation parameter C has changed since the last frame. This parameter is a two's complement in 7-bit format, and a positive value represents a change in rotation clockwise.
[0196]
Of course, the analysis techniques and expression criteria described above are merely examples. Artisans know that there are many other configurations that meet the needs of the specific bedoop application offered.
[0197]
In the illustrated system, the vedoop application program communicates with the gesture decoding module via a standardized interface protocol, such as an API. An API can inquire the gesture input module of some or all of parameters indicating the current position (for example, any or all of X, Y, A, B, and C). The module responds to the originating application with the requested parameters. Another API may query the gesture input module for some or all of the parameters indicating the current movement (eg, any or all of X ′, Y ′, A ′, B ′, C ′). it can. Yet another API makes a request to the gesture decoding module to provide updated values for some or all of the position and motion data on an execution basis as soon as it is identified from each frame. be able to. In the complementary API, the above operation is interrupted. With such a configuration, all the gesture data can be used, but the Bedoop application program only obtains the specific data it needs when it needs it.
[0198]
In a bedoop application communicating with an external server, only bedoop data (ie, CLASS, DNS, optional UID) can be sent first. If the remote server has to consider the gesture data in determining how to respond, it can poll the local bedoop system for the required data. The requested gesture data is then sent by the local bed system to the remote server in one or more individual transmissions.
[0199]
In other embodiments, the bandwidth of gesture data is narrow (eg, approximately 56 bits per image frame), so that data is sent to the remote computer as specified and automatically, and immediately when needed. Can be used. In one embodiment, this data is assembled into an 8-byte packet, where the first byte of the packet (eg, the X parameter) is preceded by a synchronization bit of “1” and subsequent bytes of the packet are , A synchronization bit of “0” is attached to the head. (These synchronization bits can be used to support accurate packet decoding.)
[0200]
In some embodiments, it may be useful to extend the length of a normal 64-bit bedoop to accommodate the associated packet of gesture data. This can be achieved, for example, by using a reserved bit such as the UID field of the bed packet. The value of this bit is normally zero. When the value is 1, it is indicated that the vedoop data is 128 bits instead of the usual 64 bits, and the latter 64 bits constitute a packet of gesture data.
[0201]
A similar extension protocol can be used to attach other auxiliary data to the vedoop data. For example, another reserved bit in the UID field can indicate that the bed data is followed by an additional 256-bit data field. The interpretation of the data field is ultimately done by a remote computer that provides bedoop data in a well-known manner. (Such bits convey, for example, profile data, credit card data, etc.) The appended data field similarly includes one or more bits that indicate that additional data is present. It is.
[0202]
[Grandma]
Many people complain that computers are too complex for most people. Trying to simplify computer-to-user interaction so that less experienced or easy-to-use users will often frustrate experienced users.
[0203]
According to this aspect of the current technology, the advanced knowledge of a computer user is implied steganographically on the talisman used by the user interacting with the system. The computer detects the data that has been steganographically encoded, and changes the mode in which it interacts with the user accordingly.
[0204]
Consider Internet browser software. Expert users are familiar with different functions that can be accessed, for example, by operating various drop-down menus / submenus, keyboard shortcuts, menus that can be used by right-clicking the mouse, scroll wheel and scroll buttons on a roller mouse, etc. Yes. Users like grandmas are usually not very familiar.
[0205]
Although gesture interfaces can greatly be expected to simplify the interaction between users and computers, it is likely that similar disagreements will continue between experienced and unfamiliar users, with one class of users The class is frustrating.
[0206]
To reduce this gap, the computer system can respond to gestures in a variety of ways, based on the proficiency shown by Talisman coding. For experienced users, for example, a gesture interface operating in internet browser software displays a list of stored favorite web addresses when the left edge of the talisman is tilted toward the light sensor. Once this list is displayed, the expert user can rotate the talisman to the right to scroll the highlights from the top to the bottom of the list. Rotate the talisman to the left to scroll through the highlights from the bottom to the top of your favorite list. Depending on the degree of rotation of the Talisman from the default direction, the scrolling speed can be changed.
[0207]
On the other hand, for novice users, such an operation using a Talisman may be a source of confusion rather than giving power. The operation of tilting the left end of the Talisman toward the sensor may be unintentional and often wrong. Such users are provided with a more satisfactory interface for moving the cursor on the screen by relying on the simple XY direction for the movement of the talisman. In this case, moving the talisman toward the sensor functions as a selection signal (ie, a left mouse click).
[0208]
(In the example just quoted, an expert user gathered a list of favorite websites. Each of the various “favorites” lists can be maintained on a computer, associated with various talismen. , A “favorites” list is provided, unlike a wife who uses another talisman.)
[0209]
[Printed photo]
The printed photo can be steganographically encoded with bedoop data that leads to information (eg, contact information, personal data, etc.) related to the person in the picture.
[0210]
Such a photograph can be presented to a bed sensor on the telephone. In a simple embodiment, the phone simply processes the vedoop data, obtains the corresponding default phone number, and dials that number. In other embodiments, various options are possible, such as dialing a house number or a work number. Presenting a photo on the phone can, for example, call the person at home by moving the photo to the left, while calling the person at work by moving to the right.
[0211]
As telephones become more capable and sophisticated devices, other actions can be triggered by other operations. In the computer / phone combination device, for example, when a photograph is rotated counterclockwise, a web browser is activated for an address provided with video data from a web camera in the person's home. When the photo is rotated clockwise, the e-mail format is displayed where the e-mail address of the person in the photo is set as the destination in advance. Rotating a photo to the right will query the system database for other photos of the same person or subject. These can be presented in response to further user input.
[0212]
In this embodiment and other embodiments, it is useful for the bedoop device to give an instruction to the user to support the operation of the object. This can be done by voice (for example, “Call the house, move the photo to the left”) or by visual hints (for example, a left or right arrow display) You can also.
[0213]
Like annotations on the back of a photo, you can use the vedoop data in the photo or annotate the photo, or print the vedoop data under the photo that you put on the album. Bedoop data can be linked to a remote database, in which case the photo owner can enter text (or audio) annotations in association with the UID of each photo. A few years later, when the photo owner forgets some of the names and puts the photo in front of the Bedoop sensor, the system will add the annotations that the photo owner had made several years ago. Respond by providing.
[0214]
[Driver's license and other cards]
Once the driver's license, social security card, and other identification documents are encoded with vedoop data by the issuing authority, the owner's personal records can be accessed via the web. When presenting the document to the Bedoop system, the system directs the web browser to a personal address corresponding to the data encoded on the document. At that address, document owners can view not only national records such as state or federal tax return data and social security qualifications, but also confidential records such as credit records. The user's selection from various functions can be validated by spatial manipulation of the document. (To protect privacy if the document is lost or stolen, the user is required to enter additional data, such as social security number or mother's maiden name.)
[0215]
By manipulating the driver's license in front of the bedoop sensor, the user requests a renewal of the driver's license and is allowed to pay a considerable fee.
[0216]
A bank (debit, credit, etc.) card is similarly encoded with bedoop data so that the card owner can access the bank records corresponding to the bank card account. (You may be asked to enter a PIN code to protect privacy.)
[0217]
Such documents can be used to access other personal data. One example is e-mail. A traveler stops at the airport at the airport, and presents a driver's license. Even if there is nothing more, the kiosk displays the email waiting for the traveler on the attached screen.
[0218]
Upon recognizing the driver's license, the kiosk can access a remote site (maintained by a driver's license laboratory, other governmental organization, private organization, or its traveler), and the vedoop data encoded in the license By authenticating the operation, and the kiosk obtains information that the exemption was previously approved for the person in response to the authenticated access. This information can include email account and password information. Using this information, the kiosk queries the corresponding email server and downloads a copy of the recently received mail for presentation at the kiosk. (For privacy protection, at some point in the process, for example, when querying remote sites for email password data that handles confidential matters, or before viewing downloaded email for viewing, etc. The entered PIN number is requested.)
[0219]
Other cards that can be carried in a wallet or handbag can also be encoded to enable various functions. As a reward for regular customers, a local sandwich shop that offers 12 free sandwiches with the purchase of 12 sandwiches is based on the vedoop data that leads to its web-based sandwich delivery service. Encode the customer's frequent customer card. Or, cancel the frequent customer card, and instead, in front of the sandwich shop's bedoop sensor, the customer shakes his or her business card or other identification card and puts it in the calculation table maintained by the store's computer. You can earn purchase credits.
[0220]
To provide new functionality, digital data can be used to encode meal tickets, health insurance cards, and written medication prescriptions as well.
[0221]
Larger trade shows such as COMDEX eliminate the need for vendors to issue thick, glossy brochures for delivery to visitors. Instead, it prints a variety of elegant promotional cards for distribution. Later, as the cards are presented to the bedoop sensor, each card leads to a web-based display that includes optional persuasive video and other multimedia components. The user is instructed to provide data to customize or focus the display to the user's own requirements. If the user wants more information, it can be requested by clicking the mouse (or twisting the card).
[0222]
[Promotion of prizes and products]
Product packages (e.g., Coca-Cola cans, Snaple bottles or Pepsi 12-pack boxes) can be encoded for contest purposes. By customizing the encoding for each product, the selected product is recognized as one of 100 that gives the owner the right to receive a prize or prize when vedoop scanned. . The remote server provided with the product's bedoop data will query the user for contact information (eg address and phone number) so that a prize can be awarded or, for smaller prizes, a local business partner. The system can print a winning certificate that can be exchanged for goods and cash. Once the winning product is identified at the remote server, the UID on the server is marked as exchanged so that the product cannot later be used for another prize.
[0223]
Other similar embodiments encode all items in the same way. Winners will be determined randomly. For example, during the contest, people around the world present Coca-Cola cans to the Bedoop system. The corresponding bedoop application on each user computer provides bedoop data to the corresponding web address. This includes the user's email address. When this data is transmitted to the corresponding server computer, it is determined that every Nth set of data is a winner, and a corresponding prize notification or prize is sent to the vedoop system that issued the winning data.
[0224]
A server computer that has received such a contest submission from a client bed system may be configured so that one user does not attack the server with multiple sets of data in an attempt to forcibly win. it can. (This can be done, for example, by checking the included e-mail address or the received IP address and ignoring the submission of the data if the same address is found in the data sent in the past time. Even on the user computer, for example, by preventing the contest data from being repeatedly sent more than once an hour, it is possible to protect against the same force. (Of course, you can also provide defenses against force.)
[0225]
Non-planar product packages, such as cylindrical soda cans, present certain optical problems during encoding and decoding as detailed below.
[0226]
[Product information and ordering]
Product packages and product advertisements can be encoded with vedoop data, and when they are presented to the vedoop system, a link to a homepage where the product can be purchased and further information can be obtained . Once the link is established, for example, to order products, move towards the camera, to get product information, move away from the camera, to perform various functions, The user can receive an instruction to operate the object in a mode different from that described above. When moving an object towards the camera to place an order, further manipulate the object to make a delivery selection (eg, turn left for late night flights, right for regular flights) The user receives instructions. If the object is moved away from the camera to obtain product information, the object is further manipulated to specify the type of information desired (eg, turn left for recipes, FDA) The user is prompted to turn to the right for nutritional information, move up for information about other products in the family, or move down to send an email to the manufacturer of the product).
[0227]
Credit card and other customer billing information, along with mailing address information, can be stored in a profile on the Vedoop system, and automatically when a purchase action is triggered, Alternatively, after the user confirms that such information has been sent (confirmed by a package operation or advertisement using one of the modes described above), it is communicated to the website that conducts the transaction. Other payment modes can of course be employed.
[0228]
[Computer access card]
The present disclosure has previously considered an access card used to provide access to a secured building.
[0229]
A driver's license, employee photo ID, and other such documents can be presented to a vedoop sensor on the computer. The computer recognizes the user and performs various processes when responding.
[0230]
One response is to log onto the network. Another response is to set up loading of the user's profile file, so that the computer can know how to arrange the desktop in the way the user prefers. By manipulating the vedoop encoded object, the user can further change the environment (eg, turn to the left to launch a standard business productivity application and software development application. To the right to launch entertainment, eg stock updates, recreational games, etc.).
[0231]
Increasingly computer services are also being provided in hotel rooms. By presenting a driver's license, you can link a computer with a bed in a hotel room to a remote site indicated by the bedoop data, gain priority data for that user, The application can be launched on a hotel computer with a configuration that mimics the environment.
[0232]
[Audio / video disc, software, and book]
The surface of CDs and DVD disks, or their labels (or certificates of trust testing) or insert advertisements or artwork thereof, or their containers (for example, jewelry boxes or plastic cases), book covers, book pages, etc. Vedoop data can be transmitted by marking or texturing on the top. Any of these objects can be presented to the vedoop device to link to the relevant website. The customer then manipulates the object (selects otherwise) and selects various options.
[0233]
For music, one option is to receive songs on other CDs by the same artist, or MP3s and other clips of songs by other artists of the same genre. Another option is to be able to watch music video clips that deal with the same artist. Yet another option is to order tickets for the upcoming concert of the artist. At the kiosk in the store, lost customers can hear a sample track before buying.
[0234]
Video DVDs can offer similar options. In the case of video, a list of other movies can be included, such as a movie by the same director, a movie in which the same star appears. In the case of software, options such as warnings, troubleshooting, product updates and upgrades can be included. Of course, the user can purchase other music from the same artist, other videos from the same star, software upgrades, etc. from the site.
[0235]
Similar options can be accessed using the vedoop data attached to the printed book material.
[0236]
When children are small, they learn to turn the pages of a book. Children learn to see the picture on the book page and enjoy listening to the story about the picture. In general, adults read words and children understand the story while watching pictures. Children enjoy listening to the story repeatedly. The combination of looking at pictures and listening to words many times is an excellent mechanism for learning to read and enjoy books.
[0237]
The above process can be automated with embedded watermarking data so that the child can independently see the picture and hear the word. This structure provides fun while teaching children how to read and love books. At the same time, give children independence and familiarize themselves with automated mechanisms.
[0238]
More specifically, the picture in the book or the paper background of the page contains a digital watermark. When the child turns the page of the book, the camera captures the image and the connected computer reads the watermark. Then, using the watermark, a heading is given to a data storage location locally or remotely, and characters corresponding to the page being viewed are obtained. After that, the characters are spoken by the character-to-speech converter and the children are told. (Alternatively, the data storage may include digitized utterances rather than simple characters, eg giving different voices to different characters in the story). The child turns the page and listens to the words printed on the book page. The child controls the process by turning the pages. Children naturally learn the relationship between printed words and words played by computers.
[0239]
[Pursuit tracking]
Advertisers typically use a variety of advertisements for the same product or service, and use a means to track which advertisements are more effective within which demographic group. Vedoop can provide such functionality.
[0240]
Consider a website of a travel agency that promotes vacations in Hawaii. Bedoop data from several advertisements can guide customers to the site.
[0241]
The same advertisement can be placed in several different magazines, each encoded with a different vedoop UID. By monitoring the UID of Bedoop's queries to the site, the travel agent can determine which magazine has the highest consumer response (eg, per 1000 readers).
[0242]
Similarly, within a single magazine, two or more advertisements are encoded with bedoop data that guides each site to a different UID. Again, by analyzing the UID used to access the site, it is possible to indicate which advertisement was more effective.
[0243]
The two UIDs in the above example may both lead to the same Internet destination or to different destinations.
[0244]
Due to the instant communication characteristics of Internet links, advertisers can know how consumers' responses to print advertisements change over time, thereby making certain products more effective Get information to help you advertise.
[0245]
Of course, more complex variations and combinations of the above are possible. In response to an ad (by granting access to a pre-stored personal profile, or by filling out a web-based form, or manipulating the ad (eg Please move the ad towards your Bedoupe sensor. ”))) If consumers provide personal information, you can collect more abundant statistical data.
[0246]
[Rolodex of cards]
With a configuration like Lolodex, the above-mentioned Vedoop encoded business cards can be collected or stored near a telephone or computer. If the refrigerator's ice machine breaks down, the householder can find a business card for an electrical appliance repairman used several years ago and present it to the vedoop sensor. A link is made to the repairman's company (eg, on a website or via telephone). On the website, the repairman provides basic information such as free time and current price list. The householder chooses (via a business card gesture or other method) an option to activate a video conference call (eg, Net Meeting) to consult about the failure. Or, the householder chooses another option to send an email. Yet another option is that the homeowner can schedule a visit repair in the repairman's weekly schedule. In yet another option, the householder can watch one or more short videos that teach the customer how to repair common electrical product failures.
[0247]
【prepaid card】
An electronic money system (eg, of the type detailed in US patent application 60 / 134,782 filed May 19, 1999) to a storage device where random tokens (representing an increase in money) are stored. Vedoop data can be encoded on the card to be guided. Presenting this card to the Vedoop system launches an application that reads and encrypts the token and transfers the encrypted data to the corresponding bank information center computer to know the balance. . There, the token is decrypted and validated (but not settled). The bank computer shows the token balance on the card in response to the bedoop system.
[0248]
For security reasons, the storage device that stores the random number token must be inaccessible by common methods. Instead, the user must present authentication data that represents permission to access the information. This permission data can be a PIN code. Alternatively, the user may provide authentication by presenting a second vedoop encoded object, eg, a driver's license, to the vedoop system. (Many other bedoop systems can conveniently use or require the use of two or more bedoop objects that are presented alternately or all at once.) A visual or audible prompt can be provided that instructs the user to present the dope object as needed.
[0249]
[Ski lift ticket]
According to another embodiment, a ski lift ticket is vedoop encoded to provide various functions.
[0250]
For example, instead of buying a lift ticket that is valid all day, a skier may purchase a ticket eight times. This data is encoded on the ticket and sensed by a bedoop sensor at each lift. The common server keeps track of the number of lift tickets actually purchased, updates the number of times when it is used, and sensors are networked to this server. Each time the skier gets on the lift or gets off, he is informed of the remaining number of times. Statistical data can be collected about traces of use (eg, N percent skiers skied all day with only two lifts).
[0251]
When you leave the slope and go home and present your used lift ticket to the Bedoop sensor, you can get information about the current snow conditions and lift hours, view the trajectory map, and ski vacation packages. You can apply. If the ticket is encoded with other information about the owner's name, UID, and commercial / marketing benefits, the local merchant will be able to scan the lift ticket and collect the results of such information. Depending on the situation, the selected item can be discounted to the ticket holder.
[0252]
[REI member card]
A particular store member card can be vedoop encoded to provide added value to the member. In an outdoor goods store such as REI, by presenting a card to the vedoop sensor, it is possible to guide to a library of maps of the US Geological Survey (USGS), a homepage regarding current fishing and hunting regulations, and the like. Of course, you can quickly access the online ordering site of the store.
[0253]
[Theme Park Ticket]
The theme park ticket is encoded with additional data that allows customization of the visitor's age and gender data and experience (eg, from the roster of theme park celebrities, the visitor's favorite is Indiana Jones). There are kiosks everywhere in the theme parks, where visitors present tickets and assemble their stays into specific stories. Some kiosks offer prizes that match the age / sex of the recipient.
[0254]
[Car key]
Vedoop encoding a car key (or keyring decoration). When taking the car to the shop for inspection, the mechanic presents the key to the vedoop sensor so that the maintenance history of the car can be obtained from the remote server that maintains it. At home, you can navigate through various websites about cars by presenting and manipulating the keys to the Bedoop sensor.
[0255]
In some embodiments, vedoop encoded objects are not used to navigate to a site, but instead provide data when a user's computer is otherwise linked to a website. Some are used. A user who surfs the web and arrives at the car evaluation site can present a key to the vedoop scanner. The vedoop data is used to access a remote database that stores the manufacturer, model, options, etc. of the car. This data is provided to a database engine that returns the estimated price of the car to the user.
[0256]
While visiting the mechanic's website, you can present a key or keyring decoration (and optionally operate) to schedule an inspection of the car.
[0257]
[Fashion coordination]
Some department stores and clothing stores offer "shopping counselors" to provide various services. For example, ask a shopping counselor to help a customer who is shopping for a dress choose shoes and accessories that fit the dress.
[0258]
Similar assistance can be provided using the vedoop encoded clothing tag of the dress. In response to such a tag, the Bedoop system queries a database and obtains a mini-catalog of clothing and accessories that have been previously identified as matching the dress identified by the tag. These items are displayed individually on the screen connected to the system. Or you can synthesize and display a virtual model wearing the dress along with one or more recommended accessories. By activating the user interface control many times (by mouse, touch screen or clothing tag gesture) and circulating various combinations, depending on the model wearing the dress while wearing various shoes etc. Customers can see the completed image instantly.
[0259]
A specific store (ie, a store pre-approved by the customer) leads to a customer profile (eg, size information, repeat purchase information, return records, style / color preferences, etc.) Thus, the customer's credit card can be vedoop encoded.
[0260]
[Shopping with credit card]
When a consumer visits a commercial website and wants to purchase the displayed product, speed up the transaction by simply presenting a vedoop encoded credit card to the vedoop sensor on the user's computer be able to. The vedoop data on the card leads to the registration of a database holding credit card numbers and expiration dates. The Bedoop application then sends this information (optionally after encrypting it) to the website along with instructions for purchasing the displayed product.
[0261]
(Usually, there is a hurdle between the urge to buy and the completion of the purchase, which prevents impulsive buying. Such or other vedoop applications help ease this kind of hurdle.)
[0262]
[Product marketing]
Bedoop data associated with one product or service can be used for cross-marketing another product and service. Consider a consumer buying a pair of golf shoes. By presenting the box to the bedoop system, the consumer can access a home page on which various promotional offers are displayed. The consumer, for example, chooses to go round one free golf at one or more specific local golf courses, or prints a coupon that can save any order from an online sock trader by 10 percent . (Various measures can be taken to prevent redemption of duplicate items from one box. One of them is a serial number, which is tracked by its homepage or cross marketer and used only once. (Alternatively, there is another way to identify data that corresponds to the consumer and track it to prevent duplicate redemptions.)
[0263]
Product tags can be vedoop encoded as well. Users can access Nike's online store with their Nike apparel item tags and shop there. In the case of a tag attached to a soccer jersey, a specific operation of the tag (eg, rotating to the left) leads the user to a soccer specialty page, such as a World Cup page. A tag attached to a golf glove leads to a local golf course website. To reserve a start time, twist the tag to the left. Twist to the right to view the course map and statistics. Some retail stores have vedoop kiosks that allow consumers to take advantage of these vedoop features.
[0264]
[Travel Planning Service]
When a consumer makes a reservation for a recreation area, various confirmation information is typically sent to the consumer (via e-mail or conventional mail). If not yet printed, this information (e.g., confirmation) can be printed by the consumer.
[0265]
Bedoop encoding on printed objects allows access to web-based information about bookings (eg, booking numbers, consumer names, arrival / departure dates, etc.). If the consumer wants to make a dinner or golf reservation, he presents this object to the bedoop system, either at the user's home or at an airport kiosk. The system recognizes the type of object and the encoded data, and establishes a link to a remote computer that provides various information about the resort and provides scheduling services. By manipulating the object (or otherwise), the consumer selects the desired dinner or golf start time. Since the system already has a reservation number (headed by UID), this type of redundant data provision is avoided.
[0266]
In some embodiments, the remote computer is maintained by an independent travel agency rather than by a resort. (The travel agent also maintains a DNS leaf node server.) The computer provides a home page (with or without the travel agency's brand) and the user's desired scheduling. Options are provided. It also provides links to other information and services (eg, providing admission tickets to nearby attractions or advertising nearby restaurants).
[0267]
An air ticket (or electronic ticket confirmation) can be similarly encoded with bedoop data. By presenting these items to the Bedoupe system at the traveler's home or at the airport, check and change travel dates, book hotels and car rentals, ensure first class upgrades, check seating on airplanes, It is possible to check the situation as a frequent airplane passenger, scan travel guidance at the destination, and the like.
[0268]
[Movie tickets]
As described above, a movie ticket can be encoded, for example, with bedoop data that identifies the title and date of the movie. The person who saw the movie goes home and presents the stub of the ticket to the Bedoop system. As one of the options presented by the corresponding Bedoop application, a review of the paid program viewing (pay-per-view) of the movie that has just been viewed is started at a certain discount rate. Another option is to download the movie to a DVD disc writable at the home of the person who saw the movie. In this case, you could probably give it a serial number, or set it to play a small number of times, so that it can only be played on the viewer's DVD player (similarly at a reduced price) Done. Yet another option is to display web-delivered video clips from the movie. Another option allows related items to be offered at a discount to the retail price for purchase. (These may be valid only for a certain period after the date encoded in the ticket stub.) Another option is to use the same genre, by the same director or performer, or by the same studio. Draw attention to customers about the upcoming movie that will be released soon. Yet another option is to direct the web browser to other movie ticket online ticket vendors. The consumer navigates between these options by manipulating the ticket stub or otherwise.
[0269]
In response to the vedoop data detected from the book cover presented to the vedoop system, the same or related options can be provided as well.
[0270]
[Video recording]
The video recording device can be programmed to record the broadcast program by presenting a printed promotional material for the program (eg, a newspaper advertisement or a TV Guide) to the bedoop sensor. The print is vedoop encoded with data, which is used by the vedoop system (built-in or separate from the video recorder) to set the recording time, date, and channel. is there.
[0271]
[Set Top Box]
A television set-top box can be used to implement many entertainment related applications with bedoop data. This type of box contains a processor and usually has a return channel for control functions. By providing a bedoop chip or an optical sensor, the functions of these devices can be greatly expanded.
[0272]
[Special Event Ticket]
Think of a basketball ticket. When this ticket is presented to the Bedoop system, the user can access the website and see the recent scores and statistics of either team. The user can also browse the seat map by taking a virtual tour of the arena based on the web. The same stadium scene as viewed from the user's seat location is displayed. In addition to ordering tickets for upcoming games, pay-per-view games and team memorabilia are ordered. For expensive tickets, users are entitled to premium web features. For example, the day before the game, there can be a chat session with the team's stars, either online, by voice, or by video.
[0273]
Unlike a conventional ticket, a user is not limited to a specific seat in a bed-encoded ticket. The ticket has a nominal seat printed on it, but the user presents the ticket to a bedoop sensor and accesses a website where another seat can be reserved. When participating in the event, when a participant presents the ticket to a bedoop sensor, the sensor reads the UID of the ticket and looks up the last choice for the participant. Then, a ticket is printed from the website where the transaction is made, to which the participant has the right to secure the seat selected earlier.
[0274]
[Signet Ring]
Signet rings have traditionally been used to identify an individual's identity or company. Such rings or other jewelry items owned by the individual are encoded with bedoop data (texturing or printing) and presented to the bedoop system as needed. A safe website that displays the person's name and other information based on the extracted vedoop data (ie, a website that takes anti-hacker measures to prevent unauthorized changes to stored recognition information) Be guided to. Such a signet ring can be presented to a vedoop system that requires confirmation of a highly reliable status / permission status before processing by the vedoop function.
[0275]
【tattoo】
Temporary tattoos are well known and generally include ink or printed film that is transferred to the skin of the person applying the tattoo through some application process (eg, moistening or otherwise). The artwork on the tattoo is arranged so that the bedoop data is steganographically encoded, so that the person (or object) who made the tattoo can be easily recognized by the machine. Young people can edit their contact database by simply taking a digital photo of their friends using a personal digital assistant that can be taken. Such a computer device decrypts the watermark, accesses a web survey of information about the person in the photograph, and adds this information to the contact database.
[0276]
[Electronic paper]
It should be noted that while the vedoop application can use various printing technologies, it is undoubtedly obvious, while electronic paper can be used as well. Developed by Xerox's Nicholas K. Sheridon and mass produced by 3M, the electronic paper is a thin layer of transparent plastic with millions of small beads like toner particles Is distributed. Each bead is in a liquid-filled cavity and can rotate freely within the cavity. The beads are a “two-color” configuration consisting of hemispheres of contrasting colors (eg, black and white). Under the influence of the voltage applied to the sheet surface, the bead rotates and the viewer sees the side of one color or the side of the other color. Bits can be used to apply a pattern of voltage to the surface to create images such as letters and pictures. The image persists until a new voltage pattern is applied to generate a new image. The reader is assumed to be familiar with Sheridon's US patent on this technology.
[0277]
Basically, it is understood that digital data can be transmitted using electronic paper based on any known watermarking method, and is suitable for transmitting digital information in a data glyph format.
[0278]
[Post-It (registered trademark) memo]
In order to convey steganographic data (eg, bedoop data), the manufacturer can spell (post texturing, post-it®) or one of the other papers. Marks can be added (by watermarking, ink jet splashing, etc.). When such a note is presented to the bedoop system, the system launches an application that saves a snapshot of the note. More specifically, the application hides the memo portion in the image data from other image data and virtually remaps it to a standardized pixel-sized rectangular format, resulting in the result. The image is JPEG compressed and stored in a specific computer subdirectory. At this time, the subdirectory is given a name indicating the date of image acquisition and is stored together with the color and / or size of the memo. (The latter two data can also be indicated by the data contained in the Bedoop payload.) If the color of the memo is indicated by digital data (eg in the file name), the image itself is in grayscale Saved. For later display, when recalled later, the white image background can be filled with a color based on digital color data.
[0279]
The bedoop system stores several past frames of image data in a buffer. When an object is recognized as a post-it note whose image is to be stored, the system analyzes several such frames and identifies one that is best for storage (eg, each When imaged in a frame, check the spatial frequency portion of the note, identify the one with the highest quality detail) and save it.
[0280]
When a post-it note is recognized by the Bedoop system, the system emits a confirmation sound (or other response) to indicate that the object has been recognized, but immediately takes snapshot processing. Do not execute. Instead, the system waits for further instructions (eg, gestures) that indicate what processing is being requested.
[0281]
By moving the memo toward the sensor, for example, the user can issue an instruction to execute the snapshot processing. (By presenting the memo closer, the imaging system can obtain a more detailed frame of image data.)
[0282]
By moving the note away, the system reads the six last saved post-it note images, decompresses them, and displays them in a tiled manner on the computer screen. Individual notes can be displayed in their original size, or they can be resized to fill the full height or width of the tile. User interface controls (in response to gestures, mouse operations, keyboard scroll arrows, etc.) allow the user to scroll back to the desired date.
[0283]
Other 64-bit bedoop payloads in other embodiments may not be required for post-it notes. In the example just described, for example, the Bedoop system responds to all post-it notes in the same way. Therefore, simply “I am a post-it note, yellow, size is 3” x 3 ”.
In some cases, a shortened bedoop format is sufficient. It may be sufficient to add a further 8 bits to the 12-bit CLASS ID to indicate the color / size combination. By reducing the payload, more robust encoding can be performed on small objects. (As will be described later, the vedoop decoding system can look for several different data formats / protocols by trying to extract vedoop data from the object.)
[0284]
[Document alignment for other purposes]
As just described, when a pre-marked paper is presented to the vedoop sensor (ie taking a snapshot of the paper), it triggers the vedoop response, but the marking is It can also be used for purposes other than invoking a response.
[0285]
Correct misalignment of scanned data using embedded subliminal graticules or other steganographic encoded registries in other applications, regardless of the specific data encoded on the paper can do. For example, in a copier, there is no need to place a document exactly on a glass platen in order to make an exact copy. After scanning the bent document, the scanner detects a steganographic registration marking in the obtained scan data. This data is then processed to perform a de-registration so that the registration marking is in the desired position. The processed scan data is then sent to the electrostatic copying unit to make a copy without the influence of bending.
[0286]
The same technology can be applied to video recorders and digital cameras as well. If such a device creates an image of an object with steganographic registration markings (eg, photographs), these markings can be used as a guide in re-registering the resulting data, eliminating the effects of misalignment .
[0287]
[Information to be mailed]
There are many contexts where data provided to consumers is only valuable when timely. Postal services are not suitable for such information because of the waiting time after the document is printed until it is finally delivered to the recipient. However, due to the Bedoop principle, the recipient can receive the mailed object printed long before delivery, and use it as soon as it is received (ie, present it to the Bedoop system) for up-to-date information. Can be obtained. In these or other embodiments, the web site can provide customized data for the user because the address / recipient / user can be uniquely identified by the bedoop data.
[0288]
Delivery companies of print advertisements can issue rewards to consumers starting with Bedoop, who are accessing the website by issuing digital tokens or coupons for free gifts, refunds, etc. Each millionth visitor wins 1 million pennies (with appropriate safeguards, for example, preventing one or more inputs per hour).
[0289]
[Vedoop encoding class]
The above-described embodiments have focused on the use of post-decoding bedoop data. Further insights can be made by considering the early part of the process, namely encoding.
[0290]
Encoding can be done in various contexts, but can be conceptualized in three broad classes. Encoding in the first stage is static marking, and document designers, prepress service stations, advertising agencies, etc. embed bedoop data. The second stage is dynamic marking, in which an automated system encodes or changes the “due” bedoop data. In such a system, the vedoop data can be tailored specifically to the context, eg, time, location, user, etc. The third stage is consumer marking, where vedoop data is added to the document during printing.
[0291]
In the second stage encoding, functions that cannot be used from the first stage can be realized. Think of an American Express website that includes travel information to Hawaii. The DNS leaf node server designates this page in response to certain bedoop data, for example, a photograph of a Hawaiian coastal landscape on a magazine.
[0292]
In fact, all the vedup data with a certain CLASS and DNS ID are directed to this home page regardless of the UID data. When a magazine photo is encoded with a special “don't care” UID field (eg, 111111111111111111111111), the vedoop packet is sent to the originating vedoop system or the mediation system through which the vedoop data passes. Informs that any data can be inserted into the UID field. The originating bedoop system can, for example, insert consecutively configured bits into this field. Some of these bits allow the user's profile to be provided to the remote server so that the vedoop response can be customized for that user. (To alleviate privacy concerns, users will naturally approve information for such use in advance.)
[0293]
As an example, if the user is male, the local bed system sets the least significant bit of the UID field to “0”, and if it is female, it sets it to “1”. The next 4 bits are a range in which the user's age is divided into 16 (for example, 3 years old or less, 4-5, 6-7, 8-9, 10-11, 12-13, 14-15, 16-17, 18-20, 21-24, etc.).
[0294]
Alternatively, or in addition, a local bed system can uniquely identify its local bed system by using signature data (eg, a system serial number, a hash code based on the system's unique invariant data). Etc.) can be packed into the don't care UID field. By referencing such data, the remote server knows that the same user is repeatedly accessing it and adjusts the response accordingly (eg, the user previously entered and stored on the remote server) Recall information and avoid having to re-enter data).
[0295]
[Additional explanation of optical input device]
Image input devices are expected to become commonplace over time. Having a digital camera as a built-in component in some computers (eg, Sony Vio laptops) is just one sign of this trend. Another example is a camera-on-a-chip system. It is represented by U.S. Pat. No. 5,841,126, and is also described by Nixon et al., “256 × 256 CMOS Active Pixel Sensor On-Chip Camera (256 × 256 CMOS Active Pixel Sensor Camera-on-a-Chip”. ”(IEEE J. Solid State Semiconductors, 31 (12), 2046-2051, (1996), and Fossum ’s“ CMOS Image Sensor: Electronic Camera-on ”. -A-Chip) "(IEEE Electronic Device Transactions, Vol. 44, No. 10, October 1997). As yet another example, (Currently Computer Augmented Vision) Stem there is are such) head-mounted camera is used. All of these, or other image input device is suitable for use in the base doop system.
[0296]
The on-chip camera system can include vedoop detector hardware integrated on the same chip substrate. The hardware is configured to find and decode the vedoop data from the image data regardless of the dimensions, rotation, dimensions different from this, and the like. The hardware is also provided with gesture decoding, and the resulting data is output in packet form on the serial output bus. Thus, such a chip has several outputs: image data (either in raw pixel format, or in the form of a data stream representing one image in various image formats), bedoop data (serial (Or parallel) 64-bit and decoded gesture data can be output.
[0297]
In other embodiments, bedoop detectors (and / or gesture detectors) may be provided on a substrate remote from the camera system.
[0298]
In order to support various bed data formats and protocols, the hardware can include RAM or ROM that stores various format / protocol information. (These various formats / protocols can be adapted to bedoop systems using, for example, various data payload lengths, subliminal grids, various encoding techniques, etc.) As such, each frame can be analyzed according to several different formats / protocols to find a format / protocol that yields valid bed output data.
[0299]
[Moveable bedoop sensor]
The described bedoop system is generally fixed, but this need not be the case. It can also be portable. Some such systems employ, for example, a palmtop computer with an optical sensor array. If a live network can be connected to the palmtop (for example, wirelessly), a bedoop application based on a remote computer can be implemented as described above. If the palmtop does not have a live network connection, any Bedoop application that relies on a remote computer simply queues such communications and the palmtop next remotely accesses it (for example, the palmtop When the top is next placed in the charger and connected to a modem that can establish internet access, they can be transmitted.
[0300]
Another example is a vedoop sensor with a 1D or 2D photosensor array (eg, CCD or CMOS) that can move around a desk or other work surface, such as a mouse. Such sensors can be cabled to an associated computer or can use a wireless interface. In order to read the digital data on which the object is marked, the peripheral device is placed on top of the item. (Built-in lighting may be necessary because the device may cover the encoding with its shadows.) Several types of such peripherals can be used for both general-purpose digital cameras and vedoop sensors. It can also be modified to play a role.
[0301]
Many applications can be found with such peripherals. For example, when you “read” a magazine or book, it ’s more intuitive to place a bedoop reader “on” the object you ’re reading than to hold the object in the air in front of the bedoop sensor. It is. For example, in a magazine page, etc., there are several vedoop sections that are encoded differently (corresponding to various articles, advertisements, etc.), and the user can read that the desired vedoop encoded section is read. This is especially useful when you want to check.
[0302]
The “bookmark” paradigm of Internet browsers is supplemented with paper bookmarks, such as, for example, bedoop data encoded on one or more pages of paper. To guide the browser to a destination with a specific bookmark, simply place the peripheral on the page (or part of it) marked with the corresponding Bedoop data. The user prints a “map” made up of postal stamp size areas gathered in a tile. Each area shows your favorite web destination.
[0303]
Such a map is printed on the mouse pad. In fact, a mouse pad with some kind of pre-coded map is suitable as a promotional material. A company may suggest printing family photos on such a mouse pad. Encoded in the photo or pad texture is the address of the website that paid for access on this way on the user's desk.
[0304]
In this and other contexts, it can be seen that the concept of gesture input described above requires relative movement between the sensor and the encoded object. In most of the above examples, the sensor is stationary and for gestures it was achieved by moving the object. Of course, if the sensor is movable (for example, like a mouse or a mobile phone), the movement by the gesture can be made effective by moving the sensor.
[0305]
One particular embodiment of the above configuration is an improved version of Microsoft's IntelliMouse that uses IntelliEye technology. The device includes a multi-element photosensor integrated on an IC with various detectors and processing circuitry, and a short focal length imaging lens and LED light source (all available from Agilent as described below). Works in conjunction with. The circuit tracks pattern movement across the sensor's field of view, thereby inferring mouse movement. The Microsoft product collects 1500 data sets per second, which is a much higher frame rate than is typically required in current applications. In some of such embodiments, the function of a mouse and the function of a bedoop image sensor are combined.
[0306]
In such peripheral devices such as a mouse, the buttons and position sensing functions that are generally provided in a conventional mouse can be omitted, and a data frame corresponding to a small range under the sensor part of the mouse is generated. Give a simple palm camera facing the desk. More generally, however, the peripheral device includes a conventional mouse button, roller wheel, and / or X / Y position sensing configuration, and uses the button and data entry position form for interaction with the vedoop application. can do.
[0307]
The optical data collected by the sensor can be processed in the peripheral processor to extract steganographically encoded binary vedoop data therefrom. Alternatively, this processing burden is placed on the associated computer system and the peripheral device simply processes and formats the raw sensor data into continuous frame image data that is output to the system.
[0308]
Scanning peripherals of the type described above are typically wired to the associated host system, but of course, wireless links (eg, radio, infrared, ultrasound, etc.) can also be used and the user can It is released from the restriction by.
[0309]
[Additional explanation of hand scanner]
In order to explain the concept introduced above in detail, in the following paragraphs, in particular, a hand scanner modeled on the Hewlett-Packard CapShare 920 will be described in detail. The scanner is configured so that it can be used for any type of identifier, such as a watermark, bar code, OCR, etc.
[0310]
It is assumed that the reader is familiar with the mechanism of the HP capsha. Such information is published as technical literature, for example, “Process for Freehand Image Capture” by Allen, Ross R. et al. (HP Capscha Technology, Imaging Science & Technology PICS Conference, 43-46 pages, March 26, 2000). The capsher scanner uses an optical sensor tracking engine assembly. It consists of part numbers HDNS2000 (IC sensor chip), HDNS-2100 (lens with light pipe), HDNS-2200 (LED clip), and HLMP-ED8O (639 nm LED). For their usage, Agilent (Agilent) ) Detailed in application note 1179, all available from Agilent Technologies, Palo Alto, California.
[0311]
As shown in FIG. 13, the captive scanner 210 includes a CPU 212, a memory 214, a linear CCD array 216, first and second 2D CCD arrays 218a, 218b, a user interface 220 (including an LCD screen and associated buttons), auxiliary Functionally includes an interface 222 (eg, serial port and IRDA port / transceiver) to device 224. Although not specifically shown, each CCD sensor has an associated LED system for illuminating the object being imaged.
[0312]
The captive scanner is enhanced by providing a wireless internet interface to the interface 222, which allows direct communication between the device 210 and the internet.
[0313]
The linear sensor 216 operates in a conventional manner and is continuous for images in a scanner with a pixel data rate of about 18 megabits / second (even if it operates at an instantaneous scanner operating speed of up to 16 inches per second and can perform high precision scanning). Then do a line scan that is not straight.
[0314]
Adjacent to the linear sensor, two 2D CCDs 218a, 218b are placed apart and used to track the movement of the scanner. The area scanned by these CCDs is illuminated obliquely with IR light to emphasize the features of the fine media surface. When the CPU recognizes the pattern of the surface feature detected by each CCD, the CPU tracks the movement of the pattern in one frame and the next frame to identify the movement of the two CCDs. By knowing the movement of the two CCDs, you can also see the movement of the scanner itself. Using this information about the movement of the scanner, the non-straight scan data obtained from the linear scanner array is remapped to composite pixel data having uniform scan line intervals. This remapped data is the final scan data provided primarily to the end user or application.
[0315]
Sizing the linear array and 2D CCD array is left to the designer. When a line scan resolution of 600 dpi is required for a 4-inch scan section, a 2400 element linear CCD is used. The size of the two 2D CCDs is generally small, for example, having a diameter of 0.25 inch × 0.25 inch. The spacing of the CCD elements is selected based on the size of the surface features to be tracked.
[0316]
The memory 214 includes both RAM and ROM. RAM is used for both raw data storage and final result storage. The ROM stores a scanner operating system, pattern matching and data processing algorithms, and other program codes.
[0317]
According to the illustrated embodiment, the ROM code also includes instructions for examining the scan data as a final result (after remapping) for the watermark data. In a special embodiment, this is done in a two stage process. Initially, the final result data is examined by the CPU and is there any significant feature associated with the watermarked data (eg, as detailed in US Pat. No. 5,862,260). Existence of calibration signal). If there is such a feature, a watermark decoding algorithm with a further enhanced calculation process is executed. By checking the watermark information in such a two-stage process, CPU time is not wasted trying to extract a watermark from image data that clearly has no watermark.
[0318]
In some embodiments, each time raw scan data is processed and remapped to a final format, watermarking is operated without user intervention. In other embodiments, watermarking is invoked in response to a user command entered via the user interface 220. In yet another embodiment, watermarking is invoked in response to a command provided to the scanner from an associated auxiliary device 224 (eg, a remote personal computer, a remote server computer, specialized internet equipment, etc.).
[0319]
In some embodiments, each time watermark payload data is detected, the decoded watermark payload data is sent to the associated auxiliary device. In other embodiments, if the auxiliary device 224 does not initially request the data, the data is not transmitted. Such a request from the auxiliary device is made by, for example, an API call by a software program executed by the auxiliary device.
[0320]
The watermark decrypted by the scanner can be shown to the user by the LCD display 220 of the scanner. Alternatively, the scanner forwards the decrypted watermark to the remote device 224, which then responds with supplemental data for display to the user as detailed elsewhere herein. To do.
[0321]
Some embodiments support the watermark detection / decoding process by using information obtained by the 2D CCDs 218a, 218b to augment the information provided to the CPU. The 2D sensor, for example, provides 2D information immediately without the delay time associated with remapping the ID data from the linear CCD array to the final format. This 2D information provided immediately is analyzed to confirm whether a calibration signal is present. As a result, analysis of the calibration signal in the final data can be shortened or avoided.
[0322]
The 2D data can also be used to characterize the texture of the background to be image processed. Knowing the background texture allows the CPU to perform filtering or other watermark / image enhancement steps to best suit the particular environment.
[0323]
With the 2D data, the CPU can also determine the relative quality of the various parts of the line scan data in the final scan data. In FIG. 14, an object 120 is scanned by a scanner 210 that moves in an arc to generate a continuous line of raw scan data 228. This arc configuration is manifested by data collected by two 2D CCDs (acting as motion encoders). Where successive lines are close to each other (as in area A), the raw scan data has a higher resolution (relatively “oversampling”). Conversely, where the continuous lines are far apart (as in region B), the raw scan data will have a lower resolution (relatively “undersampling”). In selecting or analyzing subtle watermark data, the CPU is first instructed to view the A area. The reason is that the quality of the raw data in this area is high, so it is likely that it contains usable watermark information. (In some embodiments, rather than waiting for the data to be remapped to its final form, the watermark selection and / or detection process is performed by referring to the raw scanline data. .)
[0324]
The two CCDs 218a and 218b perform various binocular processing to enhance linear scan data or enable more intelligent processing. For example, consider the case where the image being scanned does not carry a perfectly planar (eg, rectangular) signal. The substrate is distorted, the image is printed with a bend, or other deformation occurs, thereby producing an image that changes direction / dimensions beyond limits. One example is shown in FIG. This figure depicts a watermark calibration signal (shown here as a clear grid for clarity). Each of the two 2D CCDs 218a and 218b senses a calibration signal directed in a different direction. By referring to the difference between the data sensed by the two CCDs placed apart, the CPU infers the size, rotation, or other image deformation at the midpoint and scans to offset such distortion. Data can be corrected.
[0325]
Such correction does not necessarily need to be based on the watermark calibration signal. Appropriate corrections may be applied by inferring the same or related attributes at intermediate positions using other optically sensitive attributes at two spaced points.
[0326]
Two sensors 218 placed apart determine optically the distance from the scanner to the object to be imaged from two points. Consider FIG. Here, a scanner 10 having two CCD sensors 218a and 218b placed apart is shown, and an image of a distorted object 232 (for example, a bent paper base, a curved object like a drink can) is imaged. To do. The illustrated first CCD 218a detects a very sharp surface texture image, while the second CCD 218b detects an image similar to the first CCD, but as if it passed a low-pass filter. I am blurred. A part of the object 232 located under the CCD 218a is immediately adjacent to the scanner (and also touches the vicinity of the linear CCD array 216), whereas a part of the object under the CD 218b is The scanner recognizes the fact that they are arranged at some distance from each other by a software command to the CPU 212.
[0327]
By obtaining information about the spacing of the objects 232 from various parts of the linear sensor array, the data collected by the linear scanner can be reliably corrected. When detecting the watermark, the CPU recognizes that the data from the end of the linear scanner 216 that is remote from the object 232 lacks important high-frequency information. Many watermark detection algorithms allow the CPU to ignore data from such parts of the linear scanner. Thereby, it is possible to focus on the image data part having the necessary high frequency components and to produce more reliable results more quickly.
[0328]
In other watermark systems, there may be two watermarks. One was transmitted in dependence on the high frequency image component, and the other was encoded mostly with the low frequency image component (ie, the object was imaged slightly out of focus). Coded in anticipation of the situation). Recognizing that there are few high frequency components in the linear scan data, the CPU can be programmed to search for only low frequency watermark data.
[0329]
The scanner 210 can perform not only watermark decoding but also barcode decoding. The CPU 212 can apply a conventional pattern recognition algorithm to raw or final scan data. Once the pattern is identified, it can be easily decoded by applying a known barcode alphabet. As with watermarks, barcode decoding can be performed either spontaneously or in response to user / auxiliary device commands. Similarly, the decoded barcode data can be provided to the auxiliary device whenever detected, or in response to an auxiliary device query. 2D data can also be used to augment the information provided to the CPU for the purpose of assisting in the barcode detection / decoding process.
[0330]
Similarly, the advantages described above associated with the use of two 2D CCDs are equally applicable in the context of barcodes.
[0331]
As described above, once the identification information is extracted from the image data, the Internet link can provide supplemental information, an electronic commerce opportunity, and the like based on the information. In many embodiments, the scanner UI 220 can be used to provide this supplemental information to the user, for example, by software instructions that cause HTML instructions to be displayed on the UI display screen. When reconnecting to the Internet, this UI control (eg, button) can be used in the same manner to receive user commands and commands.
[0332]
[Mobile phones as Bedoupe devices; GPS receivers]
Bedoop technology can be incorporated into portable telecommunications terminals such as mobile phones (manufactured by Motorola, Nokia, Qualcomm, and others). Such a telephone can be equipped with a 1D or 2D image sensor, and the output from that sensor is sent to a vedoop decoding circuit in the telephone. This decoding circuit can be a main CPU of the telephone or a dedicated processing circuit for a bedoop function. (Also in this case, as in the other embodiments, the decryption can be performed by dedicated hardware, decryption software executed by a general-purpose CPU, or the like.)
[0333]
Cellular phones are already equipped with many functions that are convenient for bedoop operation. For example, a mobile phone typically has an LCD or similar screen that displays text or graphic information, and can be accessed from menu options displayed on the screen (eg, by moving the cursor). ) It also has a button to select, or other controls. In addition, mobile phones naturally have audio input and output devices (ie, microphones and speakers). Furthermore, since the protocol for transmitting data by the mobile phone includes data for identifying the mobile phone, there is no need to separately encode such data. The mobile phone then naturally provides a ready link to the remote computer system. In summary, the performance of such a mobile phone is comparable to that of a fully equipped desktop computer system. Thus, essentially all of the applications detailed elsewhere in this specification can be implemented using the mobile phone bedoop system.
[0334]
As with other Bedoop systems, when a cell phone senses Bedoop data, it responds locally to the data or, via the cell phone network, passes the data to a remote system (for processing). Or transfer to a computer network.
[0335]
One application that runs locally (ie within the phone) is to dial the corresponding phone number. In some embodiments, the phone number is encoded as is as part of the Bedoop data payload. In other cases, the telephone number is stored in a memory in the telephone, and a headline is attached based on the identifier decrypted from the vedoop data.
[0336]
The types of actions that can be handled remotely are virtually unlimited. Some of them require interaction with the user. For example, the remote system first responds by presenting an option menu on the screen to the user (e.g., purchase, add to shopping list, request sample, add notepad, etc.). The user then responds with further input (such as by manipulating one or more buttons on the telephone or by giving voice instructions to the voice recognition subsystem in the telephone). At this time, further input data is sent from the telephone and the requested action is executed. For other operations, no further interaction with the user is required, and the corresponding action is immediately executed.
[0337]
In the configuration described above, a bedoop decoding function is included in the telephone, but in other embodiments, image data can be transferred from the telephone and decoded at a remote location.
[0338]
We previously mentioned a GPS receiver as being able to track a person's location and update contact information accordingly. A GPS receiver can find many other applications in the context of the Bedoop. For example, the response to the vedoop system can be adjusted or changed based on the position of the person performing the action. For example, when a user presents a newspaper advertisement or coupon for a domino's pepperoni pizza meal on a mobile phone equipped with GPS, the GPS data is encoded into the vedoop data. , Sent to Domino's Bedoop server. The server refers to the GPS data to recognize the location of the closest Domino franchise and forwards the order to the franchise merchant. The franchise merchant in turn calls the user (refers to the phone number data from the mobile phone) to confirm the order, asks if there is any additional hope, informs the final price, You can hear your address. (The latter steps can be omitted. In other words, franchise merchants can use GPS data to find the corresponding street address from map data licensed through, for example, NavTech of Chicago) Can do.)
[0339]
Protocols for transmitting Bedoop data, GPS data, and mobile phone identification data from a telephone to a mobile phone network can take a variety of forms, and the design of such a system is designed by experts in the field. Is clear. In certain embodiments, when some mobile phones are receiving email or Internet access by protocol, the protocol is further modified to convey bedoop and GPS data. A protocol for transmitting telephone identification data has already been established. Therefore, when vedoop data is received by the cellular phone network, the data is converted into a packet format. It is done by incorporating GPS data and telephone data in the same packet structure, or by making such data in the form of individual packets with attached bedoop packets.
[0340]
By providing the mobile phone with an image sensor, other functions can be realized. One is to capture still or video images. Such image data can be compressed (generally an irreversible process such as MPEG, JPEG, etc., performed by dedicated hardware CODEC) and transmitted with the audio data. Such a phone screen can also be used to display incoming image or video data.
[0341]
Another function that the image sensor in the mobile phone can perform is user authentication before the phone permits a call. This is done, for example, by retinal scanning or other optically sensed metrology (biometrics). Many authentication techniques based on such quantitative biology are known.
[0342]
The mobile phone bedoop sensor is not always in communication with the mobile phone network. The phone may be out of the cell site or in an operating mode where no RF link is established. In such cases, any bedoop data to be sensed and handled remotely by the phone is stored locally within the phone and then sent to the cellular network when communication is established. Queued (this is an action that takes the form of a so-called “store-and-forward”).
[0343]
[Catalog ads]
The form of the portable scanner provides a convenient way to interact with catalog advertisements, whether of the type just described, or other types known in the art. For example, imagine a conventional paper catalog from L.L. Bean, Inc., or Lands End. Each image in the catalog is vedoop encoded with a code that identifies the product (and manufacturer, etc., if necessary) shown therein. A user looking through the catalog sees the product of interest and places the scanner on the photo (and optionally pushes a button or otherwise signals to initiate further processes) There is a need). The scanner detects the vedoop data and transfers it (optionally with data identifying the consumer) to the associated computer. When the computer polls a remote server computer maintained by the merchant, data corresponding to the item shown in the scanned image is returned. This reply data can include data indicating available sizes, data indicating available colors, data indicating various styles, flag bits indicating whether each item is in stock, and the like. This reply data is typically provided to the consumer on the display device or alternatively in an audible manner.
[0344]
The dimensions of the consumer's body (waist size, inseam, neck size, etc.) are stored in the user profile on the local computer or third party service provider computer at the vendor's server computer. It is desirable that This allows the system to customize the data provided to the user. For example, color options and availability may be shown only for the displayed shirts with a neck length of 16 inches and a sleeve length of 34 inches.
[0345]
If desired, the user can make a selection from color and style options using a portable input device (buttons, gestures, etc.) or other input devices. Or, the item may not require further details. In either case, once the desired product is sufficiently identified, the user can signal an order to the system. Payment and shipping details can be summarized in any of a variety of ways known in the art. For example, it is possible to charge a credit card number or ship to an address stored in a merchant.
[0346]
[Revenue distribution]
When a consumer presents a vedoop-encoded object to a sensor and purchases a product or service with a link established thereby, the revenue from that transaction may be divided by the parties that enabled the transaction. it can. In the case of a Bedoupe-encoded magazine advertisement, some of the parties involved are: (1) the photographer or graphic designer who created the artwork used in the advertisement, and (2) the creative talent. (3) The publisher of the magazine where the consumer met this advertisement, (4) The service provider that provided the transport channel between the consumer and the vendor, (5) Eventually vedoop data Service providers who have maintained servers linked to vendor websites.
[0347]
[Gambling application]
Casinos around the world are taking considerable steps every year to stop fraud. In response, game cards and chips used for play and betting are encoded with digital watermarks, which can be used to enhance safety. For this application to work, game cards and chips are encoded with data specific to each casino, game, card deck, and / or face value. At that time, the card or chip information is read using the camera provided on the game table. Information from the card can be used to record safety warnings or suspicious activity by:
[0348]
A camera placed on a card game table (such as Blackjack) reads the data encoded on the back of the card and determines the authenticity and face value of those cards. In other words, after a card is dealt, mark a card that is not part of the deck that is currently in use, or mark a card with a different face value from the card dealt to that player. By this, the camera can catch the person who wants to change the card. If the player tries to replace the card after it has been dealt, the watermark reader in the camera will warn of the security of the fraud.
[0349]
In addition, the data encoded on the card can be used to track the winner at that table. If the dealer and the player are conspiring, the player will be regularly awarded (based on a clever shuffle by the dealer) the cards to win. By looking at the pattern and face value of the dealt cards, you can determine if a player is winning with a much higher probability than average. Here again, security personnel are wary of suspicious behavior.
[0350]
A camera placed on a table for a game using a chip (of course, not limited to a card game) can be programmed to find the watermark in the chip. A chip that does not contain the proper watermark can signal that the chip may be fake. In another situation, when a chip is placed on the table, the face value of the chip is determined so that any replacement of the chip after the game has started will be noticed.
[0351]
The principles described above can be more broadly applied to surveillance and lookout systems that employ digital watermarking techniques to identify monitored objects.
[0352]
[Part II]
As already mentioned, the following disclosure focuses on one specific application that links print media to electronic content. But again, this technology is not so limited and can generally be thought of as a system that links objects (physical or electronic) to corresponding network or local resources. .
[0353]
According to a typical application for the technology detailed below, digital watermarks are used to print multiple magazines and articles in print media such as magazine advertisements and articles, direct mail coupons or catalogs, bank cash cards or credit cards, and business cards. Add a bit identifier. This identifier is read by software in the user's computing device and transferred to a remote database. This database identifies the URL corresponding to the identifier and returns the URL to the user's computer. Thereby, the browser on the user's computer can display the homepage specified by the URL. This home page can provide additional information and services in a more timely and / or large-scale manner than by a print medium. With such a configuration, the consumer can efficiently navigate and access the Internet, and the advertiser is provided with an effective means for linking the person who viewed the advertisement and the point of sale of electronic commerce.
[0354]
Before going into the detailed description, it may be helpful to outline a large-scale system that partially uses the techniques of the present invention. As shown in FIG. 1, this large-scale system is composed of four basic processes: registration, embedding, detection, and response.
[0355]
The registration process is a process for assigning an ID to an object and associating the ID with a corresponding action or response. Furthermore, the steps include recording the registrant's name and / or organization, product name, object description, context in which the object is found (magazine, book, audio track, etc.), and the like.
[0356]
An embedding process is a process that encodes an object having a digital identifier (eg, a watermark carrying a serial number in a payload).
[0357]
Detection is an operation complementary to embedding, that is, a process of recognizing a digital identifier from an object.
[0358]
Response is the process of taking action based on a recognized identifier.
The two steps in the middle, the embedding step and the detection step, use a myriad of known techniques. These technologies include one-dimensional (1D) barcodes, two-dimensional (2D) barcodes, magnetic ink character recognition (MICR), optical character recognition (OCR), optical mark recognition (OMR), and radio frequency identification (RF). / ID), data Griffith, organic transistors, magnetic stripes, metadata, file header information, UV / IR identifiers, and other machine-readable indicia and techniques for associating multi-bit digital data with electronic or physical objects . The detailed embodiment uses a watermarking technique, by way of example only.
[0359]
As shown in FIG. 2, the system 10 according to the embodiment includes an originating device 12, a router / server 14, a product handler 16, a registration database 17, and one or more remote resources 18.
[0360]
The transmission side device 12 can take many different forms such as a mobile phone, a portable information terminal (for example, palm pilot), a personal computer, a barcode scanning system, and the like. For convenience of explanation, in this embodiment, a personal computer will be described as an example of the device 12.
[0361]
Device 12 interacts with object 20. This object may or may not be electronic. The electronic object 20 includes a computer file, audio, video, or a still image representation (for example, a file or a streaming format). Non-electronic objects include newspapers, magazine pages, posters, product packaging, event tickets, credit cards, banknotes, and the like. Non-electronic objects also include sounds that are played on a speaker.
[0362]
Device 12 (FIG. 2), when used with a non-electronic object, typically includes some form of sensor or transducer 22 and generates an electronic signal or data corresponding to that object. Examples include CCD or CMOS-based optical sensors, microphones, barcode scanners, RF / ID sensors, magnetic stripes (as part of still or video cameras, flatbed scanners, mice, or others) A reader is included. In this case, the sensor 22 is coupled to corresponding interface electronics 24, which is coupled to device driver software 26, and that software is coupled to one or more application programs 28. The device driver software 26 functions as a software interface and communicates with the application program 28 at a relatively high level (eg, via API instructions that standardize content and format to facilitate application programming). Or relatively low level communication with the interface electronics 24.
[0363]
The detailed embodiment considers object 20 to be a magazine advertisement encoded with a steganographic watermark that conveys a multi-bit object identifier. This watermark is not visible to the human eye but is hidden in the advertising image in a way that can be detected by computer analysis. This analysis is performed by the watermark detector 30.
[0364]
The watermark detector 30 can be incorporated at a variety of different locations within the system of FIG. Typically, this detector is incorporated into the originating device 12, for example, in the device driver software 26 or in application software 28c that functions to link to external resources based on the detected watermark. . It may also be incorporated elsewhere, such as in the hardware of the interface electronics 24, in the operating system associated with the device, or external to the device 12. Some systems incorporate multiple watermark detectors at various locations within the system.
[0365]
In the illustrated system, a watermark detector is incorporated in the device driver 26. The function of the detector can be used by the application program 28c through one or more APIs specialized for the function related to the watermark. As one of the functions, there is a function of reading a watermark data payload from the object 20.
[0366]
The application 28c described here is a software program and functions to transmit watermark data from the device 12 to the router / server 14 via one or more links 32 (eg, the Internet). The application program 28c also receives information from the communication link 32 and provides it to the user (or uses that information).
[0367]
The router / server 14 is a large-capacity computer including one or more CPUs, memories, disks, and I / O ports. As is well known to those skilled in the art, disks store operating system software and application programs along with data, which are transferred to memory as needed by the CPU. The router basically functions as an intermediary between the application 28c and the product handler 16. As will be described later, the router receives requests from applications, records them in the transaction log 15, and passes them to the appropriate product handler.
[0368]
As described in detail below, the handler 16 responds according to a particular watermark payload. This response is sent directly to the device 12 by the product handler, or the handler responds by communicating with a remote resource 18 (eg, a data repository or service provider).
[0369]
In the former case, the handler 16 identifies the URL corresponding to the watermark (using the database 17) and returns the URL to the application 28c. Thereafter, the application 28c passes the URL to the web browser 28b in the device 12, and links to the Internet site identified by the URL. Alternatively, the handler may have locally stored data (eg, audio or video, or software updates) and send it to the device 12 in response to the watermark.
[0370]
In the latter case, the handler 16 does not respond directly to the device 12. Instead, the handler communicates with the remote resource 18 and responds. This communication can be as simple as possible, such as recording the receipt of a watermark message in a remote repository. Alternatively, the device 12 (or its user) may be authenticated against a remote resource, taking into account subsequent transactions (eg, communication may include part of an online contract or digital rights management transaction). No). Alternatively, a request can be made to a remote resource by communication, data or service can be returned to the device 12 or other destination (eg, activating FTP file transfer or selecting a song identified by a watermark in the user's personal music library Or download the software installed in the device 12).
[0371]
As another case, the above two cases may be combined. For example, the handler 16 may return data to the device 12 and communicate with the remote resource 18.
[0372]
In some cases, the device 12 may take further action in response to a response returned to the device 12 by the handler 16 (or remote resource 18). For example, the response returned to device 12 may include a Windows media audio file along with a request to launch a Windows media player installed on device 12. (Launching a browser pointing to a URL is another example of such action activation.)
The product handler 16 described here generally includes the same hardware components as the router 14, such as a CPU and a memory. Although only one product handler is shown in FIG. 2, several handlers can be located at the same location or can be geographically distributed so that the system includes them. Different functions may be assigned to different handlers (eg, providing a URL, providing music, etc.), or different handlers may be assigned to different watermark sources (eg, one of the handlers). One corresponds to the watermark found in the audio, the other corresponds to the watermark found in the printed advertisement, etc.). It may also be more specialized (for example, one handler responds to Ford ads, another handler responds to Chevrolet ads, or one handler responds to ads published in Wired magazine, Other handlers respond to ads in Time magazine). As a special embodiment, the router 14 sends incoming data to one of several handlers according to (1) the vendor of the originating application 28c and (2) the specific identity of the application 28c. There is.
[0373]
The following description focuses on data exchanged between application 28c, router / server 14, product handler 16, and associated protocols in one embodiment.
[0374]
[Operation concept]
When the watermarked image is shown, the application 28c analyzes the image and extracts the payload of the embedded watermark (details will be described later). The application sends some or all of this information to the router 14 in a message format.
[0375]
The router 14 decodes the received message and searches for vendor and product information. The router 14 passes a message to the corresponding product handler 16 based on this information.
[0376]
The product handler receives the message and tries to match the detected watermark serial number with the registered watermark serial number previously stored in the database 17. If they match, the product handler takes the desired action. As general operations, there are URL return for web redirection, provision of an HTML page for initial user navigation, start of software download, and the like. However, if the serial numbers do not match, the product handler returns an error code and message to the application 28c. If the corresponding operation is impossible, incomplete, inactive, or invalid even if they match, the product handler returns an error code and message to the calling application.
[0377]
FIG. 4 is a generalized view of the above-described operation.
[0378]
(Note that when the system is dedicated to a certain type of object 20 and a certain vendor's application 28c, the architecture configuration supports access to product handlers from other vendors and other corresponding objects. (This concept makes the system suitable for an information center that processes all machine-readable indicia on a web-enabled device.)
[0379]
Examples of detection and response cycles are shown below.
[Table 1]

[0380]
By generalizing this example, the system supports any product from any vendor and sends messages that match the expected request format (eg, product code, message type, identifier) to the Internet. And can receive messages in the corresponding response format. A set of message formats suitable for use in such a system is detailed below.
[0381]
[Watermark registration-first step of the process]
In order for the system to identify a response (eg, URL) corresponding to an object identifier (eg, watermark), this data must first be associated in the database 17 with the watermark associated with that data. There is. This watermark registration process captures basic identification information for later use to validate the input message and identify relevant information / actions. In the example shown here, the identification information is:
・ Customer account
・ Objects and related attributes (name, description, expiration, etc.)
·action
・ Registered serial number (for renewal of registration)
including.
[0382]
Identify watermark registrant by customer account. In most cases, this person is charged for the service. For validation and security reasons, the customer account must be a known and existing account. Account information including the account password is maintained by the account management system.
[0383]
The object and associated attributes identify the object to be watermarked. Object attributes generally include the name and description of the object, and a list of accounts that have access to object registration. The “support” account having these access rights is generally an advertising agency, a prepress house, etc., and is involved in the watermark embedding process in the print advertisement example considered here.
[0384]
The action defines the response that the customer wants when the watermark is detected. It varies from product to product, but the example described here involves returning additional information about the watermarked object. The action in the illustrated system is the return of a URL or HTML used to display the home page associated with the watermarked object. Desired responses to other products include displaying object owner and ownership information, downloading software / data, delivering streamed audio or video, advertising, starting object-based actions, etc. is there.
[0385]
The registered serial number is a component at the end of registration. It is a unique identifier for vendors and products assigned in this way so that the system can request specific information / actions for the object.
[0386]
Some key product registration concepts include:
[0387]
Watermark registration is a product specific process.
[0388]
The registration process is product specific so that each product can freely update its performance without affecting other product functions or schedules.
[0389]
The watermark registration is web-enabled.
[0390]
A typical registration is a web-enabled process that requires basic identification information from the object owner (publisher, advertising agency, studio, etc.) and has a unique identifier embedded in the object. Return the packet it has to the registrant. The watermark embedding application (ie, software) uses this packet to embed the watermark type and serial number in the client object. In the illustrated system, only one watermark is embedded in a single object. In other embodiments, multiple watermarks are embedded in a single object.
[0390]
When a customer registers a watermark, the system associates the watermark serial number with information provided by the customer during the registration process. This related information varies with different products. The following table shows a set of related information for a typical magazine advertising object:
[Table 2]

[0392]
Watermark registration expires.
[0393]
Some products have a limited watermark validity period. For these watermarks, the registration process uses an expiration date for the assigned serial number. If the system receives a message requesting action on an expired serial number, an error is returned. The registrant updates the expiration date to extend the expiration of the watermark serial number. The extension of revocation becomes a charge to the customer.
[0394]
Watermark registration can be completed in one or more web sessions.
[0395]
Registration can be a single step or multi-step process. If the media owner has all the requested information at the start of the process, the system provides a simple web-enabled method for requesting a watermark serial number online. With all the information given, the registration is considered “active”. That is, customers can use it directly. If a registrant does not have all the request information available in the first session, the registrant can provide an embedded process by providing a minimal set of information (eg, name and / or organization name and product) Still issue product watermark serial number for use in. This partial registration is most commonly used when the action associated with the watermarked media (eg, URL, etc.) is not known. A partially registered serial number is "inactive" until all requested registration information is complete. If processing of an “inactive” serial number is requested, the system issues an error message. These registrations, whether active or inactive, are considered billable items according to the terms and conditions of the applicable contract.
[0396]
The customer updates the registration to reflect the new information and / or completes the previous registration session. For example, a registered customer can request a watermark serial number without specifying the URL used to redirect the customer. The system assigns a serial number so that the customer can continue the embedding process, but registration is complete until the customer completes registration with the URL and other required information related to this serial number. Is not considered.
[0397]
Watermark registration is secure.
[0398]
Only a registrant and an account authenticated by that registrant can use a particular watermark registration.
[0399]
In the illustrated system, a customer account that registers a watermark grants permission to a particular advertising agency and / or prepress house so that certain fields in the registration can be changed as part of normal work. Customer accounts are set up as part of the contract process. For advertising agencies and prepress houses, accounts are set up as needed through a management website available to customers.
[0400]
All products have the same basic principles and are restricted so that only authorized accounts can use the registration information. The account is password protected. Advertising agencies and prepress houses share a single password. In other embodiments, each is assigned a unique password.
[0401]
Changes to the watermark registration are recorded.
[0402]
All registration actions, ie creation, modification and deletion, are recorded in the audit record. The authenticated user name, action date / time, and the action itself are all stored to provide a complete audit trail.
[0403]
FIG. 6 illustrates the process and data flow associated with registration.
[0404]
[Data input to the registration database]
In the context of watermark information detected by the media object, the client application, router, and product handler were first described, but the same conceptual infrastructure is used in the early stages of the process to enter data into the registration database 17. That is, publishers, advertising agencies, prepress houses, etc. use (a) initial data to the database, (b) update the data, using appropriately set variables in application 28c, (c) Queries the database for the current value. Alternatively, a dedicated registration server 19 (FIG. 2) is used.
[0405]
Encapsulating the recorded content of the database for a particular watermark in the file allows multiple parties to be easily involved in the registration process. Information is continuously added (or updated) by various entities to the file, and data transmission is performed between the entity described in the database 17 using the file.
[0406]
Assume that Nike places an advertisement in Wired magazine. Wired's advertising department agrees to sell paper upon request from Nike media buyers. Wired initiates the associated watermarking work by entering a specific watermark identifier by the operator of system 10. (This step and most of the subsequent steps can be performed by a computer, which is a computer that can communicate according to instructions by appropriate software used by various subscribers. Although the registration server 19 in the discussion, as already mentioned, the product handler 16 may be arranged to perform such a function.) Wired gives the operator an issue identifier (e.g. San Francisco version of the monthly issue) and internal tracking information used by magazines. The registration server 19 responds by sending a confirmation file to the wired by e-mail. This file encapsulates the previous information (that is, watermark identifier, issue ID, magazine tracking information). Server 19 generates a new database record and analyzes the received information in the corresponding field of the record.
[0407]
Wired forwards the file received from the registration server to the Nike media buyer. Nike adds additional data to the information, including advertising names and internal tracking information. The updated file is transferred to the server 19. The server processes the file again and updates the database record with new information. The confirmation file is sent by email to both Nike and Wired, so each has the latest information.
[0408]
Processing is performed in this way, and each entity provides new data to the registration server 19 by the capsule file that has been e-mailed. The server updates the corresponding database record and sends the updated capsule file to the identified subscriber, so that each subscriber has the latest information.
[0409]
Through this process, once Nike enters the data, the capsule file is transferred to an external advertising agency. The advertising agency handles the file in the same manner, adds specific information, and transfers it to the server. As a result, the server updates the database record, adds the advertising agency to the mail distribution list for file encapsulation, and sends the latest version of the file to Wired, Nike, and the advertising agency.
[0410]
Next, the prepress house and the like are involved.
[0411]
The recognition of the URL to which the watermark ID corresponds and hence the database record update that occurs is not done until near the end of the process.
[0412]
The same process allows anyone to provide additional information to the database at any time and share that information with others. (Some information is not suitable for distribution to all subscribers and can be marked accordingly.)
[0413]
Server 19 need not always be a hub through which all communication takes place. For example, a file updated by Nike is transferred directly to the advertising agency by Nike. After the information is added, the advertising agency provides the server or the like with the file that has been updated twice.
[0414]
Using the delivered file as a substitute for the actual database record has many advantages. One is that all subscribers can get the latest information locally without the need for an Internet connection. Therefore, even if a creative manager wants to work on the beach or is disconnected from the internet, he can obtain the necessary information. Another advantage is that the software tools at each subscriber are not required to be architecturally difficult, such as interfacing with a remote database, navigating attendant authentication and security barriers, Integration with local data unique to a particular advertisement is facilitated.
[0415]
In the above discussion, reference was made to e-mail files, but general e-mail programs cannot be used normally. Instead, each subscriber uses a special file management / mail program to better manage attendant operations (logistics). The program tracks the latest file for each advertisement and indexes it by various content fields so that it can be updated immediately as requested. Therefore, the user interface presents a file list grouped or classified by the database field, so that information can be edited or added simply by clicking a predetermined field or tab.
[0416]
Needless to say, the above file distribution system is not indispensable for this system. Of course, a wide variety of other configurations can also be used. One is that each subscriber logs on to the server 19 to check or update appropriately authorized database fields as needed.
[0417]
[Numbering method]
Payload information encoded within an object (eg, by a watermark) can take multiple forms and sizes. The following is a typical classification:
(A) Region-based payload segmentation
(B) Customer / use-based payload segmentation
(C) Non-segment payload
(D) Unique ID
[0418]
[Area-based payload segmentation]
Divide the payload into fields using a region-based payload segmentation approach. Each field has an individual meaning. The CLASS / DNS / UID configuration described above is an example of this type of approach.
[0419]
Consider a 60-bit payload. Twelve bits constitute a class ID, which functions as an identifier of the most important area. Of the other bits, 24 bits make up the DNSID, which identifies the intermediate level region. The class ID and DNSSID together identify the class of the object that is the data source, the customer, and the server that responds to the payload. (Some responses are processed at the client computer rather than sent to the remote server.)
[0420]
The remaining 24 bits are the user ID, which functions as the most granular identifier and indicates the specific source of the payload. The responding server knows exactly which response is provided based on this ID.
[0421]
The entire payload is embedded in the customer object. When the client computer detects the payload, the application 28c analyzes (decrypts) the payload by dividing it into a class ID field, a DNSID field, and a user ID field. One or more client-side or server-side programs are started using the class ID. Once “get up”, these products use the class ID along with the DNSID and user ID to complete the desired action.
[0422]
One of the class IDs indicates that the object is a magazine page. Based on this, the application 28c directs the payload to the router / handler described above for the purpose of response. The other class ID indicates that the object is music. The application again causes the payload to go to the same router. That is, the application directs the payload to a service maintained by the Music Industry Association for response. The other class ID also indicates that the object is a grocery package and directs the payload to an online grocery store for response. Yet another class ID indicates that the object is a business card and the payload is processed locally at the client machine. The mapping between class IDs and the corresponding response mechanism to which the payload is directed by the application 28c are maintained by a database associated with the client computer's operating system (eg, Windows registry), as described above.
[0423]
Once the payload is sent to the appropriate response destination, the entity examines the DNSID to further distinguish the correct response entity. For example, in a tree-like server, various IDs correspond to various classes of servers.
[0424]
Once the payload is directed to the correct class of server, the user ID defines the terminal “leaf” in the tree (eg, a database record), which will ultimately indicate a response.
[0425]
[Customer / use-based payload segmentation]
The second approach also uses payload segmentation techniques. However, in this configuration, the first field defines the interpretation of subsequent bits (eg, various segmented fields).
[0426]
Even in this case, it is assumed that the payload is 60 bits. Twelve bits can be used as the version ID. These bits indicate how the subsequent bits are parsed and interpreted, as well as the particular application program 28c to be used (like the class ID in the approach described above). Thus, the version ID bit serves to indicate the payload type. In the illustrated embodiment, one of those types indicates that the source of the payload is a magazine page and should be handled accordingly. In that case, the remaining 48 bits can be analyzed by dividing into three fields of owner ID (15 bits), publication ID (15 bits), and media ID (18 bits).
[0427]
The owner ID indicates a customer (for example, Nike) who registers a watermark. This is used for advertising effect analysis and billing purposes. The publication ID indicates a specific publication (eg, San Francisco version of Wired magazine of July 2000). The media ID indicates a specific page position in the publication.
[0428]
As already mentioned, the entire payload is embedded in the customer object. The payload is first analyzed to determine the version ID. If the user device 12 is programmed to handle such an object locally, further analysis is performed according to the data corresponding to the version ID, and related processing of the analyzed data is also executed. If the device was instructed to send a payload to a remote location for service, it did only the detailed analysis (if any) required to accurately identify the entity that provided the corresponding remote service, if any Can send the correct payload.
[0429]
[Non-partitioned payload]
A non-partitioned payload consists of only two parts: a version ID (described above) and an object ID. In a specific example, a 60-bit payload is used again. Of these, 12 bits serve as version IDs and the remaining 48 bits serve as object IDs.
[0430]
In this approach, owner / customer, publishing, publishing, and media relationships are all maintained in the database 17 rather than being shown in some way in the object identifier.
[0431]
[Unique ID]
This is similar to a non-partitioned payload, but consists of a single field called a unique identifier. The same application 28c is always used, and the payload data is handled consistently regardless of the contents of the payload (for example, processed locally or sent to a predetermined destination).
[0432]
Of course, a combination or combination of the above approaches can also be used. The payload length of 60 bits is merely an example, and a longer payload (for example, a maximum of 1024 bits) or a shorter payload (8 bits) can be used as a matter of course.
[0433]
A specific embodiment uses a 32-bit unpartitioned payload consisting of a 10-bit payload type and a 22-bit watermark serial number. Some materials (eg, advertisements containing composite graphics) can be encoded with several serial numbers. The mapping between the payload and the owner / publishing is maintained in the database 17.
[0434]
(As described above, the data sent from the application 28c usually includes information other than the identifier payload. For example, the type and version number of the application 28c, the electronic address of the transmission application, etc.)
[0435]
[Router]
The router 14 allows any number of different products to be used depending on the sign detection and response model. By separating these functions and leaving them as general-purpose, new products can be added without changing the design of existing products or product handlers 16. Two keys to the success of this approach are speed and flexibility. By using a standardized and published interface, the router enables both of these two goals.
[0436]
A premise of a typical interface is the siege technology, which allows the router to “open” the outer transaction seal and without decrypting the rest of the transaction (message) The vendor and application ID can be extracted. Given these two pieces of information, the router uses a simple lookup table to determine if the product handler is suitable for completing the transaction. The router then passes the vendor, application, transaction rest, and Internet "reply" address to the appropriate product handler. Although this handling is simple, routing delays are minimized, but the actual response processing for vendor / product specific handlers is delayed. By including the “reply” address in the data passed to the product handler, the router is freed from the burden of routing return to product responses.
[0437]
An overview of routers:
1. Decrypts the request packet received from the customer product into the vendor ID, application ID, and message that are the basic components of the packet;
2. Verify the basic components of the request packet against a list of known and correct values;
3. If a request packet element is found to be invalid, issue a message informing the invalid element and return it to the originating session (eg, product);
4). Send the contents of the decrypted request packet and the recognition result of the outgoing session to the appropriate product handler;
5. Any errors encountered, including invalid packets received, are reported to the system monitor.
[0438]
FIG. 5 shows the data flow associated with the router.
[0439]
[Product Handler]
The main function of the illustrated product handler 16 is to process a request received from the application 28c via the Internet and the router 14 and return request information / action to the originating device 12. In certain embodiments, the requested information is a URL associated with a watermark payload sent from the application. In other embodiments, other actions and / or information are required.
[0440]
Each received watermark payload is verified using information in the database 17. If a watermark payload ID is found and it is active, the requested action is performed. If the watermark payload ID is not found or if it is inactive, an error message is returned to the requesting application.
[0441]
Record all requests in the transaction log for tracking and billing purposes. This includes second payload information (eg, zip code, demographic household ID, etc.) passed by application 28c.
[0442]
In order to speed up the response of the system, the product handler 16 proactively sends the URL to the application in response to the arrival of the watermark payload predicted by the handler. These URLs are stored in the memory associated with the application 28c and are called up immediately when the application requires it.
[0443]
For example, consider a magazine that contains a watermarked advertisement. When the user passes the first advertisement to the device 12, the watermark is decrypted and forwarded to the product handler 16. This is in response to the URL corresponding to the advertisement. Then, the application 28c passes the received URL to the web browser 28b on the device 12. As a result, a link is established to the Internet address. But here the handler knows which magazine the user is reading. The handler refers to the watermark originally received and recognizes, for example, that the user is reading the San Francisco edition of March 14, 2000 in Time magazine and is just looking at page 85. Based on this information, the handler can query the database 17 for URLs related to other advertisements in the issue. (The database index is configured to allow fast queries that recognize all advertisements in a given magazine issue or other general data source.) These URLs are returned to the application 28c and stored. Next, if the user presents an advertisement of page 110 to device 12, application 28c knows that the advertisement already has a corresponding URL stored locally. Then, the application passes the corresponding URL to the web browser. Web browsers link immediately to avoid data going back and forth between the application and the remote system.
[0444]
The cache can be optimized in various ways. As one of them, there is a method in which a URL corresponding to a page that is supposed to be viewed next is sent first. For example, after the user has just shown page 85 to sensor 22 and sent the URL for that page, handler 16 then sends the URL associated with pages 86, 87, etc. When the URL for the last page (usually the back cover) of the magazine is sent, the handler sends URLs up to 84 pages starting from the beginning (usually the front cover). Another optimization method is to store the URL of the main advertisement first, for example, send the URL of the advertisement that spans two pages first, then send the URL of each full-page advertisement, and then sequentially Send URL of each small advertisement that occupies a part Another approach is that the handler 16 sends a URL to the device 12 and stores it in the priority order agreed upon by the contract. For example, an advertiser pays a premium advertising fee instead of being cached before other advertisers who do not pay a premium. Other cache priorities and combinations of these orders can of course be used.
[0445]
In some systems, advertisers or publishers pay for the system based on the number of URLs that the system provides to link. When the URL is cached locally (for example, in the device 12), it is preferable that the device 12 notifies the router 14 (or the handler 16) of the URL that is actually taken out of the local cache and used for establishing the link. . By doing so, the remote system can record the same URL. Thus, whenever the user presents an object to the sensor 22 for which the corresponding URL has already been cached, the application 28c sends a message to the router 14 to report the event (usually a specific URL is involved). ing). This event is then recorded in the transaction log.
[0446]
Sending the URL in anticipation in this way is one optional function performed by the product handler. Another is the ability for application 28c to query the product handler to determine if a more recent version of the application can be downloaded. If so, the application requests the product handler to respond to the software download through interaction with the user.
[0447]
More specifically, the application 28c can periodically query the product handler for the latest version of the application 28c (eg, when the application is first used on that day). If the version of device 12 is 3.04 and the remote system responds as version 3.07 is the latest version, then application 28c may provide the user with appropriate text, graphics, or other The means warn that a more recent version of the program is available and inquire whether such a latest version has been obtained. If such an instruction is given to the user, the handler 16 provides the device 12 with the latest version of the program (or a patch that can update the currently installed version).
[0448]
Sometimes it is not necessary to update the application version. Data from the remote system may indicate the validity or necessity of changing only one or more parameters in application 28c. For example, the handler 16 may periodically send a new security key to the device 12 and use the key to change the security configuration of the application. Alternatively, an instruction may be given to the application 28c, and outgoing watermark traffic may be further sent to different routers 14 until the next time, day, or until another instruction is given. By using such instructions, the performance of the system can be optimized, for example, Internet routes that have been found to be slow can be avoided to balance the load on the router.
[0449]
In summary, the handler details are as follows:
1. Determine the validity of the received identifier (eg, watermark serial number) for the list of active identifiers, and if the serial number is not found, return an error message to the originating session and record the error in an error handling routine;
2. For each received valid watermark serial number, find the corresponding active primary action from the database;
3. For each received valid watermark serial number, if the handler detects that the corresponding primary action is not currently active, the handler will instead perform a “default” action;
4). If the handler detects an active primary action associated with the received valid watermark serial number, the handler returns a URL for the application in redirection (round trip approach) or provides the detected HTML page to the originating session Do;
5. If the handler does not detect an active primary action associated with the received valid watermark serial number but detects an associated default action, the handler returns a URL for the application in redirection (round trip approach), or Provide the detected HTML page to the originating session;
6). If the handler cannot detect a valid and active primary or default action associated with the watermark serial number, the handler returns an error message to the originating session and records the error in an error handling routine;
7). Record each transaction, including those that result in error messages, for billing and analysis purposes (in other embodiments, the router performs this function);
8). Respond to a “software version request” by returning the latest available application software version number to the originating session;
9. Respond to a “software download request” by initiating a file transfer of the latest available application software to the originating session;
10. Respond to a valid registration packet upload request (proper format, existing serial number, account ID, valid corresponding account password) by returning the current registration packet for a given watermark serial number;
11. Respond to invalid registration packet requests by returning an error message indicating failure to the originating session;
12 Respond to local transaction cache flush requests by writing locally cached transactions to the transaction log;
13. First, respond to multiple URL requests by returning the URL associated with the provided serial number, and then by all other active serial numbers provided and the URL for publication, publication, and region code (optional) Correspond.
[0450]
FIG. 6 illustrates a portion of the above-described process associated with a product handler.
[0451]
[URL performance monitoring]
Returning to system operation, URLs recognized in the database may become inoperable or fail from time to time due to equipment problems at the remote website, or other problems. If necessary, program the handler 16 (or other component of the system) to test each link registered as active in the database periodically (once a day) and associated Measure homepage load time. If the homepage cannot be loaded or takes more time than usual (retests have confirmed that the condition is normal), these conditions can be noted in the corresponding database record. If the handler requests that such a URL be provided to the device 12, the handler sends a message with or without the URL to indicate to the device that the URL is behaving improperly.
[0452]
If the URL is working but the load is extremely slow (compared to its past performance or other URLs), the handler 16 sets a temporary detour for the device 12 To do. For example, the handler may instruct the device to launch a second browser window and direct the browser to an alternate destination to entertain the user while waiting for the intended page to load Can do. When the intended page is finally loaded, the first browser window is displayed. At that time, the second window for diverting attention is closed, or the first window is brought to the front while the second window is kept alive.
[0453]
This alternative destination is preferably a low bandwidth page, and if so, will not be unacceptably slower to load the desired URL. This alternative page is selected by the handler and the URL is sent after the desired URL. Instead of providing a URL from the handler, the handler can provide HTML or other pages directly to the device 12. Alternatively, if an alternative URL is stored in the device 12 and data is received from the handler 16, the second browser window is called using the alternative URL to indicate that the desired content is late. In some embodiments, the user can recognize several alternative URLs (eg, weather, stock information, jokes) from which the handler or application 28c can choose any or other ways. Alternatively, an HTML page or other application can be loaded locally in the device 12 in response to a “ready to wait” display from the handler 16.
[0454]
If the URL in the database 17 is marked as slow or inoperable, the scan operation periodically rechecks the URL and whether its status in the database has changed (eg changed from inactive to active) Whether or not) Inactive URLs are reported to registrants via email and provide an indication for manual follow-up if they do not return to action within a predetermined period.
[0455]
[Specific response by product handler]
Part 1 above provided a sample of the various applications that are possible with the illustrated system 10. Details thereof will be described below.
[0456]
Consider the case where a handmade greeting card is made using the system 10. The company that makes the greetings prepares a watermarked press-on sticker for use with the card or other letter. The customer shows the sticker to a computer with a camera (at a retail store, home, or elsewhere). The computer decrypts the watermark and sends it to the corresponding product handler 16 via the router 14. The handler recognizes the watermark as an unregistered greeting card sticker and causes the customer to input a destination URL such as the customer's personal home page. This information is entered by the customer and transferred to the remote system for entry into the registration database 17. Thereafter, whenever a sticker is shown to a properly operable system (eg, a card receiver), a browser window is automatically launched and directed to a homepage specified by the shopper. (Of course, even if a sticker is not used, for example, the same effect can be obtained by encoding the greeting card itself.)
[0457]
In some applications, the product handler has a library of various responses that can be provided to the user under special circumstances, depending on the user's further choices. Consider a college student with a suitably watermarked college ID card. When this card is presented to the device 12, the product handler responds with an HTML command that causes an options menu to appear on the device screen. For example, the following:
1. Review the schedule of upcoming university events
2. Review the schedule of upcoming sporting events
3. Review the current class schedule
4). Choose the course for next semester
5. Review your grades
When the student makes a selection (eg, with the mouse or moving the ID card in a specified manner), the application 28c sends data corresponding to the selected option to the product handler, which responds to the requested data.
[0458]
In some cases (for example, reviewing current class timetables, selecting courses for the next semester, reviewing grades), such information may be obtained from a person attempting to access using a lost or stolen ID. Care must be taken to protect it. Thus, whatever option is selected, the handler 16 first queries the password or PIN and responds to the device 12. Only after entering the correct password / PIN the requested action is performed. (For security reasons, the university chooses that the password authentication process is performed by a dedicated campus server rather than by the product handler 16. Of course, the handler 16 is the best match for the situation. This task and other tasks can be delegated to other processors.
[0459]
In other cases, it is not necessary to present an option menu, and a correct response is inferred from the situation or surroundings. Consider a driver's license that is watermarked with the owner's identification number. When presented to the e-mail Kioks 12 at the airport, the decrypted watermark is used to locate the personal e-mail account and download a new e-mail. If the same driver's license is presented to the check-in kiosk, the decrypted watermark is used to check the individual's flight reservation and issue a seat assignment. In either case, the kiosk is basically the same. However, in some cases it is referred to as an email kiosk to the router / product handler, and in other cases it is referred to as a check-in kiosk. In response, the response by the router / product handler changes.
[0460]
Returning to the university example, the student may be encouraged to swap the photo of the student ID, for example, a replacement may take a graduate qualification exam on behalf of an unqualified student. Usually, such replacement of pictures is difficult to detect. This problem can be countered by a test check-in procedure, including a procedure that causes each student to present an ID to the device 12. The application 28c specialized for this task transfers the watermark decrypted from the photograph of the ID to the handler 16, and the video of the recognized student is displayed on the device 12 in response thereto. (The university can create a necessary database of student videos when issuing an ID card.) Appropriate if the test director knows that the video on the device does not match the video on the ID card Can take action. (This configuration can be applied anywhere that uses photo ID documents, including airport check-in, customs, immigration, etc.)
[0461]
Other applications of the illustrated system include finding or acting on metadata associated with the marked object. Consider an image, video, or audio file that a user downloads from the Internet. Well-known applications, such as Microsoft's Windows Explorer (including Internet Explorer), consist of a watermark decoder, which right-clicks on the file icon or file name (for example, "Properties" Can be activated from the properties panel, for example. Once the watermark in the file is detected, the explorer application can send a corresponding packet to the remote system (eg, the router / product handler / database described above). The remote system recognizes that the packet is generated via the Windows Explorer property panel, and searches for the watermark ID in the database 17. Metadata corresponding to the file (eg, owner, creation date, permission period, exposure data, subject, etc.) is returned from the database 17 (or router, handler, or other database recognized by the database) to the application 28c. And displayed in the properties panel (selectively under the appropriate "tab").
[0462]
(The assignee has long provided a “Mark Center” service that acts as an information center, thereby using the watermark identifier found in photos, etc. In this embodiment using this service, the router 14 passes the request to the mark center service (product handler in this example), which returns response type information to the originating application. The assignee's Mark Spider service supplements the services provided by media commerce products. The Mark Spider service constantly searches the Internet site and reviews each graphic it encounters to determine if it contains a watermark. (Audio and video can be analyzed as well.) The mark spider service uses each detected watermark to record the graphic file name, size, format, date / time, and URL where the graphic was found. This information is then made available to Mark Spider customers in report form.
[0463]
Rather than simply displaying metadata, applications and / or remote systems can also make use of it. For example, a remote system can be used as a license server if the metadata indicates that the owner of the watermarked image is Corbis and the image can be authorized for a specific use for a specific time period. That is, it can be used to receive payment information from a user, grant a license, and transfer transaction details to Corbis.
[0464]
Another application is the sale or promotion of music or video on the Internet. Taking music as an example, an artist can distribute a low-fidelity (or falsified or simplified) version of music for free. The low fidelity is due to bandwidth limitations (eg, 500 Hz to 2.5 kHz), monaural (relative to stereo), or for other reasons. The artist distributes the low fidelity version as broadly as possible and tries to act as a marketing agent for the artist's other works. (Some of the network bandwidth problems faced by universities, such as students actively transferring free music over the Internet, are alleviated thanks to the free delivery of narrowband audio.)
[0465]
Each low-fidelity version is processed and an identifier (eg, an in-band watermark using steganography, a numeric ID or music / artist name field in the file header, a 128-bit obtained by applying a hash algorithm to the music data A hash value, music file header data, and the like). If the listener wants to have a full faithful version of the work, the listener operates a moderately programmed computer or music device. They extract the identifier from the work and pass it to the remote system. The remote system can respond in various ways. For example, providing a user with a full fidelity version of the same work (such as an MP3 download) and charging the user's credit card (eg, $ 0.99) or a web browser on the user's computer To e-commerce / fan websites related to the music. Such a function can be provided in a general-purpose program such as Microsoft Internet Explorer. For example, right-clicking on a file obtains a menu including this function and related functions.
[0466]
8-10 show a series of screen shots in such an embodiment. In FIG. 8, when the user right-clicks the MP3 file icon in the directory list 200, the property menu 202 including the second option “MP3 bridge” appears.
[0467]
FIG. 9 shows what happens when the user selects the MP3 bridge option. The MP3 player 204 starts up and a dialog box 206 appears. The dialog box asks the user "Do you want to know more about the artist? Yes No".
[0468]
FIG. 10 shows what happens when the user answers “yes”. The software sends the identifier extracted from the MP3 file to the remote system. The remote system responds with the address of the relevant home page and instructs the user's computer to launch a new browser window that leads to that page.
[0469]
Needless to say, similar functions can be launched via the user interface of an MP3 player (or a Windows media player, etc. rather than via Internet Explorer). The music application divides the window or presents options and associated data in an existing window.
[0470]
Another application for remote systems is the “net nanny” filter. Only when the link required through the system is checked for keywords, special mentions for adults, content assessments, or other age-appropriate signs, and meets the specific criteria selected above, A link is established to the requested computer 10.
[0471]
It should be understood that the above examples are just a few of the myriad applications possible with a detailed system.
[0472]
【report】
System software provides customer-accessible (accessible via the Internet) reports that are detailed and schematic by date, customer, publication, publication date, region, product / version, etc. Shows usage information. These can be regular reports or extraordinary reports. The content, relationship and timing of the report can be specified online by the customer.
[0473]
An example of the details of the report is as follows:
(A) Hit rate / transaction per advertisement per customer
(B) Hit rate per transaction per publication per customer
(C) Hit rate per transaction per publication per issue per customer
(D) Hit rate / transaction per customer per publication per issue per region per region
(E) Originating application (28c) Hit rate / transaction rate for each
(F) Hit rate / transaction by sender application vendor
(G) Hit rate / transaction rate by originating web domain (eg, aol.com)
(H) Hit rate / transaction rate by zip code
(I) Hit rate / transaction by country.
[0474]
Additional marketing / market reports can be generated for internal analysis by service providers and sales to other entities. These reports usually provide a more international view of the effectiveness and use of the system. By using information stored in the demographic database in conjunction with usage patterns, the system can provide customers and research institutions with more detailed demographic / statistical data regarding the use and effectiveness of the system.
[0475]
The illustrated system takes from a sample of users who have agreed to be able to track behavior in some detail, taking into account certain services (eg, free cameras, bar code reading pens, or other tools). The statistics of the demographic database are created using the statistics. These users are called demographic households. The software program contained in this system collects information shown in detail in the following table from these users via the Internet by means of a web-operating interface. These users can update / edit previously entered user / household information via an associated program. Each session is password-authenticated for safety.
[Table 3]

[0476]
[Audio and video]
Similar to newspaper advertisements, the illustrated system provides users of PCs or other devices connected to the web with access to information, content, related products, or related services based on the same principles described above.
[0477]
For example, application 28 uses a recording device (note recorder, PC connected microphone, MP3 player, etc.) to “capture” music or other audio, analyze the captured audio, and embed it. The detected watermark can be detected. Once detected, the application passes some or all of the watermark payload information to the router along with the application identification number and its vendor. The router transfers the payload information to the handler corresponding to the application. Product handler responses vary depending on the context and nature of the data. For example, the handler returns the artist, title, track, album, web URL, and purchase information to the user. A recorded news and entertainment segment includes a record of that segment (audio, video, and / or text), along with other relevant website information. The handler only allows the device 12 to launch a browser window directed to a music trading website where music can be purchased.
[0478]
【Security】
The basic safety concept of the system is to allow access to each customer information only to users authorized by the customer. Therefore, the system is preferably as follows:
1. Create and manage a list of authorized users (accounts)
2. Adopt safeguards to deny access to unauthorized users
3. Restrict users to access only the objects they are allowed to access (generally the objects belong to the customer)
4). Report and record all unauthorized access attempts
5. Maintain a record of all authorized user logins (sessions)
6). Give watermark registrant the right to grant access to other accounts (such as advertising agencies and prepress houses)
7). Set an initial password for each account
8). Give each authorized user / account the ability to change passwords
9. Gives the right to reset the password of an authenticated user / account when the current password is lost
10. Store all passwords as encrypted values (to prevent password theft)
11. Give authorized users the ability to restrict the creation, modification, deletion, listing / viewing of account information.
[0479]
[Audit Trail]
Because of the financial implications of system operation, any changes to registration or customer data should be recorded. This audit trail provides operators and their customers with an accurate account of the current and previous status of the data.
[0480]
The audit program preferably records the creation, modification, and deletion of all registration and customer data. The audit program also records the user name, date / time of creation / change / erasure of records, and for changes, the images before and after the data was changed.
[0481]
[Application and product handler interface specifications]
The basic principle of the interface between the application 28c and the handler 16 is (a) an adaptive request and response package structure and (b) a clear connection method based on industry standards. The illustrated messaging employs the http and / or https protocol to send and receive messages between system components. The outline is shown in FIG.
[0482]
Message format:
The message format is XML compliant and is defined by the following XML LDTD:
<! DOCTYPE list [
<! ELEMENT Content (vendor, appl, prod)>
<! ELEMENT ventor (#PCDATA)>
<! ELEMENT appl (#PCDATA)>
<! ELEMENT prod (#FCDATA)>
]>
[0483]
The application 28c adds data to this header for transmission to the product handler 16. Typical examples of messages and product handler responses are detailed in the following sections.
[0484]
Application message rules:
Application message specifications can be divided into request codes, primary information and secondary information.
[0485]
The “request code” instructs the product handler 16 to perform a specific action.
[0486]
The “primary information” section includes data that is required to provide services appropriately in response to application requests. The primary information changes based on the request code.
[0487]
“Secondary information” is intended for use in analysis and reporting tools and does not give instructions or support to product handlers in providing services to user requests. The content of the secondary information varies based on the request code, but not all request codes are required to have associated secondary information. Furthermore, most of the secondary information requires the customer to give express consent to the collection. If consent is not obtained, the application does not send secondary information. There is a special case for the selection, and the consumer agrees to become part of the demographic database.
[0488]
The primary and secondary information varies depending on the type of request, but generally follows the following rules: The general format for product handlers is also specified below.
[0489]
"Primary information" includes application version, watermark type, watermark serial number, context and environment:
● Application version: Depending on the product handler, the action
Used to change the password, typically used for backward compatibility
• Watermark type: The upper 9 bits of the illustrated watermark payload.
Used by product handlers when processing a scarecrow serial number
Watermark serial number: The rest of the watermark payload. Product Han
Provides an index used by Dora in the registration database
Access the watermark
● Context: Gives the product handler instructions and the context of the customer request
Change / improve actions based on
● Environment: Give instructions to product handlers and take action based on customer requested environment
Change / improve the environment (environment is, for example, home, office, car, porter
Specified as a portable device).
[0490]
Of course, other request codes can be used. Each has its own list of required and optional primary information fields. Optional fields are excluded from primary information when there is no associated value.
[0491]
Secondary information: Demographic household ID: Identifier of the selected demographic group. This is used as an actual demographic index
● Input device: The manufacturer and model of the device used to detect the watermark
, And version (eg, TWAIN driver string)
● Operating system: The operating system used on consumer PCs
System
Processor: The processor type / class of the consumer's PC
Processor speed: Clock speed in MHz of consumer PC processor
Degree (entered by user or automatically detected)
● Language: A language spoken by consumers
● Country: The country where the customer's PC exists
● Zip code: (Use with country to pinpoint customer's location)
The postal code of the consumer
Packets sent from device 12 (in addition to these explicit data) also carry an IP address (specific to the use of the http protocol) so that the remote device (eg router / handler) can respond to it Have an address.
[0492]
Response from product handler:

[0493]
URL request :
Request input:
Header (XML format)
Vendor (eg Digimark)
Appl (eg MB)
data
Request information
Req = RFU
Ver = application version number
Type = watermark type number
Ser = watermark serial number
Cxt = Context
Env = environment
Optional information
Ctry = User's country name
Lang = User's preferred language
HHID = demographic household identifier
Det = detector / detector TWAIN string
OS = User PC operating system
Tring
Proc = processor type and class of user PC
Speed = User's processor speed
Zip = user zip code
Example:
<? xml version = "1.0"? >
<Content>
<Vendor> Digimarc </ vendor>
<Appl> MB </ appI>
</ Content>
Req = RFU
Type = 1
Ser = 10001
Ver = 1.0
Cxt = A
Env = Q
Ctry = USA
Lang = English
HHID = 1234567
Det = TWAIN string
OS = Win98
Proc = Pentium III
Speed = 500
zip = 74008-1234
[0494]
Response from product handler
RtnCode = success / error number (success = 1)
URL = URL associated with a specific watermark type and serial number
Exp = expiration date / time for cache purposes (GMT) −mm / dd / yyyy hh: mm: ss format
Or
RtnCode = success / error number (error <0)
MsgText = Message text
[0495]
Reason for error:
-1 Type and serial number are OK, but there are no URLs in the database (both primary and default URLs are missing)
-2 Type and serial number are OK, but URL is marked inactive (neither primary nor default is active)
-3 There is no record in the database that matches the type and serial number
-4 Request format error: Incomplete data.
[0496]
Configuration request :
Request input:
Header (XML format)
Vendor (eg Digimark)
Appl (eg MB)
data
Request information
Req = RFC
OS = User PC operating system
System
Example:
<? xml version = "1.0"? >
<Content>
<Vendor> Digimarc </ vendor>
<Appl> MB </ appI>
</ Content>
Req = RFC
OS = Win98
[0497]
Response from product handler
RtnCode = success / error number (success = 1)
Ver = latest application version available for download
https = yes (or no)
GCURL = URL used to route the next application request
Or
RtnCode = success / error number (error <0)
MsgText = Message text
[0498]
Reason for error:
-5 Unknown operating system
-4 Request format error: Incomplete data.
[0499]
Related URL request:
Request input:
Header (XML format)
Vendor = Digimark
Appl = MB
data
Request information
Req = RFA
Ver = application version number
Type = watermark type number
Ser = watermark serial number
Cxt = Context
Env = environment
Example:
<? xml version = "1.0"? >
<Content>
<Vendor> Digimarc </ vendor>
<Appl> MB </ appI>
</ Content>
Req = RFA
Type = 1
Ser = 10001
Ver = 1.0
[0500]
Response from product handler
RtnCode = success / error number (success = 1)
Serl = Watermark serial number
Type = watermark type number
URL1 = URL related to specific watermark type and serial number
Exp1 = Expiration Date / Time (GMT)
Ser2 = Watermark serial number
Type2 = watermark type number
URL2 = URL related to specific watermark type and serial number
Exp2 = Expiration Date / Time (GMT)
......
Ser'n '= watermark serial number
Type 'n' = watermark type number
URL 'n' = URL associated with a specific watermark type and serial number
Exp'n '= Expiration Date / Time (GMT)
Or
RtnCode = success / error number (error <0)
MsgText = Message text
[0501]
Reason for error
-8 Type and serial number are OK, but there is no associated watermark or URL in the database
-9 Type and serial number are OK, but all URLs are marked inactive
-3 There is no record in the database that matches the type and serial number
-4 Request format error: Incomplete data.
[0502]
Transaction download request
(Required for locally cached redirection accounts. One request per local redirection).
Request input:
Header (XML format)
Vendor = Digimark
Appl = MB
data
Request information
Req = RFT
Ver = application version number
Type = watermark type number
Ser = watermark serial number
Cxt = Context
Env = environment
Optional information
Ctry = User's country name
Lang = User's preferred language
HHID = demographic household identifier
Det = Detector TWAIN string
OS = User PC operating system
Tring
Proc = processor type and class of user PC
Speed = User's processor speed
Zip = user zip code
Example:
<? xml version = "1.0"? >
<Content>
<Vendor> Digimarc </ vendor>
<Appl> MB </ appI>
</ Content>
Req = RFT
Type = 1
Ser = 10001
Ver = 1.0
Cxt = A
Env = Q
Ctry = USA
Lang = English
HHID = 1234567
Det = TWAIN string
OS = Win98
Proc = Pentium III
Speed = 500
zip = 74008-1234
[0503]
Response from product handler
RtnCode = success / error number (success = 1)
Or
RtnCode = success / error number (error <0)
[0504]
MsgText = Message text
Reason for error:
-4 Request format error: Incomplete data
[0505]
In order to provide the fastest system response, the data exchanged between the originating device 12 and the remote system should be as short as possible. Preferably, it is large enough to be transmitted in a single Internet data packet (for example, about 536 bits or less). With such a configuration, it is possible to avoid overhead related to data distribution on the transmission side and reassembly on the reception side.
[0506]
Generally speaking, the total elapsed time of system services for a single request (eg, watermark recognition by application 28c, packet delivery to router, decryption by router, handling by product handler, and response return to application) is: When measured from the reception of the first byte request sent in response to the request, it takes less than 3 seconds on average. A typical speed is 2 seconds or less, even if there are multiple requests of 1 second or less.
[0507]
The following discussion fully considers the above discussion, but with different priorities, supplemented with details.
[0508]
A media bridge digital message consists of two codes, both embedded in a media bridge enhanced image. The media owner code is assigned by a system administrator (e.g., a Digimark) and identifies an entity that is permitted to add media bridge enhancement to an image. The routing code is assigned by the media owner (advertiser, publisher, manufacturer, etc.) and determines where the end user is directed when the client application reads the media bridge code. Two different advertisements with the same code embedded can guide the end user to the same home page, while the same advertisements in different publications using different codes are on different home pages. You can go and use it to track which ads or magazines are most effective at bringing end users to the media owner's website.
[0509]
The media bridge system has three main components. Client applications are used by consumers (media bridge end users) at home and in business, and are usually automatically navigated from images or objects to additional information on the Internet. The media bridge router provides the client application with the appropriate internet address for a given image or object. The embedding system is used by media owners to embed media bridge codes in images prior to printing.
[0510]
[Media Bridge Client Application]
Client applications can be distributed through OEM relationships with connected digital camera manufacturers such as Logistics, Threecom, and Creative Labs. The application is installed by the end user along with the camera driver and supporting software from the camera manufacturer's installation CD.
[0511]
The Media Bridge client application runs on a 200 MHz or faster Pentium or Power PC computer embedded with a connected video camera under the Windows 95/98 / NT 4.0 and Macintosh OS 8.6 operating systems.
[0512]
Media bridge client applications are initially dedicated to using media bridge enhanced images to browse directly to additional information on Internet websites. Thus, the application requests an internet connection via a dial-up modem or a permanent connection. However, it is desirable for the client application to have an extensible architecture that supports, for example, browsing local data on a CD and linking to other applications.
[0513]
Media bridging systems can be used in most places, and video cameras can show clear, focused, high quality images. The system operates in lighting conditions that vary from dim conditions (about 40 lux) to bright conditions (3900 lux). In addition, the system operates using an auxiliary light source in very dark places and operates in a dazzlingly bright place if the image or object is shielded from the light source.
[0514]
[Operation of end-user client application]
When a client application first runs, it is desirable to present a wizard to the user, which teaches the best technique for providing a media bridge operable image to the client application via a video camera. The wizard is tailored to each camera and can use either a sample image or an actual image taken.
[0515]
Shipped in the form of an installation disc (eg, CD) can be one or more games that teach the user how to best use the client application. For example, how to focus the camera, align the encoded object in the camera's focal range, hold the object so that it doesn't move for a moment or is needed for decoding, There are acceptable lighting conditions. The camera box or anything inserted in the box can be media bridge encoded and linked via a browser to a corresponding introduction page hosted by the camera vendor or system administrator. T-shirts and other prizes may be given through the website either at random or by showing proficiency in certain aspects of the media bridge operation.
[0516]
In the illustrated configuration, the media bridge application is always running and is either active or inactive. When active, the media bridge video camera window is always in front of and completely visible of any other window, and the client application is constantly checking for video in the media bridge enhanced image. If a media bridge enhanced image is found, the appropriate information is displayed (in most cases as a home page) and the client application is selectively deactivated. When the client application is inactive, hide the video window and release the camera so that other applications can use it to use little memory or computer resources.
[0517]
In one embodiment, the client treats the camera as a serially reusable device. That is, when the client application is active and checking for video, no other application can access the video camera. Similarly, client applications cannot access video when other applications are using the camera.
[0518]
The media bridge client application includes the following features:
[0519]
(1) Launch browser / application
When a media bridge enhanced image is found, the client launches the user's web browser or other application. When browsing an Internet website, the client gives the site the identity of the image and the end user's zip code, if possible. This information allows the media owner's website to display to the user a home page that has been modified for use in a particular region. When launching another application, the client gives the application an image owner code and a routing code.
(2) Destination menu
If a large number of URLs are specified for the routing code, the client application displays a menu based on the browser. The display allows the end user to select which page to display instead of navigating directly to the home page.
(3) Brand setting
While searching for information to display the home page, the client application displays the local home page with a prestored brand (eg, a Digimark) to explain that the desired information is being searched. This branding page is replaced with the media owner's page without incurring a response delay time for the user (the content of the branding page is updated during the automatic software update).
(4) Flexible activation
When the client application is inactive, the user can activate it in the following ways
(A) Click the application icon
(B) Press the hot key combination
(C) Click the tray icon (Windows)
(D) Click the button on the browser toolbar
(E) Restore the minimized Media Bridge Client video camera window (Windows).
(5) Status display
While active, the client application provides feedback to the user via the status display pane. It is displayed in a video camera window located next to the view seen from the camera. Status includes ambient lighting feedback, distance from camera (if possible), focus, and (ready to display image-related information, try to read image, or media bridge highlighted image Contains the current status (waiting to be presented to the camera).
(6) Numerous camera support
The illustrated media bridge client application uses one camera at the same time, but any installed media bridge capable camera can be used. If the computer has only one camera, that camera is automatically selected. If there are two or more cameras, the user can select which camera to use, and the selection can be changed while the client is operating.
(7) Automatic software update
The user can automatically install updates to the client application with a simple menu selection. The client connects to the Internet and downloads and installs any available updates. In addition, the client presents a check for updates if it finds a media bridge enhanced image using the new protocol (see, for example, an encoded version of the indication along with the media bridge data).
(8) User option configuration
Almost everything in the client application can be configured by the user
(A) Automatically start the client whenever the computer starts running (default)
(B) Activation by hot key
(C) Display of activation icon on system tray (window)
(D) Button addition to Internet web browser (Internet Explorer 4 or later and Netscape 4 or later)
(E) When many cameras are installed, select the last camera used for startup
(F) Call attention to periodically check for software updates
(G) Run the wizard at startup (default)
(H) Automatic deactivation when reading media bridge emphasized images
(I) Automatic deactivation when nothing is presented to the camera for a specific period of time
(J) Ringing sound or sound file operation at the time of reading an image with media bridge emphasis
(K) Blocking sites based on RSACi assessment. Each media owner is required to perform a self-assessment of the site using RSACi indicators for the words, nudity, gender, and violence categories. When the RSACi rating for any category exceeds the end user's tolerance, the router blocks the end user from the site. (The router relies solely on the media owner's self-assessment and does not substantially check the home page against the RSACi code.) By selecting this option, RSACi (http: // www. rsac.org/ratingsv01.html) is displayed
(L) Automatic connection to the Internet via an existing dial-up (modem) connection
(M) Password protection at startup
(N) User registration information (the user is notified that all information is optional and that certain items may be given to third parties)
(O) The end user's postal code that is not required to be provided to the user is used as basic demographic information conveyed to the media owner when the end user voluntarily provides it.
(9) Wizard
This wizard sets up a specific camera to get the best results from the media bridge and provides guidance to get the best technology that uses the media bridge as a portal for more information. By default, the wizard runs every time the client application is started. The wizard also operates when the user first selects a new camera.
(10) Camera verification
When a new camera is selected as an input for the media bridge client, the client checks whether the camera is capable of media bridge operation. Otherwise, the camera is not supported and alerts the user that the client application will not work correctly.
(11) Extensible architecture
The media bridge client usually displays the Internet or a local home page in a browser window, reads an image emphasized by the media bridge, and combines it with desired information. The function can be extended by an application capable of media bridge operation that performs registration for handling specific data. For example, when a business card with media bridge emphasis is presented, the media bridge client runs an application capable of media bridging, thereby downloading business card information from the website and updating the user's contact list with new information. Update with. Another example is a children's book page with a media bridge emphasis, which allows the audio file to work on that page.
(12) Embedding support
If the media owner uses the client application to verify that the image has the correct media bridge code embedded in it, the client reads the media owner's name, routing information, and the media bridge image. Displays the relative strength of the media bridge watermark when To protect each media owner's privacy, this information is provided only when the user can provide a valid embedded username and media owner password.
[0520]
[Media Bridge Router]
The router is essentially transparent to the end user. When the client application detects an image linked with information on the Internet and emphasized by the media bridge, the client application communicates with the router to obtain the Internet address information of the home page to be displayed.
The router also includes the following functions:
[0521]
(1) Maintenance of routing information
Within the router is information that links each unique media bridge code to one or more associated Internet addresses. As one example, a system administrator (e.g., Digimark) maintains routing information using information provided by advertising company customers. In another embodiment, the media owner updates the information itself using a secure internet connected to the router.
(2) Handling of problems
If the routing request is not satisfied, the router responds in a manner that minimizes the impact on the end user. For example, if the media bridge code is unknown, the client application is given a URL to the media owner's home page. Further, every day when an error occurs, the router notifies the media owner of the occurrence of the error by e-mail.
(3) Content evaluation
If the media owner provides RSACi rating information for the image or the site, and the end user specifies an RSACi rating that the site is blocked, the router will indicate that the site contains inappropriate content, Returns to the user a home page indicating that the media owner's site cannot be contacted.
(4) Confirmation of validity
Periodically (eg daily), the router validates all active information in the database. If any errors are found, the media owner is notified via email. If the error is not repaired in one day, a digital mark is notified. Here are the conditions that are checked:
(A) URL not found on active link
(B) The URL refers to a page that does not exist
(C) The page exceeds the allowable download time requested by the Digimark.
(5) Tracking
The router records client application requests to create marketing information. Such tracking records include the following:
(A) Request date and time
(B) Media owner and image
(C) End user zip code if possible
(D) IP address that issued the request
(6) Report
Using report tracking information, the router provides the following reports for use by Digimark:
(A) Number of URL requests for a specific date range
(B) Number of URL requests by media owners for a particular date range
(C) Number of URL requests with media bridge emphasized images for a particular day range
(Tracking and reporting is preferably configured to allow media owners to obtain traffic and marketing reports online from the router).
[0522]
[Media Bridge Embedding System]
The embedded system includes:
● Embeder plug-in for photo stores to embed media bridge code
N
● Media bridge support for collating digital images with enhanced media bridges
Reader plug-in
● Media bridge for collation of proof and press print with emphasis
Client application
● Obtain a media bridge code and assign a URL to the media bridge code
Internet based router maintenance application to guess.
[0523]
The plug-in requires an internet connection for authentication only and the assignment of a new media bridge routing code. Router maintenance applications always require an internet connection.
[0524]
[Router maintenance application]
The main purpose of the router maintenance application is to assign routing information to the media bridge code so that when the client application reads an image, it presents an appropriate home page to the end user.
[0525]
The router maintenance application includes the following functions:
(1) Multilocation
A single media owner account can be accessed by different people at different locations. People from various organizations such as advertisers and their advertising agencies can also access.
(2) Access restrictions
Each media owner can restrict who has access to the router information, and who can generate new media bridge codes, use existing media bridge codes, or change information about routing codes. Has the authority to identify what can be done. Media owners can add, change or revoke access at any time.
(3) Reliable access
All Internet access to the router is via a secure connection.
(4) Routing code
Assign new routing code, change existing routing, and delete or reuse old routing code.
(5) Routing based on time
Each routing code can be assigned multiple URLs, each of which optionally has an effective date and an expiration date that define when it can be used for routing. Expired URLs are automatically deleted by the router after 30 days.
(6) Multi-routing
If multiple URLs are specified in the routing code, the router returns a browser-based menu to the end user so that the end user can see which page to display instead of navigating directly to the home page Can be selected. In one embodiment, a single routing code can have up to four expired URLs. Each URL has a simple description for browser linking to the URL, a long description of up to 500 characters, and a URL for an icon displayed on the menu. This icon is at most 50 pixels in the height direction and 300 pixels in the width direction.
(7) Record
All changes to routing information are recorded and reviewed by the media owner.
[0526]
[Outline of the plug-in]
When the media owner first embeds in the computer, the embedder asks for the media owner's account number and a valid username and a password specified by the media owner. The embedder is connected to the router via the Internet, checks whether the user is authenticated, and downloads information about the media owner. Further embedding for the media owner can be done without connecting to the router. However, each time a user connects to the router and obtains routing information for embedding, the router verifies the user name and password against the currently valid name and password. If the previously used name and password are no longer valid, the user must provide a valid name and password in order to continue embedding the media owner.
[0527]
The media owner's account number is only required for initial authentication. This is because any future authentication is done using the name of the media owner maintained by the embedder. Since an advertising agency's graphics artist can engage in the project of two or more media owners, one graphics artist can have different usernames and passwords for each media owner.
[0528]
The reader plug-in is mainly used for image matching after embedding. The reader plug-in restricts access in the same way as the embedded plug-in, and provides information about the image only if the user can provide a valid username and password for the media owner. Make restrictions. If media owner information is not available on the current computer, the reader connects to the router for verification.
[0529]
Plug-ins share the following features:
(1) Multiple media owners
A user can embed or read a plurality of media owners. The user must have a valid username and password for each media owner.
(2) Multiple users
Several people can use one computer. These people cannot share information unless they use the same username and password.
(3) Automatic software update
Users can automatically install updates to plug-ins with a simple menu selection. The plug-in connects to the Internet and downloads and installs any available updates.
(4) Reliable access
All internet access is via a secure connection.
[0530]
[Embeda plug-in]
The embedder plug-in also includes the following features:
1. Routing code assignment
The user selects the routing code to be embedded from the list of existing codes provided by the router via the Internet connection. Each routing code is identified by a unique routing number and description. Once a selection is made via the router, information about the routing code is kept on the local computer until removed by the user.
2. New routing code
If authenticated, the user connects to the router via the embedder and generates a new routing code. The routing code can be generated with or without URL information, which can be added later.
3. Update routing code
The embedder downloads any updates made to the locally cached routing code whenever connected to the router.
4). Mask embedding
The user can block the part of the image so that the media bridge code is embedded only in the blocking area. In one embodiment, different codes are used for different shielding areas. In general, the user cannot embed different media bridge codes in the same part of an image.
5. Variable brightness
The user can globally change the brightness (and hence visibility) of the media bridge watermark from light to significant, and can also change the brightness of various areas of the image locally (ie, the brightness is , Adapted to the characteristics of local images).
6). Record
Each time the user embeds an image, the embeder records the log date, time, embedded information, embedding settings (eg, brightness), user name, computer name, and input image file name. This log is a text file on each user's computer and can be viewed with any text editor.
[0531]
[Reader plug-in]
The reader plug-in also includes the following features:
(1) Reading
The scanned digital image is read and if the user is authenticated, the media owner, routing information, and media bridge watermark intensity units are displayed.
(2) Mask reading
The user can block a part of the image and read the media bridge information only from that part.
[0532]
[Part 3]
[Combination of the invention]
In accordance with aspects of the invention detailed above, some of the combinations of the invention claimed in priority cases include the following:
[0533]
A1. Applying a personal business card to a light sensor, which generates output data;
Decoding steganographic encoded multi-bit data from sensor output data;
Using the multi-bit data to establish a link to an Internet address having data relating to an owner of the business card.
[0534]
A2. The method of claim A1, comprising obtaining calendar data detailing a particular activity of the individual from the Internet site.
[0535]
A3. The method of claim A1, wherein the amount of calendar data acquired is based on an authentication level.
[0536]
A4. The authentication level is indicated by multi-bit data encoded in the individual's business card, and the individual sends the separately encoded card to different recipients, giving the recipient various access rights to the calendar data. The method of claim A3, which can be provided.
[0537]
A5. The method of claim A1, wherein the optical sensor is a business card reader that also functions to provide business card text information to a personal information manager.
[0538]
A6. 6. The method of claim A5, comprising storing an Internet address determined from multi-bit data in the personal information manager.
[0539]
A7. The method of claim A1, wherein the light sensor is a digital camera.
[0540]
A8. The method of claim A7, wherein the digital camera is mounted on a computer display.
[0541]
A9. The method of claim A7, wherein the digital camera is head mounted to the user.
[0542]
A10. Providing a print of the promotional product to a photosensor at the first site, wherein the photosensor generates output data;
Decoding steganographic encoded multi-bit data from the sensor output data;
Using the data to establish a link to an Internet site associated with a service, product or company promoted by a print of the promotional product;
Sending further information related to the service, product or company from the Internet site to the first site.
[0543]
A11. Providing a printed identification badge to a light sensor, the light sensor generating output data corresponding to the light characteristics of the surface of the badge;
A combination of steganographic encoded multi-bit data from the sensor output data;
A method comprising checking the multi-bit data to determine if it corresponds to a valid access card and unlocking based on the result of the check operation described above.
[0544]
B1. Providing a digitally encoded object to a light sensor, which generates output data;
Decoding a plurality of bit data from the output data of the sensor;
Using the multi-bit data to establish a link to an Internet address having data associated with the object.
[0545]
B2. The method of claim B, wherein the object is steganographically encoded using the multi-bit data.
[0546]
B5. With a refrigerator;
An optical sensor associated with the refrigerator, wherein the sensor is adjusted to provide image data corresponding to an object fixed in front of the sensor;
A device useful for editing a grocery list, comprising an image processor for processing the image data and extracting multi-bit binary data therefrom.
[0547]
B6. A method of operating a computer, wherein the computer includes an operating system having a registry database, the registry database associating a particular data type with a particular software program specifically corresponding thereto, and improvements include:
Provide one frame of image data,
Decoding multiple bits of identification data from the image data;
Examining the registry database to identify a software program corresponding to the identification data;
Invoking the identified software program.
[0548]
B7. Steganographic decoding of multiple field data from the image data, wherein one of the multiple fields comprises the identification data;
The method of claim B6, comprising providing another one of the multi-field data to an identified software program that uses it.
[0549]
B8. A system that supports objects encoded to carry multiple bits of auxiliary data:
A light capture device for generating image data corresponding to a field of view, wherein the field of view includes not only objects but also visible clutter;
A visual cue-based subsystem that identifies objects from visible clutter in the image data;
A system comprising a processor that extracts a plurality of bits of auxiliary data from an object identified by the subsystem and applies the extracted auxiliary data to a response system.
[0550]
B9. The system of claim B8, wherein the visible clue-based subsystem identifies objects from the visible clutter based on spectral attributes.
[0551]
B10. The system of claim B8, wherein the object includes a reflector, and the system includes an illumination source of spectral characteristics reflected by the reflector and detected by a light capture device.
[0552]
B11. The system of claim B8, wherein the visible clue-based subsystem identifies an object from the visible clutter based on a time attribute.
[0553]
B14. A method of creating a customized object for authenticating a person entering a first location, comprising:
Provide access codes to people;
Generating the printable data, wherein the access code is steganographically encoded, and printing the printable data using a printer at a second location remote from the first location.
[0554]
B15. The method of claim B14, wherein the access code is provided to the person via a network computer and the first location is a movie theater.
[0555]
B16. A printer that responds to commands from printer driver software, wherein the printer driver software is characterized as corresponding to two types of input data. One of them is provided with text data, the other is provided with digital watermark data, and the two types are not collected before being applied to the printer driver software. Individually applied to the printer driver software.
[0556]
B17. A method of generating a printout using a computer, wherein the printout includes text and the computer includes software, which provides a print dialog box in response to user control. The improvement is that the print dialog box has a graphic user interface that allows the user to select steganographic encoding of the printed output.
[0557]
B18. Processing the pages to encode multi-bit data into steganographic and giving them on blank pages;
Next, print text and images on the processed pages to create encoded and printed magazine pages;
A method for printing a magazine comprising bundling at least one of the pages of a magazine that has been steganographically encoded and printed to produce each of a plurality of magazines.
[0558]
B19. Steganographically encode travel photos to hide multi-bit data in them;
Processing travel photos, and then extracting multi-bit data;
A travel facilitating method comprising allocating an Internet web browser to a website that provides travel information useful to a consumer who wants to visit a photographed location using at least a portion of the extracted multi-bit data.
[0559]
B21. A gesture method that provides input information to the system:
Keep the object in the user's hand;
Positioning an object in at least part of the field of view of the optical scanning device;
Move the object manually;
Capture multiple image data frames multiple times per second using a scanning device;
Process multiple image data frames to identify the objects represented therein;
Analyzing object representations in the plurality of image data frames to detect a change in time of at least one parameter selected from a list consisting of a rotation state, a scale state, a differential scale state, and an XY offset;
A system comprising controlling an aspect of the system based on the detected change.
[0560]
B22. The object is digitally encoded:
The method of claim B21, wherein the method includes decoding multi-bit digital data from an object, and the system is responsive to at least a portion of the decoded digital data.
[0561]
B23. The method of claim B21, wherein the system is responsive to at least a portion of the decoded digital data by setting a complex level of system-user interaction.
[0562]
B24. Analyzing the object representation in the plurality of image data frames to detect a change in time of the rotation state and controlling some aspect of the system based on the detected change. Method.
[0563]
B25. The method of claim B21, comprising analyzing object representations in the plurality of image data frames to detect a change with time in a scale state and controlling an aspect of the system based on the detected change.
[0564]
B26. The method of claim B21, comprising analyzing the object representation in the plurality of image data frames to detect a change in differential scale state with respect to time and controlling certain aspects of the system based on the detected change.
[0565]
B27. Analyzing the object representation in the plurality of image data frames to detect a change with time in an XY offset and controlling an aspect of the system based on the detected change. Method.
[0566]
B28. Analyzing an object representation in a plurality of image data frames to detect a first change for one of the parameters, and then detecting a second change for one of the parameters; The method of claim B21, wherein an aspect of the system is controlled based on the detected change.
[0567]
B29. The method of claim B21, wherein the first and second changes are both related to the same parameter.
[0568]
B30. A method of operating a device, such as a telephone, that establishes a voice circuit between a caller and a recipient, the improvement being that the optical sensor is provided with the substrate with indicia on the substrate, and at least part of the substrate And generating image data corresponding to the field of view, steganographically decoding the multi-bit digital data from the image data, and establishing an audio circuit based on at least a part of the multi-bit digital data It is to be prepared.
[0569]
B31. The method of claim B30, wherein the indicia comprises a photographic image depicting a recipient.
[0570]
B32. Placing a unique object in at least a partial region within the field of view of the optical scanning device, wherein the unique object is selected from a list consisting of a driver's license, a document with government identification, a bank card and a stamped jewelry item;
Capture one frame of image data using a scanning device;
Processing the image data to steganographically decode the multi-bit data therefrom;
Providing at least a portion of the steganographically decoded data to a computer system.
[0571]
B33. The method of claim B32, further comprising obtaining email data from an email account corresponding to the person identified by the unique object and providing it to a user of the computer system.
[0572]
B34. An e-mail data terminal used in a public place, the terminal comprising an input unit and an output unit, wherein the output unit provides e-mail data to the user, The input unit includes an optical scanning device that generates scan data corresponding to the object, and the unique object is selected from a list consisting of a driver's license, a document with proof of identity by the government, and a bank card.
[0573]
B35. Providing an object within the field of view of the optical sensor device, said object being selected from a list comprising a retail product or a wrapping retail product;
Obtaining light data corresponding to the object;
Decoding multi-bit digital data from optical data;
Sending at least a portion of the decrypted data to a remote computer;
A method of promoting the remote computer comprising determining whether to give a reward in response to the decrypted data being sent at the remote computer.
[0574]
B36. A method of adjusting a desktop computer of a first computer to confirm user preferences, comprising:
Providing an object specific to the light sensor associated with the first computer;
Analyzing the image data generated from the light sensor and decoding the multi-bit data therefrom;
A method of adjusting a desktop computer of the computer based on the decrypted data.
[0575]
B37. In communicating from the first computer to a remote computer, at least a portion of the decrypted data is used, the remote computer comprising profile data regarding a desktop computer configuration preferred by the user:
Sending the profile data from the remote computer to the first computer;
The method of claim B36, further comprising configuring a desktop computer on the first computer based on the profile data.
[0576]
B38. Purchase products and services from the first vendor,
Receive a proof of purchase,
Providing the proof to the optical scanning device, generating image data,
Decode multi-bit data from image data,
A method of obtaining a value from a second vendor unrelated to the first vendor by using the decoded multi-bit data.
[0577]
B39. The method of claim B38, wherein the value provides a free or discounted product or service from a second vendor.
[0578]
B40. Providing a travel document to an optical scanning device, the travel document comprising encoded multi-bit data, the optical scanning device providing corresponding image data;
Identifying the multi-bit data from the image data;
Establishing a link to a remote computer based on the multi-bit data, and using the computer to change a travel plan.
[0579]
B41. A business card is provided to the optical sensor, the optical sensor generates image data, and the business card corresponds to a person;
Identifying multi-bit digital information from the image data;
Using the identified digital information to access a remote data storage area;
Obtain updated contact information about the person from the data store,
Establishing communication with the person using the updated contact information,
A communication method in which the contact information in the remote data storage area is updated on a date when various contact information becomes appropriate at various times according to the activity of the person.
[0580]
B42. The method of claim B41, wherein the multi-bit digital information on a business card is encoded steganographically.
[0581]
B44. Providing a physical object within the field of view of the light sensor associated with the first computer, the light sensor providing image data;
Decoding multi-bit digital data from a physical object representation in the image data;
Using the first portion of the multi-bit digital data to establish a link between the first computer and a remote computer;
Providing the remote computer with a second portion of the multi-bit digital data;
Providing information from the remote computer to the first computer, the information corresponding to the physical object.
[0582]
B45. The method of claim B44, wherein the first portion of the multi-bit digital data is used to identify the remote computer by traversing a network of server computers.
[0583]
B46. The method of claim B44, wherein the object is a business card associated with a person, and the information provided from the remote computer includes contact information associated with the person.
[0584]
B47. Encode print advertisements into steganographic using ancillary data,
Issue the advertisement,
Charge the advertiser for the issuance fee,
Providing a technique for providing an improved value to the advertiser using steganographic encoding;
Dividing a portion of the fee with a provider of the technology.
[0585]
B48. Incorporate multi-bit digital identifiers into photos with steganographic,
Storing annotations in a database about the identifier;
Providing the photo to a photosensor, the photosensor providing image data, and decoding the identifier from the image data;
Using the decrypted identifier to access the annotation stored in the database;
Providing the accessed annotation.
[0586]
B49. Link to an internet address using a computer to give information to the computer user from the address;
Providing an object to an optical sensor associated with the computer, the sensor generating image data corresponding to a field of view;
Physically manipulating objects within the field of view;
Identifying the operation of the object from the image data;
Generate the corresponding output data,
An Internet navigation method for changing information given to a user by changing an Internet address based on the output data.
[0587]
B50. A notepad comprising a plurality of sheets removably connected to each other at one edge by an adhesive material, wherein the multi-bit digital data of each sheet is encoded.
[0588]
B51. The note pad of claim B50, wherein the multi-bit digital data of each sheet is steganographically encoded.
[0589]
B52. The note pad of claim B50, wherein the multi-bit digital data of each same sheet as the other sheets of the pad is encoded.
[0590]
B53. An object is provided to a light sensor, the light sensor generates image data, and the multi-bit digital data of the object is steganographic encoded,
Decoding the digital data from the image data;
Storing the image data from the sensor depicting the object in response to the digital data.
[0591]
B54. The object is a paper sheet, and the method includes acquiring a plurality of frames of image data from the optical sensor,
Identifying one of the plurality of frames having an appropriate representation of the object;
Mask image data corresponding to the sheet from other image data in the identified frame,
Processing image data corresponding to the sheet to change its geometric attributes, and then identifying the size and color of the sheet from some of the decoded digital data;
54. The method of claim B53, comprising storing image data corresponding to the sheet relating to the masked and processed data indicating the date and time the image was stored along with the size and color of the sheet.
[0592]
B55. An object is provided to a light sensor, the light sensor generates image data, the multi-bit digital data of the object is steganographically encoded,
Decoding the digital data from the image data;
A method of displaying an image of a similar object in response to the digital data.
[0593]
B56. The method of claim B55, wherein the object is a paper sheet, and the method includes displaying images of a plurality of paper sheets previously stored in a display order corresponding to a pre-stored time order.
[0594]
B57. In a computer operating system, corresponding to two-dimensional image data of a continuous frame, gesture data is extracted therefrom. A software module that contains data.
[0595]
Cl. A business card is provided to the optical sensor, the optical sensor generates image data, the business card corresponds to a person,
Identifying multi-bit digital information from the image data;
Using the identified digital information to access a remote data storage area;
Obtaining updated interpersonal contact information from the data storage area;
Using the updated contact information to establish communication with the person,
A communication method comprising updating the contact information in the remote data storage area on a date that makes various contact information appropriate at various times according to the activity of the person.
[0596]
C2. The method of claim C1, wherein the business card multi-bit digital information is steganographically encoded.
[0597]
C3. Providing a physical object within the field of view of the light sensor associated with the first computer, the light sensor generating image data;
Decoding multi-bit digital data from a representation of the physical object in the image data;
Using a first portion of the multi-bit digital data to establish a link between a first computer and a remote computer;
Providing a second portion of the multi-bit digital data to the remote computer;
Providing information from the remote computer to the first computer, the information corresponding to the physical object.
[0598]
C4. The method of claim C3, comprising identifying the remote computer by traversing a network of server computers using the first portion of the multi-bit digital data.
[0599]
C5. The method of claim C3, wherein the object is a business card associated with a person, and the information provided from the remote computer includes contact information associated with the person.
[0600]
Dl. Providing a digitally encoded object to the light sensor, which generates output data;
Decoding multi-bit data from the sensor output data,
Using the multi-bit data to establish a link to an Internet address having data associated with the object.
[0601]
D2. The method of claim Dl, wherein the multi-bit data of the object is encoded steganographically.
[0602]
El. Encode print advertisements into steganographic, conceal multi-bit data in it,
Processing the print advertisement and extracting multi-bit data therefrom;
A sales promotion method for allocating an Internet web browser that provides consumer information related to a product or service promoted by the print advertisement to a website using at least a part of the extracted multi-bit data.
[0603]
E2. A method for determining which consumers respond to print ads,
Encoding a first print advertisement containing the first data into steganographic,
Encoding a second print advertisement containing the second data into steganographic,
Decrypting the first and second data when the consumer provides the first and second advertisements to the optical sensor;
A method comprising calculating a number of decrypted first and second data, respectively, to determine a consumer responsive to the advertisement.
[0604]
E4. Encode travel photos into steganographic, conceal multi-bit data in them,
Processing the travel photo and extracting multiple bit data therefrom;
A travel facilitating method comprising allocating an Internet web browser to a website that provides travel information useful to a consumer who wants to visit a place depicted in the photograph using at least a portion of the extracted multi-bit data.
[0605]
Fl. A mouse having an X-position encoder and a Y-position encoder, and circuitry for generating X-direction movement data and Y-direction movement data in response thereto and providing it to a computer associated therewith, A light sensor disposed on the mouse and a circuit for generating gray scale light image data in response thereto and providing it to a computer associated therewith, the mouse comprising a pointing device and a light A mouse that is to act as both an input device.
[0606]
F2. A substrate formed in contact with the semiconductor;
A two-dimensional image sensor for generating a sensor signal;
A first circuit for generating image data corresponding to the sensor signal and supplying the image data to the semiconductor image data output unit;
A semiconductor comprising a second circuit in response to the sensor signal, i.e., the image data, that multi-bit digital data thereof is steganographically encoded and provided to the semiconductor steganographic decoding output.
[0607]
F3. A method for operating a computer system including an Internet web browser,
Providing peripheral devices with sensors,
Positioning the peripheral device in the vicinity of a first object and assigning the web browser to a first address;
Locating the peripheral device in the vicinity of a second object and assigning the web browser to a second address.
[0608]
G1. A peripheral device of a computer system,
A housing that is adjusted to fit within the palm of the user and slides over the media;
An optical sensor comprising a plurality of sensing elements to generate an image signal;
A lens for imaging the medium on the sensor;
A circuit connected to the sensor and arranged in the housing for processing the signal from the sensor and formatting it in the same manner as an output data frame;
A peripheral device comprising transmission means for relaying the output data from the peripheral device to a computer system.
[0609]
G2. The device of claim G1, wherein the transmission means is a cable.
[0610]
G3. The device of claim G1, wherein the transmission means is a wireless link.
[0611]
G4. The circuit decodes multi-bit binary data encoded steganographically in an image detected by the sensor, and the transmission means relays the decoded data to the computer system. Devices.
[0612]
G5. Providing a printed catalog containing images of items for sale from a merchant, the multi-bit binary data of the images being steganographically encoded,
Optically detecting an image, generating corresponding image data, decoding steganographic encoded data from the image data,
An electronic commerce method comprising: electronically ordering an item from a merchant using the decrypted data, wherein the customer profile information stored in advance is utilized in the order.
[0613]
G6. The method of claim G5, wherein the customer profile information includes clothing size data.
[0614]
G7. Processing the decrypted data for transmission to a remote merchant computer, the process including supplementing the decrypted data with supplemental data corresponding to the customer;
Send the processed data to the remote merchant computer;
In response to the processed and sent data, first order data is received from the remote merchant computer;
Providing the customer with the first order data;
Receiving further input information from the user and selecting from the options included in the first order data;
The method of claim G5, further comprising sending the further input information to a remote merchant computer.
[0615]
G8. The method of claim G7, wherein the supplemental data includes customer profile information.
[0616]
G9. The method of claim G7, wherein the supplemental data includes customer identification data.
[0617]
G10. A badge,
With a photo on the badge,
The photograph comprises multi-bit auxiliary data hidden therein, the auxiliary data corresponding to an authorized messenger of the badge;
The badge further comprises further messenger identification information, the further information being detectable by a machine.
[0618]
G11. The device of claim G10, wherein the additional information is encoded by an RF proximity circuit configured with the badge.
[0619]
G12. The device of claim G10, wherein the further information is encoded in the badge in a barcode format.
[0620]
G13. The device of claim G10, wherein the additional information is encoded in a magnetic stripe format on the badge.
[0621]
G14. A way to access certain real estate,
Give the badge to the sensor station,
Generate light data corresponding to the photo on the badge,
Processing the optical data to extract encoded multi-bit auxiliary data;
Mechanically detecting the badge ID from the data not encoded in the photo,
A method comprising checking communication between a mechanically detected ID and auxiliary data extracted from the photo to determine whether access to a secure real estate is authorized.
[0622]
I1. An optical input device;
A customer application for digital data encoded in the image,
An image-based navigation system comprising a router corresponding to at least part of the digital data.
[0623]
I2. A computer storage medium comprising instructions for engaging a user-trained computer system with a camera-equipped computer system to familiarize the user with the operation of a camera-based Internet navigation system.
[0624]
I3. An internet navigation device comprising a substrate on which an image is printed and an image comprising first and second data encoded using the substrate, wherein the first data comprises an owner code and second data Is a device with router code that helps you link a camera-equipped computer system to an Internet address.
[0625]
I4. The device of claim I3, wherein the owner code and router code of the image are steganographically encoded.
[0626]
I6. An image-based network navigation method that allows a user to link to a remote computer, comprising:
Detects the encoded data from the print image,
Linking to a remote computer over a network based on the encoded data and providing the image identification information to the remote computer.
[0627]
I7. Internet navigation system with a customer application that communicates with a remote router,
Providing first data to the router from the customer application,
Providing a plurality of data from the router to the customer application;
The customer application provides a menu corresponding to the plurality of data,
Accepting user input information corresponding to one of the plurality of data.
[0628]
I8. The method of claim 17, comprising obtaining first data from image data provided from a light input device.
[0629]
I9. The method of claim I8, comprising linking the customer application to a web page corresponding to the accepted user input information.
[0630]
I10. 12. The method of claim I9, comprising providing the user with a branded item display stored locally at the customer application when waiting for the linked web page to be displayed.
[0631]
Ill. A router characterized by accepting a routing code and responding with a corresponding URL, wherein at least one routing code corresponds to a plurality of URLs, each of which includes detailed time information when the URL is used .
[0632]
J2. Generate a database record containing multiple data fields,
Generating a file corresponding to the database record and including data from at least some of the fields;
Electronically sending a copy of the file to each of a plurality of recipients;
One of the recipients adds data to the copy of the file or modifies data in the copy of the file to send the file to the database;
Updating the database record based on the modified file;
Generate a new file corresponding to the updated database record, including data from at least some of the fields;
A database method comprising electronically sending a copy of a new file to each of the plurality of recipients.
[0633]
J3. A system that links physical objects and digital objects to the corresponding digital resources,
Registration means for receiving data relating to the object including identification information and owner information of the object, and associating the data in the database with data relating to the corresponding response;
Initiating device means that senses data from the input object, processes it and forwards it to the routing means;
Routing means for processing data processed by the start device means, recording the information, and transferring at least some of the processed data to a product handler means;
A system comprising product handler means responsive to the initiating device means based on information provided by the routing means.
[0634]
J4. The system of claim J3, wherein the routing means includes means for checking information in the database.
[0635]
J5. The system of claim J3, wherein the registration means includes means for generating an encapsulated file and means for sending the file to a predetermined partner.
[0636]
J13. A network computer system that starts sending audio data and video data in response to digital watermark data sent from a remote customer application.
[0637]
J14. The network computer system of claim J13, wherein in response to digital watermark data sent from a remote computer software program, the network computer system starts sending audio and video data to the remote computer.
[0638]
J16. A network computer system for initiating delivery of updated software to the remote computer in response to watermark data sent from a remote computer software program.
[0639]
K1. A scanner including a first and second spaced 2D sensor array, a linear sensor array, a memory, and a CPU functioning as a motion encoder, the CPU being based on scanner motion data provided from the 2D sensor To process the raw scan data collected by the linear sensor array from the imaged object to obtain the final scan data, the improvement is from the scan data obtained from the object to the scanner Providing in the memory software instructions for identifying machine-readable identifiers.
[0640]
K2. A wireless interface and a display, wherein the software instructions cause the scanner to send an identifier to a remote server via the wireless interface and return information returned via the wireless interface for display on the display. The scanner of claim K1 for processing.
[0641]
K3. The scanner of claim K1, wherein based on the software instructions, the CPU processes data from a 2D sensor array for a specific purpose in addition to detecting movement of the scanner.
[0642]
K4. The scanner of claim K3, wherein the objective includes initiating a watermark detection process before data from the linear sensor array is finally processed.
[0643]
K5. The scanner of claim K4, wherein the purpose is to initiate detection of a digital watermark calibration signal.
[0644]
K6. The scanner of claim K3, wherein the objectives include identifying the location of data collected by a linear sensor array that would relatively include detectable identification data.
[0645]
K7. The scanner of claim K3, wherein the objective is to determine a feature quantity of the object surface, and based on which the filter can be applied to the scan data.
[0646]
K8. The scanner of claim K3, wherein the objective is to access the relative position of the object from various positions of the scanner.
[0647]
K9. The scanner of claim K3, wherein the object can be compensated for by determining the amount of affine transformation distortion of the scan data.
[0648]
K10. The scanner of claim K1, wherein the identifier is encoded steganographically as a digital watermark.
[0649]
K11. The scanner of claim Kl, wherein the identifier is encoded as a barcode.
[0650]
K12. A scanner having a linear sensor array, a CPU, an interface for connecting to the Internet, a user interface including a display screen and a user control unit, and sending machine-readable data detected from the scanned object to the Internet A scanner that provides the user with HTML information that is adjusted and returned from the Internet.
[0651]
L1. An image watermarking technique that also includes changing the optically detectable pattern on an object, the improvement being that the object has a non-planar surface and pre-distorts the watermark applied to the surface. And to compensate for the non-planarity in advance.
[0652]
L2. The method of L1, wherein the watermark is pre-distorted.
[0653]
L3. The method of L1, wherein the object has a cylindrical surface.
[0654]
L4. The L3 method, wherein the object is a container for a consumer product.
[0655]
L5. The method of L4, wherein the object is a soft drink can.
[0656]
L6. The method of L1, wherein the watermark is pre-distorted in the transform domain.
[0657]
L7. The method of claim L6, wherein the watermark is pre-distorted in a wavelet domain.
[0658]
L8. The method of claim L6, wherein the watermark is pre-distorted in a DCT domain.
[0659]
L9. The method of claim L1, wherein the watermark is pre-distorted to account for geometric distortions apparently induced by curvature.
[0660]
L10. The method of claim L1, wherein the surface is pre-distorted to account for geometric distortions apparently induced by curvature.
[0661]
L11. The method of claim L10, wherein the watermark is pre-distorted taking into account a geometric distortion apparently induced by curvature.
[0662]
L12. A digital watermark decoding technique for analyzing one frame of image data and decoding an encoded digital watermark, the improvement being that a distortion correction function is applied to the image data before decoding the digital watermark. Is to apply.
[0663]
L13. The method of claim L12, wherein various distortion correction functions are successfully applied to the image data and the valid watermark data is decoded therefrom.
[0664]
L14. The method of claim L12, comprising selecting one or more distortion correction functions to apply based on information provided by the user.
[0665]
L15. The method of claim L14, wherein the information identifies a general class of objects to which the object belongs without specifically identifying the shape of a particular object.
[0666]
[Conclusion]
Although the principles of our technology have been described and illustrated with reference to the illustrated embodiments, it should be understood that the invention is not so limited.
[0667]
For example, although some of the embodiments are shown with reference to an Internet-based system, the same technology can be applied to other computer-based systems as well. These include non-Internet based services such as America Online and Compuserve and dial-up bulletin board systems. Similarly, in an Internet-based embodiment, using a web browser and web page is not fundamental, and other digital navigation devices and other online data stores can be accessed as well.
[0668]
Similarly, although the example system has been specifically described in detail, its basic principles may be used in many other ways.
[0669]
For example, in another aspect, a physical object having a digital object identifier (DOI) is steganographically encoded. The Center for National Research Initiatives and the Digital Object Identifier Foundation (www.doi.org), which is based on the management of digital objects, and the distribution of infrastructure (www.doi.org) Great success in establishing. Some of this same infrastructure and technology may be adjusted to associate new functions with physical objects based on the above teachings.
[0670]
In another form, the data embedded in the object does not refer to the remote data store, but instead, the final data on the object is encoded directly. For example, a phone number can be used to actually encode a photo. When a photo is shown on the phone's light sensor, the phone can analyze the light information, extract the phone number, and dial the number without requiring external data. Similarly, an indirect link (eg, to a remote database that associates a UID with a computer address) is encoded using the pathname and file name of the corresponding electronic file to encode the office print document (eg, spreadsheet). The need for can be eliminated. A person's business card can directly encode a person's email or web address. Most of the above embodiments are suitable for directly encoding related data.
[0671]
The technology detailed in the business card example described above can supplement existing optical character recognition technology. In other words, the image data from the optical sensor can be applied to both the bedoop decoder and the OCR system. Text characters identified by the OCR system can be entered directly into the contact manager's personal database. Efficiently use the technology used in the Bedoop system to find encoded objects and handle visible distortions (eg, visible artifacts caused by scaling or rotation) for OCR detection OCR information can be extracted without carefully placing cards.
[0672]
Although some of the above-described embodiments have referred to inkjet printing, other printing technologies such as laser / xerographic printing, offset printing, etc. often have similar benefits.
[0673]
In general, the vedoop decoding of the above-described embodiment starts from image data obtained from a physical object. However, in certain situations, for example, it is advantageous to decode the image data electronically provided from the Internet.
[0674]
Similarly, while the previous embodiments generally relied on bedoop image sensors that looked for an object at an expected point, other embodiment sensors (as described above with respect to the elevator example) stare. I was able to explore instead.
[0675]
Similarly, although the illustrated embodiment typically utilizes sensors that repeatedly acquire multiple frames of image data, this is not really necessary. A single frame system, such as a flatbed scanner, or a video system configured to acquire a single frame can be used with or without a TWAIN interface.
[0676]
As described above, in the preferred embodiment, a digital code in a visible form such as a bar code can be used as long as it allows for aesthetic aspects using a steganographic encoding process for digital data.
[0677]
In some embodiments, digital data sent by means other than light can be used. By configuring an electromagnetic detector (e.g. of the type used in proximity-based card access systems) and decoding the digital data, the position away from the physical object just as in the above embodiment Can be read from.
[0678]
In general, a bedoop image sensor acquires a plurality of frames of data, so that digital data is extracted based on one or more image frames. If this result is trusted, data decoded in a plurality of frames can be stored. Furthermore, the movement of the object within the field of view of the sensor can improve the operation of the system, as it allows the system to acquire information from other perspectives, and so on.
[0679]
The preferred embodiment utilizes a 2D image sensor (eg, a CCD), but other light detection techniques may be utilized instead. For example, a supermarket laser scanner can read barcode data. Laser scanning of such a system makes it possible to acquire 2D data (either in bitmap format or in gray scale).
[0680]
In some embodiments, it may be advantageous to apply texture-based vedoop encoding to the object. Bedoop texturing can be affected by various means. This includes pressure rollers, chemical etching, laser etching, and the like.
[0681]
Note that the response triggered by the watermark may change over time. This extends the useful life of the encoded object. For example, when starting marketing a new model year car in a magazine ad for the 1999 Ford Explorer that points to the Ford URL for the 1999 Ford Explorer The encoded link can be updated to point to the URL for the 2000 model version.
[0682]
Of course, in other embodiments, the character URL can be encoded and used to assign a browser or other information appliance to that address. Furthermore, although the character URL can be encoded, it is not necessary to use it. Instead, the database can map the encoded URL to the actual URL (ie, the URL that was assigned to the browser or otherwise entered with the response to the MediaBridge object). Such an embodiment URL is encoded in the object along with a future date. As soon as the object is “read”, the local (customer) computer checks the associated date. If the date is not recognized, the word URL is used as the actual URL. If the date is accepted, the customer computer can refer to the code for the remote database (eg, at the router) and see the actual URL (if the update was not requested, the same or newer ). The actual URL is then used when providing a response to the media bridge object.
[0683]
Since it is easy for artisans in this field to use the watermark encoding / decoding system, it will not be described excessively here. Conventionally, this technique is implemented by appropriate software stored in long-term storage (eg, disk, ROM, etc.) and transferred to temporary storage (eg, RAM) for execution on the associated CPU. In other embodiments, the function is achieved by dedicated hardware or a combination of hardware and software. In certain embodiments, reprogrammable logic including FPGAs can be used effectively.
[0684]
Generally, in the above-described embodiment, a digital code is sent using a planar object, but this is not really necessary. Similarly, other shaped objects can be used. Some shapes require relatively simple image processing tasks. As described above, the data image of a soft drink can, ie other cylindrical surfaces, can be remapped using a known geometric transformation to essentially “unwind” printing from the can. Other geometric styles require more complex remapping, which is generally the same for craftsmanship. (Encoding specific reference markings such as subliminal meshes in the data facilitates such remapping. The 3D shape of the unknown object being imaged is typically a 2D generated by a scanner. (It can be estimated from the apparent distortion of the reference marking in the image data. Once the distortion is characterized, it is generally easy to eliminate the distortion and generate the image data for decoding.)
[0685]
It was once common to predict that paper documents would replace electronic media. With wisdom, electronic media may be considered a poor alternative to paper. Electronic media sends information without harm, but lacks empirical attributes. We hold paper, stack it, own it, give it, and protect it. It provides an opportunity for physical possession that is completely lacking in electronic media.
[0686]
From the above discussion, rather than replacing paper with electronic media, it is likely that in the future, paper will be given digital characteristics that mix the physical empirical techniques of paper and the technical merits of digital media. ing. This arrangement makes it possible to use a great variety of new functions that are accessible via familiar paper items rather than by “computer input peripherals”.
[0687]
In order to provide a comprehensive disclosure of this specification without being overly lengthy, Applicants rely on the patents, applications and publications identified above.
[0688]
In view of the many embodiments to which the detailed principles described above are applicable, it should be understood that the detailed embodiments are for illustrative purposes only and should not be construed as limiting the scope of the invention. It is. Rather, we claim that all embodiments of our invention are encompassed within the scope and spirit of the following claims and their equivalents.
[Brief description of the drawings]
FIG. 1 illustrates the principle processing elements of an example of a system using the present technology.
FIG. 2 is a block diagram illustrating an example of a system that executes the response process of FIG. 1;
FIG. 3 is a block diagram specifically detailing the originating device used in the system of FIG.
FIG. 4 illustrates a particular top level data flow of the system of FIG.
FIG. 5 illustrates a particular data flow associated with the router of FIG.
6 shows a specific data flow associated with the registration process of FIG.
FIG. 7 illustrates a particular data flow associated with the product handler of FIG.
FIG. 8 shows a series of screenshots in an example system.
FIG. 9 shows a series of screenshots in an example system.
FIG. 10 shows a series of screenshots in an example system.
FIG. 11 is a block diagram illustrating another embodiment of the present technology.
FIG. 12 is a block diagram illustrating another embodiment of the present technology.
FIG. 13 is a block diagram of a conventional scanner.
FIG. 14 shows an object being scanned along an arcuate path.
FIG. 15 shows how object distortion is detected.
FIG. 16 illustrates the use of binocular processing to determine the attributes of a specific object.
FIG. 17 shows a watermark grid.
FIG. 18 shows a pre-distorted watermark grid.
FIG. 19 shows another watermark grid that has been pre-distorted.
[Explanation of symbols]
12 Originating device
14 Router / Server
15 logs
16 Product Handler
17 Registration database
18a, 18b, 18c resources
19 Registration server
20 objects

Claims (24)

An operation method of a wireless mobile phone device including an image sensor,
Generating gesture data relating to movement of the wireless mobile phone device by analyzing image information captured by the image sensor;
Decoding encoded data included in the image information;
Depending on the generated gesture data and the decoded encoded data, specifying an action desired by a user of the wireless mobile phone device;
Performing the action.   The operation method according to claim 1, wherein the action is an action related to message transmission from the wireless mobile phone device.   The operation method according to claim 1, wherein the action is an action related to activation of a video conference call.   The operation method according to claim 1, wherein the action is an action related to a schedule adjustment of a reservation.   The operation method according to claim 1, wherein the action is an action related to video viewing. The gesture data is
A first digital data set representing movement of the wireless cellular telephone device in a first direction;
Moving the second digital data set representing the said wireless cell phone device in a second direction Cartesian to said first direction,
The operating method according to claim 1, comprising:   7. The method of operation of claim 6, wherein the first and second digital data sets each include a data word in two's complement format. A wireless mobile phone device comprising an image sensor,
A processor that generates gesture data relating to the movement of the wireless mobile phone device by analyzing image information captured by the image sensor, and that decodes encoded data included in the image information;
A user interface that responds to the gesture data;
The user can give a corresponding command to the wireless mobile phone device by a specific movement of the wireless mobile phone device,
The wireless mobile phone device, wherein the command given to the wireless mobile phone device depends on the decoded encoded data and the generated gesture data. A processor executing a program and an application programming interface (API);
The wireless mobile phone device according to claim 8, wherein the API is an API that allows the program to issue an inquiry for requesting wireless mobile phone device movement data included in the gesture data. A module for providing the wireless mobile phone device movement data to the program in response to the inquiry;
The wireless mobile phone device according to claim 9, wherein the module includes a two-dimensional image sensor. A processor executing a program and an application programming interface (API);
The wireless mobile phone device according to claim 8, wherein the API is an API that allows the program to issue an inquiry for requesting wireless mobile phone device position data included in the gesture data. A processor executing a program and an application programming interface (API);
The wireless mobile phone device according to claim 8, wherein the API is an API that allows the program to issue an inquiry for requesting the gesture data. The API is an API for the current wireless cell phone device movement data included in the gesture over data to the program can request a wireless cellular telephone system according to claim 12. The API is the having a first function and said first function interrupting complementary functions for requesting the execution set of movement data or position data included in the gesture over data, according to claim 12 Wireless mobile phone device. The gesture data regarding the movement of the wireless mobile phone device is:
First gesture data relating to movement of the wireless mobile phone device in the X, Y and Z directions;
The operation method according to claim 1, further comprising second gesture data related to an orientation of the wireless mobile phone device . The second gesture data regarding the orientation of the wireless mobile phone device is:
Including a first parameter related to the rotation of said wireless cell phone device, operation method of claim 15. The second gesture data regarding the orientation of the wireless mobile phone device is:
The operation method according to claim 15, further comprising a second parameter relating to a tilt of the wireless mobile phone device . The second gesture data regarding the orientation of the wireless mobile phone device is:
A first parameter relating to rotation of the wireless mobile phone device;
A second parameter relating to the inclination of the wireless mobile phone device;
Operating method of claim 15 including. The image information includes calibration data encoded steganographically,
The operation method according to any one of claims 15 to 18, wherein the second gesture data regarding the orientation of the wireless mobile phone device is generated by analyzing the calibration data . The gesture data regarding the movement of the wireless mobile phone device is:
First gesture data relating to movement of the wireless mobile phone device in the X, Y and Z directions;
The wireless mobile phone device according to claim 8, further comprising second gesture data related to an orientation of the wireless mobile phone device. The second gesture data regarding the orientation of the wireless mobile phone device is:
The wireless mobile phone device according to claim 20, comprising a first parameter relating to rotation of the wireless mobile phone device. The second gesture data regarding the orientation of the wireless mobile phone device is:
The wireless mobile phone device according to claim 20, comprising a second parameter relating to the inclination of the wireless mobile phone device. The second gesture data regarding the orientation of the wireless mobile phone device is:
A first parameter relating to rotation of the wireless mobile phone device;
A second parameter relating to the inclination of the wireless mobile phone device;
The wireless mobile phone device according to claim 20, comprising: The image information includes calibration data encoded steganographically,
The wireless mobile phone device according to any one of claims 20 to 23, wherein the second gesture data related to an orientation of the wireless mobile phone device is generated by analyzing the calibration data.

Images