JP6038749B2 - Document browsing system and document browsing program - Google Patents

Description

  The present invention relates to a document browsing system and a document browsing program for realizing an AR (Augmented Reality) technique for displaying a composite image obtained by combining additional information with a captured image by an imaging device on a display device.

  Conventionally, when a recording medium on which identification information of additional information is printed is included in a captured image acquired by an imaging device, a composite image obtained by combining the additional information identified by the identification information on the recording medium in the captured image There is known an electronic device that displays the image on a display device (see Patent Document 1).

JP 2013-026922 A

  However, in the conventional electronic device, if the recording medium on which the identification information of the additional information is printed is included in the captured image acquired by the imaging device, the additional information identified by the identification information is used as the recording medium in the captured image. Since the composite image synthesized above is displayed on the display device, even if the provider of the additional information does not want the user of the electronic device to view the composite image, the user can use this recording medium. There is a problem that a composite image can be seen only by photographing with an imaging device of an electronic device.

  In view of the above, an object of the present invention is to provide a document browsing system and a document browsing program capable of adding restrictions when a combined image obtained by combining additional information with a captured image by an imaging device is displayed on a display device.

  The document browsing system of the present invention includes an electronic device including an imaging device and a display device, a captured image acquisition unit that acquires a captured image by the imaging device, and a display control unit that controls display by the display device, When the recording medium on which the identification information of the additional information is printed is included in the captured image acquired by the captured image acquisition unit, the display control unit satisfies the specific condition associated with the identification information, A synthesized image obtained by synthesizing the additional information on the recording medium in the captured image is displayed on the display device.

  With this configuration, when the recording medium on which the identification information of the additional information is printed is included in the captured image by the imaging device, the document browsing system of the present invention captures the image when the specific condition associated with the identification information is satisfied. Since the composite image obtained by synthesizing the additional information corresponding to the identification information on the recording medium in the image is displayed on the display device, it is possible to add a restriction when displaying the composite image on the display device.

  In the document browsing system of the present invention, the specific condition may include a condition of the position of the electronic device.

  With this configuration, the document browsing system of the present invention can display the composite image on the display device only when the electronic device is present at a specific position.

  In the document browsing system of the present invention, the specific condition may include a condition of a user of the electronic device.

  With this configuration, the document browsing system of the present invention can display the composite image on the display device only when the electronic device is used by a specific user.

  In the document browsing system of the present invention, the specific condition may include a time condition.

  With this configuration, the document browsing system of the present invention can display the composite image on the display device only when the current time is a specific time.

  The document browsing program of the present invention is a document browsing program executed by an electronic device including an imaging device and a display device, and includes a captured image acquisition unit that acquires a captured image by the imaging device, and a display by the display device. The electronic device is caused to function as a display control unit for controlling, and the display control unit is configured to identify the recording medium on which the identification information of the additional information is printed when the captured image acquired by the captured image acquisition unit includes the recording medium. When a specific condition associated with information is satisfied, a synthesized image obtained by synthesizing the additional information on the recording medium in the captured image is displayed on the display device.

  With this configuration, when the recording medium on which the identification information of the additional information is printed is included in the captured image by the imaging device, the document browsing program of the present invention captures the image when the specific condition associated with the identification information is satisfied. Since the composite image obtained by synthesizing the additional information corresponding to the identification information on the recording medium in the image is displayed on the display device, it is possible to add a restriction when displaying the composite image on the display device.

  The document browsing system and the document browsing program of the present invention can add a restriction when a combined image obtained by combining additional information with a captured image by an imaging device is displayed on a display device.

1 is a block diagram of a document management system according to an embodiment of the present invention. It is a figure which shows an example of the printed matter produced by the document registration system shown in FIG. It is a block diagram of the server shown in FIG. It is a figure which shows an example of the additional condition data shown in FIG. It is a block diagram of the document browsing apparatus shown in FIG. It is a figure which shows an example of the document registered into the server shown in FIG. It is a flowchart of operation | movement of the document browsing apparatus shown in FIG. 5 in the case of browsing a document. It is an example of the front view of the document browsing apparatus shown in FIG. 5 in the state which displays the picked-up image as it is. FIG. 6 is an example of a front view of the document browsing apparatus shown in FIG. 5 in a state where a combined image obtained by combining additional information is displayed on a recording medium in a captured image.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

  First, the configuration of the document management system 10 according to the present embodiment will be described.

  FIG. 1 is a block diagram of a document management system 10 according to the present embodiment.

  As shown in FIG. 1, the document management system 10 includes a document registration system 20 for registering a document, and a document browsing system 60 for browsing a document registered in the document registration system 20.

  The document registration system 20 includes a server 30 such as a PC (Personal Computer) that manages documents, a document registration device 40 such as a PC for registering documents in the server 30, and a printed matter 80 (see FIG. 2). For example, an image forming apparatus 50 such as a printer dedicated machine or an MFP (Multifunction Peripheral) is provided. The server 30, the document registration apparatus 40, and the image forming apparatus 50 are connected to each other through a network 11 such as a LAN (Local Area Network) or the Internet.

  FIG. 2 is a diagram illustrating an example of the printed matter 80 created by the document registration system 20.

  As shown in FIG. 2, a printed matter 80 created by the document registration system 20 is printed on a recording medium 81 such as a sheet of paper with the characters “sales” 82 and an AR marker as identification information of additional information added by the AR technology. 83 are printed. The AR marker 83 is, for example, a two-dimensional code.

  As shown in FIG. 1, the document browsing system 60 is a server 30 that is also a part of the configuration of the document registration system 20, and an electronic device such as a smartphone or a tablet for browsing a document registered in the server 30. A document browsing device 70. The server 30 and the document browsing device 70 are connected via the network 11 so that they can communicate with each other.

  FIG. 3 is a block diagram of the server 30.

  As shown in FIG. 3, the server 30 is a display device such as an operation unit 31 that is an input device such as a mouse or a keyboard for inputting various operations, and an LCD (Liquid Crystal Display) that displays various information. The display unit 32, a communication unit 33 that is a communication device that communicates with an external device via the network 11 (see FIG. 1), and a storage device such as an HDD (Hard Disk Drive) that stores various data. A storage unit 34 and a control unit 35 that controls the entire server 30 are provided.

  The storage unit 34 stores document data 34a for each document. The document data 34a includes print data 34b to be printed on the recording medium 81 (see FIG. 2) and additional information related data 34c related to additional information added to the recording medium 81 by the AR technique. . The additional information related data 34c includes image data 34d of additional information, medium position data 34e indicating a position on the recording medium 81 to which the additional information is added, and an addition indicating a condition for adding the additional information to the recording medium 81. Condition data 34f.

  FIG. 4 is a diagram illustrating an example of the additional condition data 34f.

  As shown in FIG. 4, the additional condition data 34f includes the condition of the position of the electronic device that has requested additional information (hereinafter referred to as “position condition”) and the condition of the user of the electronic device that has requested additional information. (Hereinafter referred to as “user conditions”) and time conditions (hereinafter referred to as “time conditions”).

  The position condition is, for example, “inside the company premises”, “meeting room”, or the like. The position condition can be specified by latitude and longitude, for example.

  The user condition is, for example, “person who is a director or higher”. The user condition can be specified by, for example, user identification information.

  The time condition is, for example, “August 23, 2013 to August 30, 2013”.

  The control unit 35 shown in FIG. 3 includes, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory) storing programs and various data, and a RAM (Random Access Memory) used as a work area of the CPU. And. The CPU executes a program stored in the ROM or the storage unit 34.

  FIG. 5 is a block diagram of the document browsing device 70.

  As shown in FIG. 5, the document browsing apparatus 70 includes an operation unit 71 that is an input device such as buttons for inputting various operations, a display unit 72 that is a display device such as an LCD that displays various types of information, A position information acquisition unit 73 such as a GPS (Global Positioning System) receiver that acquires the position information of the document browsing device 70, an imaging unit 74 that is an imaging device that captures a still image or a moving image, and the network 11 (see FIG. 1). .) Controls the communication unit 75, which is a communication device that communicates with an external device via the Internet, a storage unit 76, which is a storage device such as an HDD that stores programs and various data, and the entire document browsing device 70. And a control unit 77.

  The operation unit 71 may include an input device that forms a touch panel together with the display unit 72.

  The storage unit 76 stores a document browsing program 76 a that is executed by the control unit 77.

  The control unit 77 includes, for example, a CPU, a ROM that stores programs and various data, and a RAM that is used as a work area of the CPU. The CPU is configured to execute a program stored in the ROM or the storage unit 76.

  The control unit 77 executes a document browsing program 76 a stored in the storage unit 76, and thereby performs captured image acquisition means 77 a that acquires a captured image by the imaging unit 74 and display control that controls display by the display unit 72. It functions as the means 77b.

  Next, the operation of the document management system 10 will be described.

  First, the operation of the document registration system 20 when registering a document will be described.

  The document registration apparatus 40 registers, for example, document data 34 a corresponding to the document 90 shown in FIG. 6 in the server 30 via the network 11 in response to an instruction via an operation unit (not shown).

  The document 90 shown in FIG. 6 includes a character 91 “sales” and a table 92. A document registrant who instructs the document registration apparatus 40 to register the document 90 can specify, for example, the table 92 of the document 90 as additional information. The document registrant can also specify the additional condition data 34f.

  The control unit 35 of the server 30 stores the document data 34 a in the storage unit 34 in response to an instruction from the document registration device 40 via the communication unit 33.

  Next, the operation of the document registration system 20 when creating the printed matter 80 will be described.

  In response to an instruction via an operation unit (not shown), the document registration apparatus 40 instructs the server 30 to print based on the document data 34a corresponding to the document 90 shown in FIG.

  In response to an instruction from the document registration device 40 via the communication unit 33, the control unit 35 of the server 30 transmits the image data to the image forming apparatus 50 based on the print data 34b of the document data 34a corresponding to the document 90 illustrated in FIG. 2 is printed.

  Next, the operation of the document browsing system 60 when browsing a document will be described.

  FIG. 7 is a flowchart of the operation of the document browsing apparatus 70 when browsing a document.

  When a specific operation is input via the operation unit 71, the control unit 77 of the document browsing apparatus 70 operates as illustrated in FIG. 7 by executing the document browsing program 76a.

  As illustrated in FIG. 7, the captured image acquisition unit 77a of the control unit 77 determines whether a captured image including the recording medium 81 on which the AR marker 83 as illustrated in FIG. 2 is acquired is acquired (S101). ).

  If it is determined in S101 that the captured image including the recording medium 81 on which the AR marker 83 is printed is not acquired, the display control unit 77b displays the captured image on the display unit 72 as it is (S102). Return to processing.

  When it is determined in S101 that the captured image including the recording medium 81 on which the AR marker 83 is printed is acquired, the display control unit 77b is included in the AR marker 83 by interpreting the AR marker 83 according to a specific rule. The obtained URL (Uniform Resource Locator) is acquired (S103). Here, this URL indicates the location of the additional information related data 34 c corresponding to the AR marker 83 in the server 30.

  Next, the display control unit 77b accesses the URL acquired in S103 via the communication unit 75, and receives the additional information related data 34c specified by the URL from the server 30 (S104).

  Next, the display control unit 77b determines whether or not the position information acquired by the position information acquisition unit 73 satisfies the position condition in the additional condition data 34f of the additional information related data 34c received in S104 (S105). If the position condition is not set in the additional condition data 34f, the display control unit 77b determines in S105 that the position condition in the additional condition data 34f is satisfied.

  If the display control unit 77b determines in S105 that the position condition is satisfied, whether or not the identification information of the logged-in user satisfies the user condition in the additional condition data 34f of the additional information related data 34c received in S104. Is determined (S106). If the user condition is not set in the additional condition data 34f, the display control unit 77b determines in S106 that the user condition in the additional condition data 34f is satisfied.

  When the display control unit 77b determines in S106 that the user condition is satisfied, the display control unit 77b determines whether or not the current time satisfies the time condition in the additional condition data 34f of the additional information related data 34c received in S104 ( S107). If the time condition is not set in the additional condition data 34f, the display control unit 77b determines in S107 that the time condition in the additional condition data 34f is satisfied.

  If the display control unit 77b determines in S105 that the position condition is not satisfied, determines in S106 that the user condition is not satisfied, or determines in S107 that the time condition is not satisfied, the captured image is displayed as it is. Is displayed on the unit 72 (S102), and the process returns to S101. For example, as shown in FIG. 8, the document browsing device 70 displays the captured image of the recording medium 81 on which the characters 82 and the AR marker 83 are printed on the display unit 72 as it is.

  When the display control unit 77b determines in S107 that the time condition is satisfied, it is indicated in the on-medium position data 34e of the additional information related data 34c received in S104 among the recording medium 81 in the captured image acquired in S101. A composite image obtained by combining the additional information indicated by the image data 34d of the additional information related data 34c is displayed at the position on the display unit 72 (S108), and the process returns to S101. For example, as shown in FIG. 9, the document browsing device 70 displays a combined image obtained by combining the captured image of the recording medium 81 with the table 92 as additional information on the display unit 72.

  As described above, the document browsing apparatus 70 does not display the additional information on the display unit 72 if there is no recording medium 81 on which the AR marker 83 is printed, and therefore has the recording medium 81 on which the AR marker 83 is printed. Only the users who are able to confirm the additional information can ensure high security performance.

  In particular, when the recording medium 81 on which the AR marker 83 is printed is included in the captured image by the imaging unit 74 (YES in S101), the document browsing device 70 satisfies a specific condition associated with the AR marker 83. (YES in S105, YES in S106, and YES in S107), the composite image obtained by synthesizing the additional information on the recording medium 81 in this captured image is displayed on the display unit 72 (S108), so the composite image is displayed on the display unit 72. Restrictions can be added.

  Specifically, when the document browsing device 70 satisfies the position condition associated with the AR marker 83 printed on the recording medium 81 included in the captured image by the imaging unit 74 (YES in S105), the captured image is displayed. Since the synthesized image obtained by synthesizing the additional information on the recording medium 81 is displayed on the display unit 72 (S108), the synthesized image is displayed on the display unit 72 only when the document browsing device 70 exists at a specific position. Can be made.

  Further, when the user condition associated with the AR marker 83 printed on the recording medium 81 included in the captured image by the imaging unit 74 is satisfied (YES in S106), the document browsing device 70 records in the captured image. Since the combined image obtained by combining the additional information on the medium 81 is displayed on the display unit 72 (S108), the combined image is displayed on the display unit 72 only when the document browsing device 70 is used by a specific user. be able to.

  Further, when the time condition associated with the AR marker 83 printed on the recording medium 81 included in the captured image by the imaging unit 74 is satisfied (YES in S107), the document browsing device 70 records the recording medium in the captured image. Since the combined image obtained by combining the additional information on 81 is displayed on the display unit 72 (S108), the combined image can be displayed on the display unit 72 only when the current time is a specific time.

  The document browsing system 60 can provide a large amount of information to the user on the display unit 72 simply by distributing an inexpensive printed matter 80 to the user of the document browsing apparatus 70. For example, the document browsing system 60 can provide color additional information to the user on the display unit 72 simply by distributing a monochrome printed material 80 that is cheaper than a color printed material to the user of the document browsing device 70. it can. Further, the document browsing system 60 provides the user with high-resolution additional information on the display unit 72 only by distributing a low-resolution printed material 80 that is cheaper than the high-resolution printed material to the user of the document browsing device 70. can do.

  Even after the printed material 80 is created, the document browsing system 60 changes the additional information related data 34c associated with the AR marker 83 included in the printed material 80, thereby providing additional information to the user. Can be updated. For example, the document browsing system 60 can provide the user of the document browsing apparatus 70 in real time with information that changes daily such as daily special price information in the latest state.

  The document browsing system 60 includes the server 30 in the present embodiment, but may be configured only by the document browsing device 70 as long as the document browsing device 70 stores the document data 34a.

60 Document browsing system 70 Document browsing device (electronic equipment)
72 Display (display device)
74 Imaging unit (imaging device)
76a Document browsing program 77a Captured image acquisition means 77b Display control means 81 Recording medium 83 AR marker (identification information of additional information)
92 Table (Additional information)

Claims (9)

Electronic equipment,
Server and
With
The electronic device is
An imaging device ;
A display device ;
Captured image acquisition means for acquiring a captured image by the imaging device;
Display control means for controlling display by the display device;
With
The server stores additional information related data related to additional information displayed on the display device;
The additional information related data is:
Image data of the additional information;
Additional condition data indicating a specific condition associated with the identification information of the additional information;
Including
Wherein the display control means, when the identification recording medium in which information is printed is included in the acquired captured image by the captured image acquisition unit, associated the additional information corresponding to the identification information included in the captured image Retrieve data from the server,
The display control means determines whether or not the specific condition indicated by the additional condition data included in the additional information related data acquired from the server is satisfied,
Wherein the display control unit, when it is determined that the specific condition is satisfied associated with the identification information included in the captured image, represented by the image data included in the additional information related data acquired from the server document browsing system characterized by displaying a composite image that forms if the additional information on the recording medium in the captured image on the display device to be.   The identification information indicates a location of the additional information related data corresponding to the identification information,
  The display control unit accesses a location indicated by the identification information included in the captured image when the recording medium on which the identification information is printed is included in the captured image acquired by the captured image acquisition unit. The document browsing system according to claim 1, wherein the additional information related data is acquired from the server.   The display control unit causes the display device to display the captured image as it is while determining that the specific condition associated with the identification information included in the captured image is not satisfied. The document browsing system according to claim 1 or 2.   The additional information related data includes on-medium position data indicating a position on the recording medium to which the additional information is added,
  The display control means is indicated in the on-medium position data included in the additional information related data acquired from the server among the recording media in the captured image when the composite image is displayed on the display device. 4. The document browsing system according to claim 1, wherein the additional information is synthesized with a position.   The document browsing system according to claim 1, wherein the specific condition includes a condition of a position of the electronic device.   The document browsing system according to any one of claims 1 to 5, wherein the specific condition includes a condition of a user of the electronic device.   The document browsing system according to claim 1, wherein the specific condition includes a time condition.     An imaging device;
    A display device;
    Captured image acquisition means for acquiring a captured image by the imaging device;
    Display control means for controlling display by the display device;
  With
  The display control unit includes additional information related to the additional information when a recording medium on which identification information of additional information to be displayed on the display device is printed is included in the captured image acquired by the captured image acquisition unit. Of the related data, the additional information related data corresponding to the identification information included in the captured image is acquired from a server,
  The additional information related data is:
    Image data of the additional information;
    Additional condition data indicating a specific condition associated with the identification information;
  Including
  The display control means determines whether or not the specific condition indicated by the additional condition data included in the additional information related data acquired from the server is satisfied,
  When the display control means determines that the specific condition associated with the identification information included in the captured image is satisfied, the display control means indicates the image data included in the additional information related data acquired from the server. The display device displays a combined image obtained by combining the additional information to be combined on the recording medium in the captured image.   A document browsing program executed by an electronic apparatus including an imaging device and a display device,
  Captured image acquisition means for acquiring a captured image by the imaging device, and
  Causing the electronic device to function as display control means for controlling display by the display device;
  The display control unit includes additional information related to the additional information when a recording medium on which identification information of additional information to be displayed on the display device is printed is included in the captured image acquired by the captured image acquisition unit. Of the related data, the additional information related data corresponding to the identification information included in the captured image is acquired from a server,
  The additional information related data is:
    Image data of the additional information;
    Additional condition data indicating a specific condition associated with the identification information;
  Including
  The display control means determines whether or not the specific condition indicated by the additional condition data included in the additional information related data acquired from the server is satisfied,
  When the display control means determines that the specific condition associated with the identification information included in the captured image is satisfied, the display control means indicates the image data included in the additional information related data acquired from the server. A document browsing program that causes the display device to display a synthesized image obtained by synthesizing the additional information to be synthesized on the recording medium in the captured image.

Images