JP6170811B2 - Image pickup processing device - Google Patents

Description

  The present invention relates to an image capturing processing apparatus that can perform processing on an information exchange server or the like by capturing an image such as a logo mark.

  By clicking a button (for example, a “Like” button) on a social network service (SNS) page, the user may indicate that he / she likes the page, the target comment / image, etc. It can be done. Accordingly, there is a possibility that the user may be connected to another user who is clicking the “Like” button in the same manner, and it is expected that the possibility of SNS will be increased.

  For example, Patent Document 1 discloses that health information exchange is promoted using a “like” button.

JP2013-109618A

  However, in the prior art as described above, a screen for the user to press the “Like” button is required. For this reason, there has been a problem that a “like” button cannot be attached to a physical product itself or printed matter. That is, even if the user looks at the product itself or a photograph of the printed product and wants to use the “Like” button, the user has to connect to the Internet from the PC and press the “Like” button. Therefore, even if the user likes the product or the like, the “Like” button cannot be pressed at that time, and the user is bothered and interested, resulting in the “Like” button being pressed. There was a problem of disappearing.

  An object of the present invention is to solve the above-described problems and provide a system that can easily perform an action on an information exchange server device even for a physical product or the like.

(1) (2) An image imaging processing device according to the present invention is embedded in captured image acquisition means for acquiring a captured image obtained by capturing an image in which identification information is embedded as digital watermark data, and embedded in the acquired captured image Electronic watermark data acquisition means for acquiring identification information, correspondence information acquisition means for accessing the management server apparatus and acquiring the address and control information of the information exchange server apparatus recorded corresponding to the identification information; Access processing means for accessing the information exchange server device based on the acquired address of the information exchange server device and performing processing based on the acquired control information.

  Therefore, it is possible to easily perform an action on the information exchange server device by capturing an image in which digital watermark data is embedded.

(3) The image pickup processing device according to the present invention is characterized in that the access processing means performs the same processing as when the management server device is accessed and the evaluation button is clicked.

  Therefore, an action of clicking an evaluation button can be easily executed by capturing an image in which electronic watermark data is embedded.

(4) In the image pickup processing device according to the present invention, the access processing means acquires the writing page from the information exchange server device and writes the writing information included in the control information on the writing page for display. This is characterized by prompting the user to input an operation.

  Therefore, it is possible to easily write to the information exchange server by capturing an image in which a digital watermark is embedded.

(5) An image capturing processing apparatus according to the present invention captures an image in which the identification information is embedded as electronic watermark data, and a recording unit that records the address and control information of the information exchange server device in association with the identification information The identification information receiving means for receiving the identification information extracted from the captured image, and the image imaging device, recorded in association with the received identification information in order to access the information exchange server device and perform processing based on the control information Transmitting means for transmitting the address and control information of the information exchange server device to the image capturing processing device.

  Therefore, it is possible to easily perform an action on the information exchange server device by capturing an image in which digital watermark data is embedded.

(6) (7) The image imaging processing device according to the present invention is embedded in a captured image acquisition unit that acquires a captured image obtained by capturing an image in which identification information is embedded as digital watermark data, and embedded in the acquired captured image An icon for recording the electronic watermark data acquisition means for acquiring the identification information, the instruction for accessing the information exchange server device with the identification information, the captured image, and the instruction for registering the icon in association with each other Creation information recording means.

  Therefore, by capturing an image, the captured image can be converted into an icon.

(8) (9) In the image capturing processing device according to the present invention, the captured image acquiring means for acquiring the captured image obtained by capturing the image in which the identification information is embedded as the digital watermark data is embedded in the acquired captured image. Electronic watermark data acquisition means for acquiring identification information, correspondence information acquisition means for accessing the management server apparatus and acquiring the address and control information of the information exchange server apparatus recorded corresponding to the identification information; An icon creation information recording unit that records an instruction for performing processing based on the control information to the information exchange server apparatus, the captured image, and an instruction for registering an icon in association with each other.

  Therefore, by capturing an image, the captured image can be converted into an icon.

  In the embodiment, “captured image acquisition unit” corresponds to step S101 in FIG. 6, FIG. 11 or FIG.

  In the embodiment, “digital watermark data acquisition means” corresponds to step S102 of FIG. 6, FIG. 11 or FIG.

  In the embodiment, “corresponding information acquisition unit” corresponds to step S103 in FIG. 6 or FIG.

  In the embodiment, “access processing means” corresponds to steps S105 and S106 in FIG.

  “Accompanying” is a concept that includes not only the case where two or more pieces of data are transmitted simultaneously, but also the case where they are sequentially transmitted sequentially in time.

  The “program” is a concept that includes not only a program that can be directly executed by the CPU, but also a source format program, a compressed program, an encrypted program, and the like.

FIG. 1 is a diagram showing the overall configuration of an image capturing processing system according to an embodiment of the present invention. 2 is a hardware configuration of the image capturing processing device 14. It is a hardware configuration of the management server device 10. It is a flowchart which shows the production | generation process of a digital watermark image. It is a figure which shows the address and control information which were recorded matched with the identification information. It is a flowchart which shows the process at the time of logo mark imaging. It is a figure which shows the logo mark with the electronic watermark printed on the goods. It is a figure which shows a confirmation screen. It is an example of a page (fan page) that introduces products. It is a figure which shows the confirmation screen for a share. It is a flowchart of an icon creation process. It is a figure which shows the case where the created icon is affixed on a page. It is a flowchart of an icon creation process.

1. Image Imaging Processing Device FIG. 1 shows the overall configuration of an image imaging processing system according to an embodiment of the present invention. In this embodiment, the system includes an image imaging processing device 14, a management server device 10, an information exchange server device 12, and a user terminal device 24.

  For example, by imaging the logo mark attached to the product itself or the logo mark printed on a pamphlet, pressing the “Like” button (or any other evaluation button) on the product introduction page The case of executing is described.

  It is assumed that an operator who sells a product registers a product page for guiding the product in the information exchange server device 12. The user operates the user terminal device 24 to access the management server device 10. Control information indicating the address of the product page of the information exchange server device 12 and the content of processing is transmitted from the user terminal device 24 to the management server device 10 as correspondence information. The correspondence information receiving means 22 of the management server device 10 receives this correspondence information. The identification information issuing means 20 issues identification information in association with the received correspondence information and returns it to the user terminal device 24. The recording unit 18 records the correspondence information and the identification information in the recording unit 16.

  Receiving the identification information, the user terminal device 24 generates a logo mark using the identification information as a digital watermark. The user prints the logo with the digital watermark on a product or catalog.

  As described above, a product or the like on which a logo mark with a digital watermark is printed is sold by the user.

  When this product is purchased by the user and the user recommends the product, it can be performed as follows. The user operates the image capturing processing device 14 to capture the logo mark printed on the product. The captured image acquisition means 2 acquires this captured image.

  The digital watermark data acquisition unit 4 extracts and acquires identification information embedded as a digital watermark in the acquired captured image. The correspondence information acquisition means 6 accesses the management server device 10 and acquires the address and control information of the information exchange server device 12 recorded corresponding to the identification information.

The access processing means 8 accesses the information exchange server device 12 based on the acquired address of the information exchange server device 12, and performs processing based on the acquired control information. On the product page, the same processing is performed as when the “Like” button is clicked.

2. Hardware Configuration FIG. 2 shows a hardware configuration of the image capturing processing device 14. In this embodiment, the mobile phone device is configured as the image pickup processing device 14. A memory 22, a camera 24, a nonvolatile memory 26, a touch screen 28, and a communication circuit 30 are connected to the CPU 20. Note that circuits relating to the call are omitted.

  The communication circuit 30 is for connecting to the Internet. The touch screen 28 displays and receives an operation by a user's touch. In the nonvolatile memory 26, an operating system (Android (trademark), etc.) 32 and an image capturing processing program 34 are recorded. The image capturing processing program 34 functions in cooperation with the operating system 32.

  FIG. 3 shows a hardware configuration of the management server device 10. A memory 42, a hard disk 44, a DVD-ROM drive 46, and a communication circuit 48 are connected to the CPU 40.

The communication circuit 48 is for connecting to the Internet. An operating system (such as WINDOWS (trademark)) 50 and a management server program 52 are recorded on the hard disk 44. The management server program 52 exhibits its function in cooperation with the operating system 50. The operating system 50 and the management server program 52 are those recorded on the DVD-ROM 54 and installed on the hard disk 44 via the DVD-ROM drive 46.

3. Digital Watermark Image Generation Processing FIG. 4 shows a flowchart of digital watermark image generation processing by the management server device 10 (management server program 52) and the user terminal device 24.

  By the user's operation, the user terminal device 24 accesses the management server device 10 and requests a page for information registration (step S1). In response to this, the management server device 10 transmits a page for registration (step S11). The user terminal device 24 displays a page for registration. The user inputs the product page address and control information of the information exchange server device 12 on this screen. Here, the control information is information indicating what kind of processing is performed on the information exchange server device 12. The input address and control information are transmitted as correspondence information to the management server device 10 (step S2).

  The management server device 10 that has received the correspondence information generates unique identification information and transmits it to the user terminal device 24 (step S12). Furthermore, the management server device 10 records the address and control information on the hard disk 44 in association with the identification information (step S13). FIG. 5 shows an example of recorded addresses and control information. In the example of the first line, the address of a page (such as a fan page of Facebook (trademark)) that introduces the product is recorded. As the control information, control information for clicking the “Like” button for the page is recorded. In the figure, the control information is represented by text, but actually, a control code defined by an API or the like is recorded.

  The user terminal device 24 acquires a logo mark (step S3). In this embodiment, the logo mark of the information exchange server device 10 desired by the user is acquired. The user terminal device 24 records logo marks of various information exchange server devices 10 in advance. For example, logos such as Facebook (trademark), Twitter (trademark), and LinkedIn (trademark). The user terminal device 24 selects and acquires any logo mark based on the address input in step S2.

  Next, the user terminal device 24 embeds the received identification information (here, “3251623” (see FIG. 5)) as a digital watermark for the logo mark (step S4).

  Digital watermark generation methods include embedding watermark information that cannot be identified by the human eye in the noise part of the image, and embedding watermark information that cannot be identified by the human eye in parts where similar image components continue. For example, watermark information composed of noise components that cannot be identified by human eyes can be embedded in a part of the noise components. Alternatively, it is also possible to use a method of embedding watermark information that is difficult to be identified by the human eye by adding a small amount of change to the image in a certain pattern in a region having a high spatial frequency. The luminance information of the image can be used as an object to which a small amount of change is applied to the image.

  The user prints this on a product or a pamphlet using the logo mark image data in which the identification information is embedded, obtained as described above. For example, as shown in FIG. 7, a logo mark 100 is printed.

In the above description, the identification information is embedded on the user terminal device 24 side, but may be embedded in the management server device 10 and transmitted to the user terminal device 24.

4). Processing at the time of logo mark image capturing FIG. 6 shows a process flowchart at the time of logo mark image capturing processing. A user who has purchased a product images the logo mark 100 attached to the product with the camera 24 of the image capturing processing device 14 (a mobile phone device in this embodiment). The CPU 20 of the image capturing processing device 14 (hereinafter, the image capturing processing device may be omitted) acquires the captured logo mark image (step S101).

  The image capturing processing device 14 extracts identification information “3251623” embedded as a digital watermark in the acquired logo mark image (step S102). The image capturing processing device 14 transmits the extracted identification information “32526123” to the management server device 10 (step S103).

  The management server device 10 reads correspondence information (address, control information) recorded corresponding to the identification information “3251623” from the hard disk 44. As shown in FIG. 5, the address of the product introduction page and the control information of the “Like” click on the page are recorded in association with the identification information “3251623”, which is read out. The management server device 10 transmits the read correspondence information to the image capturing processing device 14 (step S201).

  The image correspondence processing device 14 receives this correspondence information (step S104). Subsequently, the image corresponding processing device displays a screen on the touch screen 28 for confirming whether or not the “like” processing may be performed on the product introduction page (step S104). FIG. 8 shows an example of the screen. If the user accepts this, an OK button 102 is clicked. When not accepting, the NG button 104 is clicked.

  When the NG button is clicked, the image capturing processing device 14 does not access the product introduction page and ends the process (step S105). When the OK button 102 is clicked, the image capturing processing device 14 accesses the product introduction page of the information exchange server device 12 based on the address information in the correspondence information (step S106). At this time, based on the address information, the image capturing processing device 14 is the type of the information exchange server device 12 to be accessed (for example, Facebook (trademark), Twitter (trademark), LinkedIn (trademark), or the like. ). A module for access recorded in advance corresponding to the type is started, the user ID and password recorded in the nonvolatile memory 26 are read, and access processing to the information exchange server device 12 is performed.

  The information exchange server device 12 performs an access authentication process based on the received user ID and password (step S301).

  Next, the image capturing processing device 14 transmits control information (or processing information generated based on the control information) in the correspondence information (step S107). Here, control information is transmitted for clicking the “Like” button on the product introduction page.

  Upon receiving this control information, the information exchange server device 12 executes a “like” button click process for the product digest page (step S302). As a result, in the product page as shown in FIG. 9, the same processing is performed as when the user clicks the “Like” button for the page. Therefore, on the screen of FIG. 9, when a person browsing this clicks on the link 108, the user is displayed as a person who pressed the “Like” button. Note that if the writing to the page is registered as correspondence information in FIG. 5, such a process can be performed.

  In the above description, a case has been described in which a user registers a product introduction page of the information exchange server device 12 as an address and performs processing for the page. The user can also register the address of the information exchange server device 12 and perform processing on the user's page used by the user in the information exchange server device 12.

  In this case, as shown in the second line of FIG. 5, the user records the address of the information exchange server device 12, the control information for sharing the page, and the control information indicating the written contents. In step S <b> 106 of FIG. 6, the image capturing processing device 14 reads the address of the page used by the user in the information exchange server device 12 from the hard disk 26 and accesses the page of the information exchange server device 12.

  In step S <b> 107, the image capturing processing device 14 performs processing for sharing a predetermined page described as control information. The image capturing processing device 14 transmits control information for sharing the page and control information indicating the written content to the information exchange server device 12 (step S107). The information exchange server device 12 sends a page for creating a link by pasting a page introducing a product to a page used by the user, and transmits the page to the raw image capturing processing device 14. At this time, the information exchange server device 12 generates a writing area using the written content “very good” described as the control information, and transmits it to the image capturing processing device 14.

  The image capturing processing device 14 displays the link generation and writing screen on the touch screen 28. FIG. 10 shows the displayed screen. In the area 202 for writing, “very good...” Previously written as control information is written, and if necessary, the user can write. In the link display area 204, a part of a page for introducing a product as a link destination is displayed. In the determination area 206, a “Share” button 208 and a “Cancel” button 210 are displayed for the user to select whether to share (display on the user's page) this link.

When the user operates the image capturing processing device 14 and presses the “share” button 208, the fact is transmitted to the information exchange server device 12. In response to this, a process for sharing the page introducing the product to the user's page is executed (step S302). When the user clicks the “Cancel” button 210, the process for sharing is not executed.

5. Other embodiments
(1) In the above embodiment, when the identification information is extracted from the captured logo mark in the image terminal processing device 14, the extraction is performed only with the captured logo mark. However, the extraction accuracy of the identification information may be increased by taking the difference between the captured logo mark and the logo mark in which the identification information is not embedded. In this case, a logo mark in which identification information is not embedded may be recorded in the image terminal processing device 14 in advance. A logo mark of the main information exchange server device 12 may be recorded, and a mark closest to the captured logo mark may be selected and used.

(2) In the above embodiment, the identification information is embedded in the logo mark. However, the identification information may be embedded in marks, symbols, pictures, characters, etc. other than logo marks.

(3) In the above embodiment, the logo mark to be imaged is printed. However, it may be a logo mark displayed on the screen of a display or TV receiver.

(4) In the above embodiment, even a printed logo mark is imaged so that the same function as clicking an icon can be performed. However, the present invention can also be applied to an icon with a function displayed on a touch screen (an icon that is processed by clicking) by embedding identification information in the icon image.

(5) In the above embodiment, when the user images the logo mark, the information exchange server device 12 performs a predetermined process. In addition to this, or instead of this, icon creation processing as shown in FIG. 11 may be executed.

  The image capturing processing device 14 acquires the captured logo mark image (step S101). Next, identification information is extracted from the captured logo mark image (step S102). Subsequently, execution data (icon execution data) for executing processing for accessing the management server device 10 with identification information is generated (step S108).

  Subsequently, the image capturing processing device 14 records a logo mark image, icon execution data, and an API for registering the icon in the nonvolatile memory 26 (step S109). In this way, data for generating an icon to be executed by clicking is recorded.

  When using this, the user reads a logo mark image, icon execution data, and an API for registering an icon from the nonvolatile memory 26. These data are copied to a page (for example, own page of the information exchange server device 12) where the icon is to be registered.

  In this embodiment, the logo mark image, the icon execution data, and the API for registering the icon are recorded with the logo mark image icon. Therefore, the user only has to drag the logo mark image displayed on the touch screen 28 and drop the icon on the page where the icon is to be registered. As a result, the information exchange server device 12 registers the logo mark image and the icon execution data as icons according to the API for registering the icons.

  As a result, an icon 300 as shown in FIG. 12 is displayed on the user's page. In the icon 300, “processing for accessing the management server device 10 with identification information” is registered as icon execution data. Therefore, when another user who is viewing this user's page clicks on the icon 300, the processing from step S103 onward in FIG. 6 is executed, and a “like” button is displayed on the fan page of the information exchange server device 12 or the like. The same processing as when the button is pressed can be performed.

  In addition, if identification data is embedded as digital watermark data in the image of the icon 300, the same processing can be performed by imaging.

  In the above, “processing for accessing the management server device 10 with identification information” is registered as icon execution data. However, as shown in FIG. 13, the management server device 10 corresponds to the identification information. Corresponding information may be acquired, and icon execution data may be generated based on the acquired correspondence information. When another user clicks the icon created in this way, step S106 and subsequent steps in FIG. 6 are executed.

(6) In the above embodiment, a mobile phone is used as the image capturing processing device 14, but a portable information terminal with a communication function, a camera with a communication function, or the like may be used.

(7) In the above embodiment, the user confirms whether or not to perform the process in FIGS. However, the process may be executed without confirming with the user.

Claims (2)

Captured image acquisition means for acquiring a captured image obtained by capturing an image in which identification information is embedded as digital watermark data;
Digital watermark data acquisition means for acquiring identification information embedded in the acquired captured image;
Corresponding information acquisition means for accessing the management server device and acquiring the address and control information of the information exchange server device recorded corresponding to the identification information;
Icon creation information recording means for recording an instruction for performing processing based on the control information to the information exchange server device, the captured image, and an instruction for registering an icon in association with each other;
An image pickup processing apparatus. An image imaging processing program for realizing an image imaging processing device by a computer, wherein the computer
Captured image acquisition means for acquiring a captured image obtained by capturing an image in which identification information is embedded as digital watermark data;
Digital watermark data acquisition means for acquiring identification information embedded in the acquired captured image;
Corresponding information acquisition means for accessing the management server device and acquiring the address and control information of the information exchange server device recorded corresponding to the identification information;
Image capturing for causing an information exchange server device to function as icon creation information recording means for recording a command for performing processing based on the control information, the captured image, and a command for registering an icon in association with each other Processing program.

Images