JP6539561B2 - Business card information management system - Google Patents

Description

  The present invention relates to a technology for making the information described on a received business card easily available to a business card receiver.

  Even today, where various information can be exchanged electronically, in business sites, information such as name, department, contact information (hereinafter referred to as “business card information.” In this specification, data corresponding to the information Business cards printed on paper media are also being exchanged. Usually, the recipient of the business card stores the received business card in a holder or the like, while the address book or address book (hereinafter referred to as "address book" or "address book") executed by the computer with information (business card information) described in the business card Manage data by entering in

  However, manually entering business card information into the address book is a time-consuming task. Therefore, the applicant has proposed a mechanism for limiting the range in which the business card information can be accessed by using the image of the business card itself received from the distributor (see Patent Document 1).

Patent 5721889

  By using the mechanism described in Patent Document 1, access to business card information can be permitted only to a user who actually holds a business card. On the other hand, if image processing technology is used, it is not impossible to create an image to be used for permission determination illegally, even if it takes much time and effort. Also, the system does not assume the use of the image image thus created illegally.

  In order to solve such technical problems, the present inventor proposes a system capable of confirming that a user accessing business card information actually holds the corresponding business card. Below, an example of the said system is shown.

(System 1: System to determine the existence of a business card on the server side)
The first system is a business card information management system having a terminal operated by a receiver of a business card and a server connected to the terminal via a network or the Internet, and the server side executes the business card presence determination Let's assume the case of In addition, the number of the terminals which comprise a system is arbitrary.

  The terminal in this system includes (1) a display unit or an illumination light source, (2) an imaging unit, and (3) a business card held in a position range illuminated by illumination light from the display unit or the illumination light source. A transmitting unit that transmits a first image image of a business card obtained by capturing the image by the imaging unit to the server via the network or the Internet; and (4) a similarity with the first image image is A receiver for receiving business card information, which is data of items printed on the business card, from the server when a high second image is registered in the server; (5) the business card information received And an address book management unit applied to a corresponding item of address book data referred to by an address book program executed through the terminal.

  Further, (1) a storage device for storing the second image image registered as original data of a business card and the business card information in the server in the system, and (2) the first terminal from the terminal (3) the display unit or a receiver unit for receiving the first image image received, whether or not the influence of predetermined color information and / or a luminance level included in the illumination light is included in the reception unit; A business card presence determination unit that determines using light emission control information that controls the light emission state of the illumination light source, and (4) only when it is determined that the influence of the illumination light is included, the first image and the first image A collation unit that collates the second image and determines whether the similarity between the two images is high; (5) if the similarity between the first image and the second image is high If it is determined, Reading the card information relating to the picture image from the storage device equipped with a transmission section that transmits to the terminal.

  In this system, although an image obtained by capturing an image of a business card is transmitted from the terminal to the server, data representing a feature of the image is extracted by the terminal, and data representing the extracted feature is transmitted to the server You may.

(System 2: System to determine the existence of a business card on the terminal side)
The second system is a business card information management system having a terminal operated by a receiver of a business card and a server connected to the terminal via a network or the Internet, and the terminal side executes the business card presence determination Let's assume the case of In addition, the number of the terminals which comprise a system is arbitrary.

  The terminal in this system includes (1) a display unit or an illumination light source, (2) an imaging unit, and (3) a business card held in a position range illuminated by illumination light from the display unit or the illumination light source. The light emission of the display unit or the illumination light source determines whether the first image image of the business card obtained by capturing an image by the imaging unit includes the influence of the illumination light having a predetermined color information or luminance level. A business card presence determination unit determined using light emission control information for controlling a state, and (4) the first image from which the influence of the illumination light is removed only when it is determined that the influence of the illumination light is included When it is determined that the image is transmitted to the server via the network or the Internet, and it is determined that the influence of the illumination light is not included, the first image image is transmitted via the network or the Internet (5) data of a matter printed on the business card when a second image having a high similarity to the first image is registered in the server; A receiving unit for receiving business card information from the server; (6) an address book managing unit for applying the received business card information to corresponding items of address book data referred to by an address book program executed through the terminal; To carry.

  Further, (1) a storage device for storing the second image image registered as original data of a business card and the business card information in the server in the system, and (2) the first terminal from the terminal (3) a collating unit that collates the first image and the second image and determines whether the similarity between the two images is high; 4) When it is determined that the similarity between the first image and the second image is high, the business card information related to the second image is read from the storage device and transmitted to the terminal And a transmitter unit.

  Also in the case of this system, although an image obtained by capturing an image of a business card is transmitted from the terminal to the server, data representing the feature of the image is extracted by the terminal, and the extracted data is transmitted to the server It is good.

(System 3: Application system)
The third system comprises a first terminal operated by a first recipient of a business card, a second terminal operated by a second recipient of a business card, and a third terminal operated by a distributor of the business card And a first server connected to the first terminal via the Internet and providing a personal cloud service, and a second server connected to the second terminal via the Internet to provide a public cloud service And the second terminal or the second server is equipped with the business card presence determination function described above.

  According to the present invention, a receiver of a business card can easily make business card information even when a code such as a bar code is not printed on the surface of the business card, or even when OCR software is not installed on a terminal used by the receiver of the business card. Systems that can be used to Further, according to the present invention, the system can also cope with access to business card information using an image image created illegally.

FIG. 1 is a diagram for explaining a system configuration of a first embodiment. FIG. 2 is a diagram for explaining functional configurations of a terminal and a server that configure the system of the first embodiment. The figure which shows the example of a combination of the element technology used for existence determination. The figure which shows the example of control in the case of using a display screen as an illumination light source. The figure explaining the usage form according to the positional relationship of an illumination light source and a business card. FIG. 6 is a diagram for explaining the flow of processing executed by the terminal and the server according to the first embodiment. FIG. 6 is a view showing an example of an interface screen displayed when capturing an image. The figure which shows the example of an interface screen displayed when an applicable person is specified. The figure which shows the example of an interface screen displayed when several candidates exist. FIG. 7 is a diagram for explaining a system configuration of a second embodiment. FIG. 7 is a diagram for explaining functional configurations of a terminal and a server that configure the system of the second embodiment. FIG. 7 is a diagram for explaining the flow of processing executed by a terminal and a server according to a second embodiment. FIG. 7 is a diagram for explaining a system configuration of a third embodiment. FIG. 14 is a diagram for explaining functional configurations of a terminal and a server that configure the system of the third embodiment. FIG. 14 is a diagram for explaining the flow of processing executed by a terminal and a server according to a third embodiment. FIG. 14 is a diagram for explaining a system configuration of a fourth embodiment. FIG. 18 is a diagram for explaining functional configurations of a terminal and a server that configure a system of a fourth embodiment. FIG. 16 is a diagram for explaining the flow of processing executed by a terminal and a server according to the fourth embodiment. FIG. 14 is a diagram for explaining a system configuration of a fifth embodiment. FIG. 18 is a diagram for describing an overview of processing executed on the system of an eighth embodiment (part 1); FIG. 18 is a diagram for describing an overview of processing executed on the system of an eighth embodiment (part 2); FIG. 18 is a diagram for describing an overview of processing executed on the system of an eighth embodiment (part 3); FIG. 18 is a diagram for describing an overview of processing executed on the system of an eighth embodiment (part 4). FIG. 18 is a diagram for explaining the outline of processing executed on the system of embodiment 8 (part 5). FIG. 18 is a diagram for explaining the outline of processing executed on the system of embodiment 8 (part 6). FIG. 18 is a view for explaining a part of the functional configurations of a terminal and a server that configure the system of the eighth embodiment; FIG. 18 is a view for explaining a part of the functional configurations of a terminal and a server that configure the system of the eighth embodiment; FIG. 18 is a view for explaining the flow of processing executed by the terminal and the server according to the eighth embodiment (when the provision of business card information to a public type (information sharing type) service is denied); FIG. 18 is a view for explaining the flow of processing executed by the terminal and the server according to the eighth embodiment (when provision of business card information to a public type (information sharing type) service is permitted).

  Hereinafter, embodiments of the present invention will be described based on the drawings. The embodiment of the present invention is not limited to the examples described later, and various modifications can be made within the scope of the technical idea thereof.

(1) Embodiment 1: In the case where the server executes presence determination of a business card (part 1)
(1-1) System Configuration The present embodiment corresponds to the system 1 described above. FIG. 1 shows a configuration example of a business card information management system according to the present embodiment. The system according to the present embodiment is configured by connecting a terminal 1 operated by a receiver of a business card via a network or the Internet and a server 2 for managing business card information. The number of terminals 1 is arbitrary. The terminal 1 need not always be connected to the network or the Internet, but may be connected temporarily.

  The terminal 1 is a computer or an electronic device, and has a communication function. Electronic devices are various devices that basically have a computer. The form of the communication function may be arbitrary, and may be a wired communication standard or a wireless communication standard. In the case of a present Example, a computer, a tablet terminal, a smart phone, an electronic notebook, an electronic stationery etc. are assumed to the terminal 1. FIG. Therefore, the terminal 1 has an operation unit (CPU, RAM, ROM), a storage unit, an input / output device, a display device (which may be integral with the terminal 1 or externally attached), and a communication device. ing. In addition to this, the terminal 1 is provided with a light for illumination (illumination light source) as necessary. In addition, a camera 3 is provided in the terminal 1, and an image of the business card 4 can be acquired through the camera 3. The camera 3 may be connected to the terminal 1 through a cable such as a USB cable, may be connected to the terminal 1 by wireless communication, or may be integrally incorporated in the housing of the terminal 1. Further, the terminal 1 uses a light for illumination (illumination light source) or a display device as a light source of illumination light for illuminating the business card 4 at the time of imaging. The illumination light may be externally connected to the terminal 1 or may be integrally incorporated in the housing of the terminal 1. As described later, the camera 3 and the light source operate in conjunction with each other.

  The server 2 is a computer that performs predetermined processing on a request from a terminal 1 connected via a network or the Internet, and provides a processing result. The server 2 includes an operation unit (CPU, RAM, ROM), a storage unit, an input / output device, a display device, and a communication device. The server 2 does not have to be physically one server, and a plurality of servers may be linked to provide a management service of business card information according to the present embodiment. A database 5 is connected to the server 2. The database 5 stores at least an image of the business card 4 and corresponding business card information in a state of being associated with each other. Although FIG. 1 depicts the database 5 as an apparatus independent of the server 2, the database 5 may be an internal storage device of the server 2.

  Here, the image image of the business card basically means the image image of the entire business card, and does not include the image image of the background space of the business card captured at the time of imaging. However, even if an image of the background space of a business card is included, it is easy to remove by existing image processing. Also, the format of the image is not limited. The registrant of the business card information corresponding to the image image of the business card depends on the mode of operation of the system. For example, the registrant may be the distributor of the business card itself or the organization to which the distributor of the business card belongs (including the organization commissioned to provide the service from the organization. The same shall apply hereinafter) or the recipient of the business card But it is good. In addition, when the organization to which the provider of the business card belongs manages the server 2, the organization to which the recipient of the business card belongs (including the organization commissioned to provide the service from the organization. The same applies hereinafter) manages. In the case of operation, there may be a case in which a third party having neither a distributor nor a receiver of the business card manages and operates. In this embodiment, it is assumed that the organization to which the distributor of the business card belongs manages and operates the server 2.

(1-2) Configuration of Each Device The internal configuration of the terminal 1 and the server 2 will be described with reference to FIG. The terminal 1 includes an image acquisition unit 11, a business card image extraction unit 12, a transmission unit 13, a reception unit 14, an address book management unit 15, and an illumination unit 16. The functions of these processing units are often provided through the execution of programs by a CPU that constitutes a computer. Some processing units may be implemented as hardware. The image acquisition unit 11 interlocks with the camera 3 and the illumination unit 16 to acquire an image of the business card 4. The business card image extraction unit 12 extracts only the image image of the business card body from among the image images input from the image acquisition unit 11. However, when the extraction process is performed by the server 2, the execution of the business card image extraction unit 12 is unnecessary. The business card image extraction unit 12 extracts the image of the business card body from the image image using a known technology (for example, an edge detection technology or the like).

  The transmission unit 13 transmits the image of the business card body to the server 2 via the network or the Internet. The receiving unit 14 receives, from the server 2, business card information corresponding to the previously transmitted image. The file format of the business card information is, for example, vCard, CSV (Comma-Separated Values), html. When the file format of the business card information is vCard or CSV and the corresponding file is opened, the address book management unit 15 adds information to the corresponding item of the address book data. It is also assumed that the user of the terminal 1 manually copies the individual information displayed on the screen to the corresponding items of the address book data.

  In the case of the present embodiment, the illumination unit 16 is a generation source of illumination light used when imaging the business card 4 and is not necessarily a dedicated light source for illuminating the business card 4. The illumination unit 16 uses, for example, an external or built-in light (for example, when the terminal 1 is a smartphone, a small light arranged beside the camera 3) or an external or built-in display device. When used as a light source, the display device displays a single color image (blue screen, full white screen, etc.) or a pattern image having different display colors and luminances in a plurality of areas (for example, right and left or top and bottom). Further, the image displayed on the display device may be arbitrary as long as an effect to be described later can be obtained. At the time of imaging, the business card 4 is held in the position range illuminated by the illumination light. In addition, the image image of the business card 4 such that the illuminance on the business card 4 due to the illumination light output from the illumination unit 16 is higher than the illuminance on the business card 4 due to the ambient light (light under the use environment of the terminal 1) Is assumed to be imaged.

  The server 2 includes a receiving unit 21, a checking unit 22, a transmitting unit 23, and a business card presence determination unit 24. These processing units are also provided through the execution of a program by a CPU that constitutes a computer. However, some processing units may be implemented as hardware. The receiving unit 21 receives an image of the main body of the business card from the terminal 1 via the network or the Internet. The collation unit 22 collates the received image (image of the business card body) with the image (original image) stored in the database 5, and an image (original image) having high similarity to the received image. Search for It is desirable to use an image image from which the influence of illumination light has been removed. Since the light emission control data of the illumination light is known to the collation unit 22, it can be easily removed by image processing using the data.

  A known method is used for image image matching processing (image matching). The matching results include (1) when only one image image is hit, (2) when a plurality of image images are hit (ie, when a plurality of candidates are hit), (3) not applicable. The transmission unit 23 sends back these three types of comparison results to the terminal 1 that has transmitted the image. When only one image image having a high degree of similarity can be identified, the transmission unit 23 transmits business card information associated with the identified image image (here, the name, affiliation, contact information printed on the business card) Etc.) is also sent to the terminal 1.

  The business card presence determination unit 24 has a function of supplying data (light emission control data) for controlling light emission of illumination light used at the time of imaging a business card to the lighting unit 16 (using the transmission unit 23 for data transmission); And a function of determining whether the image received from 1 includes the influence of the illumination light controlled by the light emission control data. Control data of the illumination light is stored in a storage unit (not shown) in the server 2. The business card presence determination unit 24 starts using the service of downloading business card information through imaging of a business card, through detection of access to a portal site that provides the service, or from the terminal 1 to the effect that the corresponding application program has been started. Detect through notification. The business card presence determination unit 24 transmits the light emission control data to the terminal 1 using the service.

  Further, the business card presence determination unit 24 refers to the light emission control data, and determines whether or not the received image includes the influence of the illumination light controlled by the light emission control data. The determination criterion of the presence or absence of the influence of the illumination light depends on the content of the light emission control data. When it is determined that the influence is “included” (when it is determined that the business card is present), the business card presence determination unit 24 applies the image image received from the terminal 1 to the comparison unit 22. On the other hand, when it is determined that the influence of the illumination light controlled by the light emission control data is "not included" in the image (when it is determined that the business card does not exist), the business card presence determination unit 24 determines the image The transmission unit 23 is notified of this without giving it to the collation unit 22 (without executing the collation process etc.). In this case, the transmission unit 23 may change the combination (described later) of the light emission control data used for imaging the image pattern, while displaying a screen prompting the imaging of the image image again on the display unit of the terminal 1 .

(1-3) Combination of Elemental Technologies Used for Presence Determination FIG. 3 illustrates an example of a combination of element technologies used for presence determination. Basically, a combination of an illumination light output method by the illumination unit 16 and an imaging method by the camera 3 can be considered. In addition, when using the light for illumination as an illumination light source, the color and brightness | luminance of illumination light depend on the kind and range of the color which can generate | occur | produce illumination light itself, and brightness | luminance. In addition, when a display device is used as the illumination light source, the illumination light depends on the content of the display image.

  Thus, the element technology that can be used for the existence determination depends on the device configuration of the terminal 1. For this reason, in practice, it is preferable that the user can select a combination of element technologies used for the existence determination, or that software can select autonomously. Below, the example of control of the illumination light source corresponding to each combination is explained. In addition, about the control example which handles one brightness | luminance and / or color at 1 time among the control examples mentioned later, it is effective also to control of the light for illumination. However, it is not this limitation when the light for two or more kinds of illuminations can be used.

・ Combination 1
This combination is a case where the camera 3 captures a still image of the business card 4 illuminated with illumination light whose color and luminance do not change with time. Examples of the illumination light here include a white screen and a blue back screen. FIG. 4 (A) is an example of a white screen of the entire surface white, and FIG. 4 (B) is an example of the blue back screen. The example of the white screen includes any image that can not be recognized on the image image when the business card 4 is captured. When such an image is used as an illumination light source, the effect as illumination light is the same as when illuminating illumination light having a uniform luminance value and a specific color. In order to determine the existence of a business card, it is desirable that the luminance value and color of illumination light not present in the use environment.

  For example, a landscape image or other image as shown in FIG. 4E is the same as illuminating a white screen if the content of the image is not reflected on the surface of the business card 4. In addition to the above, as an example of illumination light, as shown in FIG. 4C, screens having different colors on the left and right of the screen (the upper and lower may be different or a combination of three or more colors may be used) or FIG. It may be a gradation screen as shown in). FIG. 4C can also be considered when the luminance is different between the left and right of the screen. Further, in FIG. 4D, not only the luminance level but also a gradation screen in which the hue changes from one side to the other side of the screen can be considered. Of course, the characteristic pattern portions of these screens are reflected on the surface of the business card 4 to maximize the influence of the illumination light. For example, in the case of FIG. 4C, the fact that both the left and right colors are reflected on the surface of the business card 4 makes it possible to confirm with high accuracy that the business card actually exists.

  In the case of this combination, the determination of the business card presence determination unit 24 is performed, for example, as follows. In the case of FIG. 4A, the business card presence determination unit 24 determines whether or not the business card 4 is present, depending on, for example, whether the average brightness level calculated from the image image exceeds the brightness level used as a threshold. That is, when the average luminance level calculated from the image image exceeds the threshold value, the business card presence determination unit 24 determines that the business card 4 is present. In the case of FIG. 4B (in the case of a blue back screen), the business card presence determination unit 24 determines whether or not the business card 4 is present depending on, for example, whether the number of blue components included in the image is greater than a threshold. Of course, when the threshold value is exceeded, the business card presence determination unit 24 determines that the business card 4 is present. In both FIGS. 4A and 4B, the illumination light for business card presence determination is not lit (while displaying the normal interface screen) and compared with the image image captured. The presence or absence of the influence can be determined more accurately. The threshold may be set using information (received from the terminal 1) such as the illuminance of ambient light around the terminal 1.

  In the case of FIG. 4C, the business card existence determination unit 24 determines whether or not the business card 4 exists, for example, depending on whether the two-color component designated by the light emission control data exists in the left, right or upper and lower areas of the image. Determine if If the specified two-color components exist, the business card presence determination unit 24 determines that the business card 4 is present. In the case of FIG. 4D, the business card existence determination unit 24 determines whether or not the business card 4 exists, for example, depending on whether the change in luminance level or color on the image matches the change specified in the light emission control data. Determine If the changes match, the business card presence determination unit 24 determines that the business card 4 is present. In the case of FIG. 4E, the business card presence determination unit 24 determines whether or not the business card 4 is present, for example, based on whether or not the color distribution of the image whose output is designated by the light emission control data appears on the image. When a predetermined color distribution appears, the business card presence determination unit 24 determines that the business card 4 is present. In any determination, the effect is further enhanced when the background of the business card 4 is white. A scheme may be adopted in which light emission control data according to the background color of the business card 4 is applied by allowing the user to input the background color of the business card 4 in advance or executing processing for automatically recognizing the background color. . For example, an image including many hues having a relationship between the background color of the name card 4 and the complementary color is used as illumination light.

・ Combination 2
This combination is a case where the camera 3 captures a moving image of the business card 4 illuminated with illumination light whose color and brightness do not change with time. The difference from Combination 1 is only that the captured image is a moving image. Since the color and the luminance of the illumination light do not change in the time direction, the determination accuracy based on the color and the luminance is almost the same as that of the combination 1. However, since the image image is captured as a moving image, the accuracy of the existence determination can be improved by combining it with the fluctuation (shake) of the image caused by the user holding the business card 4 by hand. The image captured in the moving image mode includes, for example, a plurality of still image sequences captured at one second intervals. Being able to capture a plurality of still image sequences continuous in time provides sufficient evidence that a business card is present in front of the camera 3.

  In the case of this combination, the determination of the business card presence determination unit 24 is performed, for example, as follows. For example, in the cases of FIG. 4A to FIG. 4E, the business card presence determination unit 24 detects the change in luminance by imaging not only during the output of the illumination light for business card presence determination but also during and after the period. Whether or not the business card 4 is present is determined depending on whether or not the change is a change assumed from the light emission control data. Further, for example, the business card presence determination unit 24 is a change assumed in luminance and color on the image image appearing before and after the output of the illumination light for business card presence determination, and is a change assumed for light emission control data It is determined whether the business card 4 is present or not according to whether or not is detected.

・ Combination 3
This combination is a case where the camera 3 captures a still image of the business card 4 illuminated with illumination light whose luminance changes with time. For example, when the display screen with high brightness (left side) and the display screen with low brightness (right side) are alternately switched as shown in FIG. 4F, for example, the brightness level becomes linear or nonlinear in the time direction. In the case of switching, when switching to a display screen of different luminance levels at random, as shown in FIG. In this case, the image image of the business card 4 is affected by the illuminance by the illumination light at any point in time. The business card presence determination unit 24 collates the light emission control data at the imaging time based on the time information at the imaging time attached to the image, and does the image image have an influence assumed from the luminance level of the illumination light at the imaging time? The existence of the business card 4 is determined by determining whether or not it is not. In order to improve the determination accuracy, it is desirable to use a plurality of image images captured by illumination light at two points in time having a luminance level difference equal to or greater than a predetermined value.

  In the case of this combination, the determination of the business card presence determination unit 24 is performed, for example, as follows. In the case of FIG. 4F, the business card presence determination unit 24 collates, for example, imaging time information of the image with the light emission control data to specify the luminance level of the illumination light at the time of acquisition of the image, and the illumination light It is determined whether the business card 4 is present or not by comparing the threshold value assumed from the brightness level of and the brightness level of the image. Alternatively, the business card existence determination unit 24 determines the existence of the business card 4 based on whether the amount of change in luminance level in the image at two imaging points exceeds a threshold. The same applies to the case of FIG. 4 (G).

・ Combination 4
This combination is a case where the camera 3 captures a moving image of the business card 4 illuminated with illumination light whose luminance changes with time. The difference from Combination 3 is only that the captured image is a moving image. In this case, it is possible to detect a change in the luminance level of the illumination light as a time change. The business card presence determination unit 24 determines the presence of the business card 4 by determining whether the change pattern of the luminance level appearing in the image image matches the change pattern of the light emission control data. Alternatively, the business card presence determination unit 24 determines the presence of the business card 4 based on whether the amount of change in luminance level generated in the image within the imaging time exceeds a threshold. The same applies to the case of FIG. 4 (G).

  In the case of this combination, the determination of the business card presence determination unit 24 is performed, for example, as follows. For example, in the case of FIG. 4F, the business card presence determination unit 24 detects a change in luminance during the output of the illumination light for business card presence determination, depending on whether the change is a change assumed from the light emission control data. It is determined whether the business card 4 exists. The same applies to the case of FIG. 4 (G). When the presence determination of the business card is performed on the server 2 side, the transmission unit 13 of the terminal 1 transmits time information capable of specifying a time change of the luminance level to the server 2 in association with the image.

・ Combination 5
This combination is a case where the camera 3 captures a still image of the business card 4 illuminated with illumination light whose color changes with time. For example, as shown in FIG. 4 (G), when colors switch on the left and right of the screen with time change, when hue changes linearly or non-linearly in the time direction, it appears when switching to display screens of different hues at random. In this case, the image of the business card 4 is affected by the hue of the illumination light at any point in time. The business card presence determination unit 24 collates the light emission control data at the imaging time based on the time information at the imaging time attached to the image image, and whether the influence assumed from the hue of the illumination light at the imaging time is included in the image The presence of the business card 4 is determined by determining In order to improve the determination accuracy, it is desirable to use a plurality of image images captured at the timing when illumination light of different luminance levels is irradiated.

  In the case of this combination, the determination of the business card presence determination unit 24 is performed, for example, as follows. The business card presence determination unit 24 collates, for example, imaging time information of the image with the light emission control data, identifies the color or color arrangement pattern of the illumination light at the time of acquisition of the image, and identifies the color or coloration of the identified illumination light Whether or not the business card 4 is present is determined based on the degree of coincidence between the pattern and the color or color arrangement pattern of the image. When the presence determination of the business card is performed on the server 2 side, the transmission unit 13 of the terminal 1 transmits time information capable of specifying a time change of the color information to the server 2 in association with the image.

・ Combination 6
This combination is a case where the camera 3 captures a moving image of the business card 4 illuminated with illumination light whose color changes with time. The difference from the combination 5 is only that the captured image is a moving image. In this case, it is possible to detect a change in the hue of the illumination light as a change in the hue of the image. The business card presence determination unit 24 determines the presence of the business card 4 by determining whether the change pattern of the hue appearing in the image image matches the change pattern of the light emission control data.

  In the case of this combination, the determination of the business card presence determination unit 24 is performed, for example, as follows. For example, the business card existence determination unit 24 detects a change in color or color arrangement pattern while capturing the illumination light for business card existence determination not only during output but also during and after the period, and the change is assumed from the light emission control data It is determined whether the business card 4 is present or not depending on whether or not it is a change. Further, for example, the business card presence determination unit 24 determines whether the business card 4 is present or not depending on whether the color or the color arrangement pattern in the output of the illumination light for business card presence determination is a change assumed from the light emission control data. . When the presence determination of the business card is performed on the server 2 side, the transmission unit 13 of the terminal 1 transmits time information capable of specifying a time change of the color information to the server 2 in association with the image.

・ Combination 7
This combination is a case where the camera 3 captures a still image of the business card 4 illuminated with illumination light whose color and luminance level change with time. In this case, the image image of the business card 4 is affected by the hue and luminance level of the illumination light at any point in time. The business card presence determination unit 24 collates the light emission control data at the imaging time based on time information at the imaging time attached to the image, and the influence assumed from the hue and luminance of the illumination light at the imaging time is included in the image The existence of the business card 4 is determined by determining whether or not it is. In order to improve the determination accuracy, it is desirable to use a plurality of image images captured at the timing when illumination light of different luminance levels is irradiated.

  In the case of this combination, the determination of the business card presence determination unit 24 is performed, for example, as follows. For example, the business card existence determination unit 24 collates the imaging time information of the image with the light emission control data, specifies the luminance level and the color (or color arrangement pattern) of the illumination light at the time of acquisition of the image, and specifies the specified illumination. Whether the business card 4 is present or not is determined based on the degree of coincidence between the luminance level of light and the color (or color arrangement pattern) and the luminance level of the image and the color (or color arrangement pattern). When the presence determination of the business card is performed on the server 2 side, the transmission unit 13 of the terminal 1 transmits to the server 2 the time information capable of specifying the time change of the color information and the brightness level in association with the image.

・ Combination 8
This combination is a case where the camera 3 captures a moving image of the business card 4 illuminated with illumination light whose color and luminance level change with time. The difference from the combination 7 is only that the captured image is a moving image. In this case, it is possible to detect changes in the luminance level and color (or color arrangement pattern) of the illumination light as changes in the brightness level and color (or color arrangement pattern) of the image. The business card presence determination unit 24 determines the presence of the business card 4 by determining whether the change pattern of the luminance level and color (or color arrangement pattern) appearing in the image image matches the change pattern of the light emission control data.

  In the case of this combination, the determination of the business card presence determination unit 24 is performed, for example, as follows. For example, depending on whether the change in the color (including the color arrangement pattern) or the luminance level of the image image during the output of the illumination light for business card existence judgment is a change assumed from the light emission control data. It is determined whether the business card 4 exists. Of course, if the two changes coincide, the business card presence determination unit 24 determines that the business card 4 is present. When the presence determination of the business card is performed on the server 2 side, the transmission unit 13 of the terminal 1 transmits to the server 2 the time information capable of specifying the time change of the color information and the brightness level in association with the image.

(1-4) Use form Here, the use form example of the terminal 1 which comprises a system is demonstrated. FIG. 5A shows a typical usage when the terminal 1 is a desktop PC or the like. In this case, the camera 3 captures an image of the business card 4 presented in front of the display screen of the monitor of the terminal 1. In this case, the display screen is used as illumination light. FIG. 5 (B) shows a typical usage form in the case where the terminal 1 is a notebook PC or the like. Except that the display device is integrated with the lid member of the terminal 1, the usage configuration is the same as that of FIG. 5 (A).

  FIG. 5C shows a typical use form in the case where the terminal 1 is a portable terminal such as a smartphone. In this case, the business card 4 illuminated by the light provided on the back side of the smartphone (opposite to the main screen) is captured by the camera 3 provided on the same side as the light. FIG. 5D also shows the case where the terminal 1 is a portable terminal such as a smartphone. In this case, the camera 3 provided on the front side (the main screen side) of the smartphone captures an image of the business card 4. In this case, the display screen of the main display is used as illumination light.

(1-5) Processing Operation Subsequently, a processing operation executed in time series in the business card information management system according to the present embodiment will be described. In the following description, it is assumed that the user of the terminal 1 (recipient of a business card) knows a portal site (a web site address used by the server 2 to provide a service) that provides a distribution service of business card information. The following processing operation is started from the state in which the user of the terminal 1 accesses the corresponding portal site. Hereinafter, a series of processing operations will be described with reference to FIGS. 6 shows the flow of processing proceeding in time series, and FIG. 7 to FIG. 9 show examples of interface screens displayed as the processing progresses.

  When the user of the terminal 1 accesses the server 2 (portal site) (step S100), the business card presence determination unit 24 transmits light emission control data to the terminal 1 (step S101). The light emission control data is received by the operation unit of the terminal 1. Thereafter, the terminal 1 displays the screen shown in FIG. 7 on the display screen 30. In FIG. 7, the browser window 31 in the display screen 30 displays an instruction content such as "Please hold a business card to the camera" along with a title "Business card information provision service". The browser window 31 is provided through the receiving unit 21 of the server 2.

  After this display, the display screen 30 or the light for illumination is controlled for a fixed period in any of the modes shown in FIG. An image captured by the camera 3 within this fixed period is displayed on the monitor screen 32 of the browser window 31. Note that the imaging of the image may be performed once both before and during the output of the illumination light for business card presence determination so that the influence of the ambient light can be confirmed. As described above, in the imaging process of an image, the camera 3, the image acquisition unit 11, and the illumination unit 16 are interlocked.

  The captured image is transmitted from the terminal 1 to the server 2 through the image acquisition unit 11, the business card image extraction unit 12, and the transmission unit 13 (step S102). Thereafter, the business card presence determination unit 24 determines whether the influence of the illumination light instructed earlier through the light emission control data is included in the image. When the existence of the business card 4 is not confirmed, the business card existence determination unit 24 transmits different light emission control data to the terminal 1 or instructs reacquisition of an image under the same condition. As described above, in the case of the system according to the present embodiment, the user of the system is actually holding the business card in order to use the presence or absence of the influence appearing in the image through the emission control of the illumination light for the existence determination of the business card. It can be limited to a user who is likely to have a close personal relationship with a certain user or a person actually holding it. That is, the request for the business card information can be reliably eliminated from the person who has not actually distributed the business card. As a result, it is possible to realize a highly secure system in which the distributor of the business card can limit the unintended outflow of the business card information.

  When the presence of the business card is confirmed, the business card presence determination unit 24 provides the matching unit 22 with the corresponding image. The collation unit 22 collates the received image with the image (original image) stored in the database 5, and determines whether the degree of similarity between the two image is high. The collation result (including the name card information) is transmitted from the server 2 to the terminal 1 regardless of whether an image (original image) having a high degree of similarity is detected (step S103).

  When an image (original image) having a high degree of similarity can be specified, a screen as shown in FIG. 8 is displayed on the display screen 30 of the terminal 1. In the example of FIG. 8, before the display or transmission of the business card information, a comment is displayed on the browser window 31 to confirm to the user whether the collation result is correct and the similarity is displayed only when the confirmation by the user is obtained. A scheme is adopted in which business card information associated with a high image (original image) is displayed on the screen. When the file format of the business card information is vCard or the like, the address book management unit 15 of the terminal 1 automatically reflects the received business card information in the address book data.

  However, there is also a possibility that a plurality of image images (original images) having similar degrees of similarity may be hit. In this case, a screen as shown in FIG. 9 is displayed on the display screen 30 of the terminal 1. In the example of FIG. 9, a comment prompting the user of the terminal 1 to input additional information is displayed on the browser window 31. For example, in FIG. 9, an additional information input field 33 for inputting a part of the information printed on the name card 4 is provided. The information necessary for narrowing down may be specified from the server 2. When the send button 34 is clicked, the input information is sent to the server 2 and is used in the process of narrowing down the candidates by the matching unit 22. Note that a comment requesting retake of the image of the business card 4 may be displayed. Incidentally, in the matching process by the matching unit 22, when the image image (original image) having a high degree of similarity is not detected, or when a plurality of candidates remain, the server 2 only notifies the terminal 1 to that effect. Notify and do not provide business card information.

(1-6) Characteristic Effects As described above, using the business card information management system according to the present embodiment, the business card printed on the business card is also printed on the business card on which the barcode and the QR code are not printed. Information can be distributed to the recipients of the business card through the server 2. In addition, as in the present embodiment, a person who can access business card information by using an image image of a business card captured in real time (especially by using the presence or absence of the influence of special illumination light) Users) can virtually be limited to those who actually exchanged business cards.

  In addition, at business sites, since business cards exchanged with clients are often stored at hand, it is possible to make effective use of stored business cards. In particular, in the case of an existing system adopting a keyword input method, the business card information of the corresponding person can not be accessed if the correct reading name can not be inputted when searching for a person having a difficult reading name. It is only necessary to hold the camera 3 and access to business card information is easy since there is no need to specify a "read name". Furthermore, in the case of the present embodiment, it is not necessary to install the OCR software in the terminal 1 as in the existing system, and effective use of hardware resources of the terminal 1 and reduction of processing load can be realized. Of course, the cost for mounting the OCR software on the terminal 1 can also be eliminated.

(2) Embodiment 2: When the server executes presence determination of a business card (part 2)
(2-1) System Configuration The present embodiment is also an aspect of the system 1 described above. In the first embodiment described above, the case where the server 2 (business card presence determination unit 24) transmits light emission control data to the illumination unit 16 has been described, but in the present embodiment, the terminal 1 autonomously controls the illumination light. And a mechanism for giving the information to the server 2 (business card presence determination unit 24) is adopted.

  FIG. 10 shows a configuration example of a business card information management system according to the present embodiment. In FIG. 10, parts corresponding to those in FIG. 1 are given the same reference numerals. 10 differs from FIG. 1 in that light emission control data used at the time of imaging is included as information transmitted from the terminal 1 to the server 2. FIG. 11 shows the internal configuration of the terminal 1 and the server 2. In FIG. 11, parts corresponding to those in FIG. In the case of the present embodiment, the terminal 1 is provided with the light emission control unit 17, and the light emission control unit 17 autonomously controls the light emission state of the illumination unit 16. Further, light emission control data is transmitted from the light emission control unit 17 to the server 2 (business card presence determination unit 24). The content of the light emission control data is the same as that of the first embodiment, and the processing content of the business card presence determination unit 24 is the same as that of the first embodiment except that the presence determination is performed using the light emission control data given from the terminal 1 It is similar.

(2-2) Processing Operation and Effect FIG. 12 shows the processing operation executed in time series in the business card information management system according to the present embodiment. A series of processes are started by the user of the terminal 1 accessing the server 2 (portal site) (step S200). Thereafter, the terminal 1 displays the screen shown in FIG. 7 on the display screen 30. The access to the server 2 (portal site) is notified to the light emission control unit 17 by a CPU (not shown) in the terminal 1 or from the server 2.

  The light emission control unit 17 controls the display screen 30 or the lighting light based on the light emission control data held inside the terminal 1. As in the first embodiment, the display screen 30 or the light for illumination is controlled for a certain period in any combination shown in FIG. The image captured in this period is transmitted from the terminal 1 to the server 2 through the image acquisition unit 11, the business card image extraction unit 12, and the transmission unit 13 (step S201). At this time, light emission control data used to capture an image is also transmitted from the terminal 1 to the server 2.

  Thereafter, the business card presence determination unit 24 on the server 2 side determines whether the influence of the illumination light is included in the image based on the received light emission control data. When the existence of the business card 4 is not confirmed, the business card existence determination unit 24 transmits different light emission control data to the terminal 1 or instructs reacquisition of an image under the same condition. On the other hand, when the presence of the business card is confirmed, the business card presence determination unit 24 provides the matching unit 22 with the corresponding image. The collation unit 22 collates the received image with the image (original image) stored in the database 5, and determines whether the degree of similarity between the two image is high. The collation result (including business card information) is transmitted from the server 2 to the terminal 1 regardless of whether an image (original image) having a high degree of similarity is detected (step S202). Thereafter, the address book management unit 15 automatically reflects the received business card information on the address book data. Also by the mechanism of this embodiment, the same effect as that of the first embodiment described above can be realized.

(3) Embodiment 3: When the terminal executes presence determination of a business card (part 1)
(3-1) System Configuration The present embodiment corresponds to the system 2 described above. That is, unlike the first and second embodiments described above, the present embodiment corresponds to the case where the presence determination of the business card is executed at the terminal 1. For this reason, the terminal 1 side is provided with the function of determining the existence of a business card. FIG. 13 shows a configuration example of a business card information management system according to the present embodiment. In FIG. 13, parts corresponding to those in FIG. 1 are given the same reference numerals. In FIG. 13, since the presence determination of the business card is executed by the terminal 1, the image image captured by the camera 3 is transmitted to the server 2 only when the presence of the business card 4 is confirmed.

  FIG. 14 shows the internal configuration of the terminal 1 and the server 2 in the present embodiment. In FIG. 14, the parts corresponding to those in FIG. The configuration unique to FIG. 14 is that the terminal 1 is provided with the business card presence determination unit 18. The business card presence determination unit 18 determines the presence of a business card based on the light emission control data received from the server 2 and controls the light emission of the illumination unit 16. In FIG. 14, the functional block for transmitting the light emission control data is not clearly indicated on the server 2 side, but the light emission control data may be provided together with, for example, an image of the portal site. The business card presence determination unit 18 is installed in the terminal 1 as an application program, or is provided as a script from a portal site of the server 2.

(3-2) Processing Operation and Effects FIG. 15 shows processing operations performed in time series in the business card information management system according to the present embodiment. When the user of the terminal 1 accesses the server 2 (portal site) (step S300), light emission control data is transmitted from the server 2 to the terminal 1 (step S301). Thereafter, the terminal 1 displays the screen shown in FIG. 7 on the display screen 30. On the other hand, the business card presence determination unit 18 controls the display screen 30 or the lighting light based on the received light emission control data. As in the first embodiment, the display screen 30 or the light for illumination is controlled for a certain period in any combination shown in FIG.

  In this state, the business card presence determination unit 18 executed on the terminal 1 determines whether the influence of the illumination light applied to the business card 4 at the time of capturing the image is included in the captured image. In the case of the present embodiment, the target image is transmitted from the terminal 1 to the server 2 only when the existence of the business card is confirmed (step S302).

  Thereafter, the collation unit 22 collates the received image with the image (original image) stored in the database 5 to determine whether the degree of similarity between the two image is high. The collation result (including the name card information) is transmitted from the server 2 to the terminal 1 regardless of whether an image (original image) having a high degree of similarity is detected (step S303). Thereafter, the address book management unit 15 automatically reflects the received business card information on the address book data. Also by the mechanism of this embodiment, the same effect as that of the first embodiment described above can be realized.

(4) Embodiment 4: Case where terminal executes presence determination of business card (part 2)
(4-1) System Configuration The present embodiment is also an aspect of the system 2 described above. In the above-mentioned embodiment, although the case where server 2 transmits luminescence control data to terminal 1 was explained, in this embodiment, terminal 1 controls illumination light autonomously. FIG. 16 shows a configuration example of a business card information management system according to the present embodiment. In FIG. 16, parts corresponding to those in FIG. 13 are given the same reference numerals. In FIG. 16, since the terminal 1 has the light emission control data, the light emission control data is not transmitted from the server 2 to the terminal 1.

  FIG. 17 shows internal configurations of the terminal 1 and the server 2 in the present embodiment. In FIG. 17, parts corresponding to those in FIG. As described above, the business card presence determination unit 18 of the present embodiment uses the light emission control data held inside the terminal 1 to control the display screen 30 or the lighting light.

(4-2) Processing Operation and Effect FIG. 18 shows the processing operation executed in time series in the business card information management system according to the present embodiment. A series of processes are started by the user of the terminal 1 accessing the server 2 (portal site) (step S400). Thereafter, the terminal 1 displays the screen shown in FIG. 7 on the display screen 30. The access to the server 2 (portal site) is notified to the business card presence determination unit 18.

  Thereafter, the business card presence determination unit 18 controls the display screen 30 or the illumination light based on the light emission control data held in the terminal 1. As in the first embodiment, the display screen 30 or the light for illumination is controlled for a certain period in any of the modes shown in FIG. In this state, the business card presence determination unit 18 executed on the terminal 1 determines whether the influence of the illumination light applied to the business card 4 at the time of capturing the image is included in the captured image. In the case of the present embodiment, the target image is transmitted from the terminal 1 to the server 2 only when the existence of the business card is confirmed (step S401).

  Thereafter, the collation unit 22 collates the received image with the image (original image) stored in the database 5 to determine whether the degree of similarity between the two image is high. The collation result (including business card information) is transmitted from the server 2 to the terminal 1 regardless of whether an image (original image) having a high degree of similarity is detected (step S402). Thereafter, the address book management unit 15 automatically reflects the received business card information on the address book data. Also by the mechanism of the present embodiment, the same effect as that of the above-described third embodiment can be realized.

(5) Example 5
This embodiment uses the configuration of the first to fourth embodiments described above. FIG. 19 shows a configuration example of a business card information management system according to the present embodiment. In FIG. 19, parts corresponding to those in FIG. 1 are given the same reference numerals. As shown in FIG. 19, the basic configuration of the system is the same as that of the first embodiment. This embodiment mainly assumes a system built in the organization to which the recipient of the business card belongs. Therefore, an internal network is assumed for connection between the terminal 1 and the server 2. However, when a virtual LAN is built on the Internet, the Internet is also assumed as a network. The difference between the present embodiment and the first embodiment is that the image image stored in the database 5 is associated with shared information (information to be shared in the office such as a memo, a visit history, etc.) in addition to the business card information. It is.

  In the case of this embodiment, the display screen of the terminal 1 displays the business card information received from the server 2 as well as the shared information. The shared information is not limited to the display target of the terminal 1 but may be reflected by the address book management unit 15 on the address book data managed by the individual. In the case of this embodiment, sharing of client information in the company is further promoted.

(6) Example 6
This embodiment also uses the configuration of the first to fourth embodiments described above. In the above-described first embodiment, the light emission state of the illumination light used when capturing the image of the business card 4 is controlled. However, the control may be combined with capturing of an image of which the direction of the business card 4 is different. For example, the probability that the business card 4 actually exists in the hand of the user of the terminal 1 can be enhanced by combining with a mechanism for capturing an image in the direction designated by the business card presence determination unit 24. Here, the direction of the business card 4 includes, for example, (1) a plurality of arrangement directions (for example, vertically and horizontally) and (2) both front and back sides of the business card.

  In this case, in addition to the determination processing described in the first embodiment, the business card presence determination unit 24 determines the presence of the business card based on whether the received image includes still images having different orientations of the business card 4. Note that, for example, when the characters printed on the business card are in the portrait orientation, the collation unit 22 preferentially selects a still image in which the direction of the business card is close to the portrait direction, and in the case where the characters printed on the business card are in landscape orientation. Priority is given to still images close to the horizontal direction. When the received image is the front and back, the still image on the front is preferentially selected.

(7) Example 7
This embodiment also uses the configuration of the first to fourth embodiments described above. In the case of the first embodiment described above, the case where one image image and corresponding business card information are associated and stored in the database 5 has been described. In this embodiment, when there is business card information whose generation is newer than that of the business card information of the image transmitted from the terminal 1 to the server 2, the latest business card information is transmitted from the server 2. This is a mechanism to cope with the case where printing of a business card is not in time even if the affiliation etc. is changed. In addition, it is also a mechanism to cope with the case where there is a change in the affiliation etc from the receipt of the business card to the time of later communication.

  When an image (original image) having a high degree of similarity with the received image is detected, the collation unit 22 of the present embodiment further determines generation information of the image, and an image of a newer generation than the collated image. When the image is present, the business card information associated with the image image of the latest generation is given to the transmission unit 23. On the other hand, if several years have passed since the registration of the image determined to have a high degree of similarity, and there are multiple generations in between, the relationship between the receiver of the business card and the distributor of the business card is It is likely that it has already been diluted. Providing up-to-date business card information even to a person whose relationship is thus reduced may have a negative effect.

  Therefore, for example, when the difference between the generation (number) of the image image used in the matching process and the latest generation (number) of the same person exceeds the threshold value (for example, two generations) in the matching unit 22 in the present embodiment. Adds the ability to not provide the latest generation of business card information. In the collating unit 22 of the present embodiment, when the number of years elapsed from the date of registration of the image used for collation processing to the time of collation exceeds a threshold (for example, 2 years), the latest generation is generated. It is also possible to add a function that does not provide the business card information of. Not only one of these functions may be mounted, but both of them may be mounted as a function of the collation unit 22.

  In the case of this embodiment, the latest business card information of the same person can be acquired from the server 2 even if the generation of the business card possessed at hand is old. Therefore, even if there is a change of affiliation immediately before the exchange of a business card, and the printed business card of the previous affiliation is received because printing of the business card is not in time, or if there is a change of affiliation after the business card is received, It becomes possible to acquire business card information printed on the latest business card being used. In the present embodiment, by providing certain restrictions on the provision of the latest business card information, it is possible to limit the provision of information to a third party whose current transaction relationship is thin.

(8) Example 8
(8-1) Outline of System This embodiment corresponds to the system 3 described above. In the case of the systems 1 and 2, various methods for acquiring business card information have been described on the premise that the image of the business card and the business card information thereof have already been registered in the database of the server 2. The present embodiment corresponding to the system 3 is characterized in the procedure from the registration of the image image of the business card and the business card information to the disclosure to a third party. So, in a present Example, first, the outline | summary of the process performed in the name card information management system which concerns on a present Example is demonstrated using FIGS. 20-25. In these figures, parts corresponding to those in FIG. The terminal 103 (FIG. 25) corresponds to the terminal 1 of FIG.

(8-1-1) Personal Information Registration First, the recipient 1 who receives the business card from the distributor A accesses the server 100 on the cloud, and receives an image of the received business card and its business card information Register the printed name, department, contact information, etc.). The server 100 provides the recipient 1 with a management service of address book data as a personal cloud service. FIG. 20 shows the processing image. The receiver 1 who is the user of the terminal 101 captures an image of the business card 4 using the camera 3 and registers the image in the address book data displayed in the browser window. At this time, the receiver 1 also registers business card information using an input device (for example, a keyboard) of the terminal 101. The address book is provided as a function of software (address book program) executed by the server 100.

(8-1-2) Notification of registration to distributor and confirmation of intention to provide to public type service If there is registration (including change) of image and business card information, server providing personal type cloud service 100 notifies the terminal 102 operated by the distributor A of the business card that the business card information has been registered, and inquires whether or not there is an intention to provide the service to the public type service. FIG. 21 shows the processing image. Note that the e-mail address input as business card information is used for notification to the terminal 102. At this time, the distributor A is presented with business card information to be published. In addition, the mechanism of public service is also presented.

(8-1-3) Reply of Distributor The availability of disclosure of the registered business card information is sent from the terminal 102 operated by the distributor A of the business card to the server 100. FIG. 22 shows the processing image. The answer is either "permit" or "do not permit" publication of the business card information.

(8-1-4) When the Answer is "Don't Allow" In this case, the server 100 manages the image image of the business card of Distributor A registered earlier and its business card information only in the address book of Recipient 1 Continue to FIG. 23 shows the processing image.

(8-1-5) When the Answer is "Permit" In this case, the server 100 providing the personal cloud service is permitted to the server 200 providing the public cloud service. Move the image of distributor A's business card and its business card information. That is, the information on the distributor A managed in the address book of the receiver 1 is deleted. However, simultaneously with the deletion, a link is set between the area of the deleted data and the movement destination of the data. FIG. 24 shows the processing image.

  After setting the link, when the terminal 101 accesses the page of the distributor A of the address book, the server 100 (personal type service) accesses the business card information of the corresponding distributor A through the link, and the read business card information It sends to the terminal 1 which the recipient 1 operates. The recipient 1 can operate the address book displayed in the browser window of the terminal 1 without any discomfort.

(8-1-6) Request for Business Card Information by Second Recipient The subsequent processing is the same as that of the above-described embodiment. First, the second recipient (recipient 2) that has received the business card of the distributor A transmits an image of the business card of the distributor A to the server 200 that provides the public cloud service. FIG. 25 shows the processing image. Specifically, an image is transmitted from the terminal 103 operated by the recipient 2 to the server 200. At this time, it is determined whether the business card exists by any of the methods described in the first to seventh embodiments.

  When the existence of the business card is confirmed, the server 200 collates the received image with the registered image, and business card information associated with the image determined to have a high degree of similarity (early, receipt The business card information input by the person 1 is transmitted to the terminal 103. As a result, the receiver 2 who is the operator of the terminal 103 can easily reflect the name card information of the distributor A in the address book managed by the receiver A without manually inputting. When the recipient 2 also uses the address book service executed by the server 100, a link to the data of the distributor A on the server 200 is set for the corresponding page.

(8-2) Configuration of Each Device Hereinafter, the configurations of the terminals 101, 102, 103 and the servers 100, 200 necessary for realizing the above-described system will be described.

(8-2-1) Terminal 101
FIG. 26 shows the internal configuration of the terminal 101 operated by the recipient 1. The terminal 101 includes an image acquisition unit 11, a business card image extraction unit 12, an address book management unit 15, a business card information input unit 111, and a transmission / reception unit 112. These processing units are also provided through the execution of a program by a CPU that constitutes a computer. Also, some of the processing units may be implemented as hardware.

  The business card information input unit 111 is an input device (for example, a keyboard) used to input business card information printed on the business card 4 captured by the camera 3. In the case of the present embodiment, since the address book of the recipient 1 is executed by the server 100 providing the personal cloud service, the business card information input in the predetermined field on the browser window is the address book operation unit 15. And transmitted to the server 100 through the transmission / reception unit 112. The transmission unit 13 is a part of the function of the transmission / reception unit 112.

(8-2-2) Server 100
FIG. 26 shows an internal configuration of the server 100 that provides the recipient 1 with a personal cloud service. The server 100 includes a transmission / reception unit 121, an address book management unit 122, and a database 123. An address book management unit 122 manages an address book for each individual who is a service providing destination. The database 123 stores a plurality of address books in which only registered individuals are managed to be accessible. When there is a new registration in any of the address books under management, the address book management unit 122 notifies the registered person's e-mail address of registration of the image image of the business card and the business card information Also, it has a function of inquiring whether the registered business card information is disclosed to a third party who has received the business card other than the registrant (is it provided to a public service).

  When distributor A permits the provision of business card information to a third party who holds his / her business card, the address book management unit 122 moves the business card information or the like corresponding to the server 200 as shown in FIG. Of deletion of data) and setting of a link to a movement destination.

(8-2-3) terminal 102
The terminal 102 operated by the distributor A is an electronic device having a computer or a communication function having a computer as a basic configuration. The form of the communication function may be arbitrary, and may be a wired communication standard or a wireless communication standard. The terminal 102 is a computer, a tablet terminal, a smartphone, an electronic notebook, an electronic stationery or the like. The terminal 102 has a receiving unit that receives an inquiry from the server 100 and a transmitting unit that transmits a response to the inquiry to the server 100.

(8-2-4) terminal 103
The internal configuration of the terminal 103 is, for example, the same as the configuration (FIG. 2) of the terminal 1 of the first embodiment, so the description will be omitted. Of course, in the case where the mechanisms of the second to seventh embodiments are adopted for determining the existence of a business card, the configuration of the terminal 1 used in each embodiment is adopted.

(8-2-5) Server 2
FIG. 27 shows an internal configuration of the server 200 that provides the public type cloud service to the recipient 2. The server 200 includes a database 5, a collation unit 22, a transmission / reception unit 201, and an address book management unit 202. In the case where the mechanism of the first embodiment is adopted for the business card presence determination, the server 200 is provided with the business card presence determination unit 24. In addition to this, the server 200 is also provided with a communication function with the server 100. Of course, in the case of adopting the arrangements of the other embodiments 2 to 7 for the business card presence determination, the device configuration corresponding to each embodiment is adopted as the configuration of the server 200. The address book management unit 202 cooperates with the address book management unit 122 on the server 100 side to manage image images stored in the database 5 and their business card information.

(8-3) Processing Operation Subsequently, the processing operation executed in time series in the business card information management system according to the present embodiment will be described using FIG. 28 and FIG. FIG. 28 shows the processing operation when the distributor A of the business card rejects the request for providing the business card information to the public type (information sharing type) service. FIG. 29 shows the processing operation when the distributor A of the business card permits the request for providing the business card information to the public type (information sharing type) service.

(8-3-1) Processing operation 1
First, a case will be described in which the distributor A of the business card refuses to register the business card information of the business card distributed by himself / herself in a service published to a third party who holds his / her business card. In this case, as described above, FIG. 28 corresponds. In this case, the user of the terminal 101 (recipient 1 of the business card of the distributor A) accesses the address book on the cloud personally used by the user, and the image of the business card of the distributor A received anew And the business card information is registered in the server 100 (step S500).

  The server 100 registers the received image and the business card information in the database 123 in association with each other through the address book management unit 122. After the registration is completed, the address book management unit 122 addresses the e-mail address included in the registered business card information (that is, addressed to the terminal 102 operated by the distributor A), the business card by the third party (recipient 1) The registration of information and the availability of provision of the registered business card information to the public type service provided to the third party (recipient 2) are inquired (step S501). In the case of this example, a response to the provision rejection is sent back from the terminal 102 to the server 100 (step S502). In this case, the business card information registered in the server 100 is managed as information accessible only to the recipient 1 who has registered the information.

(8-3-2) Processing operation 2
Next, the case where the distributor A of the business card permits the business card information of the business card distributed by itself to be registered in a service published to a third party who holds the business card of the user will be described. In this case, as described above, FIG. 29 corresponds. The processes in steps S600 and S601 are the same as the processes in steps S500 and S501, and thus the description thereof is omitted.

  When the response of the provision permission is returned from the terminal 102 to the server 100 (step S603), the server 100 moves the permitted image and business card information to the server 200 providing the public type service (step S603). Step S604). The server 100 deletes the original data and sets a link to the destination as the data moves. As a result, the preconditions of the first to seventh embodiments described above are satisfied.

  In this state, the recipient 2 who knows the web page (the address of the service provided by the server 200) providing the business card information distribution service transmits the image image of the business card of the distributor A received by itself to the server 200. (Step S605). Specifically, an image is transmitted from the terminal 103 operated by the recipient 2 to the server 200. At this time, the existence determination process of the business card 4 described in the first to seventh embodiments is executed. When the existence of the business card 4 is confirmed, the server 200 collates the received image with the image stored in the database, and when an image having a high degree of similarity is detected, the server 200 generates a detected image. The associated business card information is returned to the terminal 103 (step S606).

  The terminal 103 reflects the received business card information in an address book on software executed through the own terminal. Note that the address book here is not limited to the address book stored in the hard disk of the terminal 103, and may be an address book on the cloud used by the recipient 1. When the recipient 2 also manages the address book through the service on the cloud, a link to the business card information of the server 200 is set on the corresponding page of the recipient 2's address book.

(8-4) Characteristic effects

  As described above, also in the case of the business card information management system according to the present embodiment, basically the same effect as that of the first embodiment can be obtained. In the case of this embodiment, business card data (image image and business card information) personally stored on the cloud by the receiver of the business card can be made public, and information can be shared among those who actually hold the business card. Becomes possible.

(9) Other Embodiments The present invention is not limited to the configurations of the above-described embodiments, but includes various modifications. For example, in order to explain the present invention intelligibly, the above-mentioned embodiments are described in detail for some of the embodiments, and it is not necessary to have all the configurations described. In addition, part of one embodiment can be replaced with the configuration of another embodiment, and the configuration of another embodiment can be added to the configuration of one embodiment. Moreover, it is also possible to add another structure to the structure of each Example, to substitute the partial structure of each Example by another structure, or to delete the partial structure of each Example.

  In addition, each configuration, function, processing unit, processing means, and the like described above may realize part or all of them as an integrated circuit or other hardware, for example. Further, each configuration, function, and the like described above may be realized by a processor interpreting and executing a program that realizes each function. That is, each configuration may be realized by software. In this case, information such as programs, tables, and files for realizing each function can be stored in a memory, a hard disk, a storage device such as a solid state drive (SSD), or a storage medium such as an IC card, an SD card, or a DVD. .

  REFERENCE SIGNS LIST 1 terminal 2 server 3 camera 4 business card 5 business card database 11 image acquisition unit 12 business card image extraction unit 13 transmission unit 14 reception unit 15 address book management unit DESCRIPTION OF SYMBOLS 16 ... Lighting part, 17 ... Emission control part, 18 ... Business card existence determination part, 21 ... Reception part, 22 ... Verification part, 23 ... Transmission part, 24 ... Business card existence determination part, 25 ... Business card image extraction part, 30 ... Display Screen 31 31 browser window 32 monitor screen 33 additional information input field 34 send button 100 server 1 101 terminal 1 (recipient 1) 102 terminal 2 (distributor A) 103 ... terminal 3 (recipient 2), 111 ... business card information input unit, 112 ... transmission / reception unit, 121 ... transmission / reception unit, 122 ... address book management unit, 123 ... database, 200 ... server 2, 201 ... transmission / reception unit, 202 ... address Book Management Department.

Claims (14)

A business card information management system comprising a terminal operated by a receiver of a business card and a server connected to the terminal via a network or the Internet,
The terminal is
A display unit or an illumination light source,
An imaging unit,
The first image image of the business card obtained by imaging the business card held in the position range illuminated by the illumination light from the display unit or the illumination light source by the imaging unit is the network image or the Internet via the network A transmitter that sends to the server;
A receiving unit that receives business card information, which is data of items printed on the business card, from the server, when a second image having high similarity to the first image is registered in the server; When,
An address book management unit which applies the received business card information to a corresponding item of address book data referred to by an address book program executed through the terminal;
Have
The server is
A storage device for storing the second image image registered as original data of a business card and the business card information in association with each other;
A receiver configured to receive the first image from the terminal;
Light emission control information for controlling the light emission state of the display unit or the illumination light source as to whether the received first image image includes the influence of predetermined color information and / or luminance level included in the illumination light A business card presence determination unit to use and determine;
A collating unit that collates the first image and the second image and determines whether the similarity between the two images is high only when it is determined that the influence of the illumination light is included. When,
When it is determined that the similarity between the first image and the second image is high, the business card information related to the second image is read from the storage device and transmitted to the terminal Department,
A business card information management system characterized by having. In the business card information management system according to claim 1,
The business card information management system, wherein the server transmits the light emission control information to the terminal via the network or the Internet. In the business card information management system according to claim 1,
The terminal further includes a light emission control unit configured to control a light emission state of the display unit or the illumination light source based on the light emission control information.
The business card information management system, wherein the terminal transmits the light emission control information to the server via the network or the Internet. A business card information management system comprising a terminal operated by a receiver of a business card and a server connected to the terminal via a network or the Internet,
The terminal is
A display unit or an illumination light source,
An imaging unit,
The first image of the business card obtained by imaging the business card held in the display unit or the position range illuminated by the illumination light from the illumination light source by the imaging unit has predetermined color information or luminance level A business card presence determination unit that determines whether or not the influence of the illumination light is included using light emission control information that controls the light emission state of the display unit or the illumination light source;
Only when it is determined that the influence of the illumination light is included, the first image image from which the influence of the illumination light is removed is transmitted to the server via the network or the Internet, and the influence of the illumination light is A transmitter that does not transmit the first image to the server via the network or the Internet when it is determined that the first image is not included;
A receiving unit that receives business card information, which is data of items printed on the business card, from the server, when a second image having high similarity to the first image is registered in the server; When,
An address book management unit which applies the received business card information to a corresponding item of address book data referred to by an address book program executed through the terminal;
Have
The server is
A storage device for storing the second image image registered as original data of a business card and the business card information in association with each other;
A receiver configured to receive the first image from the terminal;
A collating unit that collates the first image and the second image and determines whether the similarity between the two image is high or not;
When it is determined that the similarity between the first image and the second image is high, the business card information related to the second image is read from the storage device and transmitted to the terminal Department,
A business card information management system characterized by having. In the business card information management system according to claim 4,
The business card information management system, wherein the server transmits the light emission control information to the terminal via the network or the Internet. In the business card information management system according to claim 4,
The business card information management system, wherein the terminal further includes a light emission control unit configured to control a light emission state of the display unit or the illumination light source based on the light emission control information. In the business card information management system according to claim 1 or 4,
The business card information management system, wherein the illumination light is emitted from the entire surface of the display unit or from the illumination light source of a single color. In the business card information management system according to claim 1 or 4,
In the business card information management system, an image pattern having a plurality of areas having different color information and / or different luminance levels is displayed on the display unit at the time of capturing the first image. In the business card information management system according to claim 1 or 4,
The business card information management system, wherein the luminance level and / or color information of the illumination light changes in a time direction. In the business card information management system according to claim 1 or 4,
The business card information management system, wherein the imaging unit captures the first image as a still image or a moving image. In the business card information management system according to claim 1,
When the imaging unit captures the first image as a still image, when the luminance level and / or color information of the illumination light changes in the time direction.
The business card information management system, wherein the transmission unit of the terminal associates time information capable of specifying a time change of the luminance level and / or color information with the first image and transmits the information to the server. In the business card information management system according to claim 1,
When the imaging unit captures the first image as a moving image, when the luminance level of the illumination light and / or the color information changes in the time direction.
The business card information management system, wherein the transmission unit of the terminal associates time information capable of specifying a time change of the luminance level and / or color information with the first image and transmits the information to the server. A first terminal operated by a first recipient of the business card, a second terminal operated by a second recipient of the business card, a third terminal operated by a distributor of the business card, the third via the Internet A business card having a first server connected to one terminal and providing a personal cloud service, and a second server connected to the second terminal via the Internet and providing a public cloud service An information management system,
The first terminal is
A first imaging unit,
A transmitter configured to transmit the first image of the business card imaged by the first imaging unit and business card information, which is data of matters printed on the business card, to the first server via the Internet;
Have
The second terminal is
A second imaging unit,
A display unit or an illumination light source,
The second image image of the business card obtained by imaging the business card held in the position range illuminated by the illumination light from the display unit or the illumination light source by the second imaging unit is the second image via the Internet A transmitter to send to the server of
A receiver configured to receive the business card information from the second server when a third image having high similarity to the second image is registered in the second server;
An address book management unit which applies the received business card information to a corresponding item of address book data referred to by an address book program executed through the second terminal;
Have
The third terminal is
A reception unit that receives, from the first server, a notification of new registration of business card information of its own and an inquiry about availability of registered business card information to a public-type cloud service via the Internet;
A transmitter for transmitting a response to the inquiry to the first server via the Internet;
Have
The first server is
A receiving unit that receives the first image and the business card information from the first terminal via the Internet;
A process of applying the received first image image and the business card information to the corresponding item of the address book data managed for each individual, the first image image permitted to be provided to the public type cloud service, and An address book management unit that executes a process of moving the business card information to the second server and a process of setting link information for enabling access to the moved data to the address book data;
Notification of new registration of business card information and public of business card information registered to the third terminal operated by a registered person after registration of the first image and the business card information in the address book data A transmitting unit that transmits to the third terminal via the Internet an inquiry as to whether to provide the cloud service of the third type;
Have
The second server is
A storage device for storing the first image image and the business card information received from the first server as the third image image and the related business card information;
A receiver configured to receive the second image from the second terminal;
It is judged using the light emission control information for controlling the light emission state of the display unit or the illumination light source whether the received second image image includes the influence of the illumination light having a predetermined color information or a luminance level. Business card presence determination unit
A collating unit that collates the second image and the third image and determines whether the similarity between the two images is high only when it is determined that the influence of the illumination light is included. When,
When it is determined that the degree of similarity between the second image and the third image is high, the business card information related to the third image is read from the storage device and the second terminal is used. A transmitting unit to transmit,
A business card information management system characterized by having. A first terminal operated by a first recipient of the business card, a second terminal operated by a second recipient of the business card, a third terminal operated by a distributor of the business card, the third via the Internet A business card having a first server connected to one terminal and providing a personal cloud service, and a second server connected to the second terminal via the Internet and providing a public cloud service An information management system,
The first terminal is
A first imaging unit,
A transmitter configured to transmit the first image of the business card imaged by the first imaging unit and business card information, which is data of matters printed on the business card, to the first server via the Internet;
Have
The second terminal is
A second imaging unit,
A display unit or an illumination light source,
Predetermined color information or luminance in a second image image of a business card obtained by imaging the business card held in the second imaging unit with the business card held in the position range illuminated by illumination light from the display unit or the illumination light source A business card presence determination unit that determines whether or not the influence of illumination light having a level is included using light emission control information that controls the light emission state of the display unit or the illumination light source;
Only when it is determined that the influence of the illumination light is included, the second image image from which the influence of the illumination light is removed is transmitted to the second server via the Internet, and the influence of the illumination light is included. A transmitting unit that does not transmit the second image to the second server via the Internet if it is determined that the second image is not determined;
A receiver configured to receive the business card information from the second server when a third image having high similarity to the second image is registered in the second server;
An address book management unit which applies the received business card information to a corresponding item of address book data referred to by an address book program executed through the second terminal;
Have
The third terminal is
A reception unit that receives, from the first server, a notification of new registration of business card information of its own and an inquiry about availability of registered business card information to a public-type cloud service via the Internet;
A transmitter for transmitting a response to the inquiry to the first server via the Internet;
Have
The first server is
A receiving unit that receives the first image and the business card information from the first terminal via the Internet;
A process of applying the received first image image and the business card information to the corresponding item of the address book data managed for each individual, the first image image permitted to be provided to the public type cloud service, and An address book management unit that executes a process of moving the business card information to the second server and a process of setting link information for enabling access to the moved data to the address book data;
Notification of new registration of business card information and public of business card information registered to the third terminal operated by a registered person after registration of the first image and the business card information in the address book data A transmitting unit that transmits to the third terminal via the Internet an inquiry as to whether to provide the cloud service of the third type;
Have
The second server is
A storage device for storing the first image image and the business card information received from the first server as the third image image and the related business card information;
A receiver configured to receive the second image from the second terminal;
A collating unit that collates the second image and the third image and determines whether the similarity between the two images is high;
When it is determined that the degree of similarity between the second image and the third image is high, the business card information related to the third image is read from the storage device and the second terminal is used. A transmitting unit to transmit,
A business card information management system characterized by having.

Images