JP6968333B2 - Information provision system - Google Patents

Description

The present invention relates to an information providing system, and more particularly to an information providing system for providing useful information to a user of a client terminal such as a smartphone.

Patent Document 1 discloses a technique for easily fortune-telling a person's face, palmistry, and compatibility with a digital camera. In this digital camera, the owner's personal data is stored in the user information memory in advance, and when the subject is photographed, the image data is stored in the built-in memory. Then, the feature extraction unit reads the image data from the built-in memory, extracts the features, creates a caricature, selects the face pattern closest to the caricature by the system controller, and determines the fortune-telling attached to this face pattern. The result is read out and displayed on the liquid crystal panel.

Japanese Patent Application Laid-Open No. 2003-60956

However, the digital camera disclosed in Patent Document 1 can provide the user with only the same amount of information as that obtained by looking at a book in which information such as physiognomy is described. In this case, although the digital camera can process a huge amount of information, this processing capacity cannot be fully utilized.

In recent years, this problem also applies to smartphones, which are used as image pickup terminals instead of digital cameras. As is known, there are various application programs on smartphones. However, for example, an offline type fortune-telling application program, even if it is downloaded and installed on a smartphone, does not fully utilize its processing power as in the case of a digital camera.

As a result, the information provided to the user is only static, so users who are always provided with similar results will eventually get bored with this application program and will not continue to use it. Can be considered. In order not to make users bored, the information provided to users will need to be fresh as well as useful.

In fact, if you look at fortune-telling application programs, there are currently no explosive hits like game application programs, and fortune-telling application programs are online as well as offline. There is also data that tends to be uninstalled compared to application programs in other fields, including those.

In addition, imaging terminals such as digital cameras and smartphones will take various images, but it is necessary to simplify the management of those images and build a mechanism that enables effective use of the images after the fact. Is also desired.

In particular, in today's cloud service development, it has become possible to store a huge amount of images including moving images for a long period of time on a cloud server. Therefore, if the images captured by the image pickup terminal can be managed well, the range of utilization of the images will be expanded.

From the above point of view, in the end, the image-related application program is suitable for the user's taste while fully utilizing the processing power of the terminal on which it is installed, the user's satisfaction is high, and the user's usability is high. It can be said that there is no good application program.

Therefore, it is an object of the present invention to provide an information providing system using an image-related application program, which is attractive to the user.

Another object of the present invention is to provide an information providing system for providing useful information to a user of a client terminal such as a smartphone.

In order to solve the above problems, the information providing system of the present invention is used.
An capturing means for capturing user image or audio data (for example, the imaging means 110 in FIG. 2), a transmitting means for transmitting the data captured by the capturing means (for example, the transmitting means 120 in FIG. 2), and the like. (For example, the client terminal 100 in FIG. 1) and
Refer to the storage medium (for example, the storage medium 210 in FIG. 2) in which a plurality of images or sounds and the proposed information corresponding thereto are stored in a pair, and the storage medium based on the data transmitted by the transmission means. A reading means (for example, the reading means 220 in FIG. 2) for reading the proposal information corresponding to the data, and a reply means (for example, the reply means 230 in FIG. 2) for returning the proposal information read by the reading means. And a server device having (for example, the server device 200 in FIG. 1) and
To prepare for.

The information providing system of the present invention is, for example,
A client terminal having an image pickup means for capturing a face image of the user when the user is operating the client terminal body, and a transmission means for transmitting the face image captured by the image pickup means.
Corresponds to the face image by referring to the storage medium in which a plurality of face images and the proposal information corresponding to each face image are stored in a pair and the storage medium based on the face image transmitted by the transmission means. A server device having a reading means for reading the proposal information and a reply means for returning the proposal information read by the reading means.
To prepare for.

According to the present invention, the information provided to the user can be made dynamic by appropriately updating the proposed information to the desired one in the server device, and the information can be fresh and useful. It becomes possible to make things.

For example, as the above proposal information, a text in which the position of the information resource on the network is embedded in the required text part, indicating the sales destination of the product attached to the text part or the provision destination of the service. By updating to information including data, the user can obtain recommended products based on physiognomy based on facial images.

The capture means may immediately capture or record an image in response to an operation of an imaging instruction or a recording instruction by the user, or, for example, output when a predetermined time set in the client terminal arrives. An image may be taken while the user is performing a stop operation in response to the alarm to be issued. In the former case, the user will take the initiative in taking an image, but in the latter case, the system will take the initiative in taking an image.

When the system takes the initiative in imaging, the user can obtain effective information without any troublesome work, and the user does not use arbitrary imaging data, so to speak, in a natural way. The imaging data of the above can be used. Therefore, for example, if we provide users with today's fortune-telling results that many people are interested in, or if we provide recommended information that accompanies the fortune-telling results, we believe that the frequency of use of this system will increase. Be done.

In addition, according to one embodiment of the present invention, it is possible to effectively manage the imaging data and the like in the server device, so that useful information can be provided to the user.

In this way, since useful information can be provided to the user, it can be said that when the operation of the system is realized by the application program for the smartphone, the user uninstalls the application program less frequently.

Then, as a secondary effect, when the advertisement is displayed in the screen displayed on the display by invoking the application program, an excellent advertising effect can be obtained.

In this system, images are transmitted from the client terminal, so it is advisable to consider measures against image leakage on the network. If a secure system is built, problems such as image leakage will not occur, but even if image leakage occurs, image leakage that is against the user's will should be minimized. Therefore, it is advisable to confirm with the user whether or not the face image captured by the imaging means may be transmitted prior to the transmission.

Further, the program of the present invention is
Steps to capture user image or audio data,
The step of transmitting the captured data and
The step of receiving the proposal information when the proposal information corresponding to the transmitted data is returned, and
Can be executed by the client terminal.

It is a schematic block diagram of the information provision system 1000 of embodiment of this invention. It is a block diagram which shows the structure of the client terminal 100 and the server apparatus 200 shown in FIG. It is a flow chart which shows the operation of Example 1 of this invention. It is a figure which shows the screen display example of the smartphone 100 of Example 2 of this invention.

100 Client terminal 110 Imaging means 120 Transmission means 200 Server device 210 Storage medium 220 Reading means 230 Reply means 300 Administrator terminal 400 Network

Embodiment of the invention

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a schematic configuration diagram of an information providing system 1000 according to an embodiment of the present invention. FIG. 1 shows a client terminal 100, a server device 200, an administrator terminal 300, and a network 400, which will be described below.

FIG. 2 is a block diagram showing the configurations of the client terminal 100 and the server device 200 shown in FIG.

The client terminal 100 includes an image pickup means 110 such as a camera that captures a face image or the like of the user as a still image or a moving image when the user is operating the client terminal 100 main body, and a face image captured by the image pickup means 110. It is a terminal having a transmission means 120 for transmitting and the like to the server device 200, and a memory 130 for storing a face image and the like captured by the image pickup means 110.

As an example of hardware, the client terminal 100 can be realized by a smartphone, a digital camera with a communication function, a tablet with a camera, a notebook personal computer with a camera, a PDA with a camera, and the like.

Although the case of capturing the user's face image will be described here as an example, the image pickup target is not necessarily limited to the face image, and the user's voice is captured in place of the image or together with the image. It is also possible to set the voice as a transmission target by the transmission means 120.

However, it does not exclude that the image pickup means 110 and the transmission means 120 are realized by different hardware, and is connected to, for example, a webcam, a pointing device such as a mouse with a camera, or an IC recorder with a camera. It can be a notebook or desktop personal computer, a camera and a wristwatch with a communication function, or a wearable device with a camera and a communication function.

The server device 200 is based on a storage medium 210 in which a plurality of face images and the like and proposal information corresponding to each face image and the like are stored in a pair, and a face image and the like transmitted by the transmission means 120, which will be described below. It has a reading means 220 for reading the proposal information corresponding to the face image and the like with reference to the storage medium 210, and a reply means 230 for returning the proposal information read by the reading means 220 to the client terminal 100.

As the server device 200, various cloud-type database server devices such as IaaS, PaaS, SaaS, and DAAS can be used.

The storage medium 210 does not need to be a built-in type for the server device 200, and may be an external type. Further, the face image or the like transmitted by the transmission means 120 can be stored in the storage medium 210 or another storage medium.

In the storage medium 210, a folder or the like unique to each client terminal 100 is created, and the imaging data is stored in a physically or logically different area for each client terminal 100. Further, if the image data is stored with a file name that can specify the transmission date and time, it is possible to manage a plurality of facial images and the like in chronological order. Further, when the folder information is added to the image pickup data transmitted from the user, the image pickup data can be stored in the folder according to the information.

When managing a plurality of face images in chronological order, it is considered easier to compare the face images if their sizes are the same. Therefore, as will be described later, when the user takes the initiative in taking an image, for example, even if an auxiliary line for instructing the display position of the face image is displayed on the display serving as the finder of the smartphone 100 at the time of taking an image. good. On the other hand, the smartphone 100 may perform image processing such as enlargement or reduction in order to adjust the size of the face image without taking such measures.

The reading means 220 refers to the storage medium 210 based on the imaging data or the like transmitted by the transmitting means 120, and reads out the proposed information corresponding to the imaging data. Specifically, when the data transmitted by the transmitting means 120 is the imaging data, the reading means 220 extracts feature points such as the positions and sizes of the eyes and nose and performs face recognition processing and the like. , Identify the proposed information corresponding to the imaging data. On the other hand, when the data transmitted by the transmitting means 120 is voice data, the reading means 220 performs voice authentication processing or the like from the frequency spectrum or the like to specify the proposed information corresponding to the voice data.

The reply means 230 returns the proposal information read by the read means 220 to the client terminal 100.

The administrator terminal 300 is a terminal operated by the administrator of the server device 200. The administrator terminal 300 creates proposal information that can be transmitted to the client terminal 100 and transmits the proposal information to the storage medium 210, or the storage medium based on the newly created proposal information or the proposal information transmitted from another terminal (not shown). It is a terminal that updates the proposal information stored in 210. Each proposal information is stored in the storage medium 210 in a state of being associated with data such as a face image to be compared with the imaging data and the like.

An example of the hardware of the administrator terminal 300 is a personal computer, but the administrator terminal 300 is not limited to this, and may be a tablet or a smartphone as long as it is an information processing device having a communication function.

The network 400 connects the client terminal 100, the server device 200, and the administrator terminal 300 to each other. The network 400 can be various networks such as the Internet, Ethernet, and mobile phone networks. It does not matter whether the network 400 is a wired network or a wireless network.

Subsequently, with respect to the information providing system 1000 of the embodiment of the present invention, the case where a smartphone is used as the client terminal 100 and the following various processes are realized by the application program installed in the smartphone, together with various usage scenes. explain. For ease of understanding, the code 100 is also attached to the smartphone.

(Example 1)

FIG. 3 is a flow chart showing the operation of the first embodiment of the present invention. FIG. 3 shows the operation of the user, the client terminal (smartphone) 100, the server device 200, and the administrator terminal 300.

First, the administrator terminal 300 or another terminal (not shown) periodically or irregularly creates proposal information useful to the user (step S1).

Examples of proposed information, if the user is a woman, today's make-up, today's hairstyle, today's clothing, may be over today's lunch, soil variety. In addition, it is possible to propose actions such as going shopping on weekends, going to a hairdresser, cooking, and traveling. That is, the proposal information may be created for various periods such as daily, weekly, monthly, and yearly.

In addition, if multiple link destinations such as sites where coupons related to the content can be obtained can be linked to the proposal information, the user can move to the link destination by touching the screen of the smartphone 100. It can also be possible.

According to the example of the above proposal information, the link destination here is, for example, a beauty salon near the user's home address, work location, etc. obtained from the smartphone 100 in advance, or a select shop. Or the site itself, such as a restaurant, or a site where you can get coupons issued by each of these stores. In addition, the site for selling cooking utensils or the site of a travel agency can be used as a link destination.

The user's home address, work location, etc. may be input by the user through the smartphone 100 or the like prior to the use of the information providing system 1000. Alternatively, when the smartphone 100 is equipped with a GPS function, the GPS function may be used to recognize the user's travel route and predict the user's home address, work location, etc. based on the route. ..

The proposal information created by the administrator terminal 300 is transmitted to the server device 200 via the network 400 in a state of being associated with data such as a face image to be compared with the image pickup data or the like (step S2).

When the server device 200 receives the proposal information transmitted from the administrator terminal 300, the server device 200 stores it in the storage medium 210 (step S3).

Specifically, prior to the start of operation of this system, a plurality of face images are stored in the storage medium 210, and the proposal information corresponding to each of the face images is associated with each face image. Store in pairs.

Here, there are many users of the smartphone 100 who use the alarm function instead of the alarm clock of the smartphone 100. In this case, when the time when the alarm is set arrives, the smartphone 100 outputs an alarm sound (step S4).

In this embodiment, for example, when the camera application program which is the image pickup means 110 is started by using the output of the alarm sound as a trigger and the user performs an operation for stopping the output of the alarm sound (step S5), the image pickup means 110 (Step S6). This makes it possible to typically capture a user's facial image on a regular basis every day.

However, the camera application program may be activated by the user operating the smartphone 100, and the image pickup means 110 may perform the image pickup by the user instructing the image pickup.

The face image captured by the image pickup means 120 is stored in the smartphone 100 (step S7), or is transmitted to the server device 200 by the transmission means 120 via the network 400 without being stored (step S8). .. It should be noted that the user may capture several images and transmit one or two or more facial images selected by the user to the server device 200.

When the server device 200 receives the face image transmitted from the smartphone 100, it outputs it to the reading means 220. The reading means 220 reads out the proposal information stored corresponding to the face image by referring to the storage medium 210 based on the face image (step S9).

When the proposal information is actually read by the reading means 220, the reply means 230 receives the read proposal information and returns it to the smartphone 100 via the network 400 (step S10).

According to this embodiment, various information can be provided to the user based on the face image of the user.

That is, for example, feature points are extracted to provide physiognomy results based on physiognomy, or when the usage period of the information providing system 1000 becomes long and a plurality of facial images are stocked, those and the latest facial image are combined. If you recognize that your hair has become longer by contrasting, we recommend that you go to a hairdressing shop, or if you recognize that your complexion is not good, you have swelling, or you have bears around your eyes, we recommend makeup that corresponds to them. And so on.

In addition, if the date of birth of the user is acquired in advance, the birthday fortune-telling result can be provided. Further, if the user's preference information is acquired in advance, it is possible to select a link destination that matches the preference information.

That is, for example, when it is acquired in advance that the user likes Japanese food and is a gourmet, the server device 200 includes going to a restaurant for a meal as the proposal information to be returned to the user. , Accessing restaurant word-of-mouth sites, etc., and based on the keyword "Japanese food" and keywords such as the user's home address or work location, those that have been evaluated well above a certain level among Japanese restaurants Can also be picked up and the site of the restaurant in the word-of-mouth site or the site of the restaurant itself can be selected as the link destination.

The proposal information itself may be text data, but it can also be notified to the user by voice output.

Further, according to the present embodiment, the user takes an image without being aware of it, such as taking an image when the user performs an operation for stopping the output of the alarm sound of the smartphone 100, and transmits the imaged data to the server device 200. As a result, information can be provided to the user.

Therefore, since the user can obtain various information without performing troublesome operations, the information providing system 1000 has high user satisfaction and is easy for the user to use.

In this embodiment, an example of taking an image when an operation for stopping the output of the alarm sound is shown is shown, but the timing of taking an image is not limited to this. For example, instead of the alarm sound, some voice output or vibration start may be performed and an operation for stopping the vibration may be performed. Incidentally, instead of the alarm provided in the smartphone 100 itself, it may be possible to set an alarm or the like in the application program for executing the process in the information providing system 1000.

(Example 2)

Subsequently, since various images are taken by the image pickup means 110 of the smartphone 100, an embodiment of effectively processing the image pickup data will be described.

In the smartphone 100, the image pickup data by the image pickup means 110 is usually stored in the memory 130 built in the smartphone 100. At that time, the user may voluntarily create a folder for storing the imaging data, but at best, the imaging data is grouped and stored in the memory 130.

We propose the following processing that can be provided by an application program. That is,

(1) Folders can be created by the user, but by default, for example, "work", "family", "private", "gallery", "SNS", "blog", "happy", "happy", " Set up a folder with a name such as "secret". That is, the memory 130 is divided into a plurality of folders. Further, the server device 200 is also provided with a folder corresponding to each of the above folders on a one-to-one basis for each user.

FIG. 4 is a diagram showing a screen display example of the smartphone 100 of the second embodiment of the present invention. Here, in addition to "work", "family", etc. as described above, select when the imaging data is stored only in the memory of the smartphone 100 and not transmitted to the server device 200 as before. It also shows the "normal" folders that are created.

(2) When the user takes an image, the imaged data is captured. After that, the folder list screen is displayed so that the user can select the folder in which the imaged data is stored by tapping or the like. .. In other words, by displaying the folder selection screen, it is prompted to select the folder to save the data.

(3) For example, when any of the folders is selected by the user, the imaging data is stored in the folder in the memory 130, or instead, by the transmission means 120, the network 400. Is transmitted to the corresponding folder in the server device 200 through. At this time, folder information indicating the storage destination in the storage medium 210 of the server device 200 is added to the image pickup data.

(4) Further, the server device 200 is a shared server of the user's office or a personal computer used by the user when a folder with a name such as "work" is instructed by the folder information as a storage destination. It is also possible to send the image pickup data to a computer or the like.

In other words, when the server device 200 is accessed from a shared server or the like (download device) in the office, the imaging data stored in the folder with a name such as "work" can be downloaded. However, for this purpose, it is sufficient to set a dedicated ID, a password, and the like in advance, and to enable viewing and downloading of the imaging data only when authentication is obtained by these.

Similarly, for a folder with a name such as "family", only the user's family has the hardware to communicate with the folder, such as a personal computer, smartphone, or even an in-vehicle car navigation system. It may be made accessible by using. By doing so, it is possible to share and view what was taken by the user's family.

Further, in the case of a folder with a name such as "gallery", a semi-professional photographer who wants to sell material photographs and a non-professional photographer can preferably use it. For example, a semi-professional cameraman or the like determines the selling price of the imaging data, and uploads the selling price information to the server device 200 together with the imaging data. Make the "Gallery" folder accessible to anyone or any user who has this application program installed. If a person who actually accesses a folder with a name such as "Gallery" finds an image data that he / she likes, he / she may be able to download it by paying the selling price. As a result, the cameraman can obtain a profit on the sale of the imaging data, and the purchaser of the imaging data can acquire a favorite photograph at a price not as high as that of a professional photographer.

In the case of a folder with a name such as "SNS" or "blog", the URL of the user's SNS or blog is associated with the folder of the server device 200. Then, for example, when a user images a dish at a restaurant and a folder with a name such as "blog" is selected, the imaged data is uploaded to the user's blog. .. By doing so, it is convenient for the user to write an article about the imaging data on the blog later.

In the case of a folder with a name such as "Happy", the image is taken when the user finds it fun, or the image data is stored as a memorial. For example, in recent years, even elementary and junior high school students have been using smartphone 100, so if they use a folder with a name such as "Happy" from that time, it will be screened at their own wedding ceremony. It can also be used for films. Users should provide a unique password for access to folders named such as "Happy". Then, if the user informs the film producing company or the like of the password, the film producing company or the like can access the imaging data in the folder, so that the film can be created from a huge amount of imaging data. You can save the trouble of selecting things. Of course, it can be suitably used not only for weddings but also for various ceremonial occasions. For example, you can make a funeral film or a film of your own history.

In the case of folders other than those named "private" and "secret", uploading may not be possible to the server device 200 in the first place. Alternatively, in the case of these folders, a high degree of security that cannot be seen by outsiders can be adopted.

Note that some folders may not be provided in the free version of the application program. For example, in the case of a folder with a name such as "Gallery", the user may get a profit on sale, so the free version allows access to image data uploaded by others, but uploading is charged. There are various ways of operation, such as making only the edition.

Claims (7)

Notifying the fortune-telling result and the proposal information returned by the capturing means for capturing the user's image or voice data as fortune-telling data, the transmitting means for transmitting the fortune-telling data captured by the capturing means, and the reply means described later. A client terminal having a notification means for
A storage medium in which a plurality of image or audio data, correspondingly updated fortune-telling results, and appropriately updated proposal information incidental to the fortune-telling results are linked and stored, and
A reading means for reading the fortune-telling result and the proposed information corresponding to the fortune-telling data by referring to the storage medium based on the fortune-telling data transmitted by the transmitting means, and a fortune-telling result and the proposal read by the reading means. A server device having a reply means for returning information, and
Information provision system. The capture means is
When the user stops the action of the client terminal at a predetermined time, or
Import when the user performs an explicit operation.
The information providing system according to claim 1. The client terminal further has a confirmation means for confirming to the user whether or not the fortune-telling data captured by the capture means can be transmitted by the transmission means.
The information providing system according to claim 1. The reading means extracts feature points including the positions and sizes of eyes and nose from the fortune-telling data transmitted by the transmitting means, and updates the fortune-telling results to be read as appropriate based on the extraction results. Determine proposal information,
The information providing system according to claim 1. The proposed information includes text data in which the position of an information resource on a network is embedded, which indicates the sales destination of goods or the provision destination of services incidental to the required text portion.
The information providing system according to claim 1. The client terminal further
A storage means for storing fortune-telling data divided into a plurality of folders and captured by the import means, and a storage means.
A means for urging the user to select a folder for saving the fortune-telling data saved by the storage means when the fortune-telling data is taken in by the import means.
The information providing system according to claim 1. A step of receiving user image or audio data transmitted from a client terminal as fortune-telling data, and
Appropriately updated proposed information and are stored tied incidental to the received based on the fortune-telling data that corresponds to these and a plurality of image or audio data suitable Yichun updated divination result and the fortune-telling result A step of reading the fortune-telling result and the proposal information corresponding to the fortune-telling data by referring to the storage medium, and
A step of returning the read fortune-telling result and the proposal information to the client terminal to notify the client terminal.
A program that causes the server device to execute.

Images