JP2017033354A - Information delivery system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information delivery system 1000 that utilizes image-related application programs and is attractive to users.SOLUTION: An information delivery system 1000 comprises; a client terminal 100 having image capturing means 110 configured to capture an image of a user, and transmission means 120 configured to transmit data of the image captured by the image capturing means 110; a server device 200 having a storage medium 210 that stores a plurality of images paired with corresponding proposed information, reading means 220 configured to refer to the storage medium 210 based on the data transmitted by the transmission means 120 and read proposed information corresponding to the data, and reply means 230 configured to reply with the proposed information read by the reading means 220.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an information providing system, and more particularly to an information providing system for providing useful information to a user of a client terminal such as a smartphone.

  Patent Document 1 discloses a technique for easily forging a human phase, a palm, and compatibility with a digital camera. In this digital camera, the owner's personal data is stored in advance in the user information memory, and when the subject is photographed, the image data is stored in the built-in memory. Then, the feature extraction unit reads the image data from the built-in memory, extracts the features and creates a portrait, selects the facial pattern closest to the portrait by the system controller, and determines the fortune telling attached to this facial pattern The result is read out and displayed on the liquid crystal panel.

Japanese Patent Laid-Open No. 2003-60956

  However, the digital camera disclosed in Patent Document 1 can only provide the user with information equivalent to that obtained by viewing a book in which information such as fortune telling is described. Even though a digital camera can process an enormous amount of information, this processing capability is not fully utilized.

  In recent years, this problem is also true for smartphones that are used as imaging terminals instead of digital cameras. As is known, various application programs exist on smartphones. However, for example, even if an offline-type fortune-telling application program is downloaded and installed on a smartphone, the processing capability is not fully utilized as in the case of a digital camera.

  As a result, the information provided to the user is only static, so a user who always provides only similar results will eventually get bored with this application program and will not continue to use it. It is possible. In order not to bore the user, the information provided to the user will need to be fresh as well as useful.

  In fact, if we focus on fortune-telling application programs, there are no explosive hits like game application programs at the moment, and fortune-telling application programs are not only offline type but also online type. Even if it is included, there is data that tends to be uninstalled as compared with application programs in other fields.

  In addition, an imaging terminal such as a digital camera or a smartphone captures various images. However, the management of these images should be simplified, and a mechanism that enables effective use of images afterwards will be established. Is also desired.

  In particular, today, where cloud services have been developed, it has become possible to store a large amount of images including moving images for a long period of time on a cloud server. Therefore, if the image captured by the imaging terminal can be managed well, the range of utilization of the image will be expanded.

  From the above viewpoints, it can be said that image-related application programs fully utilize the processing capabilities of the terminal on which they are installed, match user preferences, have high user satisfaction, and are user-friendly. It can be said that there is no good application program.

  Accordingly, an object of the present invention is to provide an information providing system using an image-related application program that is attractive to a user.

  Moreover, this invention makes it a subject to provide the information provision system for providing useful information with respect to the user of client terminals, such as a smart phone.

In order to solve the above problems, the client terminal of the present invention provides:
Capture means for capturing image or audio data (for example, the imaging means 110 in FIG. 2);
Storage means (for example, the memory 130 in FIG. 1) that stores data that is divided into a plurality of folders and is captured by the capture means;
Promotion means for prompting the user to select a folder to store the data stored by the storage means when the data is captured by the capture means (for example, displaying a folder list screen on the smartphone 100 main body in FIG. 1) Means)
Is provided.

An example of the information providing system of the present invention is as follows:
An imaging unit that captures a face image of the user when the user is operating the client terminal body, a storage unit that stores data that is divided into a plurality of folders and is captured by the capture unit, and the storage Transmission means for transmitting data stored in some of the folders stored by the means, and a client terminal, and a server device for receiving data transmitted from the client device,
The client device is
A plurality of folders corresponding to each of the folders;
The client apparatus can transmit data after adding information indicating a storage location of the data when transmitting the data.

  The information providing system of the present invention may include a download device that downloads data stored in some of the folders of the server device.

In addition, the server device
A storage medium in which a plurality of images or sounds and corresponding proposal information are stored;
Reading means for reading the proposal information corresponding to the data with reference to the storage medium based on the data transmitted by the transmission means;
Reply means for returning the proposal information read by the reading means;
You may have.

  According to the information providing system of the present invention, it is possible to easily transmit data from a client terminal to a server device. In addition, in a server device having a relatively large storage medium, Management is also possible.

  For example, as the above proposal information, a text in which the position of the information resource on the network is embedded indicating the sales destination or the service providing destination of the product attached to the text portion with respect to the required text portion. If the information is updated to information including data, the user can obtain recommended products based on a fortune-telling based on a face image.

  Note that the capturing means may immediately capture or record in response to the user's operation for capturing or recording, or for example, output upon arrival of a predetermined time set in the client terminal. An image may be taken when the user performs a stop operation for the alarm to be performed. In the former case, the user takes an image or the like mainly, whereas in the latter case, the image is taken on the system side or the like.

  When the system performs image capturing on its own, the user can obtain effective information without troublesome work and does not use the user's arbitrary image data. Can be used. Therefore, for example, if the fortune-telling results of the day that many people are interested in are provided to users, or if recommended information accompanying the fortune-telling results is provided, the frequency of use of the system will increase. It is done.

  In addition, according to an embodiment of the present invention, it is possible to effectively manage imaging data and the like in the server device, so that useful information can be provided to the user.

  Thus, since useful information can be provided to the user, when the operation of the system is realized by an application program for a smartphone, it can be said that the frequency with which the user uninstalls the application program is reduced.

  Then, as a secondary effect, when an advertisement is displayed on the screen displayed on the display by starting the application program, an excellent advertisement effect can be obtained.

  In this system, since an image is transmitted from the client terminal, countermeasures for image leakage on the network should be considered. If a secure system is built, there will be no problem of image leakage, but in the unlikely event that image leakage occurs, image leakage that is against the user's will should be minimized. Therefore, it is preferable to confirm with the user prior to the transmission whether or not the face image captured by the imaging unit may be transmitted.

The program of the present invention is
Capturing an image or sound;
Causing the user to select a folder to which the captured data is to be saved from a plurality of folders;
Can be executed by the client terminal.

It is a typical block diagram of the information provision system 1000 of embodiment of this invention. It is a block diagram which shows the structure of the client terminal 100 and server apparatus 200 which are shown in FIG. It is a flowchart which shows operation | movement of Example 1 of this invention. It is a figure which shows the example of a screen display of the smart phone 100 of Example 2 of this invention.

DESCRIPTION OF SYMBOLS 100 Client terminal 110 Imaging means 120 Transmission means 200 Server apparatus 210 Storage medium 220 Reading means 230 Reply means 300 Administrator terminal 400 Network

DETAILED DESCRIPTION OF THE INVENTION

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a schematic configuration diagram of an information providing system 1000 according to the embodiment of this invention. FIG. 1 shows a client terminal 100, a server device 200, an administrator terminal 300, and a network 400, which will be described below.

  FIG. 2 is a block diagram illustrating configurations of the client terminal 100 and the server device 200 illustrated in FIG.

  The client terminal 100 includes an imaging unit 110 such as a camera that captures a face image of the user as a still image or a moving image when the user is operating the main body of the client terminal 100, and a face image captured by the imaging unit 110. Are transmitted to the server apparatus 200, and a memory 130 in which a face image captured by the imaging unit 110 is stored.

  As an example of hardware, the client terminal 100 can be realized by a smartphone, a digital camera with a communication function, a tablet with a camera, a notebook personal computer with a camera, a PDA with a camera, or the like.

  Note that here, a case where a user's face image is captured will be described as an example, but the imaging target is not necessarily limited to a face image, and the user's voice is captured instead of or together with the image. It is also possible to make audio a transmission target by the transmission unit 120.

  However, it does not exclude that the imaging unit 110 and the transmission unit 120 are realized by different hardware. For example, a web camera, a pointing device such as a mouse with a camera, or an IC recorder with a camera is connected to the imaging unit 110 and the transmission unit 120. A notebook computer or a desktop personal computer, a wristwatch with a camera and a communication function, or a wearable device with a camera and a communication function.

  The server apparatus 200 is based on a storage medium 210 that stores a plurality of face images and the like and proposal information corresponding to each face image, which will be described below, and a face image transmitted by the transmission unit 120. A reading unit 220 that reads the proposal information corresponding to the face image or the like with reference to the storage medium 210, and a reply unit 230 that returns the proposal information read by the reading unit 220 to the client terminal 100.

  As the server device 200, various cloud-type database server devices such as IaaS, PaaS, SaaS, and DaaS can be used.

  The storage medium 210 does not need to be a built-in type with respect to the server device 200, and may be an external type. In addition, the face image transmitted by the transmission unit 120 can be stored in the storage medium 210 or another storage medium.

  In the storage medium 210, a unique folder or the like is created for each client terminal 100, and imaging data is stored in an area physically or logically different for each client terminal 100. In addition, if a file name that can specify the transmission date and time of imaging data is added and stored, a plurality of face images and the like can be managed in time series. Furthermore, when folder information is added to the imaging data transmitted from the user, the imaging data can be stored in a folder according to the information.

  When managing a plurality of face images according to time series, it is considered easier to compare if the face images have the same size and the like. Therefore, as will be described later, when the user mainly takes an image, for example, even if an auxiliary line for instructing the display position of the face image is displayed on the display serving as the finder of the smartphone 100 at the time of imaging. Good. On the other hand, image processing such as enlargement or reduction may be performed in the smartphone 100 to adjust the size of the face image without performing such a correspondence.

  The reading unit 220 reads the proposal information corresponding to the imaging data with reference to the storage medium 210 based on the imaging data transmitted by the transmission unit 120. Specifically, when the data transmitted by the transmission unit 120 is imaging data, the reading unit 220 extracts feature points such as the positions and sizes of eyes and nose, and performs face authentication processing and the like. The proposal information corresponding to the imaging data is specified. On the other hand, when the data transmitted by the transmission unit 120 is voice data, the reading unit 220 performs voice authentication processing or the like from the frequency spectrum or the like, and specifies proposal information corresponding to the voice data.

  The reply unit 230 sends the proposal information read by the reading unit 220 back to the client terminal 100.

  The administrator terminal 300 is a terminal that is operated by an administrator of the server device 200. The administrator terminal 300 creates proposal information that can be transmitted to the client terminal 100 and transmits the proposal information to the storage medium 210, or based on newly created proposal information or proposal information transmitted from another terminal (not shown). 210 is a terminal that updates the proposal information stored in 210. Note that each proposal information is stored in the storage medium 210 in a state of being associated with data such as a face image to be compared with imaging data.

  The administrator terminal 300 may be a personal computer as an example of hardware, but is not limited thereto, and may be a tablet or a smartphone as long as the information processing apparatus has a communication function.

  The network 400 connects the client terminal 100, the server device 200, and the administrator terminal 300 to each other. The network 400 can be various networks such as the Internet, Ethernet, and mobile phone network. It does not matter whether the network 400 is a wired network or a wireless network.

  Subsequently, for the information providing system 1000 according to the embodiment of the present invention, a smartphone is used as the client terminal 100, and the following various processes are realized by application programs installed in the smartphone, with various usage scenes as an example. explain. For easy understanding, the reference numeral 100 is also attached to the smartphone.

Example 1
FIG. 3 is a flowchart showing the operation of the first embodiment of the present invention. FIG. 3 shows operations of the user, the client terminal (smartphone) 100, the server device 200, and the administrator terminal 300.

  First, the administrator terminal 300 or another terminal (not shown) creates proposal information useful for the user regularly or irregularly (step S1).

  As an example of the proposal information, if the user is a woman, there may be a wide variety such as today's makeup, today's hairstyle, today's clothes, today's lunch, and today's fortune-telling. In addition, it may be possible to suggest actions such as going shopping on weekends, going to a beauty salon, cooking, or traveling. That is, the proposal information may be created with various periods such as daily, weekly, monthly, and yearly.

  In addition, if the proposal information can be linked with a plurality of link destinations such as a site where a coupon relating to the content can be obtained, the user moves to the link destination by touching the screen of the smartphone 100 or the like. It can also be possible.

  According to the example of the previous proposal information, the link destination here is, for example, the user's home address, work location, etc. obtained in advance from the smartphone 100 and a nearby beauty salon or select shop. Or a site such as a restaurant itself or a site where coupons issued by these stores can be obtained. Also, a cooking tool sales site or a travel agency site can be used as a link destination.

  In addition, what is necessary is just to input a user's home address, a workplace address, etc. through the smart phone 100 etc. from a user prior to utilization of the information provision system 1000. Alternatively, when the smartphone 100 has a GPS function, the user's travel route may be recognized using the GPS function, and the user's home address, work location, etc. may be predicted based on the route. .

  The proposal information created by the administrator terminal 300 is transmitted to the server device 200 via the network 400 in a state linked to data such as a face image to be compared with the imaging data (step S2).

  Upon receiving the proposal information transmitted from the administrator terminal 300, the server device 200 stores it in the storage medium 210 (step S3).

  Specifically, prior to the start of operation of the system, a plurality of face images are stored in the storage medium 210, and corresponding proposal information is associated with each face image, Store in pairs.

  Here, many users of the smartphone 100 use the alarm function instead of the alarm clock of the smartphone 100. In this case, when the time when the alarm is set arrives, the smartphone 100 outputs an alarm sound (step S4).

  In this embodiment, for example, when an alarm sound output is used as a trigger to start a camera application program that is the imaging unit 110, and the user performs an operation to stop the output of the alarm sound (step S5), the imaging unit 110 is activated. The image is picked up by (step S6). If it carries out like this, typically, it will become possible to image a user's face picture at regular time every day.

  But you may make it image-capture with the imaging means 110, when a user operates the smart phone 100 and starts a camera application program and a user gives an imaging instruction | indication.

  The face image picked up by the image pickup means 120 is stored in the smartphone 100 (step S7) or transmitted to the server device 200 via the network 400 by the transmission means 120 without being stored (step S8). . Note that the user may take several images, and one or more face images selected by the user may be transmitted to the server device 200.

  When server apparatus 200 receives the face image transmitted from smartphone 100, server apparatus 200 outputs the face image to reading means 220. The reading unit 220 reads the proposal information stored corresponding to the face image by referring to the storage medium 210 based on the face image (step S9).

  When the proposal information is actually read by the reading unit 220, the reply unit 230 receives the read proposal information and sends it back to the smartphone 100 via the network 400 (step S10).

  According to the present embodiment, various information can be provided to the user based on the user's face image.

  That is, for example, when feature points are extracted to provide fortune-telling results based on psychology, or when the information providing system 1000 is used for a long time and a plurality of face images are stocked, these and the most recent face images are displayed. If it is recognized that the hair has become longer by comparison, it is recommended to go to a beauty salon, or if it is recognized that there is a swelling or a bear in the eyes, makeup according to them is recommended And so on.

  In addition, if the user's date of birth is acquired in advance, a birthday fortune-telling result can be provided. Furthermore, if user preference information is acquired in advance, a link destination that matches the preference information can be selected.

  In other words, for example, when the user likes Japanese food and has acquired gourmet food in advance, when the restaurant information includes returning to the user as suggestion information, the server apparatus 200 , By accessing a word-of-mouth website of a restaurant, etc., and a good evaluation of a certain level or more among Japanese restaurants based on the keyword “Japanese food” and a keyword such as a user's home address or work location The site of the restaurant or the site of the restaurant itself in the word-of-mouth site can be selected as the link destination.

  The proposal information itself may be text data, but can be notified to the user by voice output.

  Furthermore, according to the present embodiment, when the user performs an operation for stopping the output of the alarm sound of the smartphone 100, for example, imaging is performed without the user being aware, and the imaging data is transmitted to the server apparatus 200. As a result, information can be provided to the user.

  Therefore, since the user can obtain various information without troublesome operations, the information providing system 1000 has high user satisfaction and is user-friendly.

  In the present embodiment, an example is shown in which an image is captured when an operation for stopping the output of the alarm sound is performed. However, the timing at which the image is captured is not limited thereto. For example, instead of the alarm sound, some sound output may be performed or vibration may be started, and an operation for stopping it may be performed. Incidentally, in place of the alarm provided in the smartphone 100 itself, an alarm or the like may be set in an application program for executing processing in the information providing system 1000.

(Example 2)
Next, since various imaging is performed by the imaging unit 110 of the smartphone 100, an embodiment that effectively processes the imaging data will be described.

  In the smartphone 100, the image data captured by the image capturing unit 110 is normally stored in the memory 130 built in the smartphone 100. At that time, it may be possible for the user to voluntarily create a folder for storing the imaging data, but at most, the imaging data is only grouped and stored in the memory 130.

In this embodiment, the following processing is possible, and a part of which can be provided by an application program is proposed. That is,
(1) Although a user can create a folder arbitrarily, by default, for example, “work”, “family”, “private”, “gallery”, “SNS”, “blog”, “happy”, “ Create a folder with a name such as “Secret”. That is, the memory 130 is divided into a plurality of folders. Further, the server apparatus 200 is also provided with a folder corresponding to each of the folders on a one-to-one basis for each user.

  FIG. 4 is a diagram illustrating a screen display example of the smartphone 100 according to the second embodiment of the present invention. Here, as described above, in addition to “work”, “family”, and the like, the selection is made when imaging data is stored only in the memory of the main body of the smartphone 100 and is not transmitted to the server device 200 as before. Also shown is the “normal” folder.

  (2) When the user captures an image, the captured image data is captured. After that, a folder list screen is displayed, and the user can select a folder for storing the captured image data by an operation such as tapping. . In other words, by displaying a folder selection screen, the user is prompted to select a folder for saving data.

  (3) For example, when any of the folders is selected by the user, the imaging data is stored in the folder in the memory 130 or alternatively, the transmission unit 120 uses the network 400 to store the image data. To the corresponding folder in the server apparatus 200. At this time, folder information indicating a storage destination in the storage medium 210 of the server device 200 is added to the imaging data.

  (4) Furthermore, the server device 200, for example, when a folder with a name such as “work” is instructed by the folder information as a storage destination, the user's office shared server or the personal user used by the user The imaging data can be transmitted to a computer or the like.

  In other words, when the server device 200 is accessed from a shared server or the like (downloading device) in the office, the imaging data stored in a folder with a name such as “work” can be downloaded. However, for this purpose, a dedicated ID, a password, and the like are set in advance, and it is only necessary to allow browsing and downloading of imaging data only when authentication is obtained.

  Similarly, for a folder with a name such as “family”, only the user's family has a hardware having a communication function such as a personal computer, a smartphone, and an in-vehicle car navigation system. Can be accessed using. In this way, what is taken by the user's family can be shared and viewed by the family.

  In the case of a folder with a name such as “Gallery”, a semi-professional photographer or a non-professional photographer who wants to sell material photographs can use it suitably. For example, the semi-professional photographer or the like determines the selling price of the imaging data and uploads the selling price information to the server device 200 together with the imaging data. Anyone or a user who has installed this application program can access the “gallery” folder. If a person who has actually accessed a folder with a name such as “Gallery” finds his / her favorite image data, he / she can download it by paying the selling price. As a result, the photographer can obtain a profit from the sale of the imaged data, and the purchaser of the imaged data can obtain a favorite photograph with an amount not as high as that of the professional photographer.

  In the case of a folder with a name such as “SNS” or “blog”, the URL of the user's SNS or blog is associated with the folder of the server apparatus 200. For example, when a user images a dish at a restaurant and a folder with a name such as “blog” is selected, the image data is uploaded to the user's blog. . In this way, if an article relating to the imaging data is only written on the blog later, convenience for the user is improved.

  In the case of a folder with a name such as “Happy”, it is stored such that it is taken when the user feels fun or is taken as a memorial image. For example, in recent years, even elementary and junior high school students have been using smartphones 100, so if they use a folder with a name such as “Happy” from that time, they will be screened at their own wedding It can also be used for films. In order to access a folder with a name such as “Happy”, the user sets a unique password. If the user informs the film creation company of the password, the film creation company can access the image data in the folder. Saves you the trouble of selecting things. Of course, it can be suitably used for various ceremonial occasions besides weddings. For example, it is possible to create a funeral film or a film of your own history.

  In cases other than folders with names such as “private” and “secret”, uploading to the server apparatus 200 may be prohibited. Alternatively, in the case of these folders, it is possible to adopt a high level of security that cannot be seen by any outsiders.

  Some folders may not be provided in the free version application program. For example, in the case of a folder with a name such as “Gallery”, it is possible to gain profits from the sale to the user, so in the free version you can access the image data uploaded by others, but the upload is charged There are various ways of operation, such as making only a version available.

Claims (6)

Capture means for capturing image or audio data;
Storage means for storing data that is divided into a plurality of folders and that is captured by the capture means;
Facilitating means for prompting the user to select a folder to which the data is stored when the data is captured by the capturing means;
A client terminal comprising:   The client apparatus according to claim 1, further comprising transmission means for transmitting data stored in some of the folders. An information providing system comprising: the client device according to claim 1; and a server device that receives data transmitted from the client device.
The server device has a plurality of folders corresponding to the folders,
An information providing system in which the client device transmits data after adding information indicating a storage location of the data.   The information providing system according to claim 3, further comprising a download device that downloads data stored in some of the folders of the server device. The server device
A storage medium in which a plurality of images or sounds and corresponding proposal information are stored;
Reading means for reading the proposal information corresponding to the data with reference to the storage medium based on the data transmitted by the transmission means;
Reply means for returning the proposal information read by the reading means;
The information providing system according to claim 3. Capturing an image or sound;
Causing the user to select a folder to which the captured data is to be saved from a plurality of folders;
That causes a client terminal to execute

Images