JP2010238100A - Mobile information terminal, information distribution system, and method and program for controlling information browsing - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable an information distribution source such as an advertiser to distribute advertisement information to a wide range without being restricted by places such as stores, and to enable a user to obtain advertisement information desired by himself (herself) without being restricted by places such as stores and obtain desired information from a desired advertiser. <P>SOLUTION: An advertisement information transmission server 4 stores advertisement information. A mobile telephone terminal 2B stores the URL (advertisement URL) of advertisement information. A mobile telephone terminal 2A, when photographing a real space in which a user or the like of the terminal 2B exists, obtains positional information and the advertisement URL from the terminal 2B existing in a photographing range by short-range radio communication. Further, the terminal 2A accesses the advertisement information transmission server 4 by the advertisement URL and obtains the advertisement information. Then the terminal 2A displays the advertisement information in the vicinity of an image of the user of the terminal 2B displayed on a view finder. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention includes a mobile information terminal such as a mobile phone terminal having various functions such as a camera function and a GPS (Global Positioning System) function, a plurality of mobile information terminals, and a server that distributes advertisement information to the terminals. It relates to an information distribution system. The present invention also relates to an information browsing control method and an information browsing control program for displaying advertisement information and the like on a display of a portable information terminal.

  In recent years, in a portable information terminal such as a cellular phone terminal, a current position (that is, a current position of a terminal user) is obtained by using a communication function provided in the portable information terminal and a current position acquisition function represented by GPS. A technology has been established to provide information on stores existing around and various service information related to the current location to the portable information terminal. The acquisition of such information may be performed automatically by, for example, a user registering in advance with an information providing service. For example, address information embedded in a so-called QR (Quick Response) code is used as a camera attached to the terminal. There is a case where the user himself / herself actively performs the reading as in the example of accessing the information providing source indicated by the read address information using the function.

  In addition, in the published patent publication (Patent Document 1) of Japanese Patent Application Laid-Open No. 2007-280363, a neighborhood advertisement is based on terminal location information and terminal IDs of other mobile phones and store location information and advertisement information of a plurality of stores. A technology is disclosed in which information is selected and the neighboring advertisement information is transmitted to a desired mobile phone and displayed. That is, in Patent Document 1, information is ranked and transmitted to a desired mobile phone based on distance information between another mobile phone and an advertisement target such as a store or time information at the time of information transmission. Therefore, a mechanism for preferentially displaying information with high utility value is disclosed.

  In addition, the published patent publication (Patent Document 2) of Japanese Patent Application Laid-Open No. 2005-173042 receives the content of the advertisement and the position information on the real space of the advertisement, detects the position and orientation of the display surface for displaying the advertisement, A technique for determining a display position of an advertisement on the display surface based on the position and orientation and the received position information, and creating and displaying advertisement display information based on the display position and the received content information is disclosed. Has been. That is, Patent Document 2 discloses a technique for displaying an advertisement on a terminal in association with a real space.

  Furthermore, in Japanese Patent Laid-Open Publication No. 2003-16347 (Patent Document 3), a mobile terminal that receives an information object from a regional advertisement information distribution server distributes advertisement information by transmitting the information object between mobile terminals. Such a technique is disclosed. That is, Patent Literature 3 discloses a technique for acquiring advertisement information captured by a person (mobile phone) in a predetermined communicable area via short-range communication.

  Also, in Japanese Patent Application Laid-Open No. 2006-3963 (Patent Document 4), a bulletin board such as a signboard or a display is installed around a station where there are many passersby to display a map of the surrounding area. An area guidance system is disclosed in which a part of the map is photographed using a camera-equipped mobile phone terminal to receive a service about detailed information on facilities around the station. That is, in this patent document 4, a short-distance communication is performed with an electronic bulletin board computer that is photographed through a viewfinder of a mobile phone, so that the contact information of the target facility and a product for advertisement are displayed on the viewfinder. A technique for displaying an image or the like is disclosed.

JP 2007-280363 A (FIG. 1) Japanese Patent Laying-Open No. 2005-173042 (FIG. 15) Japanese Patent Laying-Open No. 2005-173042 (FIG. 1) Japanese Patent Laying-Open No. 2006-3963 (FIG. 1)

  By the way, in the case of the advertising information distribution method described in the above-described conventional Patent Document 1, Patent Document 2, and Patent Document 4, the user of the portable information terminal, for example, at a desired place where a store or the like exists. Since the advertisement information is obtained after going out, it is not possible to receive advertisement information such as a store away from the current position of the user.

  On the other hand, it is impossible for an advertiser who wants to distribute advertisement information to guide a user who is in a remote place to a store or the like because the advertisement information cannot be transmitted if the user does not come to a specific place. . However, distributing advertisement information to an unspecified number of users without considering the current position of the user may send unnecessary information to the user, which may be annoying. Such a nuisance act results in a bad impression from the user and is not preferable for the advertiser.

  In the case of the technique described in Patent Document 3, advertisement information is transmitted and received between mobile terminals by short-range wireless communication, but the mobile terminal that exchanges the advertisement information exists in an area where short-range wireless communication is possible. Terminal. In other words, in this technology, advertisement information is acquired from all terminals that exist within the range where short-range wireless communication is possible, so the advertisement information that the user really wants may not be obtained and is unnecessary. There is a high possibility that even advertising information will be sent and received. Therefore, it is difficult to acquire information desired by the user from a specific partner desired by the user.

  The present invention has been proposed in view of such circumstances, and for example, an information distribution source such as an advertiser is not limited to a place in a real space where a store or the like exists, and information is distributed over a wide range. The user side can obtain information desired by the user without being limited to the place in the real space where the store etc. exists, and further the desired information from the desired partner. It is an object of the present invention to provide a portable information terminal, an information distribution system, an information browsing control method, and an information browsing control program that can also acquire the information.

  The portable information terminal according to the present invention calculates the shooting range in the real world that is shot by the shooting unit, and the current position information of the other portable information terminal from the other portable information terminal through the short-range wireless communication The storage location address information held by another portable information terminal is acquired. Then, the portable information terminal of the present invention calculates another portable information terminal existing in the shooting range using the current position of the other portable information terminal, the current position of the own terminal, and the shooting range, Connects to the storage location specified by the storage location address information acquired from the portable information terminal through the network communication unit, acquires information from the storage location, and other portable information terminals are displayed on the display screen of the video display unit. The position displayed on the screen is calculated, and the previously acquired information is displayed in the vicinity of the display position or superimposed on the display position. Thereby, this invention solves the subject mentioned above.

  That is, according to the present invention, the mobile information terminal acquires storage location address information from another mobile information terminal existing within the shooting range, acquires information from the information storage location indicated by the address information, and Information is displayed in the vicinity of the display position of another portable information terminal displayed on the display screen. That is, in the present invention, the other portable information terminal is a movable terminal, while the information displayed in the vicinity of the display position of the other portable information terminal is information acquired from an information storage location prepared separately. Therefore, the information is not limited to a fixed place in the real space. In addition, since the terminal user can arbitrarily select the shooting target (other terminal) by the mobile phone terminal, the information acquired from the storage location address information from the shooting target (other terminal) is: It is information from the other party that the user wanted to obtain.

  In the present invention, when a captured image is displayed on the screen, storage location address information is acquired from a terminal within the imaging range by short-range wireless communication, and the storage location indicated by the storage location address information The information is acquired from the information, and the information is displayed in the vicinity of the terminal display position in the captured video. Thereby, according to the present invention, for example, an information distribution source such as an advertiser can distribute information to a wide range without being limited to a place in a real space where a store or the like is present. The person side can acquire the information he desires without being limited to the place in the real space where the store or the like exists, and further can acquire the desired information from the desired partner.

1 is a diagram illustrating a schematic overall configuration example of an information distribution system according to an embodiment of the present invention. It is a block diagram which shows the schematic internal structural example of the mobile telephone terminal of embodiment of this invention. An example of a captured video that is displayed in real time on the viewfinder screen of the mobile phone terminal when a person or the like is captured by the mobile phone terminal, and in particular, two advertising information is displayed in the vicinity of the human video It is a figure used for description. Shows an example of a captured video that is displayed in real time on the viewfinder screen of the mobile phone terminal when a person is photographed by the mobile phone terminal, and in particular, the advertisement information moves with the movement of the person video in the viewfinder screen It is a figure used for description of a mode to do. It is a figure used for description of the relationship between the imaging | photography range of the real space by the camera module of a mobile telephone terminal, and the position of each mobile telephone terminal which the person etc. who exist in the real space of the imaging | photography range have. Among each mobile phone terminal possessed by a person displayed in the viewfinder screen, in particular, only one mobile phone terminal is taken as an example, and when the person who owns the mobile phone terminal is displayed on the viewfinder screen It is a figure used for description of a display position. In the mobile phone terminal (A), processing from obtaining an advertisement URL from another mobile phone terminal (B), obtaining advertisement information from the advertisement information transmission server based on the advertisement URL, and displaying it on the viewfinder screen It is a flowchart which shows the flow. Sequence diagram when the mobile phone terminal (A) acquires an advertisement URL from another mobile phone terminal (B), acquires advertisement information from the advertisement information transmission server based on the advertisement URL, and displays it on the viewfinder screen It is. It is a flowchart which shows the flow of a process which transmits advertising URL in response to the request | requirement in other mobile telephone terminals (A) in a mobile telephone terminal (B). FIG. 10 is a sequence diagram when an advertisement URL is requested from another cellular phone terminal (A) in the cellular phone terminal (B) and the advertisement URL is transmitted in response to the request.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

  In the following description, as an application example of the portable information terminal of the present invention, a mobile phone terminal having various functions such as a camera function, a GPS function, a direction and inclination detection function is given. The present invention is merely an example, and the present invention is not limited to this example. For example, the present invention can be applied to various portable information terminals other than the mobile phone terminal.

[Overall system configuration and overview]
FIG. 1 shows a schematic overall configuration example of an information distribution system according to an embodiment of the present invention.

  In FIG. 1, the mobile phone terminals 2A and 2B have all the functions of a general mobile phone terminal such as a memory, key buttons, display, and CPU, for example, in the case of this embodiment, An information display function, a current position detection function, a short-distance wireless communication function, a posture detailed information acquisition function, a web (Web) communication function, and the like are provided.

  Here, the camera function is a function for photographing a video in the real space, and the information display function displays the camera-captured video on the display screen in real time and includes various advertising information described later in the captured video. It is a function to superimpose and display various information and messages. The current position detection function is, for example, a function that receives a radio wave from the GPS satellite 1 and calculates the current position (latitude, longitude, altitude) of the terminal itself. Further, the detailed posture information acquisition function is based on detection information from various sensors such as a gyro sensor, an acceleration sensor, and an electronic compass, and information on the current position obtained by the current position detection function. It is a function for grasping the posture and grasping the photographing direction and the photographing range by the camera function. The web communication function is a function of connecting to a communication network 3 such as the Internet via a mobile phone packet network and accessing an advertisement information transmitting server 4 or an advertisement information registration server 5 described later provided on the Internet. It has been. The short-range wireless communication function is a function for transmitting and receiving various information between mobile phone terminals within a short-range range by, for example, a so-called Bluetooth (registered trademark) system. Note that short-range wireless communication can be performed between a plurality of terminals as well as when two mobile phone terminals perform one-to-one.

  In FIG. 1, an advertiser terminal 6 is an advertiser, for example, a personal computer or a server such as a store or a company, and the advertisement information prepared by the advertiser is sent via the communication network 3 such as the Internet. The data is transmitted to the transmission server 4 and stored. In the present embodiment, there are a plurality of advertisers, but of course there may be only one advertiser.

  The advertisement information registration server 5 manages storage location address information for a mobile phone terminal or the like to access the advertisement information stored in the advertisement information transmission server 4 through the communication network 3. That is, the advertisement information registration server 5 manages the URL (Uniform Resource Locator) of advertisement information stored in the advertisement information transmission server 4 in a list. The advertisement information registration server 5 is a server that transmits the URL of the advertisement information stored in the advertisement information transmission server 4 to the mobile phone terminal registered in the advertisement information distribution service according to the present embodiment. It has been. In the following description, the URL of the advertisement information is referred to as an advertisement URL.

  The advertisement information transmission server 4 stores the advertisement information supplied from the advertiser terminal 6 described above. In addition, when there is an access specifying the advertisement URL from the mobile phone terminal via the communication network 3, the advertisement information transmission server 4 sends the advertisement information corresponding to the advertisement URL to the mobile phone of the access source. It is a server that transmits to a telephone terminal.

  In addition, the advertisement information transmission server 4 and the advertisement information registration server 5 may each be one server, or may be a server group including a plurality of servers. The advertisement information transmission server 4 and the advertisement information registration server 5 may be provided separately or may be integrated as a single server.

  As described above, in the information distribution system of the present embodiment shown in FIG. 1, for example, the mobile phone terminals 2A and 2B can detect the current position using the GPS, acquire the terminal state by various sensors, and take a picture by the camera function. Further, it is possible to grasp the current position and posture at the time of shooting by the camera function, and the position and range of the real world being shot. In addition, the mobile phone terminals 2A and 2B according to the present embodiment can communicate with other mobile phone terminals existing in the short-range range by using short-range wireless communication. In addition, the mobile phone terminals 2A and 2B according to the present embodiment receive discounts by, for example, taking store coupon information into the terminal and presenting the coupon information when shopping at a store, for example. It is possible to respond to the service.

  In the information distribution system according to the present embodiment, for example, the mobile phone terminal 2A takes a picture of a person holding the other mobile phone terminal 2B with a camera function, and the person video is displayed on a display (viewfinder) screen in real time. , The advertisement URL stored in the mobile phone terminal 2B of the person is acquired by short-range wireless communication, and the advertisement information corresponding to the advertisement URL is transmitted via the communication network 3. It is acquired from the server 4 and can be displayed in the vicinity of the person image or superimposed on the person image.

  Thereby, according to the information distribution system of this embodiment, for example, the user of the mobile phone terminal 2A can use the advertisement URL stored in the mobile phone terminal 2B possessed by the person in the camera shooting direction and the shooting range, for example. The advertisement information corresponding to can be easily obtained from the advertisement information transmission server 4 and viewed. That is, according to the information distribution system of the present embodiment, the user of the mobile phone terminal 2A uses the terminal 2B of the person being photographed as an intermediary to advertise a store or the like at a location away from the current position where the user is located. Information can be easily acquired and viewed. In other words, the user of the mobile phone terminal 2A can acquire the advertisement information corresponding to the advertisement URL stored in the terminal 2B of the person who is taking the image as desired. Further, according to the information distribution system of the present embodiment, the advertiser desires that the user obtains the user's mobile phone terminal (2A) at a location away from the store or the like through the person photographing. It is possible to deliver and display advertising information.

  In the above description, the mobile phone terminal of the user viewing the advertisement information is the terminal 2A, and the mobile phone terminal on the side storing the advertisement URL is the terminal 2B. Moreover, these terminals may be singular or plural.

[Schematic configuration of mobile phone terminal]
FIG. 2 shows a schematic internal configuration example of the mobile phone terminals 2A and 2B according to the embodiment of the present invention. In the example of FIG. 2, only main components related to the display of advertisement information and the like are shown, and illustration of components related to various general functions of the mobile phone terminal is omitted. Of course, it goes without saying that the mobile phone terminal of the present embodiment also has various general functions.

  As shown in FIG. 2, the mobile phone terminal of this embodiment includes a control / calculation module 10, a camera module 11, a GPS module 12, a posture detailed information acquisition module 13, and a web communication module 15 as main components according to the present invention. , A short-range wireless communication module 16, a memory module 17, a key button module 18, a display module 19, and the like. Note that the notation of a module in the present embodiment includes both hardware and software units.

  The web communication module 15 is connected to the communication network 3 via the mobile phone packet network, and communicates with a server on the Internet via the communication network 3, particularly in the case of this embodiment. Can communicate with the advertisement information transmission server 4 and the advertisement information registration server 5.

  The display module 19 includes, for example, a display panel such as a liquid crystal or an organic EL (ElectroLuminescent), and a display driving circuit for displaying an image or the like on the display panel.

  The key button module 18 is mounted on a mobile phone terminal such as a numeric keypad, a speech key, an end key (power button), a clear key, an application key, a cross key, a decision key, and a shutter button for a camera. It consists of various keys and a circuit for generating an operation signal when these keys are operated. In particular, in the case of the present embodiment, pressing of a predetermined key button of the key button module 18 serves as a trigger for starting or ending advertisement information browsing as described later.

  The camera module 11 includes an imaging lens system, an imaging device, a video processing circuit that converts an imaging signal obtained from the imaging device into a video signal for display display, and the like. The real-world video signal captured by the image sensor of the camera module 11 is sent to the display module 19. As a result, the screen of the display module 19 is used as a so-called viewfinder, and on the viewfinder screen, real-time captured images of the real world captured by the camera module 11 are displayed.

  The GPS module 12 receives radio waves from the GPS satellite 1, and uses the received information to calculate the absolute position (latitude, longitude, altitude) of the terminal itself in the real world at the current time. The GPS module 12 stores the calculated absolute position information in the memory module 17.

  The short-range wireless communication module 16 is a communication device for performing short-range wireless communication such as a so-called Bluetooth method, UWB (Ultra Wide Band) method, wireless LAN (Local Area Network) method, and infrared communication method. In the present embodiment, the short-range wireless communication module 16 may include all communication devices such as the Bluetooth method, the UWB method, the wireless LAN method, or any one or two of them. It may consist of two communication devices. In particular, in the case of this embodiment, information on the current position and advertisement URL are transmitted and received between mobile phone terminals capable of short-range wireless communication, as will be described later.

  The posture detailed information acquisition module 13 includes a gyro sensor, an acceleration sensor, an electronic compass, and the like. The gyro sensor detects the amount and direction of rotation when a rotational motion is applied to the mobile phone terminal, and the tilt of the mobile phone terminal due to the rotation. The acceleration sensor detects the movement acceleration when the acceleration movement is applied to the mobile phone terminal, the movement amount, and the movement direction. The electronic compass detects the current orientation of the mobile phone terminal, particularly the orientation in which the lens of the camera module 11 faces in the present embodiment.

  The memory module 17 stores the information browsing control program of the present invention as one of the application programs of the mobile phone terminal. In the case of the present embodiment, the information browsing control program is executed by a CPU (not shown), thereby providing an advertisement URL to another terminal via short-range wireless communication, or provided from another terminal. A process of acquiring advertisement information from the advertisement information transmission server 4 based on the advertisement URL, a process of displaying the acquired advertisement information on the viewfinder screen, and the like are realized. In the present embodiment, the URL (advertisement URL) of the advertisement information stored in the advertisement information transmission server 4 is stored in the memory module 17 of the mobile phone terminal registered in the advertisement information distribution service. It will be. In addition, the advertisement URL and the current position information are stored in the memory module 17 of the mobile phone terminal that has received the advertisement URL and the current position information of the terminal from another terminal via short-range wireless communication. When advertisement information is received from the advertisement information transmission server 4 based on the advertisement URL, the advertisement information is also saved.

  The control / arithmetic module 10 controls the overall control of the mobile phone terminal of this embodiment and the operation of each module. Further, the control / arithmetic module 10 executes the information browsing control program of the memory module 17 to thereby perform the shooting range calculation unit, the other terminal information acquisition control unit, the shooting range terminal calculation unit, and the stored information acquisition control according to the present invention. Functions of the display unit, the display position calculation unit, and the information display control unit.

  Here, the control / arithmetic module 10 when executing the information browsing control program of the present embodiment is a photographing range photographed by the camera module 11 in the real world as a photographing range calculation unit according to the present invention. Is calculated. That is, the control / arithmetic module 10 uses the detection signals from the gyro sensor, acceleration sensor, and electronic compass of the posture detailed information acquisition module 13 and the absolute position of the terminal calculated by the GPS module 12 at the present time. The detailed photographing range of the real space which is photographed by the camera module 11 is obtained. More specifically, the control / calculation module 10 obtains the attitude of the terminal itself in the real space at the present time based on the detection signals of the gyro sensor and the acceleration sensor of the attitude detailed information acquisition module 13. Further, in that posture, the direction in which the lens of the camera module 11 is directed is calculated from the detection signal from the electronic compass and the absolute position of the terminal calculated by the GPS module 12. Then, the control / calculation module 10 projects the extent of any orientation in the real space by the camera module 11 based on the orientation of the terminal in the real space and the orientation of the lens in the orientation. Is calculated. A specific example of a detailed shooting range in the real space obtained by the control / calculation module 10 will be described later.

  Further, the control / calculation module 10 serves as the other terminal information acquisition control unit according to the present invention, and stores the current location information of the other terminal and the other terminal from the other terminal through the short-range wireless communication module 16. Location address information (advertisement URL) is acquired. That is, the control / calculation module 10 in this case searches through the short-range wireless communication module 16 whether there is another terminal that can communicate within the short-range range, and detects the presence of the other terminal as a result of the search. In addition, it is determined whether or not the other terminal holds the advertisement URL. When the advertisement URL is held, the current location information of the other terminal is acquired together with the advertisement URL.

  Further, the control / calculation module 10 is present within the shooting range using the current position of the other terminal, the current position of the own terminal, and the shooting range as the terminal within the shooting range according to the present invention. Calculate other terminals. That is, the control / arithmetic module 10 in this case calculates other terminals existing within the photographing range by performing calculations using mathematical formulas described later.

  The control / arithmetic module 10 is connected to the storage location specified by the advertisement URL (that is, the advertisement information transmission server 4) through the web communication module 15 as the storage information acquisition control unit according to the present invention, and the advertisement Advertisement information is acquired from the storage location specified by the URL. That is, the control / calculation module 10 in this case accesses the advertisement information transmission server 4 through the web communication module 15 by the advertisement URL acquired from the other terminal existing in the shooting range, and the advertisement information transmission server 4 To obtain the advertisement information indicated by the outside-city advertisement URL.

  In addition, the control / calculation module 10 calculates a position where a person or the like who has another terminal within the photographing range is displayed on the viewfinder screen of the display module 19 as a display position calculation unit according to the present invention. That is, the control / arithmetic module 10 in this case obtains the display position of a person or the like on the viewfinder screen by performing a calculation using a mathematical expression described later.

  Further, the control / arithmetic module 10 displays the advertisement information in the vicinity of the person image on the viewfinder screen or superimposed on the person image as the information display control unit according to the present invention.

  Details of control and calculation by the control / calculation module 10 will be described later.

[Viewfinder display image example with advertisement information superimposed on the captured image]
In FIG. 3, in this embodiment, for example, when a person holding the mobile phone terminal 2B is photographed by the camera module 11 of the mobile phone terminal 2A, the screen of the display module 19 of the mobile phone terminal 2A is displayed. Shows a photographed video example (an example of the viewfinder screen 30) displayed in real time. In FIG. 3, for example, a part of the real space landscape 31 where the house 31a and the tree 31b exist is the shooting range of the camera module 11, and the viewfinder screen 30 displaying the shooting range is shown. FIG. 9 shows a display example in the case where a video of a person carrying the mobile phone terminal 2 </ b> B (person video 34) and two pieces of advertisement information are displayed in the vicinity of the person video 34.

  As in the example of FIG. 3, when shooting is performed by the camera module 11, the mobile phone terminal 2 </ b> A according to the present embodiment includes the captured image in the real space displayed on the viewfinder screen 30 of the display module 19. From this, the video display position of the person holding the mobile phone terminal 2B of the present embodiment is specified, and the advertisement information 35, 36 is displayed in the vicinity of the person video 34, for example.

  Further, when the person image 34 moves in the direction indicated by the arrow Y in the figure in the photographed image of FIG. 3, for example, the display position of the person image 34 moves as shown in FIG. The mobile phone terminal 2 </ b> A in the form moves the advertisement information 35 and 36 in accordance with the movement of the person video 34. That is, the mobile phone terminal of the present embodiment specifies the video display position of the person carrying the mobile phone terminal 2B of the present embodiment in the photographed video for each short period such as a video frame period, The advertisement information 35 and 36 can be moved and displayed in accordance with the movement of the person video 34.

  3 and 4 show an example in which only two pieces of advertisement information 35 and 36 are displayed around one person video 34. However, for example, the number of pieces of advertisement information is large, and all pieces of advertisement information are included. When displayed, the captured image on the viewfinder screen becomes unsightly, the number of displayed advertisement information may be limited, or the user may be allowed to select the advertisement information to be displayed. When the display advertisement information is limited, for example, the display advertisement information may be limited in the order of registration or the newness of the advertisement itself, or may be limited to display only the advertisement information of a desired category. When selecting advertisement information, the setting of which advertisement information is displayed (or not displayed) may be performed when advertisement information is displayed, or may be set in advance. May be.

  In addition, when a plurality of person videos are displayed in the viewfinder screen and a plurality of advertisement information is displayed around each person video, if there are a plurality of the same advertisement information, Instead of displaying them individually, they can be displayed in a distinguishable manner from other advertising information by, for example, enlarging them, changing their colors, or changing their display positions.

  Further, as the advertisement information, for example, information such as a store name / store address, for example, a product category such as “One Piece” and its price can be cited. Furthermore, the advertisement information is not only information on stores and products, but also, for example, train delay information and road information, information on the holding of any event, a combination of local special product information and local weather information, etc. Also good.

  Furthermore, as a method of displaying the advertisement information, the person image displayed on the viewfinder screen is displayed at a position corresponding to, for example, clothes or a bag, or the advertisement information is displayed not only as text but also as an illustration or a photographic image. You may display as information to include.

  In addition, if there is any access to the advertiser from the user who saw the advertisement information, the owner of the mobile phone terminal on the side showing the advertisement information (the side sending the advertisement URL) responded to the access A mechanism for delivering a reward may be provided.

[Identify the shooting range of the camera module and the terminal position within the shooting range]
As described above, the mobile phone terminal of the present embodiment is capable of specifying the position of the mobile phone terminal held by a person or the like within the shooting range by the camera module 11. Will be described with reference to FIGS.

  FIG. 5 shows a shooting range 23 in the real space by the camera module 11 of the mobile phone terminal (hereinafter referred to as a mobile phone terminal A) of the present embodiment on the shooting side, and the real space within the shooting range 23. An example of the positional relationship with the mobile phone terminals (in the example of FIG. 5, the mobile phone terminals B1, B2, and B3) possessed by a person or the like existing in FIG. Also, in FIG. 6, among the mobile phone terminals B1, B2, and B3 of each person that are present in the shooting range 23 of FIG. 5 and displayed on the viewfinder screen of the display module 19, in particular, the mobile phone terminals Only B1 is shown.

  As shown in FIG. 5, the shooting range 23 in the real space by the lens of the camera module 11 is a range surrounded by a fan shape. Note that the actual shooting range by the lens of the camera module 11 is included up to a distance at infinity within the field angle range of the lens, but it is a reality that all the distance at infinity is included in the shooting range. Not right. For this reason, in the present embodiment, a certain limit is set for the distance from the lens of the camera module 11 in the photographing range 23. In the present embodiment, as shown in FIG. 5, the photographing range 23 is within a distance of, for example, a radius R from the focal point of the lens of the camera module 11. Further, the imaging range 23 shown in FIG. 5 shows only the horizontal spread around the optical axis J of the lens of the camera module 11.

  Further, the cellular phone terminal A of the present embodiment obtains the shooting range 23 from the current position of the terminal itself and the direction and inclination of the lens of the camera module 11. That is, the mobile phone terminal A of the present embodiment includes a current position measured by the GPS module 12, a rotation amount and rotation direction by the gyro sensor of the posture detailed information acquisition module 13, a detection signal of the inclination due to the rotation, and an acceleration sensor. The imaging range 23 is calculated using the movement acceleration, the movement amount, the movement direction detection signal, and the direction detection signal of the electronic compass.

  In addition, the mobile phone terminal A of the present embodiment uses the short-range wireless communication to acquire the current position information measured by each of the GPS modules 12 by the other mobile phone terminals B1, B2, and B3 existing in the shooting range 23. Obtained through the communication module 16.

  Here, among the mobile phone terminals B1, B2, and B3 shown in FIG. 5, for example, only the mobile phone terminal B1 is cited, and the latitude and longitude coordinates of the current position of the terminal B1 are (x1, y1), and the mobile phone terminal A If the latitude and longitude coordinates of the current position are (x, y), the distance D between the terminal A and the terminal B1 can be obtained by the following equation (1).

D = √ ((x1−x) ² + (y1−y) ² ) (1)

  Further, when the lens optical axis of the terminal A is J, and the angle between the optical axis J and the line connecting the coordinates (x1, y1) and the coordinates (x, y) is θ, the above equation (1) is used. When sin θ is expressed using the measured distance D, the following equation (2) is obtained.

sinθ = √ ((x1-x) ² ) / D (2)

  Therefore, the angle θ can be obtained by the following formula (3).

θ = arcsin (√ ((x1−x) ² ) / D) (3)

  The angle between the optical axis J and one horizontal end of the shooting range 23 is φ, and the horizontal length of the shooting range 23, that is, the horizontal length of the viewfinder screen is 2L. Assuming that the center point (optical axis) of the viewfinder is the origin, the position b in the horizontal direction within the photographing range 23 of the mobile phone terminal B1 can be expressed by the following equation (4).

  a = L * θ / φ (4)

  Each calculation described above is for the horizontal direction (horizontal direction) of the shooting range 23. Similarly, by calculating for the vertical direction (vertical direction) of the shooting range 23, the mobile phone terminal in the viewfinder screen is displayed. The display position of the person carrying B1 can be specified. The same processing is performed for the mobile phone terminals B2 and B3.

  In the mobile phone terminal of the present embodiment, advertisement information is drawn in the vicinity of the display position specified as described above. In addition, the mobile phone terminal of the present embodiment performs the display position specifying process as described above for each short period such as a video frame period, and the vicinity of the position specified for each short period is displayed in the advertisement information. By performing a display update process that sets the display position, a display process that moves the advertisement information in accordance with the movement of the person video is realized.

[Advertising Information Display Flowchart]
In FIG. 7, an advertisement URL is obtained from another cellular phone terminal (terminal B or the like) in the cellular phone terminal (terminal A side), and further advertisement information is obtained from the advertisement information transmission server 4 based on the advertisement URL. The flow of processing until it is displayed on the viewfinder screen is shown. The processing shown in FIG. 7 is realized by the control / arithmetic module 10 executing the information browsing control program of the present invention and controlling each module in the mobile phone terminal of the present embodiment.

  In the mobile phone terminal of the present embodiment, when a predetermined key button in the key button module 16 is pressed, the control / arithmetic module 10 activates the information browsing control program in the memory module 17, and the flowchart of FIG. Start processing.

  When the process of the flowchart of FIG. 7 starts, the control / arithmetic module 10 activates the short-range wireless communication module 16 as a process of step S1, and the present invention enters the short-range range through the short-range wireless communication module 16. The information browsing control program of the embodiment is activated to enable short-distance wireless communication, and a search is made as to whether there is a mobile phone terminal or the like of another user holding an advertisement URL. When the control / arithmetic module 10 finds another user's mobile phone terminal holding the advertisement URL in step S2, the control / arithmetic module 10 advances the processing to the loop of step S3 to step S13, and performs steps S1 and S2. Repeat the loop process for the number of mobile phone terminals found in. On the other hand, if the mobile phone terminal of another user cannot be found in step S2, the control / arithmetic module 10 ends the process of this flowchart.

  When the process proceeds to the loop of step S3 to step S13, the control / arithmetic module 10 transmits the advertisement URL held by the mobile phone terminal of the other user and its advertisement through the short-range wireless communication module 16 as the process of step S4. Get terminal location information.

  Next, the control / arithmetic module 10 proceeds to step S5, and the GPS module 12 acquires the current position of the terminal itself.

  Further, the control / arithmetic module 10 acquires the orientation and inclination of the lens of the camera module 11 from the detection signal of the posture detailed information acquisition module 16 as the process of step S6.

  Then, the control / arithmetic module 10 performs the process of step S7, the current position of the other user terminal acquired in step S4, the current position of the own terminal determined in step S5, and the direction and inclination of the lens determined in step S6. Based on the above, the display position of the other user terminal (actually, the person video possessing the terminal) on the viewfinder screen of the display module 19 is calculated.

  Next, the control / arithmetic module 10 determines whether or not there is advertisement information acquired by the same advertisement URL as the already displayed advertisement information as the process of step S8. If there is, the process proceeds to step S10. If not, the process proceeds to step S9.

  In step S9, the control / arithmetic module 10 connects to the advertisement information transmission server 4 based on the advertisement URL through the web communication module 15, and acquires advertisement information corresponding to the advertisement URL from the server 4. To do. Then, the control / arithmetic module 10 draws the advertisement information in the vicinity of the display position on the viewfinder screen previously obtained in step S7. After the process of step S11, the process proceeds to step S12.

  On the other hand, when the process proceeds from step S8 to step S10, the control / calculation module 10 displays the advertisement information corresponding to the advertisement URL on the viewfinder screen by, for example, enlarging or changing the color as described above. draw. After step S10, the process proceeds to step S12.

  When the processing proceeds to step S11, the control / arithmetic module 10 displays the display position obtained in step S7, that is, the display position of the person video possessing the other user terminal on the viewfinder screen. If it is within the display range, the process returns to step S4. If it is out of the display range, the process proceeds to the next loop at step S13.

  Then, in the loop of step S3 to step S13, when all the processes for the number of other user terminals are completed, the control / arithmetic module 10 ends the process of this flowchart.

[Advertising Information Display Sequence]
In FIG. 8, in the information distribution system of the present embodiment, the mobile phone terminal (terminal A side) acquires an advertisement URL from another mobile phone terminal (terminal B or the like), and further transmits advertisement information based on the advertisement URL. The sequence at the time of acquiring advertisement information from the server 4 and displaying it on the viewfinder screen is shown.

  In FIG. 8, when the mobile phone terminal A is instructed to set the advertisement information viewing mode to ON (T1) from the user through an operation of the key button module 16 at an arbitrary place where GPS position information can be acquired. The viewfinder of the display module 19 is activated (T2). Next, the mobile phone terminal A transmits a request message for requesting an advertisement URL to the mobile phone terminal B of another user in the short range using the short range wireless communication module 16 (T3).

  Upon receiving the request message (T21), the mobile phone terminal B existing within the short range of the mobile phone terminal A receives the current location information and the advertisement URL from the mobile phone terminal A by short-range wireless communication. (T22).

  When the location information and the advertisement URL are received from the cellular phone terminal B, the cellular phone terminal A stores the information in the memory module 17 (T4), and then acquires the current location of the terminal by the GPS module 12 ( Then, the current position information is also stored in the memory module 17 (T6).

  Next, the cellular phone terminal A obtains the camera orientation of the camera module 11 by the posture detailed information acquisition module 16, and calculates the range and position of the real space reflected in the viewfinder (T7).

  The mobile phone terminal A then determines the position of the mobile phone terminal B on the viewfinder screen (other users) based on the calculation results and the current position information of the own terminal and other user terminals stored in the memory module 17. Is calculated (T8).

  In addition, the mobile phone terminal A compares the URL of the advertisement information that has already been displayed (T9), and if it is not the same URL of the advertisement information, the advertisement information transmission request message to the advertisement information transmission server 4 is sent. Is transmitted (T10).

  Upon receiving this request message (T31), the advertisement information transmission server 4 transmits the advertisement information in response to the request (T32).

  When receiving the advertisement information, the mobile phone terminal A draws the acquired advertisement information on the viewfinder screen as described above. At the time of drawing, the advertisement information of the same advertisement URL is enlarged and displayed as described above.

  Thereafter, the cellular phone terminal A terminates the process when an instruction is given from the user to turn off the advertisement information viewing mode through the operation of the key button module 16 (T12).

[Flow chart for providing advertisement information]
FIG. 9 shows a flow of processing in which an advertisement URL is requested from another cellular phone terminal (terminal A or the like) in the cellular phone terminal (terminal B side), and the advertisement URL is transmitted in response to the request. The processing shown in FIG. 9 is realized by the control / arithmetic module 10 executing the information browsing control program of the present invention to control each module in the mobile phone terminal of the present embodiment.

  In the mobile phone terminal of this embodiment, when a predetermined key button in the key button module 16 is pressed, the control / arithmetic module 10 activates the information browsing control program in the memory module 17, and the flowchart of FIG. Processing starts.

  When the process of the flowchart of FIG. 9 starts, the control / arithmetic module 10 holds the advertisement URL specifying the advertisement information stored in the advertisement information transmission server 4 in the memory module 17 as the process of step S21. If NO in step S22, the flow chart of FIG. 9 is terminated. On the other hand, if held, the process proceeds to step S22.

  In step S22, the control / arithmetic module 10 activates the short-range wireless communication module 16 and sets the short-range wireless communication with another terminal (reception mode).

  Next, in step S23, the control / arithmetic module 10 determines whether a request for an advertisement URL has been received from another mobile phone terminal (for example, terminal A) through the short-range wireless communication module 16. If not received, the process proceeds to step S28 described later. On the other hand, if received, the process proceeds to a loop of step S24 to step S27.

  When the process proceeds to the loop of step S24 to step S27, the control / arithmetic module 10 acquires the current position of the own terminal by the GPS module 12 as the process of step S25.

  Then, the control / arithmetic module 10 requests the advertisement URL held in the memory module 17 and the current position information acquired in step S25 through the short-range wireless communication module 16 as the process of step S26. Send to mobile phone terminal.

  Thereafter, in the loop of step S24 to step S27, when all the processes for requests from other user terminals are completed, the control / arithmetic module 10 advances the process to step S28.

  Proceeding to step S28, the control / arithmetic module 10 determines whether or not an instruction to end short-range wireless communication has been input, for example, through an operation of the key button module 16. If the instruction to end is not input, step S28 is performed. The process returns to S23, whereas if an end instruction is input, the process of this flowchart ends.

[Advertising information provision sequence]
In FIG. 10, in the information distribution system of this embodiment, the mobile phone terminal (terminal B side) requests an advertisement URL from another mobile phone terminal (terminal A or the like), and transmits the advertisement URL in response to the request. A sequence of cases is shown.

  In FIG. 10, when the mobile phone terminal B is instructed to turn the advertisement information viewing mode ON (4T1) from the user through the operation of the key button module 16 at an arbitrary place where the position information can be obtained by GPS, The short-range wireless communication module 16 is activated to enable a short-range wireless communication with another user's mobile phone terminal A within the short-range range (T42).

  At this time, when a request message for requesting an advertisement URL is transmitted from the mobile phone terminal A side (T51) and the mobile phone terminal B receives the request message (T43), the mobile phone terminal B receives the GPS module 12 The current position of the terminal is acquired (T44), and the current position information is stored in the memory module 17 (T45).

  Next, the cellular phone terminal B transmits the information on the current location of the terminal itself and the advertisement URL stored in the memory module 17 to the cellular phone terminal A side as response data by short-range wireless communication ( T46). Thereby, the mobile phone terminal A side can receive the current location information and the advertisement URL of the mobile phone terminal B as response data (T52).

  Thereafter, the cellular phone terminal B terminates the short-range wireless communication with the cellular phone terminal A (T47), and instructs the user to turn off the advertisement information viewing mode through the operation of the key button module 16 (T48). When is done, the process is terminated.

[Summary]
As described above, according to the embodiment of the present invention, for example, when a person image captured in real time by the camera function of a mobile phone terminal is displayed on the viewfinder screen, the mobile phone possessed by the person is displayed. An advertisement URL is acquired from the terminal by short-range wireless communication, advertisement information corresponding to the advertisement URL is acquired from the advertisement information transmission server 4, and can be displayed in the vicinity of the person video.

  Thereby, according to the present embodiment, the user of the mobile phone terminal can easily browse the advertisement information of a store or the like away from the current position where he / she is located through the terminal of the person who is shooting. It becomes possible to do. Further, according to the present embodiment, the advertiser can show the advertisement information to the mobile phone terminal of the user at a place away from the store or the like. That is, in the embodiment of the present invention, an information distribution source such as an advertiser can distribute information to a wide range without being limited to a place in a real space where a store or the like exists, and the user side Can acquire information desired by itself without being limited to the place in the real space where the store or the like exists.

  The above description of the embodiment of the present invention is an example of the present invention. For this reason, the present invention is not limited to the above-described embodiment, and it is needless to say that various modifications can be made according to the design or the like as long as the technical idea according to the present invention is not deviated.

  In the embodiment described above, an example of displaying an advertisement of a store, a company, or the like has been described. However, the present invention can display not only the advertisement but also a message input by the user himself / herself, for example. In this case, a personal message is stored on the message transmission server, and a URL indicating the storage location of the message is prepared in the mobile phone terminal B, and the mobile phone terminal A is used by the camera function as described above. When a request message requesting a URL is received from the mobile phone terminal B, the URL of the personal message is returned from the mobile phone terminal B to the mobile phone terminal A as response data together with the position information. At this time, the cellular phone terminal A accesses the message transmission server based on the personal message URL, acquires the message, and displays it in the vicinity of the person video of the terminal B as described above. Note that there are various possible personal messages. For example, a message indicating the current state of the user of the mobile phone terminal B (for example, a message such as “I am in a hurry”, “Working”, “Recruiting a lover”, etc.) It may be.

  Also, as described above, when you can view advertisements and personal messages, access is restricted so that only specific people can see those advertisements and messages, rather than showing unspecified number of people. Can also be set. One specific example of setting access restrictions is sending and receiving phone numbers and email addresses between both terminals via short-range wireless communication so that users cannot view them, and these phone numbers and email addresses are registered in advance. Only in the case where the message is present, a technique such as making it possible to view the message or the like can be used. The example of restricting access using personal information such as a telephone number or an e-mail address is particularly applicable to a mobile phone terminal that registers and manages personal information. Thus, it is not suitable for a terminal that does not manage personal information.

DESCRIPTION OF SYMBOLS 1 ... GPS satellite, 2A, 2B, A, B1-B3 ... Mobile phone terminal, 3 ... Communication network, 4 ... Advertisement information transmission server, 5 ... Advertisement information registration server, 6 ... Advertiser terminal, 10 ... Control and calculation module , 11 ... Camera module, 12 ... GPS module, 13 ... Attitude detailed information acquisition module, 14 ... Advertising information display control / calculation module, 15 ... Web communication module, 16 ... Near field communication module, 17 ... Memory module, 18 ... Key button module, 19 ... display module, 30 ... landscape, 31a ... home, 31b ... tree, 34 ... person video, 35, 36 ... advertising information

Claims (7)

A shooting unit that takes a picture of the real world with a shooting lens and a shooting element;
A video display unit for displaying video;
A self-terminal position detection unit for detecting a current position of the self-terminal;
A network communication unit for performing communication through a predetermined wireless communication network;
A near field communication unit for performing near field communication with other portable information terminals;
A shooting range calculation unit that calculates a shooting range shot by the shooting unit in the real world;
Other terminal information acquisition control unit that acquires the current location information of the other portable information terminal and the storage location address information held by the other portable information terminal from the other portable information terminal through the short-range wireless communication unit When,
A shooting range terminal calculation unit that calculates another portable information terminal existing in the shooting range using the current position of the other portable information terminal, the current position of the terminal itself, and the shooting range;
Storage that connects to the storage location specified by the storage location address information acquired from the other portable information terminal calculated by the terminal within the photographing range and that acquires information from the storage location through the network communication unit An information acquisition control unit;
A display position calculation unit that calculates a position at which the other portable information terminal calculated by the terminal within the shooting range is displayed on the display screen of the video display unit;
An information display control unit for displaying the information acquired by the storage information acquisition control unit in the vicinity of the display position calculated by the display position calculation unit or overlapping the display position;
A portable information terminal. The shooting range calculation unit
A gyro sensor that detects the amount and direction of rotation when a rotational motion is applied to the terminal, and the inclination of the terminal due to the rotation;
An acceleration sensor for detecting a movement acceleration when the acceleration motion is applied to the terminal, a movement amount thereof, and a movement direction thereof;
An electronic compass for detecting the direction in which the photographing lens of the photographing unit faces,
Based on the detection signals of the gyro sensor and the acceleration sensor, the orientation of the terminal at present is obtained in the real space, and the direction in which the photographing lens of the photographing unit faces is obtained from the detection signal obtained from the electronic compass. The portable information terminal according to claim 1, wherein a photographing range in the real world photographed by the photographing unit is calculated based on a posture of the own terminal in the camera and a direction in which the photographing lens faces in the posture.   The portable information terminal according to claim 2, wherein the photographing range calculation unit sets the photographing range within a certain distance from the focal point of the photographing lens of the photographing unit. The shooting range calculation unit calculates the shooting range for each predetermined time period,
The other terminal information acquisition control unit acquires the current location information of the other portable information terminal and the storage location address information held by the other portable information terminal every predetermined time period,
The photographing range terminal calculation unit calculates another portable information terminal existing in the photographing range for each predetermined time period,
The stored information acquisition control unit acquires information from the storage location for each predetermined time period,
The display position calculation unit calculates a position at which another portable information terminal is displayed on the display screen of the video display unit every predetermined time period,
The portable information terminal according to any one of claims 1 to 3, wherein the information display control unit displays the information in the vicinity of the display position or superimposed on the display position every predetermined time period. . An information storage server connected to a predetermined wireless communication network and storing predetermined information;
Holding a storage location address information of the information stored in the information storage server, a first portable information terminal that transmits the current location of the terminal and the storage location address information by short-range wireless communication;
Display the video captured by the camera function on the screen, calculate the shooting range by the camera function, and acquire the current location information and the storage location address information from the first portable information terminal through short-range wireless communication And calculating the first portable information terminal existing within the shooting range using the current position of the first portable information terminal, the current position of the terminal itself, and the shooting range, and setting the predetermined wireless communication network Via the storage location specified by the storage location address information acquired from the first portable information terminal within the imaging range, and acquiring the predetermined information within the imaging range. The first portable information terminal existing in the first display area displays the predetermined information acquired from the storage location in the vicinity of the position displayed on the screen or superimposed on the display position. And the portable information terminal,
An information distribution system comprising: A step of photographing a real world by a photographing means having a photographing lens and a photographing element;
A step in which video display means displays the video imaged by the imaging means on the screen;
A shooting range calculation unit calculating a shooting range in the real world shot by the shooting means;
A step where the current position detecting means detects the current position of the terminal;
Through the short-range wireless communication means, the other terminal information acquisition control unit acquires the current location information of the other portable information terminal and the storage location address information held by the other portable information terminal from the other portable information terminal. And steps to
A step of calculating an in-shooting range terminal calculating unit using the current position of the other portable information terminal, the current position of the own terminal, and the shooting range to calculate another portable information terminal existing in the shooting range; ,
The storage information acquisition control unit connects to the storage location specified by the storage location address information acquired from the other portable information terminal calculated by the imaging range terminal calculation unit through a predetermined wireless communication network, and Obtaining information from the storage location;
A display position calculation unit calculating a position where the other portable information terminal calculated by the imaging range terminal calculation unit is displayed on the screen of the video display means;
The information display control unit displaying the information acquired by the stored information acquisition control unit in the vicinity of the display position calculated by the display position calculation unit or overlapping the display position; and
An information browsing control method. Shooting control processing for shooting the real world by shooting means having a shooting lens and a shooting element;
Video control processing for displaying the video imaged by the imaging means on the screen of the video display means;
A shooting range calculation process for calculating a shooting range in the real world shot by the shooting means;
A current position detection control process for causing the current position detection means to detect the current position of the terminal;
Other terminal information acquisition control processing for acquiring the current location information of the other portable information terminal and the storage location address information held by the other portable information terminal from the other portable information terminal through the short-range wireless communication means; ,
A shooting range terminal calculation process for calculating another portable information terminal existing in the shooting range using the current position of the other portable information terminal, the current position of the own terminal, and the shooting range;
Connect to the storage location specified by the storage location address information acquired from the other portable information terminal calculated in the imaging range terminal calculation processing through a predetermined wireless communication network, and acquire information from the storage location Storage information acquisition control processing to
A display position calculation process for calculating a position at which the other portable information terminal calculated in the photographing range terminal calculation process is displayed on the screen of the video display means;
An information display control process for displaying the information acquired in the stored information acquisition control process in the vicinity of the display position calculated in the display position calculation process or overlapping the display position.
An information browsing control program to be executed by a portable information terminal.

Images