JP2012133502A - Server device, first terminal device, second terminal device, information processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem of the conventional information sysmtem in which: information regarding a mobile object such as a human or a car being photographed cannot be outputted.SOLUTION: One or more pieces of object information having an object identifier and area information are stored in a recording medium. One or more pieces of second terminal information having the second terminal identifier of a second terminal device and mobile object information regarding a mobile object are stored. First terminal information having the first position information and the first direction information of a first terminal device is received. Current second terminal information including the second terminal identifier and the second position information of the second terminal device is received. The first position information, the first direction information, and a visual field angle are applied to the area information of each object information and the current second terminal information of each second terminal device. One or more second terminal devices photographed by the first terminal device are determined. One or more pieces of mobile object information corresponding to one or more determined second terminal devices are acquired. Then, one or more pieces of information are output. By this program, information regarding the mobile object such as a human or a car being photographed can be output.

Description

  The present invention relates to an information system or the like that outputs information related to a moving object (for example, a person or a car) that is an object photographed by a camera and that can move.

  Conventionally, information distribution type landscape labeling in which geographical information on a computer is associated with each part in a landscape image of a real scene and presented to the user, and various information (advertisement information, guidance information, etc.) is sent to the user. There was a device (Patent Document 1).

  In addition, the background data processing, data transfer, and terminal display time on the host computer can be greatly reduced, and 3D map information using the latest background map can be configured on the terminal device to perform light operations. There was a map-related information distribution system that can be used (Patent Document 2).

  Furthermore, there has been a subject information processing apparatus and a subject information processing method that automatically embed subject information in a video photographed by a camera device (Patent Document 3).

JP-A-11-66347 JP 2008-158583 A JP 2002-152713 A

  However, in the conventional information system, there is no system that can output information on a moving object such as a person or a car that is taking a picture.

  The first terminal device of the first invention is a first terminal device that constitutes an information system comprising a server device, a first terminal device, and a second terminal device that moves in accordance with the movement of a moving body, The server device includes an object information storage unit that can store one or more object information including an object identifier that identifies an object and region information indicating a region in which the object exists, and a second terminal identifier that identifies a second terminal device A second terminal information storage unit that can store one or more pieces of second terminal information having mobile body information that is information about the mobile body, a second terminal identifier, and a second terminal that can be identified by the second terminal identifier A current second terminal information storage unit capable of storing one or more current second terminal information including second position information indicating the position of the device; and a first indicating the position of the first terminal device from the first terminal device. A first terminal information receiving unit that receives first terminal information having position information and first direction information indicating a direction in which the first terminal device is facing; Current second terminal information reception that receives current second terminal information including an identifier and second position information of a second terminal device that can be identified by the second terminal identifier, and at least temporarily stores the current second terminal information in a current second terminal information storage unit Each of the object information storage unit, the first position information included in the first terminal information, the first direction information included in the first terminal information, and the viewing angle stored in advance or included in the first terminal information. Applies to the area information of the object information and the current second terminal information of each second terminal device of the current second terminal information storage unit, and determines one or more second terminal devices that the first terminal device is photographing. Two terminals A mobile unit information acquisition unit that acquires, from the second terminal information storage unit, one or more mobile unit information corresponding to each of the one or more second terminal devices determined by the fixing unit and the imaging second terminal determination unit; A mobile information transmission unit that transmits one or more pieces of movement information acquired by the terminal information acquisition unit to the first terminal device, wherein the first terminal device includes first position information indicating a position of the first terminal device; A first terminal information acquisition unit that acquires first direction information indicating a direction in which the first terminal device is facing, a camera unit that acquires a video, and a camera video output unit that outputs a video acquired by the camera unit An output unit comprising, a first transmission unit for transmitting the first terminal information acquired by the first terminal information acquisition unit to the server device, and a first reception unit for receiving mobile object information from the server device, The output unit outputs the mobile body information that is output by the first receiver. The second terminal device acquires second terminal information having a second terminal identifier storage unit capable of storing a second terminal identifier and second position information indicating a position of the second terminal device. Information including a second terminal information acquisition unit, a second terminal identifier, and a second transmission unit that transmits current second terminal information having the second terminal information acquired by the first terminal information acquisition unit to the server device It is the 1st terminal device which comprises a system.

  With this configuration, it is possible to output information relating to a moving object such as a person who is taking a picture or a car.

  Further, in the first terminal device of the second invention, in contrast to the first invention, the region information includes two-dimensional region information indicating a two-dimensional region on the map and height information indicating the height of the object. And the imaging second terminal determination unit uses the first position information and the first direction information included in the first terminal information, and the viewing angle stored in advance or included in the first terminal information. Acquiring a shooting area in space, applying the shooting area to the area information of each object information in the object information storage unit and the current second terminal information of each second terminal device of the current second terminal information storage unit; One or more objects and one or more second terminal devices photographed by one terminal device are determined, and objects are determined in order of increasing distance from the first terminal device when determining one or more second terminal devices. And inspect the second terminal device, the first The object and the second terminal device are registered when the object previously determined to be photographed by the terminal device and the information of the region that becomes invisible by the photographing of the second terminal device are registered as the invisible region. It is the 1st terminal device which comprises the information system which complete | finishes the test | inspection of whether it is image | photographed by the terminal device.

  With such a configuration, it is possible to recognize a moving body such as a person or a car that is taking a picture in a three-dimensional space and output information on the moving body.

  Further, in the first terminal device of the third invention, for the first or second invention, the photographing second terminal determination unit assumes that the size of each second terminal device is a predetermined size. The first position information included in the first terminal information, the first direction information included in the first terminal information, and the viewing angle stored in advance or included in the first terminal information are stored in each object information in the object information storage unit. Applies to the current second terminal information of each second terminal device in the area information and current second terminal information storage unit, and constitutes an information system that determines one or more second terminal devices photographed by the first terminal device The first terminal device.

  With this configuration, it is possible to easily recognize a moving object such as a person or a car that is taking a picture and output information related to the moving object.

  The first terminal device according to the fourth aspect of the present invention is the first terminal device according to any one of the first to third aspects, wherein the server device includes an object corresponding to one or more pieces of object information in the object information storage unit and the first terminal device. And the distance between the second terminal device and the first terminal device corresponding to one or more current second terminal information in the current second terminal information storage unit, the object information of each object and the first terminal information A distance calculation unit that calculates for each object or each second terminal device from the position information possessed or the current second terminal information of each second terminal device and the position information possessed by the first terminal information. The terminal determination unit inspects the object and the second terminal device in order of increasing distance from the first terminal device, and determines one or more second terminal devices captured by the first terminal device. A first terminal device constituting the beam.

  With such a configuration, it is possible to recognize a moving object such as a person or a vehicle who is taking a picture at high speed and output information related to the moving object.

  The first terminal device according to the fifth aspect of the present invention is the first terminal device according to any one of the first to fourth aspects, wherein the shooting second terminal determination unit determines the object and the second terminal in order of increasing distance from the first terminal device. When the device is inspected and the information of the area determined to be invisible by the shooting of the second terminal device and the object previously determined as being photographed by the first terminal device is registered as the invisible region, and the visible region disappears , A first terminal device constituting an information system for ending the examination of whether or not the object and the second terminal device are photographed by the first terminal device.

  With such a configuration, it is possible to recognize a moving object such as a person or a vehicle who is taking a picture at high speed and output information related to the moving object.

  The first terminal device according to the sixth aspect of the present invention is the first terminal device according to any one of the first to fourth aspects, wherein the shooting second terminal determination unit determines the object and the second terminal in order of increasing distance from the first terminal device. The device is inspected, and the information of the invisible region is registered as the invisible region by photographing the object previously determined that the first terminal device is photographing. It is a first terminal device that constitutes an information system that inspects only objects and second terminal devices whose distance from the device is within a threshold and determines one or more second terminal devices photographed by the first terminal device.

  With this configuration, it is possible to recognize a moving object such as a person or a car that is taking a picture at a higher speed and output information related to the moving object.

  The first terminal device according to the seventh aspect of the present invention is the first terminal device according to any one of the first to fourth aspects, wherein the shooting second terminal determination unit determines the object and the second terminal in order of increasing distance from the first terminal device. It is the first terminal device that constitutes the information system that terminates the inspection when the number of second terminal devices that have been inspected and determined that the first terminal device is photographing becomes a threshold value.

  With this configuration, it is possible to recognize a moving object such as a person or a car that is taking a picture at a higher speed and output information related to the moving object.

  In the first terminal device of the eighth invention, the mobile body information output means superimposes the mobile body information on the video acquired by the camera unit, and outputs the mobile body information in any one of the first to seventh inventions. The first terminal device.

  With such a configuration, it is possible to recognize a moving object such as a person or a car who is taking a picture at higher speed and appropriately output information on the moving object.

  The first terminal device of the ninth aspect of the invention is a first terminal device constituting an information system comprising a first terminal device and a second terminal device that moves in accordance with the movement of a moving body, One terminal device includes an object information storage unit that can store one or more object information having an object identifier that identifies an object and region information indicating a region in which the object exists, and a second terminal that identifies the second terminal device A second terminal information storage unit that can store one or more second terminal information having an identifier and mobile body information that is information about the mobile body, a second terminal identifier, and a second terminal that can be identified by the second terminal identifier A current second terminal information storage unit capable of storing one or more current second terminal information including second position information indicating the position of the terminal device, first position information indicating the position of the first terminal device, and the first terminal An output unit including a first terminal information acquisition unit that acquires first direction information indicating a direction in which the device is facing, a camera unit that acquires a video, and a camera video output unit that outputs the video acquired by the camera unit Current second terminal information including the second terminal identifier of the second terminal device and the second position information of the second terminal device that can be identified by the second terminal identifier from the second terminal device, A current second terminal information receiving unit that at least temporarily accumulates in the second terminal information storage unit, first position information that the first terminal information has, and first direction information that the first terminal information has, The viewing angle is applied to the region information of each object information in the object information storage unit and the current second terminal information of each second terminal device in the current second terminal information storage unit, and the first terminal device is shooting 1 The second terminal information storage stores at least one mobile terminal information corresponding to each of the one or more second terminal devices determined by the second photographing terminal determining unit and the second photographing terminal determining unit that determines the second terminal device above. The mobile body information acquisition unit acquired from the mobile unit and the output unit include mobile body information output means for outputting the mobile body information acquired by the mobile body information acquisition unit, and the second terminal device stores the second terminal identifier. A second terminal identifier storage unit, a second terminal information acquisition unit that acquires second terminal information having second position information indicating a position of the second terminal device, a second terminal identifier, and a first terminal information acquisition It is the 1st terminal device which comprises the information system which comprises the 2nd transmission part which transmits the current 2nd terminal information which has the 2nd terminal information which the part acquired to the 1st terminal device.

  With such a configuration, it is possible to recognize a moving object such as a person or a car that is taking a picture and output information related to the moving object.

  Moreover, the 1st terminal device of this 10th invention is a 1st terminal device with which current 2nd terminal information contains mobile body information with respect to 9th invention.

  With such a configuration, it is possible to recognize a moving object such as a person or a car that is taking a picture and output information related to the moving object.

  According to the information system of the present invention, it is possible to recognize a moving body such as a person or a car that is taking a picture and output information related to the moving body.

Conceptual diagram of information system 1 according to Embodiment 1 Block diagram of the information system 1 The block diagram of the 1st terminal device 12 which comprises the information system 1 A flowchart for explaining the operation of the server device 11 Flowchart for explaining the photographing second terminal determination process Flowchart explaining the same object sort processing Flow chart explaining the visibility determination process Flow chart explaining the visibility determination process Flow chart for explaining the operation of the first terminal device 12 Figure showing the same object information management table Figure showing the second terminal information management table The figure which shows the example of a display in the same 1st terminal device 12. The figure which shows the concept of the determination of the visible region The figure which shows the temporary management table etc. The figure which shows the example of a display of the mobile body information The figure which shows the example of a display of the mobile body information Figure showing the same object information management table The figure which shows the example of a display in the same 1st terminal device 12. Diagram explaining the viewing angle The figure which shows the temporary management table etc. The figure which shows the example of a display of the mobile body information Conceptual diagram of information system 2 in the present embodiment in the second embodiment Block diagram of the information system 2 Flow chart for explaining the operation of the first terminal device 21 Overview of the computer system in the above embodiment Block diagram of the computer system

Hereinafter, embodiments of an information system and the like will be described with reference to the drawings. In addition, since the component which attached | subjected the same code | symbol in embodiment performs the same operation | movement, description may be abbreviate | omitted again.
(Embodiment 1)

  In this embodiment, an information system that outputs information related to a moving object in a real space taken by a camera will be described. The camera may be not only a camera that captures still images but also a video camera that captures moving images. The moving body may be any moving object such as a car, a bicycle, a train, an airplane, or a person.

  In the present embodiment, the information system includes a server device, a first terminal device, and a second terminal device. The first terminal device is a terminal with a camera. The first terminal device is, for example, a mobile terminal, a mobile phone, a navigation terminal, a terminal having a surveillance camera, or the like. That is, the first terminal device may be a moving terminal or a fixed terminal. The second terminal device is a terminal device that moves according to the movement of the moving body. The second terminal device is, for example, a mobile terminal or a mobile phone held by a person, an in-vehicle navigation terminal, a mobile terminal or a mobile phone held by a person in the company, and the like.

  FIG. 1 is a conceptual diagram of an information system 1 in the present embodiment. The information system 1 includes a server device 11, one or more first terminal devices 12, and one or more second terminal devices 13.

  FIG. 2 is a block diagram of the information system 1 in the present embodiment. FIG. 3 is a block diagram of the first terminal device 12 constituting the information system 1.

  The server device 11 includes an object information storage unit 111, a second terminal information storage unit 112, a current second terminal information storage unit 113, a first terminal information reception unit 114, a current second terminal information reception unit 115, a distance calculation unit 116, The imaging | photography 2nd terminal determination part 117, the mobile body information acquisition part 118, and the mobile body information transmission part 119 are provided.

  The first terminal device 12 includes a reception unit 121, a camera unit 122, a first terminal information acquisition unit 123, a first transmission unit 124, a first reception unit 125, and an output unit 126.

  The first terminal information acquisition unit 123 includes first position information acquisition means 1231 and first direction information acquisition means 1232.

  The output unit 126 includes camera video output means 1261 and moving body information output means 1262.

  Furthermore, the second terminal device 13 includes a second terminal identifier storage unit 131, a second terminal information acquisition unit 132, and a second transmission unit 133.

  The object information storage unit 111 can store one or more pieces of object information. The object information is information having an object identifier and area information indicating an area where the object exists. An object is a geographic object that is usually an object that appears on a map or on a geography. An object is usually a non-moving object such as a store, a building, a mountain, a river, a scenic spot, or a park. The object may be, for example, a store or a company in a building. The content of the object is not limited as long as it appears on the map or the geography. The object information storage unit 111 may store map information. In such a case, the map information includes one or more object information. The object identifier is information for identifying an object, such as an object name, an ID for identifying the object, a URL of a web page in which information about the object is stored, a URI, and the like. The area information is usually information on a two-dimensional area. However, the region information may be three-dimensional region information or one-dimensional information (point information). That is, the area information may be position information (X, Y) that specifies the position (point) of the object. This (X, Y) is, for example, (latitude, longitude), and is information indicating the center of gravity of the object region, for example. When the area is a rectangle, the area information is, for example, information on position information (longitude, latitude) of the upper left point and lower right point of the rectangle. Furthermore, the area information includes, for example, a set of points (eight points) constituting the vertex of a three-dimensional object solid figure (for example, hexahedron) or four points having the height of the solid figure (for example, hexahedron). And so on. When the region information is information on a three-dimensional region, the region information usually includes two-dimensional region information indicating a two-dimensional region on the map and height information indicating the height of the object.

  The object information storage unit 111 is preferably a non-volatile recording medium, but can also be realized by a volatile recording medium.

  The process in which the object information is stored in the object information storage unit 111 does not matter. For example, object information may be stored in the object information storage unit 111 via a recording medium, and object information transmitted via a communication line or the like is stored in the object information storage unit 111. Alternatively, the object information input via the input device may be stored in the object information storage unit 111.

  The second terminal information storage unit 112 can store one or more pieces of second terminal information. The second terminal information includes a second terminal identifier for identifying the second terminal device 13 and mobile body information that is information regarding the mobile body. Here, the second terminal identifier is an ID, a telephone number, an IP address, a MAC address, or the like. In addition, when the moving body is a person, the moving body information includes, for example, a person's name, gender, age, contact information, and a person's blog URL. In addition, when the moving body is an automobile, the moving body information includes a name of the automobile, a manufacturer name, information on the owner of the automobile, a web page of the automobile manufacturer, and the like. However, the mobile body information may be anything as long as it is information about the mobile body or a person holding the mobile body.

  The second terminal information storage unit 112 is preferably a non-volatile recording medium, but can also be realized by a volatile recording medium. The process of storing the second terminal information in the second terminal information storage unit 112 does not matter. For example, the second terminal information may be stored in the second terminal information storage unit 112 via a recording medium, and the second terminal information transmitted from the second terminal device 13 via a communication line or the like. May be stored in the second terminal information storage unit 112, or the second terminal information input via the input device may be stored in the second terminal information storage unit 112. Good.

  The current second terminal information storage unit 113 can store one or more pieces of current second terminal information. The current second terminal information includes a second terminal identifier and second position information indicating the position of the second terminal device 13 that can be identified by the second terminal identifier. The current second terminal information includes information indicating the current position of the second terminal device 13. The current second terminal information may include information indicating the size of the second terminal device 13 and information on an area where the second terminal device 13 exists. The second position information is usually (latitude, longitude), but may be any information that specifies the position, such as relative coordinates (X, Y) on the map.

  The current second terminal information storage unit 113 is preferably a volatile recording medium, but can also be realized by a non-volatile recording medium.

  The first terminal information receiving unit 114 receives first terminal information from the first terminal device 12. The first terminal information includes first position information indicating the position of the first terminal device 12 and first direction information indicating a direction in which the first terminal device 12 is facing. The first terminal information preferably has a viewing angle. The first position information is usually (latitude, longitude) information, but may be information indicating a position in space. The information indicating the position in the space is, for example, (latitude, longitude, altitude). The direction information may include direction information such as east, west, south, and north. Further, the first direction information may include the terminal orientation (upward, downward, etc.). The first direction information is, for example, 56.2 ° (an orientation in which north is 0 ° and east is 90 °), south-southwest, and the like. The first direction information may include, for example, an angle in the height direction. The first direction information may be, for example, (Yaw, Pitch, Roll). “Yaw” of (Yaw, Pitch, Roll) is the angle with respect to the vertical axis and the degree of left and right shaking of the tip (length etc.), “Pitch” is the angle with respect to the horizontal axis and the degree of shaking of the tip up and down, “Roll” Is the angle with respect to the vertical axis and the degree of left and right shaking of the entire first terminal device 12. The first position information is acquired by, for example, a GPS receiver. The first direction information is acquired by, for example, a compass or a compass and a gyro. There is no limitation on the means for acquiring the first direction information and the first position information. Furthermore, the first terminal information preferably includes a terminal identifier for identifying the first terminal device 12 (for example, an IP address, a telephone number, an ID, a MAC address, etc. used for transmitting / receiving information). The first terminal information receiving unit 114 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast.

  The current second terminal information receiving unit 115 receives current second terminal information from the second terminal device 13 and at least temporarily accumulates it in the current second terminal information storage unit 113. Here, the current second terminal information includes the second terminal identifier of the second terminal device 13 and the second position information of the second terminal device 13 that can be identified by the second terminal identifier. The current second terminal information may include mobile information.

  The current second terminal information receiving unit 115 is normally realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast.

  The distance calculation unit 116 includes the distance between each object corresponding to one or more object information in the object information storage unit 111 and the first terminal device 12, and one or more current second terminal information in the current second terminal information storage unit 113. The distance between each second terminal device 13 and the first terminal device 12 corresponding to the position information of the object information and the first terminal information of each object, or the current second terminal information of each second terminal device 13 It calculates for every object or the 2nd terminal device 13 from the positional information which 1st terminal information has.

  Here, the distance may be the distance between the point of the center of gravity of the area and the position indicated by the first position information included in the first terminal information, or the first position included in any one of the areas and the first terminal information It may be a distance from the position indicated by the information, or a distance from a point in the region closest to the position indicated by the first position information included in the first terminal information. The distance may be a distance between a position indicated by the second position information included in the current second terminal information and a position indicated by the first position information included in the first terminal information.

  The distance calculation unit 116 can be usually realized by an MPU, a memory, or the like. The processing procedure of the distance calculation unit 116 is usually realized by software, and the software is recorded in a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

  The imaging second terminal determination unit 117 includes first position information included in the first terminal information, first direction information included in the first terminal information, and a viewing angle stored in advance or included in the first terminal information. One or more second terminal devices 13 captured by the first terminal device 12 are applied to the area information of each object information in the object information storage unit 111 and each current second terminal information in the current second terminal information storage unit 113. To decide. Here, the viewing angle is an angle at which the camera unit 122 can shoot, and may be an angle on a plane or a three-dimensional angle including a height direction. The three-dimensional angle is obtained, for example, by a plane angle (θ1) and a height direction angle (θ2). Moreover, the imaging | photography 2nd terminal determination part 117 may store beforehand the viewing angle, and may be contained in 1st terminal information. Here, “determining the second terminal device 13” may be to acquire a second terminal identifier, to acquire all or part of the second terminal information, For example, the record ID of the managed table may be acquired. That is, “determining the second terminal device 13” only needs to acquire information specifying the second terminal device 13. Note that the shooting second terminal determination unit 117 may determine the object being shot. The determination of an object is, for example, obtaining an object identifier.

  The imaging second terminal determination unit 117 uses the first position information and the first direction information included in the first terminal information and the viewing angle stored in advance or included in the first terminal information on the three-dimensional space. The imaging region is applied to the region information of each object information in the object information storage unit 111 and the current second terminal information of each second terminal device 13 of the current second terminal information storage unit 113, One or more objects captured by one terminal device 12 and one or more second terminal devices 13 may be determined. In such a case, the imaging second terminal determination unit 117 inspects the object and the second terminal device 13 in order of increasing distance from the first terminal device 12 when determining one or more second terminal devices 13. If the first terminal device 12 captures the object previously determined as being photographed and the information of the region that becomes invisible by the photographing of the second terminal device 13 are registered as an invisible region. The inspection of whether or not the second terminal device 13 is photographed by the first terminal device 12 is terminated.

  The imaging second terminal determination unit 117 assumes that the size of each second terminal device 13 is a predetermined size, first position information included in the first terminal information, and first direction information included in the first terminal information, , The viewing angle stored in advance or included in the first terminal information, the area information of each object information in the object information storage unit 111 and the current second terminal device 13 in the current second terminal information storage unit 113 It is preferable to determine one or more second terminal devices 13 that are applied to the terminal information and photographed by the first terminal device 12.

  In addition, the shooting second terminal determination unit inspects the object and the second terminal device 13 in order of increasing distance from the first terminal device 12, and selects one or more second terminal devices that the first terminal device 12 is shooting. It is preferable to determine.

  In addition, the shooting second terminal determination unit inspects the object and the second terminal device 13 in order of increasing distance from the first terminal device 12, and determines the object and the first determined as the first terminal device 12 shooting. Whether or not the object and the second terminal device 13 are photographed by the first terminal device 12 when the invisible region information is registered as an invisible region after the photographing of the two terminal device 13 is performed and the visible region disappears. It is preferable to end the inspection.

  In addition, the shooting second terminal determination unit 117 inspects the object and the second terminal device 13 in order of increasing distance from the first terminal device 12, and determines the object previously determined that the first terminal device 12 is shooting. Information on the area that becomes invisible by shooting is registered as an invisible area, and only objects that are objects in the visible area and whose distance from the first terminal device 12 is within the threshold and the second terminal device 13 are inspected, It is preferable to determine one or more second terminal devices 13 that are photographed by the first terminal device 12.

  Moreover, the imaging | photography 2nd terminal determination part 117 test | inspects an object and the 2nd terminal device 13 in order with the short distance from the 1st terminal device 12, and the 2nd terminal device which determined that the 1st terminal device 12 was image | photographing. It is preferable to end the inspection when the number 13 becomes a threshold value.

  The imaging second terminal determination unit 117 can be usually realized by an MPU, a memory, or the like. The processing procedure of the imaging second terminal determination unit 117 is usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

  The mobile body information acquisition unit 118 acquires one or more mobile body information corresponding to each of the one or more second terminal devices 13 determined by the imaging second terminal determination unit 117 from the second terminal information storage unit 112. The mobile body information acquisition unit 118 acquires, from the second terminal information storage unit 112, for example, one or more mobile body information that is paired with one or more second terminal identifiers acquired by the imaging second terminal determination unit 117. . The mobile body information acquisition unit 118 can usually be realized by an MPU, a memory, or the like. The processing procedure of the mobile body information acquisition unit 118 is usually realized by software, and the software is recorded in a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

  The mobile body information transmission unit 119 transmits one or more pieces of movement information acquired by the second terminal information acquisition unit 132 to the first terminal device 12.

  The mobile body information transmission unit 119 is usually realized by a wireless or wired communication unit, but may be realized by a broadcasting unit.

  The first terminal device 12 is a terminal equipped with a camera.

  The accepting unit 121 accepts user instructions and data. The instructions include, for example, an activation instruction for the first terminal device 12 and various instructions for the camera unit 122. In addition, the input means such as instructions and data may be anything such as a keyboard, mouse or menu screen. The accepting unit 121 can be realized by a device driver for input means such as a keyboard, control software for a menu screen, or the like.

  The camera unit 122 acquires a video. The camera unit 122 is a so-called camera. The camera unit 122 usually acquires an image currently displayed in the viewfinder. The camera unit 122 can be realized by a CCD camera, for example.

  The first terminal information acquisition unit 123 acquires first position information indicating the position of the first terminal device 12 and first direction information indicating the direction in which the first terminal device 12 is facing. The first terminal information acquisition unit 123 may acquire first terminal information including first position information, first direction information, and a viewing angle. In such a case, the first terminal information acquisition unit 123 stores the viewing angle in advance. The viewing angle has the same meaning as the viewing angle information. The viewing angle may be a two-dimensional angle or a three-dimensional angle. In addition, if the position, direction, and viewing angle of the first terminal device 12 (camera unit 122) are known, it is possible to know a region that can be photographed. That is, the first terminal information is information for specifying an area to be photographed by the camera unit 122. The area to be imaged is preferably a three-dimensional area, but may be a two-dimensional area.

  The first position information acquisition unit 1231 constituting the first terminal information acquisition unit 123 acquires position information indicating the position of the first terminal device 12. The first position information acquisition unit 1231 is configured by, for example, a GPS receiver. The first position information acquisition unit 1231 includes, for example, a radio wave reception unit and a processing unit (for example, an MPU or a memory) that acquires position information from the intensity of three or more radio waves received from three or more base stations. Etc.) may be configured. The method by which the first position information acquisition unit 1231 acquires the first position information does not matter. The first position information may be a two-dimensional position or a position in a three-dimensional space.

  The first direction information acquisition unit 1232 acquires first direction information indicating the direction in which the first terminal device 12 is facing. The first direction information may be information indicating a two-dimensional direction or information indicating a three-dimensional direction (including the vertical direction). The first direction information acquisition unit 1232 is realized by, for example, a compass. The first direction information acquisition unit 1232 is realized by, for example, a compass and a gyro.

  The first transmission unit 124 transmits the first terminal information acquired by the first terminal information acquisition unit 123 to the server device 11. The first transmission unit 124 is usually realized by wireless or wired communication means, but may be realized by broadcasting means.

  The first receiving unit 125 receives mobile information from the server device 11. The first receiving unit 125 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast.

  The output unit 126 outputs the video acquired by the camera unit 122. Further, the output unit 126 outputs the mobile body information received by the first receiving unit 125.

  Camera video output means 1261 constituting the output unit 126 outputs the video acquired by the camera unit 122.

  Moreover, the mobile body information output means 1262 outputs the mobile body information received by the first receiving unit 125. The moving body information output means 1262 preferably outputs the moving body information superimposed on the video acquired by the camera unit 122. In addition, it is preferable that the moving body information output unit 1262 outputs the moving body information in a manner in which the moving body information is associated with the moving body in the video acquired by the camera unit 122. Here, the “mode of associating with a moving object” means that the moving object and the moving object information are associated with each other by an arrow, the background color of the moving object information is the same as the background color of the moving object, and the like.

  The output is usually a display on a display, but projection using a projector, printing on a printer, sound output, transmission to an external device, accumulation in a recording medium, other processing devices and other It is a concept that includes delivery of processing results to a program or the like.

  The output unit 126 may or may not include an output device such as a display. The output unit 126 can be implemented by output device driver software, or output device driver software and an output device.

  The second terminal identifier storage unit 131 can store the second terminal identifier. The second terminal identifier is, for example, an ID, a telephone number, a MAC address, an IP address, or the like.

  The second terminal identifier storage unit 131 is preferably a nonvolatile recording medium, but can also be realized by a volatile recording medium. The process of storing the second terminal identifier in the second terminal identifier storage unit 131 does not matter.

  The second terminal information acquisition unit 132 acquires second terminal information having second position information indicating the position of the second terminal device 13. The second terminal information acquisition unit 132 is configured by a GPS receiver, for example. The second terminal information acquisition unit 132 is, for example, a wireless radio wave reception unit and a processing unit (eg, MPU or memory) that acquires position information from the intensity of three or more radio waves received from three or more base stations. Etc.) may be configured. It does not matter how the second terminal information acquisition unit 132 acquires the second position information. The second position information may be a two-dimensional position or a position in a three-dimensional space. The second terminal information acquisition unit 132 may configure current second terminal information using the second position information and the second terminal identifier.

  The second transmission unit 133 transmits current second terminal information including the second terminal identifier and the second terminal information acquired by the first terminal information acquisition unit 123 to the server device 11. The second transmission unit 133 is usually realized by a wireless or wired communication unit, but may be realized by a broadcasting unit.

  Next, the operation of the information system 1 will be described. First, operation | movement of the server apparatus 11 is demonstrated using the flowchart of FIG.

  (Step S <b> 401) The current second terminal information receiving unit 115 determines whether or not current second terminal information has been received from the second terminal device 13. If the current second terminal information is received, the process proceeds to step S402, and if not received, the process proceeds to step S403.

  (Step S402) The current second terminal information receiving unit 115 temporarily stores the current second terminal information received in step S401 in the current second terminal information storage unit 113. The process returns to step S401.

  (Step S <b> 403) The first terminal information receiving unit 114 determines whether or not the first terminal information has been received from the first terminal device 12. If the first terminal information is received, the process goes to step S404, and if the first terminal information is not received, the process returns to step S401.

  (Step S404) The imaging second terminal determination unit 117 uses the first terminal information received in Step S403 to obtain the position information and / or direction information of the first terminal information in each object information storage unit 111. This is applied to the area information of the object information and each current second terminal information stored in the current second terminal information storage unit 113, and the first terminal device 12 takes a picture (shown on the display of the first terminal device 12). 1) One or more second terminal devices 13 are determined. Such a process is called a photographing second terminal determination process. In addition, it is suitable for the imaging | photography 2nd terminal determination part 117 to determine the 1 or more 2nd terminal devices 13 which the 1st terminal device 12 image | photographs also using the viewing angle stored beforehand. In addition, the 2nd terminal device 13 which the 1st terminal device 12 image | photographed is also called imaging | photography 2nd terminal. The shooting second terminal determination process will be described with reference to the flowchart of FIG.

  (Step S405) The moving body information acquisition unit 118 substitutes 1 for a counter i.

  (Step S406) The moving body information acquisition unit 118 determines whether or not the i-th imaging second terminal device is present in the imaging second terminal device determined in step S404. If the i-th imaging second terminal device exists, the process proceeds to step S407, and if the i-th imaging second terminal device does not exist, the process proceeds to step S409.

  (Step S407) The mobile body information acquisition unit 118 acquires the mobile body information corresponding to the i-th imaging second terminal device from the second terminal information storage unit 112. In addition, the mobile body information acquisition unit 118 normally appends the acquired mobile body information to the buffer.

  (Step S408) The moving body information acquisition unit 118 increments the counter i by one. The process returns to step S406.

  (Step S409) The moving body information transmitting unit 119 determines whether or not the moving body information has been acquired in step S407. If moving body information can be acquired, it will go to step S410, and if moving body information cannot be acquired, it will return to step S401.

  (Step S410) The mobile body information transmitting unit 119 transmits the mobile body information acquired in Step S407 to the first terminal device 12. In addition, the mobile body information transmission part 119 may transmit that to the 1st terminal device 12, when mobile body information is not acquired. The process returns to step S401.

  In the flowchart of FIG. 4, the process ends when the power is turned off or the process ends.

  Further, in the flowchart of FIG. 4, one piece of mobile body information may be transmitted. That is, when there are a plurality of pieces of mobile body information, the mobile body information acquisition unit 118 selects mobile body information corresponding to the mobile body that is closest to the first terminal device 12, or the user instructs on the screen. The moving body information corresponding to the moving body may be selected. When the user instructs on the screen, the first terminal information includes the coordinate value on the screen instructed by the user, and the moving body information acquisition unit 118 uses the coordinate value to identify the moving body, and The mobile body information corresponding to the mobile body is selected. A technique for converting coordinate values on the screen into (latitude, longitude) is a known technique. That is, the mobile body information acquisition unit 118 converts the coordinate value on the screen into position information (latitude, longitude), and the mobile body (second terminal device 13) having the second position information that matches or is closest to the position information. ) Is selected.

  Next, the photographing second terminal determination process in step S404 will be described using the flowchart in FIG.

  (Step S501) The imaging second terminal determination unit 117 acquires the first position information included in the first terminal information received in Step S403.

  (Step S502) The imaging second terminal determination unit 117 acquires an angle at which no imaging is performed, using the first direction information included in the first terminal information received in Step S403 and the viewing angle. Then, the imaging second terminal determination unit 117 registers (records) the angle (the angle of the invisible region) in the recording medium. For example, when the first direction information is 90 degrees (for example, true east) and the viewing angle is 40 degrees, the captured angle is “70 degrees to 110 degrees”. Therefore, the imaging second terminal determination unit 117 registers “0 <= invisible region angle <70” and “110 <invisible region angle <= 360”. Here, the imaging second terminal determination unit 117 may acquire and register an imaging angle (visible region angle). That is, it is assumed that the registration of the angle of the visible region is equivalent to the registration of the angle of the invisible region.

  (Step S503) The imaging second terminal determination unit 117 uses the first position information acquired in Step S501, and in the order of the object closer to the first terminal device 12 or the second terminal device 13, the objects in the object information storage unit 111 The information and the current second terminal information in the current second terminal information storage unit 113 are sorted. Such a process is called an object sort process. Object sort processing will be described with reference to the flowchart of FIG.

  (Step S504) The second imaging terminal determination unit 117 substitutes 1 for the counter i.

  (Step S505) The imaging second terminal determination unit 117 includes the i-th object information or the second terminal information (hereinafter also referred to as “object etc.”) in the object information or the current second terminal information sorted in Step S503. ) Exists. If the i-th object or the like exists, the process goes to step S506, and if the i-th object or the like does not exist, the process returns to the upper process.

  (Step S506) The imaging second terminal determination unit 117 selects, from the sorted object information or second terminal information, area information or second position information (area information, etc.) included in the i-th object information or second terminal information. Get).

  (Step S507) The imaging second terminal determination unit 117 uses the first position information acquired in Step S501 and the region information or the second position information acquired in Step S505, and the i-th object or the second terminal device. 13 determines whether or not the image is displayed on the display of the first terminal device 12. Such a determination is referred to as a visual determination process. The visibility determination process will be described with reference to the flowcharts of FIGS. Note that an object shown on the display of the first terminal device 12 is called a shooting object, and the second terminal device 13 shown on the display of the first terminal device 12 is called a shooting second terminal. The shooting object and the shooting second terminal are also referred to as a shooting second terminal.

  (Step S508) If the result of determination in step S506 is that the i-th object or the second terminal device 13 is the second imaging terminal, the second imaging terminal determining unit 117 goes to step S509, and if it is not the second imaging terminal Go to step S510. In this step, if it is a shooting object, the process jumps to step S510.

  (Step S509) The imaging second terminal determination unit 117 stores at least the second terminal identifier of the i-th second terminal device 13 in a storage medium (not shown).

  (Step S510) The imaging second terminal determination unit 117 determines whether or not a visible area exists from the registered invisible area or visible area. If the visible area exists, the process goes to step S511, and if not, the process returns to the upper process. Such determination may be performed in a two-dimensional plane or may be performed in a three-dimensional space.

  (Step S511) The imaging second terminal determination unit 117 increments the counter i by one. The process returns to step S505.

  In the flowchart of FIG. 5, the angle of the invisible region is registered. However, the angle of the visible region may be registered, and only an object that falls within this angle may be processed.

  Further, in step S510 of the flowchart of FIG. 5, the imaging second terminal determination unit 117 determines the order of the distance from the first terminal device 12 (the range of objects or the set of second terminal devices 13 in which the range or angle is divided). The object inspected in the order in which the first terminal device 12 is photographing, and the information of the object that has been previously determined as being photographed by the first terminal device 12 or the region that becomes invisible by the photographing of the second terminal device 13 is defined as the invisible region. Registration is completed, and when the visible area disappears (same meaning as when all become invisible areas), the inspection of whether the object or the second terminal device 13 is photographed by the first terminal device 12 ends. Explained what to do.

Specifically, the process of step S510 is as follows. That is, the imaging second terminal determination unit 117 inspects objects and the like in the order from the first terminal device 12, and determines the object previously determined that the first terminal device 12 is imaging or the second terminal device 13 (second Information of a region that becomes invisible by photographing of the terminal (usually a minimum angle (θ ₁ ) and a maximum angle (θ ₂ ) described later) is registered as an invisible region, and the second terminal to be inspected next Whether or not the first terminal device 12 obtains information on the region that becomes an invisible region, and whether or not all the regions specified by the minimum angle (θ ₃ ) and the maximum angle (θ ₄ ) have already been registered as invisible regions. If it is not registered as an invisible region, it is determined that the second terminal to be inspected next is taken by the first terminal device 12, and the minimum angle (θ ₃ ) and the maximum angle (θ ₄ ) are used. The process of registering the specified area as an invisible area is repeated, and when all areas of the viewing angle included in the first terminal information become invisible areas, the inspection of the second terminal or the like is terminated.

  Further, in the flowchart of FIG. 5, when the visible region is no longer present, the detection process of the second terminal being photographed is terminated. However, when the second terminal devices 13 in the visible region are found by the number of thresholds, the second terminal device 13 that matches a predetermined condition (for example, a moving object designated by the user, a specific moving object, etc.). When the object is detected, the object detection process may be terminated depending on other conditions, such as only the second terminal device 13 within a predetermined distance from the distance of the first terminal device 12 being the inspection target.

  Next, the object sort processing in step S503 will be described with reference to the flowchart of FIG.

  (Step S601) The distance calculation unit 116 substitutes 1 for the counter i.

  (Step S602) The distance calculation unit 116 determines whether the i-th object information or current second terminal information exists in the object information storage unit 111 and the current second terminal information storage unit 113. If the i-th object information exists, the process goes to step S603, and if the i-th object does not exist, the process goes to step S607. The distance calculation unit 116 first processes the object information in the object information storage unit 111 sequentially, and after the processing of the object information in the object information storage unit 111 is completed, the current calculation in the current second terminal information storage unit 113 is performed. The second terminal information is sequentially processed.

  (Step S603) The distance calculation unit 116 acquires position information (region information or second position information) included in the i-th object information or the like from the object information storage unit 111 or current second terminal information. Note that the position information included in the i-th object information or the like is included in the i-th object information or the current second terminal information.

  (Step S604) The distance calculation unit 116 calculates the distance between the point indicated by the first position information included in the first terminal information and the point indicated by the position information acquired in Step S603. Note that the position information acquired in step S603 is, for example, a representative point of region information (for example, position information of a point closest to the center of gravity or the first position information).

  (Step S605) The distance calculation unit 116 pairs the distance acquired in Step S604 and the object information (or part of the information) of the i-th object and temporarily stores them in a recording medium (not shown). The distance calculation unit 116 also temporarily stores the distance acquired in step S604 and the i-th current second terminal information (or a part of the information) in a pair on a recording medium (not shown).

  (Step S606) The distance calculation unit 116 increments the counter i by one. The process returns to step S602.

  (Step S607) The photographing second terminal determination unit 117 sorts the object information or the current second terminal information in the order of the closer (smaller) distance using the distance as a key. Return to upper process. The object information or current second terminal information to be sorted may be a part of the object information or current second terminal information.

  Next, the visibility determination process in step S506 will be described with reference to the flowchart in FIG. The visibility determination process here is a first visibility determination process. The first visibility determination process determines whether the object or the second terminal device 13 is output on the display of the first terminal device 12 using only the planar information of the object and the second terminal device 13. It is processing.

  (Step S701) The second imaging terminal determination unit 117 substitutes 1 for a counter i.

  (Step S702) The imaging second terminal determination unit 117 determines whether or not the i-th point exists in the area information or current second terminal information of the object to be determined. If the i-th point exists, the process goes to step S703, and if the i-th point does not exist, the process goes to step S705. The region information is assumed to be composed of points indicating the outer shape, for example. The points indicating the outer shape include four points if the region indicated by the region information is a tetragon, and eight points if the region is an octagon. The point is usually indicated by (latitude, longitude) or (x coordinate, y coordinate).

  (Step S703) The imaging second terminal determination unit 117 calculates an angle (θ) between the i-th point and the first position information (first position information included in the first terminal information), and uses the angle (θ). Temporarily store in buffer. The reference for the angle (θ) is, for example, true north. However, the standard only needs to be constant and is not necessarily true north. The first position information is information indicating the position of the first terminal device 12.

  (Step S704) The second imaging terminal determination unit 117 increments the counter i by 1. The process returns to step S702.

(Step S705) The imaging second terminal determination unit 117 acquires the minimum angle (θ ₁ ) and the maximum angle (θ ₂ ) from the angle (θ) temporarily stored in the buffer in Step S703. Note that if there is one angle (θ) temporarily stored in the buffer in step S703, the second imaging terminal determination unit 117 acquires the one angle.

(Step S706) The imaging second terminal determination unit 117 determines whether or not all the areas of the minimum angle (θ ₁ ) and the maximum angle (θ ₂ ) acquired in step S705 are already registered angles. Judging. If it is an area of an already registered angle, go to step S710, and if it does not include any of the already registered angle areas, go to step S707. If there is one angle acquired in step S705, the second imaging terminal determination unit 117 determines whether or not the angle is an already registered angle region.

  (Step S707) The shooting second terminal determination unit 117 determines that this object or the second terminal device 13 is shot. As the return value, for example, information (for example, “1”) indicating that it is a shooting object or a shooting second terminal is substituted.

(Step S708) Since the imaging second terminal determination unit 117 determines that this object or the second terminal device 13 is the imaging object, in addition to the angle currently registered as the invisible region, the minimum angle (θ ₁ ) And the angle width (region) where the region of the maximum angle (θ ₂ ) is the invisible region is acquired. For example, when “30 to 40 degrees” is currently registered, the minimum angle (θ ₁ ) is 35 degrees, and the maximum angle (θ ₂ ) is 45 degrees, the second imaging terminal is determined. The unit 117 acquires “30 degrees to 45 degrees”. Also, for example, when “30 to 40 degrees” is currently registered, the minimum angle (θ ₁ ) is 55 degrees, and the maximum angle (θ ₂ ) is 60 degrees, “55 to 60 degrees”. Get "degree".

  (Step S709) The second imaging terminal determination unit 117 registers the angle acquired in step S708. For example, in the above, “30 degrees to 45 degrees” is overwritten with the information “30 degrees to 40 degrees”. For example, in the above, “55 degrees to 60 degrees” is additionally written. Return to upper process. At this time, a return value (a value indicating the shooting object) is also returned.

  (Step S710) The shooting second terminal determination unit 117 determines that the shooting second terminal determination unit 117 has not shot the object or the second terminal device 13. Information (for example, “0”) indicating that the object is a non-photographing object or a non-photographing second terminal is substituted as a return value. Return to upper process. At this time, a return value (a value indicating a non-photographing object or a non-photographing second terminal) is also returned.

  Next, the visibility determination process in step S506 will be described with reference to the flowchart in FIG. The visibility determination process here is a second visibility determination process. In the second visibility determination process, the object or the second terminal device 13 is output to the display of the first terminal device 12 using the three-dimensional information of the object or the three-dimensional information of the object and the second terminal device 13. This is a process of determining whether or not the In the flowchart of FIG. 8, the description of the same steps as those of the flowchart of FIG. 7 is omitted.

(Step S801) The imaging second terminal determination unit 117 calculates an angle (θ _h ) in the height direction between the i-th point (x1, y1, z1) and the first position information (x0, y0, z0). Store it in the buffer.

(Step S802) The second imaging terminal determination unit 117 acquires the angle (θ ₃ ) in the height direction from the viewpoint (position information). θ ₃ is the maximum angle among θ _h stored in step S801.

(Step S < _b > 803) Whether the second imaging terminal determining unit 117 has already registered an angle greater than the angle (θ ₃ ) in the height direction in the region of the minimum angle (θ ₁ ) and the maximum angle (θ ₂ ). Judge whether or not. If it is registered, the process goes to step S710, and if not registered, the process goes to step S707. If an angle equal to or greater than the angle (θ ₃ ) in the height direction has already been registered, this indicates that the target object or the second terminal device 13 is in an invisible region and is not a shooting object or a shooting second terminal.

(Step S804) Since the imaging second terminal determination unit 117 determines that the object or the second terminal device 13 is the imaging second terminal or the like, in addition to the angle currently registered as the invisible region, the minimum angle (θ ₁ ) and the angle width (region) where the planar region of the maximum angle (θ ₂ ) is the invisible region is acquired. For example, when “30 to 40 degrees” is currently registered, the minimum angle (θ ₁ ) is 35 degrees, and the maximum angle (θ ₂ ) is 45 degrees, the second imaging terminal is determined. The unit 117 acquires “30 degrees to 45 degrees”.

(Step S805) The imaging second terminal determination unit 117 acquires the angle (θ ₃ ) in the height direction because the object or the second terminal device 13 is the imaging second terminal or the like. For example, when the height angle “30 degrees” is registered in the plane area of the minimum angle (θ ₁ ) and the maximum angle (θ ₂ ), the acquired angle in the height direction (θ ₃ ) Is “35 degrees”, “35 degrees” is acquired.

(Step S806) The imaging second terminal determination unit 117 associates the angle of the planar area (for example, “30 degrees to 45 degrees”) acquired in Step S804 with the angle in the height direction (for example, “35 degrees”). Add and register (register). Return to upper process. At this time, a return value is also returned. Note that the imaging second terminal determination unit 117 determines that the angle in the height direction currently registered as the invisible area is the angle in the height direction in the plane area of the minimum angle (θ ₁ ) and the maximum angle (θ ₂ ). (theta ₃₎ determines the whether or, if the height direction of the angle (theta ₃₎ above, do not accumulate angle (theta ₃₎ in the height direction.

  Next, operation | movement of the 1st terminal device 12 is demonstrated using the flowchart of FIG.

  (Step S901) The reception unit 121 determines whether an instruction or the like has been received. If an instruction or the like is accepted, the process goes to step S902. If an instruction or the like is not accepted, the process returns to step S901.

  (Step S902) The receiving unit 121 determines whether or not the instruction received in step S901 is a start instruction. If it is an activation instruction, the process proceeds to step S903, and if it is not an activation instruction, the process proceeds to step S911. The activation instruction is an instruction to activate the first terminal device 12.

  (Step S903) The camera unit 122 acquires a camera video.

  (Step S904) The camera video output means 1261 of the output unit 126 outputs the video acquired by the camera unit 122.

  (Step S905) The first position information acquisition unit 1231 of the first terminal information acquisition unit 123 acquires first position information indicating the position of the first terminal device 12.

  (Step S906) The first direction information acquisition unit 1232 acquires first direction information indicating the direction in which the first terminal device 12 is facing.

  (Step S907) The 1st terminal information acquisition part 123 comprises the 1st terminal information which has the 1st position information acquired at Step S905, and the 1st direction information acquired at Step S906. In addition, it is suitable for the 1st terminal information acquisition part 123 to comprise the 1st terminal information containing the viewing angle stored beforehand.

  (Step S908) The first transmission unit 124 transmits the first terminal information (usually the latest first terminal information) configured in Step S907 to the server device 11.

  (Step S909) The first reception unit 125 determines whether or not one or more pieces of mobile body information have been received in response to the transmission of the first terminal information. If moving body information is received, it will go to step S910, and if moving body information is not received, it will return to step S909. Here, it is preferable to return to step S901 if the mobile object information is not received for a certain time or longer.

  (Step S910) The output unit 126 outputs one or more pieces of mobile body information received in step S912. The process returns to step S901.

  In addition, when there is no mobile information, it is preferable that the output unit 126 does not output anything. Further, the output unit 126 outputs, for example, one or more pieces of moving body information to an area other than the area on the camera, and an object on the camera image corresponding to the one or more pieces of moving body information is set as another object. It is preferable to output in a visually distinguishable manner.

  (Step S911) The receiving unit 121 determines whether or not another instruction has been received from the user. If any other instruction is accepted, the process goes to step S912. If no other instruction is accepted, the process returns to step S901.

  (Step S912) Means (not shown) perform operations corresponding to other instructions. The process returns to step S901.

  In the flowchart of FIG. 9, the process is terminated by power-off or a process termination interrupt.

  In the flowchart of FIG. 9, the first terminal information may be transmitted to the server device 11 according to a user instruction.

  Next, the operation of the second terminal device 13 will be described. The second terminal information acquisition unit 132 of the second terminal device 13 reads the second terminal identifier of the second terminal identifier storage unit 131. Then, the second terminal information acquisition unit 132 acquires second position information. Next, the 2nd terminal information acquisition part 132 comprises the current 2nd terminal information which has a 2nd terminal identifier and 2nd position information. Next, the second transmission unit 133 transmits the current second terminal information to the server device 11. Note that the current second terminal information may include information that the user of the second terminal device 13 thinks may be disclosed to a third party. Such information is referred to as second terminal public information. The second terminal public information is stored in advance in the second terminal information acquisition unit 132, for example. The second terminal public information may be anything such as the name and age of the user of the second terminal device 13, for example.

  Note that the second terminal device 13 may directly transmit the second terminal public information (mobile information) to the first terminal device 12. In such a case, the first terminal device 12 receives the second terminal identifier and the moving body information from the second terminal device 13 and corresponds to the second terminal identifier that identifies the second imaging terminal received from the server device 11. Select and output moving body information.

  Hereinafter, a specific operation of the information system 1 in the present embodiment will be described. A conceptual diagram of the information system 1 is shown in FIG. In the information system 1, it is possible to display information related to the moving body (second terminal device 13) included in the image captured by the camera.

Hereinafter, the information system 1 will be described using two specific examples. In the first specific example, the second terminal device 13 included in the captured video is recognized in consideration of only planar information such as the object without considering the object or the height of the second terminal device 13. In this mode, information on the second terminal device 13 is output. The specific example 2 is the height of the object and the second terminal device 13 (only the height of the object may be used. That is, the object considers the height and the height of the second terminal device 13 does not need to be considered). This is a mode in which the second terminal device 13 included in the captured video is recognized and information related to the second terminal device 13 is output.
(Specific example 1)

  Now, the object information storage unit 111 of the server apparatus 11 holds the object information management table shown in FIG. The object information management table is a table that manages object information on the map. The object information management table manages one or more records having attribute values such as “object identifier”, “object name”, “location information”, and “region information”. Here, the “object identifier” is an ID of an object. “Object name” indicates the name of the object. “Position information” is information for specifying the position of an object, and here is (latitude, longitude). “Area information” is information indicating a two-dimensional area in which an object is arranged, and here indicates three or more vertices of an object that is a polygon. The vertex is also (latitude, longitude) here.

  Here, the first terminal device 12 is assumed to be a terminal having two displays. The first terminal device 12 may be a terminal having one display or a terminal having three or more displays.

  The second terminal information storage unit 112 of the server device 11 holds a second terminal information management table shown in FIG. The second terminal information management table holds one or more records having “second terminal identifier” and “mobile object information”. “Moving object information” has attribute values such as “name”, “age”, and “sex”.

Then, it is assumed that the second terminal information acquisition unit 132 of the second terminal device 13 held by a certain person “ABC” acquires the second position information (X ₂₁ , Y ₂₁ ). Next, the second terminal information acquisition unit 132 reads the second terminal identifier “090144445111” from the second terminal identifier storage unit 131. Then, the second terminal information acquisition unit 132 configures current second terminal information “090144445111, (X ₂₁ , Y ₂₁ )”.

Next, the second transmission unit 133 transmits the current second terminal information “090144445111, (X ₂₁ , Y ₂₁ )” to the server device 11. It is assumed that the second transmission unit 133 holds information for communicating with the server device 11 (for example, the IP address of the server device 11) in advance.

  The second terminal device 13 configures current second terminal information and transmits it to the server device 11 periodically (for example, once / second).

Next, the current second terminal information receiving unit 115 of the server device 11 receives the current second terminal information “090144445111, (X ₂₁ , Y ₂₁ )”. Then, the current second terminal information reception unit 115 temporarily stores the received current second terminal information “090144445111, (X ₂₁ , Y ₂₁ )” in the current second terminal information storage unit 113.

  Then, it is assumed that the user has activated the first terminal device 12. Then, the reception unit 121 receives an activation instruction. And the camera part 122 acquires a camera image | video. Then, the camera video output unit 1261 of the output unit 126 outputs the video acquired by the camera unit 122. Then, as shown in FIG. 12, an image of the outside world is output to the first display (upper display) of the first terminal device 12. In FIG. 12, the moving body is a person. In FIG. 12, the person holds the second terminal device 13. The second terminal identifier “090144445111” is stored in the second terminal identifier storage unit 131 of the second terminal device 13. That is, the person shown is “ABC”.

  Next, the user thinks that the person shown has been seen somewhere, and the mobile terminal information acquisition instruction, which is an instruction to acquire the person's information, is input to the first terminal device 12. And

  Next, the reception unit 121 receives a moving body information acquisition instruction. The moving body information acquisition instruction includes the instructed coordinate information (x1, y1). Then, the first position information acquisition unit 1231 of the first terminal information acquisition unit 123 acquires first position information (X, Y) indicating the position of the first terminal device 12 and coordinate information (x1, y1).

  Next, the first direction information acquisition unit 1232 acquires first direction information (θA) indicating a direction in which the first terminal device 12 is facing. The first direction information (θA) indicates, for example, a clockwise angle from true north (90 degrees for true east).

  In addition, the first terminal information acquisition unit 123 reads information on the viewing angle of the camera unit 122 (simply referred to as “viewing angle”). Here, it is assumed that the viewing angle is “θa”. The camera unit 122 stores a viewing angle “θa” in advance. And

  Next, the first terminal information acquisition unit 123 acquires the acquired first position information (X, Y), coordinate information (x1, y1), acquired first direction information (θx), and viewing angle (θa). The first terminal information (X, Y, x1, y1, θA, θa) is configured.

  Next, the first transmission unit 124 transmits the configured first terminal information (X, Y, x1, y1, θA, θa) to the server device 11.

  Next, the first terminal information receiving unit 114 of the server device 11 receives the first terminal information (X, Y, x1, y1, θA, θa) from the first terminal device 12.

  Next, the shooting second terminal determination unit 117 determines a shooting object as follows. That is, the imaging second terminal determination unit 117 acquires the first position information (X, Y) included in the received first terminal information.

  Next, the imaging second terminal determination unit 117 calculates an angle that becomes an invisible region by using the direction information (θA) and the viewing angle (θa) included in the terminal information. The imaging second terminal determination unit 117 determines “(θA− (θa / 2)) <= visible region <= (θA + (θa / 2))” as an angle that becomes the visible region. Then, the angle excluding the visible region is calculated and stored as the invisible region angle. Such a concept is shown in FIG. When the visible region does not cross the true north line, the invisible region angle is “0 <= invisible region angle <(θA− (θa / 2))” and “(θA + (θa / 2)) <invisible region. Angle <= 360 ”. When the visible region extends across the true north line, the invisible region angle is “(θA + (θa / 2)) <invisible region angle <(θA− (θa / 2))”.

  Then, the distance calculation unit 116 calculates the distance between the first terminal device 12 and each object or the second terminal device 13 using the first position information (X, Y) of the first terminal device 12. Then, the shooting second terminal determination unit 117 uses the distance calculated by the distance calculation unit 116, in order of the object closer to the first terminal device 12 or the second terminal device 13, in the order of the object information and the second information. Sort the two-terminal information. The sort process is performed by the process described with reference to FIG. As a result of the sorting process, for example, the second imaging terminal determination unit 117 acquires a temporary management table such as an object as shown in FIG. Each record of the temporary management table such as an object has an “identifier”, a “distance”, and a “flag”. The distance is the distance between the point indicated by the first position information (X, Y) and the point indicated by the position information of the object or the second terminal device 13. The identifier is an object identifier or a second terminal identifier. The flag is information for distinguishing whether the record in the temporary management table such as an object is object information or second terminal device 13 information. The flag is “0” when the information is object information, and the flag is “1” when the information is information on the second terminal device 13. In addition, the imaging second terminal determination unit 117 substitutes “0” for the flag when the position information to be used is acquired from the object information storage unit 111 during the sorting process, and the current second terminal information storage unit If acquired from 113, “1” is substituted into the flag.

  Next, the shooting second terminal determination unit 117 determines whether or not the shooting is performed from a higher-order record in the temporary management table such as an object.

That is, the imaging second terminal determination unit 117 reads the identifier “1” of the first record in the temporary management table for objects and the like. Then, using the identifier “1” as a key, the object information management table or the current second terminal information storage unit 113 is searched, and the region information “(x ₁ , y ₁ ) (x ₂ , y ₂ ) (x ₃ , y ₃ ) (x ₄ , y ₄ ) ”.

Next, the imaging second terminal determination unit 117 receives the received first terminal information (X, Y, x1, y1, θA, θa) and the acquired area information “(x ₁ , y ₁ ) (x ₂ , y ₂ ) (x ₃ , y ₃ ) (x ₄ , y ₄ ) ”is used to determine whether or not the first object or the second terminal device 13 is a shooting object or the like.

First, the imaging second terminal determination unit 117 acquires the _first point (x ₁ , y ₁ ) in the area information of the object or the like to be determined (the object with the identifier “1”).

Next, the imaging second terminal determination unit 117 calculates an angle (θ1) between the first point (x ₁ , y ₁ ) and the first position information (X, Y), and buffers the angle (θ1). Temporarily store. Similarly, the second imaging terminal determination unit 117 determines each point from the second point to the first position information (X) in the area information of the object to be determined (the object with the identifier “1”, etc.). , Y) and angles (θ2, θ3, θ4) are calculated, and the angles (θ2, θ3, θ4) are also temporarily stored in the buffer. (Θ1, θ2, θ3, θ4) is stored in the buffer.

  Next, the imaging second terminal determination unit 117 calculates the minimum angle (for example, (θ1)) and the maximum angle (for example, (θ4)) from the angles (θ1, θ2, θ3, θ4) temporarily stored in the buffer. To get.

  Next, the imaging second terminal determination unit 117 determines that all the acquired areas of the minimum angle (θ1) and the maximum angle (θ4) are the already registered angle areas (“(θA− (θa / 2)) < = Visible region <= (An angle excluding (θA + (θa / 2)) ”). Here, it is assumed that the imaging second terminal determination unit 117 determines that the acquired area of the minimum angle (θ1) and the maximum angle (θ4) is a visible area. Then, the second shooting terminal determination unit 117 determines that the object with the identifier “1” is a shooting object.

  Next, the imaging second terminal determination unit 117 sets “θ1 <= invisible region <= θ4” as a new invisible region. That is, the imaging second terminal determination unit 117, for example, “0 <= invisible region angle <(θA− (θa / 2))” and “(θA + (θa / 2)) <invisible region angle <= 360”. The invisible area angle obtained by merging “θ1 <= invisible area <= θ4” is registered in the recording medium. Here, merging means adding “θ1 <= invisible region <= θ4” to the invisible region so far, and the invisible region so far may include “θ1 <= invisible region <= θ4”. Yes, sometimes not included. Here, the imaging second terminal determination unit 117 may store the identifier “1” of the first object in a storage medium (not shown).

  Next, the imaging second terminal determination unit 117 determines that a visible area exists from the registered invisible area or visible area.

Next, the imaging second terminal determination unit 117 acquires the second identifier “090144445111” of the temporary object management table, and searches the object information management table using the identifier “090144445111” as a key, but acquires information. Can not. Next, the imaging second terminal determination unit 117 searches the current second terminal information storage unit 113 using the identifier “090144445111” as a key. Then, the imaging second terminal determination unit 117 acquires the second position information (X ₂₁ , Y ₂₁ ) paired with the identifier “090144445111” from the current second terminal information storage unit 113.

Next, photographing the second terminal determining unit 117 uses the received terminal information (X, Y, x1, y1 , θA, θa) and, the obtained second position information _{(X 21, Y 21),} It is determined whether or not the second terminal device 13 identified by the second identifier “090144445111” is the imaging second terminal.

First, the imaging second terminal determination unit 117 acquires second position information (X ₂₁ , Y ₂₁ ) of the second terminal device 13 to be determined.

Next, the imaging second terminal determination unit 117 calculates an angle (θ101) between the second position information (X ₂₁ , Y ₂₁ ) and the first position information (X, Y), and buffers the angle (θ101). Temporarily store. Then, (θ101) is stored in the buffer. Here, the second terminal information of the second terminal device 13 has only one point of information here, but may have information of two or more points (region information).

  Next, the imaging second terminal determination unit 117 determines whether or not the acquired angle (θ101) is an area of an already registered angle. Then, it is assumed that the imaging second terminal determination unit 117 determines that the angle (θ101) is an angle region that has not been registered. Therefore, the imaging second terminal determination unit 117 determines that the second terminal device 13 with the identifier “090144445111” is the imaging second terminal.

  Next, the mobile body information acquisition unit 118 stores the mobile body information “name: ABC, age: 29, gender: male...” Corresponding to the imaging second terminal device “090144445111” in the second terminal information storage unit. 112.

  It is preferable that the imaging second terminal determination unit 117 does not register an area that is invisible in the second terminal device 13. This is because the second terminal device 13 is a moving body and is expected to move constantly.

  Next, the second imaging terminal determination unit 117 stores the identifier “090144445111” in a storage medium (not shown).

  The above processing is repeated for the third and subsequent objects or the second terminal device 13. Assume that only mobile information corresponding to the identifier “090144445111” is obtained.

  Next, the mobile body information transmitting unit 119 transmits the acquired mobile body information “name: ABC, age: 29, gender: male...” To the first terminal device 12.

  Next, the 1st receiving part 125 of the 1st terminal device 12 receives mobile body information "name: ABC, age: 29, sex: male ..." corresponding to transmission of 1st terminal information. .

  Then, the output unit 126 outputs the received mobile body information “name: ABC, age: 29, gender: male...”. For example, the output unit 126 outputs moving body information as shown in FIG.

  In FIG. 15, the moving body information is output to a different display independently of the camera image. However, as illustrated in FIG. 16, it is preferable that the output unit 126 superimposes the moving body information on the video acquired by the camera unit 122 and outputs it. In such a case, the means (conversion means) (not shown) of the server device 11 or the first terminal device 12 uses the second position information (for example, (latitude, longitude)) included in the second terminal information as the first terminal device 12. It is necessary to convert to coordinate information (relative coordinate information) on the display. In other words, the conversion means calculates the second position information (for example, (latitude, longitude)) and the first terminal information (first position information (for example, (latitude, longitude)), viewing angle, resolution, etc.) from the second position information. Relative coordinates on the display of the first terminal device 12 corresponding to the position information are calculated. Then, the output unit 126 outputs moving body information in association with the second terminal device 13 shown in the relative coordinates on the display. The technique for calculating the relative coordinates on the display from the position information (latitude, longitude) is a known technique possessed by navigation terminals and the like, and thus detailed description thereof is omitted. In addition, when the server apparatus 11 calculates a relative coordinate, a relative coordinate shall be contained in the mobile body information transmitted to the 1st terminal device 12 from the server apparatus 11. FIG.

  In FIG. 15, the output unit 126 may output moving body information at the position of the coordinate information (x1, y1).

  In the above description, the server device 11 may select only the moving body information about the moving body corresponding to the position of the coordinate information (x1, y1), and the first terminal device 12 may output the moving body information.

Furthermore, in the above, when a plurality of pieces of mobile body information are received, only the mobile body information of the second terminal device 13 that is closest to the second terminal device 13 may be output. Moreover, you may output only the mobile body information of the 2nd terminal device 13 which exists in the center part of the 2nd terminal device 13 most.
(Specific example 2)

  Now, the object information storage unit 111 of the server apparatus 11 holds the object information management table shown in FIG. The object information management table is a table that manages object information on the map. The object information management table manages one or more records having attribute values such as “object identifier”, “object name”, “location information”, and “region information”. 17, the difference from the object information management table of FIG. 10 is that each point constituting the area information has height information (z).

  The first terminal device 12 is a terminal having two displays.

  The second terminal information storage unit 112 of the server device 11 holds a second terminal information management table shown in FIG. The second terminal information management table holds one or more records having “second terminal identifier” and “mobile object information”. “Moving object information” has attribute values such as “name”, “age”, and “sex”.

  In this case, it is assumed that the user has activated the first terminal device 12. Then, the reception unit 121 receives an activation instruction. And the camera part 122 acquires a camera image | video. Then, the camera video output unit 1261 of the output unit 126 outputs the video acquired by the camera unit 122. Then, as shown in FIG. 18, an image of the outside world is output to the first display (upper display) of the first terminal device 12. In FIG. 18, reference numeral 1801 denotes a car, and the second terminal device 13 is mounted on the car 1801. The second terminal device 13 is, for example, a navigation terminal. The second terminal identifier “1866.11.251.1” is stored in the second terminal identifier storage unit 131 of the second terminal device 13.

The second terminal information acquisition unit 132 of the second terminal device 13 acquires the second position information (X ₂₂ , Y ₂₂ ). Next, the second terminal information acquisition unit 132 reads the second terminal identifier “1866.11.251.1” from the second terminal identifier storage unit 131. Then, the second terminal information acquiring unit 132, a current second terminal information _{"186.11.251.1, (X 22, Y 22} ) " constitutes a.

Next, the second transmission unit 133 transmits the current second terminal information “1866.11.251.1, (X ₂₂ , Y ₂₂ )” to the server device 11. It is assumed that the second transmission unit 133 holds information for communicating with the server device 11 (for example, the IP address of the server device 11) in advance.

  The second terminal device 13 configures current second terminal information and transmits it to the server device 11 periodically (for example, once / second).

Next, the current second terminal information receiving unit 115 of the server apparatus 11 receives the current second terminal information “1866.11.251.1, (X ₂₂ , Y ₂₂ )”. The current second terminal information receiving unit 115 temporarily accumulates the received current second terminal information “1866.11.251.1, (X ₂₂ , Y ₂₂ )” in the current second terminal information storage unit 113. .

  Next, the first location information acquisition unit 1231 (here, for example, a GPS receiver) of the first terminal information acquisition unit 123 of the first terminal device 12 receives the first location information (X, Y) of the first terminal device 12. , Z). Z is the height.

  Next, the first direction information acquisition unit 1232 acquires first direction information (θA, θB) indicating the direction in which the first terminal device 12 is facing. θA is an angle on a plane, and θB is an angle in the height direction. The direction information (θA) indicates, for example, a clockwise angle from true north (90 degrees for true east).

  In addition, the first terminal information acquisition unit 123 reads information on the viewing angle of the camera unit 122 (simply referred to as “viewing angle”). Here, it is assumed that the viewing angles are (θa, θb). The camera unit 122 stores the viewing angles (θa, θb) in advance. Here, θa is an angle on the plane, and θb is an angle in the height direction. Viewing angles (θa, θb) are shown in FIG.

  Next, the first terminal information acquisition unit 123 has the acquired first position information (X, Y, Z), the acquired first direction information (θA, θB), and the viewing angle (θa, θb). First terminal information (x, y, z, θx, θy, θa, θb) is configured.

  Then, the first terminal information receiving unit 114 of the server device 11 receives the first terminal information (X, Y, Z, θA, θB, θa, θb) from the first terminal device 12.

  Next, the second imaging terminal determination unit 117 of the server device 11 determines the second imaging terminal as follows. That is, the imaging second terminal determination unit 117 acquires position information (X, Y, Z) included in the received first terminal information.

  Next, the imaging second terminal determination unit 117 calculates a three-dimensional angle that becomes an invisible region using the first direction information (θA, θB) and the viewing angle (θa, θb) included in the terminal information. The imaging second terminal determination unit 117 acquires a two-dimensional angle “(θA− (θa / 2)) <= visible region <= (θA + (θa / 2))” that becomes a visible region. Then, the imaging second terminal determination unit 117 acquires the angle “(θB− (θb / 2)) <= visible region <= (θB + (θb / 2))” that becomes the visible region. Then, the area that is not the visible area is accumulated as an invisible area.

Then, the imaging second terminal determination unit 117 uses the acquired first position information (X, Y, Z) in the order of objects closer to the first terminal device 12, the object information in the object information storage unit 111 and the second information. Sort terminal information. The sort process is performed by the process described with reference to FIG. Here, (X, Y) of the position information (X, Y, Z) and the position information of each object or the second position information included in the second terminal information (for example, (x _a , y _a )) ) Is used to calculate the distance between the first terminal device 12 and each object, and the distance is sorted as a key. Then, as a result of the sorting process, the second imaging terminal determination unit 117 acquires a temporary management table such as an object as shown in FIG. Each record of the temporary management table such as an object has an object identifier, a distance, and a flag. The distance is a distance between a point indicated by the position information (X, Y, Z) (however, Z may not be used) and a point indicated by the position information of the object.

  Next, the shooting second terminal determination unit 117 determines whether or not it is a shooting second terminal from a higher-order record in the temporary management table such as an object.

That is, the imaging second terminal determination unit 117 reads the identifier “1” of the first record in the temporary management table for objects and the like. Then, the object information management table is searched using the identifier “1” as a key, and the region information “(x ₁ , y ₁ , z ₁ ) (x ₂ , y ₂ , z ₂ ) paired with the identifier“ 1 ”is searched. (X ₃ , y ₃ , z ₃ ) (x ₄ , y ₄ , z ₄ ) ”is acquired.

Next, the imaging second terminal determination unit 117 receives the received first terminal information (X, Y, Z, θA, θB, θa, θb) and the acquired area information “(x ₁ , y ₁ , z _1). ) (X ₂ , y ₂ , z ₂ ) (x ₃ , y ₃ , z ₃ ) (x ₄ , y ₄ , z ₄ ) ”is used to determine whether or not the first object is a shooting object. To do.

First, the imaging second terminal determination unit 117 acquires the _first point (x ₁ , y ₁ , z ₁ ) in the area information of the object to be determined (object with the object identifier “1”).

Next, the imaging second terminal determination unit 117 calculates an angle (θ11) on the plane between the first point (x ₁ , y ₁ , z ₁ ) and the first position information (X, Y, Z). The angle (θ11) is temporarily stored in the buffer. In addition, the imaging second terminal determination unit 117 calculates an angle (θ12) in the height direction between the first point (x ₁ , y ₁ , z ₁ ) and the first position information (X, Y, Z). The angle (θ12) is temporarily stored in the buffer. Similarly, the imaging second terminal determination unit 117 includes each of the fourth point from the second point in the area information of the object to be determined (object having the object identifier “1”) and the first position information (X, The angle (θ12, θ13, θ14) on the plane with Y, Z) is calculated, and the angle (θ12, θ13, θ14) is also temporarily stored in the buffer. (Θ11, θ12, θ13, θ14) is stored in the buffer. Further, similarly, the second imaging terminal determining unit 117 similarly determines each of the fourth point from the second point in the area information of the object to be determined (object having the object identifier “1”) and the first position information ( The angle (θ22, θ23, θ24) in the height direction with respect to X, Y, Z) is calculated, and the angle (θ22, θ23, θ24) is also temporarily stored in the buffer. (Θ21, θ22, θ23, θ24) is stored in the buffer.

  Next, the imaging second terminal determination unit 117 determines the minimum angle (for example, (θ11)) and the maximum angle (for example, (θ14) from the angles (θ11, θ12, θ13, θ14) temporarily stored in the buffer. )) And get.

  In addition, the imaging second terminal determination unit 117 acquires the maximum angle (θ24) in the height direction from the angles (θ21, θ22, θ23, θ24) temporarily stored in the buffer.

  Next, the imaging second terminal determination unit 117 determines whether all of the acquired areas of the minimum angle (θ11) and the maximum angle (θ14) on the plane are already registered areas. Here, it is assumed that the imaging second terminal determination unit 117 determines that the acquired area of the minimum angle (θ11) and the maximum angle (θ14) is a visible area. Then, the shooting second terminal determination unit 117 determines that the object with the object identifier “1” is a shooting object.

  Here, for example, the imaging second terminal determination unit 117 determines that a part of the acquired area of the minimum angle (θ11) and the maximum angle (θ14) on the plane is not an already registered area. Even in this case, it is determined that the area is visible. That is, the shooting second terminal determination unit 117 determines that the object with the identifier “1” is a shooting object. For example, even when the second imaging terminal determining unit 117 determines that all of the acquired areas of the minimum angle (θ11) and the maximum angle (θ14) on the plane are already registered angle areas. If the maximum angle (θ24) in the height direction is larger than the registered maximum angle in the height direction, it is determined that the region is the visible region in the region of the minimum angle (θ11) and the maximum angle (θ14) on the plane. To do. That is, the shooting second terminal determination unit 117 determines that the object with the identifier “1” is a shooting object.

  Next, the imaging second terminal determination unit 117 sets “θ11 <= invisible region <= θ14” as a new invisible region. That is, the imaging second terminal determination unit 117, for example, “0 <= invisible region angle <(θA− (θa / 2))” and “(θA + (θa / 2)) <invisible region angle <= 360”. The invisible area angle on the plane obtained by merging “θ11 <= invisible area <= θ14” is registered in the recording medium. If the registered maximum angle in the height direction is smaller than (θ24), the second imaging terminal determination unit 117 registers the maximum angle (θ24) in the height direction in association with the area on this plane. To do.

  Next, since the flag of the first object is “0”, the shooting second terminal determination unit 117 determines that it is not the second terminal device 13 and does not accumulate information in a storage medium (not shown).

  Next, it is assumed that the imaging second terminal determination unit 117 determines that a visible area exists from the registered invisible area or visible area.

Next, the imaging second terminal determination unit 117 reads the identifier “1866.11.251.1” of the second record in the temporary management table for objects and the like. Then, using the identifier “1866.11.251.1” as a key, the object information management table and the current second terminal information storage unit 113 are searched, and the second paired with the identifier “1866.11.251.1”. The position information “(X ₂₂ , Y ₂₂ )” is acquired.

Next, photographing the second terminal determination section 117, a first terminal information received (X, Y, Z, θA , θB, θa, θb) and, the acquired second position information _{(X 22, Y} 22) Is used to determine whether or not the second terminal apparatus 13 corresponding to the second record has been shot.

First, the imaging second terminal determination unit 117 has an angle (θn1) on the plane between the second position information (X ₂₂ , Y ₂₂ ) and (X, Y) included in the first position information (X, Y, Z). And the angle (θn1) is temporarily stored in the buffer. In addition, the imaging second terminal determination unit 117 calculates an angle (θn2) in the height direction between the point (X ₂₂ , Y ₂₂ , default value) and the first position information (X, Y, Z), and the angle (Θn2) is temporarily stored in the buffer. (Θn1, θn2) is stored in the buffer.

  Next, the imaging second terminal determination unit 117 determines whether or not the acquired angle (θn1) on the plane is an already registered area. Here, it is assumed that the imaging second terminal determination unit 117 determines that the acquired angle (θn1) is a visible region. Then, the second imaging terminal determination unit 117 determines that the second terminal device 13 with the identifier “1866.11.251.1” is the second imaging terminal.

  Next, the imaging second terminal determination unit 117 determines that it is the second terminal device 13 because the flag of the second record is “1”.

  Next, the mobile body information acquisition unit 118 obtains the mobile body information “name: car C,...” Corresponding to the imaging second terminal device “186.11.251.1” as the second terminal information storage unit 112. Get from.

  Next, the imaging second terminal determination unit 117 stores the identifier “1866.11.251.1” and the moving body information “name: car C,...” In a storage medium (not shown).

  The above processing is repeated for the third and subsequent objects or the second terminal device 13. Then, it is assumed that only mobile information corresponding to the identifier “1866.11.251.1” has been obtained.

  Next, the moving body information transmitting unit 119 transmits the acquired moving body information “name: car C,...” To the first terminal device 12.

  Next, the 1st receiving part 125 of the 1st terminal device 12 receives mobile body information "name: car C, ..." corresponding to transmission of 1st terminal information.

  And the output part 126 outputs the received moving body information "Name: Car C, ...". For example, the output unit 126 outputs moving body information as shown in FIG. In addition, in FIG. 21, the output aspect of mobile body information is not ask | required.

  As described above, according to the present embodiment, it is possible to output information relating to a moving object such as a person or a car that is taking a picture.

  Further, according to the present embodiment, high-speed processing can be performed by appropriately terminating the processing for detecting the shooting object and the second terminal device 13.

  Moreover, according to this Embodiment, since the height of an object and the 2nd terminal device 13 is also considered, the information regarding the 2nd terminal device 13 visible behind a certain building can also be obtained, for example.

  Further, according to the present embodiment, the moving body information is output to one of the two screens, so that the user can view the moving body information without disturbing the video of the camera.

  Note that the processing in the present embodiment may be realized by software. Then, this software may be distributed by software download or the like. Further, this software may be recorded and distributed on a recording medium such as a CD-ROM. This also applies to other embodiments in this specification. In addition, the software which implement | achieves the server apparatus 11 in this Embodiment is the following programs. That is, this program stores, in a recording medium, one or more object information having an object identifier for identifying an object and area information indicating an area in which the object exists, and a second terminal for identifying a second terminal device One or more second terminal information having an identifier and mobile body information that is information about the mobile body is stored, and from the first terminal device, the first position information indicating the position of the first terminal device is stored. A first terminal information receiving unit that receives first terminal information including first direction information indicating a direction in which the first terminal device is facing; and a second terminal of the second terminal device from the second terminal device. A current that receives current second terminal information including an identifier and second position information of the second terminal device that can be identified by the second terminal identifier, and stores at least temporarily in a recording medium A two-terminal information receiving unit; first position information included in the first terminal information; first direction information included in the first terminal information; and a viewing angle stored in advance or included in the first terminal information. And applying to the region information of each object information of the recording medium and the current second terminal information of each second terminal device of the recording medium, and determining one or more second terminal devices photographed by the first terminal device An imaging second terminal determination unit that performs the acquisition, and a mobile body information acquisition unit that acquires, from the recording medium, one or more pieces of mobile body information corresponding to each of the one or more second terminal devices determined by the imaging second terminal determination unit A program for causing one or more pieces of movement information acquired by the second terminal information acquisition unit to function as a mobile body information transmission unit for transmitting to the first terminal device.

  In the above program, the region information includes two-dimensional region information indicating a two-dimensional region on a map and height information indicating the height of an object. Using the first position information and the first direction information included in one terminal information and the viewing angle stored in advance or included in the first terminal information, an imaging region in a three-dimensional space is acquired and the imaging is performed. The area is applied to the area information of each object information of the recording medium and the current second terminal information of each second terminal apparatus of the recording medium, and the one or more objects and one or more objects being photographed by the first terminal apparatus The second terminal device is determined, and when determining the one or more second terminal devices, the objects and the second terminal device are inspected in order of increasing distance from the first terminal device, and the first terminal Device photographed If the object and the second terminal device are registered as the invisible region, the object and the second terminal device are registered in the terminal device. It is preferable that the program causes the computer to function as a test for ending the inspection of whether or not the image has been taken.

  In the above program, the second photographing terminal determination unit assumes that the size of each second terminal device is a predetermined size, and the first position information included in the first terminal information and the first terminal information The first direction information included in the information and the viewing angle stored in advance or included in the first terminal information are the region information of each object information in the object information storage unit and the current of each second terminal device of the recording medium. It is preferable that the program is a program that causes a computer to function as one that determines the one or more second terminal devices that are applied to the second terminal information and photographed by the first terminal device.

  In the program, a distance between an object corresponding to one or more object information of the recording medium and the first terminal device, and a second terminal device corresponding to one or more current second terminal information of the recording medium; The position information of the object information and the first terminal information of each object, or the current second terminal information and the first terminal information of each second terminal device has the distance to the first terminal device. And a distance calculating unit that calculates each object or each second terminal device from the position information, and the shooting second terminal determining unit selects the object and the second terminal device in order of increasing distance from the first terminal device. It is a program that causes a computer to function as one that inspects and determines one or more second terminal devices photographed by the first terminal device. It is to be preferred.

  Further, in the above program, the shooting second terminal determination unit inspects the object and the second terminal device in order of increasing distance from the first terminal device, and determines first that the first terminal device is shooting. If the object and the second terminal device are photographed by the first terminal device when the invisible region and the second terminal device are registered as invisible regions, and the visible region disappears It is preferable that the program for causing the computer to function as the one for ending the inspection of whether or not.

  Further, in the above program, the shooting second terminal determination unit inspects the object and the second terminal device in order of increasing distance from the first terminal device, and determines first that the first terminal device is shooting. The information of the area that becomes invisible by shooting the captured object is registered as an invisible area, and only objects that are visible area and whose distance from the first terminal device is within the threshold and only the second terminal device are inspected. And it is suitable that it is a program which makes a computer function as what determines the 1 or more 2nd terminal device which said 1st terminal device image | photographs.

  Further, in the above program, the shooting second terminal determination unit inspects the object and the second terminal device in order of increasing distance from the first terminal device, and determines that the first terminal device is shooting. When the number of two terminal devices reaches a threshold value, it is preferable that the program terminates the inspection and causes the computer to function.

  In the above program, it is preferable that the moving body information output means is a program that causes a computer to function as the moving body information that is output by superimposing the moving body information on an image acquired by the camera unit.

  Moreover, the software which implement | achieves the 1st terminal device 12 in this Embodiment is the following programs. That is, this program is a first terminal information acquisition unit that acquires first position information indicating the position of the first terminal device and first direction information indicating a direction in which the first terminal device is facing. And a camera unit for acquiring video, an output unit including camera video output means for outputting video acquired by the camera unit, and first terminal information acquired by the first terminal information acquisition unit in a server device A first transmitting unit for transmitting, and a first receiving unit for receiving the moving body information from the server device, wherein the output unit outputs moving body information received by the first receiving unit. A program for causing an output unit to function.

  Moreover, the software which implement | achieves the 2nd terminal device 13 in this Embodiment is the following programs. That is, this program stores the second terminal identifier in the recording medium, and the computer acquires second terminal information that acquires the second terminal information having the second position information indicating the position of the second terminal device. Current second terminal information including the second terminal identifier and the second terminal information acquired by the first terminal information acquisition unit as a second transmission unit that transmits to the server device. Program.

  (Embodiment 2)

  In the present embodiment, an information system in which the first terminal device and the second terminal device communicate with each other by P2P, and information related to the second terminal device photographed by the first terminal device is output to the first terminal device. explain.

  The conceptual diagram of the information system 2 in this Embodiment is FIG. FIG. 23 is a block diagram of the information system 2 in the present embodiment.

  The information system 2 includes one or more first terminal devices 21 and one or more second terminal devices 22. The second terminal device 22 preferably broadcasts the second terminal information.

  The first terminal device 21 includes an object information storage unit 111, a second terminal information storage unit 112, a current second terminal information storage unit 113, a reception unit 121, a camera unit 122, a first terminal information acquisition unit 123, and a current second terminal. An information reception unit 215, a distance calculation unit 116, an imaging second terminal determination unit 117, a moving body information acquisition unit 118, and an output unit 126 are provided.

  The first terminal information acquisition unit 123 includes a first position information acquisition unit 1231 and a first direction information acquisition unit 1232.

  The second terminal device 22 includes a second terminal identifier storage unit 131, a second terminal information acquisition unit 132, and a second transmission unit 233.

  The current second terminal information receiving unit 215 receives current second terminal information including the second terminal identifier and the second position information of the second terminal device 22 that can be identified by the second terminal identifier from the second terminal device 22. Received and at least temporarily stored in the current second terminal information storage unit 113. The current second terminal information usually includes mobile information.

  The current second terminal information receiving unit 215 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast.

  The second transmission unit 233 transmits the second terminal information to the first terminal device 21. The second transmission unit 233 is usually realized by wireless or wired communication means, but may be realized by broadcasting means.

  Next, the operation of the information system 2 will be described. First, operation | movement of the 1st terminal device 21 is demonstrated using the flowchart of FIG. In the flowchart of FIG. 23, the description of the same steps as those in the flowchart of FIG. 4 or 9 is omitted.

  (Step S2401) The current second terminal information receiving unit 215 of the first terminal device 21 determines whether or not the current second terminal information has been received from the second terminal device 22. Go to step S302.

  Note that the processing is ended by powering off or interruption for aborting the processing in the flowchart in FIG.

  Hereinafter, a specific operation of the information system 2 in the present embodiment will be described. The specific operation of the information system 2 is the same as the specific operation of the information system 1 except that the first terminal device 21 and the second terminal device 22 communicate by peer-to-peer.

  As described above, according to the present embodiment, it is possible to output information relating to a moving object such as a person or a car that is taking a picture.

  In addition, the software which implement | achieves the 1st terminal device in this Embodiment is the following programs. That is, this program stores one or more pieces of object information having an object identifier for identifying an object and area information indicating an area in which the object exists, and identifies the second terminal device. One or more second terminal information having a second terminal identifier and moving body information that is information about the moving body is stored, and first position information indicating a position of the first terminal device, and the first A first terminal information acquisition unit that acquires first direction information indicating a direction in which the terminal device is facing; a camera unit that acquires a video; and a camera video output unit that outputs a video acquired by the camera unit. From the output unit and the second terminal device, a second current identifier including the second terminal identifier of the second terminal device and the second position information of the second terminal device that can be identified by the second terminal identifier. Current terminal information reception unit that receives terminal information and stores at least temporarily in a recording medium, first position information included in the first terminal information, first direction information included in the first terminal information, and stored in advance Or the viewing angle is applied to the area information of each object information of the recording medium and the current second terminal information of each second terminal device of the recording medium, and the first terminal device is shooting 1 The second terminal device that determines the second terminal device described above, and one or more pieces of moving body information corresponding to each of the one or more second terminal devices determined by the second terminal terminal determination unit, A program that causes a computer to function as a mobile body information acquisition unit that is acquired from an information storage unit, and the output unit includes mobile body information output means that outputs mobile body information acquired by the mobile body information acquisition unit A.

  FIG. 25 shows the external appearance of a computer that executes the program described in this specification to realize the server device, the first terminal device, or the second terminal device of the above-described embodiment. The above-described embodiments can be realized by computer hardware and a computer program executed thereon. FIG. 25 is an overview diagram of the computer system 340, and FIG. 26 is a block diagram of the computer system 340.

  In FIG. 25, a computer system 340 includes a computer 341 including an FD drive and a CD-ROM drive, a keyboard 342, a mouse 343, and a monitor 344.

  26, in addition to the FD drive 3411 and the CD-ROM drive 3412, the computer 341 stores an MPU 3413, a bus 3414 connected to the CD-ROM drive 3412 and the FD drive 3411, and a program such as a bootup program. A RAM 3416 for temporarily storing application program instructions and providing a temporary storage space; and a hard disk 3417 for storing application programs, system programs, and data. Although not shown here, the computer 341 may further include a network card that provides connection to the LAN.

  A program for causing the computer system 340 to execute the functions of the server device or the like of the above-described embodiment is stored in the CD-ROM 3501 or the FD 3502, inserted into the CD-ROM drive 3412 or the FD drive 3411, and further stored in the hard disk 3417. May be forwarded. Alternatively, the program may be transmitted to the computer 341 via a network (not shown) and stored in the hard disk 3417. The program is loaded into the RAM 3416 at the time of execution. The program may be loaded directly from the CD-ROM 3501, the FD 3502, or the network.

  The program does not necessarily include an operating system (OS), a third party program, or the like that causes the computer 341 to execute the functions of the server device or the like of the above-described embodiment. The program only needs to include an instruction portion that calls an appropriate function (module) in a controlled manner and obtains a desired result. How the computer system 340 operates is well known and will not be described in detail.

  In the above program, in the step of transmitting information, the step of receiving information, etc., processing performed by hardware, for example, processing performed by a modem or an interface card in the transmission step (only performed by hardware) Processing) is not included.

  Further, the computer that executes the program may be singular or plural. That is, centralized processing may be performed, or distributed processing may be performed.

  Further, in each of the above embodiments, it goes without saying that two or more communication units existing in one apparatus may be physically realized by one medium.

  In each of the above embodiments, each process (each function) may be realized by centralized processing by a single device (system), or by distributed processing by a plurality of devices. May be.

  The present invention is not limited to the above-described embodiments, and various modifications are possible, and it goes without saying that these are also included in the scope of the present invention.

  As described above, the information system according to the present invention has an effect that it can output information on a moving object such as a person who is taking a picture or a car, and is useful as an information system or the like.

DESCRIPTION OF SYMBOLS 1, 2 Information system 11 Server apparatus 12, 21 First terminal apparatus 13, 22 Second terminal apparatus 111 Object information storage part 112 Second terminal information storage part 113 Current second terminal information storage part 114 First terminal information reception part 115 215 Current second terminal information reception unit 116 Distance calculation unit 117 Imaging second terminal determination unit 118 Mobile object information acquisition unit 119 Mobile object information transmission unit 121 Reception unit 122 Camera unit 123 First terminal information acquisition unit 124 First transmission unit 125 1st reception part 126 output part 131 2nd terminal identifier storage part 132 2nd terminal information acquisition part 133,233 2nd transmission part 1231 1st position information acquisition means 1232 1st direction information acquisition means 1261 camera image output means 1262 movement Body information output means

Claims (17)

A first terminal device constituting an information system comprising a server device, a first terminal device, and a second terminal device that moves in accordance with the movement of the moving body,
The server device
An object information storage unit capable of storing one or more object information having an object identifier for identifying an object and area information indicating an area in which the object exists;
A second terminal information storage unit capable of storing one or more second terminal information having a second terminal identifier for identifying the second terminal device and mobile information that is information on the mobile;
A current second terminal information storage unit capable of storing one or more current second terminal information including the second terminal identifier and second position information indicating a position of the second terminal device that can be identified by the second terminal identifier; ,
A first terminal that receives, from the first terminal device, first terminal information having first position information indicating a position of the first terminal device and first direction information indicating a direction in which the first terminal device is facing. An information receiver;
Receiving from the second terminal device current second terminal information including a second terminal identifier of the second terminal device and second position information of the second terminal device that can be identified by the second terminal identifier; A current second terminal information receiving unit that at least temporarily accumulates in the current second terminal information storage unit;
The first position information included in the first terminal information, the first direction information included in the first terminal information, and the viewing angle stored in advance or included in the first terminal information are stored in the object information storage unit. Applies to the area information of each object information and the current second terminal information of each second terminal device of the current second terminal information storage unit, and determines one or more second terminal devices photographed by the first terminal device A shooting second terminal determination unit,
A mobile body information acquisition unit that acquires, from the second terminal information storage unit, one or more mobile body information corresponding to each of the one or more second terminal devices determined by the imaging second terminal determination unit;
A mobile information transmission unit that transmits one or more pieces of movement information acquired by the second terminal information acquisition unit to the first terminal device;
The first terminal device is
A first terminal information acquisition unit that acquires first position information indicating the position of the first terminal device and first direction information indicating a direction in which the first terminal device is facing;
A camera unit for acquiring images;
An output unit comprising camera video output means for outputting video acquired by the camera unit;
A first transmission unit for transmitting the first terminal information acquired by the first terminal information acquisition unit to the server device;
A first receiving unit that receives the mobile object information from the server device;
The output unit is
Comprising mobile body information output means for outputting mobile body information received by the first receiver;
The second terminal device is
A second terminal identifier storage unit capable of storing the second terminal identifier;
A second terminal information acquisition unit for acquiring second terminal information having second position information indicating the position of the second terminal device;
An information system including a second transmission unit that transmits current second terminal information having the second terminal identifier and the second terminal information acquired by the first terminal information acquisition unit to the server device is configured. First terminal device. The region information includes two-dimensional region information indicating a two-dimensional region on the map and height information indicating the height of the object,
The photographing second terminal determination unit
Using the first position information and the first direction information that the first terminal information has, and the viewing angle that is stored in advance or the first terminal information has, obtain a shooting area on the three-dimensional space, The imaging area is applied to the area information of each object information in the object information storage section and the current second terminal information of each second terminal apparatus in the current second terminal information storage section, and the first terminal apparatus captures the image. Determining one or more objects and one or more second terminal devices, and
When determining the one or more second terminal devices, the object and the second terminal device are inspected in order of increasing distance from the first terminal device, and the first terminal device is determined to be shooting first. Whether or not the object and the second terminal device are photographed by the terminal device when the information of the region that becomes invisible by photographing of the object and the second terminal device is registered as the invisible region and the visible region disappears The 1st terminal device which comprises the information system of Claim 1 which complete | finishes a test | inspection. The photographing second terminal determination unit
Assuming that the size of each second terminal device is a predetermined size, the first position information included in the first terminal information, the first direction information included in the first terminal information, and Applying the viewing angle of the first terminal information to the region information of each object information in the object information storage unit and the current second terminal information of each second terminal device of the current second terminal information storage unit, The 1st terminal device which comprises the information system of Claim 1 or Claim 2 which determines the 1 or more 2nd terminal device which one terminal device image | photographs. The server device
A distance between an object corresponding to one or more object information in the object information storage unit and the first terminal device, and a second terminal device corresponding to one or more current second terminal information in the current second terminal information storage unit And the distance information between the first terminal device, the position information of the object information of each object and the first terminal information, or the current second terminal information and the first terminal information of each second terminal device. Further comprising a distance calculation unit that calculates for each object or second terminal device from the positional information that has,
The photographing second terminal determination unit
The object and the second terminal device are inspected in order of increasing distance from the first terminal device, and one or more second terminal devices photographed by the first terminal device are determined. The 1st terminal device which comprises the information system of description. The photographing second terminal determination unit
The object and the second terminal device are inspected in order from the shortest distance from the first terminal device, and the region determined to be invisible by the imaging of the object and the second terminal device previously determined that the first terminal device is photographing. 5. The information is registered as an invisible area, and when the visible area disappears, the inspection of whether or not the object and the second terminal device are photographed by the first terminal device is terminated. A first terminal device constituting the information system. The photographing second terminal determination unit
The object and the second terminal device are inspected in order from the shortest distance from the first terminal device, and the information of the region that becomes invisible by the shooting of the object determined earlier as the first terminal device is shooting is set as the invisible region. One or more objects that are registered, inspect only objects that are objects in the visible region and whose distance from the first terminal device is within a threshold, and the second terminal device, and the first terminal device is photographing The 1st terminal device which comprises the information system in any one of Claims 1-4 which determines a 2nd terminal device. The photographing second terminal determination unit
Inspecting the object and the second terminal device in order from the shortest distance from the first terminal device, and when the number of second terminal devices determined that the first terminal device is photographing becomes a threshold, the inspection The 1st terminal device which comprises the information system in any one of Claims 1-4 which complete | finishes. The mobile body information output means includes
The first terminal device according to claim 1, wherein the mobile body information is output by being superimposed on an image acquired by the camera unit. An object information storage unit capable of storing one or more object information having an object identifier for identifying an object and area information indicating an area in which the object exists;
A second terminal information storage unit capable of storing one or more second terminal information having a second terminal identifier for identifying a second terminal device and mobile body information that is information about the mobile body;
A current second terminal information storage unit capable of storing one or more current second terminal information including the second terminal identifier and second position information indicating a position of the second terminal device that can be identified by the second terminal identifier; ,
First terminal information for receiving first terminal information having first position information indicating the position of the first terminal device and first direction information indicating a direction in which the first terminal device is facing from the first terminal device. A receiver,
Receiving from the second terminal device current second terminal information including a second terminal identifier of the second terminal device and second position information of the second terminal device that can be identified by the second terminal identifier; A current second terminal information receiving unit that at least temporarily accumulates in the current second terminal information storage unit;
The first position information included in the first terminal information, the first direction information included in the first terminal information, and the viewing angle stored in advance or included in the first terminal information are stored in the object information storage unit. Applies to the area information of each object information and the current second terminal information of each second terminal device of the current second terminal information storage unit, and determines one or more second terminal devices photographed by the first terminal device A shooting second terminal determination unit,
A mobile body information acquisition unit that acquires, from the second terminal information storage unit, one or more mobile body information corresponding to each of the one or more second terminal devices determined by the imaging second terminal determination unit;
A server apparatus comprising: a mobile body information transmission unit that transmits one or more pieces of movement information acquired by the second terminal information acquisition unit to the first terminal device. A first terminal information acquisition unit that acquires first position information indicating a position of the first terminal device and first direction information indicating a direction in which the first terminal device is facing;
A camera unit for acquiring images;
An output unit comprising camera video output means for outputting video acquired by the camera unit;
A first transmission unit that transmits the first terminal information acquired by the first terminal information acquisition unit to the server device;
A first receiving unit that receives the mobile object information from the server device;
The output unit is
A first terminal device further comprising mobile body information output means for outputting mobile body information received by the first receiver. A first terminal device constituting an information system comprising a first terminal device and a second terminal device that moves in accordance with the movement of a moving body,
The first terminal device is
An object information storage unit capable of storing one or more object information having an object identifier for identifying an object and area information indicating an area in which the object exists;
A second terminal information storage unit capable of storing one or more second terminal information having a second terminal identifier for identifying the second terminal device and mobile information that is information on the mobile;
A current second terminal information storage unit capable of storing one or more current second terminal information including the second terminal identifier and second position information indicating a position of the second terminal device that can be identified by the second terminal identifier; ,
A first terminal information acquisition unit that acquires first position information indicating the position of the first terminal device and first direction information indicating a direction in which the first terminal device is facing;
A camera unit for acquiring images;
An output unit comprising camera video output means for outputting video acquired by the camera unit;
From the second terminal device, current second terminal information including the second terminal identifier of the second terminal device and the second position information of the second terminal device that can be identified by the second terminal identifier, A current second terminal information receiving unit that at least temporarily accumulates in the current second terminal information storage unit;
The first position information included in the first terminal information, the first direction information included in the first terminal information, and the pre-stored or viewing angle, the area information of each object information in the object information storage unit, and An imaging second terminal determination unit that applies to current second terminal information of each second terminal device in the current second terminal information storage unit and determines one or more second terminal devices that the first terminal device is capturing. When,
A mobile body information acquisition unit that acquires, from the second terminal information storage unit, one or more mobile body information corresponding to each of the one or more second terminal devices determined by the imaging second terminal determination unit;
The output unit is
Comprising mobile body information output means for outputting mobile body information acquired by the mobile body information acquisition unit;
The second terminal device is
A second terminal identifier storage unit capable of storing the second terminal identifier;
A second terminal information acquisition unit for acquiring second terminal information having second position information indicating the position of the second terminal device;
An information system comprising: a second transmission unit configured to transmit current second terminal information having the second terminal identifier and the second terminal information acquired by the first terminal information acquisition unit to the first terminal device. First terminal device to be configured. The current second terminal information is
The 1st terminal device of Claim 11 containing mobile body information. The server apparatus which comprises the information system in any one of Claims 1-8. The 2nd terminal device which comprises the information system in any one of Claims 1-8, Claim 10, and Claim 11. On the recording medium,
Storing one or more pieces of object information having an object identifier for identifying the object and area information indicating an area in which the object exists; and
Storing one or more second terminal information having a second terminal identifier for identifying the second terminal device and mobile body information that is information about the mobile body;
An information processing method realized by a first terminal information acquisition unit, a camera unit, an output unit, a current second terminal information reception unit, a shooting second terminal determination unit, and a moving body information acquisition unit,
A first terminal information acquisition step in which the first terminal information acquisition unit acquires first position information indicating a position of the first terminal device and first direction information indicating a direction in which the first terminal device is facing; ,
A camera step in which the camera unit acquires video;
An output step in which the output unit outputs the video acquired in the camera step;
The current second terminal information receiving unit includes, from the second terminal device, a second terminal identifier of the second terminal device and second location information of the second terminal device that can be identified by the second terminal identifier. Receiving the current second terminal information and at least temporarily storing the current second terminal information in the recording medium; and
The imaging second terminal determination unit includes the first position information included in the first terminal information, the first direction information included in the first terminal information, and a pre-stored or viewing angle of the recording medium. An imaging second terminal that is applied to the area information of each object information and the current second terminal information of each second terminal device of the recording medium to determine one or more second terminal devices that the first terminal device is imaging A decision step;
A mobile body information acquisition step in which the mobile body information acquisition unit acquires, from the recording medium, one or more mobile body information corresponding to each of the one or more second terminal devices determined by the imaging second terminal determination unit; Equipped,
In the output step,
An information processing method for outputting mobile body information acquired by the mobile body information acquisition unit. On the recording medium,
Storing one or more object information having an object identifier for identifying an object and area information indicating an area in which the object exists;
Storing one or more second terminal information having a second terminal identifier for identifying a second terminal device and mobile body information that is information about the mobile body;
Computer
First terminal information for receiving first terminal information having first position information indicating the position of the first terminal device and first direction information indicating a direction in which the first terminal device is facing from the first terminal device. A receiver,
Current second terminal information including the second terminal identifier of the second terminal device and the second position information of the second terminal device that can be identified by the second terminal identifier is received from the second terminal device and recorded. A current second terminal information receiving unit for at least temporarily storing in the medium;
Each object of the recording medium includes first position information included in the first terminal information, first direction information included in the first terminal information, and a viewing angle stored in advance or included in the first terminal information. An imaging second terminal determination unit that applies to area information of information and current second terminal information of each second terminal device of the recording medium and determines one or more second terminal devices that the first terminal device is capturing When,
A mobile body information acquisition unit that acquires, from the recording medium, one or more mobile body information corresponding to each of the one or more second terminal devices determined by the imaging second terminal determination unit;
A program for causing one or more pieces of movement information acquired by the second terminal information acquisition unit to function as a mobile body information transmission unit for transmitting to the first terminal device. Computer
A first terminal information acquisition unit that acquires first position information indicating a position of the first terminal device and first direction information indicating a direction in which the first terminal device is facing;
A camera unit for acquiring images;
An output unit comprising camera video output means for outputting video acquired by the camera unit;
A first transmission unit that transmits the first terminal information acquired by the first terminal information acquisition unit to the server device;
A first receiving unit that receives the mobile object information from the server device;
The output unit is
The program for functioning as what comprises the mobile body information output means which outputs the mobile body information which the said 1st receiving part received.