JP2005017074A - Device and program for transmitting/receiving information - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information transmitting/receiving device that allows a person, who goes to meet a person waiting, to accurately grasp the state of a meeting place by a picture, and to find out the person waiting. <P>SOLUTION: The information transmitting/receiving device includes a current position acquiring means 1 that is provided at the side of a first user who waits for a second user at a specified meeting place and acquires the current position of the first user; a meeting place acquiring means 2 for acquiring the meeting place of the first and second users; a travel direction estimation means 3 for estimating the direction of movement of the first user who arrives at the meeting place, based on the positional relation between the current position of the first user and the meeting place; an imaging command generating means 5 for generating an imaging command for making the picture of the meeting place in a specified imaging direction imaged, based on the travel direction, estimated by the travel direction estimation means 3; and a transmitting/receiving means 6 for transmitting a generated imaging command toward the second user. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
【Technical field】
The present invention relates to an information transmission / reception apparatus and an information transmission / reception program that are provided on the side of one user who waits with another user at a predetermined meeting place, and that allows the other user to take an image of the meeting place.
[0002]
[Background]
There is a navigation system in which a waiter transmits position information of a meeting place toward a vehicle, and the vehicle performs a route search using the received position information as a destination (see Patent Document 1). According to this navigation system, the driver can search the route to the destination without performing the destination search operation, and can reach the vicinity of the meeting place according to the guidance route.
However, there is a problem that a driver who does not know the land around the meeting place may not actually find the waiting person even if the driver can reach the vicinity of the meeting place.
[0003]
Also, in Patent Document 2, the latitude, longitude, altitude, and traveling direction of the vehicle position are specified, and the terrain information is extracted from a database such as a CD-ROM holding terrain information related to the scenery in the traveling direction of the host vehicle. Based on the above, there is described a technique for generating an image representing a scenery in the driver's line of sight and displaying the generated image on a display device.
However, the technique described in Patent Document 2 generates a landscape video based on information stored in a storage device such as a CD-ROM, and thus cannot cope with changes in landmarks and landmarks. It was. That is, depending on the technique described in Patent Document 2, a landscape that reflects landmarks (flowers, trees, etc.) that change according to the season or weather, or landmarks that are temporarily arranged and change over time (carts, novice, etc.) There was a problem that video could not be generated.
[0004]
That is, there is a problem that a person who picks up the waiting person cannot accurately grasp the situation of the meeting place at the time of meeting and cannot easily find the waiting person.
[0005]
[Prior art]
[Patent Document 1]
JP 2001-141478 A
[Patent Document 2]
JP-A-8-327375
[0006]
DISCLOSURE OF THE INVENTION
An object of the present invention is to allow a driver who searches for a waiting person near a meeting place to photograph the scenery that the driver will see when he finds the waiting person.
[0007]
According to this invention, it is provided on the one user side who waits with another user at a predetermined meeting place, exchanges information with the other user side, and acquires the current position of the one user. Based on a current position acquisition function, a meeting place acquisition function for acquiring a meeting place between the one user and another user, and a positional relationship between the current position of the one user and the meeting place, the meeting place A traveling direction prediction function for predicting the traveling direction of the one user who arrives, and an imaging command for capturing an image of the meeting place in a predetermined imaging direction based on the traveling direction predicted by the traveling direction prediction function An imaging command generation function for transmitting and receiving / transmitting an imaging command generated by the imaging command generation function to the other user It is possible to provide a computer (information transmitting and receiving apparatus).
The driver who searches for the waiting person can easily find the waiting person by referring to the video imaged by the waiting person.
[0008]
DETAILED DESCRIPTION OF THE INVENTION
The information transmission / reception apparatus 100 of the present invention is boarded by a first user (corresponding to "one user", the same applies below) who waits with a second user (corresponding to "other users", the same applies hereinafter) at a predetermined meeting place. It is an apparatus provided in a vehicle that can transmit and receive information to and from the second user side. The second user has a portable terminal 200 having at least camera means and transmission / reception means. The mobile terminal 200 on the second user side and the information transmitting / receiving apparatus 100 can exchange information with each other via a communication line. The 2nd user side may have the same in-vehicle information transmitter / receiver 100 as the 1st user other than portable terminal 200.
[0009]
The information transmission / reception device 100 is mounted on a vehicle on which the first user is boarded, and can exchange information with the information input device 300, the navigation device 400, the presentation device 500, and the storage device 600 that are also mounted on the vehicle. As shown in FIG.
[0010]
A portable terminal 200 that transmits and receives information to and from the information transmitting and receiving apparatus 100 includes at least a transmitting and receiving unit 201, a camera unit 202 that performs imaging, a presentation unit 203 such as a monitor, and an electronic compass 204. The transmission / reception means 201 has the same function as the transmission / reception means 6 of the information transmission / reception apparatus 100. The camera unit 202 is an imaging unit having functions such as an imaging magnification control function, an imaging distance control function, an autofocus function, an exposure setting function, an aperture control function, an automatic flash function, and other ordinary digital cameras. According to the camera unit 202, it is possible to correct the shooting environment even in the case of backlighting or when the degree of exposure is not sufficient. The electronic compass 204 has a function of detecting which direction the mobile terminal 200 is facing. The electronic compass 204 of the present embodiment includes a geomagnetic sensor that detects three components of geomagnetism, and detects the direction in which the mobile terminal 200 is directed. A locator function such as a GPS function (Global Positioning System) may be used.
[0011]
[First Embodiment]
The information transmitting / receiving apparatus 100 and related apparatuses will be described below with reference to the drawings.
As shown in FIG. 1, the information transmitting / receiving apparatus 100 of the present embodiment includes a current position acquisition unit 1, a meeting place acquisition unit 2, a traveling direction prediction unit 3, a viewpoint position calculation unit 4, and an imaging command generation unit 5. And a transmission / reception means 6. Specifically, at least a program for predicting the traveling direction of the first user arriving at the meeting place and generating an imaging command for capturing an image of the meeting place in a predetermined imaging direction based on the predicted traveling direction is stored. A ROM and a CPU functioning as the traveling direction prediction unit 3 and the imaging command generation unit 5 and a RAM functioning as the storage device 600 are provided by executing a program stored in the ROM.
[0012]
The ROM further stores a program for generating an imaging command for imaging the video at the meeting place based on the predicted traveling direction and the calculated viewpoint position of the first user, and the CPU executes the program. Thus, it functions as the viewpoint position calculation unit 4 and the imaging command generation unit 5.
[0013]
This apparatus is powered on when the vehicle ignition is turned on. Of course, a small battery other than the vehicle drive battery may be built in and always activated. In order to prevent wear, it is preferable to charge a small battery during traveling.
[0014]
The “current position acquisition unit 1” acquires a meeting place between the first user and the second user. The current position acquisition unit 1 acquires the current position via the current position detection unit 410 of the navigation measure 400. The current position detection means 410 detects the current position of the vehicle on which the first user is boarding using a GPS function (Global Positioning System) and a vehicle position detection function such as a gyro sensor.
[0015]
The “waiting place acquisition unit 2” acquires position information of a place where the first user and the second user meet via the information input device 300 or the destination acquisition unit 422. The acquired information on the meeting place may be position information input to the meeting information input unit 310 or position information input to the navigation device 400 as a destination. Further, the position information of the meeting place may be acquired from the schedule data described by a predetermined method.
[0016]
The “traveling direction predicting means 3” includes a route calculation unit 31 and a road shape reference unit 32, and the first user arriving at the meeting place based on the positional relationship between the current position of the first user and the meeting place. Predict the direction of travel. The traveling direction prediction process of the traveling direction predicting means 3 will be described with reference to FIG.
[0017]
The “route calculation unit 31” is stored in the storage device 600 based on the positional relationship between the current position of the first user acquired by the current position acquisition unit 1 and the meeting place acquired by the meeting place acquisition unit 2. By referring to the map information, the route from the current position to the meeting place is calculated. FIG. 2 shows a route calculated based on the map information. From the calculated route and the travel history of the first user (including the current position), the traveling direction a of the first user that has arrived at the meeting place A can be estimated.
[0018]
In the present embodiment, it is estimated that a meeting place that is the end point of the guide route and a line connecting a point several meters before the guide route on the guide route is the traveling direction. Note that the route calculation process may be performed by the route calculation unit 420 of the navigation device 400 to acquire the calculated route. When the information transmitting / receiving apparatus 100 is not mounted on the vehicle, the route of the first user is calculated using an electronic compass, a triaxial geomagnetic sensation, and an acceleration sensor.
[0019]
The “road shape reference unit 31” acquires the stored road shape in advance. When the road shape reference unit 31 is activated, the traveling direction prediction unit 3 refers to the acquired road shape based on the positional relationship between the current position of the first user and the meeting place, and reaches the meeting place. Predict the direction of travel. If it is assumed that the traveling direction is a line connecting a meeting place and a point a few meters before the meeting place, the second user may not be found in the traveling direction if the road shape is complicated. Therefore, in the present embodiment, the road shape reference unit 31 is provided, and the traveling direction predicting unit 3 estimates the direction along the road shape as the traveling direction.
[0020]
Thereby, even when the road at the meeting place has a special shape such as a rotary, it is possible to determine the accurate traveling direction at the meeting place by referring to the road shape. The traveling direction obtained as a prediction result is sent to the imaging command generation means 5.
[0021]
When the traveling direction estimated based on the route calculated by the route calculation unit 31 and the traveling direction estimated based on the road shape read by the road shape reference unit 32 are different, the traveling direction prediction means 3 is either 1 may be determined as a priority, or a combined direction of two estimated directions may be determined as the direction of travel.
[0022]
The “viewpoint position calculation unit 4” calculates the position of the viewpoint of the first user. The video that the first user sees at the meeting place varies depending on the viewpoint of the first user. However, since the vehicle height of the vehicle used by the first user varies and the height of the first user varies, the viewpoint of the first user (driver) driving the vehicle is not constant. In order to accurately capture an image viewed by the first user, it is necessary to consider the viewpoint position of the first user according to the vehicle height and the height of the driver of the vehicle. In the present embodiment, in order to determine the imaging position of the video to be imaged according to the viewpoint position of the first user, the viewpoint position calculation means 4 is provided to calculate the viewpoint position of the first user.
[0023]
Specifically, the viewpoint position calculating unit 4 calculates the viewpoint position by detecting the position of the eyes of the first user who gets on the vehicle using a camera provided in the vehicle. In addition, the vehicle information regarding the received vehicle height may be acquired to calculate the viewpoint position of the first user, or the vehicle height previously associated with the vehicle ID and the height associated with the driver ID are stored in advance. The calculated viewpoint position of the first user may be sent to the imaging command generation unit 5 as necessary.
[0024]
The “imaging command generating unit 5” generates an imaging command for capturing an image of a meeting place in a predetermined imaging direction based on at least the traveling direction predicted by the traveling direction predicting unit 3. Further, in consideration of the viewpoint position of the first user, the “imaging command generation unit 5” is configured so that the imaging direction based on the traveling direction predicted by the traveling direction prediction unit 3 and the first user calculated by the viewpoint position calculating unit. An imaging command for capturing an image of a meeting place at an imaging position based on the viewpoint position may be generated. Specifically, the imaging command generation means 5 has an imaging direction calculation function for calculating the imaging direction included in the imaging command based on the traveling direction, and outputs an imaging command using the imaging direction calculated by the imaging direction calculation function. Generate. The imaging command generation means 5 has an imaging position calculation function for calculating an imaging position included in the imaging command based on the viewpoint position, and generates an imaging command using the imaging position calculated by the imaging position calculation function. . That is, the imaging command generated by the imaging command generation unit 5 includes information for specifying the imaging direction and / or imaging position.
[0025]
The imaging command may include a command for imaging the second user. This is because the second user can be easily found if the second user's appearance, clothes, color of clothes, belongings, etc. can be known in advance.
[0026]
First, an imaging command including an imaging direction will be described.
The information specifying the imaging direction included in the imaging command is information based on at least two-dimensional azimuth information of east, west, south, and north. The imaging direction included in the imaging command is preferably substantially the same direction at least in the horizontal direction as the traveling direction predicted by the traveling direction predicting means 3. Thereby, it is possible to capture an image in the imaging direction along the traveling direction of the first user arriving at the meeting place. However, the traveling direction and the imaging direction are not limited to being substantially the same direction, and the imaging direction may be defined to have a predetermined angle with respect to the traveling direction. The predetermined angle is not particularly limited, and can be set in the range of the left-right direction (0 ° to 30 °) based on the traveling direction. For example, when the information transmitting / receiving apparatus 100 is mounted on a vehicle, the imaging direction is preferably a direction rotated by a predetermined angle toward the shoulder side of the road with respect to the traveling direction. In such a case, it can be set in the range of the left side or the right side (0 ° to 20 °) based on the traveling direction. This is because it is considered that the image on the shoulder side where the store or facility is located contains more information as a mark of the meeting place than the image in the same direction as the traveling direction of the vehicle traveling on the roadway.
[0027]
The imaging command generation means 5 processes the imaging direction based on the predicted traveling direction into information that can be recognized by the second user, and includes the information in the imaging command. The processing method of the imaging direction is not particularly limited, and the imaging direction may be indicated to the second user as an orientation (east, west, south, and north), or the imaging direction may be converted into an image such as an arrow and indicated to the second user. The imaging direction may be expressed by an icon that can specify the orientation and shown to the second user. Since the second user's mobile terminal 200 includes the electronic compass 204, the imaging direction included in the imaging command can be recognized as data, and the imaging direction can be displayed with an icon or the like.
[0028]
FIG. 3 shows an example of an “imaging command for capturing an image of a meeting place in a predetermined imaging direction” shown to the second user. In this imaging command, the “imaging direction” is instructed to the second user by an icon that can specify the direction.
[0029]
FIG. 3A shows the front of the mobile terminal 200 possessed by the second user, and FIG. 3B shows the back of the mobile terminal 200. On the front and back of the portable terminal 200, a monitor M.M. M ′ is provided. On the monitors M and M ′, icons capable of specifying the direction are displayed.
[0030]
FIG. 3C shows icon display when the imaging direction, that is, the camera direction is not correct. As shown in FIG. 3C, when the orientation of the camera unit 202 of the mobile terminal 200 that is directed to take an image is not correct, an X mark is displayed on the icon. When “x” is indicated, it means that the direction seen from the first user boarding the vehicle is different from the imaging direction of the image captured by the second user (waiting person). Since only this display can determine whether or not the imaging direction is correct, a display indicating how much the second user's camera should be rotated may be added. In the present embodiment, the arrow shown next to the icon is an arrow that indicates the direction in which the direction of the camera is corrected and the degree of correction. A large arrow indicates that the angle for rotating the direction of the camera is large, and a small arrow indicates that the angle for rotating the direction of the camera is small. The icon in FIG. 3C instructs the second user to rotate the camera direction to the left, and the icon in FIG. 3D instructs the second user to rotate the camera slightly to the left. I am instructing. When the orientation of the camera, that is, the imaging direction becomes a direction according to the imaging command by the adjustment of the second user, the icon display changes (from “×” to “•”) as shown in FIG. In this way, the second user adjusts the orientation of the mobile terminal 200 so that the icon of FIG.
[0031]
In this way, by sending a command to the second user to image the video at the meeting place in the imaging direction based on the traveling direction, the video viewed from the same direction as the direction in which the first user looks at the meeting place is sent to the second user. An image can be taken.
[0032]
Next, an imaging command including an imaging position based on the viewpoint position of the second user will be described.
The information specifying the viewpoint position is at least two-dimensional height information along the direction of gravity. The line-of-sight position included in the imaging command may be calculated based on the height of the vehicle on which the second user is boarded and the height of the second user. Of course, the eyes of the second user may be detected by a camera installed in the vehicle, and the detected eye position may be set as the line of sight.
[0033]
The imaging command generation means 5 processes the imaging position based on the calculated viewpoint position into information that can be recognized by the second user, and includes it in the imaging command. The processing method of the imaging position is not particularly limited, and the imaging position may be indicated to the second user as the height, or the imaging position may be indicated to the second user by representing the position with an icon capable of specifying the position. .
[0034]
FIG. 4 shows an example of an “imaging command for capturing an image of a meeting place at a predetermined imaging position” shown to the second user. In this imaging command, the “imaging direction” is instructed to the second user by an icon that can specify the direction.
[0035]
The portable terminal 200 shown in FIGS. 4 (a) and 4 (b) is the same as the portable terminal 200 shown in FIGS. 3 (a) and 3 (b). FIG. 4C shows icon display when the imaging position, that is, the camera position is not correct. As shown in FIGS. 4C and 4D, when the position of the camera unit 202 of the mobile terminal 200 directed to take an image is not correct, the circles indicated on the icons do not overlap. When the position of the camera, that is, the imaging position becomes a position according to the imaging command by the adjustment of the second user, two circles displayed on the icon overlap as shown in FIG. In this way, the second user adjusts the position of the mobile terminal 200 so that the icon of FIG.
[0036]
In this manner, by sending a command to the second user to image the video at the meeting place at the imaging position based on the viewpoint position of the first user, the video viewed from the same place where the first user sees the meeting place is viewed. The second user can take an image.
[0037]
In addition, the operation of adjusting the imaging position based on the viewpoint position is performed after the above-described imaging direction is determined. That is, the second user (waiting person) maintains the state where the icon “•” is displayed on the monitor of the mobile terminal 200 (the imaging direction in accordance with the imaging command), while the two circles of the icons overlap (imaging command) To capture the meeting place).
[0038]
In this way, by sending a command to the second user to capture an image of the meeting place at the image pickup direction based on the traveling direction and the image pickup position based on the first user's viewpoint position, the direction in which the first user views the meeting place and A video image viewed from the same direction and location as the location can be captured by the second user.
[0039]
As described above, the first user can cause the second user to pick up an image having the same direction and / or position as the image viewed by the first user and refer to the image that has been picked up. It can be easily found.
[0040]
Thus, the image | video image | photographed by the meeting other party is transmitted to the vehicle side. When this video is received on the vehicle side, it is displayed on the monitor of the in-vehicle information terminal. By referring to the displayed video, the vehicle driver can search for a meeting partner and smoothly perform the meeting.
[0041]
The “transmission / reception means 6” has an information transmission / reception function, and transmits / receives information to / from the portable terminal 200 at least. The information to be transmitted / received includes at least an imaging command and a video of a meeting place taken by the mobile terminal 200 on the second user side.
[0042]
The transmission / reception means is not particularly limited. For example, a general telephone, a mobile phone, a PHS phone, an in-vehicle phone using a public line network, a mobile communication device using a public communication network such as a module with a built-in communication function, an MCA (Multi Channel Access System) wireless system, Bluetooth, IEEE 802.11 system It may be a wireless communication function (DSRC (Dedicated Short Range Communications)) according to other wireless LAN standards (802.11a, 802.11b, 802.11g, etc.). In the present embodiment, a wireless LAN or DSRC (Dedicated Short Range Communications) is adopted from the viewpoint of reducing communication charges.
[0043]
Note that the transmission / reception means 6 is an information transmission / reception device 100 such as Bluetooth or infrared (IrDA), or wired such as RS-232C (serial interface), USB (Universal Serial Bus), or UART (Universal Asynchronous Receiver Transmitter). Connected with each configuration.
[0044]
Next, a control procedure of the information transmitting / receiving apparatus 100 according to the present embodiment will be described based on the flowchart of FIG.
The transmission / reception means 6 confirms that a link is established between the information transmission device 100 mounted on the vehicle and the communication terminal existing in the vehicle (S111). The first user performs a connection operation until the link is established, and waits until the link is established. When it is confirmed that the link is established, the process proceeds to S112.
[0045]
In S112, the navigation device 400 is initialized. Specifically, the contents of the DVD-ROM and the hard disk are read and the current position detecting means 410 mounted on the vehicle is activated.
[0046]
The current position acquisition means 1 acquires the current position of the vehicle on which the first user is boarded via the current position detection means 410 of the navigation device 400 (S113).
[0047]
The meeting place acquisition unit 2 acquires the meeting place through the meeting information input unit 310 or the destination acquisition unit 422 of the navigation device 400 (S114). The method for inputting the meeting place is not limited and can be input by the same method as the destination input in a general navigation apparatus. For example, a method of selecting and inputting a genre from a menu or the like, a method of inputting a telephone number, a method of directly inputting an address, or the like can be used.
[0048]
The route calculation unit 31 of the traveling direction predicting means 3 calculates a guide route from the current position to the meeting place from the positional relationship between the current position and the meeting place (S115). This guidance route calculation process may be performed by the route calculation means 420 of the navigation device 400. The road shape reference unit 32 accesses the storage device 600 and reads the road shape (S116).
[0049]
The traveling direction predicting means 3 predicts the traveling direction of the first user arriving at the meeting place from the positional relationship between the current position and the meeting place. In the present embodiment, in addition to the positional relationship between the current position and the meeting place, the traveling direction is predicted with reference to the road shape (S117).
[0050]
The imaging command generation unit 5 determines the imaging direction based on the traveling direction predicted by the traveling direction prediction unit 3 (S118). The viewpoint position calculation unit 4 calculates the viewpoint position of the first user (S119). The imaging command generation unit 5 determines the imaging position based on the viewpoint position calculated by the viewpoint position calculation unit 4 (S120). That is, the imaging command generation unit 5 determines an imaging direction based on the traveling direction and an imaging position based on the viewpoint position.
[0051]
The imaging command generation means 5 specifies at least the imaging direction and generates an imaging command for capturing an image of the meeting place in the specified imaging direction. The imaging command may include an imaging position based on the viewpoint position (S121).
[0052]
The imaging command generation unit 5 sends the imaging command to the mobile terminal 200 on the second user side via the transmission / reception unit 6 (S122). The imaging command transmission process can be performed using a general information transmission / reception application such as an electronic mail or an instant messenger.
[0053]
The imaging command includes an imaging direction and an imaging position, and the imaging direction (camera direction (horizontal direction)) and imaging position (driver viewpoint direction (vertical direction)) are displayed as icons on the mobile terminal 200 on the second user side. (S123).
[0054]
The information transmitting apparatus 100 waits for reception of the image of the waiting place imaged by the second user from the mobile terminal 200 (S124). The video received via the transmission / reception means 6 is displayed on the monitor of the presentation device 500 (S125, S126).
[0055]
The information transmitting / receiving apparatus 100 configured and functioning as described above has the following effects.
The first user who picks up the second user (waiting person) predicts the traveling direction when arriving at the meeting place, and issues an imaging command for capturing an image of the meeting place in the imaging direction based on the predicted traveling direction. Since it is transmitted to the two users, the first user can acquire the video imaged along the direction of his / her own line of sight, so the second user can be easily found with reference to this video image.
[0056]
Depending on the position identification accuracy of the in-vehicle navigation device 400, it may be difficult to identify even the place where the person is standing, but the place where the person came for the first time if looking at the video of the place where the waiting person is standing in advance Even so, the location can be easily identified. That is, the first user can search for a meeting partner while watching the video, and can smoothly search for a waiting person even in a complicated place or an incomprehensible place. Moreover, since the captured image is captured from the direction that the second user will see at the destination, the image is meaningful as a clue to search for the waiting person.
[0057]
Since the road shape is referred to in predicting the traveling direction of the first user, the traveling direction of the first user heading to the meeting place can be appropriately predicted even in a place where the road shape is complicated, such as a rotary station.
[0058]
The viewpoint position of the first user who picks up the second user (waiting person) is calculated, and an imaging command for capturing an image of the meeting place at the imaging direction based on the traveling direction and the imaging position based on the viewpoint position is transmitted to the second user. Thus, the first user can acquire a video that matches the viewpoint position of the first user. That is, it is possible to capture an image in which the difference in the appearance of the scenery due to the difference in vehicle height and height is corrected. The first user can easily find the second user with reference to the video captured from the viewpoint common to the first user's viewpoint.
[0059]
[Second Embodiment]
Next, the information transmission / reception apparatus 100 of 2nd Embodiment is demonstrated.
The information transmitting / receiving apparatus 100 according to the second embodiment causes the second user to capture an image corresponding to the visual field range of the first user. That is, the present embodiment calculates the first user's visual field range, generates an imaging command for capturing an image of the meeting place at a predetermined imaging magnification or imaging distance based on the visual field range, and outputs the imaging command to the second user. Send to the side. The configuration of the second embodiment is shown in FIG. As shown in FIG. 6, the configuration of the information transmitting / receiving apparatus 100 of the second embodiment is basically the same as the configuration of the first embodiment shown in FIG. The difference is that the information transmitting / receiving apparatus 100 according to the second embodiment has a visual field range calculating means 7. Moreover, the imaging command generation means 5 of 2nd Embodiment has an imaging magnification calculation function and an imaging distance calculation function. Here, different points will be mainly described.
[0060]
The “view range calculation means 7” calculates the range of the viewpoint of the first user. A method for calculating the range of the visual field is not particularly limited. FIG. 7 shows two calculation examples for calculating the visual field range of the first user boarding the vehicle.
[0061]
The example shown in FIG. 7A is a method of taking a scene using a camera installed in a vehicle and specifying the visual field range of the first user from the four-dimensional three-dimensional coordinates of the image. In FIG. 7A, the range that the first user can see through the windshield is associated with the visual field range, and the visual field range is specified by four points of coordinate values r1 to r4. The video corresponding to the visual field range preferably corresponds to the size of the monitor 500 that displays the captured video.
[0062]
Since the first user searches for the second user while comparing the scene actually viewed with the video captured by the second user, the scene actually viewed by the first user and the video captured by the second user are in the same range. A video is preferred. In the present embodiment, by generating the imaging command based on the visual field range of the first user, the video according to the imaging command can be displayed as the same scene as the video that the first user actually sees at the meeting place. . Incidentally, when the video imaged by the second user is a video with a small range of coordinate values r01 to r04 as shown in FIG. 7A, this video is actually viewed by the first user at the meeting place. The scene is different from the video, and it is difficult to find the second user based on the video.
[0063]
The example shown in FIG. 7B is an example in which the visual field range of the first user is measured using the eye tracking function. As shown in FIG. 7B, the field-of-view range calculation means 7 stores a viewpoint movement history using a camera that detects the movement of the viewpoint of the first user, and coordinates values r11 to r1 from the movement history distribution. The coordinate value r14 is calculated as the visual field range.
[0064]
The imaging magnification calculation function of the imaging command generation unit 5 determines the imaging magnification based on the visual field range surrounded by the coordinate values r1 to r4. The imaging distance calculation function determines the imaging distance based on the visual field range surrounded by the coordinate values r1 to r4. The imaging magnification and the imaging distance are preferably determined so as to substantially match at least the visual field range of the first user, and more preferably determined so as to substantially match the visual field range of the first user and the display range of the monitor 600. . When information (imaging magnification, imaging distance, etc.) of the camera means 202 of the mobile terminal 200 is necessary for determining the imaging magnification and imaging distance, a request command is transmitted to the mobile terminal 200 of the second user, and transmission / reception is performed. Necessary information is acquired through the means 6. Of course, information related to the mobile terminal 200 may be stored or acquired in advance, or model information may be acquired from the mobile terminal 200 and information corresponding to the model may be read from the stored information.
[0065]
The calculated imaging magnification and / or imaging distance is included in the imaging command in addition to the imaging direction and the like. That is, the imaging command of this embodiment may include an imaging direction, imaging magnification, and / or imaging distance, and may include an imaging direction, imaging position, imaging magnification, and / or imaging distance.
[0066]
The imaging command generation means 5 processes the imaging magnification and the imaging distance based on the calculated visual field range into information that can be recognized by the second user, and includes the information in the imaging command. The processing method of the imaging magnification and the imaging distance is not particularly limited, and the imaging magnification and the imaging distance may be shown as numerical values to the second user, or the imaging magnification and the imaging distance may be expressed by an icon that can be specified. It may be shown to the user.
[0067]
FIG. 8 shows an example of an “imaging command for capturing an image of a meeting place at a predetermined imaging magnification and / or imaging distance” shown to the second user. In this imaging command, an “imaging magnification” and “imaging distance” are instructed to the second user by an icon that can specify an imaging magnification and an imaging distance.
[0068]
FIG. 8A shows the front of the mobile terminal 200 possessed by the second user, and FIG. 8B shows the back of the mobile terminal 200. On the front and back of the portable terminal 200, a monitor M.M. M ′ is provided. On the monitors M and M ′, icons capable of specifying the direction are displayed.
[0069]
FIG. 8C shows the display of the icon M21 when the imaging magnification and / or imaging distance is not correct. As shown in FIG. 8C, when the imaging magnification is large and the imaging distance is short, a comparative circle (dotted line) that is smaller than the reference circle (solid line) is shown. The relative difference between the size of the reference circle and the comparison circle corresponds to the difference between the imaging magnification and imaging distance of the imaging command, and the imaging magnification and imaging distance that are actually imaged.
[0070]
When the comparison circle (dotted line) is smaller or larger than the reference circle (solid line), the imaging magnification and the imaging distance need to be adjusted. As with the icon shown in FIG. 8C, the imaging magnification and the imaging distance of the icon shown in FIG. 8D are not appropriate. Further, the imaging magnification and imaging distance are adjusted, and when the state shown in FIG. 8E, that is, when the sizes of the reference circle (solid line) and the comparison circle (dotted line) substantially match, the imaging magnification and imaging of the mobile terminal 200 are obtained. The distance is an imaging magnification and an imaging distance according to the imaging command.
[0071]
The imaging command may include an imaging magnification and an imaging distance, or may include one of the imaging magnification and the imaging distance. Since there is a limit to the imaging magnification, it is preferable to include the imaging distance together with the imaging magnification in the imaging command so as to capture the landscape according to the field of view range.
[0072]
An imaging command including the calculated imaging magnification and imaging distance is transmitted from the information transmitting / receiving device 100 to the mobile terminal 200 on the second user side. The second user captures an image of the meeting place according to the instruction based on the imaging command.
[0073]
In this way, by sending an imaging command including an imaging magnification based on the first user's visual field range and an image of capturing an image of the meeting place at the imaging distance to the second user, the same as the first user's visual field. The image of the range of can be made to image a 2nd user.
[0074]
As described above, the first user can easily search for the second user because the second user can take an image whose visual field range coincides with the image seen by the first user and can refer to the taken image. be able to.
[0075]
Next, the processing procedure of 2nd Embodiment is demonstrated based on the flowchart of FIG.
[0076]
The processing from S111 to S118 shown in FIG. 9 is common to the control processing of the first embodiment shown in FIG. In the present embodiment, the imaging command includes the imaging direction, the imaging magnification, and / or the imaging distance. Of course, the processing from S119 to S121 of the first embodiment may be included, and the imaging position may be included in the imaging command.
[0077]
Here, the process after S201 different from 1st Embodiment is demonstrated.
[0078]
First, the visual field range of the first user who gets on the vehicle is calculated (S201). The visual field range is calculated using the above-described on-vehicle camera and eye tracking function. The imaging magnification determination function determines the imaging magnification, and the imaging distance determination function determines the imaging distance. A magnification and a distance are calculated such that the visual field range of the first user matches the video range displayed on the monitor 500.
[0079]
The imaging command generation unit 5 generates an imaging command including the imaging direction, the imaging magnification, and / or the imaging distance (S203). The generated imaging command is transmitted to the portable terminal 200 via the transmission / reception means 6 (S204). An icon for setting / changing the imaging direction, the imaging magnification and / or the imaging distance is displayed on the mobile terminal 200 of the second user (S205). In this embodiment, the second user has set / changed the imaging magnification and the imaging distance by the icon, but the imaging instruction may be changed directly on the application installed in the camera unit 202 of the mobile terminal 200. Good. The change of the imaging magnification may be instructed directly to the camera means 202 or may be instructed to the second user.
[0080]
The information transmitting / receiving apparatus 100 waits for reception of the image captured by the second user (S206). When the captured video is received (S207), it is displayed on the monitor 500 (S208).
[0081]
According to the present embodiment, in addition to the effects of the first embodiment, since the range of the scenery that can be actually seen from the first user matches the range of the image captured by the second user, The actual scenery can be directly compared with the video imaged by the second user, and the second user can be easily found.
[0082]
[Third Embodiment]
Next, a third embodiment will be described.
The information transmitting / receiving apparatus 100 according to the third embodiment converts the video received from the second user into video according to the imaging command. Even if an imaging direction, an imaging position, an imaging magnification, and an imaging distance are specified by an imaging command, an image that does not comply with the command may be captured. In this embodiment, the video imaged in such a case is corrected to a video image according to the imaging command.
The configuration of the third embodiment is shown in FIG. As shown in FIG. 10, the configuration of the information transmitting / receiving apparatus 100 of the third embodiment is basically the same as the configuration of the second embodiment shown in FIG. The difference is that the information transmitting / receiving apparatus 100 of the third embodiment has a video converting means 8. Here, different points will be mainly described.
[0083]
The information transmitting / receiving apparatus 100 according to the present embodiment includes a video conversion unit 8. The video conversion means 8 acquires the captured video of the meeting place and the imaging direction of the video from the second user side, compares the acquired video imaging direction with the imaging direction included in the imaging command, and acquires the video The video is converted into a video according to the imaging direction of the imaging command.
[0084]
The “video converting means 8” converts the video captured by the second user into a video according to the imaging command. Specifically, a three-dimensional coordinate conversion process is performed from a video imaged in the imaging direction B (projection surface B) to a video imaged in the imaging direction A (imaging command) (projection surface B). A general method can be used for the coordinate conversion processing performed here, and an example thereof will be described with reference to FIGS. 11 and 12.
[0085]
First, the conversion process regarding the imaging direction will be described with reference to FIG. FIG. 11 is a view of the imaging point and the video screen as viewed from above. The projection plane (video plane) of the video imaged by the second user is the B plane, and the projection plane (video plane) of the video imaged in the video direction according to the imaging command is the A plane. The imaging direction of the actually captured video is detected using the electronic compass 204 of the mobile terminal 200 on the second user side, and is acquired from the second user together with the captured video. The imaging direction of the actually captured image is compared with the imaging direction included in the imaging command. In the example shown in FIG. 11, there is a difference in angle θ between the A plane and the B plane. Based on the angle θ, the image projected on the B plane is converted to the A plane. That is, the captured landmark P on the B plane is mapped to the landmark P ′ on the A plane. This makes it possible to convert a video that was not shot from the correct angle into a video that was shot from an almost arbitrary angle, and convert a video whose imaging direction does not follow the imaging command to a video that follows the imaging command. Can do.
[0086]
Based on FIG. 12, the conversion process regarding an imaging distance is demonstrated. FIG. 12 is a view of the imaging point and the video screen as viewed from above. The projection plane (video plane) of the video imaged by the second user is the B plane, and the projection plane (video plane) of the video imaged in the video direction according to the imaging command is the A plane. The imaging distance of the actually captured image is detected using the camera means 202 of the mobile terminal 200 on the second user side, and is acquired from the second user together with the captured image. The imaging distance of the actually captured image is compared with the imaging distance included in the imaging command. In the example shown in FIG. 12, there is a difference of Δd = d2−d1 between the A surface and the B surface. Based on the distance difference Δd, the image projected on the B plane is converted to the A plane. That is, the captured landmark R on the B plane is mapped to the landmark R ′ on the A plane. This makes it possible to convert video that was not shot at the correct imaging distance into video that was shot from almost any imaging distance, and convert video that does not follow the imaging command to video that follows the imaging command. can do.
[0087]
Here, the processing of the video conversion unit 8 has been described by taking the imaging direction and the imaging distance as an example, but the video conversion unit 8 uses the coordinate conversion processing for the imaging position and the imaging magnification to obtain the video according to the imaging command. be able to.
[0088]
The processing from S111 to S118 shown in FIG. 13 is the same as the control processing of the first embodiment shown in FIG. 5 as in the second embodiment. In the present embodiment, the imaging command includes the imaging direction, the imaging magnification, and / or the imaging distance. Of course, the processing from S119 to S121 of the first embodiment may be included, and the imaging position may be included in the imaging command.
[0089]
Here, the processing after S301 different from the first embodiment will be described.
[0090]
An image captured by the second user is acquired. In this step, along with the video, the imaging direction, imaging position, imaging magnification, and imaging distance of the video are acquired as necessary (S207). The video conversion means 8 detects the difference between the B plane that is the actually captured image plane and the A plane that is the image plane according to the imaging command. Specifically, from the feature points on both planes (4 points on the screen corner),
[0091]
[Expression 1]
Plane equation
A plane: a _A x + b _A y + c _A z + d _A = 0
B plane: a _B x + b _B y + c _B z + d _B = 0
Is calculated, and the vertical vectors of both planes and the angle formed by the vertical vectors are calculated therefrom.
[0092]
In S312, a conversion (mapping) is performed from the actually shot image plane (B plane) to the video year (A plane) actually viewed by the first user. For the video conversion (mapping), the process shown in FIG. 11 is performed using the angle formed by both planes calculated in S311.
[0093]
According to the present embodiment, when the second user cannot capture images according to the correct imaging direction, imaging position, imaging magnification, and imaging distance, an image captured with the imaging direction, imaging position, imaging magnification, and imaging distance according to the imaging command is displayed. It can be provided to the first user.
[0094]
That is, the first user can obtain an image corresponding to the traveling direction at the meeting place, and can easily find the second user. The first user can obtain an image corresponding to the viewpoint position, and can easily find the second user. The first user can obtain an image corresponding to the visual field area, and can easily find the second user.
[0095]
When the second user's mobile terminal 200 does not have a function for displaying an imaging command as an icon as shown in FIGS. 3, 4, and 8, it is difficult to capture an image that accurately follows the imaging command. . According to the present embodiment, even a video captured by the mobile terminal 200 that does not have a function of displaying an imaging command with an icon can be converted into a video according to the imaging command, and the first user is the second user The second user can be easily searched with reference to the video obtained from the above.
[0096]
Although the information transmission / reception apparatus 100 has been described in the present embodiment, a computer that operates according to the information transmission / reception program of the present invention operates in the same manner as the information transmission / reception apparatus 100 and has the same effects.
[0097]
The embodiment described above is described for facilitating the understanding of the present invention, and is not described for limiting the present invention. Therefore, each element disclosed in the above embodiment is intended to include all design changes and equivalents belonging to the technical scope of the present invention.
[Brief description of the drawings]
FIG. 1 is a block diagram of an information transmitting / receiving apparatus 100 according to a first embodiment.
FIG. 2 is a diagram for explaining processing of a traveling direction predicting unit 3;
FIGS. 3A to 3E are diagrams for explaining a first example of a display mode of an imaging command.
FIGS. 4A to 4E are diagrams for explaining a second example of a display mode of an imaging command.
FIG. 5 is a flowchart showing a control procedure of the information transmitting / receiving apparatus 100 of the first embodiment.
FIG. 6 is a block diagram of an information transmitting / receiving apparatus 100 according to the second embodiment.
FIG. 7 is a diagram for explaining processing of a visual field range calculation unit 7;
FIGS. 8A to 8E are diagrams for explaining a third example of a display mode of an imaging command.
FIG. 9 is a flowchart showing a control procedure of the information transmitting / receiving apparatus 100 of the second embodiment.
FIG. 10 is a block diagram of an information transmitting / receiving apparatus 100 according to a third embodiment.
FIG. 11 is a first diagram for explaining the processing of the video conversion means 8;
FIG. 12 is a second diagram for explaining the processing of the video conversion means 8;
FIG. 13 is a flowchart showing a control procedure of the information transmitting / receiving apparatus 100 of the third embodiment.
[Explanation of symbols]
100: Transmission / reception device
1 ... Current position acquisition means
2 ... Meeting place acquisition means
3 ... Travel direction prediction means
31: Route calculation unit
32 ... Road shape reference part
4. Viewpoint position calculation means
5 ... Imaging command generation means
6 ... Transmission / reception means
7: Field of view range calculation means
8 ... Video conversion means
200 ... mobile terminal
300 ... Information input device
400 ... navigation device
500 ... presentation device
600 ... Storage device

Claims (8)

An information transmitting / receiving apparatus provided on one user side for meeting with another user at a predetermined meeting place, and for transmitting / receiving information to / from the other user side,
Current position acquisition means for acquiring the current position of the one user;
A meeting place acquisition means for acquiring a meeting place between the one user and another user;
A traveling direction predicting means for predicting a traveling direction of the one user arriving at the meeting place based on a positional relationship between the current position of the one user and the meeting place;
An imaging command generating unit that generates an imaging command for capturing an image of the meeting place in a predetermined imaging direction based on the traveling direction predicted by the traveling direction predicting unit;
An information transmission / reception apparatus comprising: a transmission / reception unit that transmits the imaging command generated by the imaging command generation unit to the other user. The advancing direction prediction means acquires the road shape of the meeting place in advance, and refers to the acquired road shape based on the positional relationship between the current position of the one user and the meeting place, and the meeting place The information transmission / reception apparatus according to claim 1, wherein the traveling direction of the one user arriving at the terminal is predicted. Viewpoint position calculating means for calculating the viewpoint position of the one user,
The imaging command generation unit includes a predetermined imaging direction based on the traveling direction predicted by the traveling direction prediction unit, and a predetermined imaging position based on the viewpoint position of the one user calculated by the viewpoint position calculating unit. The information transmission / reception apparatus according to claim 1, wherein an imaging command for capturing an image of the meeting place is generated. Visual field range calculating means for calculating the visual field range of the one user,
The imaging command generation unit further includes a command for capturing an image of the waiting place at an imaging magnification or an imaging distance based on the visual field range calculated by the visual field range calculation unit. The information transmitting / receiving apparatus according to any one of the above. The captured video of the meeting place and the imaging direction in which the video is captured are acquired from the other user side, the imaging direction of the acquired video is compared with the imaging direction included in the imaging command, The information transmitting / receiving apparatus according to claim 1, further comprising: a video conversion unit that converts the acquired video into a video according to an imaging direction of the imaging command. The video conversion means acquires the captured video of the meeting place and the imaging position of the video from the other user side, and compares the acquired imaging position of the video with the imaging position included in the imaging command. The information transmitting / receiving apparatus according to claim 5, further comprising a function of converting the acquired video into a video according to an imaging position of the imaging command. The video conversion means acquires the captured video of the meeting place and the imaging magnification and / or imaging distance of the video from the other user side, and acquires the imaging magnification and / or imaging distance of the acquired video and the imaging distance. The information according to claim 5 or 6, further comprising a function of comparing an imaging magnification and / or an imaging distance included in an imaging command and converting the acquired video into an image according to the imaging magnification and / or imaging distance of the imaging command. Transmitter / receiver. To the computer on the one user's side who meets with other users at a predetermined meeting place,
A function of acquiring a current position of the one user;
A function of obtaining a meeting place between the one user and another user;
A function of predicting a traveling direction of the one user arriving at the meeting place based on a positional relationship between the current position of the one user and the meeting place;
A function of generating an imaging command for capturing an image of the meeting place in a predetermined imaging direction based on the predicted traveling direction;
An information transmission / reception program for realizing a function of transmitting the generated imaging command to the other user.

Images