JP2016035432A - Terminal device, control method of terminal device, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a terminal device capable of finding easily own vehicle, even if the kind of a vehicle borrowed by oneself is forgotten; and to provide a control method and a program.SOLUTION: A terminal device includes: guidance relevant information reception means for acquiring parking position information showing a parking position where a vehicle is parked, and acquiring vehicle identification information for specifying the vehicle; and guidance image display means for displaying the vehicle identification information 52 together with the guidance image 51 for guiding a user to the parking position based on the acquired parking position information.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a terminal device that guides a user to a parking position where a vehicle is parked, a control method for the terminal device, and a program.

  Conventionally, as this type of terminal device (mobile terminal device), a first receiving means for receiving vehicle point coordinates indicating a parking position of a vehicle from an in-vehicle device, and a transmission for transmitting the received vehicle point coordinates to the information providing device. And a second receiving means for receiving the guidance information from the information providing device, and a guidance means for guiding the user to the parking position of the vehicle using the guidance information (Patent Literature). 1). The guidance means displays a guidance route from the current location of the terminal device to the vehicle point coordinates (vehicle parking position) and a map image of the parking lot, and guides the user to the parking position of the vehicle.

JP 2013-148419 A

By the way, when such a terminal device is used, the user visually confirms the vehicle after coming to the vicinity of the parking position of the vehicle according to the displayed guidance route and map image, and the vehicle is his / her own vehicle. It will be confirmed whether there is, and will discover his own vehicle.
However, in the case where the vehicle is a vehicle rented by a rental car, car sharing, or the like, the user may have forgotten what the vehicle was. In such a case, even if it comes to the vicinity of the parking position of the vehicle, it takes time to confirm the above, and it takes time to find your vehicle. As described above, the conventional terminal device has a problem that it is complicated to find the vehicle if the user forgets what the vehicle is.

  The present invention provides a terminal device, a terminal device control method, and a program capable of easily discovering the user's vehicle even if the user has forgotten what the vehicle he borrowed was. It is an issue.

  The terminal device of the present invention includes a parking position acquisition unit that acquires parking position information indicating a parking position where a vehicle is parked, an identification information acquisition unit that acquires vehicle identification information for specifying the vehicle, and the acquired parking position information. And a display means for displaying vehicle identification information together with a guidance image for guiding the user to the parking position.

  In this case, it is preferable that the vehicle identification information includes at least one of vehicle model name information, an appearance image, and a license plate image or automobile registration number information.

  On the other hand, the guide image is a parking map image showing a route from the entrance of the parking lot to the parking position on the map of the parked parking lot, an arrow image showing the direction and distance from the user position to the parking position, It is preferably any one of an augmented reality image indicating a parking position on the captured image.

  In this case, it is preferable to further include guidance image switching means for switching the guidance image between a parking lot map image, an arrow image, and an augmented reality image.

  Moreover, it is preferable that a parking position acquisition means acquires the parking position information transmitted as a trigger from the specific behavior of the vehicle from the in-vehicle device.

  In this case, the specific behavior is preferably at least one of engine stop, door opening / closing, and side brake operation.

  The terminal device control method of the present invention includes a parking position acquisition step in which the terminal device acquires parking position information indicating a parking position where the vehicle is parked, and an identification information acquisition step in which vehicle identification information for specifying the vehicle is acquired. And a display step of displaying vehicle identification information together with a guidance image for guiding the user to the parking position based on the acquired parking position information.

  A program according to the present invention causes a computer to execute each step in the above-described method for controlling a terminal device.

It is a control block diagram of the guidance system concerning one embodiment of this embodiment. It is a functional block diagram of a guidance system. (A) is a diagram showing a guidance screen when the display mode is “parking map mode”, and (b) is a guidance screen when the display mode is “arrow mode”. (C) is a diagram showing a guidance screen when the display mode is “AR mode”. It is the flowchart which showed guidance related information registration operation. It is the flowchart which showed guidance operation | movement.

  Hereinafter, a terminal device, a terminal device control method, and a program according to an embodiment of the present invention will be described with reference to the accompanying drawings. In the present embodiment, a portable terminal to which the terminal device of the present invention is applied and a guidance system including the portable terminal are illustrated. This guidance system is a system that guides the user to the parking position of the vehicle with a portable terminal when the user forgets the position where the user parked his vehicle (the parking position of the vehicle). Moreover, this guidance system assumes that a user is guided to the parking position of the vehicle, not the vehicle owned by the user, but the vehicle borrowed by the user through a rental car or car sharing.

  As shown in FIG. 1, the guidance system SY includes a mobile terminal (terminal device) 1 carried by a user and an in-vehicle device 2 mounted on a vehicle borrowed by the user. The mobile terminal 1 and the in-vehicle device 2 are connected by wireless communication. The portable terminal 1 has a guidance function for guiding the user to the parking position of the vehicle, and the in-vehicle device 2 provides the portable terminal 1 with various information used for the guidance function.

  The in-vehicle device 2 is a car navigation device mounted on a vehicle borrowed by a user, and includes a GPS (Global Positioning System) receiver 11, a self-contained navigation sensor 12, a communication unit 13, a control unit 14, and a storage unit 15. And.

  The GPS receiver 11 receives GPS information (including position information and time information) from a GPS satellite. The self-contained navigation sensor 12 includes various sensors, and is used for detecting the current position of the vehicle in combination with the GPS receiver 11.

  The communication unit 13 performs short-range wireless communication and infrared communication with the mobile terminal 1. Note that Bluetooth (registered trademark), ZigBee (registered trademark), or UWB (Ultra Wide Band) may be applied as a communication method for short-range wireless communication.

  The control unit 14 includes a central processing unit (CPU), a read only memory (ROM), a random access memory (RAM), and the like, and performs overall control of the entire in-vehicle device 2. The storage unit 15 is composed of a hard disk drive or the like, and stores (stores) various information.

  The mobile terminal 1 includes a smartphone, and includes a GPS receiver 21, a camera 22, a 6-axis sensor 23, a display 24, a touch panel 25, a communication unit 26, a control unit 27, and a storage unit 28. And a connection bus 29 for connecting them.

  The GPS receiver 21 receives GPS information from GPS satellites and detects the current position of the mobile terminal 1.

  The camera 22 is composed of an image sensor such as a complementary metal oxide semiconductor (CMOS) or a charge coupled device (CCD), and can capture still images and moving images.

  The 6-axis sensor 23 includes a 3-axis acceleration sensor and a 3-axis magnetic sensor (both not shown), and detects the orientation of the mobile terminal 1, that is, the orientation of the camera 22.

  The display 24 can display an image in color, and displays a guidance screen G (see FIG. 3) and various operation screens for guiding the user to the parking position of the vehicle. The touch panel 25 is configured by a matrix switch superimposed on the display 24, and detects contact with a finger or the like to detect various operations by the user.

  The communication unit 26 performs short-range wireless communication and infrared communication with the in-vehicle device 2. The control unit 27 includes a CPU, a ROM, a RAM, and the like, and performs overall control of the entire mobile terminal 1. The storage unit 28 is configured by a flash ROM or the like, and stores (stores) various information.

  Next, functional configurations of the mobile terminal 1 and the in-vehicle device 2 will be described with reference to FIG. As shown in FIG. 2, the in-vehicle device 2 includes a current position detecting unit 31, a map data storing unit 32, a vehicle identification information storing unit 33, and a guidance related information transmitting unit 34 as main functional configurations. ing. In addition, the in-vehicle device 2 includes other means (a destination setting means, a route search means, etc.) for realizing a car navigation function.

  The current position detection means 31 includes a GPS receiver 11 and a self-contained navigation sensor 12 as main parts, and a vehicle on which the in-vehicle device 2 is mounted based on GPS information from the GPS receiver 11 and a detection result of the self-contained navigation sensor 12. Detect the current position of. The current position detection means 31 always acquires the latest current position by detecting the current position periodically (for example, every second) while the power of the in-vehicle device 2 is turned on.

  The map data storage means 32 stores the map data used for the car navigation function with the storage unit 15 as a main part. The map data includes information on each facility (latitude, longitude, facility name, etc.) and parking lot map information indicating a map of the parking lot at each facility.

  The vehicle identification information storage means 33 stores the vehicle identification information 52 (see FIG. 3) for specifying the vehicle on which the in-vehicle device 2 is mounted, with the storage unit 15 as a main part. The vehicle identification information 52 includes vehicle type name information 61 indicating the vehicle type name of the vehicle, vehicle color information 62 indicating the color of the vehicle, and image data indicating the appearance of the vehicle (hereinafter referred to as an appearance image 63). , Image data indicating a license plate of the vehicle (hereinafter referred to as license plate image 64) is included (see FIG. 3 for both). The vehicle identification information 52 is obtained from an information providing server managed by a rental car company or a car sharing company. That is, the in-vehicle device 2 acquires the vehicle identification information 52 of the vehicle on which the in-vehicle device 2 is mounted from the information providing server, and stores it in the vehicle identification information storage unit 33 in advance.

  The guidance related information transmitting unit 34 transmits the parking position information indicating the parking position of the vehicle to the mobile terminal 1 with the communication unit 13 and the control unit 14 as main parts. Specifically, information on the current position detected by the current position detection unit 31 is transmitted to the mobile terminal 1 with the stop of the engine in the vehicle as a trigger. That is, since it can be determined that the vehicle has been parked because the engine has stopped, the information on the parking position (parking position information) is transmitted by transmitting the latest current position information at this timing. It has become.

  The guidance related information transmitting means 34 carries the parking location map information obtained from the map data storage means 32 and the vehicle identification information 52 obtained from the vehicle identification information storage means 33 together with the parking position information. Transmit to terminal 1. The guidance related information transmitting means 34 searches for the facility corresponding to the detected current position (parking position) from the map data, extracts the parking lot map information of the facility specified by the search from the map data, and extracts this. Send. Hereinafter, the parking position information, the parking lot map information, and the vehicle identification information 52 transmitted together by the guidance related information transmission unit 34 are referred to as “guidance related information”.

  The mobile terminal 1 includes, as main functional configurations, a guidance related information receiving unit (parking position acquisition unit and identification information acquisition unit) 41, a guidance related information storage unit 42, a current position detection unit 43, and an image photographing unit 44. A photographing direction detecting means 45, an operation receiving means 46, a display mode switching means (guidance image switching means) 47, and a guidance screen display means (display means) 48.

  The guidance related information receiving means 41 receives the guidance related information (parking position information, parking lot map information, and vehicle identification information 52) transmitted from the in-vehicle device 2 with the communication unit 26 as a main part. The guidance related information storage unit 42 stores the guidance related information received by the guidance related information reception unit 41 with the storage unit 28 as a main part.

  The current position detection unit 43 uses the GPS receiver 21 as a main part, and detects the current position of the mobile terminal 1, that is, the current position of the user carrying the mobile terminal 1 based on GPS information from the GPS receiver 21. The information on the current position of the user detected by the current position detection unit 43 is hereinafter referred to as user position information.

  The image capturing means 44 captures a moving image (hereinafter referred to as a captured image) with the camera 22 as a main part. The shooting direction detection unit 45 uses the 6-axis sensor 23 as a main part, and detects the shooting direction by the image shooting unit 44 based on the orientation information of the camera 22 detected by the 6-axis sensor 23. The information on the captured image and the capturing direction is used in combination with the user position information to generate an AR image 51c (described later) used for guidance.

  The operation accepting unit 46 uses the touch panel 25 as a main part, detects various operations by the user, and accepts the various operations. In the present embodiment, a mode switching operation for switching the display mode of the guidance screen G and a guidance start operation for starting a guidance operation are mainly detected and accepted.

  The display mode switching means 47 has the control unit 27 as a main part, and according to the mode switching operation received by the operation receiving means 46, the display modes on the guidance screen G are “parking lot map mode”, “arrow mode”, “ Switch between "AR mode". Although details will be described later, the display mode switching unit 47 switches the guide image 51 among the parking lot map image 51a, the arrow image 51b, and the AR image 51c by switching the display mode.

  The guide screen display means 48 displays the guide screen G with the display 24 and the control unit 27 as main parts. As shown in FIG. 3, a guidance image 51 for guiding the user to the parking position of the vehicle and vehicle identification information 52 obtained from the in-vehicle device 2 are arranged on the guidance screen G. That is, the guidance screen display means 48 displays the vehicle identification information 52 together with the guidance image 51.

  As shown in FIGS. 3A to 3C, the guidance image 51 on the guidance screen G is an image that guides the user to the parking position based on the parking position information stored in the guidance related information storage unit 42. . The guidance image 51 can be switched among a parking lot map image 51a, an arrow image 51b, and an AR image (augmented reality image) 51c by switching the display mode by the display mode switching means 47.

  Specifically, as shown in FIG. 3A, when the display mode is “parking lot map mode”, the guidance screen display unit 48 stores the parking information stored in the guidance related information storage unit 42. Based on the position information and the parking lot map information, a parking lot map image 51a indicating a route from the entrance of the parking lot to the parking position is generated and displayed on the map of the parked parking lot.

  As shown in FIG. 3B, when the display mode is “arrow mode”, the guidance screen display means 48 displays the parking position information stored in the guidance related information storage means 42 and the current position information. Based on the user position information detected by the position detection means 43, an arrow image 51b indicating the direction and distance from the user position to the parking position is generated and displayed.

  Further, as shown in FIG. 3C, when the display mode is “AR mode”, the guidance screen display means 48 displays the parking position information stored in the guidance related information storage means 42 and the current Based on the user position information detected by the position detection unit 43 and the shooting direction information detected by the shooting direction detection unit 45, the AR image indicating the parking position of the vehicle on the shot image shot by the image shooting unit 44. 51c is generated and displayed. In the AR image 51c, when the parking position or the vehicle is reflected in the captured image, an icon indicating the parking position or the vehicle is displayed superimposed on the captured image, and the parking position or the vehicle is displayed in the captured image. If it is not shown, an icon indicating the parking position and the vehicle in which direction outside the captured image is superimposed on the captured image. As shown in the figure, it is preferable to display the distance from the user position to the parking position also in the AR image 51c.

On the other hand, the vehicle identification information 52 on the guidance screen G is read and arranged from the information stored in the guidance related information storage means 42. As described above, the vehicle identification information 52 includes the vehicle model name information 61, the vehicle color information 62, the appearance image 63, and the license plate image 64. At the same time, various information 61, 62, 63, 64 is displayed. As shown in FIG. 3, the appearance image 63 is a photographic image taken from the front of the vehicle, a photographic image taken from the back of the vehicle, and a photographic image taken from obliquely above the vehicle. Thus, by displaying a photographic image taken from the front and a photographic image taken from the back, the vehicle can be forward-facing parking (forward parking) or backward-facing parking (reverse parking). It is easy to check. Each photographic image is displayed in color, and the color of the vehicle in the photographic image is also the color of the vehicle borrowed by the user. As a result, the color of the vehicle can be seen from the appearance image 63.
In this way, by displaying various information 61, 62, 63, 64 for visually identifying (identifying) the vehicle together with the guidance image 51, the user forgets what the vehicle is. In the event of accidents, the vehicle can be easily found.

  Next, with reference to FIG. 4 and FIG. 5, the guidance related information registration operation and the guidance operation by the guidance system SY will be described. First, the guidance related information registration operation will be described with reference to FIG. The guidance related information registration operation is an operation of registering (storing) the guidance related information in the mobile terminal 1 and is executed with the stop of the engine as a trigger when the vehicle is parked.

  As shown in FIG. 4, when the in-vehicle device 2 detects the stop of the engine of the vehicle in which the in-vehicle device 2 is mounted (S1: Yes), the guidance-related information transmission unit 34 uses this as a trigger to send guidance-related information. It transmits to the portable terminal 1 (S2). That is, parking position information, parking lot map information, and vehicle identification information 52 are transmitted.

  On the other hand, the portable terminal 1 receives the guidance related information from the in-vehicle device 2 by the guidance related information receiving means 41 (S3) (parking position acquisition step and identification information acquisition step). When the guidance related information is received, the received guidance related information is stored in the guidance related information storage means 42 (S4). Thereby, guidance related information, that is, parking position information, parking lot map information, and vehicle identification information 52 are registered in the mobile terminal 1. Thereby, this guidance related information registration operation is completed.

  Next, the guidance operation will be described with reference to FIG. This guidance operation is executed by using a guidance start operation by the user as a trigger when the user tries to find a parked vehicle.

  As illustrated in FIG. 5, when the portable terminal 1 detects a guidance start operation by the user by the operation accepting unit 46 (S11: Yes), the parking registered by the guidance related information registration operation from the guidance related information storage unit 42 is performed. The position information and the vehicle identification information 52 are read (S12). Then, each information for displaying each guidance image 51 is acquired according to a display mode (S13). That is, when the display mode is “parking lot map mode”, the parking lot map information is read out and acquired from the guidance related information storage means 42. If the display mode is “arrow mode”, the user position information is acquired by the current position detecting means 43. When the display mode is “AR mode”, the user position information is acquired by the current position detection unit 43 and the information of the shooting direction is acquired by the shooting direction detection unit 45.

  If each information is acquired, the guidance screen display means 48 will display the guidance screen G based on the read parking position information and vehicle identification information 52, and each information acquired according to display mode (S14) (display) Step). That is, the guidance screen display means 48 includes the guidance image 51 (the parking lot map image 51a, the arrow image 51b, or the AR image 51c) based on the information acquired according to the parking position information and the display mode, and the read vehicle identification information 52. Are displayed at the same time. By viewing this display, the user can easily find the vehicle. Thereby, this guidance operation is completed.

  According to the above configuration, the information for identifying the vehicle (vehicle identification information 52) (information on the vehicle to be searched by the user) is displayed together with the guidance image 51. Even if the user forgets what kind of vehicle the vehicle is, by checking the vehicle identification information 52, it is possible to immediately confirm what kind of vehicle the vehicle is. Therefore, when it comes to the vicinity of a parking position by the guidance image 51, it can discover a vehicle immediately and can confirm immediately whether the said vehicle is a vehicle which it borrowed. In this way, even if you forget what the vehicle you borrowed is, you can easily find your vehicle. In particular, displaying the appearance image 63 makes it easier to find one's own vehicle.

  Moreover, usability can be improved by switching the guidance image 51 among the parking lot map image 51a, the arrow image 51b, and the AR image 51c.

  In the above-described embodiment, the appearance image 63 (each photographic image) may be configured such that an image obtained by changing the light source is displayed in a switchable manner. That is, the appearance (mainly the color) of the vehicle differs between when receiving sunlight and when receiving indoor light such as a fluorescent lamp. For this reason, it is preferable to prepare a plurality of appearance images 63 in which the light sources are changed correspondingly to these so that they can be displayed.

  Moreover, in the said embodiment, although it was the structure which displays the license plate image 64, it may replace with this and the structure which displays the character information (automobile registration number information) itself of a motor vehicle registration number may be sufficient.

  Further, in the above embodiment, the display mode switching unit 47 is configured to switch the display mode according to the mode switching operation by the user. However, the display mode switching unit 47 automatically switches the display mode according to a specific condition. It may be configured to switch automatically. For example, when the user location information cannot be acquired by the current location means in an underground parking lot or the like, it may be configured to switch to “parking map mode” that does not use this, or the parking lot map information is included in the map data. If there is no parking lot map information, it may be configured to switch to “arrow mode” or “AR mode” that does not use this.

  In the above embodiment, the guide image 51 is switched among the parking lot map image 51a, the arrow image 51b, and the AR image 51c. In addition, the route from the user position to the parking lot is used. It is good also as a structure which can be switched also to the navigation image which shows.

  Moreover, in the said embodiment, although the vehicle-mounted apparatus 2 was the structure which transmits the guidance relevant information containing parking position information by using the engine stop in a vehicle as a trigger, guidance relevant information is triggered by the specific behavior of a vehicle. However, the present invention is not limited to this. For example, the vehicle-mounted device 2 may be configured to transmit guidance-related information using a door opening / closing or side brake operation in the vehicle as a trigger. Alternatively, the guidance related information may be transmitted using a combination of engine stop, door opening / closing and side brake operation as a trigger.

  In addition, in the said embodiment, although this invention was applied to the smart phone, the structure which applies this invention to other portable terminals 1, such as a tablet PC, a mobile telephone, and a PDA terminal may be sufficient. As a result, this invention may be applied not only to a portable terminal device but to a non-portable terminal device.

  In addition, a program (such as an application program including a Web application) that realizes each component in the mobile terminal 1 described in the above embodiment and a program that realizes each step in the control method of the mobile terminal 1 described in the above embodiment. It is also possible to provide. Further, the program can be provided by being stored in a recording medium (not shown). That is, a program for causing a computer to function as each component of the mobile terminal 1, a recording medium storing the program, a program for causing the computer to execute each step in the control method of the mobile terminal 1, and The recorded recording medium is also included in the scope of rights of the present invention.

  DESCRIPTION OF SYMBOLS 1: Portable terminal 2: Vehicle-mounted apparatus 41: Guidance related information receiving means 47: Display mode switching means 48: Guidance screen display means 51: Guidance image 51a: Parking lot map image 51b: Arrow image 51c : AR image 52: Vehicle identification information 61: Model name information 63: Appearance image 64: License plate image

Claims (8)

Parking position acquisition means for acquiring parking position information indicating a parking position where the vehicle is parked;
Identification information acquisition means for acquiring vehicle identification information for specifying the vehicle;
A terminal device comprising: display means for displaying the vehicle identification information together with a guidance image for guiding the user to the parking position based on the acquired parking position information.   The terminal device according to claim 1, wherein the vehicle identification information includes at least one of vehicle type name information, an appearance image, a license plate image, and automobile registration number information of the vehicle.   The guidance image includes a parking lot map image showing a route from the entrance of the parking lot to the parking position on a map of the parked parking lot, and an arrow image showing a direction and distance from the user position to the parking position. The terminal device according to claim 1, wherein the terminal device is an augmented reality image indicating the parking position on a captured image.   The terminal device according to claim 3, further comprising a guidance image switching unit that switches the guidance image between the parking lot map image, the arrow image, and the augmented reality image.   The terminal device according to any one of claims 1 to 4, wherein the parking position acquisition unit acquires the parking position information transmitted from an in-vehicle device using a specific behavior of the vehicle as a trigger. .   The terminal device according to claim 5, wherein the specific behavior is at least one of engine stop, door opening / closing, and side brake operation. The terminal device
A parking position acquisition step for acquiring parking position information indicating a parking position where the vehicle is parked;
An identification information acquisition step of acquiring vehicle identification information for specifying the vehicle;
And a display step of displaying the vehicle identification information together with a guidance image for guiding the user to the parking position based on the acquired parking position information.   The program for making a computer perform each step in the control method of the terminal device of Claim 7.

Images