WO2017213157A1

WO2017213157A1 - Article for vehicle installation fitting method and article for vehicle installation fitting system

Info

Publication number: WO2017213157A1
Application number: PCT/JP2017/021036
Authority: WO
Inventors: 勝徳田; 秀昭岡野; 浩光飯田; 昌之古谷; 幸一品田; 謙一持田
Original assignee: 株式会社カーメイト
Priority date: 2016-06-08
Filing date: 2017-06-06
Publication date: 2017-12-14
Also published as: JP2017220059A; JP6741342B2

Abstract

[Problem] The present invention addresses the problem of providing an article for vehicle installation fitting method and an article for vehicle installation fitting system capable of fitting an article for vehicle installation on a screen of a portable terminal, etc. [Solution] This article for vehicle installation fitting method is characterized by comprising: a step for recognizing a reference part of a predetermined vehicle in a vehicle image and calculating an attachment reference position for an article for vehicle installation; a step for recognizing the reference part and calculating the scale of the article for vehicle installation; and a step for synthesizing the article for vehicle installation in which the scale is adjusted to the attachment reference position for the article for vehicle installation of the vehicle in the vehicle image.

Description

Vehicle wearing article try-on method, vehicle wearing article try-on system

The present invention relates to a vehicle-mounted article fitting method and a vehicle-mounted article fitting system that can display various vehicle-mounted articles (roof boxes, child seats, etc.) on a screen according to user preferences.

A roof box may be mounted on the base carrier of the roof in order to carry a load with a vehicle.
There are various types of roof boxes, such as a large capacity type, a long type, a design type with low air resistance, and various colors, and a base carrier is required accordingly.

When purchasing a roof box, it is necessary to select the roof box according to the application and design and determine whether the box can be attached to the vehicle. Currently, users refer to the roof box catalog and sales staff's advice.
Similar to the roof box, there are tires and wheels as various vehicle parts attached to the vehicle. There are a plurality of combinations of wheels and tires for each vehicle type, and sales staff are required to have experience and know-how.

Therefore, Patent Document 1 discloses a sales support system in which even those who are not familiar with the knowledge about wheels and tires can obtain tire and wheel combination information that matches the vehicle.

JP 2005-44376 A

However, the system disclosed in Patent Document 1 selects a combination that can be mounted from pre-registered vehicle type, tire, and wheel information. For example, whether the wheel design selected by the user matches the vehicle. It is not taken into account to try on a vehicle to judge
At present, there are samples and the like that can be mounted on the vehicle, and if the store is actively engaged in try-on work, the user can try it on before purchase. However, such sample fitting is very limited and time-consuming to install and is not efficient.

Therefore, in view of the above-mentioned problems of the prior art, an object of the present invention is to provide a vehicle-mounted article fitting method and a vehicle-mounted article fitting system capable of trying on a vehicle-mounted article on a screen of a mobile terminal or the like.

As a first means for solving the above problems, the present invention includes a step of recognizing a predetermined reference portion of a vehicle in a vehicle image and calculating a reference position for mounting a vehicle-mounted article, and the reference portion. Recognizing and calculating a scale of the vehicle-mounted article; and synthesizing the vehicle-mounted article with the scale adjusted to a reference position for mounting the vehicle-mounted article on the vehicle in the vehicle image. An object of the present invention is to provide a vehicle fitting article fitting method.
Thereby, on the screen of a portable terminal etc., the vehicle image which mounted vehicle mounting goods, such as a roof box, on a user's vehicle can be virtually displayed.

As a second means for solving the above-mentioned problem, in the first means, the vehicle-mounted article is a roof box, the reference portion is a front and rear tire, and the center of the front and rear tires An object of the present invention is to provide a vehicle-mounted article fitting method characterized by acquiring position information and calculating a reference position for mounting the roof box based on the position information and vehicle information registered in advance.
Thereby, the reference position for mounting the roof box can be easily calculated, and the mounting position of the roof box can be accurately obtained.

As a third means for solving the above-mentioned problems, in the first or second means, the present invention provides the vehicle-mounted article is a roof box, the reference portion is a front and rear tire, and the front and rear tires. 3. The vehicle fitting article fitting method according to claim 1, wherein the number of pixels is calculated, and the scale of the roof box is calculated based on the number of pixels and vehicle information registered in advance. It is to provide.
Thereby, the roof box which adjusted the scale according to the size of the vehicle in a vehicle picture can be displayed.

As a fourth means for solving the above-mentioned problems, the present invention provides the vehicle according to any one of the first to third aspects, wherein the vehicle image is taken in advance and registered in a storage unit. 4. The vehicle fitting article fitting method according to claim 1, wherein the method is one of an image, a newly taken image, and a vehicle image registered in a database in advance. There is.
As a result, the roof box can be tried on again afterwards with respect to the previously captured vehicle image. Further, by using the newly photographed image, it is possible to try on the roof box for the vehicle owned by the user. Furthermore, by using a pre-registered vehicle image, it is possible to try on the roof box for a vehicle type other than the vehicle owned by the user.

As a fifth means for solving the above-mentioned problems, the present invention provides a storage unit for acquiring a vehicle image, and a reference position of a vehicle-mounted article by recognizing a predetermined reference part of the vehicle in the vehicle image. And a control unit that calculates a scale of the vehicle-mounted article, and an image composition processing unit that synthesizes the vehicle-mounted article whose scale has been adjusted to an attachment reference position of the vehicle-mounted article of the vehicle in the vehicle image. Another object of the present invention is to provide a vehicle-mounted article fitting system characterized by the above.
Thereby, it is possible to easily display a vehicle image in which a vehicle mounting article such as a roof box is mounted on the user's vehicle on the screen of the mobile terminal or the like.

As a sixth means for solving the above-mentioned problem, the present invention provides a communication section capable of communicating with a photographing section for photographing the vehicle or a database in which vehicle information of the vehicle is registered in advance. An object of the present invention is to provide a vehicle-mounted article fitting system characterized by comprising the above.
Thereby, the roof box can be tried on a vehicle owned by the user by using a newly taken image. Furthermore, by using a pre-registered vehicle image, it is possible to try on the roof box for a vehicle type other than the vehicle owned by the user.

As a seventh means for solving the above-mentioned problems, in the fifth or sixth means, the present invention is the vehicle-mounted article is a roof box, and the reference portion is front and rear tires,
The control unit acquires position information of the center of the front and rear tires, and calculates a mounting reference position of the roof box based on the position information and vehicle information registered in advance. Is to provide.
Thereby, the reference position for mounting the roof box can be easily calculated, and the mounting position of the roof box can be accurately obtained.

As an eighth means for solving the above-mentioned problems, in the present invention according to any one of the fifth to seventh aspects, the vehicle-mounted article is a roof box, and the reference portion is a front and rear tire. The control unit calculates the number of pixels between the front and rear tires, and calculates the scale of the roof box based on the number of pixels and vehicle information registered in advance. An object of the present invention is to provide a vehicle wearing article try-on system according to any one of the above.
Thereby, the roof box which adjusted the scale according to the size of the vehicle in a vehicle picture can be displayed.

According to the present invention configured as described above, it is possible to easily create a virtual vehicle image in which a vehicle wearing article (roof box, child seat, etc.) is mounted on the user's vehicle and display it on the screen of a mobile terminal or the like. Moreover, based on the vehicle information and vehicle mounting equipment information registered beforehand, the virtual vehicle image which mounts the vehicle mounting goods selected arbitrarily can be produced with respect to the vehicle selected arbitrarily.

It is a block diagram of the vehicle wearing article try-on system of the present invention. It is a process flow figure of the vehicle wearing goods trial fitting method of the present invention. It is explanatory drawing of the vehicle wearing goods try-on method. It is explanatory drawing of the attachment reference position of a roof box.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of a vehicle wearing article fitting method and a vehicle wearing article fitting system according to the present invention will be described below in detail with reference to the accompanying drawings.

[Vehicle-mounted article fitting system 10]
FIG. 1 is a block diagram of a vehicle wearing article try-on system of the present invention. As shown in the figure, the vehicle wearing article try-on system 10 of the present invention includes an imaging unit 20, an input unit 30, a storage unit 40, a control unit 50, an image composition processing unit 60, a display unit 70, and a communication unit 80. The database 90 is the main basic configuration. In addition, although a roof box, a child seat, etc. can be mentioned as a vehicle installation article, In this embodiment, it demonstrates below using a roof box as an example.

The imaging unit 20 is a CCD, CMOS camera, or the like that images a vehicle. The photographing unit 20 may be any photographing device capable of photographing images (still images, moving images, etc.), and a camera or the like built in a portable terminal can be used as an example.
The input unit 30 is a user interface such as a mouse, a keyboard, and a touch panel for inputting information on a vehicle or vehicle-mounted items.

The storage unit 40 is a memory that stores an image acquired from the imaging unit 20, data acquired from the input unit 30, a composite image acquired from the image composition processing unit 60 described later, and the like via the control unit 50 described later.
The control unit 50 recognizes a predetermined reference portion of the vehicle in the vehicle image, extracts a feature point of the vehicle, calculates a mounting position of the vehicle wearing article, and mounts the vehicle image to be combined with the vehicle. CPU etc. which perform arithmetic processing, such as processing which calculates the scale of goods.

The image composition processing unit 60 generates a vehicle image (a vehicle image represented in a two-dimensional or three-dimensional (3D model)) in which a roof box that is a vehicle-mounted article is mounted on the vehicle image.
The display unit 70 is a display that displays vehicle information, a vehicle image, a synthesized image obtained by virtually synthesizing a vehicle wearing article on the vehicle, and the like.
The communication unit 80 can transmit and receive with an external database 90 via a network such as the Internet.

The database 90 includes vehicle information (manufacturer, vehicle type, model year, type, vehicle dimensions, vehicle images represented in 2D and 3D, etc.), information on vehicle mounted products such as roof boxes and child seats (manufacturer, product name). , Product number, detailed information, product images expressed in 2D and 3D, etc.), conformity information of vehicle-mounted equipment (whether it can be mounted, allowable range of mounting position, etc.), acquisition information, etc. .

The vehicle wearing article try-on system 10 according to the present invention can be realized as a form using a software program or application software, or as a form of a personal computer or portable terminal in which these softwares are installed.

[How to try on vehicles]
Next, the vehicle wearing article try-on method of the present invention using the vehicle wearing article fitting system 10 will be described below.

[New fitting A]
The method for shooting a vehicle owned by the user and trying on the roof box is as follows.

Vehicle information is input (S100). The vehicle information includes manufacturer, vehicle type, model year, type, and the like.
Next, a roof box is selected (S120). A roof box that can be adapted to the vehicle is displayed based on the vehicle information and the adaptation information. Specifically, the product name, product number, product image, detailed information, etc. of the roof box are displayed.

The vehicle is photographed (S140). The side surface of the vehicle is photographed by the photographing unit 20, and the photographed image (still image, moving image, etc.) is displayed on the screen of the display unit 70.
Whether or not the vehicle can be automatically recognized is determined (S160).
Automatic recognition of the vehicle is performed by the control unit 50 as follows.
FIG. 3 is an explanatory view of a roof box fitting method. In the present embodiment, as an example, a case where front and rear tires of a vehicle image are recognized as a reference portion of the vehicle will be described below.

As shown in FIG. 3A, a recognition range (two circles) is displayed at a location corresponding to the front and rear tires in the vehicle image. At this time, the recognition definition of the front and rear tires is, for example, that there are two left and right circles on the Y axis, and the two circles are separated by a predetermined distance.
In addition, a front lamp, a tail lamp, a side door, a side mirror, a window, a door, a door handle, etc. can be applied as the reference part of the vehicle to be recognized.

As shown in FIG. 3 (2), the centers of the front and rear tires in the recognition range are derived, and the number of pixels between the two centers is acquired from the center position information (position coordinates on the vehicle image, etc.).
FIG. 4 is an explanatory view of the reference position for attaching the roof box. The reference position for mounting the roof box is calculated from position information of two centers of the front and rear tires on the screen (position coordinates on the vehicle image, etc.).
As an example, in FIG. 4A, a vertical line passing through a half position (in the middle of the circle 2 and circle 3) between the centers of the front and rear tires (circle 1) is the X-axis reference line. Then, the front / rear door clearance position (circle 5) is calculated from the pre-registered front tire and front / rear door clearance (circle 4) and the X-axis reference line.
Also, using the pre-registered front / rear carrier mounting position (circle 6) and bar front / rear distance (circle 7), the bar front / rear distance (circle 8 and 9) and the front bar mounting position (circle 10). The intermediate position between the front and rear bars (circle 11) can be calculated, and the roof box mounting position (X axis: circle 12) can be calculated.
In FIG. 4B, a horizontal line passing through the centers of the front and rear tires is the Y-axis reference line. Then, the base carrier mounting height (circles 4 and 5) can be calculated using the pre-registered vehicle total height (circle 1), tire radius (circle 2), and base carrier single body height (circle 3). it can. Of these, the circle 5 is the mounting position (Y axis) of the roof box.

Further, the number of pixels of the roof box displayed on the screen is calculated using the number of pixels between the two centers, the distance between the front and rear tires registered in advance, and the length of the roof box. Based on the number of pixels of the roof box, a roof box adjusted to a scale suitable for the vehicle image on the screen can be obtained. In other words, the actual size per pixel is calculated from the number of pixels between the two centers and the distance between the front and rear tires registered in advance. The display size (number of pixels) of the roof box can be calculated from the actual size per pixel and the length of the roof box.
Next, as shown in FIG. 3 (3), feature points (square marks) of the vehicle in the vehicle image are extracted. Here, the feature points of the vehicle are, for example, the four corners of the side door, the tail lamp, and a plurality of such points are extracted.

When the above-mentioned automatic recognition of the vehicle cannot be performed (for example, the background and the vehicle have the same color or darkness), the vehicle is manually recognized (S180). The specific manual recognition designates the center of the front and rear tires of the vehicle image.
You can get the number of pixels between the two centers of the specified front and rear tires and adjust the scale of the roof box. Also, the mounting position of the roof box can be calculated from the positional information of the two centers of the front and rear tires.

As another recognition method, markers such as AR (Augmented Reality) markers are pasted on the front and rear tires of the vehicle to be photographed in advance. And you may comprise so that a front-and-rear tire may be recognized with the marker in the vehicle image which image | photographed the vehicle.
After automatic or manual recognition of the vehicle, the roof box is tried on (S200). As shown in FIG. 3 (4), the image composition processing unit 60 adjusts the scale of the vehicle image and synthesizes the roof box based on the reference position and feature point of the roof box (displayed in two dimensions and three dimensions). Generated image) and display it on the display screen.

At this time, as shown in FIG. 3 (5), in the image composition processing unit 60, when the user moves from the side shooting location while holding the mobile terminal, the above-described plurality of feature points are tracked and featured. Based on the points, the orientation of the roof box can be varied.
Further, in the above-described composite image, the intermediate position of the roof box is displayed in alignment with the reference mounting position of the roof box. Generally, an allowable range is set for the mounting position of the roof box, and image composition processing can be performed by moving the mounting position of the roof box within this allowable range.

Data is saved (S220). Data and image data input in steps S100 to S200 are recorded in the storage unit 40.
Accordingly, the roof box can be tried on a vehicle owned by the user by using a newly taken image.

[Try-on record confirmation B]
A method of retrofitting using the vehicle image stored in the above-described step S220 is performed as follows.
A vehicle image stored in the storage unit 40 is selected (S300).
A roof box is selected (S320). A roof box that can be adapted to the vehicle is displayed based on the stored vehicle information. Specifically, the product name, product number, product image, detailed information, etc. of the roof box.

The above-mentioned roof box is tried on (S200). The image synthesis processing unit 60 generates an image obtained by synthesizing a new roof box whose scale has been adjusted to the stored vehicle image, and displays the image on the display screen.
The above data is stored (S220). Data and image data input in steps S300 to S200 are recorded in the storage unit 40.
As a result, the roof box can be tried on again afterwards with respect to the previously captured vehicle image.

[Registered vehicle fitting C]
The method of trying on the roof box for a vehicle type other than the vehicle owned by the user is as follows.
Registered vehicle information is input (S400). When the user inputs the manufacturer and model of the vehicle, the vehicles registered in advance on the database 90 are displayed.

A roof box is selected (S420). A roof box that can be adapted to the vehicle based on the registered vehicle information is displayed. Specifically, the product name, product number, product image, detailed information, etc. of the roof box.
The above-mentioned roof box is tried on (S200). The image synthesis processing unit 60 generates an image obtained by synthesizing a roof box adjusted in scale with a vehicle image registered in advance, and displays the image on the display screen.

Data similar to the above is stored (S220). Data and image data input in steps S400 to S200 are recorded in the storage unit 40.
Thereby, by using the image of the vehicle registered in advance, it is possible to try on the roof box for a vehicle type other than the vehicle owned by the user.

According to such a roof box fitting method of the present invention, a virtual vehicle image in which a roof box is mounted on a vehicle can be easily created and displayed on a screen of a portable terminal or the like.

When a child seat is used as a vehicle-mounted article, the predetermined vehicle reference part in the vehicle image includes the height of the seat to be mounted, in the case of an ISOFIX (isofix) compatible vehicle, the anchor pitch, and the above-mentioned It is good to apply AR marker.

Even with such a child seat fitting method, a virtual vehicle image can be easily created and displayed on a screen of a portable terminal or the like, as in the case where a roof box is mounted on a vehicle.

The vehicle-mounted article fitting method and the vehicle-mounted article fitting system of the present invention have industrial applicability in the fields of manufacturing and sales of vehicles and vehicle-equipped accessories attached to vehicles.

DESCRIPTION OF SYMBOLS 10 ......... Vehicle wearing article try-on system, 20 ......... Photographing part, 30 ......... Input part, 40 ......... Storage part, 50 ......... Control part, 60 ......... Image composition processing part, 70 ... ... display unit, 80 ... communication unit, 90 ... database.

Claims

Recognizing a predetermined reference portion of the vehicle in the vehicle image and calculating an attachment reference position of the vehicle-mounted article;
Recognizing the reference portion and calculating a scale of the vehicle-mounted article;
Synthesizing the vehicle-mounted article whose scale has been adjusted to an attachment reference position of the vehicle-mounted article of the vehicle in the vehicle image;
A vehicle-mounted article fitting method characterized by comprising:
The vehicle wearing article is a roof box, the reference portion is front and rear tires, and acquires position information of the center of the front and rear tires,
2. The vehicle wearing article try-on method according to claim 1, wherein an attachment reference position of the roof box is calculated based on the position information and vehicle information registered in advance.
The vehicle-mounted article is a roof box, the reference part is front and rear tires, the number of pixels between the front and rear tires is calculated, and the scale of the roof box is calculated based on the number of pixels and vehicle information registered in advance. The vehicle wearing article try-on method according to claim 1 or 2, characterized by:
2. The vehicle image according to claim 1, wherein the vehicle image is one of an image of a vehicle that has been previously captured and registered in a storage unit, a newly captured image, and an image of a vehicle that has been previously registered in a database. 4. The vehicle wearing article try-on method according to any one of items 3 to 3.
A storage unit for acquiring a vehicle image;
A control unit for recognizing a predetermined reference portion of the vehicle in the vehicle image and calculating a reference position for mounting the vehicle-mounted article and a scale of the vehicle-mounted article;
An image composition processing unit for synthesizing the vehicle-mounted article whose scale has been adjusted to an attachment reference position of the vehicle-mounted article in the vehicle image;
A vehicle fitting product fitting system characterized by comprising:
6. The vehicle wearing article try-on system according to claim 5, further comprising a communication unit capable of communicating with a photographing unit for photographing the vehicle or a database in which vehicle information of the vehicle is registered in advance.
The vehicle-mounted article is a roof box, and the reference portion is front and rear tires,
The said control part acquires the positional information on the center of the said front-and-back tire, and calculates the attachment reference position of the said roof box based on the said positional information and vehicle information registered beforehand. The vehicle wearing article try-on system described in 1.
The vehicle-mounted article is a roof box, and the reference portion is front and rear tires,
8. The control unit according to claim 5, wherein the control unit calculates the number of pixels between the front and rear tires, and calculates the scale of the roof box based on the number of pixels and vehicle information registered in advance. The vehicle wearing article try-on system according to item 1.