WO2023142379A1

WO2023142379A1 - In-vehicle payment system and method

Info

Publication number: WO2023142379A1
Application number: PCT/CN2022/103016
Authority: WO
Inventors: 闫新旭; 张航; 宋超; 石志伟; 翟昭华; 邓福岳
Original assignee: 中国第一汽车股份有限公司
Priority date: 2022-01-28
Filing date: 2022-06-30
Publication date: 2023-08-03
Also published as: CN114613022A

Abstract

An in-vehicle payment system and method, which can improve the payment efficiency of drive-through payment, reduce the payment cost, and improve the universality and convenience of a payment mode. The in-vehicle payment method comprises: an in-vehicle control apparatus acquiring, according to a received payment instruction, a payment image that includes user payment information, and sending an image projection instruction and the payment image to a vehicle lamp projection apparatus (101); and then, the vehicle lamp projection apparatus controlling, according to the image projection instruction, a DLP vehicle lamp to project the payment image to a location area that is located outside a vehicle body (102).

Description

A vehicle toll payment system and method

technical field

The application relates to the technical field of vehicle mobile payment, in particular to a vehicle-mounted toll payment system and a vehicle-to-vehicle payment method.

Background technique

In recent years, with the continuous improvement of residents' living standards, cars have become an indispensable part of people's lives, and the resulting demand and scenarios for some instant fee payment in the car, that is, users do not need to get out of the car It can realize the payment of fees in certain scenarios, such as charging tolls and parking fees at highway intersections, parking lots and other vehicle toll stations, and the vehicle (drive-through) payment fee is also gradually rising and showing a variety of methods And the trend of demand growth, for example, the payment method of vehicle payment can be cash payment, ETC payment, mobile phone QR code payment, etc.

However, the existing in-vehicle payment is still relatively cumbersome. For example, cash payment requires the user to prepare banknotes in advance and the payment time may be extended due to change. The payment efficiency is very low; ETC payment requires the car to be pre-installed with ETC electronic equipment and bind a bank card This will increase the user's payment cost (purchase ETC electronic equipment), and the popularity of ETC equipment is not very high; mobile phone QR code payment requires the user to operate the mobile phone to scan the code to pay, which will also prolong the payment time , the payment efficiency is low.

Therefore, there is an urgent need for a payment method with higher efficiency, lower cost, and greater universality to meet people's needs for humanization, automation, and convenience of drive-through payment.

Contents of the invention

Based on this, in order to improve the payment efficiency of the drive-through payment, reduce the payment cost, and improve the universality and convenience of the payment method, the present application discloses the following technical solutions.

On the one hand, a vehicle toll payment system is provided, including:

1. A vehicle toll payment system, characterized in that it comprises:

The on-vehicle control device is configured to acquire a payment image containing user payment information according to the received payment instruction, and send the image projection instruction and the payment image to the vehicle lamp projection device;

The vehicle light projection device is configured to control the DLP vehicle light to project the toll payment image to a position area outside the vehicle body according to the image projection instruction.

In a possible implementation manner, the on-board control device is further configured to: send an instruction to stop projection to the lamp projection device according to the received payment completion instruction;

The vehicle light projection device is further configured to: control the DLP vehicle light to stop projection according to the stop projection instruction.

In a possible implementation manner, the payment instruction and/or the payment completion instruction are voice prompts issued by the charging party; and,

The vehicle-mounted control device includes a vehicle-mounted voice recognition module, and the vehicle-mounted voice recognition module is configured to: perform semantic recognition on the voice prompt, convert the recognition result into corresponding instruction information and send it to the vehicle-mounted control device, wherein the instruction The information is the payment instruction or the payment completion instruction.

In a possible implementation, in the process of DLP car light projection, the vehicle voice recognition module is further configured to: collect the screen position adjustment prompt issued by the charging party in real time and perform semantic recognition, and convert the recognition result into corresponding The position adjustment instruction information and send it to the vehicle control device;

The vehicle control device is further configured to: send a corresponding vehicle light swing command to the vehicle light projection device according to the position adjustment instruction information;

The lamp projection device is further configured to: control the DLP lamp to swing in a corresponding direction according to the lamp swing instruction.

In a possible implementation manner, the system also includes a light sensor installed on the vehicle body; and,

The car lamp projection device is further configured to: after receiving the image projection instruction, obtain the ambient brightness detected by the light sensor installed on the vehicle body, and according to the environment brightness during the process of controlling the DLP car lamp projection Brightness adjusts the brightness and/or contrast of the DLP lights.

On the other hand, another vehicle-mounted toll payment system is provided, including: a vehicle-mounted image acquisition device, a vehicle-mounted control device, and a vehicle light projection device; wherein,

The on-vehicle control device is configured to: control the on-vehicle image acquisition device to collect images of the area outside the vehicle body according to the received payment instruction, and identify the projected area logo on the collected external images;

When the identification of the projection area is identified, the on-board control device acquires the payment image containing the user payment information, and sends the image projection instruction and the payment image to the car lamp projection device, and the car lamp projection device is configured as follows: Controlling the DLP vehicle lights according to the image projection instruction to project the payment image to the position area outside the vehicle body;

In the case that the projection area logo is not recognized, the vehicle-mounted control device controls the vehicle-mounted image acquisition device to collect the environmental image, recognizes the charging pattern containing the charging information of the merchant from the environmental image, and the vehicle-mounted control device automatically performs the charging according to the charging pattern. Pay the fees.

In a possible implementation manner, the on-board control device is further configured to: control the on-board image acquisition device to collect images of the area outside the vehicle body during the DLP lamp projection process, and determine the actual Whether the degree of non-overlapping between the projected image and the target projection area exceeds the set threshold, and if it exceeds the set threshold, send the corresponding car light swing command to the car light projection device, and the car light projection device according to the car light swing command Controlling the DLP vehicle lights to swing in the direction of reducing the non-overlapping degree until the non-overlapping degree does not exceed the set threshold.

On the other hand, it also provides a vehicle toll payment method, including:

The on-board control device acquires the payment image including the user payment information according to the received payment instruction, and sends the image projection instruction and the payment image to the vehicle lamp projection device;

The vehicle light projection device controls the DLP vehicle light to project the toll payment image to a position area outside the vehicle body according to the image projection instruction.

In a possible implementation manner, the method also includes:

The on-vehicle control device sends a stop projection instruction to the lamp projection device according to the received payment completion instruction;

The vehicle light projection device controls the DLP vehicle light to stop projection according to the stop projection instruction.

The vehicle-mounted voice recognition module of the vehicle-mounted control device performs semantic recognition on the voice prompt, converts the recognition result into corresponding instruction information and sends it to the vehicle-mounted control device, wherein the instruction information is the payment instruction or the payment completion instruct.

In a possible implementation manner, the method also includes:

During the DLP lamp projection process, the on-board voice recognition module collects the screen position adjustment prompts issued by the charging party in real time and performs semantic recognition, and converts the recognition results into corresponding position adjustment instruction information and sends them to the on-board control device. The device sends a corresponding lamp swing command to the lamp projection device according to the position adjustment instruction information, and the lamp projection device controls the DLP lamp to swing in a corresponding direction according to the lamp swing command.

In a possible implementation manner, the method also includes:

After the lamp projection device receives the image projection command, it obtains the ambient brightness detected by the light sensor installed on the vehicle body, and adjusts the brightness of the DLP lamp according to the ambient brightness during the process of controlling the projection of the DLP lamp and/or contrast.

On the other hand, another vehicle toll payment method is also provided, including:

The vehicle-mounted control device controls the vehicle-mounted image acquisition device to collect images of the area outside the vehicle body according to the received payment instructions, and identifies the projected area logo on the collected external images;

When the projection area logo is recognized, the payment image containing the user payment information is acquired, and the image projection instruction and the payment image are sent to the vehicle lamp projection device, and the vehicle lamp projection device is controlled according to the image projection instruction DLP headlights project the toll payment image to a position area located outside the vehicle body;

In a possible implementation manner, the method also includes:

In the process of DLP car lamp projection, the on-board control device controls the on-board image acquisition device to collect images of the area outside the vehicle body, and judges whether the non-overlapping degree between the actual projection picture and the target projection area exceeds Set a threshold, and send a corresponding lamp swing command to the lamp projection device when the threshold is exceeded, and the lamp projection device controls the DLP lamp to reduce the non-overlapping degree according to the lamp swing command Swing until the non-overlapping degree does not exceed the set threshold.

The on-board toll payment system and method disclosed in this application does not require the user to lower the window to display the QR code on the mobile phone to the guard or the self-service toll machine for scanning, but directly controls the IVI system and DLP equipped with the vehicle itself in the car. The car lights change the display method of the QR code that needs to be given to the toll booth to be projected on the ground. With the help of the lighting of the car lights, the projected QR code is very clear and has a large area, which is beneficial for the toll party to scan the code for charging. The entire payment process is convenient and fast, with high payment efficiency, no need for personnel in the car to operate the mobile phone, and no delay in scanning codes because the distance from the on-duty personnel or self-service toll machines is too far away, and there is no need for users to install additional equipment such as ETC in advance, reducing the cost of payment. The cost of payment can meet people's needs for humanization, automation and convenience of payment.

Description of drawings

The embodiments described below with reference to the accompanying drawings are exemplary, and are intended to explain and illustrate the present application, but should not be construed as limiting the protection scope of the present application.

Fig. 1 is a structural block diagram of the on-board toll payment system in Embodiment 1 disclosed in the present application.

Fig. 2 is a schematic diagram of a real scene of a vehicle projecting a two-dimensional code.

Fig. 3 is a structural block diagram of the on-board toll payment system in Embodiment 2 disclosed in the present application.

Fig. 4 is a schematic flow chart of the on-board toll payment method in Embodiment 3 disclosed in the present application.

Fig. 5 is a schematic flow chart of the on-board toll payment method in Embodiment 4 disclosed in the present application.

Detailed ways

In order to make the purpose, technical solution and advantages of the implementation of the application clearer, the technical solution in the embodiment of the application will be described in more detail below in conjunction with the drawings in the embodiment of the application.

The first embodiment disclosed in this application will be described in detail below with reference to FIGS. There is direct interaction with the charging party in person, and there is no need to lower the window or operate the mobile phone, but to realize the payment of parking fees, tolls, etc. in the car through the control device and projection device equipped with the vehicle.

The vehicle-mounted toll payment system disclosed in this embodiment mainly includes: a vehicle-mounted control device and a vehicle lamp projection device.

The on-vehicle control device is configured to acquire a payment image including user payment information according to the received payment instruction, and send the image projection instruction and the payment image to the vehicle lamp projection device.

The on-board control device can use the IVI system equipped with the vehicle itself. The IVI system (In-Vehicle Infotainment, IVI) is the in-vehicle infotainment system. The system can implement a series of applications including 3D navigation, real-time road conditions, IPTV, assisted driving, fault detection, vehicle information, body control, mobile office, wireless communication, online entertainment and TSP services. In this embodiment, Alipay, WeChat and other commonly used APPs with payment functions can be pre-installed in the vehicle control device, for example, Alipay and WeChat APPs are pre-installed in the IVI host of the IVI system.

The car light projection device can adopt the DLP car light projection system. DLP (Digital Light Processing) is the digital light processing technology, and the digital micromirror device (Digital Micromirror Device, DMD) is used as the main key component to realize the digital optical processing process. The projection principle of DLP technology is to homogenize the light source through an integrator (Integrator), divide the light into three colors of R, G, and B through a color wheel (Color Wheel) with three primary colors, and then image the color on the lens. On the DMD, the electrical signal of the digital rotating lens is converted into a grayscale by means of a synchronous signal, and the continuous light is converted into a gray scale, and the colors are expressed with the three colors of R, G, and B, and finally the image is projected through the lens. The image projected by DLP technology has a high contrast ratio, and it has a great advantage when projecting a pattern such as a two-dimensional code that contains color blocks and has a strong color contrast between different blocks.

Among them, DMD is to arrange a matrix composed of microlenses (precise, miniature mirrors) on the semiconductor chip. Each microlens controls a pixel in the projection screen. The number of microlenses matches the resolution of the projection screen. These microlenses can change angles rapidly under the control of digital drive signals, and when the corresponding signal is received, the microlenses will tilt by 10 degrees. Essentially, the angle of the microlens has only two states: "on" and "off". If the microlens in the projection state is shown as "on", it will tilt +10 degrees with the digital signal, and the reflected incident light will be projected onto the screen through the projection lens; if it is in the non-projection state, it is shown as "OFF", tilt -10 degrees, and incident light reflected on the micromirror is absorbed by the light absorber.

The DLP car light projection system may specifically include a DLP car light controller and a DLP car light, wherein the DLP car light controller is electrically connected to the IVI host of the IVI system, and is used to receive images to be projected from the IVI host. DLP car lights can use front lights (headlights) as projection lights, and the projected picture is located on the front side of the vehicle body; rear lights (tail lights) can also be used, and the projected picture is located on the rear side of the vehicle body; With the new car lights installed on the side of the car body, the projected image is on the side of the car body. In this embodiment, as shown in FIG. 2 , left and right front lamps are used as DLP lamps for projection.

The DLP vehicle light is electrically connected to the DLP vehicle light controller, and is used to project the image to be projected to the outside under the control of the DLP vehicle light controller.

The working process of the vehicle payment system is as follows: Take the parking lot as an example. When the vehicle leaves the parking lot, it is stopped by the parking pole at the exit of the parking lot. Select the "one-key payment" option on the vehicle-mounted control device, and the vehicle-mounted control device receives the "one-key payment" payment instruction from the user, and dynamically obtains the dynamic payment code of the user's default payment APP according to the instruction. The payment code contains the user's payment information, and then the vehicle control device transmits the image projection command together with the image information of the dynamic payment code to the DLP lamp controller of the DLP lamp projection system in real time, and the DLP lamp controller executes the received image The projection command analyzes the image information, and controls the left and right DLP headlights (headlights) of the vehicle through the left and right light projection commands to project the payment code pattern on the ground, which is located in front of the front of the car and is separated from the front of the car. Within a certain area at a certain distance, a projection pattern as shown in Figure 2 is formed, for example, a two-dimensional code pattern with an area of 1 square meter projected 1 meter in front of the front of the vehicle, and because the height of the parking pole of the barrier gate is usually Not lower than the height of the lights from the ground, and there will be a certain distance between the lights and the parking pole. The projection direction is obliquely downward, so the parking pole will not block the light projection, and then the toll booth at the exit of the parking lot will be The projected payment code can be located and recognized, and the user's payment information can be obtained by scanning the code, and then the parking fee can be deducted to complete the self-service parking fee payment process without getting out of the car and without lowering the window.

It should be noted that if the DLP car lights use taillights, the projection screen is located in the rear area outside the vehicle body;

It can be understood that the charging party can pre-set a range mark on the ground or other positions used to specify the projection area. For example, in Figure 2, a box mark A is used on the ground to designate the area as the target projection area, and the box Logo A can be used as a projection area logo, that is, a range logo set by the charging party on the ground or other positions used to specify the projection area in advance. The user needs to project the payment code into the box logo A, and the charging party can use Through the pre-calibration, the code scanner aligned with the box mark A can scan the code directly, so that it is not necessary to locate the projected payment code every time the payment is charged, which improves the success rate of the code scanning of the charging party.

In addition, in order to further increase the diversity of vehicle payment methods, users can still be equipped with ETC in the car and use ETC to pay, for example, at expressway toll stations, and users can also bind the license plate with a bank card to be recognized by the toll station License plate and automatic payment, traditional payment modes such as ETC and license plate recognition can also be combined with the payment system provided by this application on the vehicle.

The vehicle-mounted toll payment system disclosed in this embodiment does not require the user to lower the window to display the QR code on the mobile phone to the on-duty personnel or the self-service toll collection machine to scan the code, but directly controls the IVI system and the DLP vehicle equipped with the vehicle itself in the vehicle. Lighting, the display method of the QR code that needs to be given to the toll booth has been changed to projecting on the ground. With the help of the lighting of the car lamp, the projected QR code is very clear and has a large area, which is beneficial for the toll party to scan the code and charge. The payment process is convenient and fast, and the payment efficiency is high. There is no need for the personnel in the car to operate the mobile phone, and there will be no delay in scanning the code because the distance from the on-duty personnel or the self-service toll machine is too far away, and there is no need for the user to install additional equipment such as ETC in advance, which reduces the payment The cost can meet people's needs for humanization, automation and convenience of payment.

When the on-duty personnel of the toll booth in the parking lot or the self-service toll machine complete the charging, the user will be prompted that the payment has been completed. At this time, the user needs to turn off the projection and drive away from the parking lot. Therefore, in a possible implementation, the vehicle control device is also used The configuration is as follows: sending an instruction to stop projection to the lamp projection device according to the received payment completion instruction. The vehicle light projection device is further configured to: control the DLP vehicle light to stop projection according to the stop projection instruction.

Among them, the payment completion instruction can be completed by the user by operating the vehicle control device (IVI system). For example, the user hears the voice prompt "Payment has been completed" issued by the guard or the self-service toll machine, or the user sees the payment on the display screen of the self-service toll collection machine. If the words "Payment Completed" are displayed, you can select the option "Close Projection" on the vehicle control device. This option is equivalent to the payment completion instruction, and then the DLP lights will stop projecting.

At present, a large part of parking lot toll booths use unattended self-service toll machines to collect parking fees at the exit of the parking lot. Therefore, in order to improve user experience and increase the automation and convenience of the payment process, in In a possible implementation manner, the payment instruction and/or the payment completion instruction are voice prompts issued by the charging party. And, the vehicle-mounted control device includes a vehicle-mounted voice recognition module, and the vehicle-mounted voice recognition module can include a voice collection device placed outside the vehicle body and close to the left driver's seat. For example, a miniature microphone can be used as the voice collection device, and the voice collection device will The collected voice information is transmitted to the vehicle-mounted voice recognition module in real time, and the vehicle-mounted voice recognition module extracts voice prompts therefrom, performs semantic recognition on the voice prompts, converts the recognition results into corresponding instruction information and sends them to the vehicle-mounted control device, Wherein, the instruction information is the payment instruction or the payment completion instruction.

That is to say, the way to obtain the instruction is not for the user to select the options on the screen in the IVI system, but when the self-service toll machine sends out a voice prompt such as "Please pay XX yuan parking fee", the vehicle-mounted voice recognition module will recognize it in real time. Recognize the external sound signal, and thus recognize the voice prompt "Please pay XX yuan parking fee". At this time, the vehicle-mounted voice recognition module will determine the meaning of the voice prompt through semantic recognition, and select from the instruction information library. The instruction information corresponding to this meaning, that is, "payment instruction", is sent to the on-board control device, and finally triggers the projection of the payment code.

The specific semantic recognition process can be: after the voice signal is collected, the voice signal is segmented by judging the volume of the voice signal, because there is no sound before and after the voice prompt is issued, so it can be included by volume The voice signal of the voice prompt is segmented from all received voice signals, and then the segmented voice signal is converted into text form through speech recognition technology to obtain the meaning of the voice prompt. Since the voice prompt is issued by a machine, the recognition The conversion rate is high, and then the converted text (that is, the meaning of the voice) is compared with the various text information pre-stored in the instruction information base, and the number of overlapping characters and the character length of the public character string are used to determine the highest similarity. The text information is used as the instruction information corresponding to the voice prompt. The speech recognition manner is not limited to this, and will not be listed here.

The same is true for the "payment completion instruction". When the self-service toll collection machine completes the scanning of the projected code, it will automatically send out a voice prompt such as "payment successful", and the vehicle-mounted voice recognition module will also recognize the voice prompt and read it from the instruction information database. It is determined that the "payment completion instruction" is the instruction information that matches the meaning of the voice prompt, and after it is sent to the vehicle control device, it finally triggers the shutdown of the projection.

Fully automated projection control is performed through voice recognition, and the entire payment process does not require user participation, making payment more humane.

For scenes with projection area signs, in order to prevent the user's vehicle from being unable to correctly scan the user's payment code due to the location of the vehicle, different models, etc., the projection screen is located outside the target projection area (the projection identification area designated by the charging party) , the charging party may set the area of the target projection area to be significantly larger than the actual projected screen area of a general vehicle, so that it is easier for the actual projected screen to fall into the target projection area, and the charging party will also set the scanning code of the scanning device The range is set to cover the entire target projection area, so as to realize the function of adapting to the target projection area and successfully scanning the payment code on the projection screen. However, no matter whether the charging party adopts manual scanning or automatic scanning by equipment, sometimes it may happen that due to obstructions and other reasons, the entire range of the target projection area cannot be covered when scanning the code, resulting in the inability to recognize the payment code pattern projected by the user. Therefore, In a possible implementation, in the process of DLP car light projection, the vehicle voice recognition module collects the screen position adjustment prompt issued by the charging party in real time and performs semantic recognition, and converts the recognition result into corresponding position adjustment instruction information and sent to the on-board control device, the on-board control device sends a corresponding car light swing command to the car light projection device according to the position adjustment instruction information, and the car light projection device controls the DLP car lights to perform corresponding directions according to the car light swing command. swing.

Assuming that the target projection area is a 4*4 square area, the actual projection screen of the vehicle to be paid is a 2*2 square area, and the current projection position is located in the upper right corner of the target projection area. As a result, the code scanning equipment of the self-service toll machine or the on-duty personnel in the toll booth cannot collect the content in the upper right corner of the target projection area, so the payment code cannot be recognized. At this time, the self-service toll collection machine identifies the cause of the failure of the current code scanning failure, and determines that the payment code cannot be completely scanned due to occlusion. Therefore, the self-service toll collection machine can issue a corresponding screen position adjustment prompt through the voice device, such as "project to the left ", and for toll booths guarded by humans, the staff can also say "turn to the left" when they find that they cannot scan the code normally due to obstacles. The on-board voice recognition module of the on-board control device will collect external sound signals in real time after the DLP lights are turned on for projection, and collect the screen position adjustment prompts of "projecting to the left" or "adjusting to the left" through voice signal extraction and other methods , determine the meaning of the screen position adjustment prompt after semantic recognition, and select the adjustment instruction information corresponding to the meaning from the instruction information database, wherein the semantic recognition method can be the same as the recognition of the voice prompt in the previous article, at this time The position adjustment instruction information of the vehicle includes an instruction to make the vehicle light swing to the left by a certain angle. Afterwards, the on-board control device generates a light swing command. At this time, the light swing command can be "swing left 10 degrees". After the light projection device receives the light swing command, the DLP car light will swing to the left accordingly. 10°, so that the actual projection screen moves to the position close to the upper left corner of the target projection area, avoiding the obstruction of obstacles, so that the code scanning equipment of the self-service toll machine or the guards in the toll booth can scan the code correctly.

There are many scenarios for instant toll payment in the car, such as paying parking fees in the parking lot, paying tolls at expressway toll stations, etc., and the environmental conditions in different scenarios are different, which will affect the scanned code after projection. The identification has a certain influence, so in order to eliminate the influence of some environmental conditions, in a possible implementation manner, the system further includes a light sensor installed on the vehicle body. The light sensor, also known as the brightness sensor, can sense the brightness of the surrounding environment. The car lamp projection device is further configured to: after receiving the image projection instruction, obtain the ambient brightness detected by the light sensor installed on the vehicle body, and according to the environment brightness during the process of controlling the DLP car lamp projection Brightness adjusts the brightness and/or contrast of the DLP lights.

When the ambient brightness is high, the car light projection device will control the DLP car lights to increase the brightness of the corresponding degree, or the corresponding degree of contrast improvement, or increase the brightness and contrast at the same time, so that when the charging party scans the code, it will not be affected by the projected image. Too dark or blurry to scan the code. Specifically, since DLP technology is a reflective projection method, it mainly changes the brightness and contrast of the projected picture by improving the color wheel technology, changing the inclination angle of the micromirror, and reducing optical path loss. When the ambient brightness is low, the car light projection device can also control the DLP car lights to properly reduce the brightness and contrast of the projected image, avoiding exposure during code scanning and saving energy.

Embodiment 2 disclosed in the present application will be described in detail below with reference to FIG. 3 . This embodiment discloses another vehicle-mounted toll payment system, which mainly includes: a vehicle-mounted image acquisition device, a vehicle-mounted control device and a vehicle lamp projection device.

The vehicle-mounted control device controls the vehicle-mounted image acquisition device to collect images of the area outside the vehicle body according to the received payment instruction, and recognizes the projected area logo on the collected external images.

When the projection area logo is recognized, the payment image containing the user payment information is acquired, and the image projection instruction and the payment image are sent to the vehicle lamp projection device, and the vehicle lamp projection device is controlled according to the image projection instruction The DLP headlights project the toll payment image to a location area located outside the vehicle body.

Specifically, the implementation of projection in this embodiment is similar to that in Embodiment 1, and will not be repeated here. The difference from Embodiment 1 is that this embodiment also includes a vehicle-mounted image acquisition device, the vehicle-mounted image acquisition device can use a camera, and the installation location can be a position close to the outside of the roof, for example, it is installed on the front side of the roof , the installation position can be adapted to the position of the DLP lamp. When the headlight is used as the DLP lamp, the installation position of the camera is the front side of the roof, and the installation position of the camera corresponding to the DLP lamp of the rear lamp is the roof. rear side. Since not all toll parties in all scenarios can charge by scanning the code on the projected screen, in order to prevent the user from lowering the car window and operating the mobile phone to pay by himself, and to improve the diversity and universality of the user's payment methods, this implementation The example also provides a way for the user to scan the code of the charging party, that is, use the vehicle-mounted image acquisition device to first judge whether there is a projection area mark in the current scene. A range identifier set at the location of the designated projection area, for example, the box identifier A in FIG. 2 is a projection area identifier.

Continuing to take the parking lot payment as an example, if the on-board control device recognizes the projection area logo after recognizing the image of the outside area of the vehicle body collected by the on-board image acquisition device, it means that the parking lot has a projection area logo, indicating that the current scene The charging party below supports projection scanning code payment, which is the way the charging party scans the user. At this time, the acquisition of the payment code and the implementation of the projection can be started as in the steps of the first embodiment.

If the on-board control device does not recognize the projection area logo after the image of the external area of the vehicle body is recognized, it is considered that the toll party in the current scene does not support projection scanning code payment, so it is necessary to use the user to scan the toll party to pay. The vehicle-mounted image acquisition device is also used to collect environmental images around the vehicle body, especially the external image on the left side of the vehicle body, and obtain the charging pattern pre-placed by the charging party. The charging pattern can be a two-dimensional code pattern containing merchant charging information. The toll pattern is sent to the IVI system by the on-board image acquisition device. The IVI system scans the toll pattern and pays the corresponding fee. After the completion, the toll party will release the user's vehicle.

It can be understood that the vehicle-mounted image acquisition device can be installed on a pan-tilt for easy rotation to adjust the direction of image acquisition, and the charging party can set special signs around the charging pattern to indicate that the charging pattern is on the side, which is convenient for vehicle-mounted image acquisition. Rapid positioning and recognition of the charging pattern by the collection device.

The specific image recognition method can be as follows: first, the neural network is used to extract the features of the images collected by the vehicle-mounted image acquisition device to obtain the feature map, and then the region selection network (Region Proposal Network, RPN) is used for each sliding window on the feature map. Each feature point corresponds to the part on the image, and multiple candidate regions of different scales are generated, and the candidate regions are mapped to the feature map to obtain the region of interest, and the region of interest is pooled to obtain the region of interest of the set size, using convolution The layer classifies the interest area of the set size, and judges whether the corresponding candidate area is a charging pattern area, for example, whether it is a two-dimensional code. The image recognition manner is not limited to this, and will not be listed here.

This embodiment not only provides the payment method of lighting projection, but also provides the payment method of automatically scanning the code of the charging party. Both methods do not require the user to lower the window to display the QR code on the mobile phone to the guard or self-service charging machine Scan the code, and use the IVI system equipped in the car or other similar systems to complete the whole payment process. Needs for humanization, automation and convenience.

In a possible implementation manner, in the case where the projection area identifier is identified, the method further includes:

In a possible implementation manner, the payment instruction and/or the payment completion instruction are voice prompts issued by the charging party; and, the vehicle-mounted voice recognition module of the vehicle control device performs semantic recognition on the voice prompt, and will The identification result is converted into corresponding instruction information and sent to the vehicle control device, wherein the instruction information is the payment instruction or the payment completion instruction.

The above-mentioned steps of stopping projection, voice recognition, adjusting the position of the projected screen, and adjusting the brightness of projection are all generated under the method of payment by projection, which is similar to the situation in Embodiment 1, and will not be repeated here.

Since the types and performances of lights of different models may be different, and the parking position of each vehicle when stopping at the exit of the parking lot for payment may also be different, so in order to make the projected image completely or mostly fall into the projected area logo , in a possible implementation manner, the vehicle-mounted control device is further configured to: control the vehicle-mounted image acquisition device to collect images of the area outside the vehicle body during the DLP lamp projection process, and determine Whether the degree of non-overlapping between the actual projected image and the target projection area exceeds the set threshold, and if the degree of non-overlapping exceeds the set threshold, control the DLP lights to swing in the direction of reducing the degree of non-overlapping until the degree of non-overlapping exceeds exceeds the set threshold.

In the previous step, the vehicle-mounted image acquisition device is responsible for collecting whether there is a projection area mark on the nearby ground. If there is no projection area mark, it will collect the payment pattern on the toll booth by rotating, etc., and continue to collect when there is a projection area mark. The image of the ground in the corresponding direction (front or rear or side), the purpose at this time is to determine whether the actual projection picture falls into the target projection area surrounded by the projection area mark, and the vehicle-mounted image acquisition device will capture the corresponding direction The ground image is sent to the IVI system, and the IVI system can judge the non-overlapping degree of the actual projection screen and the target projection area through edge detection algorithms, gray image segmentation methods, etc. Edge shape, from which the area ratio of the actual projected picture outside and within the target projection area is obtained, and the non-overlapping degree is obtained through the area ratio. If the non-overlapping degree exceeds the set threshold, it means that the projected picture does not fall within the target projection area Too much so that it is difficult for the charging party to recognize the user's payment information normally. At this time, the IVI system needs to adjust the DLP headlights to swing. For vehicles equipped with adaptive headlight systems, the headlights can be four If the lighting direction is adjusted by swinging, the IVI system can obtain the deviation direction between the actual projection screen and the target projection area after recognizing the edge shape, and control the corresponding amplitude of the reverse swing of the DLP car light based on the deviation direction, and then control the vehicle image. The image of the external area in front of the car body fed back by the acquisition device is used for identification and calculation of non-overlapping degree. If the set threshold is still exceeded at this time, the swing control will be carried out again. If the set threshold is not exceeded at this time, it means that the swing has been in place, and the charging party can Normal scan code is charged.

In addition, it should be noted that the vehicle-mounted voice recognition module can not only be used to adjust the position of the projected picture within the target area, but also can issue voice prompts and vehicle-mounted voice recognition through the charging party when the projected picture part falls outside the target area. The identification of the module can be realized in conjunction with the realization of the same function as the image acquisition through the vehicle-mounted image acquisition device and the adjustment of the projection screen to the target projection area through image recognition. That is to say, when the DLP vehicle starts to project The projected image deviates too much from the target area, so that even if the target area is large, half of the image is located outside the target area. At this time, the charging party can use voice to inform the on-board control module to adjust the projection until the adjustment is completed by the charging party. Scanning the code, whether the projection screen falls into the target area by voice or the vehicle collects images through the on-board image acquisition device to make the projection screen fall into the target area can be determined by the user according to the on-site situation.

The third embodiment disclosed in the present application will be described in detail below with reference to FIG. 4 . This embodiment discloses a vehicle toll payment method, and this embodiment is a method for implementing the vehicle toll payment system in the foregoing embodiment one.

As shown in Figure 4, the vehicle payment method disclosed in this embodiment includes the following steps:

Step 101, the on-board control device acquires a payment image including user payment information according to the received payment instruction, and sends the image projection instruction and the payment image to the vehicle light projection device;

Step 102 , the vehicle light projection device controls the DLP vehicle light to project the toll payment image to a position area located outside the vehicle body according to the image projection instruction.

In a possible implementation manner, the method also includes:

Embodiment 4 disclosed by the present application is described in detail below with reference to FIG. 5. This embodiment discloses another vehicle-mounted payment method. This embodiment is a method for implementing the vehicle-mounted payment system in the foregoing embodiment 2.

As shown in Figure 5, the vehicle payment method disclosed in this embodiment includes the following steps:

Step 201, the vehicle-mounted control device controls the vehicle-mounted image acquisition device to collect images of the area outside the vehicle body according to the received payment instruction, and identifies the projected area identification of the collected external images;

Step 202, if the projection area logo is recognized, acquire the payment image containing the user payment information, and send the image projection instruction and the payment image to the car lamp projection device, and the car lamp projection device The projection command controls the DLP car lights to project the payment image to the position area outside the vehicle body;

Step 203, if the projection area logo is not recognized, the vehicle-mounted control device controls the vehicle-mounted image acquisition device to collect an environmental image, recognizes a charging pattern containing merchant charging information from the environmental image, and the vehicle-mounted control device Pattern for automatic payment.

The difference between the present embodiment and the third embodiment is mainly that in this embodiment, the vehicle-mounted image acquisition device is used to judge whether the current projection scene is present, and if there is no projection scene, the user scans the merchant for payment instead.

In a possible implementation manner, the method also includes:

In the process of DLP car lamp projection, the on-board control device controls the on-board image acquisition device to collect images of the area outside the vehicle body, and judges whether the non-overlapping degree between the actual projection picture and the target projection area exceeds A threshold is set, and when the threshold is exceeded, the DLP lamp is controlled to swing in a direction to reduce the degree of non-overlap until the degree of non-overlap does not exceed the threshold.

The above is only a specific embodiment of the application, but the scope of protection of the application is not limited thereto. Any person familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the application. All should be covered within the scope of protection of this application. Therefore, the protection scope of the present application should be determined by the protection scope of the claims.

Claims

A vehicle toll payment system, characterized in that it comprises:

The on-vehicle control device is configured to acquire a payment image containing user payment information according to the received payment instruction, and send the image projection instruction and the payment image to the vehicle lamp projection device;

The vehicle light projection device is configured to control the DLP vehicle light to project the toll payment image to a position area outside the vehicle body according to the image projection instruction.
The vehicle-mounted toll payment system according to claim 1, wherein the vehicle-mounted control device is further configured to: send a stop projection instruction to the vehicle lamp projection device according to the received payment completion instruction;

The vehicle light projection device is further configured to: control the DLP vehicle light to stop projection according to the stop projection instruction.
The vehicle toll payment system according to claim 2, characterized in that, the payment instruction and/or the payment completion instruction are voice prompts issued by the charging party; and,

The vehicle-mounted control device includes a vehicle-mounted voice recognition module, and the vehicle-mounted voice recognition module is configured to: perform semantic recognition on the voice prompt, convert the recognition result into corresponding instruction information and send it to the vehicle-mounted control device, wherein the instruction The information is the payment instruction or the payment completion instruction.
The vehicle toll payment system according to claim 1, further comprising a light sensor mounted on the vehicle body; and,

The car lamp projection device is further configured to: after receiving the image projection instruction, obtain the ambient brightness detected by the light sensor installed on the vehicle body, and control the DLP car lamp projection process according to the environment brightness Brightness adjusts the brightness and/or contrast of the DLP lights.
A vehicle-mounted toll payment system, characterized in that it includes: a vehicle-mounted image acquisition device, a vehicle-mounted control device, and a vehicle light projection device; wherein,

The on-vehicle control device is configured to: control the on-vehicle image acquisition device to collect images of the area outside the vehicle body according to the received payment instruction, and identify the projected area logo on the collected external images;

When the identification of the projection area is recognized, the on-board control device acquires the payment image containing the user payment information, and sends the image projection instruction and the payment image to the car lamp projection device, and the car lamp projection device is configured as: Controlling the DLP vehicle lights according to the image projection instruction to project the payment image to the position area outside the vehicle body;

In the case that the projection area logo is not recognized, the vehicle-mounted control device controls the vehicle-mounted image acquisition device to collect the environmental image, recognizes the charging pattern containing the charging information of the merchant from the environmental image, and the vehicle-mounted control device automatically performs the charging according to the charging pattern. Pay the fees.
A vehicle toll payment method, characterized in that it comprises:

The on-board control device acquires the payment image including the user payment information according to the received payment instruction, and sends the image projection instruction and the payment image to the vehicle lamp projection device;

The vehicle light projection device controls the DLP vehicle light to project the payment image to the location area located outside the vehicle body according to the image projection instruction.
The vehicle toll payment method according to claim 6, further comprising:

The on-vehicle control device sends a stop projection instruction to the lamp projection device according to the received payment completion instruction;

The vehicle light projection device controls the DLP vehicle light to stop projection according to the stop projection instruction.
The vehicle toll payment method according to claim 7, characterized in that, the payment instructions and/or the payment completion instructions are voice prompts issued by the charging party; and,

The vehicle-mounted voice recognition module of the vehicle-mounted control device performs semantic recognition on the voice prompt, converts the recognition result into corresponding instruction information and sends it to the vehicle-mounted control device, wherein the instruction information is the payment instruction or the payment completion instruct.
The vehicle toll payment method according to claim 6, further comprising:

After the lamp projection device receives the image projection command, it obtains the ambient brightness detected by the light sensor installed on the vehicle body, and adjusts the brightness of the DLP lamp according to the ambient brightness during the process of controlling the projection of the DLP lamp and/or contrast.
A vehicle toll payment method, characterized in that it comprises:

The vehicle-mounted control device controls the vehicle-mounted image acquisition device to collect images of the area outside the vehicle body according to the received payment instructions, and identifies the projected area identification of the collected external images;

When the projection area logo is recognized, the payment image containing the user payment information is acquired, and the image projection instruction and the payment image are sent to the vehicle lamp projection device, and the vehicle lamp projection device is controlled according to the image projection instruction DLP headlights project the toll payment image to a position area located outside the vehicle body;

In the case that the projection area logo is not recognized, the vehicle-mounted control device controls the vehicle-mounted image acquisition device to collect the environmental image, recognizes the charging pattern containing the charging information of the merchant from the environmental image, and the vehicle-mounted control device automatically performs the charging according to the charging pattern. Pay the fees.