CN111435278A - Information interaction system and information interaction method based on license plate recognition - Google Patents

Information interaction system and information interaction method based on license plate recognition Download PDF

Info

Publication number
CN111435278A
CN111435278A CN201910106851.7A CN201910106851A CN111435278A CN 111435278 A CN111435278 A CN 111435278A CN 201910106851 A CN201910106851 A CN 201910106851A CN 111435278 A CN111435278 A CN 111435278A
Authority
CN
China
Prior art keywords
user
information
target user
vehicle
license plate
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910106851.7A
Other languages
Chinese (zh)
Inventor
金德奎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201910106851.7A priority Critical patent/CN111435278A/en
Publication of CN111435278A publication Critical patent/CN111435278A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G06V20/584Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of vehicle lights or traffic lights
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/017Detecting movement of traffic to be counted or controlled identifying vehicles
    • G08G1/0175Detecting movement of traffic to be counted or controlled identifying vehicles by photographing vehicles, e.g. when violating traffic rules
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/62Text, e.g. of license plates, overlay texts or captions on TV images
    • G06V20/625License plates

Abstract

The invention provides an information interaction system and an information interaction method based on license plate recognition, wherein user equipment obtains an image at least comprising a license plate of a target user automobile in real time through a camera, extracts vehicle data at least comprising the license plate, searches and compares the extracted vehicle data at least comprising the license plate with user vehicle data at least comprising the license plate data and a corresponding user Identity (ID) in a system database, if matching is successful, pushes an information window of the target user on a client interface of the user equipment, clicks the information window, pops up a chat window to send and receive information with the target user or enter a next layer window or interface, and performs information interaction to realize social interaction.

Description

Information interaction system and information interaction method based on license plate recognition
Technical Field
The invention relates to an information interaction system and an information interaction method, in particular to an information interaction system and an information interaction method based on license plate recognition.
Background
In the prior art, the automobile license plate recognition is mature through AI artificial intelligence, but application scenes are few, such as license plate recognition access to a parking lot, license plate recognition charging and the like, but interaction connection cannot be directly generated between a majority of users and vehicle users and between the vehicle users, so that social interaction and information propagation are performed. For example, a common user wants to perform interactive connection with a vehicle user, and can only go to and communicate with the other user directly after the user gets off the vehicle, so as to perform social interaction, but in a real scene, more vehicles are driven on the street or parked at a certain place, and the vehicle user as an owner has already left the vehicle, so that communication cannot be performed. If the potential safety hazard of the running vehicle is discovered by a roadside user or other vehicle users in the same running process, the vehicle user with the potential safety hazard cannot be notified. If the parked vehicle blocks the path of other vehicles and the owner is not present, the owner of the parked vehicle cannot be notified to remove the vehicle.
In the prior art, there is no good solution at present, how to quickly identify a target user with a vehicle in a real scene by a common user with the vehicle and a vehicle user with the vehicle, and the common user with the vehicle and the vehicle user with the vehicle directly establish connection with the target user with the vehicle to perform information interaction, so that social interaction and information dissemination are realized.
Disclosure of Invention
The technical problem to be solved by the invention is to provide an information interaction system and an information interaction method based on license plate recognition, and the problems in the prior art are solved. The technical scheme is as follows:
an information interaction method based on license plate recognition is characterized in that:
the method comprises the steps that user equipment and a client side obtain an image at least comprising a license plate of a target user automobile in real time through a camera, and vehicle data at least comprising the license plate is extracted;
the extracted vehicle data at least comprising license plates are searched and compared with user vehicle data at least comprising license plate data in a system server database and corresponding user identity IDs, and if matching is successful, the target user information window is pushed on a user equipment client interface;
the target user information window at least comprises one of a head portrait and a nickname of the target user, vehicle information of the target user, user (identity) information of the target user disclosed outside the scene, content information pushed by the target user and social buttons of the target user;
furthermore, the user clicks the information window of the target user, pops up a chat window to send and receive information with the target user or enters a next layer window or interface to carry out information interaction, and social interaction is realized.
The information window further comprises advertisement information pushed by a target user or advertisement information pushed by a system, wherein the advertisement information can be characters, pictures, audio, video, virtual contents such as AR (augmented reality) VR (virtual reality) and the like.
The social button is an avatar of the target user;
or the social button is a license plate image of a target user acquired in real time by a camera at an equipment client of the user;
or the social contact button is a license plate recognition frame or a vehicle recognition frame which is generated on the target user license plate image or the vehicle image acquired in real time after the license plate image is searched, compared and matched successfully by extracting the license plate data and the user vehicle data at least comprising the license plate data and the corresponding user identity ID in the system server database at the equipment client of the user in real time.
And when the license plate recognition, comparison and matching of more than one target user vehicle are successful, sequentially generating more than one target user social buttons, and sequentially arranging the social buttons on the user client interface according to the sequence to generate the social button arrangement.
After the license plate recognition, comparison and matching of more than one target user vehicle are carried out in sequence and corresponding social button arrangement is generated, the social buttons which are not displayed on the current interface can be browsed in a sliding mode, and further social operation of any social button is achieved.
The target user information also comprises words, pictures, voice and videos pushed by a system or a user to the target user, and AR augmented reality virtual media pushed and rendered near the license plate of the target user or on a vehicle;
the target user can further view information by clicking the pushed characters, pictures, voice and video and pushing and rendering AR augmented reality virtual media near the license plate or on the vehicle of the target user, or interact with the user through the information.
Displaying a nickname of a target user on the information or the social button;
or displaying a gender symbol of the target user on the information or the social button;
or, displaying the nickname plus the sex symbol of the target user on the information or the social button;
or displaying the vehicle mark or the license plate number of the target user on the information or the social button;
or displaying the vehicle information of the target user on the information or the social button, wherein the vehicle information at least comprises one of the brand, the model, the reference price, the main technical parameters and the appearance picture of the vehicle
The client interface is provided with a user setting button, and the user setting page is entered by clicking the setting button;
the user setting page comprises user information external disclosure range selection buttons, and the selection buttons comprise at least one of whether to externally disclose own name, gender, age, occupation, area, whether to vehicle user, whether to own real head portrait, short personal information, what user is visible, where and when, only receive safety warning information when the vehicle is in driving, and only receive friend information when the vehicle is in driving;
the safety warning information comprises safety warning information pushed by the system and safety warning information which is sent to a target user by a user through license plate recognition of the target user by the user through client equipment of the user.
When the vehicle distance between the user and the target user is long, in order to accurately identify and match the user identity corresponding to the target user, the user adjusts the focal length by finger multi-point touch sliding, and the license plate image of the target user is amplified;
or, a focusing button is arranged on the operation interface, and a user clicks or slides the focusing button through fingers to adjust the focal length and amplify the face image of the target user;
or, the user equipment client automatically adjusts the focal length of the equipment camera until the license plate is accurately identified.
Whether a system user is a vehicle user or a non-vehicle user, a user equipment camera can be used in a real scene to acquire a face image of a target user in the system, and face feature data are extracted;
comparing the extracted face feature data with user face feature data of a database, and if matching is successful, generating a social button of the target user;
and clicking the social button, popping up a corresponding social window, and realizing social interaction with the target user.
The utility model provides an information interaction system based on license plate discernment which characterized in that:
the system comprises user client equipment and a system server;
the user client equipment comprises a mobile phone or a tablet computer with a camera, a display screen, an operating system processor and a communication module;
or the user client equipment comprises a mobile phone with a camera, a display screen, a processor and a communication module, and further comprises an image acquisition device arranged on the vehicle, wherein the image acquisition device at least comprises the camera, the microprocessor and the communication module, or the image acquisition device is a vehicle event data recorder with the camera and the communication module;
the camera of the image acquisition device installed on the vehicle and the communication module are connected with the microprocessor, and acquired image data are transmitted to a vehicle user equipment client through the communication module; or, for a non-vehicle user, the camera of the user client equipment directly transmits the acquired image data to the user equipment client;
the user equipment client acquires an image at least comprising a license plate of a target user automobile in real time through the camera, and extracts vehicle data at least comprising the license plate of the automobile;
the extracted vehicle data at least comprising the license plate is sent to a system server, the extracted vehicle data is searched and compared with user vehicle data at least comprising the license plate data in a database of the system server and a corresponding user Identity (ID), and if the matching is successful, the target user information is generated on a client interface of user equipment;
the target user information at least comprises one of a head portrait and a nickname of the target user, vehicle information of the target user, user (identity) information of the target user disclosed outside the scene, content information pushed by the target user and social buttons of the target user;
and clicking the information window of the target user by the user, popping up a chat window to send and receive information with the target user or entering a next layer window or interface, and performing information interaction to realize social interaction.
The invention provides an information interaction system and an information interaction method based on license plate recognition, which overcome the problems in the prior art, and user equipment acquires an image at least comprising a license plate of a target user automobile in real time through a camera and extracts vehicle data at least comprising the license plate of the automobile; searching and comparing the extracted vehicle data at least comprising the license plate with the user vehicle data at least comprising the license plate data in the system database and the corresponding user identity ID, and if the matching is successful, pushing the target user information window on a user equipment client interface; the target user information window at least comprises one of a head portrait and a nickname of the target user, vehicle information of the target user, user (identity) information of the target user disclosed outside the scene, content information pushed by the target user and social buttons of the target user; furthermore, the user clicks the information window of the target user, pops up a chat window to send and receive information with the target user or enters a next layer window or interface to carry out information interaction, and social interaction is realized.
According to the invention, a common user without a vehicle can scan the license plate of a target user with the vehicle through a mobile phone client, identify and match the mobile phone client ID of the vehicle user corresponding to the license plate, and directly establish connection with the target user of the vehicle to carry out information interaction, so that social interaction and information transmission are realized, and the information interaction and social bottleneck between the common user and the vehicle user are broken. In addition, the vehicle users can acquire the license plate information and the vehicle information of other surrounding vehicles in real time through an image acquisition device or a driving recorder which is arranged on the vehicle and provided with a camera, a microprocessor and a communication module, AI artificial intelligence license plate identification is carried out, the mobile phone client ID of the corresponding vehicle user is searched and matched, the connection is directly established with the user for information interaction, social interaction and information transmission are realized, and the information interaction and social bottleneck among the vehicle users are broken.
The user equipment comprises a mobile phone and a tablet personal computer, and also comprises intelligent glasses with an image acquisition device, such as AR glasses, MR glasses and VR glasses. The license plate information and the vehicle information of the vehicle user in the current real scene can be collected by the ordinary user by using the mobile phone, so that the use cost of the user is reduced, and the vast ordinary users can participate in information interaction and social interaction. The vehicle user can also install an image acquisition device or a vehicle event data recorder which is only provided with a camera, a microcontroller and a communication module to transmit acquired images to the mobile phone client of the user, so that the user client identity IDs of other vehicles can be identified through the license plate, and the vehicle user can directly establish connection with users of other vehicles to carry out information interaction and social interaction, thereby reducing the use cost of the vehicle user. The invention solves the problems in the prior art and brings new and better experience to users. Thus, the present invention represents a significant technical advance over the prior art.
Drawings
FIG. 1 is a first flow chart of the method of the present invention.
FIG. 2 is a flow chart two of the method of the present invention.
FIG. 3 is a third flow chart of the method of the present invention.
FIG. 4 is a fourth flow chart of the method of the present invention.
Fig. 5 is a flow chart five of the method of the present invention.
Fig. 6 is a flow chart six of the method of the present invention.
Fig. 7 is a seventh flow chart of the method of the present invention.
Fig. 8 is a flow chart eight of the method of the present invention.
Figure 9 is a flow chart nine of the method of the present invention.
FIG. 10 is a first schematic diagram of a client interface of the method of the present invention.
FIG. 11 is a second schematic diagram of a client interface of the method of the present invention.
FIG. 12 is a third schematic view of a client interface of the method of the present invention.
FIG. 13 is a fourth schematic view of a client interface of the method of the present invention.
FIG. 14 is a fifth schematic view of a client interface of the method of the present invention.
FIG. 15 is a sixth schematic of a client interface of the method of the present invention.
Fig. 16 is a first system diagram of the present invention.
FIG. 17 is a second schematic of the system of the present invention.
Fig. 18 is a block diagram of an image capture device of the system of the present invention.
Fig. 19 is a block diagram of a second embodiment of the system of the present invention.
Detailed Description
The invention is further described with reference to the following figures and embodiments.
An information interaction method based on license plate recognition comprises the following steps:
as shown in fig. 1, fig. 10, fig. 11, fig. 12, fig. 13, fig. 14, fig. 15, and fig. 17, the user equipment 100 acquires an image 211 of the automobile of the target user 20, which includes at least a license plate, in real time through the camera 101, and extracts vehicle data, which includes at least a license plate number 210; the extracted vehicle data at least comprising the license plate number 210 is searched and compared with the user vehicle data at least comprising the license plate data in the database of the system server 1000 and the corresponding user identity ID, and if the matching is successful, the information of the target user 20 is pushed on the user equipment client interface 110; the target user 20 information at least comprises one of the head portrait 220 and the nickname of the target user, the vehicle information of the target user 20, the user (identity) information of the target user 20 disclosed outside the scene, the content information 230 pushed by the target user 20, and the social button of the target user 20 (both the head portrait 220 and the information 230 can be used as social buttons); further, the user 10 clicks the information of the target user 20 (clicks a social button), and the pop-up chat window 120 performs information transmission and reception with the target user 20 or enters a next-layer window or interface for information interaction, thereby implementing social interaction.
The information window also comprises advertisement information pushed by a target user or advertisement information pushed by a system, wherein the advertisement information can be characters, pictures, audio, video, virtual contents such as AR (augmented reality) VR (virtual reality) and the like.
As shown in fig. 10 to 12, 14 to 16, and 17, the social button is an avatar 220 of the target user 20; or, the social button is a license plate image of the target user 20 obtained in real time by the camera 101 at the device 100 client 110 of the user 10; or, the social button is a license plate recognition box 211 or a vehicle recognition box 212 generated on the license plate image or the vehicle image of the target user 20 acquired in real time after the license plate image of the target user 20 acquired in real time is searched, compared and matched successfully by extracting the license plate data and the user vehicle data at least including the license plate data and the corresponding user identity ID in the database of the system server 1000 at the client 110 of the device 100 of the user 10 through the camera 101.
Generally, the area of the acquired license plate image and the area of the acquired vehicle image are larger than that of the license plate recognition frame and the vehicle recognition frame, and the license plate recognition frame and the vehicle recognition frame can be generated as long as the image resolution is enough and the whole vehicle image including the license plate is acquired. Regarding the labeling of the recognition frame, the real-time tracking and labeling of the license plate recognition frame or the vehicle recognition frame can be selected according to the actual situation of the mobile phone client, and only the license plate recognition frame or the vehicle recognition frame can be labeled. Generally, the license plate recognition box can be marked as long as the license plate number is recognized, the head portrait or other information of the user is pushed immediately after the system server successfully queries and matches the corresponding user identity ID, and the head portrait or other information is stored or temporarily stored in a head portrait list, and the head portrait list is described below.
As shown in fig. 3 and 13, when the license plate recognition, comparison, and matching are successfully performed on more than one target user vehicle in sequence, the social buttons of more than one target user are sequentially generated, for example, the social buttons 220, 320, 420, 520, and 620 are sequentially generated and sequentially arranged on the user client interface, so as to generate the social button arrangement.
As shown in fig. 4, after license plate recognition, comparison, and matching are successfully performed on more than one target user vehicle in sequence and corresponding social button arrangement is generated, the social buttons not displayed on the current interface can be slid and viewed, so that further social operation on any social button is realized.
As shown in fig. 5, 12, 14 to 16, the target user information further includes text, pictures, voice, video pushed by the system or user to the target user, such as the chat window 120 in fig. 12, the information interface 230 in fig. 14 and 15, and the AR augmented reality virtual medium 240 pushed near the license plate or on the vehicle of the target user as shown in fig. 16. The target user may further view information by clicking on the pushed text, picture, voice, video information window 230 and pushing the rendered AR augmented reality virtual medium 240 near the license plate or on the vehicle of the target user, or interact with the user through the chat window 120, information window 230, AR augmented reality virtual medium 240.
As shown in fig. 6, 10, and 13 to 15, a nickname 221 of a target user is displayed on the information or the social button; or, displaying the gender symbol 222 of the target user on the information or the social button; or, displaying the nickname 221 and the sex symbol 222 of the target user on the information or the social button; or, displaying the vehicle mark 223 or the license plate number of the target user on the information or the social button; or displaying the vehicle information 230 of the target user on the information or the social button, wherein the vehicle information at least comprises one of the brand, the model, the reference price, the main technical parameter and the appearance picture of the vehicle. The vehicle appearance picture can also be used as the user head portrait, or the vehicle appearance is fused with the user head portrait.
As shown in fig. 7, the client interface has a user setting button, and the user setting page is entered by clicking the setting button; the user setting page comprises user information external disclosure range selection buttons, and the selection buttons comprise at least one of whether to externally disclose own name, gender, age, occupation, area, whether to vehicle user, whether to own real head portrait, short personal information, what user is visible, where and when, only receive safety warning information when the vehicle is in driving, and only receive friend information when the vehicle is in driving.
The safety warning information comprises safety warning information pushed by the system and safety warning information which is sent to a target user by a user through license plate recognition of the target user by the user through client equipment of the user.
As shown in fig. 8, when the vehicle distance between the user and the target user is long, in order to accurately identify and match the user identity corresponding to the target user, the user equipment client automatically adjusts the focal length of the equipment camera until the license plate is accurately identified. The user can also adjust the focal length by multi-point touch sliding of the fingers, and the license plate image of the target user is amplified. Or, a focusing button is arranged on the operation interface, and a user clicks or slides the focusing button through fingers to adjust the focal length and magnify the face image of the target user. This allows identification of a vehicle license plate at a distance.
As shown in fig. 9, no matter a system user is a vehicle user or a non-vehicle user, the system user can use a user equipment camera to obtain a face image of a target user in the system in a real scene, and extract face feature data; comparing the extracted face feature data with user face feature data of a database, and if matching is successful, generating a social button of the target user; and clicking the social button, popping up a corresponding social window, and realizing social interaction with the target user.
The utility model provides an information interaction system based on license plate discernment which characterized in that:
as shown in fig. 17, a first embodiment of the system is that the system includes user client devices 100 and 200 and a system server 1000. The user client device 100 is a normal non-vehicle user and the user client device 200 is a vehicle user.
The user client device 100, 200 comprises a mobile phone or tablet computer having a camera, a display screen, an operating system processor, and a communication module.
The user equipment 100 and the client side acquire an image 211 at least comprising a license plate of the automobile of the target user 20 in real time through the camera 101, and extract vehicle data at least comprising the license plate 210; the extracted vehicle data at least comprising the license plate number 210 is searched and compared with the user vehicle data at least comprising the license plate data in the database of the system server 1000 and the corresponding user identity ID, and if the matching is successful, the information of the target user 20 is pushed on the user equipment client interface 110; further, the user 10 clicks the information of the target user 20 (clicks a social button), and the pop-up chat window 120 performs information transmission and reception with the target user 20 or enters a next-layer window or interface for information interaction, thereby implementing social interaction.
As shown in fig. 18 and 19, a second embodiment of the system is that the user client devices 200 and 300 include a mobile phone having a camera, a display screen, a processor and a communication module, and further include image capturing devices 240 and 340 mounted on the vehicle, where the image capturing device 240 or 340 at least includes a camera 241, a microprocessor 242 and a communication module 243, or the image capturing device is a vehicle recorder having a camera and a communication module.
As shown in fig. 19, the camera 241 and the communication module 243 of the image capturing device 240 mounted on the vehicle are connected to the microprocessor 242, and captured image data is transmitted to the client of the vehicle user equipment 200 through the communication module 243; or for non-vehicle users or vehicle users without image acquisition devices, the camera of the user mobile phone equipment directly transmits acquired image data to the user mobile phone client.
And the user equipment client acquires the image at least comprising the license plate of the target user automobile in real time through the camera, and extracts the vehicle data at least comprising the license plate of the automobile.
And sending the extracted vehicle data at least comprising the license plate to a system server, searching and comparing the extracted vehicle data with user vehicle data at least comprising the license plate data in a database of the system server and the corresponding user identity ID, and if the matching is successful, generating the target user information on a client interface of the user equipment.
The target user information at least comprises one of the head portrait and the nickname of the target user, the vehicle information of the target user, the user (identity) information of the target user disclosed outside the scene, the content information pushed by the target user and the social buttons of the target user.
And clicking the information window of the target user by the user, popping up a chat window to send and receive information with the target user or entering a next layer window or interface, and performing information interaction to realize social interaction.
The license plate recognition technology adopted by the invention is the prior art, such as adopting AI artificial intelligence to carry out deep learning, collecting and recognizing license plate numbers in real time, collecting vehicle images in real time to carry out vehicle image recognition, and tracking license plates and whole vehicles in real time. And will not be described in detail herein.
The above description is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, many variations and modifications can be made without departing from the spirit of the present invention, and these are all within the scope of the present invention.

Claims (10)

1. An information interaction method based on license plate recognition is characterized in that:
the method comprises the steps that user equipment obtains an image at least comprising a license plate of a target user automobile in real time through a camera, and extracts vehicle data at least comprising the license plate;
the extracted vehicle data at least comprising license plates are searched and compared with user vehicle data at least comprising license plate data in a system server database and corresponding user identity IDs, and if matching is successful, the target user information window is pushed on a user equipment client interface;
the target user information window at least comprises one of a head portrait and a nickname of the target user, vehicle information of the target user, user (identity) information of the target user disclosed outside the scene, content information pushed by the target user and social buttons of the target user;
furthermore, the user clicks the information window of the target user, pops up a chat window to send and receive information with the target user or enters a next layer window or interface to carry out information interaction, and social interaction is realized.
2. The method of claim 1, wherein:
the social button is an avatar of the target user;
or the social button is a license plate image of a target user acquired in real time by a camera at an equipment client of the user;
or the social contact button is a license plate recognition frame or a vehicle recognition frame which is generated on the target user license plate image or the vehicle image acquired in real time after the license plate image is searched, compared and matched successfully by extracting the license plate data and the user vehicle data at least comprising the license plate data and the corresponding user identity ID in the system server database at the equipment client of the user in real time.
3. The method of claim 1, wherein:
and when the license plate recognition, comparison and matching of more than one target user vehicle are successful, sequentially generating more than one target user social buttons, and sequentially arranging the social buttons on the user client interface according to the sequence to generate the social button arrangement.
The information window further comprises advertisement information pushed by a target user or advertisement information pushed by a system, and the advertisement information can be characters, pictures, audio, video, virtual content such as AR (augmented reality) VR (virtual reality) and the like.
4. The method of claim 3, wherein:
after the license plate recognition, comparison and matching of more than one target user vehicle are carried out in sequence and corresponding social button arrangement is generated, the social buttons which are not displayed on the current interface can be browsed in a sliding mode, and further social operation of any social button is achieved.
5. The method of claim 1, wherein:
the target user information also comprises words, pictures, voice and videos pushed by a system or a user to the target user, and AR augmented reality virtual media pushed and rendered near the license plate of the target user or on a vehicle;
the target user can further view information by clicking the pushed characters, pictures, voice and video and pushing and rendering AR augmented reality virtual media near the license plate or on the vehicle of the target user, or interact with the user through the information.
6. The method of any one of claims 1-5, wherein:
displaying a nickname of a target user on the information or the social button;
or displaying a gender symbol of the target user on the information or the social button;
or, displaying the nickname plus the sex symbol of the target user on the information or the social button;
or displaying the vehicle mark or the license plate number of the target user on the information or the social button;
or displaying the vehicle information of the target user on the information or the social button, wherein the vehicle information at least comprises one of a vehicle brand, a model, a reference price, a main technical parameter and a shape picture.
7. The method of any one of claims 1-5, wherein:
the client interface is provided with a user setting button, and the user setting page is entered by clicking the setting button;
the user setting page comprises user information external disclosure range selection buttons, and the selection buttons comprise at least one of whether to externally disclose own name, gender, age, occupation, area, whether to vehicle user, whether to own real head portrait, short personal information, what user is visible, where and when, only receive safety warning information when the vehicle is in driving, and only receive friend information when the vehicle is in driving;
the safety warning information comprises safety warning information pushed by the system and safety warning information which is sent to a target user by a user through license plate recognition of the target user by the user through client equipment of the user.
8. The method of any one of claims 1-5, wherein:
when the vehicle distance between the user and the target user is long, in order to accurately identify and match the user identity corresponding to the target user, the user adjusts the focal length by finger multi-point touch sliding, and the license plate image of the target user is amplified;
or, a focusing button is arranged on the operation interface, and a user clicks or slides the focusing button through fingers to adjust the focal length and amplify the face image of the target user;
or, the user equipment client automatically adjusts the focal length of the equipment camera until the license plate is accurately identified.
9. The method of any one of claims 1-5, wherein:
whether a system user is a vehicle user or a non-vehicle user, a user equipment camera can be used in a real scene to acquire a face image of a target user in the system, and face feature data are extracted;
comparing the extracted face feature data with user face feature data of a database, and if matching is successful, generating a social button of the target user;
and clicking the social button, popping up a corresponding social window, and realizing social interaction with the target user.
10. The utility model provides an information interaction system based on license plate discernment which characterized in that:
the system comprises user client equipment and a system server;
the user client equipment comprises a mobile phone or a tablet computer with a camera, a display screen, an operating system processor and a communication module;
or the user client equipment comprises a mobile phone with a camera, a display screen, a processor and a communication module, and further comprises an image acquisition device arranged on the vehicle, wherein the image acquisition device at least comprises the camera, the microprocessor and the communication module, or the image acquisition device is a vehicle event data recorder with the camera and the communication module;
the camera of the image acquisition device installed on the vehicle and the communication module are connected with the microprocessor, and acquired image data are transmitted to a vehicle user equipment client through the communication module; or, for a non-vehicle user, the camera of the user client equipment directly transmits the acquired image data to the user equipment client;
the user equipment client acquires an image at least comprising a license plate of a target user automobile in real time through the camera, and extracts vehicle data at least comprising the license plate of the automobile;
the extracted vehicle data at least comprising the license plate is sent to a system server, the extracted vehicle data is searched and compared with user vehicle data at least comprising the license plate data in a database of the system server and a corresponding user Identity (ID), and if the matching is successful, the target user information is generated on a client interface of user equipment;
the target user information at least comprises one of a head portrait and a nickname of the target user, vehicle information of the target user, user (identity) information of the target user disclosed outside the scene, content information pushed by the target user and social buttons of the target user;
and clicking the information window of the target user by the user, popping up a chat window to send and receive information with the target user or entering a next layer window or interface, and performing information interaction to realize social interaction.
CN201910106851.7A 2019-01-14 2019-01-14 Information interaction system and information interaction method based on license plate recognition Pending CN111435278A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910106851.7A CN111435278A (en) 2019-01-14 2019-01-14 Information interaction system and information interaction method based on license plate recognition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910106851.7A CN111435278A (en) 2019-01-14 2019-01-14 Information interaction system and information interaction method based on license plate recognition

Publications (1)

Publication Number Publication Date
CN111435278A true CN111435278A (en) 2020-07-21

Family

ID=71581002

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910106851.7A Pending CN111435278A (en) 2019-01-14 2019-01-14 Information interaction system and information interaction method based on license plate recognition

Country Status (1)

Country Link
CN (1) CN111435278A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112073304A (en) * 2020-09-04 2020-12-11 华人运通(上海)云计算科技有限公司 Social communication system and method between vehicles
CN113192348A (en) * 2021-04-21 2021-07-30 支付宝(杭州)信息技术有限公司 Vehicle abnormity warning method and device and computer equipment

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110106781A1 (en) * 2009-10-29 2011-05-05 Sharanne Pearson System and Method for Dating Using Vehicle License Plate Numbers
CN103049520A (en) * 2011-12-19 2013-04-17 微软公司 Action initiation and execution employing pictures
CN104572732A (en) * 2013-10-22 2015-04-29 腾讯科技(深圳)有限公司 Method and device for inquiring user identification and method and device for acquiring user identification
US20150215288A1 (en) * 2014-01-28 2015-07-30 Kevin R. Ramsaur Decentralized peer-based indirect authentication method for personal online social networking profiles
CN105610964A (en) * 2016-01-19 2016-05-25 深圳市凯立德科技股份有限公司 Interaction method capable of binging social application account by license plate number, car recorder and system
CN108307102A (en) * 2017-06-16 2018-07-20 腾讯科技(深圳)有限公司 Method for information display, apparatus and system
CN108494840A (en) * 2018-03-13 2018-09-04 杭州求圣科技有限公司 Move vehicle notice system
CN108843101A (en) * 2018-06-22 2018-11-20 杭州五色云文化传播有限公司 Intelligent interaction device suitable for garage
CN108965453A (en) * 2018-08-02 2018-12-07 韩宁 A kind of system and its operating method using license number as call number

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110106781A1 (en) * 2009-10-29 2011-05-05 Sharanne Pearson System and Method for Dating Using Vehicle License Plate Numbers
CN103049520A (en) * 2011-12-19 2013-04-17 微软公司 Action initiation and execution employing pictures
CN104572732A (en) * 2013-10-22 2015-04-29 腾讯科技(深圳)有限公司 Method and device for inquiring user identification and method and device for acquiring user identification
US20150215288A1 (en) * 2014-01-28 2015-07-30 Kevin R. Ramsaur Decentralized peer-based indirect authentication method for personal online social networking profiles
CN105610964A (en) * 2016-01-19 2016-05-25 深圳市凯立德科技股份有限公司 Interaction method capable of binging social application account by license plate number, car recorder and system
CN108307102A (en) * 2017-06-16 2018-07-20 腾讯科技(深圳)有限公司 Method for information display, apparatus and system
CN108494840A (en) * 2018-03-13 2018-09-04 杭州求圣科技有限公司 Move vehicle notice system
CN108843101A (en) * 2018-06-22 2018-11-20 杭州五色云文化传播有限公司 Intelligent interaction device suitable for garage
CN108965453A (en) * 2018-08-02 2018-12-07 韩宁 A kind of system and its operating method using license number as call number

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112073304A (en) * 2020-09-04 2020-12-11 华人运通(上海)云计算科技有限公司 Social communication system and method between vehicles
CN113192348A (en) * 2021-04-21 2021-07-30 支付宝(杭州)信息技术有限公司 Vehicle abnormity warning method and device and computer equipment

Similar Documents

Publication Publication Date Title
CN108234591B (en) Content data recommendation method and device based on identity authentication device and storage medium
US8024359B2 (en) System and method for accessing electronic data via an image search engine
CN102298533B (en) Method for activating application program and terminal equipment
CN105450778B (en) Information transmission system
US20120062595A1 (en) Method and apparatus for providing augmented reality
US20090061949A1 (en) System, method and mobile unit to sense objects or text and retrieve related information
CN104021398A (en) Wearable intelligent device and method for assisting identity recognition
CN103369049A (en) Mobile terminal and server interactive method and system thereof
CN105631051A (en) Character recognition based mobile augmented reality reading method and reading system thereof
CN103310189A (en) Object identification in images or image sequences
CN103455142A (en) Image identification real-time three-dimensional interactive device and image identification real-time three-dimensional interactive method
CN110956483A (en) Advertisement information pushing method, system, server and vehicle
CN103425993A (en) Method and system for recognizing images
CN108596670A (en) Advertisement sending method, apparatus and system
CN105631461A (en) Image recognition system and method
CN111435278A (en) Information interaction system and information interaction method based on license plate recognition
CN205563604U (en) A intelligent image recognition device for selling among management system
US20230206093A1 (en) Music recommendation method and apparatus
CN113891105A (en) Picture display method and device, storage medium and electronic equipment
WO2019062347A1 (en) Facial recognition method and related product
US20150199729A1 (en) Methods and systems for dynamic advertising on mobile and stationary platforms
CN111491209A (en) Video cover determining method and device, electronic equipment and storage medium
CN113010017B (en) Multimedia information interactive display method, system and electronic equipment
CN109447192A (en) Information-pushing method and Related product
CN107484013A (en) A kind of method that television program interaction is carried out using mobile device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination