CN110868687A - House property introduction method, system, server and vehicle - Google Patents

House property introduction method, system, server and vehicle Download PDF

Info

Publication number
CN110868687A
CN110868687A CN201810956116.0A CN201810956116A CN110868687A CN 110868687 A CN110868687 A CN 110868687A CN 201810956116 A CN201810956116 A CN 201810956116A CN 110868687 A CN110868687 A CN 110868687A
Authority
CN
China
Prior art keywords
property
vehicle
information
real
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810956116.0A
Other languages
Chinese (zh)
Other versions
CN110868687B (en
Inventor
时红仁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Qinggan Intelligent Technology Co Ltd
Original Assignee
Shanghai Qinggan Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Qinggan Intelligent Technology Co Ltd filed Critical Shanghai Qinggan Intelligent Technology Co Ltd
Priority to CN201810956116.0A priority Critical patent/CN110868687B/en
Publication of CN110868687A publication Critical patent/CN110868687A/en
Application granted granted Critical
Publication of CN110868687B publication Critical patent/CN110868687B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • H04W4/025Services making use of location information using location based information parameters
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/30Services specially adapted for particular environments, situations or purposes
    • H04W4/40Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
    • H04W4/44Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P] for communication between vehicles and infrastructures, e.g. vehicle-to-cloud [V2C] or vehicle-to-home [V2H]

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computing Systems (AREA)
  • Medical Informatics (AREA)
  • Ophthalmology & Optometry (AREA)
  • Traffic Control Systems (AREA)

Abstract

The application relates to a house property introduction method, a system, a server and a vehicle, wherein when the vehicle receives a voice instruction for introducing a house property, the vehicle sends real-time acquired external videos and eyeball tracking information to the server through a 5G internet of vehicles network, the server acquires the real-time position of the vehicle when receiving the external videos and the eyeball tracking information, determines a target house property on the road side and acquires house property information of the target house property according to the real-time position, the eyeball tracking information and the external videos, and sends the acquired house property information to the vehicle through the 5G internet of vehicles network, so that the vehicle displays the house property information to a user. Through the mode, the user intention can be timely acquired according to the eyeball tracking information when the instruction is received, meanwhile, the high-speed and high-efficiency Internet of vehicles is constructed by utilizing the 5G technical network, the external videos and the vehicle positions of the vehicles can be simultaneously processed by the server, so that the house property introduction service is conveniently and timely provided, and the seen and obtained travel experience is realized.

Description

House property introduction method, system, server and vehicle
Technical Field
The application relates to the technical field of vehicles, in particular to a house property introduction method, a system, a server and a vehicle.
Background
With the rapid development of automobile industry and the improvement of living standard of people in China, the quantity of automobiles owned by families of residents is rapidly increased, and the automobiles gradually become one of indispensable transportation means in the life of people.
Meanwhile, people do not position the automobile as a simple transportation tool and a travel tool any more, the requirements on the aspects of realizing intelligent travel and the like through the automobile are increasingly large, and in order to realize the intelligent travel, each independent automobile needs to be connected through an internet of vehicles technology to perform big data analysis, so that the problems of shortage of frequency spectrum resources, crowded frequency bands, safety and the like of vehicle-mounted communication are increasingly prominent. With the rapid development of the fifth generation mobile communication (5G), the current car networking problem can be effectively solved through the performances of low time delay, high reliability, efficient spectrum utilization and the like, so that the implementation and deployment of the 5G car networking are imperative.
On the other hand, the eyeball tracking technology can track according to the characteristic changes of the eyeball and the periphery of the eyeball, or track according to the angle change of the iris, or actively project light beams such as infrared rays and the like to the iris to extract the characteristics, when the eyes of a person look at different directions, the eyes have slight changes, the changes can generate the extractable characteristics, and the computer can extract the characteristics through image capture or scanning, so that the changes of the eyes are tracked in real time, the state and the demand of a user are predicted, response is carried out, and the purpose of controlling the equipment by the eyes is achieved. For automobile manufacturers, the application of eyeball tracking technology is still a new topic, and at present, a camera is mainly used for monitoring the eyeball movement of a driver, and if the eyes of the driver are closed for a little long time, a system can start a sound alarm to wake up the driver so as to prevent accidents. Because the application of the eyeball tracking technology in the automobile field is still limited to the analysis of eyeball states at present, but not really applied to the identification of intentions of users, in this way, under a scene, when a user drives a car to pass through a section of road and watches interesting houses and stores around, the vehicle cannot acquire the intentions of the user in time, so that the user cannot acquire required information in time, and the travel experience of the user is influenced.
In response to the above problems, those skilled in the art have sought solutions.
Disclosure of Invention
An object of the application is to provide a house property introduction method, a system, a server and a vehicle, which can solve the technical problems, can timely acquire user intention according to eyeball tracking information when receiving an instruction, and simultaneously construct a high-speed and high-efficiency Internet of vehicles network by using a 5G technical network, so that the server can simultaneously process videos outside the vehicle and vehicle positions, thereby conveniently and timely providing house property introduction service and realizing what you see is what you get trip experience.
In order to solve the above technical problem, the present application provides a method for introducing a property, including:
when the vehicle receives a voice instruction for introducing a house property, the vehicle sends the vehicle exterior video and eyeball tracking information which are collected in real time to a server through a 5G vehicle networking network;
the server acquires the real-time position of the vehicle when receiving the external video and the eyeball tracking information, determines the target property of the road side according to the real-time position, the eyeball tracking information and the external video, acquires the property information of the target property, and sends the acquired property information to the vehicle through a 5G internet of vehicles network, so that the vehicle displays the property information to a user.
Wherein, according to real-time position, eyeball tracking information, the outer video of car confirm the target property of road side and obtain the property information of target property, include:
the server acquires the eyeball motion angle of the user according to the eyeball tracking information;
determining a coordinate range of the road side according to the eyeball motion angle and the real-time position;
if the continuous set duration of the coordinate range is consistent, determining the property in the coordinate range as a target property on the road side;
and acquiring the property information of the target property, wherein the property information comprises property source data and an image of the target property extracted from the vehicle exterior video.
Wherein, according to real-time position, eyeball tracking information, the outer video of car confirm the target property of road side and obtain the property information of target property, include:
the server acquires the eyeball movement angle of the user according to the tracking information;
determining a coordinate range of the road side according to the eyeball motion angle and the real-time position;
extracting at least one frame of image corresponding to the real-time position of the vehicle exterior video and judging whether the at least one frame of image contains the appearance characteristics of the building;
if the at least one frame of image contains the appearance characteristics of the building and the continuous set duration of the coordinate range is consistent, determining the property in the coordinate range as a target property on the road side;
and acquiring the property information of the target property, wherein the property information comprises property source data and an image of the target property extracted from the vehicle exterior video.
The house source data comprise house names, house source quantity and prices.
Wherein, the vehicle will the property information shows for the user, include:
the vehicle displays the received property information through the head-up display and/or plays the received property information through the voice device;
and when the property information contains the property position, marking the target property at the corresponding position on the electronic map.
Wherein the method further comprises:
when the vehicle receives the property information, the property information and the corresponding vehicle exterior video are stored, and the property information and the corresponding vehicle exterior video are displayed when an instruction for checking the property information is received.
Wherein the method further comprises:
and when receiving a mobile terminal viewing instruction, the vehicle sends an information acquisition request to the server, so that the server sends the property information to a corresponding mobile terminal for display.
The application also provides a vehicle, which comprises a video acquisition device, an eyeball tracking device, a voice receiving device and a processing module;
the video acquisition device is used for acquiring the video outside the vehicle;
the eyeball tracking device is used for collecting eyeball tracking information;
the voice receiving device is used for receiving a voice instruction;
the processing module is respectively connected with the video acquisition device, the eyeball tracking device and the voice receiving device, and is used for loading and executing at least one program instruction to realize the following method:
when a vehicle receives a voice instruction for introducing a property, sending vehicle-external video and eyeball tracking information which are collected in real time to a server through a 5G vehicle networking network, so that the server acquires the real-time position of the vehicle when receiving the vehicle-external video and eyeball tracking information, confirms a target property on the road side according to the real-time position, the eyeball tracking information and the vehicle-external video, acquires the property information of the target property, and sends the acquired property information to the vehicle through the 5G vehicle networking network; and the number of the first and second groups,
and when the property information is received, displaying the property information to a user.
The present application also provides a server for loading and executing at least one program instruction to implement the method of:
the method comprises the steps that when a server receives real-time acquired vehicle exterior video and eyeball tracking information sent by a vehicle according to a voice instruction introducing a real estate through a 5G vehicle networking network, the real-time position of the vehicle is obtained;
confirming a target property at the road side according to the real-time position, the eyeball tracking information and the vehicle exterior video and acquiring property information of the target property;
and sending the acquired property information to the vehicle through a 5G Internet of vehicles network so that the vehicle can show the property information to a user.
The application also provides a real estate introduction system, which comprises the vehicle and the server.
According to the house property introduction method, the system, the server and the vehicle, when the vehicle receives a voice instruction for introducing the house property, the vehicle-mounted videos and the eyeball tracking information which are collected in real time are sent to the server through the 5G internet of vehicles, when the vehicle-mounted videos and the eyeball tracking information are received by the server, the real-time position of the vehicle is obtained, the target house property of the road side is determined according to the real-time position, the eyeball tracking information and the vehicle-mounted videos, the house property information of the target house property is obtained, the obtained house property information is sent to the vehicle through the 5G internet of vehicles, and therefore the house property information is displayed to a user by the vehicle. Through the mode, the user intention can be timely acquired according to the eyeball tracking information when the instruction is received, meanwhile, the high-speed and high-efficiency Internet of vehicles is constructed by utilizing the 5G technical network, the external videos and the vehicle positions of the vehicles can be processed by the server at the same time, and therefore the house property introduction service is safely, timely and conveniently provided, and the seen and obtained travel experience is realized.
The foregoing description is only an overview of the technical solutions of the present application, and in order to make the technical means of the present application more clearly understood, the present application may be implemented in accordance with the content of the description, and in order to make the above and other objects, features, and advantages of the present application more clearly understood, the following preferred embodiments are described in detail with reference to the accompanying drawings.
Drawings
Fig. 1 is a flow chart illustrating a property introduction method according to an exemplary embodiment.
FIG. 2 is a block diagram of a vehicle shown in accordance with an exemplary embodiment.
Detailed Description
To further illustrate the technical means and effects of the present application for achieving the intended application, the following detailed description is provided with reference to the accompanying drawings and preferred embodiments of the present application for describing the method, system, server and vehicle, and the detailed description thereof.
The foregoing and other technical matters, features and effects of the present application will be apparent from the following detailed description of preferred embodiments, which is to be read in connection with the accompanying drawings. While the present application is susceptible to embodiment and specific details, specific reference will now be made in detail to the present disclosure for the purpose of illustrating the general principles of the invention.
Fig. 1 is a flow chart illustrating a property introduction method according to an exemplary embodiment. Referring to fig. 1, the method for introducing a property of the present embodiment includes, but is not limited to, the following steps:
and step 110, when the vehicle receives a voice instruction for introducing a house property, sending the vehicle exterior video and the eyeball tracking information which are collected in real time to a server through a 5G vehicle networking network.
Wherein, when a user drives a car to pass through a road section which is extremely favorite in landscape, environment and the like, the user may be interested in information of nearby real estate, such as a district name, a house price, a house source number and the like, at the same time, the user can speak "how the house price is at this place" to the voice receiving device while observing the favorite real estate (district or villa building) or observe the favorite real estate (district or villa building) after speaking "how the house price is at this place" to the voice receiving device, the processing module of the vehicle identifies the received voice information so as to trigger a voice instruction for introducing the real estate, when the voice instruction for introducing the real estate is triggered, the vehicle acquires a landscape video at the road side as an outside video through a video acquisition device, such as a vehicle-mounted camera, the outside video contains an image of the real estate which the user is interested, and the vehicle tracks eyeball movement of the user through an eyeball tracking device so as to acquire eyeball tracking information of the user, the user's viewing direction can be known by analyzing the eyeball tracking information, the eyeball tracking device is, for example, an image acquisition device such as a camera, and the like, and the eyeball tracking device tracks by acquiring the change of characteristics of the eyeball and the eyeball periphery or according to the change of the iris angle, and the eyeball tracking device is, for example, an infrared device, and extracts the characteristics by actively projecting light beams such as infrared rays and the like to the iris. Of course, the collection of the video and the eyeball tracking information outside the vehicle can be carried out all the time without receiving the voice instruction for introducing the real estate. Then, the vehicle sends the vehicle-mounted video and eyeball tracking information collected in real time to the server through the 5G vehicle networking network, and due to the fact that the 5G network has the characteristics of being low in time delay, high in reliability, efficient in frequency spectrum utilization and the like, the vehicle-mounted video and eyeball tracking information received by the server can accurately correspond to the real-time position of the vehicle, and the analysis result is more accurate.
Step 120, when the server receives the vehicle exterior video and the eyeball tracking information, the server acquires the real-time position of the vehicle, determines the target property of the road side according to the real-time position, the eyeball tracking information and the vehicle exterior video, acquires the property information of the target property, and sends the acquired property information to the vehicle through the 5G vehicle networking network, so that the vehicle displays the property information to the user.
The server acquires the real-time position of the vehicle when receiving the external video and the eyeball tracking information, and the 5G network has the characteristics of low time delay, high reliability, efficient spectrum utilization and the like, so that the external video and the eyeball tracking information received by the server can accurately correspond to the real-time position of the vehicle, namely, the external video and the eyeball tracking information acquired by the server, namely the external video and the eyeball tracking information corresponding to each real-time position of the vehicle, and the data error is small.
In one embodiment, determining a target property on the road side according to the real-time position, the eyeball tracking information and the vehicle exterior video and acquiring property information of the target property comprises:
the server acquires the eyeball motion angle of the user according to the eyeball tracking information;
determining the coordinate range of the road side according to the eyeball motion angle and the real-time position;
if the continuous set duration of the coordinate range is consistent, determining the property in the coordinate range as a target property on the road side;
and acquiring the property information of the target property, wherein the property information comprises the property source data and the image of the target property extracted from the vehicle exterior video.
In this embodiment, the eyeball movement angle refers to an included angle between a line of sight of the user and a central axis of the vehicle, so that a viewing direction of the user can be determined according to the eyeball movement angle, for example, the viewing direction of the user is 10 °, 20 °, 30 ° on the left side of the vehicle, and the like. After the eyeball movement angle is determined, the sight line of a user is intersected with the road side according to the eyeball movement angle and the real-time position of a vehicle, a map coordinate to be converted is determined and converted, then the coordinate range of the road side is determined according to a preset range determination rule, the coordinate range of the road side can be adjusted according to the size of the eyeball movement angle, when the eyeball movement angle is large, the house watched by the user is close to the vehicle distance, a small coordinate range can be obtained, when the eyeball movement angle is small, the house watched by the user is far away from the vehicle distance, and a large coordinate range can be obtained to improve the accuracy of analysis.
When a user watches interested properties, the stay time of the sight line of the user is relatively long, and the change of the corresponding determined coordinate range is relatively small, so that if the calculated coordinate range is kept consistent for a set duration, for example, 2S is kept basically unchanged, the properties in the coordinate range are determined as target properties on the road side, and the number of the target properties can be one, two or more. Then, the server acquires the property information of the target property, the property information comprises property source data and an image of the target property extracted from the vehicle exterior video, the property source data is acquired by data docking with a property transaction third-party system, in one embodiment, the property source data comprises a property name, a property quantity and a price, and further comprises a property address, and the image of the target property extracted from the vehicle exterior video can be used for a user to judge whether the acquired property source data is the property source data of the interesting property. After the server acquires the property information, the acquired property information is sent to the vehicle through the 5G Internet of vehicles, so that the information delay is reduced.
In one embodiment, determining a target property on the road side according to the real-time position, the eyeball tracking information and the vehicle exterior video and acquiring property information of the target property comprises:
the server acquires the eyeball movement angle of the user according to the tracking information;
determining the coordinate range of the road side according to the eyeball motion angle and the real-time position;
extracting at least one frame of image corresponding to the real-time position of the vehicle exterior video and judging whether the at least one frame of image contains the appearance characteristics of the building;
if at least one frame of image contains the appearance characteristics of the building and the continuous set duration of the coordinate range is consistent, determining the property in the coordinate range as a target property on the road side;
and acquiring the property information of the target property, wherein the property information comprises the property source data and the image of the target property extracted from the vehicle exterior video.
In this embodiment, the eyeball movement angle refers to an included angle between a line of sight of the user and a central axis of the vehicle, so that a viewing direction of the user can be determined according to the eyeball movement angle, for example, the viewing direction of the user is 10 °, 20 °, 30 ° on the left side of the vehicle, and the like. After the eyeball movement angle is determined, the sight line of a user is intersected with the road side according to the eyeball movement angle and the real-time position of a vehicle, a map coordinate to be converted is determined and converted, then the coordinate range of the road side is determined according to a preset range determination rule, the coordinate range of the road side can be adjusted according to the size of the eyeball movement angle, when the eyeball movement angle is large, the house watched by the user is close to the vehicle distance, a small coordinate range can be obtained, when the eyeball movement angle is small, the house watched by the user is far away from the vehicle distance, and a large coordinate range can be obtained to improve the accuracy of analysis.
When a user watches interested property, the time of the sight line staying is relatively long, the corresponding determined coordinate range is relatively small in change, and in addition, when the property building exists in the watching direction of the user, at least one frame of image which is extracted from the vehicle exterior video and corresponds to the real-time position contains the appearance feature of the building. Therefore, if at least one frame of image includes the appearance feature of the building and the calculated coordinate range is kept consistent for the set duration, for example, for 2S, the property in the coordinate range is confirmed as the target property on the road side. Then, the server acquires the property information of the target property, the property information comprises property source data and an image of the target property extracted from the vehicle exterior video, the property source data is acquired by data docking with a property transaction third-party system, in one embodiment, the property source data comprises a property name, a property quantity and a price, and further comprises a property address, and the image of the target property extracted from the vehicle exterior video can be used for a user to judge whether the acquired property source data is the property source data of the interesting property. After the server acquires the property information, the acquired property information is sent to the vehicle through the 5G Internet of vehicles, so that the information delay is reduced.
In one embodiment, the process of the vehicle presenting the property information to the user may specifically include the steps of:
the vehicle displays the received property information through the head-up display and/or plays the received property information through the voice device;
and when the property information contains the property position, marking the target property at the corresponding position on the electronic map.
When the vehicle receives the property information through the 5G internet of vehicles, the received property information, such as the property name, the house source quantity, the price and the image, can be displayed through a Head Up Display (HUD), the received property information, such as the property name, the house source quantity and the price, can be played through a voice device, and in addition, the vehicle can also output the property information through the Head up display and the voice device, so that a user can conveniently and safely know the property information of an interested target property in the driving process. Furthermore, when the property information includes the property position or address, the vehicle can mark the target property at the corresponding position on the electronic map, so that the user can know the surrounding environment of the position of the property. Due to the application of the 5G technology and the eyeball tracking technology, the house property information is acquired more timely, safely and conveniently, and the user experience is good.
In one embodiment, the property introduction method of the present application further includes:
when the vehicle receives the property information, the property information and the corresponding vehicle-outside video are stored, and the property information and the corresponding vehicle-outside video are displayed when an instruction for checking the property information is received.
Wherein, the vehicle is when receiving the voice command of introducing the property, gather the outer video of car in real time and save, when receiving the property information, save the outer video of the car of property information and correspondence in order to collect, so, when receiving the instruction of looking over the property information, can show the outer video of property information and correspondence according to the instruction for the user can look over the property information when free, avoids driving the problem that the in-process information is known incompletely.
In one embodiment, the property introduction method of the present application further includes:
when the vehicle receives a mobile terminal checking instruction, an information acquisition request is sent to the server, so that the server sends the property information to the corresponding mobile terminal for display.
After the vehicle receives the property information, if a user wants to check the property information through a mobile terminal such as a mobile phone, related operations can be performed on the vehicle-mounted terminal, a mobile terminal checking instruction is triggered to send an information acquisition request to the server, and the server sends the property information to the corresponding mobile terminal to display after receiving the information acquisition request.
According to the house property introduction method, when a vehicle receives a voice instruction for introducing house properties, the vehicle sends real-time collected vehicle-exterior videos and eyeball tracking information to a server through a 5G vehicle networking network, the server obtains the real-time position of the vehicle when receiving the vehicle-exterior videos and the eyeball tracking information, determines the target house properties of the road side according to the real-time position, the eyeball tracking information and the vehicle-exterior videos and obtains the house property information of the target house properties, and sends the obtained house property information to the vehicle through the 5G vehicle networking network, so that the vehicle displays the house property information to a user. According to the method and the system, the user intention can be timely acquired according to the eyeball tracking information when an instruction is received, meanwhile, the 5G technical network is utilized to construct a high-speed and high-efficiency Internet of vehicles network, the server can simultaneously process the videos and the vehicle positions outside the vehicle, so that the house property introduction service is conveniently and timely provided, and the seen and obtained travel experience is realized.
FIG. 2 is a block diagram of a vehicle shown in accordance with an exemplary embodiment. As shown in fig. 2, the vehicle of the present embodiment includes a video capture device 210, an eye tracker 220, a voice receiver 230, and a processing module 240.
And the video acquisition device 210 is used for acquiring the video outside the vehicle.
And the eyeball tracking device 220 is used for collecting eyeball tracking information.
And the voice receiving device 230 is used for receiving the voice instruction.
The processing module 240 is respectively connected to the video capturing device 210, the eye tracking device 220, and the voice receiving device 230, and is configured to load and execute at least one program instruction to implement the following method:
when the vehicle receives a voice instruction for introducing a property, the vehicle-mounted video and eyeball tracking information which are collected in real time are sent to the server through the 5G vehicle networking network, so that the server acquires the real-time position of the vehicle when receiving the vehicle-mounted video and eyeball tracking information, confirms a target property on the road side according to the real-time position, the eyeball tracking information and the vehicle-mounted video, acquires the property information of the target property, and sends the acquired property information to the vehicle through the 5G vehicle networking network; and the number of the first and second groups,
and when the property information is received, displaying the property information to the user.
For the specific working process and steps of the vehicle of this embodiment, please refer to the description of the embodiment shown in fig. 1, which is not repeated herein.
The present application further provides a server for loading and executing at least one program instruction to implement the following method:
the method comprises the steps that when a server receives real-time acquired vehicle exterior video and eyeball tracking information sent by a vehicle according to a voice instruction for introducing a real estate through a 5G vehicle networking network, the real-time position of the vehicle is obtained;
confirming a target property at the road side according to the real-time position, the eyeball tracking information and the vehicle exterior video and acquiring property information of the target property;
and sending the acquired property information to the vehicle through the 5G Internet of vehicles network so that the vehicle can show the property information to the user.
For the specific working process and steps of the server of this embodiment, please refer to the description of the embodiment shown in fig. 1 and fig. 2, which is not described herein again.
The application also provides a real estate introduction system, which comprises the vehicle and the server.
For the specific working processes and steps of the vehicle and the server in the property introduction system of this embodiment, please refer to the description of the embodiment shown in fig. 1 and fig. 2, which is not repeated herein.
The utility model provides a house property introduction system, vehicle and server, the vehicle is when receiving the voice command who introduces the house property, send the outer video of real-time collection and eyeball tracking information for the server through 5G car networking network, the server is when receiving outer video of car and eyeball tracking information, acquire the real-time position of vehicle, according to real-time position, eyeball tracking information, the outer video of car confirms the target house property of road side and acquires the house property information of target house property, and, send the house property information that acquires for the vehicle through 5G car networking network, so that the vehicle shows house property information for the user. Through the mode, the user intention can be timely acquired according to the eyeball tracking information when the instruction is received, meanwhile, the high-speed and high-efficiency Internet of vehicles is constructed by utilizing the 5G technical network, the external videos and the vehicle positions of the vehicles can be simultaneously processed by the server, so that the house property introduction service is conveniently and timely provided, and the seen and obtained travel experience is realized.
Although the present application has been described with reference to a preferred embodiment, it should be understood that various changes, substitutions and alterations can be made herein without departing from the spirit and scope of the application, and all changes, substitutions and alterations that fall within the spirit and scope of the application are to be understood as being included within the following description of the preferred embodiment.

Claims (10)

1. A method for introducing a property, comprising:
when the vehicle receives a voice instruction for introducing a house property, the vehicle sends the vehicle exterior video and eyeball tracking information which are collected in real time to a server through a 5G vehicle networking network;
the server acquires the real-time position of the vehicle when receiving the external video and the eyeball tracking information, determines the target property of the road side according to the real-time position, the eyeball tracking information and the external video, acquires the property information of the target property, and sends the acquired property information to the vehicle through a 5G internet of vehicles network, so that the vehicle displays the property information to a user.
2. The property introduction method according to claim 1, wherein the determining a target property on a road side and acquiring property information of the target property according to the real-time position, the eyeball tracking information, and the off-vehicle video comprises:
the server acquires the eyeball motion angle of the user according to the eyeball tracking information;
determining a coordinate range of the road side according to the eyeball motion angle and the real-time position;
if the continuous set duration of the coordinate range is consistent, determining the property in the coordinate range as a target property on the road side;
and acquiring the property information of the target property, wherein the property information comprises property source data and an image of the target property extracted from the vehicle exterior video.
3. The property introduction method according to claim 1, wherein the determining a target property on a road side and acquiring property information of the target property according to the real-time position, the eyeball tracking information, and the off-vehicle video comprises:
the server acquires the eyeball movement angle of the user according to the tracking information;
determining a coordinate range of the road side according to the eyeball motion angle and the real-time position;
extracting at least one frame of image corresponding to the real-time position of the vehicle exterior video and judging whether the at least one frame of image contains the appearance characteristics of the building;
if the at least one frame of image contains the appearance characteristics of the building and the continuous set duration of the coordinate range is consistent, determining the property in the coordinate range as a target property on the road side;
and acquiring the property information of the target property, wherein the property information comprises property source data and an image of the target property extracted from the vehicle exterior video.
4. The property introduction method according to claim 2 or 3, wherein the property source data includes a property name, a quantity of property sources, and a price.
5. The property introduction method according to claim 1 or 2, wherein the vehicle presents the property information to a user, comprising:
the vehicle displays the received property information through the head-up display and/or plays the received property information through the voice device;
and when the property information contains the property position, marking the target property at the corresponding position on the electronic map.
6. The property introduction method as claimed in claim 1 or 2, further comprising:
when the vehicle receives the property information, the property information and the corresponding vehicle exterior video are stored, and the property information and the corresponding vehicle exterior video are displayed when an instruction for checking the property information is received.
7. The property introduction method as claimed in claim 1 or 2, further comprising:
and when receiving a mobile terminal viewing instruction, the vehicle sends an information acquisition request to the server, so that the server sends the property information to a corresponding mobile terminal for display.
8. A vehicle is characterized by comprising a video acquisition device, an eyeball tracking device, a voice receiving device and a processing module;
the video acquisition device is used for acquiring the video outside the vehicle;
the eyeball tracking device is used for collecting eyeball tracking information;
the voice receiving device is used for receiving a voice instruction;
the processing module is respectively connected with the video acquisition device, the eyeball tracking device and the voice receiving device, and is used for loading and executing at least one program instruction to realize the following method:
when a vehicle receives a voice instruction for introducing a property, sending vehicle-external video and eyeball tracking information which are collected in real time to a server through a 5G vehicle networking network, so that the server acquires the real-time position of the vehicle when receiving the vehicle-external video and eyeball tracking information, confirms a target property on the road side according to the real-time position, the eyeball tracking information and the vehicle-external video, acquires the property information of the target property, and sends the acquired property information to the vehicle through the 5G vehicle networking network; and the number of the first and second groups,
and when the property information is received, displaying the property information to a user.
9. A server, wherein the server is configured to load and execute at least one program instruction to implement the method of:
the method comprises the steps that when a server receives real-time acquired vehicle exterior video and eyeball tracking information sent by a vehicle according to a voice instruction introducing a real estate through a 5G vehicle networking network, the real-time position of the vehicle is obtained;
confirming a target property at the road side according to the real-time position, the eyeball tracking information and the vehicle exterior video and acquiring property information of the target property;
and sending the acquired property information to the vehicle through a 5G Internet of vehicles network so that the vehicle can show the property information to a user.
10. A property introduction system comprising the vehicle according to claim 8 and the server according to claim 9.
CN201810956116.0A 2018-08-21 2018-08-21 House property introduction method, system, server and vehicle Active CN110868687B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810956116.0A CN110868687B (en) 2018-08-21 2018-08-21 House property introduction method, system, server and vehicle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810956116.0A CN110868687B (en) 2018-08-21 2018-08-21 House property introduction method, system, server and vehicle

Publications (2)

Publication Number Publication Date
CN110868687A true CN110868687A (en) 2020-03-06
CN110868687B CN110868687B (en) 2023-05-26

Family

ID=69650899

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810956116.0A Active CN110868687B (en) 2018-08-21 2018-08-21 House property introduction method, system, server and vehicle

Country Status (1)

Country Link
CN (1) CN110868687B (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030023372A1 (en) * 2001-07-24 2003-01-30 Hwa-Soo Chon Road instruction information system for vehicles
US20060075442A1 (en) * 2004-08-31 2006-04-06 Real Data Center, Inc. Apparatus and method for producing video drive-by data corresponding to a geographic location
CN102111711A (en) * 2010-12-31 2011-06-29 上海杰图房网信息科技有限公司 System and method for exhibiting real estate panorama based on local position information
CN102393939A (en) * 2011-07-13 2012-03-28 上海杰图看房网络有限公司 Method and system for house property panoramic exhibition by portable terminal
US20120169582A1 (en) * 2011-01-05 2012-07-05 Visteon Global Technologies System ready switch for eye tracking human machine interaction control system
US20160173865A1 (en) * 2014-12-11 2016-06-16 Hyundai Motor Company Wearable glasses, control method thereof, and vehicle control system
CN106651175A (en) * 2016-12-21 2017-05-10 驭势科技(北京)有限公司 Unmanned vehicle operation management system, general control platform, branch control platform, vehicle-mounted computation device and computer readable storage medium
CN107054225A (en) * 2017-03-10 2017-08-18 戴姆勒股份公司 Display system for vehicle and vehicle
CN107770036A (en) * 2016-08-16 2018-03-06 北京嘀嘀无限科技发展有限公司 Information of real estate retrieval, data receiver are with sending processing method, server and device

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030023372A1 (en) * 2001-07-24 2003-01-30 Hwa-Soo Chon Road instruction information system for vehicles
US20060075442A1 (en) * 2004-08-31 2006-04-06 Real Data Center, Inc. Apparatus and method for producing video drive-by data corresponding to a geographic location
CN102111711A (en) * 2010-12-31 2011-06-29 上海杰图房网信息科技有限公司 System and method for exhibiting real estate panorama based on local position information
US20120169582A1 (en) * 2011-01-05 2012-07-05 Visteon Global Technologies System ready switch for eye tracking human machine interaction control system
CN102393939A (en) * 2011-07-13 2012-03-28 上海杰图看房网络有限公司 Method and system for house property panoramic exhibition by portable terminal
US20160173865A1 (en) * 2014-12-11 2016-06-16 Hyundai Motor Company Wearable glasses, control method thereof, and vehicle control system
CN107770036A (en) * 2016-08-16 2018-03-06 北京嘀嘀无限科技发展有限公司 Information of real estate retrieval, data receiver are with sending processing method, server and device
CN106651175A (en) * 2016-12-21 2017-05-10 驭势科技(北京)有限公司 Unmanned vehicle operation management system, general control platform, branch control platform, vehicle-mounted computation device and computer readable storage medium
CN107054225A (en) * 2017-03-10 2017-08-18 戴姆勒股份公司 Display system for vehicle and vehicle

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
AMER AL-RAHAYFEH; MIAD FAEZIPOUR: "Enhanced frame rate for real-time eye tracking using circular hough transform", 2013 IEEE LONG ISLAND SYSTEMS, APPLICATIONS AND TECHNOLOGY CONFERENCE (LISAT) *
刘志强; 宋雪松; 汪彭; 周桂良: "基于眼部特征的疲劳驾驶辨识方法研究", 《重庆理工大学学报(自然科学)》 *
王华容: "道路交通研究中眼动技术的应用与展望", 《交通医学》 *

Also Published As

Publication number Publication date
CN110868687B (en) 2023-05-26

Similar Documents

Publication Publication Date Title
CN110856107A (en) Intelligent tour guide method, system, server and vehicle
CN105182535A (en) Method of using intelligent glasses for vehicle maintenance
CN112132113A (en) Vehicle re-identification method and device, training method and electronic equipment
JP2022548441A (en) POSITION AND ATTITUDE DETERMINATION METHOD, APPARATUS, ELECTRONIC DEVICE, STORAGE MEDIUM AND COMPUTER PROGRAM
CN104054039A (en) Augmented Reality With Sound And Geometric Analysis
CN110956483A (en) Advertisement information pushing method, system, server and vehicle
US20210394636A1 (en) Systems and methods for identifying characteristics of electric vehicles
CN102980586A (en) Navigation terminal and navigation method using the same
CN114661026A (en) Interactive vehicle remote diagnosis method and system based on augmented reality and storage medium thereof
CN114815779B (en) Automobile remote interactive diagnosis method, system and storage medium based on AR and VR
US20100114861A1 (en) System and method for information acquisition
CN113237490A (en) AR navigation method, system, electronic device and storage medium
CN111311942A (en) Road condition display method and system based on V2X technology, V2X terminal and V2X server
CN102789719A (en) Diver sight line recognition instrument in road driving skill test process and realizing method thereof
CN205232353U (en) Interactive intelligent terminal system
CN108881846B (en) Information fusion method and device and computer readable storage medium
CN101620788A (en) Mobile AV and image recognition intellectualized system
CN108366233B (en) Network camera connecting method, device, equipment and storage medium
KR20220023742A (en) Method of providing and acquiring data related of vehicle accident
CN110868687A (en) House property introduction method, system, server and vehicle
CN111860416A (en) Unmanned aerial vehicle image monitoring control device and control method thereof
CN110855733B (en) Vehicle introduction method, system, server and vehicle
CN115407355B (en) Library position map verification method and device and terminal equipment
CN113010544B (en) AR augmented reality-based charging auditing method and system
CN112118418B (en) Car searching method, car and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant