Disclosure of Invention
The application aims to provide a vehicle, a vehicle device and a vehicle along-the-road object detailed information display method thereof, which can identify along-the-road objects, and can automatically generate detailed information such as animation, introduction and picture display when the along-the-road objects are adjacent to certain distance areas, so that users can know the detailed information conveniently, and the user interaction experience is enhanced.
In order to solve the above technical problem, the present application provides a method for displaying detailed information on a vehicle along-road object, which includes, as one embodiment:
the vehicle-mounted equipment judges whether a target along-the-way object of a preset type is acquired or not;
if a target along-road object of a preset type is obtained, judging whether the target along-road object enters a specified distance area or not;
if the vehicle equipment enters the appointed distance area, identifying the characteristic information of the target along-the-way object by the vehicle equipment;
acquiring detailed information of the target along-the-way object from a database and/or a network according to the characteristic information;
and displaying the detailed information to a user in a preset mode, wherein the preset mode comprises a vehicle-mounted liquid crystal instrument panel, a head-up liquid crystal screen in the vehicle and/or a windshield.
As an embodiment, after the step of displaying the detailed information to the user in a predetermined manner, the method further includes:
the vehicle-mounted equipment judges whether a new to-be-identified along-the-way object is acquired;
if a new to-be-identified along-road object is obtained, identifying the characteristic information of the to-be-identified along-road object and obtaining corresponding detailed information; and displaying a plurality of detailed information corresponding to the plurality of along-the-way objects to the user in an automatic cycle and/or click pop-up mode.
As one embodiment, the in-vehicle device identifies characteristic information of the shape, contour, color and/or pattern of the target along-the-way object through a camera;
and/or the vehicle-mounted equipment acquires the characteristic information of the shape, the contour and/or the texture of the target along-the-way object in a pressure sensing mode.
As an embodiment, the step of obtaining detailed information of the target along-road object from a self database and/or a network according to the characteristic information specifically includes:
the vehicle-mounted equipment searches detailed information corresponding to the target along-the-way object from a pre-stored local database;
and/or the vehicle-mounted equipment sends the characteristic information to a cloud server for processing, and obtains detailed information which is returned by the cloud server and is associated with the characteristic information.
As one implementation manner, the in-vehicle device obtains first characteristic information of a side of the target along-road object adjacent to the vehicle, second characteristic information of a back side far away from the vehicle, and/or third characteristic information of a plurality of side surfaces between the contact surface and the back side to construct and obtain three-dimensional characteristic information of the target along-road object.
In one embodiment, the specified distance area is one kilometer, two kilometers, three kilometers or five kilometers.
In one embodiment, the detailed information is displayed to the user by browsing through videos, pictures, websites, game interfaces and/or floating windows.
As one embodiment, when the detailed information is displayed to the user by means of the floating window, the color and transparency of the floating window can be manually set, and the display position of the floating window can be adjusted.
In order to solve the technical problem, the present application further provides a vehicle-mounted device, as one implementation manner, the vehicle-mounted device includes a memory and a processor, the memory stores a computer program, and the processor is configured to execute the computer program to implement the steps of the method for displaying detailed information of the vehicle along-road object as described above.
In order to solve the technical problem, the present application further provides a vehicle, as one embodiment, the vehicle is configured with the in-vehicle device as described above.
The vehicle equipment judges whether a target along-the-way object of a preset type is obtained or not, if the target along-the-way object of the preset type is obtained, whether the target along-the-way object enters an appointed distance area or not is judged, if the target along-the-way object enters the appointed distance area, the vehicle equipment identifies characteristic information of the target along-the-way object, and according to the characteristic information, detailed information of the target along-the-way object is obtained from a database and/or a network of the vehicle equipment, and is displayed to a user in a preset mode, wherein the preset mode comprises a vehicle-mounted liquid crystal instrument panel, a head-up liquid crystal screen and/or windshield glass in the vehicle. According to the method and the device, the along-road objects can be identified, and when the along-road objects are adjacent to certain distance areas, detailed information such as animation, introduction and picture display can be automatically generated, so that a user can conveniently know the along-road objects, and the user interaction experience is enhanced.
The foregoing description is only an overview of the technical solutions of the present application, and in order to make the technical means of the present application more clearly understood, the present application may be implemented in accordance with the content of the description, and in order to make the above and other objects, features, and advantages of the present application more clearly understood, the following preferred embodiments are described in detail with reference to the accompanying drawings.
Detailed Description
To further illustrate the technical means and effects of the present application for achieving the intended application purpose, the following detailed description is provided with reference to the accompanying drawings and preferred embodiments for describing specific embodiments, methods, steps, features and effects of the vehicle, the in-vehicle equipment and the vehicle along-road object detailed information display method according to the present application.
The foregoing and other technical matters, features and effects of the present application will be apparent from the following detailed description of preferred embodiments, which is to be read in connection with the accompanying drawings. While the present application has been described in terms of specific embodiments and examples for achieving the desired objects and objectives, it is to be understood that the invention is not limited to the disclosed embodiments, but is to be accorded the widest scope consistent with the principles and novel features as defined by the appended claims.
Referring to fig. 1, fig. 1 is a schematic flow chart illustrating an embodiment of a method for displaying detailed information of a vehicle along a route according to the present application.
The detailed information display method for the vehicle along-road object according to the present embodiment may include, but is not limited to, the following steps.
Step S101, the vehicle-mounted equipment judges whether a target along-the-way object of a preset type is acquired or not;
step S102, if a target along-road object of a preset type is obtained, whether the target along-road object enters a specified distance area is judged; if not, no treatment is carried out;
step S103, if the vehicle equipment enters a specified distance area, identifying characteristic information of the target along-the-way object by the vehicle equipment;
step S104, acquiring detailed information of the target along-the-way object from a self database and/or a network according to the characteristic information;
and S105, displaying the detailed information to a user in a preset mode, wherein the preset mode comprises a vehicle-mounted liquid crystal instrument panel, a head-up liquid crystal screen in the vehicle and/or windshield glass.
The predetermined manner described in this embodiment may specifically refer to displaying on a vehicle-mounted liquid crystal instrument panel, a head-up liquid crystal screen in a vehicle, and/or a windshield by means of a plurality of aggregated cards, folded pages, a scrolling broadcast, and the like of aggregated contents.
In the present embodiment, the predetermined type of target along-road object may refer to a road, a building, a landscape, a human, activity information thereof, and the like outside the vehicle.
It should be noted that, after the step of displaying the detailed information to the user in a predetermined manner in this embodiment, the following process may be further included:
in the process 201, the in-vehicle device determines whether a new to-be-identified along-the-way object is acquired;
the process 202, if a new to-be-identified waypoint object is obtained, identifying the characteristic information of the to-be-identified waypoint object and obtaining corresponding detailed information; and displaying a plurality of detailed information corresponding to the plurality of along-the-way objects to the user in an automatic cycle and/or click pop-up mode.
It should be noted that, in the car-in-vehicle equipment according to this embodiment, the camera recognizes the characteristic information of the shape, the contour, the color and/or the pattern of the target along-the-way object.
It should be noted that, in this embodiment, the processing may be performed in the in-vehicle device itself, or may be performed remotely through a 3G communication network, a 4G communication network, a 5G communication network, a WIFI network, and the like, and specifically, the step of obtaining the detailed information of the target along-the-way object from the database and/or the network according to the feature information in this embodiment may specifically include:
in a first mode, the vehicle-mounted equipment searches detailed information corresponding to the target along-the-way object from a pre-stored local database;
and/or in a second mode, the vehicle-mounted equipment sends the characteristic information to a cloud server for processing, and obtains detailed information which is returned by the cloud server and is associated with the characteristic information.
It is easily understood that the present embodiment may perform feature information acquisition on any side of the target along-road object and generate detailed information corresponding to different features, and specifically, the in-vehicle device of the present embodiment acquires first feature information of a side of the target along-road object adjacent to the vehicle, second feature information of a back side of the side far away from the vehicle, and/or third feature information of a plurality of side surfaces between the contact surface and the back side to construct three-dimensional feature information of the target along-road object.
In this embodiment, the specified distance area is one kilometer, two kilometers, three kilometers, or five kilometers. Further, the vehicle-mounted camera may be an AI artificial intelligence camera.
Specifically, the detailed information in this embodiment is displayed to the user by browsing videos, pictures, websites, game interfaces, and/or floating windows.
It should be noted that, in the present embodiment, when the detailed information is displayed to the user in the floating window manner, the color and the transparency of the floating window may be manually set, and the display position of the floating window may be adjusted.
According to the method and the device, the along-road objects can be identified, and when the along-road objects are adjacent to certain distance areas, detailed information such as animation, introduction and picture display can be automatically generated, so that a user can conveniently know the along-road objects, and the user interaction experience is enhanced.
Referring to fig. 2, the present application further provides a vehicle-mounted device, as an embodiment, the vehicle-mounted device includes a memory 20 and a processor 21, the memory 20 stores a computer program, and the processor 21 is configured to execute the computer program to implement the steps of the method for displaying detailed information of the vehicle along-road object as described above.
Specifically, the processor 21 is configured to determine whether a predetermined type of target along-road object is acquired;
if a target along-road object of a predetermined type is acquired, the processor 21 is configured to determine whether the target along-road object enters a specified distance area; if not, no treatment is carried out;
if the target road object enters the designated distance area, the processor 21 is used for identifying the characteristic information of the target road object;
the processor 21 is configured to obtain detailed information of the target along-road object from a database and/or a network thereof according to the characteristic information;
the processor 21 is configured to display the detailed information to a user in a predetermined manner, where the predetermined manner includes an on-vehicle liquid crystal dashboard, an in-vehicle head-up liquid crystal display, and/or a windshield.
In the present embodiment, the predetermined type of target along-road object may refer to a road, a building, a landscape, a human, activity information thereof, and the like outside the vehicle.
It should be noted that, in this embodiment, the processor 21 is configured to determine whether a new to-be-identified waypoint object is acquired, and if a new to-be-identified waypoint object is acquired, identify feature information of the to-be-identified waypoint object and acquire corresponding detailed information; and displaying a plurality of detailed information corresponding to the plurality of along-the-way objects to the user in an automatic cycle and/or click pop-up mode.
It is easy to understand that, the embodiment can also perform changes such as gradual change, abrupt change, texture switching, color switching, shape switching, volume change and position when displaying, so as to enrich the experience.
It should be noted that, in the car-in-vehicle equipment according to this embodiment, the camera recognizes the characteristic information of the shape, the contour, the color and/or the pattern of the target along-the-way object.
It should be noted that the camera of the present embodiment may be an AI artificial intelligence camera.
It should be noted that, in this embodiment, the processing may be performed in the in-vehicle device itself, or may be performed remotely through a 3G communication network, a 4G communication network, a 5G communication network, a WIFI network, and the like, specifically, the processor 21 in this embodiment obtains detailed information of the target along-the-way object from its database and/or network according to the feature information, and specifically, the following several ways may be included:
in a first mode, the processor 21 searches detailed information corresponding to the target along-route object from a pre-stored local database;
and/or in a second mode, the vehicle-mounted equipment sends the characteristic information to a cloud server for processing, and obtains detailed information which is returned by the cloud server and is associated with the characteristic information.
It is easily understood that the present embodiment may perform feature information acquisition on any side of the target along-road object and generate detailed information corresponding to different features, and specifically, the processor 21 of the present embodiment is configured to acquire first feature information of a side of the target along-road object adjacent to the vehicle, second feature information of a back side far away from the side of the vehicle, and/or third feature information of a plurality of side surfaces located between the contact surface and the back side to construct feature information for obtaining a three-dimensional feature of the target along-road object.
Specifically, the detailed information in this embodiment is displayed to the user by browsing videos, pictures, websites, game interfaces, and/or floating windows. In this embodiment, when the detailed information is displayed to the user in the floating window mode, the color and the transparency of the floating window can be manually set, and the display position of the floating window can be adjusted.
It is worth mentioning that the designated distance area is one kilometer, two kilometers, three kilometers or five kilometers.
Please refer to fig. 2, the present application further provides a vehicle, and as an embodiment of the vehicle, the vehicle is configured with the vehicle-mounted device as described above.
As one of the embodiments, the vehicle may also display detailed information to the user through a car home screen, a center armrest display screen, a front windshield platform display screen, and/or a seatback display screen.
According to the method and the device, the along-road objects can be identified, and when the along-road objects are adjacent to certain distance areas, detailed information such as animation, introduction and picture display can be automatically generated, so that a user can conveniently know the along-road objects, and the user interaction experience is enhanced.
It should be noted that the 5G communication/communication network technology of the present embodiment may be a technology oriented to a scene, and the present application utilizes the 5G technology to play a key supporting role for a vehicle (especially an intelligent networked automobile), and simultaneously implements connection of people, a connection object, or a connection vehicle, and may specifically adopt the following three typical application scenarios.
The first is eMBB (enhanced Mobile Broadband), so that the user experience rate is 0.1-1 gpbs, the peak rate is 10gbps, and the traffic density is 10Tbps/km 2;
for the second ultra-reliable low-delay communication, the main index which can be realized by the method is that the end-to-end time delay is in the ms (millisecond) level; the reliability is close to 100%;
the third is mMTC (mass machine type communication), and the main index which can be realized by the application is the connection number density, 100 ten thousand other terminals are connected per square kilometer, and the connection number density is 10^6/km 2.
Through the mode, the characteristics of the super-reliable of this application utilization 5G technique, low time delay combine for example radar and camera etc. just can provide the ability that shows for the vehicle, can realize interdynamic with the vehicle, utilize the interactive perception function of 5G technique simultaneously, and the user can do an output to external environment, and the unable light can detect the state, can also do some feedbacks etc.. Further, the method and the device can also be applied to cooperation of automatic driving, such as cooperation type collision avoidance and vehicle formation among vehicles, so that the vehicle speed is integrally formed and the passing efficiency is improved.
In addition, the communication enhancement automatic driving perception capability can be achieved by utilizing the 5G technology, and the requirements of passengers in the automobile on AR (augmented reality)/VR (virtual reality), games, movies, mobile office and other vehicle-mounted information entertainment and high precision can be met. According to the method and the device, the downloading amount of the 3D high-precision positioning map at the centimeter level can be 3-4 Gb/km, the data volume of the map per second under the condition that the speed of a normal vehicle is limited to 120km/h (kilometer per hour) is 90 Mbps-120 Mbps, and meanwhile, the real-time reconstruction of a local map fused with vehicle-mounted sensor information, modeling and analysis of dangerous situations and the like can be supported.
It should be noted that the method and the device can also be applied to an automatic driving layer, can assist in realizing partial intelligent cloud control on the urban fixed route vehicles by utilizing a 5G technology, and can realize cloud-based operation optimization and remote display and control under specific conditions on unmanned vehicles in parks and ports.
In the present application, the above-mentioned system and method CAN be used in a vehicle system having a vehicle TBOX, i.e. the vehicle is a vehicle system that CAN have a vehicle TBOX, and CAN be further connected to a CAN bus of the vehicle.
In this embodiment, the CAN may include three network channels CAN _1, CAN _2, and CAN _3, and the vehicle may further include one ethernet network channel, where the three CAN network channels may be connected to the ethernet network channel through two in-vehicle networking gateways, for example, where the CAN _1 network channel includes a hybrid power assembly system, where the CAN _2 network channel includes an operation support system, where the CAN _3 network channel includes an electric dynamometer system, and the ethernet network channel includes a high-level management system, the high-level management system includes a human-vehicle-road simulation system and a comprehensive information collection unit that are connected as nodes to the ethernet network channel, and the in-vehicle networking gateways of the CAN _1 network channel, the CAN _2 network channel, and the ethernet network channel may be integrated in the comprehensive information collection unit; the car networking gateway of the CAN _3 network channel and the Ethernet network channel CAN be integrated in a man-car-road simulation system.
Further, the nodes connected to the CAN _1 network channel include: the hybrid power system comprises an engine ECU, a motor MCU, a battery BMS, an automatic transmission TCU and a hybrid power controller HCU; the nodes connected with the CAN _2 network channel are as follows: the system comprises a rack measurement and control system, an accelerator sensor group, a power analyzer, an instantaneous oil consumption instrument, a direct-current power supply cabinet, an engine water temperature control system, an engine oil temperature control system, a motor water temperature control system and an engine intercooling temperature control system; the nodes connected with the CAN _3 network channel are as follows: electric dynamometer machine controller.
The preferable speed of the CAN _1 network channel is 250Kbps, and a J1939 protocol is adopted; the rate of the CAN _2 network channel is 500Kbps, and a CANopen protocol is adopted; the rate of the CAN _3 network channel is 1Mbps, and a CANopen protocol is adopted; the rate of the Ethernet network channel is 10/100Mbps, and a TCP/IP protocol is adopted.
In this embodiment, the car networking gateway supports a 5G technology V2X car networking network, which may also be equipped with an IEEE802.3 interface, a DSPI interface, an eSCI interface, a CAN interface, an MLB interface, a LIN interface, and/or an I2C interface.
In this embodiment, for example, the IEEE802.3 interface may be used to connect to a wireless router to provide a WIFI network for the entire vehicle; the DSPI (provider manager component) interface is used for connecting a Bluetooth adapter and an NFC (near field communication) adapter and can provide Bluetooth connection and NFC connection; the eSCI interface is used for connecting the 4G/5G module and communicating with the Internet; the CAN interface is used for connecting a vehicle CAN bus; the MLB interface is used for connecting an MOST (media oriented system transmission) bus in the vehicle, and the LIN interface is used for connecting a LIN (local interconnect network) bus in the vehicle; the IC interface is used for connecting a DSRC (dedicated short-range communication) module and a fingerprint identification module. In addition, the application can merge different networks by mutually converting different protocols by adopting the MPC5668G chip.
In addition, the vehicle TBOX system, Telematics-BOX, of the present embodiment is simply referred to as a vehicle TBOX or a Telematics.
Telematics is a synthesis of Telecommunications and information science (information) and is defined as a service system that provides information through a computer system, a wireless communication technology, a satellite navigation device, and an internet technology that exchanges information such as text and voice, which are built in a vehicle. In short, the vehicle is connected to the internet (vehicle networking system) through a wireless network, and various information necessary for driving and life is provided for the vehicle owner.
In addition, Telematics is a combination of wireless communication technology, satellite navigation system, network communication technology and vehicle-mounted computer, when a fault occurs during vehicle running, the vehicle is remotely diagnosed by connecting a service center through wireless communication, and the computer built in the engine can record the state of main parts of the vehicle and provide accurate fault position and reason for maintenance personnel at any time. The vehicle can receive information and check traffic maps, road condition introduction, traffic information, safety and public security services, entertainment information services and the like through the user communication terminal, and in addition, the vehicle of the embodiment can be provided with electronic games and network application in a rear seat. It is easy to understand that, this embodiment provides service through Telematics, can make things convenient for the user to know traffic information, the parking stall situation that closes on the parking area, confirms current position, can also be connected with the network server at home, in time knows electrical apparatus running condition, the safety condition and guest's condition of visiting etc. at home.
The vehicle according to this embodiment may further include an Advanced Driver Assistance System (ADAS) that collects environmental data inside and outside the vehicle at the first time using the various sensors mounted on the vehicle, and performs technical processing such as identification, detection, and tracking of static and dynamic objects, so that a Driver can recognize a risk that may occur at the fastest time, thereby attracting attention and improving safety. Correspondingly, the ADAS of the present application may also employ sensors such as radar, laser, and ultrasonic sensors, which can detect light, heat, pressure, or other variables for monitoring the state of the vehicle, and are usually located on the front and rear bumpers, side view mirrors, the inside of the steering column, or on the windshield of the vehicle. It is obvious that various intelligent hardware used by the ADAS function can access the V2X car networking network by means of an ethernet link to implement communication connection and interaction.
The host computer of the present embodiment vehicle may comprise suitable logic, circuitry, and/or code that may enable operation and/or functional operation of the five layers above the OSI model (Open System Interconnection, Open communication systems Interconnection reference model). Thus, the host may generate and/or process packets for transmission over the network, and may also process packets received from the network. At the same time, the host may provide services to a local user and/or one or more remote users or network nodes by executing corresponding instructions and/or running one or more applications. In various embodiments of the present application, the host may employ one or more security protocols.
In the present application, the network connection used to implement the V2X car networking network may be a switch, which may have AVB functionality (Audio Video brightening, meeting the IEEE802.1 set of standards), and/or include one or more unshielded twisted pair wires, each of which may have an 8P8C module connector.
In a preferred embodiment, the V2X vehicle networking network specifically comprises a vehicle body control module BCM, a power bus P-CAN, a vehicle body bus I-CAN, a combination instrument CMIC, a chassis control device and a vehicle body control device.
In this embodiment, the body control module BCM may integrate the functions of the car networking gateway to perform signal conversion, message forwarding, and the like between different network segments, i.e., between the power bus P-CAN and the body bus I-CAN, for example, if a controller connected to the power bus needs to communicate with a controller connected to the body bus I-CAN, the body control module BCM may perform signal conversion, message forwarding, and the like between the two controllers.
The power bus P-CAN and the vehicle body bus I-CAN are respectively connected with a vehicle body control module BCM.
The combination instrument CMIC is connected with a power bus P-CAN, and the combination instrument CMIC is connected with a vehicle body bus I-CAN. Preferably, the combination meter CMIC of the present embodiment is connected to different buses, such as a power bus P-CAN and a vehicle body bus I-CAN, and when the combination meter CMIC needs to acquire controller information that is hung on any bus, it is not necessary to perform signal conversion and message forwarding through a vehicle body control module BCM, so that gateway pressure CAN be reduced, network load CAN be reduced, and the speed of acquiring information by the combination meter CMIC CAN be increased.
The chassis control device is connected with the power bus P-CAN. The vehicle body control device is connected with a vehicle body bus I-CAN. In some examples, the chassis control device and the body control device CAN respectively broadcast data such as information to the power bus P-CAN and the body bus I-CAN, so that other vehicle-mounted controllers and other devices hung on the power bus P-CAN or the body bus I-CAN CAN acquire the broadcast information, and communication between the vehicle-mounted devices such as different controllers is realized.
In addition, the V2X car networking network of the vehicle of the embodiment may use two CAN buses, i.e., a power bus P-CAN and a car body bus I-CAN, and use the car body control module BCM as a gateway, and a structure that the combination meter CMIC is connected to both the power bus P-CAN and the car body bus I-CAN, so that an operation that information of the chassis control device or the car body control device is forwarded to the combination meter CMIC through the gateway when the combination meter CMIC is hung on one of the two buses in the conventional manner CAN be omitted, thereby reducing the pressure of the car body control module BCM as a gateway, reducing network load, and more conveniently sending information of vehicle-mounted devices hung on the plurality of buses, e.g., the power bus P-CAN and the car body bus I-CAN, to the combination meter CMIC for display and with strong information transmission real-time.
Finally, specific embodiments of the present application may include the following:
the on-board unit displays detailed information by using a current liquid crystal instrument, a Head-Up liquid crystal Display (HUD) in the vehicle or a predetermined mode of a windshield, and after road information is superimposed on a live-action picture by an AR (Augmented Reality) technology, positional information/building object labeling information along the way is superimposed on the live-action picture. I.e. on the projection of a liquid crystal screen or windscreen, marking the information of the building, such as: the name of the building, the information of the activity inside the current building, and the like, and the information of the destination and the approach point, and the like, may be superimposed on the screen of the liquid crystal display or the projection of the windshield, and directly marked in the area where the target building and the coordinates are located.
Although the present application has been described with reference to a preferred embodiment, it should be understood that various changes, substitutions and alterations can be made herein without departing from the spirit and scope of the application, and all changes, substitutions and alterations that fall within the spirit and scope of the application are to be understood as being included within the following description of the preferred embodiment.