CN111325080A - Vehicle and article information identification display method and system thereof - Google Patents
Vehicle and article information identification display method and system thereof Download PDFInfo
- Publication number
- CN111325080A CN111325080A CN201811544819.9A CN201811544819A CN111325080A CN 111325080 A CN111325080 A CN 111325080A CN 201811544819 A CN201811544819 A CN 201811544819A CN 111325080 A CN111325080 A CN 111325080A
- Authority
- CN
- China
- Prior art keywords
- information
- vehicle
- article
- description
- target object
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 45
- 238000007667 floating Methods 0.000 claims description 14
- 238000012545 processing Methods 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 6
- 230000003993 interaction Effects 0.000 abstract description 5
- 238000004891 communication Methods 0.000 description 21
- 230000006855 networking Effects 0.000 description 11
- ADLSFYJDHWUKFP-UHFFFAOYSA-N 5-methoxy-11,12-dihydroindolo[2,3-a]carbazole-6-carbonitrile Chemical compound N1C2=C3NC4=CC=C[CH]C4=C3C(OC)=C(C#N)C2=C2[C]1C=CC=C2 ADLSFYJDHWUKFP-UHFFFAOYSA-N 0.000 description 10
- 238000005516 engineering process Methods 0.000 description 10
- 230000006870 function Effects 0.000 description 8
- 230000008859 change Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000001965 increasing effect Effects 0.000 description 3
- 230000002452 interceptive effect Effects 0.000 description 3
- 239000010977 jade Substances 0.000 description 3
- 239000002304 perfume Substances 0.000 description 3
- 230000004075 alteration Effects 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 241000256837 Apidae Species 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000004931 aggregating effect Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 238000005282 brightening Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000010705 motor oil Substances 0.000 description 1
- 239000003921 oil Substances 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000006116 polymerization reaction Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application relates to the technical field of vehicles, and provides a vehicle and an article information identification and display method and system thereof. According to the method and the device, the portable articles or the vehicle-mounted ornaments of the user can be identified, and when the articles are close to certain identification areas, the description/introduction information of the articles can be acquired and displayed to the user, so that the user can know the articles instantly, and human-computer interaction can be realized.
Description
Technical Field
The application relates to the technical field of vehicles, in particular to an article information identification display method, and a system and a vehicle applying the article information identification display method.
Background
With the continuous improvement of living standard, automobiles are more and more common in the life of people, and gradually become one of indispensable vehicles in the life of people in cities and villages.
Meanwhile, people no longer simply define the automobile as a transportation tool and a travel tool, and the requirements on the aspects of safety, environmental protection, comfort, entertainment and the like of the automobile are increasing.
Particularly, in the using process of the vehicle, a user hopes that the using experience of the vehicle can be more comfortable, interactive, ornamental and the like, but the vehicle can only provide a simple carrying function at present, the user generally simply drives the vehicle, and passengers can only chat, watch a mobile phone or directly sleep.
Obviously, the existing vehicle interior arrangement can not obviously follow the trend of technical development, and is difficult to meet the increasing material culture requirements.
In view of various defects in the prior art, the inventors of the present application have conducted extensive research to provide a vehicle and an article information identification and display method and system thereof.
Disclosure of Invention
The invention aims to provide a vehicle and an article information identification and display method and system thereof, which can identify the carried articles of a user, and can automatically generate description/introduction information such as animation, introduction and picture display when the articles are adjacent to certain identification areas, thereby facilitating the understanding of the user and enhancing the interactive experience of the user.
In order to solve the above technical problem, the present application provides an article information identification display method, as one embodiment, the article information identification display method includes:
the screen display device judges whether a target object is acquired or not;
if the target object is obtained, judging whether the target object enters a designated identification area;
if the target object enters the designated identification area, identifying the characteristic information of the target object by the camera;
the vehicle-mounted equipment acquires the description/introduction information of the target object from a database and/or a network of the vehicle-mounted equipment according to the characteristic information;
the description/introduction information is displayed to the user in a predetermined manner.
As one embodiment, after the step of displaying the description/introduction information to the user in a predetermined manner, the method further includes:
the screen display device judges whether a new article to be identified is acquired;
if a new article to be identified is obtained, the camera identifies the characteristic information of the article to be identified and obtains corresponding description/introduction information; and displaying a plurality of description/introduction information corresponding to the plurality of articles to the user in an automatic cycle and/or click mode.
As one embodiment, the in-vehicle device identifies characteristic information of the shape, contour, color, pattern and/or texture of the target object through a camera;
and/or the screen display device acquires characteristic information of the shape, the contour and/or the texture of the target object in a pressure sensing mode of the pressure sensor.
As one embodiment, the step of obtaining, by the in-vehicle device, the description/introduction information of the target item from a database thereof and/or a network according to the feature information specifically includes:
the vehicle-mounted equipment searches the description/introduction information corresponding to the target object from a pre-stored local database;
and/or the vehicle-mounted equipment sends the characteristic information to a cloud server for processing, and obtains description/introduction information which is returned by the cloud server and is associated with the characteristic information.
In one embodiment, the camera obtains first characteristic information of a contact surface of the target object, which is adjacent to the designated identification area, second characteristic information of a back surface far away from the contact surface, and/or third characteristic information of a plurality of side surfaces between the contact surface and the back surface as the characteristic information of the target object.
As one embodiment, the screen display device is an integrated screen display desktop, a vehicle-mounted central armrest with a screen and/or a vehicle-mounted camera.
In one embodiment, the description/introduction information is displayed to the user by way of a video, picture, website, game interface, and/or floating window.
As one embodiment, when the description/introduction information is displayed to the user by means of a floating window, the color and transparency of the floating window can be manually set, and the display position of the floating window can be adjusted.
In order to solve the above technical problem, the present application further provides an article information identification display system and a car machine device, as one of the implementation manners, the car machine device is configured with a screen display device, a camera and a car machine device, the car machine device includes a memory and a processor, the memory stores a computer program, and the processor is configured to execute the computer program, so as to implement the article information identification display method described above.
In order to solve the technical problem, the present application further provides a vehicle, as one embodiment, the vehicle is provided with the article information identification display system as described above.
According to the vehicle and the article information identification display method and system thereof, a screen display device judges whether a target article is acquired, if the target article is acquired, whether the target article enters a designated identification area is judged, if the target article enters the designated identification area, a camera identifies the feature information of the target article, and the vehicle-mounted equipment acquires the description/introduction information of the target article from a database and/or a network of the vehicle-mounted equipment according to the feature information and displays the description/introduction information to a user in a preset mode. According to the method and the device, the portable articles of the user can be identified, and when the articles are adjacent to certain identification areas, description/introduction information such as animation, introduction and picture display can be automatically generated, so that the user can conveniently know the information, and the user interaction experience is enhanced.
In this way, this application can sense the little article of putting to can the classification of intelligent recognition object, encircle this goods of furniture for display rather than for use object at the screen and demonstrate the preferred aggregate card content relevant with it, greatly improve the use of vehicle passenger cabin and experience, can also use intelligent house field etc..
The foregoing description is only an overview of the technical solutions of the present application, and in order to make the technical means of the present application more clearly understood, the present application may be implemented in accordance with the content of the description, and in order to make the above and other objects, features, and advantages of the present application more clearly understood, the following preferred embodiments are described in detail with reference to the accompanying drawings.
Drawings
Fig. 1 is a schematic flow chart of an embodiment of an article information identification display method according to the present application.
Fig. 2 is a schematic block diagram of a vehicle-mounted device of the article information identification display system according to the present application.
Detailed Description
To further illustrate the technical means and effects of the present application for achieving the intended application purpose, the following detailed description is provided with reference to the accompanying drawings and preferred embodiments for describing specific embodiments, methods, steps, features and effects of the vehicle and its article information identification and display method and system according to the present application.
The foregoing and other technical matters, features and effects of the present application will be apparent from the following detailed description of preferred embodiments, which is to be read in connection with the accompanying drawings. While the present application has been described in terms of specific embodiments and examples for achieving the desired objects and objectives, it is to be understood that the invention is not limited to the disclosed embodiments, but is to be accorded the widest scope consistent with the principles and novel features as defined by the appended claims.
Referring to fig. 1, fig. 1 is a schematic flow chart illustrating an embodiment of an article information identification display method according to the present application.
The article information identification and display method according to the present embodiment may include, but is not limited to, the following steps.
Step S101, a screen display device judges whether a target object is acquired;
step S102, if a target article is obtained, judging whether the target article enters a specified identification area; if not, no treatment is carried out;
step S103, if entering a designated identification area, identifying the characteristic information of the target object by a camera;
step S104, the vehicle-mounted equipment acquires the description/introduction information of the target object from a database and/or a network thereof according to the characteristic information;
step S105, the description/introduction information is displayed to the user in a preset mode.
It should be noted that the predetermined manner described in this embodiment may refer to a manner such as a syndication card, a folded page, a scrolling broadcast, etc., through which a plurality of pieces of syndication content are syndication; in addition, gradation, abrupt change, texture switching, color switching, shape switching, volume change, position change, and the like can also be referred to.
In this embodiment, the target object may refer to a decorative ornament in a vehicle, or an ornament carried by a user, such as a jade bracelet, a necklace, a mascot, a teacup, a key, a mobile phone, or even a perfume bottle.
It should be noted that, after the step of displaying the description/introduction information to the user in a predetermined manner in this embodiment, the following process may be further included:
in the process 201, the screen display device determines whether a new article to be identified is acquired;
in the process 202, if a new article to be identified is obtained, the camera identifies the characteristic information of the article to be identified and obtains corresponding description/introduction information; and displaying a plurality of description/introduction information corresponding to the plurality of articles to the user in an automatic cycle and/or click mode.
It should be noted that, in the present embodiment, the in-vehicle device identifies, through the camera, the feature information of the shape, the contour, the color, the pattern, and/or the texture of the target object; and/or the screen display device acquires characteristic information of the shape, the contour and/or the texture of the target object in a pressure sensing mode of the pressure sensor.
In this embodiment, the identification area of the on-screen display device may have a pressure sensing function for sensing pressure on an adjacent target object and further identifying structural information such as contours and textures.
It should be noted that, in this embodiment, the processing may be performed in the in-vehicle device itself, or may be performed remotely through a 3G communication network, a 4G communication network, a 5G communication network, a WIFI network, and the like, and specifically, the step of obtaining, by the in-vehicle device according to the feature information, the description/introduction information of the target item from its database and/or network may specifically include:
in a first mode, the vehicle-mounted device searches description/introduction information corresponding to the target object from a pre-stored local database;
and/or in a second mode, the vehicle-mounted equipment sends the characteristic information to a cloud server for processing, and obtains description/introduction information which is returned by the cloud server and is associated with the characteristic information.
It is easily understood that the present embodiment may perform feature information acquisition on any surface of a target article and generate different corresponding description/introduction information, and specifically, the camera of the present embodiment acquires, as feature information of the target article, first feature information of a contact surface of the target article adjacent to the designated identification area, second feature information of a back surface far from the contact surface, and/or third feature information of a plurality of side surfaces located between the contact surface and the back surface.
In this embodiment, the screen display device is an integrated screen display desktop, an on-vehicle center armrest with a screen, and/or an on-vehicle camera. Further, the vehicle-mounted camera may be an AI artificial intelligence camera.
Specifically, the description/introduction information may also be displayed to the user by means of a video, a picture, a website, a game interface and/or a floating window.
It should be noted that, in the present embodiment, when the description/introduction information is displayed to the user in a floating window manner, the color and the transparency of the floating window may be manually set, and the display position of the floating window may be adjusted.
According to the method and the device, the portable articles of the user can be identified, and when the articles are adjacent to certain identification areas, description/introduction information such as animation, introduction and picture display can be automatically generated, so that the user can conveniently know the information, and the user interaction experience is enhanced.
Referring to fig. 2, the present application further provides an article information identification display system, which may be configured with a screen display device, a camera, and a vehicle-mounted device, as an embodiment, the vehicle-mounted device includes a memory 20 and a processor 21, the memory 20 stores a computer program, and the processor 21 is configured to execute the computer program to implement the article information identification display method described above.
Specifically, the processor 21 is configured to determine whether a target object is acquired through a screen display device;
if the target object is obtained, the processor 21 is configured to determine whether the target object enters a designated identification area; if not, no treatment is carried out;
if the target object enters the designated identification area, the processor 21 is used for identifying the characteristic information of the shape, the outline, the color, the pattern and/or the texture of the target object through the camera;
the processor 21 is configured to obtain, by the in-vehicle device, description/introduction information of the target item from a database and/or a network thereof according to the characteristic information;
the processor 21 is configured to display the description/introduction information to the user in a predetermined manner.
In this embodiment, the target object may refer to a decorative ornament in a vehicle, or an ornament carried by a user, such as a jade bracelet, a necklace, a mascot, a teacup, a key, a mobile phone, or even a perfume bottle.
It should be noted that, in this embodiment, the processor 21 is configured to determine whether a new article to be identified is acquired, and if a new article to be identified is acquired, the camera identifies feature information of the article to be identified and acquires corresponding description/introduction information; and displaying a plurality of description/introduction information corresponding to the plurality of articles to the user in an automatic cycle and/or click mode.
It is easily understood that the predetermined manner of the present embodiment may refer to gradation, abrupt change, texture switching, color switching, shape switching, volume change, position change, and the like.
It should be noted that, in the present embodiment, the in-vehicle device identifies, through the camera, the feature information of the shape, the contour, the color, the pattern, and/or the texture of the target object; and/or the screen display device acquires characteristic information of the shape, the contour and/or the texture of the target object in a pressure sensing mode of the pressure sensor.
It should be noted that the camera of the present embodiment may be an AI artificial intelligence camera.
In the present embodiment, the recognition area may have a pressure sensing function for sensing pressure in the adjacent target object and recognizing structural information such as a contour and a texture.
It should be noted that, in this embodiment, the processing may be performed in the in-vehicle device itself, or may be performed in a remote manner through a 3G communication network, a 4G communication network, a 5G communication network, a WIFI network, and the like, specifically, the processor 21 in this embodiment obtains the description/introduction information of the target item from its database and/or network according to the characteristic information, and specifically may include the following several manners:
in a first mode, the processor 21 searches the explanation/introduction information corresponding to the target item from a pre-stored local database;
and/or in a second mode, the vehicle-mounted equipment sends the characteristic information to a cloud server for processing, and obtains description/introduction information which is returned by the cloud server and is associated with the characteristic information.
It is easily understood that the present embodiment may perform feature information acquisition on any surface of a target article and generate different corresponding description/introduction information, and specifically, the processor 21 of the present embodiment is configured to acquire, by using a camera, first feature information of a contact surface of the target article adjacent to the designated identification area, second feature information of a back surface far away from the contact surface, and/or third feature information of a plurality of side surfaces located between the contact surface and the back surface as feature information of the target article.
Specifically, the description/introduction information described in the present embodiment is displayed to the user by means of a video, a picture, a website, a game interface, and/or a floating window. In this embodiment, when the description/introduction information is displayed to the user in the floating window mode, the color and the transparency of the floating window may be manually set, and the display position thereof may be adjusted.
It is worth mentioning that the screen display device is an integrated screen display desktop, a vehicle-mounted central armrest with a screen and/or a vehicle-mounted camera.
Referring to fig. 2, the present application further provides a vehicle, as an embodiment, the vehicle is configured with the article information identification display system and/or the in-vehicle device therein as described above.
The screen display device can be a car machine main screen, a central armrest display screen, a front windshield platform display screen and/or a seatback display screen.
According to the method and the device, the portable articles of the user can be identified, and when the articles are adjacent to certain identification areas, description/introduction information such as animation, introduction and picture display can be automatically generated, so that the user can conveniently know the information, and the user interaction experience is enhanced.
It should be noted that the 5G communication/communication network technology of the present embodiment may be a technology oriented to a scene, and the present application utilizes the 5G technology to play a key supporting role for a vehicle (especially an intelligent networked automobile), and simultaneously implements connection of people, a connection object, or a connection vehicle, and may specifically adopt the following three typical application scenarios.
The first is eMBB (enhanced Mobile Broadband), so that the user experience rate is 0.1-1 gpbs, the peak rate is 10gbps, and the traffic density is 10Tbps/km 2;
for the second ultra-reliable low-delay communication, the main index which can be realized by the method is that the end-to-end time delay is in the ms (millisecond) level; the reliability is close to 100%;
the third is mMTC (mass machine type communication), and the main index which can be realized by the application is the connection number density, 100 ten thousand other terminals are connected per square kilometer, and the connection number density is 10^6/km 2.
Through the mode, the characteristics of the super-reliable of this application utilization 5G technique, low time delay combine for example radar and camera etc. just can provide the ability that shows for the vehicle, can realize interdynamic with the vehicle, utilize the interactive perception function of 5G technique simultaneously, and the user can do an output to external environment, and the unable light can detect the state, can also do some feedbacks etc.. Further, the method and the device can also be applied to cooperation of automatic driving, such as cooperation type collision avoidance and vehicle formation among vehicles, so that the vehicle speed is integrally formed and the passing efficiency is improved.
In addition, the communication enhancement automatic driving perception capability can be achieved by utilizing the 5G technology, and the requirements of passengers in the automobile on AR (augmented reality)/VR (virtual reality), games, movies, mobile office and other vehicle-mounted information entertainment and high precision can be met. According to the method and the device, the downloading amount of the 3D high-precision positioning map at the centimeter level can be 3-4 Gb/km, the data volume of the map per second under the condition that the speed of a normal vehicle is limited to 120km/h (kilometer per hour) is 90 Mbps-120 Mbps, and meanwhile, the real-time reconstruction of a local map fused with vehicle-mounted sensor information, modeling and analysis of dangerous situations and the like can be supported.
It should be noted that the method and the device can also be applied to an automatic driving layer, can assist in realizing partial intelligent cloud control on the urban fixed route vehicles by utilizing a 5G technology, and can realize cloud-based operation optimization and remote display and control under specific conditions on unmanned vehicles in parks and ports.
In the present application, the above-mentioned system and method CAN be used in a vehicle system having a vehicle TBOX, i.e. the vehicle is a vehicle system that CAN have a vehicle TBOX, and CAN be further connected to a CAN bus of the vehicle.
In this embodiment, the CAN may include three network channels CAN _1, CAN _2, and CAN _3, and the vehicle may further include one ethernet network channel, where the three CAN network channels may be connected to the ethernet network channel through two in-vehicle networking gateways, for example, where the CAN _1 network channel includes a hybrid power assembly system, where the CAN _2 network channel includes an operation support system, where the CAN _3 network channel includes an electric dynamometer system, and the ethernet network channel includes a high-level management system, the high-level management system includes a human-vehicle-road simulation system and a comprehensive information collection unit that are connected as nodes to the ethernet network channel, and the in-vehicle networking gateways of the CAN _1 network channel, the CAN _2 network channel, and the ethernet network channel may be integrated in the comprehensive information collection unit; the car networking gateway of the CAN _3 network channel and the Ethernet network channel CAN be integrated in a man-car-road simulation system.
Further, the nodes connected to the CAN _1 network channel include: the hybrid power system comprises an engine ECU, a motor MCU, a battery BMS, an automatic transmission TCU and a hybrid power controller HCU; the nodes connected with the CAN _2 network channel are as follows: the system comprises a rack measurement and control system, an accelerator sensor group, a power analyzer, an instantaneous oil consumption instrument, a direct-current power supply cabinet, an engine water temperature control system, an engine oil temperature control system, a motor water temperature control system and an engine intercooling temperature control system; the nodes connected with the CAN _3 network channel are as follows: electric dynamometer machine controller.
The preferable speed of the CAN _1 network channel is 250Kbps, and a J1939 protocol is adopted; the rate of the CAN _2 network channel is 500Kbps, and a CANopen protocol is adopted; the rate of the CAN _3 network channel is 1Mbps, and a CANopen protocol is adopted; the rate of the Ethernet network channel is 10/100Mbps, and a TCP/IP protocol is adopted.
In this embodiment, the car networking gateway supports a 5G technology V2X car networking network, which may also be equipped with an IEEE802.3 interface, a DSPI interface, an eSCI interface, a CAN interface, an MLB interface, a LIN interface, and/or an I2C interface.
In this embodiment, for example, the IEEE802.3 interface may be used to connect to a wireless router to provide a WIFI network for the entire vehicle; the DSPI (provider manager component) interface is used for connecting a Bluetooth adapter and an NFC (near field communication) adapter and can provide Bluetooth connection and NFC connection; the eSCI interface is used for connecting the 4G/5G module and communicating with the Internet; the CAN interface is used for connecting a vehicle CAN bus; the MLB interface is used for connecting an MOST (media oriented system transmission) bus in the vehicle, and the LIN interface is used for connecting a LIN (local interconnect network) bus in the vehicle; the IC interface is used for connecting a DSRC (dedicated short-range communication) module and a fingerprint identification module. In addition, the application can merge different networks by mutually converting different protocols by adopting the MPC5668G chip.
In addition, the vehicle TBOX system, Telematics-BOX, of the present embodiment is simply referred to as a vehicle TBOX or a Telematics.
Telematics is a synthesis of Telecommunications and information science (information) and is defined as a service system that provides information through a computer system, a wireless communication technology, a satellite navigation device, and an internet technology that exchanges information such as text and voice, which are built in a vehicle. In short, the vehicle is connected to the internet (vehicle networking system) through a wireless network, and various information necessary for driving and life is provided for the vehicle owner.
In addition, Telematics is a combination of wireless communication technology, satellite navigation system, network communication technology and vehicle-mounted computer, when a fault occurs during vehicle running, the vehicle is remotely diagnosed by connecting a service center through wireless communication, and the computer built in the engine can record the state of main parts of the vehicle and provide accurate fault position and reason for maintenance personnel at any time. The vehicle can receive information and check traffic maps, road condition introduction, traffic information, safety and public security services, entertainment information services and the like through the user communication terminal, and in addition, the vehicle of the embodiment can be provided with electronic games and network application in a rear seat. It is easy to understand that, this embodiment provides service through Telematics, can make things convenient for the user to know traffic information, the parking stall situation that closes on the parking area, confirms current position, can also be connected with the network server at home, in time knows electrical apparatus running condition, the safety condition and guest's condition of visiting etc. at home.
The vehicle according to this embodiment may further include an Advanced Driver Assistance System (ADAS) that collects environmental data inside and outside the vehicle at the first time using the various sensors mounted on the vehicle, and performs technical processing such as identification, detection, and tracking of static and dynamic objects, so that a Driver can recognize a risk that may occur at the fastest time, thereby attracting attention and improving safety. Correspondingly, the ADAS of the present application may also employ sensors such as radar, laser, and ultrasonic sensors, which can detect light, heat, pressure, or other variables for monitoring the state of the vehicle, and are usually located on the front and rear bumpers, side view mirrors, the inside of the steering column, or on the windshield of the vehicle. It is obvious that various intelligent hardware used by the ADAS function can access the V2X car networking network by means of an ethernet link to implement communication connection and interaction.
The host computer of the present embodiment vehicle may comprise suitable logic, circuitry, and/or code that may enable operation and/or functional operation of the five layers above the OSI model (Open System Interconnection, Open communication systems Interconnection reference model). Thus, the host may generate and/or process packets for transmission over the network, and may also process packets received from the network. At the same time, the host may provide services to a local user and/or one or more remote users or network nodes by executing corresponding instructions and/or running one or more applications. In various embodiments of the present application, the host may employ one or more security protocols.
In the present application, the network connection used to implement the V2X car networking network may be a switch, which may have AVB functionality (Audio Video brightening, meeting the IEEE802.1 set of standards), and/or include one or more unshielded twisted pair wires, each of which may have an 8P8C module connector.
In a preferred embodiment, the V2X vehicle networking network specifically comprises a vehicle body control module BCM, a power bus P-CAN, a vehicle body bus I-CAN, a combination instrument CMIC, a chassis control device and a vehicle body control device.
In this embodiment, the body control module BCM may integrate the functions of the car networking gateway to perform signal conversion, message forwarding, and the like between different network segments, i.e., between the power bus P-CAN and the body bus I-CAN, for example, if a controller connected to the power bus needs to communicate with a controller connected to the body bus I-CAN, the body control module BCM may perform signal conversion, message forwarding, and the like between the two controllers.
The power bus P-CAN and the vehicle body bus I-CAN are respectively connected with a vehicle body control module BCM.
The combination instrument CMIC is connected with a power bus P-CAN, and the combination instrument CMIC is connected with a vehicle body bus I-CAN. Preferably, the combination meter CMIC of the present embodiment is connected to different buses, such as a power bus P-CAN and a vehicle body bus I-CAN, and when the combination meter CMIC needs to acquire controller information that is hung on any bus, it is not necessary to perform signal conversion and message forwarding through a vehicle body control module BCM, so that gateway pressure CAN be reduced, network load CAN be reduced, and the speed of acquiring information by the combination meter CMIC CAN be increased.
The chassis control device is connected with the power bus P-CAN. The vehicle body control device is connected with a vehicle body bus I-CAN. In some examples, the chassis control device and the body control device CAN respectively broadcast data such as information to the power bus P-CAN and the body bus I-CAN, so that other vehicle-mounted controllers and other devices hung on the power bus P-CAN or the body bus I-CAN CAN acquire the broadcast information, and communication between the vehicle-mounted devices such as different controllers is realized.
In addition, the V2X car networking network of the vehicle of the embodiment may use two CAN buses, i.e., a power bus P-CAN and a car body bus I-CAN, and use the car body control module BCM as a gateway, and a structure that the combination meter CMIC is connected to both the power bus P-CAN and the car body bus I-CAN, so that an operation that information of the chassis control device or the car body control device is forwarded to the combination meter CMIC through the gateway when the combination meter CMIC is hung on one of the two buses in the conventional manner CAN be omitted, thereby reducing the pressure of the car body control module BCM as a gateway, reducing network load, and more conveniently sending information of vehicle-mounted devices hung on the plurality of buses, e.g., the power bus P-CAN and the car body bus I-CAN, to the combination meter CMIC for display and with strong information transmission real-time.
Finally, specific embodiments of the present application may include the following:
1. the vehicle customer area is provided with an entertainment information integrated identification area (such as a desktop screen), can also be a large-area central armrest and has a pressure sensing function;
2. an AI camera capable of identifying objects is arranged in the vehicle;
the implementation principle comprises the following steps:
1. the pressure sensing function of the desktop screen can sense the outline characteristics of a target object, such as the bottom or other parts where contact occurs;
2. after the car machine equipment receives the outline characteristic recognition completion event of the desktop screen, the car machine equipment can interact with the AI camera, and can recognize the ornament objects placed on the desktop screen through the AI camera, such as a jade bracelet, a necklace, a teacup, a key, a mobile phone, a perfume bottle and the like, wherein the implementation mode can set the event triggering the recognition action, such as the object appearing in the recognition area for 3 seconds and the like;
the AI camera can identify the appearance characteristics of the target object, and can also acquire the related aggregated content (namely all related content including the description/introduction information) from the cloud server according to the identified characteristic types and send the aggregated content to the vehicle-mounted device, and the vehicle-mounted device puts the aggregated content into a card UI (user interface) container;
4. the car machine equipment can reasonably arrange the aggregate card around the periphery of the bottom contour of the target object and display the aggregate content in the card UI container;
5. in addition, if the object moves or changes the position of the object on the desktop, the desktop screen can re-arrange the aggregated cards around the bottom outline area of the new position;
6. if the vehicle-mounted device identifies a plurality of aggregated cards, the aggregated cards can be selected by a user in a stacking mode, and when the user clicks a certain aggregated card, the vehicle-mounted device finishes the identification mode, and displays the selected aggregated content on a large screen, such as playing videos and pictures, opening websites or games.
In some applicable scenes, if a child puts the transformers toy in the hand on a table, the table can sense and identify the skyscraper or the bumblebee, and animation films, games, songs and the like related to the toys are presented in a mode of aggregating cards with proper sizes and the like at the positions surrounding the toys, so that the intelligent entertainment experience of the intelligent table can be improved; alternatively, the user can identify the object by placing the small commodity on a desktop, and present shopping content, evaluation, use method introduction, and the like related to the object around the object.
This application can sense the little article of putting, can the classification of intelligent recognition object to encircle this goods of furniture for display rather than for use object at the screen and demonstrate the preferred polymerization card content relevant with it, greatly improve the car cockpit, the intelligent use of intelligent house even is experienced.
Although the present application has been described with reference to a preferred embodiment, it should be understood that various changes, substitutions and alterations can be made herein without departing from the spirit and scope of the application, and all changes, substitutions and alterations that fall within the spirit and scope of the application are to be understood as being included within the following description of the preferred embodiment.
Claims (10)
1. The article information identification display method is characterized by providing a screen display device, a camera and a vehicle-mounted device, and comprises the following steps:
the screen display device judges whether a target object is acquired or not;
if the target object is obtained, judging whether the target object enters a designated identification area;
if the target object enters the designated identification area, identifying the characteristic information of the target object by the camera;
the vehicle-mounted equipment acquires the description/introduction information of the target object from a database and/or a network of the vehicle-mounted equipment according to the characteristic information;
the description/introduction information is displayed to the user in a predetermined manner.
2. The item information identification display method according to claim 1, wherein after the step of displaying the description/introduction information to the user in a predetermined manner, further comprising:
the screen display device judges whether a new article to be identified is acquired;
if a new article to be identified is obtained, the camera identifies the characteristic information of the article to be identified and obtains corresponding description/introduction information;
and displaying a plurality of description/introduction information corresponding to the plurality of articles to the user in an automatic cycle and/or click mode.
3. The article information identification and display method according to claim 1, wherein the in-vehicle equipment identifies the feature information of the shape, contour, color, pattern and/or texture of the target article through a camera;
and/or the screen display device acquires characteristic information of the shape, the contour and/or the texture of the target object in a pressure sensing mode of the pressure sensor.
4. The item information identification and display method according to claim 3, wherein the step of obtaining, by the in-vehicle device, the description/introduction information of the target item from a database thereof and/or a network according to the feature information specifically includes:
the vehicle-mounted equipment searches the description/introduction information corresponding to the target object from a pre-stored local database;
and/or the vehicle-mounted equipment sends the characteristic information to a cloud server for processing, and obtains description/introduction information which is returned by the cloud server and is associated with the characteristic information.
5. The item information identification display method according to claim 1, wherein the camera acquires first characteristic information of a contact surface of the target item adjacent to the designated identification area, second characteristic information of a back surface distant from the contact surface, and/or third characteristic information of a plurality of side surfaces located between the contact surface and the back surface as the characteristic information of the target item.
6. The method for identifying and displaying the item information according to any one of claims 1 to 5, wherein the screen display device is an integrated screen display desktop, a vehicle-mounted center armrest with a screen, and/or a vehicle-mounted camera.
7. The article information identification display method according to claim 1, wherein the description/introduction information is displayed to the user by means of a video, a picture, a website, a game interface and/or a floating window.
8. The article information identification display method according to claim 7, wherein when the explanatory/introductory information is displayed to the user by way of a floating window, the color and transparency of the floating window can be manually set, and the display position thereof can be adjusted.
9. An article information identification display system, characterized in that, a screen display device, a camera and a vehicle machine device are configured, the vehicle machine device comprises a memory and a processor, the memory stores a computer program, and the processor is used for executing the computer program to realize the article information identification display method according to any one of claims 1 to 8.
10. A vehicle characterized by being provided with the article information recognition display system according to claim 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811544819.9A CN111325080A (en) | 2018-12-17 | 2018-12-17 | Vehicle and article information identification display method and system thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811544819.9A CN111325080A (en) | 2018-12-17 | 2018-12-17 | Vehicle and article information identification display method and system thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111325080A true CN111325080A (en) | 2020-06-23 |
Family
ID=71166637
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811544819.9A Pending CN111325080A (en) | 2018-12-17 | 2018-12-17 | Vehicle and article information identification display method and system thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111325080A (en) |
Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202257872U (en) * | 2011-08-28 | 2012-05-30 | 烟台汽车工程职业学院 | Monitoring and alarming device for preventing losing of objects of passenger in taxi |
| CN103150540A (en) * | 2011-12-06 | 2013-06-12 | 原熙 | System for acquiring item information through camera device of mobile communication equipment |
| CN105224845A (en) * | 2015-09-01 | 2016-01-06 | 京东方科技集团股份有限公司 | Identity recognition device and manufacture method, personal identification method |
| CN205981415U (en) * | 2016-09-14 | 2017-02-22 | 深圳市深信信息技术有限公司 | Intelligence electronic scale with fruit vegetables recognition function |
| CN206074013U (en) * | 2016-08-30 | 2017-04-05 | 北京华力兴科技发展有限责任公司 | Various dimensions vehicle information display |
| CN206649496U (en) * | 2017-01-19 | 2017-11-17 | 广景视睿科技（深圳）有限公司 | A kind of object identification and projection interactive device |
| CN107576261A (en) * | 2017-08-31 | 2018-01-12 | 上海摩软通讯技术有限公司 | Texture acquirement method and mobile terminal |
| CN107585096A (en) * | 2016-07-08 | 2018-01-16 | 奥迪股份公司 | Anti- forgetting system for prompting, method and vehicle |
| CN107728349A (en) * | 2016-08-12 | 2018-02-23 | 深圳市掌网科技股份有限公司 | The interactive device and method of changeable displaying content |
| US20180061153A1 (en) * | 2016-08-31 | 2018-03-01 | Mitsubishi Jidosha Kogyo Kabushiki Kaisha | Information providing system of vehicle |
| CN107767590A (en) * | 2016-08-16 | 2018-03-06 | 深圳仪普生科技有限公司 | Automatic identification commercialization bar code electronic scale and Automatic identification method |
| CN107767460A (en) * | 2016-08-18 | 2018-03-06 | 深圳市劲嘉数媒科技有限公司 | The methods of exhibiting and device of augmented reality |
| CN107870755A (en) * | 2016-09-27 | 2018-04-03 | 通用汽车环球科技运作有限责任公司 | Vehicle window image display system and method |
| CN108280434A (en) * | 2018-01-25 | 2018-07-13 | 北京小米移动软件有限公司 | The method and apparatus for showing information |
| CN108537095A (en) * | 2017-03-06 | 2018-09-14 | 艺龙网信息技术（北京）有限公司 | Method, system, server and the virtual reality device of identification displaying Item Information |
| CN108596699A (en) * | 2017-12-27 | 2018-09-28 | 金瓜子科技发展（北京）有限公司 | Vehicle source display methods and device |
| CN108596295A (en) * | 2018-03-27 | 2018-09-28 | 英业达科技有限公司 | The system and method for article position is confirmed using automatic vehicle |
| CN108717826A (en) * | 2018-05-28 | 2018-10-30 | 江苏贝尔装饰材料有限公司 | Object methods of exhibiting and device |
-
2018
- 2018-12-17 CN CN201811544819.9A patent/CN111325080A/en active Pending
Patent Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202257872U (en) * | 2011-08-28 | 2012-05-30 | 烟台汽车工程职业学院 | Monitoring and alarming device for preventing losing of objects of passenger in taxi |
| CN103150540A (en) * | 2011-12-06 | 2013-06-12 | 原熙 | System for acquiring item information through camera device of mobile communication equipment |
| CN105224845A (en) * | 2015-09-01 | 2016-01-06 | 京东方科技集团股份有限公司 | Identity recognition device and manufacture method, personal identification method |
| CN107585096A (en) * | 2016-07-08 | 2018-01-16 | 奥迪股份公司 | Anti- forgetting system for prompting, method and vehicle |
| CN107728349A (en) * | 2016-08-12 | 2018-02-23 | 深圳市掌网科技股份有限公司 | The interactive device and method of changeable displaying content |
| CN107767590A (en) * | 2016-08-16 | 2018-03-06 | 深圳仪普生科技有限公司 | Automatic identification commercialization bar code electronic scale and Automatic identification method |
| CN107767460A (en) * | 2016-08-18 | 2018-03-06 | 深圳市劲嘉数媒科技有限公司 | The methods of exhibiting and device of augmented reality |
| CN206074013U (en) * | 2016-08-30 | 2017-04-05 | 北京华力兴科技发展有限责任公司 | Various dimensions vehicle information display |
| US20180061153A1 (en) * | 2016-08-31 | 2018-03-01 | Mitsubishi Jidosha Kogyo Kabushiki Kaisha | Information providing system of vehicle |
| CN205981415U (en) * | 2016-09-14 | 2017-02-22 | 深圳市深信信息技术有限公司 | Intelligence electronic scale with fruit vegetables recognition function |
| CN107870755A (en) * | 2016-09-27 | 2018-04-03 | 通用汽车环球科技运作有限责任公司 | Vehicle window image display system and method |
| CN206649496U (en) * | 2017-01-19 | 2017-11-17 | 广景视睿科技（深圳）有限公司 | A kind of object identification and projection interactive device |
| CN108537095A (en) * | 2017-03-06 | 2018-09-14 | 艺龙网信息技术（北京）有限公司 | Method, system, server and the virtual reality device of identification displaying Item Information |
| CN107576261A (en) * | 2017-08-31 | 2018-01-12 | 上海摩软通讯技术有限公司 | Texture acquirement method and mobile terminal |
| CN108596699A (en) * | 2017-12-27 | 2018-09-28 | 金瓜子科技发展（北京）有限公司 | Vehicle source display methods and device |
| CN108280434A (en) * | 2018-01-25 | 2018-07-13 | 北京小米移动软件有限公司 | The method and apparatus for showing information |
| CN108596295A (en) * | 2018-03-27 | 2018-09-28 | 英业达科技有限公司 | The system and method for article position is confirmed using automatic vehicle |
| CN108717826A (en) * | 2018-05-28 | 2018-10-30 | 江苏贝尔装饰材料有限公司 | Object methods of exhibiting and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110901524B (en) | Vehicle, vehicle equipment and vehicle-mounted atmosphere lamp style automatic adjusting method thereof | |
| CN108833589B (en) | Vehicle, vehicle equipment and vehicle equipment navigation data synchronization method thereof | |
| CN108923808A (en) | Vehicle and its car-mounted terminal and speech interaction mode active triggering method | |
| CN111688488A (en) | Vehicle, vehicle machine equipment and virtual scene control method thereof | |
| CN111200720A (en) | Internet of vehicles platform, vehicle remote video monitoring method and system | |
| CN110920540A (en) | Vehicle, vehicle equipment and vehicle equipment theme automatic adjusting method thereof | |
| CN110793537A (en) | Navigation path recommendation method, vehicle machine and vehicle | |
| CN111311939A (en) | Vehicle, vehicle equipment and traffic light information map display method thereof | |
| CN110958559A (en) | Vehicle, vehicle equipment and instant interaction method based on map display | |
| CN111284325B (en) | Vehicle, vehicle equipment and vehicle along-the-road object detailed information display method thereof | |
| CN110920388A (en) | Vehicle, vehicle equipment and vehicle equipment style adjusting method based on environmental factors | |
| CN111660965A (en) | Vehicle and intelligent steering wheel adjusting method and device based on seat adjustment | |
| CN110954127A (en) | Vehicle, user terminal and navigation map theme automatic adjusting method thereof | |
| CN111328042B (en) | Vehicle and equipment operation information display method and system thereof | |
| CN111078808A (en) | Vehicle, user terminal and map personalized adjusting method based on environmental factors | |
| CN111289009A (en) | Vehicle, vehicle equipment and vehicle equipment interest point input searching method thereof | |
| CN111619348A (en) | Vehicle, vehicle equipment and display control method based on instrument panel | |
| CN111210541A (en) | Vehicle, vehicle equipment and intelligent speed limit information prompting method | |
| CN111291142A (en) | Vehicle, vehicle equipment and personalized vehicle equipment interest point searching and displaying method thereof | |
| CN108983773A (en) | Vehicle, vehicle device equipment, user communication terminal and its stroke automatic planning | |
| CN111325080A (en) | Vehicle and article information identification display method and system thereof | |
| CN111050153B (en) | Vehicle, vehicle equipment and three-dimensional realization method of vehicle equipment | |
| CN111324329A (en) | Vehicle and voice interaction method and system based on article display information | |
| CN111092920B (en) | Vehicle, vehicle equipment and vehicle matching business service method thereof | |
| CN111324756A (en) | Vehicle and method and system for generating decorative animation based on real object |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Room 208, building 4, 1411 Yecheng Road, Jiading District, Shanghai, 201821 Applicant after: Botai vehicle networking technology (Shanghai) Co.,Ltd. Address before: Room 208, building 4, 1411 Yecheng Road, Jiading District, Shanghai, 201821 Applicant before: SHANGHAI PATEO ELECTRONIC EQUIPMENT MANUFACTURING Co.,Ltd. |
|
| CB02 | Change of applicant information |