CN111328042B - Vehicle and equipment operation information display method and system thereof - Google Patents
Vehicle and equipment operation information display method and system thereof Download PDFInfo
- Publication number
- CN111328042B CN111328042B CN201811544817.XA CN201811544817A CN111328042B CN 111328042 B CN111328042 B CN 111328042B CN 201811544817 A CN201811544817 A CN 201811544817A CN 111328042 B CN111328042 B CN 111328042B
- Authority
- CN
- China
- Prior art keywords
- equipment
- vehicle
- intelligent
- operation information
- screen display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/40—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/037—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for occupant comfort, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B19/00—Driving, starting, stopping record carriers not specifically of filamentary or web form, or of supports therefor; Control thereof; Control of operating function ; Driving both disc and head
- G11B19/02—Control of operating function, e.g. switching from recording to reproducing
- G11B19/022—Control panels
- G11B19/025—'Virtual' control panels, e.g. Graphical User Interface [GUI]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/40—Bus networks
- H04L12/40006—Architecture of a communication node
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/40—Bus networks
- H04L12/40006—Architecture of a communication node
- H04L12/40013—Details regarding a bus controller
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/40—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
- H04W4/48—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P] for in-vehicle communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W8/00—Network data management
- H04W8/005—Discovery of network devices, e.g. terminals
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/40—Bus networks
- H04L2012/40208—Bus networks characterized by the use of a particular bus standard
- H04L2012/40215—Controller Area Network CAN
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/40—Bus networks
- H04L2012/40267—Bus for use in transportation systems
- H04L2012/40273—Bus for use in transportation systems the transportation system being a vehicle
Abstract
The application relates to the technical field of vehicles, and provides a vehicle and a method and a system for displaying equipment operation information thereof, and provides a screen display device, a camera and a vehicle equipment, wherein the screen display device judges whether to acquire intelligent equipment, if so, judges whether the intelligent equipment is adjacent and/or in contact with a screen display area of the screen display device, and if adjacent and/or in contact with the screen display area of the screen display device, the camera acquires feature mark information of the intelligent equipment, and the vehicle equipment is used for controlling according to the feature mark information loading, the equipment operation information is sent to the screen display area for displaying so as to be operated by a user. This application can discern user's personal intelligent article, when these intelligent articles border on to some screen display region in addition, can automatic generation equipment operation information, supply the user to know intelligent article and carry out indirect control intelligent article through car machine equipment, increase interactive enjoyment.
Description
Technical Field
The application relates to the technical field of vehicle equipment, in particular to an equipment operation information display method, a system applying the equipment operation information display method and a vehicle.
Background
With the continuous improvement of living standard, automobiles are more and more common in the life of people, and gradually become one of indispensable vehicles in the life of people in cities and villages.
Meanwhile, people no longer simply define the automobile as a transportation tool and a travel tool, and the requirements on the aspects of safety, environmental protection, comfort, entertainment and the like of the automobile are increasing.
Particularly, in the using process of the vehicle, a user hopes that the vehicle using experience can be more comfortable, interactive, attractive and the like, however, the vehicle can only provide a simple carrying function at present, the user generally drives the vehicle simply, and passengers can only chat, watch a mobile phone or directly sleep. In addition, some intelligent devices have complex functions, and users generally have difficulty in knowing the functions in time, so that additional help information needs to be provided for the users to operate the intelligent devices.
Obviously, the existing vehicle interior arrangement can not obviously follow the trend of technical development, and is difficult to meet the increasing material culture requirements.
In view of various defects of the prior art, the inventors of the present application have conducted extensive studies to provide a vehicle and a device operation information display method and system thereof.
Disclosure of Invention
The purpose of the application is to provide a vehicle and a method and a system for displaying equipment operation information of the vehicle, which can identify portable intelligent articles of a user, and can automatically generate the equipment operation information when the intelligent articles are adjacent to certain screen display areas, so that the user can know the intelligent articles and indirectly control the intelligent articles through vehicle equipment, and the interactive fun is increased.
In order to solve the above technical problem, the present application provides an apparatus operation information display method, which is an implementation manner of the apparatus operation information display method, and provides a screen display device, a camera and a vehicle device, where the apparatus operation information display method includes:
the screen display device judges whether the intelligent equipment is acquired or not;
if the intelligent equipment is acquired, judging whether the intelligent equipment is adjacent to and/or in contact with a screen display area of a screen display device;
if the intelligent equipment is adjacent to and/or in contact with a screen display area of a screen display device, the camera acquires feature mark information of the intelligent equipment;
the vehicle-mounted equipment loads equipment operation information for controlling the intelligent equipment according to the feature mark information;
and sending the equipment operation information to the screen display area for display so as to be operated by a user.
As one implementation manner, the step of determining, by the screen display device, whether the smart device is acquired specifically includes:
the vehicle-mounted equipment searches for the intelligent equipment in a Bluetooth mode;
and if the intelligent equipment is searched, acquiring the equipment ID of the intelligent equipment, and judging whether the intelligent equipment is the intelligent equipment or not according to the acquired equipment ID.
As one implementation manner, the in-vehicle device starts the vehicle-mounted camera to identify the intelligent device, so as to obtain the feature tag information of the intelligent device.
As one implementation manner, the step of loading, by the in-vehicle device, device operation information for controlling the intelligent device according to the feature tag information specifically includes:
the vehicle-mounted equipment judges whether the intelligent equipment is bound or not according to the feature mark information;
and if the intelligent equipment is the bound intelligent equipment, locally loading corresponding equipment operation information from the vehicle-mounted equipment.
As one implementation manner, if the intelligent device is an unbound intelligent device, the in-vehicle device loads corresponding device operation information from the cloud server according to the feature tag information.
As one of the implementation manners, the car-machine device loads the corresponding device operation information, which specifically includes the following processes:
the method comprises the steps that the vehicle-mounted equipment obtains operation function items of the intelligent equipment and a control interaction command protocol corresponding to the operation function items, wherein the operation function items comprise an up item, a down item, a left item, a right item, a confirmation item, a previous item, a next item, a play item, a pause item, a volume value and/or a sending sharing item.
As an embodiment, the step of sending the device operation information to the on-screen display area for displaying specifically includes:
and displaying the intelligent equipment in the screen display area, and displaying the equipment operation information in a distributed manner around the intelligent equipment.
As an embodiment, after the step of sending the device operation information to the on-screen display area for displaying, the method further includes:
the vehicle-mounted equipment judges whether the operation voice of the user is received or not;
and if the operation voice of the user is received, analyzing an operation command corresponding to the operation voice, and sending the operation command to the intelligent equipment so as to enable the intelligent equipment to execute corresponding response operation.
In order to solve the above technical problem, the present application further provides an apparatus operation information display system, as one of the implementation manners, configured with a screen display device, a camera and a car-mounted device, where the car-mounted device includes a memory and a processor, where the memory stores a computer program, and the processor is configured to execute the computer program to implement the steps of the apparatus operation information display method described above.
In order to solve the above technical problem, the present application further provides a vehicle, as one embodiment, the vehicle is provided with the device operation information display system as described above.
In one embodiment, the screen display device is a car main screen, a central armrest display screen, a front windshield platform display screen, and/or a seatback display screen.
The vehicle and the equipment operation information display method and system thereof provide a screen display device, a camera and a vehicle-mounted equipment, the screen display device judges whether to acquire the intelligent equipment, if so, judges whether the intelligent equipment is adjacent to and/or in contact with a screen display area of the screen display device, if the intelligent equipment is adjacent to and/or in contact with the screen display area of the screen display device, the camera acquires feature mark information of the intelligent equipment, and the vehicle-mounted equipment loads equipment operation information used for controlling the intelligent equipment according to the feature mark information and sends the equipment operation information to the screen display area for display so as to be operated by a user. This application can discern user's the intelligent article of hand-carrying, when these intelligent articles adjoin to some screen display region in addition, can automatic generation equipment operation information for the user knows intelligent article and carries out indirect control intelligent article through car machine equipment, increases interactive enjoyment.
The foregoing description is only an overview of the technical solutions of the present application, and in order to make the technical means of the present application more clearly understood, the present application may be implemented in accordance with the content of the description, and in order to make the above and other objects, features, and advantages of the present application more clearly understood, the following preferred embodiments are described in detail with reference to the accompanying drawings.
Drawings
Fig. 1 is a schematic flow chart illustrating an embodiment of a method for displaying device operation information according to the present application.
Fig. 2 is a schematic block diagram of a vehicle-mounted device of the device operation information display system according to the present application.
Detailed Description
To further illustrate the technical means and effects of the present application for achieving the intended application purpose, the following detailed description is provided with reference to the accompanying drawings and preferred embodiments for describing specific embodiments, methods, steps, features and effects of the vehicle and the device operation information display method and system thereof according to the present application.
The foregoing and other technical matters, features and effects of the present application will be apparent from the following detailed description of preferred embodiments, which is to be read in connection with the accompanying drawings. While the present disclosure has been described in connection with specific embodiments thereof, it is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
Referring to fig. 1, fig. 1 is a schematic flow chart illustrating an embodiment of a method for displaying device operation information according to the present application.
It should be noted that, this embodiment provides a screen display device, a camera, and a car-mounted device, and the device operation information display method may include, but is not limited to, the following steps.
Step S101, a screen display device judges whether intelligent equipment is acquired;
step S102, if the intelligent equipment is obtained, judging whether the intelligent equipment is adjacent to and/or in contact with a screen display area of a screen display device; if not, no processing is carried out;
step S103, if the intelligent equipment is adjacent to and/or in contact with a screen display area of a screen display device, a camera acquires feature mark information of the intelligent equipment; wherein, if the screen display area is not adjacent to or contacted with the screen display area, no treatment is carried out;
step S104, the in-vehicle equipment loads equipment operation information for controlling the intelligent equipment according to the feature tag information;
and S105, sending the equipment operation information to the screen display area for displaying so as to be operated by a user.
It should be noted that, the step of determining, by the screen display device according to this embodiment, whether to acquire the smart device may specifically include: the vehicle-mounted equipment searches for the intelligent equipment in a Bluetooth mode; and if the intelligent equipment is searched, acquiring the equipment ID of the intelligent equipment, and judging whether the intelligent equipment is the intelligent equipment or not according to the acquired equipment ID.
It will be readily appreciated that devices connected via bluetooth or the like will typically also display a device ID, such as an M-speaker, or a 6S-iPhone, or the like.
Specifically, the vehicle-mounted device in the embodiment starts the vehicle-mounted camera to identify the intelligent device so as to acquire the feature tag information of the intelligent device.
In this embodiment, the step of loading, by the in-vehicle device, device operation information for controlling the intelligent device according to the feature tag information specifically includes: the vehicle-mounted equipment judges whether the intelligent equipment is bound or not according to the feature mark information; and if the intelligent device is the bound intelligent device, locally loading corresponding device operation information from the vehicle-mounted device.
In other embodiments, if the device is an unbound intelligent device, the in-vehicle device loads corresponding device operation information from the cloud server according to the feature tag information.
This embodiment uses two smart machines of cell-phone or bluetooth speaker as an example, and the equipment operation information that car machine equipment loading corresponds specifically includes the process: the method comprises the steps that the vehicle-mounted equipment obtains operation function items of the intelligent equipment and a control interaction command protocol corresponding to the operation function items, wherein the operation function items comprise an up item, a down item, a left item, a right item, a confirmation item, a previous item, a next item, a play item, a pause item, a volume value and/or a sending sharing item.
In order to increase the interactive experience of the user, the step of sending the device operation information to the screen display area for displaying in the embodiment specifically includes: and displaying the intelligent equipment in the screen display area, and displaying the equipment operation information in a distributed manner around the intelligent equipment.
It should be noted that, a user is inconvenient to operate when driving, and after the step of sending the device operation information to the screen display area for displaying, the method of the present embodiment further includes: the vehicle-mounted equipment judges whether the operation voice of the user is received or not; and if the operation voice of the user is received, analyzing an operation command corresponding to the operation voice, and sending the operation command to the intelligent equipment so as to enable the intelligent equipment to execute corresponding response operation.
It should be particularly noted that, after the step of sending the device operation information to the on-screen display area for displaying for a user to operate, the following process may be further included:
in the process 201, the in-vehicle device obtains a real-time distance value between the intelligent device and a screen display area of the screen display device;
and a process 202 of dynamically adjusting a screen display playing mode of the device operation information according to the real-time distance value.
It is to be understood that the on-screen display manner of the present embodiment may refer to gradual change, abrupt change, texture switching, color switching, shape switching, volume change, position change, and the like.
It should be noted that, in the present embodiment, the in-vehicle device obtains the feature tag information of the intelligent device through the camera; and/or the vehicle-mounted equipment acquires the characteristic mark information of the shape, the contour and/or the texture of the intelligent equipment in a pressure sensing mode.
In this embodiment, the screen area of the screen device may have a pressure sensing function, for example, a pressure sensor, for sensing pressure of the adjacent smart devices and recognizing structural information such as contour and texture.
It should be noted that, in the present embodiment, the processing may be performed in the in-vehicle device itself, or the remote processing may be performed through a 3G communication network, a 4G communication network, a 5G communication network, a WIFI network, or the like.
Specifically, the intelligent device displayed in the on-screen display area according to the embodiment may be a reflection animation, a virtual three-dimensional simulation animation, a planar simulation animation, or a virtual scene derivative animation.
This application can discern user's the intelligent article of hand-carrying, when these intelligent articles adjoin to some screen display region in addition, can automatic generation equipment operation information for the user knows intelligent article and carries out indirect control intelligent article through car machine equipment, increases interactive enjoyment.
Referring to fig. 2, the present application further provides an apparatus operation information display system, as an implementation manner, configured with a screen display device, a camera, and a car-mounted apparatus, where the car-mounted apparatus includes a memory 20 and a processor 21, the memory 20 stores a computer program, and the processor 21 is configured to execute the computer program, so as to implement the apparatus operation information display method described above.
Specifically, the processor 21 is configured to determine whether the intelligent device is acquired through a screen display device;
if the intelligent device is obtained, the processor 21 is configured to determine whether the intelligent device is adjacent to and/or in contact with a screen display area of a screen display apparatus; if not, no processing is carried out;
if the mobile terminal is close to and/or in contact with a screen display area of the screen display device, the processor 21 is configured to obtain feature mark information of the intelligent device through a camera; wherein if the screen display area is not adjacent to or contacted with the screen display area, no treatment is carried out;
the processor 21 is configured to load, by the in-vehicle device, device operation information for controlling the intelligent device according to the feature tag information;
the processor 21 is configured to send the device operation information to the on-screen display area for displaying, so that a user can perform an operation.
It should be noted that, in this embodiment, the processor 21 is configured to search for the smart device in a bluetooth manner; and if the intelligent equipment is searched, acquiring the equipment ID of the intelligent equipment, and judging whether the intelligent equipment is the intelligent equipment or not according to the acquired equipment ID.
It will be readily appreciated that devices connected via bluetooth or the like will typically also display a device ID, such as an M-box, or a 6S-iPhone or the like.
Specifically, the in-vehicle device in the embodiment starts the vehicle-mounted camera to identify the intelligent device so as to acquire the feature tag information of the intelligent device.
In this embodiment, the processor 21 is configured to determine whether the smart device is a bound smart device according to the feature tag information; and if the intelligent equipment is the bound intelligent equipment, locally loading corresponding equipment operation information from the vehicle-mounted equipment.
In other embodiments, if the device is an unbound smart device, the processor 21 is configured to load corresponding device operation information from a cloud server according to the feature tag information.
In this embodiment, two smart devices, such as a mobile phone or a bluetooth speaker, are taken as an example, and the processor 21 is configured to obtain an operation function item of the smart device and a control interaction command protocol corresponding to the operation function item, where the operation function item includes up, down, left, right, confirmation, previous, next, play, pause, volume +, volume-, and/or sending share.
In order to increase the interactive experience of the user, the intelligent device is displayed in the screen display area, and the device operation information is distributed and displayed around the intelligent device.
It should be noted that, the user is inconvenient to operate when driving, and this embodiment further includes: the processor 21 is configured to determine whether an operation voice of a user is received; and if receiving the operation voice of the user, analyzing an operation command corresponding to the operation voice, and sending the operation command to the intelligent equipment so that the intelligent equipment executes corresponding response operation.
It should be particularly noted that, in this embodiment, after the device operation information is sent to the on-screen display area to be displayed, so that a user performs an operation, the processor 21 is configured to obtain a real-time distance value between the intelligent device and the on-screen display area of the on-screen display apparatus; the processor 21 is configured to dynamically adjust a screen display playing mode of the device operation information according to the real-time distance value.
It is easily understood that the on-screen display mode of the present embodiment may refer to gradual change, abrupt change, texture switching, color switching, shape switching, volume change, position change, and the like.
It should be noted that, in this embodiment, the processor 21 is configured to obtain the feature tag information of the intelligent device through a camera; and/or the processor 21 is configured to obtain the feature marking information of the shape, contour and/or texture of the smart device by a pressure sensing manner.
In this embodiment, the on-screen area of the on-screen display device may have a pressure sensing function for sensing pressure on the adjacent smart device and recognizing structural information such as contours and textures.
It should be noted that, in the present embodiment, the processing may be performed in the in-vehicle device itself, or the remote processing may be performed through a 3G communication network, a 4G communication network, a 5G communication network, a WIFI network, and the like.
Specifically, the intelligent device displayed in the on-screen display area according to the embodiment may be a reflection animation, a virtual three-dimensional simulation animation, a planar simulation animation, or a virtual scene derivative animation.
This application can discern user's personal intelligent article, when these intelligent articles border on to some screen display region in addition, can automatic generation equipment operation information, supply the user to know intelligent article and carry out indirect control intelligent article through car machine equipment, increase interactive enjoyment.
With reference to fig. 2, the present application further provides a vehicle, as an embodiment, the vehicle is configured with the device operation information display system and the vehicle-mounted device configured with the same.
As one embodiment, the screen display device is a car machine main screen, a central armrest display screen, a front windshield platform display screen and/or a seat back display screen.
This application can discern user's personal intelligent article, when these intelligent articles border on to some screen display region in addition, can automatic generation equipment operation information, supply the user to know intelligent article and carry out indirect control intelligent article through car machine equipment, increase interactive enjoyment.
It should be noted that the 5G communication/communication network technology of the present embodiment may be a technology oriented to scene, and the application utilizes the 5G technology to play a key supporting role for a vehicle (especially an intelligent internet automobile), and simultaneously implements connection of people, a connection object, or a connection vehicle, and may specifically adopt the following three typical application scenarios.
The first one is eMBB (enhanced Mobile Broadband), which enables the user experience rate to be 0.1-1 gpbs, the peak rate to be 10 gpps and the flow density to be 10Tbps/km2;
for the second ultra-reliable low-delay communication, the main index which can be realized by the method is that the end-to-end time delay is in the ms (millisecond) level; the reliability is close to 100%;
and the third is mMTC (massive machine type communication), and the main index which can be realized by the method is the connection number density, 100 ten thousand other terminals are connected per square kilometer, and the connection number density is 10^6/km2.
Through the mode, the characteristics of the super-reliable of this application utilization 5G technique, low time delay combine for example radar and camera etc. just can provide the ability that shows for the vehicle, can realize interdynamic with the vehicle, utilize the interactive perception function of 5G technique simultaneously, and the user can do an output to external environment, and the unable light can detect the state, can also do some feedbacks etc.. Furthermore, the method and the device can also be applied to cooperation of automatic driving, such as cooperation type collision avoidance and vehicle formation among vehicles, so that the vehicles can be integrally formed and pass, and the passing efficiency is improved.
In addition, the communication enhancement automatic driving perception capability can be achieved by utilizing the 5G technology, and the requirements of passengers in the automobile on vehicle-mounted information entertainment such as AR (augmented reality)/VR (virtual reality), games, movies and mobile offices and high precision can be met. According to the method and the device, the downloading amount of the 3D high-precision positioning map at the centimeter level can be 3-4 Gb/km, the data volume of the map per second under the condition that the speed of a normal vehicle is limited to 120km/h (kilometer per hour) is 90 Mbps-120 Mbps, and meanwhile, the real-time reconstruction of a local map fused with vehicle-mounted sensor information, modeling and analysis of dangerous situations and the like can be supported.
It should be noted that the method and the device can also be applied to an automatic driving layer, can assist in achieving partial intelligent cloud control on urban fixed route vehicles by utilizing a 5G technology, and achieve cloud-based operation optimization and remote display and control under specific conditions on unmanned vehicles in parks and ports.
In the present application, the above-mentioned system and method CAN be used in a vehicle system having a vehicle TBOX, i.e. the vehicle is a vehicle system which CAN have a vehicle TBOX and which CAN be connected to a CAN bus of the vehicle.
In this embodiment, the CAN may include three network channels CAN _1, CAN _2, and CAN _3, and the vehicle may further include one ethernet network channel, where the three CAN network channels may be connected to the ethernet network channel through two car networking gateways, for example, where the CAN _1 network channel includes a hybrid powertrain system, where the CAN _2 network channel includes an operation support system, where the CAN _3 network channel includes an electric dynamometer system, and the ethernet network channel includes a high-level management system, the high-level management system includes a human-vehicle-road simulation system and a comprehensive information collection unit that are connected to the ethernet network channel as nodes, and the car networking gateways of the CAN _1 network channel, the CAN _2 network channel, and the ethernet network channel may be integrated in the comprehensive information collection unit; the car networking gateway of the CAN _3 network channel and the Ethernet network channel CAN be integrated in a man-car-road simulation system.
Further, the nodes connected to the CAN _1 network channel include: the hybrid power system comprises an engine ECU, a motor MCU, a battery BMS, an automatic transmission TCU and a hybrid power controller HCU; the nodes connected with the CAN _2 network channel are as follows: the system comprises a rack measurement and control system, an accelerator sensor group, a power analyzer, an instantaneous oil consumption instrument, a direct-current power supply cabinet, an engine water temperature control system, an engine oil temperature control system, a motor water temperature control system and an engine intercooling temperature control system; the nodes connected with the CAN _3 network channel comprise: electric dynamometer machine controller.
The preferable speed of the CAN _1 network channel is 250Kbps, and a J1939 protocol is adopted; the rate of a CAN _2 network channel is 500Kbps, and a CANopen protocol is adopted; the rate of the CAN _3 network channel is 1Mbps, and a CANopen protocol is adopted; the speed of the Ethernet network channel is 10/100Mbps, and a TCP/IP protocol is adopted.
In this embodiment, the car networking gateway supports a 5G technology V2X car networking network, which may also be equipped with an IEEE802.3 interface, a DSPI interface, an eSCI interface, a CAN interface, an MLB interface, a LIN interface, and/or an I2C interface.
In the embodiment, for example, the IEEE802.3 interface may be used to connect to a wireless router to provide a WIFI network for the entire vehicle; the DSPI (provider manager component) interface is used for connecting a Bluetooth adapter and an NFC (near field communication) adapter and can provide Bluetooth connection and NFC connection; the eSCI interface is used for connecting the 4G/5G module and communicating with the Internet; the CAN interface is used for connecting a vehicle CAN bus; the MLB interface is used for connecting an MOST (media oriented system transmission) bus in the vehicle, and the LIN interface is used for connecting a LIN (local interconnect network) bus in the vehicle; the IC interface is used for connecting a DSRC (dedicated short-range communication) module and a fingerprint identification module. In addition, the MPC5668G chip is adopted to mutually convert different protocols, so that different networks can be fused.
In addition, the vehicle TBOX system, telematics-BOX, of the present embodiment is simply referred to as a vehicle TBOX or a Telematics.
The Telematics is a combination of Telecommunications and information science (information) for remote communications, and is defined as a service system that provides information by a computer system built in a vehicle, a wireless communication technology, a satellite navigation device, and an internet technology for exchanging information such as text and voice. In short, the vehicle is connected to the internet (vehicle networking system) through a wireless network, and various information necessary for driving and life is provided for the vehicle owner.
In addition, telematics is a combination of wireless communication technology, satellite navigation system, network communication technology and vehicle-mounted computer, when a fault occurs during vehicle running, the vehicle is remotely diagnosed by connecting a service center through wireless communication, and the computer built in the engine can record the state of main parts of the vehicle and provide accurate fault position and reason for maintenance personnel at any time. The vehicle can receive information and check traffic maps, road condition introduction, traffic information, safety and public security services, entertainment information services and the like through the user communication terminal, and in addition, the vehicle of the embodiment can be provided with electronic games and network application in a rear seat. It is easy to understand that, this embodiment provides service through Telematics, can make things convenient for the user to know traffic information, the parking stall situation that closes on the parking area, confirms current position, can also be connected with the network server at home, in time knows electrical apparatus running condition, the safety condition and guest's condition of visiting etc. at home.
The vehicle according to this embodiment may further include an Advanced Driver Assistance System (ADAS) that collects environmental data inside and outside the vehicle at the first time using the various sensors mounted on the vehicle, and performs technical processing such as identification, detection, and tracking of static and dynamic objects, so that a Driver can recognize a risk that may occur at the fastest time, thereby attracting attention and improving safety. Correspondingly, the ADAS may also employ sensors such as radar, laser, and ultrasonic sensors, which detect light, heat, pressure, or other variables used to monitor the state of the vehicle, typically located on the front and rear bumpers, side view mirrors, the inside of the steering column, or the windshield of the vehicle. It is obvious that various intelligent hardware used by the ADAS function can be accessed to the V2X car networking network by means of an ethernet link to implement communication connection and interaction.
The host computer of the present embodiment vehicle may comprise suitable logic, circuitry, and/or code that may enable operation and/or functional operation of the five layers above the OSI model (Open System Interconnection, open communication systems Interconnection reference model). Thus, the host may generate and/or process packets for transmission over the network, and may also process packets received from the network. At the same time, the host may provide services to a local user and/or one or more remote users or network nodes by executing corresponding instructions and/or running one or more applications. In various embodiments of the present application, the host may employ one or more security protocols.
In the present application, the network connection used to implement a V2X vehicle networking network may be a switch, which may have AVB functionality (Audio Video brightening, meeting the IEEE802.1 set of standards), and/or include one or more unshielded twisted pair wires, each of which may have an 8P8C module connector.
In a preferred embodiment, the V2X vehicle networking network specifically comprises a vehicle body control module BCM, a power bus P-CAN, a vehicle body bus I-CAN, a combination instrument CMIC, a chassis control device and a vehicle body control device.
In this embodiment, the body control module BCM may integrate the functions of the car networking gateway to perform signal conversion, message forwarding, and the like between different network segments, i.e., between the power bus P-CAN and the body bus I-CAN, for example, if a controller connected to the power bus needs to communicate with a controller connected to the body bus I-CAN, the body control module BCM may perform signal conversion, message forwarding, and the like between the two controllers.
The power bus P-CAN and the vehicle body bus I-CAN are respectively connected with a vehicle body control module BCM.
The combination instrument CMIC is connected with the power bus P-CAN, and the combination instrument CMIC is connected with the vehicle body bus I-CAN. Preferably, the combination meter CMIC of the present embodiment is connected to different buses, such as a power bus P-CAN and a vehicle body bus I-CAN, and when the combination meter CMIC needs to acquire controller information hung on any bus, it is not necessary to perform signal conversion and message forwarding through a vehicle body control module BCM, so that gateway pressure CAN be reduced, network load CAN be reduced, and the speed of acquiring information by the combination meter CMIC CAN be increased.
The chassis control device is connected with the power bus P-CAN. The vehicle body control device is connected with a vehicle body bus I-CAN. In some examples, the chassis control device and the vehicle body control device CAN respectively broadcast data such as information to the power bus P-CAN and the vehicle body bus I-CAN, so that other vehicle-mounted controllers and other devices hung on the power bus P-CAN or the vehicle body bus I-CAN obtain the broadcast information, and communication between the vehicle-mounted devices such as different controllers is realized.
In addition, the V2X car networking network of the vehicle of the embodiment may use two CAN buses, i.e., a power bus P-CAN and a car body bus I-CAN, and use a car body control module BCM as a gateway, and a structure in which the combination meter CMIC is connected to both the power bus P-CAN and the car body bus I-CAN, so that an operation in which information of a chassis control device or a car body control device is forwarded to the combination meter CMIC through the gateway when the combination meter CMIC is hung on one of the two buses in a conventional manner CAN be omitted, thereby reducing the pressure of the car body control module BCM as a gateway, reducing network load, and more conveniently sending information of a plurality of buses, such as vehicle-mounted devices hung on the power bus P-CAN and the car body bus I-CAN, to the combination meter CMIC for display and with strong real-time information transmission.
Finally, specific embodiments of the present application may include the following:
1. the vehicle customer area is provided with an entertainment information integrated screen display area (such as a desktop screen), can also be a large-area central handrail, and has a pressure sensing function;
2. an AI (artificial intelligence) camera capable of identifying objects is arranged in the vehicle;
the implementation principle comprises the following steps:
1. the pressure sensing function of the desktop screen can sense intelligent equipment such as bottom contour characteristics;
2. after receiving the contour feature recognition completion event of the desktop screen, the vehicle control system interacts with the AI camera to recognize the ornament object placed on the desktop screen;
3. the method comprises the following steps that a main control system such as a vehicle-mounted device or an intelligent home is connected with a screen display desktop and a camera, the main control system can establish WIFI or Bluetooth connection with the intelligent device, enumerate and acquire functions or equipment items of the device, and download control menu items, interaction commands and the like of the identified intelligent device from a cloud server through the Internet;
in the specific implementation process, the method comprises the following steps:
1. the vehicle-mounted equipment is added with a function of binding certain intelligent equipment by searching and finding in a wireless mode and visual characteristics of a camera, such as an intelligent Bluetooth sound box, is placed on a desk, identifies the Device-ID of the equipment by finding and identifying the Bluetooth, and establishes a corresponding relation between the visual intelligent equipment and wireless connection by starting the camera to carry out characteristic memory learning;
2. the desktop screen has a pressure sensing function and enters an identification mode; if the intelligent desktop is appointed to be placed on the intelligent desktop in a screen-off state, an object is sensed to be placed on the intelligent desktop, the standing time exceeds 3 seconds, and the intelligent desktop is triggered by a non-human body, the outline characteristics of the general bottom of the object are identified, a main control system is informed to start an AI camera to visually identify the desktop object, and whether the desktop object is a bound wireless device or not is detected;
3. when the vehicle equipment judges that the wireless equipment identifier is bound, and the AI camera recognizes that the visual characteristics of the object placed on the desktop have higher matching approximation with the bound intelligent equipment, the intelligent desktop is informed to acquire the bottom outline and the occupied coordinates of the object;
4. the vehicle-mounted equipment acquires the operating function item and the control interaction command protocol of the intelligent equipment, can acquire a control protocol matched with a specified product model through the cloud server, and can also acquire the control protocol through a method of directly communicating and interacting with the intelligent equipment;
for example, specific embodiments include, but are not limited to, the following:
A. requesting an operation protocol of intelligent equipment of a certain model from a cloud server URL to acquire the following control protocol;
B. the following control protocol is obtained through a preset Bluetooth service port or a network port service of the intelligent device:
specific control protocols include, but are not limited to, the following:
5. and the vehicle equipment performs UI surrounding layout of a control menu according to the placement position and the bottom outline of the intelligent sound box and displays the UI surrounding layout in a screen of a desktop.
6. The desktop screen display detects a control menu click selection event of a user, and optionally, can also support voice recognition to select a certain control menu item;
7. sending an operation code corresponding to the control name of the menu item to the intelligent device, or performing further logic processing, for example, when sending the MP3, selecting a path of the MP3 file, and sending binary data of the MP3 file in a package manner;
8. receiving an operation response sent by the intelligent equipment, judging whether the operation response is successful or not, and correspondingly giving a prompt on the desktop;
9. when the intelligent device is taken up from the desktop, the screen detects the departure of the intelligent device, and an operation menu is automatically cleared.
This embodiment can sense the smart machine who puts it through intelligent screen display desktop to can this smart machine of automatic identification, establish wireless connection automatically, enumerate the operation service function of smart machine at last, and show the operation function interface relevant with this equipment around the desktop that this smart machine placed, provide the mode of visual operation this equipment like this conveniently, improved the intelligent desktop of vehicle and smart machine's operation experience.
Although the present invention has been described with reference to the preferred embodiments, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted for elements thereof without departing from the scope of the present invention.
Claims (10)
1. The utility model provides an equipment operation information display method which characterized in that provides a screen display device, camera and car machine equipment, equipment operation information display method includes:
the screen display device judges whether the intelligent equipment is acquired or not;
if the intelligent equipment is obtained, judging whether the intelligent equipment is adjacent to and/or in contact with a screen display area of a screen display device, wherein the screen display area of the screen display device has a pressure sensing function;
if the intelligent equipment is adjacent to and/or in contact with a screen display area of a screen display device, the camera acquires feature mark information of the intelligent equipment;
the vehicle-mounted equipment loads equipment operation information for controlling the intelligent equipment according to the feature mark information;
and sending the equipment operation information to the screen display area for display, wherein the equipment operation information surrounds the intelligent equipment for distributed display so as to be operated by a user.
2. The device operation information display method according to claim 1, wherein the step of the screen display device determining whether the smart device is acquired further comprises:
the vehicle-mounted equipment searches for the intelligent equipment in a Bluetooth mode;
and if the intelligent equipment is searched, acquiring the equipment ID of the intelligent equipment, and judging whether the intelligent equipment is the intelligent equipment or not according to the acquired equipment ID.
3. The device operation information display method according to claim 2, wherein the in-vehicle device starts a vehicle-mounted camera to identify the smart device, so as to obtain the feature tag information of the smart device.
4. The device operation information display method according to claim 3, wherein the step of loading, by the in-vehicle device, device operation information for controlling the smart device according to the feature tag information specifically includes:
the vehicle-mounted equipment judges whether the intelligent equipment is bound or not according to the feature mark information;
and if the intelligent device is the bound intelligent device, locally loading corresponding device operation information from the vehicle-mounted device.
5. The device operation information display method according to claim 4, wherein if the device operation information is an unbound intelligent device, the in-vehicle device loads corresponding device operation information from the cloud server according to the feature tag information.
6. The device operation information display method according to claim 4 or 5, wherein the in-vehicle device loads the corresponding device operation information, and specifically comprises:
the vehicle-mounted equipment acquires operation function items of the intelligent equipment and a control interaction command protocol corresponding to the operation function items, wherein the operation function items comprise an up, a down, a left, a right, a confirmation, a previous, a next, a play, a pause, a volume +, a volume-and/or a sending share.
7. The method according to claim 1, wherein after the step of sending the device operation information to the on-screen display area for display, the method further comprises:
the vehicle-mounted equipment judges whether the operation voice of the user is received or not;
and if receiving the operation voice of the user, analyzing an operation instruction corresponding to the operation voice, and sending the operation instruction to the intelligent equipment so that the intelligent equipment executes corresponding response operation.
8. An equipment operation information display system is characterized by being provided with a screen display device, a camera and a car machine equipment, wherein the car machine equipment comprises a memory and a processor, the memory stores a computer program, and the processor is used for executing the computer program so as to realize the equipment operation information display method according to any one of claims 1-7.
9. A vehicle characterized in that the vehicle is equipped with the apparatus operation information display system according to claim 8.
10. The vehicle of claim 9, wherein the screen display device is an on-board home screen, a center armrest display screen, a front windshield platform display screen, and/or a seatback display screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811544817.XA CN111328042B (en) | 2018-12-17 | 2018-12-17 | Vehicle and equipment operation information display method and system thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811544817.XA CN111328042B (en) | 2018-12-17 | 2018-12-17 | Vehicle and equipment operation information display method and system thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111328042A CN111328042A (en) | 2020-06-23 |
| CN111328042B true CN111328042B (en) | 2022-12-27 |
Family
ID=71168519
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811544817.XA Active CN111328042B (en) | 2018-12-17 | 2018-12-17 | Vehicle and equipment operation information display method and system thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111328042B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112153522A (en) * | 2020-09-09 | 2020-12-29 | 上海仙塔智能科技有限公司 | Vehicle-mounted sound box control system and vehicle-mounted sound box |
| CN112153521B (en) * | 2020-09-09 | 2023-01-24 | 上海仙塔智能科技有限公司 | Vehicle-mounted sound box control system and vehicle-mounted sound box |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103023964A (en) * | 2012-10-31 | 2013-04-03 | 惠州市德赛西威汽车电子有限公司 | Vehicle-mounted information sharing entertainment system |
| CN203135997U (en) * | 2013-02-22 | 2013-08-14 | 吴澎 | Vehicle information entertainment system having smartphone connecting function |
| CN103546422A (en) * | 2012-07-10 | 2014-01-29 | 比亚迪股份有限公司 | Vehicular screen multiplexing system, application method thereof and multimedia interaction system |
| CN103685573A (en) * | 2013-12-31 | 2014-03-26 | 东风汽车有限公司 | Interaction system used between automobile and intelligent terminal |
| CN204272099U (en) * | 2014-05-06 | 2015-04-15 | 上海通用汽车有限公司 | On-board multimedia device and vehicle mounted multimedia communication system |
| CN104655146A (en) * | 2015-02-11 | 2015-05-27 | 北京远特科技有限公司 | Method and system for navigation or communication in vehicle |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105912100A (en) * | 2016-03-31 | 2016-08-31 | 智车优行科技（北京）有限公司 | Screensaver lifting device, screensaver lifting method and vehicle |
| CN106341780A (en) * | 2016-09-22 | 2017-01-18 | 深圳市优程科技有限公司 | Intelligent terminal remote control system and method based on vehicle-mounted Bluetooth |
| CN106873765B (en) * | 2016-12-27 | 2018-09-11 | 比亚迪股份有限公司 | The switching method and apparatus of the screen state of car-mounted terminal |
-
2018
- 2018-12-17 CN CN201811544817.XA patent/CN111328042B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103546422A (en) * | 2012-07-10 | 2014-01-29 | 比亚迪股份有限公司 | Vehicular screen multiplexing system, application method thereof and multimedia interaction system |
| CN103023964A (en) * | 2012-10-31 | 2013-04-03 | 惠州市德赛西威汽车电子有限公司 | Vehicle-mounted information sharing entertainment system |
| CN203135997U (en) * | 2013-02-22 | 2013-08-14 | 吴澎 | Vehicle information entertainment system having smartphone connecting function |
| CN103685573A (en) * | 2013-12-31 | 2014-03-26 | 东风汽车有限公司 | Interaction system used between automobile and intelligent terminal |
| CN204272099U (en) * | 2014-05-06 | 2015-04-15 | 上海通用汽车有限公司 | On-board multimedia device and vehicle mounted multimedia communication system |
| CN104655146A (en) * | 2015-02-11 | 2015-05-27 | 北京远特科技有限公司 | Method and system for navigation or communication in vehicle |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111328042A (en) | 2020-06-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110798658A (en) | Remote vehicle moving control method, mobile terminal and vehicle | |
| CN108833589B (en) | Vehicle, vehicle equipment and vehicle equipment navigation data synchronization method thereof | |
| CN109115236A (en) | Vehicle, vehicle device equipment and its stroke automatic navigation method based on condition triggering | |
| CN110958559B (en) | Vehicle, vehicle-mounted equipment and instant interaction method based on map display | |
| CN109115235A (en) | Vehicle, vehicle device equipment, user communication terminal and its more equipment switch air navigation aid | |
| CN110793537A (en) | Navigation path recommendation method, vehicle machine and vehicle | |
| CN110654331A (en) | Vehicle, vehicle equipment and vehicle-mounted assistant interaction method thereof | |
| CN111328042B (en) | Vehicle and equipment operation information display method and system thereof | |
| CN110954117A (en) | Vehicle, navigation travel service pushing method thereof and cloud server | |
| CN111204300A (en) | Vehicle, vehicle equipment and display element color setting method | |
| CN110920388A (en) | Vehicle, vehicle equipment and vehicle equipment style adjusting method based on environmental factors | |
| CN111284325B (en) | Vehicle, vehicle equipment and vehicle along-the-road object detailed information display method thereof | |
| CN110871810A (en) | Vehicle, vehicle equipment and driving information prompting method based on driving mode | |
| CN111688488A (en) | Vehicle, vehicle machine equipment and virtual scene control method thereof | |
| CN111660965A (en) | Vehicle and intelligent steering wheel adjusting method and device based on seat adjustment | |
| CN109131159A (en) | Vehicle, vehicle device equipment and its optimization air navigation aid based on new energy | |
| CN111291275A (en) | Vehicle, vehicle equipment and live-based tour scheme recommendation method thereof | |
| CN108874221A (en) | The application control method of vehicle and its car-mounted terminal touch-control system | |
| CN111026475A (en) | Vehicle, vehicle equipment and vehicle service processing method based on map software | |
| CN111289009A (en) | Vehicle, vehicle equipment and vehicle equipment interest point input searching method thereof | |
| CN111291142A (en) | Vehicle, vehicle equipment and personalized vehicle equipment interest point searching and displaying method thereof | |
| CN111619348A (en) | Vehicle, vehicle equipment and display control method based on instrument panel | |
| CN108983773A (en) | Vehicle, vehicle device equipment, user communication terminal and its stroke automatic planning | |
| CN111210541A (en) | Vehicle, vehicle equipment and intelligent speed limit information prompting method | |
| CN111092920B (en) | Vehicle, vehicle equipment and vehicle matching business service method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Room 208, building 4, 1411 Yecheng Road, Jiading District, Shanghai, 201821 Applicant after: Botai vehicle networking technology (Shanghai) Co.,Ltd. Address before: Room 208, building 4, 1411 Yecheng Road, Jiading District, Shanghai, 201821 Applicant before: SHANGHAI PATEO ELECTRONIC EQUIPMENT MANUFACTURING Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |