CN110880254B

CN110880254B - In-vehicle distance education method, in-vehicle distance education system and vehicle

Info

Publication number: CN110880254B
Application number: CN201811033831.3A
Authority: CN
Inventors: 吴锦冠
Original assignee: Shanghai Pateo Network Technology Service Co Ltd
Current assignee: Shanghai Pateo Network Technology Service Co Ltd
Priority date: 2018-09-05
Filing date: 2018-09-05
Publication date: 2022-11-25
Anticipated expiration: 2038-09-05
Also published as: CN110880254A

Abstract

The invention provides an in-vehicle distance education method, an in-vehicle distance education system and a vehicle, wherein the in-vehicle distance education method is applied between AR equipment and a cloud server, the AR equipment and the cloud server are both connected with a high-speed communication network, and the in-vehicle distance education method comprises the following steps: the AR equipment automatically identifies static objects outside the vehicle and sends the static objects to a cloud server in real time; the cloud server obtains dynamic story information processed according to the static object and returns the dynamic story information to the AR equipment in real time; the AR device superimposes the dynamic story information into the static object. The in-vehicle distance education method, the in-vehicle distance education system and the vehicle can draw a vivid and lovely story outside the vehicle to the child by using the AR device in the driving process, improve the attention of the child and achieve good experience of educating the child.

Description

In-vehicle distance education method, in-vehicle distance education system and vehicle

Technical Field

The invention relates to the technical field of remote education, in particular to an in-vehicle remote education method, an in-vehicle remote education system and a vehicle.

Background

With the rapid development of society and economy, the social activity range of people is greatly expanded, and parents usually use a coach with a child to travel for playing in a rest time to accompany the child.

However, in the long-time driving process, the attention of the children is lower, the children often show dysphoria and uninteresting, and even cry and screaming ceaselessly due to staying in the vehicle for a long time sometimes, and the traveling mood is affected. At this time, the problem of how to educate children well during the long-distance driving process so as to cultivate the attention of children is always troubling many parents.

In response to the above problems, those skilled in the art have sought solutions.

Disclosure of Invention

In view of the above, the invention provides an in-vehicle distance education method, an in-vehicle distance education system and a vehicle, which can draw a vivid and lovely story outside a vehicle to a child by using an AR device in a driving process, improve the attention of the child and achieve good experience of educating the child.

The invention provides an in-vehicle distance education method, which is applied between AR equipment and a cloud server, wherein the AR equipment and the cloud server are both connected with a high-speed communication network, and the in-vehicle distance education method comprises the following steps: the AR equipment automatically identifies static objects outside the vehicle and sends the static objects to a cloud server in real time; the cloud server obtains dynamic story information processed according to the static object and returns the dynamic story information to the AR equipment in real time; the AR device superimposes the dynamic story information into the static object.

Specifically, the steps of the cloud server acquiring dynamic story information processed according to the static object and returning the dynamic story information to the AR device in real time include: analyzing the static object to obtain a basic form corresponding to the static object; acquiring dynamic story data matched with the basic form; and processing the dynamic story data and the basic form to obtain the dynamic story information, and returning the dynamic story information to the AR equipment in real time.

Specifically, the step of acquiring dynamic story data matched with the basic form comprises: taking the basic form as a parameter to carry out automatic editing processing to obtain a dynamic effect; and acquiring dynamic story data matched with the dynamic effect.

Specifically, the high-speed communication network is a 5G communication network.

The present invention also provides an in-vehicle distance education system including: the system comprises an AR device and a cloud server, wherein the AR device and the cloud server are both connected with a high-speed communication network; the AR equipment is used for automatically identifying static objects outside the vehicle and sending the static objects to the cloud server in real time; the cloud server is used for acquiring dynamic story information processed according to the static object and returning the dynamic story information to the AR equipment in real time; the AR device is further configured to superimpose the dynamic story information into the static object.

Specifically, the cloud server includes: a memory for storing executable program code; and a processor, configured to invoke the executable program code in the memory, so as to implement the steps of obtaining dynamic story information processed according to the static object, and returning the dynamic story information to the AR device in real time, including: analyzing the static object to obtain a basic form corresponding to the static object; acquiring dynamic story data matched with the basic form; and processing the dynamic story data and the basic form to obtain the dynamic story information, and returning the dynamic story information to the AR equipment in real time.

Specifically, the processor, executing the step of acquiring dynamic story data matched with the basic form, includes: taking the basic form as a parameter to carry out automatic editing processing to obtain a dynamic effect; and acquiring dynamic story data matched with the dynamic effect.

The invention also provides a vehicle comprising the in-vehicle distance education system.

Specifically, the in-vehicle distance education method, in-vehicle distance education system and vehicle that this embodiment provided, follow children's eyeball through AR equipment and automatically identify the outside static object of vehicle, and send static object to cloud server in real time, cloud server acquires and handles according to static object and obtains dynamic story information, and return dynamic story information back to AR equipment in real time, so that AR equipment superposes dynamic story information to static object in, thereby can utilize AR equipment to depict the outer vivid lovely story of car to children at the driving in-process, promote children's attention, reach good education children's experience.

The foregoing description is only an overview of the technical solutions of the present invention, and in order to make the technical means of the present invention more clearly understood, the present invention may be implemented in accordance with the content of the description, and in order to make the above and other objects, features, and advantages of the present invention more clearly understood, the following preferred embodiments are described in detail with reference to the accompanying drawings.

Drawings

Fig. 1 is a schematic flowchart of an in-vehicle distance education method according to a first embodiment of the present invention;

fig. 2 is a flowchart illustrating an in-vehicle distance education method according to a second embodiment of the present invention;

fig. 3 is a flowchart illustrating a remote education method in a vehicle according to a third embodiment of the present invention;

fig. 4 is a block diagram illustrating the construction of an in-vehicle distance education system according to a fourth embodiment of the present invention;

fig. 5 is a block diagram of the cloud server in fig. 4;

fig. 6 is a block diagram of a vehicle according to a fifth embodiment of the invention.

Detailed Description

To further explain the technical means and effects of the present invention adopted to achieve the predetermined objects, the present invention will be described in detail below with reference to the accompanying drawings and preferred embodiments.

Fig. 1 is a flowchart illustrating an in-vehicle distance education method according to a first embodiment of the present invention. The embodiment is an in-vehicle distance education method executed by an AR device and a cloud server. Specifically, the AR device and the cloud server are both connected to a high-speed communication network, so as to realize high-speed data information transmission between the AR device and the cloud server. As shown in fig. 1, the in-vehicle distance education method of the present embodiment may include the steps of:

step S11: the AR device automatically identifies static objects outside the vehicle and sends the static objects to the cloud server in real time.

In particular, in an embodiment, the AR device may be, but is not limited to, AR glasses, for example, the AR device may also be a Halo holographic helmet, and the like. Specifically, a child in the vehicle looks outside the vehicle by wearing the AR device, and at this time, the AR device captures a picture outside the vehicle following the eyeball of the child, and automatically recognizes a static object outside the vehicle. Specifically, in one embodiment, the static objects may be, but are not limited to, roads, floors, billboards, trees, mountains, lakes, and the like. And the AR equipment uploads the static object to the cloud server in real time through the high-speed communication network.

Specifically, in an embodiment, the high-speed communication network may be, but is not limited to, a 5G communication network, for example, in other embodiments, the high-speed communication network may also be a communication network with a higher transmission rate than the 5G communication network, so as to implement low latency of data transmission between the AR device and the cloud server, and improve user experience.

Step S12: and the cloud server acquires dynamic story information processed according to the static object and returns the dynamic story information to the AR equipment in real time.

Specifically, in an embodiment, the cloud server receives a static object uploaded by the AR device in real time, and stores the static object in an education information list corresponding to the AR device. Specifically, the cloud server further analyzes and processes the static object in real time to obtain dynamic story information of a story matched with the static object, for example, when the static object identified by the AR device is a road, an animal or a robot running on the road is obtained, and when the static object identified by the AR device is a sky, an animal or a machine flying in the sky or a universe cloud picture and the like are obtained, so that eyeballs of children can be attracted, thinking of the children is expanded, and an effect of teaching the children is achieved. Specifically, the cloud server returns the obtained dynamic accident information to the AR equipment corresponding to the static object in the education information list in real time.

Step S13: the AR device superimposes the dynamic story information into the static object.

Specifically, in an embodiment, the AR device receives the dynamic story information returned by the cloud server in real time, and superimposes the received dynamic story information onto a static object, so that the education information is superimposed onto a real object, the interest in learning is improved, and the education efficiency is improved.

Referring to fig. 2, fig. 2 is a flowchart illustrating an in-vehicle distance education method according to a second embodiment of the present invention. The embodiment is an in-vehicle distance education method executed by a vehicle machine. As shown in fig. 1 and 2, in the in-vehicle distance education method according to the embodiment, the step of acquiring the dynamic story information by the cloud server according to the static object processing, and returning the dynamic story information to the AR device in real time includes the following steps:

step S21: and analyzing the static object to obtain a basic form corresponding to the static object.

Specifically, in one embodiment, the basic form of the static object may be, but is not limited to, a building object, a natural object, a road, a tunnel, etc., such as a floor, a hill, a lawn, a tree, a lake, the sky, a road, a tunnel, etc. Specifically, the cloud server analyzes the static object in the image information to obtain a basic form corresponding to the static object.

Step S22: dynamic story data matching the base form is obtained.

Specifically, in an embodiment, the cloud server obtains dynamic story data matched with the basic form, for example, when the basic form of the static object is a floor, obtains a name, a location, a height of the floor, historical information of the floor, and the like corresponding to the floor. For example, when the basic form of the static object is a hill, a plurality of animals corresponding to the hill, for example, dinosaurs, are obtained to run on the hill. Specifically, the high in the clouds server obtains the speed of a vehicle that corresponds with this AR equipment to set up the speed that the animal ran according to the speed of a vehicle, thereby can demonstrate the animal vividly to children in the car and run, chase the situation of chasing at hillside or meadow, attract children's attention, promote the experience of education.

Step S23: and processing the dynamic story data and the basic form to obtain dynamic story information, and returning the dynamic story information to the AR equipment in real time.

Specifically, in one embodiment, the cloud server processes the dynamic story data and the basic form to obtain dynamic story information, and returns the dynamic story information to the AR device in real time. Specifically, the cloud server further obtains the distance and the direction of the AR device from the static object, and obtains the moving direction and the moving speed of the AR device. Specifically, in an embodiment, the cloud server processes the basic form of the static object, the distance and the orientation of the AR device from the static object, and the moving direction and the moving speed of the AR device to accurately obtain the dynamic story data of the corresponding story. Specifically, the cloud server calibrates the acquired dynamic story data on a corresponding label of the basic form of the static object to obtain dynamic story information. The cloud server returns the dynamic story information to the AR equipment in real time, so that the AR equipment can stack the received dynamic story information to the static object in real time, education of children is realized, and education experience is improved.

Referring to fig. 3, fig. 3 is a flowchart illustrating a remote education method in a vehicle according to a third embodiment of the present invention. As shown in fig. 2 and 3, the step of acquiring dynamic story data matched with the basic form in the in-vehicle distance education method of the embodiment specifically includes the following steps:

step S31: and automatically editing the basic form as a parameter to obtain a dynamic effect.

Specifically, in an embodiment, the cloud server performs automatic editing processing on the basic form of the static object as a parameter to obtain a dynamic effect corresponding to the static object.

Step S32: and acquiring dynamic story data matched with the dynamic effect.

Specifically, in an embodiment, the cloud server may but not limited to obtain dynamic story data matched with the dynamic effect from the 3D animation story database, so that when the AR device superimposes the dynamic story data on a static object, a vivid and lovely story is generated, the attention of children is attracted, the attention of children is trained, and the educational experience is improved.

Referring to fig. 4, fig. 4 is a block diagram illustrating a remote education system 100 in a vehicle according to a fourth embodiment of the present invention. As shown in fig. 4, the in-vehicle distance education system 100 provided in the present embodiment includes an AR device 10 and a cloud server 20. Specifically, in this embodiment, the AR device 10 and the cloud server 20 are both connected to a high-speed communication network.

Specifically, in one embodiment, the AR device 10 is configured to automatically identify static objects outside the vehicle and send the static objects to the cloud server 20 in real time. The cloud server 20 is configured to obtain the dynamic story information processed according to the static object, and return the dynamic story information to the AR device 10 in real time. The AR device 10 is also used to superimpose dynamic story information into static objects.

Referring to fig. 5, fig. 5 is a block diagram of the cloud server 20 in fig. 4. As shown in fig. 4 and fig. 5, in the embodiment, specifically, the cloud server 20 includes a memory 21 and a processor 22.

In particular, in one embodiment, memory 21 is used to store executable program code. The processor 22 is configured to call the executable program code in the memory 21 to implement the steps of obtaining dynamic story information processed from the static objects and returning the dynamic story information to the AR device 10 in real time, including: analyzing the static object to obtain a basic form corresponding to the static object; acquiring dynamic story data matched with the basic form; the dynamic story data and the basic form are processed to obtain dynamic story information, and the dynamic story information is returned to the AR device 10 in real time.

Specifically, in one embodiment, processor 22, performing the step of obtaining dynamic story data that matches the base form includes: the basic form is used as a parameter to carry out automatic editing processing to obtain a dynamic effect; and acquiring dynamic story data matched with the dynamic effect.

In particular, in one embodiment, the high-speed communication network may be, but is not limited to, a 5G communication network. For example, in other embodiments, the high-speed communication network may also be a communication network with a higher transmission rate than the 5G communication network, so as to achieve low latency of data transmission between the AR device 10 and the cloud server 20, and improve user experience.

For the specific process of implementing each function of each functional unit of the in-vehicle distance education system 100, please refer to the specific contents described in the embodiments shown in fig. 1 to fig. 3, which will not be described herein again.

Referring to fig. 6, fig. 6 is a block diagram of a vehicle 200 according to a fifth embodiment of the invention. As shown in fig. 6, the present embodiment provides a vehicle 200 including an in-vehicle distance education system 210. Specifically, please refer to the description of the in-vehicle distance education system 100 in the embodiment shown in fig. 5 for the specific structure of the in-vehicle distance education system 210, which will not be described herein.

It should be noted that, the AR device, the cloud server, the car machine, and the vehicle in each of the above embodiments may all adopt a 5G technology, for example, a 5G communication network is used to implement network connection with each other, the 5G technology adopted in this embodiment may be a technology oriented to scenization, the application plays a key supporting role in the vehicle by using the 5G technology, and simultaneously implements a connection person, a connection object, or a connection vehicle, and may specifically adopt the following three typical application scenarios.

The first is eMBB (enhanced Mobile Broadband), which enables the user experience rate to be 0.1-1 gpbs, the peak rate to be 10 gpbs and the flow density to be 10Tbps/km2;

for the second ultra-reliable low-delay communication, the main index which can be realized by the method is that the end-to-end time delay is in the ms (millisecond) level; the reliability is close to 100%;

the third is mMTC (massive machine type communication), and the main index which can be realized by the method is the connection number density, 100 ten thousand other terminals are connected per square kilometer, and the number is 10^6/km2.

Through the mode, the characteristics of the super-reliable of this application utilization 5G technique, low time delay combine for example radar and camera etc. just can provide the ability that shows for the vehicle, can realize interdynamic with the vehicle, utilize the interactive perception function of 5G technique simultaneously, and the user can do an output to external environment, and the unable light can detect the state, can also do some feedbacks etc..

In addition, the communication enhanced automatic driving perception capability can be realized by utilizing the 5G technology, and the requirements of in-vehicle passengers on AR (augmented reality)/VR (virtual reality), games, movies, mobile office and other in-vehicle infotainment and high precision can be met. According to the method and the device, the downloading amount of the 3D high-precision positioning map at the centimeter level can be 3-4 Gb/km, the data volume of the map per second under the condition that the speed of a normal vehicle is limited to 120km/h (kilometer per hour) is 90 Mbps-120 Mbps, and meanwhile, the real-time reconstruction of a local map fused with vehicle-mounted sensor information, modeling and analysis of dangerous situations and the like can be supported.

In the present application, the vehicle machine CAN be used in a vehicle system with a vehicle TBOX, and CAN be connected to a CAN bus of the vehicle.

In this embodiment, the CAN may include three network channels CAN _1, CAN _2, and CAN _3, and the vehicle may further include one ethernet network channel, where the three CAN network channels may be connected to the ethernet network channel through two car networking gateways, for example, where the CAN _1 network channel includes a hybrid powertrain system, where the CAN _2 network channel includes an operation support system, where the CAN _3 network channel includes an electric dynamometer system, and the ethernet network channel includes a high level management system, where the high level management system includes a human-vehicle-road simulation system and a comprehensive information collection unit connected as nodes on the ethernet network channel, and the car networking gateways of the CAN _1 network channel, the CAN _2 network channel, and the ethernet network channel may be integrated in the comprehensive information collection unit; the car networking gateway of the CAN _3 network channel and the Ethernet network channel CAN be integrated in a man-car-road simulation system.

Further, the nodes connected to the CAN _1 network channel include: the hybrid power system comprises an engine ECU, a motor MCU, a battery BMS, an automatic transmission TCU and a hybrid power controller HCU; the nodes connected with the CAN _2 network channel are as follows: the system comprises a rack measurement and control system, an accelerator sensor group, a power analyzer, an instantaneous oil consumption instrument, a direct-current power supply cabinet, an engine water temperature control system, an engine oil temperature control system, a motor water temperature control system and an engine intercooling temperature control system; the nodes connected with the CAN _3 network channel comprise: electric dynamometer machine controller.

The speed of the preferable CAN _1 network channel is 250Kbps, and a J1939 protocol is adopted; the rate of the CAN _2 network channel is 500Kbps, and a CANopen protocol is adopted; the rate of the CAN _3 network channel is 1Mbps, and a CANopen protocol is adopted; the rate of the Ethernet network channel is 10/100Mbps, and a TCP/IP protocol is adopted.

In this embodiment, the car networking gateway supports a 5G network of 5G technology, which may also be equipped with an IEEE802.3 interface, a DSPI interface, an eSCI interface, a CAN interface, an MLB interface, a LIN interface, and/or an I2C interface.

In this embodiment, for example, the IEEE802.3 interface may be used to connect to a wireless router to provide a WIFI network for the entire vehicle; the DSPI (provider manager component) interface is used for connecting a Bluetooth adapter and an NFC (near field communication) adapter and can provide Bluetooth connection and NFC connection; the eSCI interface is used for connecting the 4G/5G module and communicating with the Internet; the CAN interface is used for connecting a vehicle CAN bus; the MLB interface is used for connecting an MOST (media oriented system transmission) bus in a vehicle, and the LIN interface is used for connecting a LIN (local interconnect network) bus in the vehicle; the IC interface is used for connecting a DSRC (dedicated short-range communication) module and a fingerprint identification module. In addition, the MPC5668G chip is adopted to carry out mutual conversion on different protocols, so that different networks are fused.

In addition, the vehicle TBOX system (Telematics-BOX) of the present embodiment is simply referred to as an on-vehicle TBOX or Telematics on-vehicle processor 22.

The Telematics is a combination of Telecommunications and information science (information) for remote communications, and is defined as a service system that provides information by a computer system built in a vehicle, a wireless communication technology, a satellite navigation device, and an internet technology for exchanging information such as text and voice. In short, the vehicle is connected to the internet (vehicle networking system) through a wireless network, and various information necessary for driving and life is provided for the vehicle owner.

In addition, telematics is the integration of wireless communication technology, satellite navigation system, network communication technology and on-board computer, when a fault occurs during vehicle running, the cloud server is connected through wireless communication to perform remote vehicle diagnosis, and the computer built in the engine can record the state of the main components of the vehicle and provide accurate fault position and reason for maintenance personnel at any time. The vehicle can receive information and check traffic maps, road condition introduction, traffic information, safety and public security services, entertainment information services and the like through the user communication terminal, and in addition, the vehicle of the embodiment can be provided with electronic games and network application in a rear seat. It is easy to understand that, this embodiment provides service through Telematics, can make things convenient for the user to know traffic information, the parking stall situation that closes on the parking area, confirms current position, can also be connected with the network server at home, in time knows electrical apparatus running condition, the safety condition and guest's condition of visiting etc. at home.

The vehicle according to this embodiment may further include an Advanced Driver Assistance System (ADAS) that collects environmental data inside and outside the vehicle at the first time using the various sensors mounted on the vehicle, and performs technical processing such as identification, detection, and tracking of static and dynamic objects, so that a Driver can recognize a risk that may occur at the fastest time, thereby attracting attention and improving safety. Correspondingly, the ADAS of the present application may also employ sensors such as radar, laser, and ultrasonic sensors, which can detect light, heat, pressure, or other variables for monitoring the state of the vehicle, and are usually located on the front and rear bumpers, side view mirrors, the inside of the steering column, or on the windshield of the vehicle. It is obvious that various intelligent hardware used by the ADAS function can be accessed to the car networking system by means of an ethernet link to realize communication connection and interaction.

The host computer of the present embodiment vehicle may comprise suitable logic, circuitry, and/or code that may enable operation and/or functional operation of the five layers above the OSI model (Open System Interconnection, open communication systems Interconnection reference model). Thus, the host may generate and/or process packets for transmission over the network, and may also process packets received from the network. At the same time, the host may provide services to a local user and/or one or more remote users or network nodes by executing corresponding instructions and/or running one or more applications. In various embodiments of the present application, the host may employ one or more security protocols.

In addition, an embodiment of the present invention further provides a computer-readable storage medium, in which computer-executable instructions are stored, where the computer-readable storage medium is, for example, a non-volatile memory such as an optical disc, a hard disc, or a flash memory. The computer-executable instructions are for causing a computer or similar computing device to perform various operations of the in-vehicle distance education method described above.

It should be noted that, in the present specification, the embodiments are all described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other. For the terminal class embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for relevant points, reference may be made to part of the description of the method embodiment.

Claims

1. An in-vehicle distance education method applied between an AR device and a cloud server, wherein the AR device and the cloud server are both connected with a high-speed communication network, and the in-vehicle distance education method comprises the following steps:

the AR equipment automatically identifies static objects outside the vehicle and sends the static objects to a cloud server in real time;

the cloud server analyzes the static object to obtain a basic form corresponding to the static object;

taking the basic form as a parameter to carry out automatic editing processing to obtain a dynamic effect;

acquiring dynamic story data matched with the dynamic effect;

processing the dynamic story data and the basic form to obtain the dynamic story information, and returning the dynamic story information to the AR equipment in real time;

the AR device superimposes the dynamic story information into the static object.

2. The in-vehicle distance education method according to claim 1, wherein the high-speed communication network is a 5G communication network.

3. An in-vehicle distance education system, characterized in that the in-vehicle distance education system comprises: the system comprises an AR device and a cloud server, wherein the AR device and the cloud server are both connected with a high-speed communication network;

the AR equipment is used for automatically identifying static objects outside the vehicle and sending the static objects to the cloud server in real time;

the cloud server comprises: a memory for storing executable program code; the processor is used for calling the executable program code in the memory to analyze the static object to obtain a basic form corresponding to the static object, automatically editing and processing the basic form as a parameter to obtain a dynamic effect, acquiring dynamic story data matched with the dynamic effect, processing the dynamic story data and the basic form to obtain the dynamic story information, and returning the dynamic story information to the AR device in real time;

the AR device is further configured to superimpose the dynamic story information into the static object.

4. The in-vehicle distance education system of claim 3 wherein the high speed communication network is a 5G communication network.

5. A vehicle characterized in that the vehicle includes the in-vehicle distance education system according to any one of claims 3 to 4.