CN113014849A - Driving training video call system and method based on Web RTC - Google Patents
Driving training video call system and method based on Web RTC Download PDFInfo
- Publication number
- CN113014849A CN113014849A CN202110203053.3A CN202110203053A CN113014849A CN 113014849 A CN113014849 A CN 113014849A CN 202110203053 A CN202110203053 A CN 202110203053A CN 113014849 A CN113014849 A CN 113014849A
- Authority
- CN
- China
- Prior art keywords
- student
- coach
- rtc
- module
- socket
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
- H04L69/161—Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields
- H04L69/162—Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields involving adaptations of sockets based mechanisms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Security & Cryptography (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a driving training video call system and method based on a Web RTC (real time clock), wherein the driving training video call system based on the Web RTC comprises the following components: the student communication system comprises a coach end, a student end, a socket server end and an RTC server end, wherein the student end comprises a socket module, an RTC module and a help seeking module, the coach end comprises the socket module, the RTC module, the student display module and a request display module, and one coach end corresponds to one or more student ends. The invention realizes the online video call between the coach and the student, enables the coach to know the real-time in-car and out-car states, correctly reflects the driving condition of the student and improves the driving training efficiency.
Description
Technical Field
The application belongs to the technical field of driving training, and particularly relates to a driving training video call system and method based on a Web RTC.
Background
The traditional training mode of driving school mostly adopts the mode that a coach sits on a copilot and guides a driver seat student to operate a vehicle according to the correct steps on site. However, the face-to-face teaching mode is easy to cause psychological burden to students and is also easy to cause the emotion of coaches to be difficult to stabilize.
In order to get rid of the problems caused by the face-to-face teaching mode, the driving training is gradually developed into a mode of guiding a student and a coach not to directly participate in teaching by a driving training robot (software) installed in a vehicle along with the development of computer software and related hardware to replace the traditional teaching mode. The novel training mode smoothes the differences of different teaching modes brought by different coaches through standardized teaching, and enables students to keep relaxed and pleasant moods in the training process. When the trainee needs to turn to the coach for further manual instruction, a system which can enable the coach to easily participate in the video call with the trainee and can know the real-time state inside and outside the vehicle so as to conveniently instruct the trainee is needed.
At present, a common driving training robot communication method mainly utilizes various network cameras provided by third-party manufacturers to carry out audio and video communication. This approach has several disadvantages: 1. the cost problem is as follows: at present, a mainstream network camera manufacturer provides local installation service, and audio and video service provided by the manufacturer is installed in a local project, which needs professional personnel of the manufacturer to install and maintain and is expensive; 2. network problem: mainstream network camera manufacturers also provide cloud video services, which require that network camera equipment is connected to the internet, and a local platform acquires streams through internet addresses, wherein certain equipment is not allowed to be connected to the internet and can only run in a driving school of a local area network and cannot be used; 3. the time delay problem is as follows: the prior network camera has the problems of low transmission rate, high time delay and the like.
Disclosure of Invention
The application aims to provide a driving training video call system and method based on a Web RTC (real time clock), so that online video call between a coach and a student is realized, the coach can know real-time in-vehicle and out-vehicle states, the driving condition of the student is correctly reflected, and the driving training efficiency is improved.
In order to achieve the purpose, the technical scheme adopted by the application is as follows:
a Web RTC-based driving training video call system comprises: coach end, student end, socket service end and RTC service end, the student end includes socket module, RTC module and seeks help the module, the coach end includes socket module, RTC module, student display module and request display module, and a coach end corresponds one or more student end, wherein:
the help seeking module is used for initiating a student call request under the trigger of the student;
the request display module is used for displaying a student list of the current request for communication, and agreeing or refusing the student communication request of the specified student under the trigger of a coach;
the trainee display module is used for displaying information of all trainee ends corresponding to the coach end and initiating a coach call request to the appointed trainee end under the trigger of the coach;
the socket server is used for establishing socket connection between a socket module of the coach end and a socket module of the appointed student end when the coach agrees with the student call request or the coach end initiates the coach call request;
the RTC server is used for establishing RTC connection between the RTC module of the coach end and the RTC module of the appointed student end after the socket connection is successfully established at the socket server, and establishing point-to-point video call between the coach end and the appointed student end after the RTC connection is successfully established.
Several alternatives are provided below, but not as an additional limitation to the above general solution, but merely as a further addition or preference, each alternative being combinable individually for the above general solution or among several alternatives without technical or logical contradictions.
Preferably, the driving training video call system based on the Web RTC further comprises an API server;
the API server is used for receiving the student call requests sent by the socket server and sequencing the existing student call requests according to a preset priority to obtain a priority queue; and the device is also used for returning a priority queue to the request display module as a latest student list requesting for conversation after receiving a query request sent by the request display module of the coach terminal.
Preferably, the student end further comprises an OBD acquisition module and a GPS acquisition module, the coach end further comprises an OBD display module and a GPS display module, wherein:
the OBD acquisition module is used for acquiring OBD data of a vehicle installed at a student end and transmitting the OBD data to the OBD display module of a coach end;
the GPS acquisition module is used for acquiring GPS data of a vehicle installed at a student end and sending the GPS data to the GPS display module of the coach end;
the OBD display module is used for displaying OBD data sent by all student terminals corresponding to the coach terminal;
and the GPS display module is used for displaying the GPS data sent by all the student terminals corresponding to the coach terminal.
Preferably, the driving training video call system based on the Web RTC further comprises a data server;
the data server receives the OBD data sent by the OBD acquisition module of the student side and the GPS data sent by the GPS acquisition module, forwards the OBD data to the OBD display module of the coach side, and forwards the GPS data to the GPS display module of the coach side.
The application also provides a Web RTC-based driving training video call method, which is realized based on the Web RTC-based driving training video call system, and comprises the following steps:
case 1, the coach initiates real-time video viewing:
1) a coach terminal initiates a coach call request for real-time video viewing through a student display module, wherein the coach call request comprises a student id of a student terminal with a specified call;
2) establishing communication connection between a socket module of a coach end and a socket server, and executing the next step if the socket server successfully establishes communication connection with a socket module of a student end corresponding to the student id; otherwise, ending the call;
3) the RTC module of the coach end sends a connection signaling to the RTC server, and the RTC server forwards the connection signaling to the RTC module of the student end corresponding to the student id, establishes RTC connection and closes the microphone;
4) the RTC server establishes a point-to-point video call link, the RTC module of the coach end and the RTC module of the student end add the acquired video stream to the point-to-point video call link, and send a video added signaling to the RTC server for point-to-point real-time video viewing;
case 2, the coach side initiates audio and video call: on the basis that a coach side initiates real-time video viewing, a microphone is opened, and point-to-point audio and video communication can be carried out;
and 3, initiating audio and video call by the student side:
1) the student side initiates a student call request of audio and video call through the help seeking module, wherein the student call request comprises a student id of the student side;
2) the socket module of the student end establishes communication connection with a socket server, and the socket server adds the student call request to a student list consisting of priority queues;
3) the method comprises the steps that a request display module of a coach end displays a student list in real time, if a socket module of the coach end returns a call rejection request to a socket server, the socket server moves a corresponding student id out of the student list, and the call of a student end corresponding to the student id is finished; if the socket module of the coach end returns a call agreement request to the socket server, the socket server moves the corresponding student id out of the student column, returns a call agreement request to the student end corresponding to the student id, and executes the next step;
4) the socket module of the student end is in communication connection with the socket server end, and if the socket server end is in communication connection with the socket module of the coach end successfully, the next step is executed; otherwise, ending the call;
5) the RTC module of the student side sends a connection signaling to the RTC server side, and the RTC server side forwards the connection signaling to the corresponding RTC module of the coach side, establishes RTC connection and turns on a microphone;
6) the RTC server establishes a point-to-point video call link, the RTC module of the coach end and the RTC module of the student end add the acquired video stream to the point-to-point video call link, and send a video added signaling to the RTC server to carry out point-to-point audio and video call.
Preferably, the method for adding the student call request to the student list composed of the priority queues by the socket server includes: the socket server pushes the student call requests to an API server, the API server receives the student call requests sent by the socket server, and the existing student call requests are sequenced according to preset priorities to obtain a priority queue as a student list;
the request display module of the coach terminal displays a student list in real time, and the request display module comprises: and the API server returns a priority queue to the request display module after receiving the query request sent by the request display module of the coach end, and the priority queue serves as a latest student list requesting for conversation at present.
According to the driving training video call system and method based on the Web RTC, real-time video viewing or audio and video call is carried out according to specific application scenes by utilizing the audio and video call characteristics of the Web RTC, so that a student can quickly and accurately establish connection and know the conditions inside and outside the vehicle when seeking help coaches and coaches observe the student, and the driving training efficiency is improved.
Drawings
Fig. 1 is a block diagram of a Web RTC-based driving training video call system according to the present application;
fig. 2 is a block diagram of another embodiment of a Web RTC-based driver training video call system according to the present application;
FIG. 3 is a flowchart illustrating an embodiment of the present application in which a coach initiates a video call actively;
fig. 4 is a flowchart of an embodiment of the present application in which a trainee initiates a video call actively.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used in the description of the present application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application.
In one embodiment, a driving training video call system based on a Web Real-Time Communication (Web RTC) is provided to provide effective audio and video interaction for driving training, meet the requirements of a coach for remote monitoring and coaching of trainers for driving training learning, and effectively improve the efficiency and quality of the driving training.
As shown in fig. 1, the driving training video call system based on the Web RTC in this embodiment includes: the student communication system comprises a coach end, a student end, a socket server end and an RTC server end, wherein the student end comprises a socket module, an RTC module and a help seeking module, and the coach end comprises the socket module, the RTC module, a student display module and a request display module.
In the application scenario of the embodiment, one trainer end corresponds to one or more student ends, and preferably, one trainer end is set to correspond to a plurality of student ends, so that resource sharing is realized, and differences of different teaching modes brought by different trainers can be smoothed. In the embodiment, a trainer end and a plurality of student ends are taken as an example for explanation, in the practical application process, if the number of students is large, a plurality of trainer ends can be arranged, and each trainer end corresponds to each student end, so as to realize the extended application of the application.
Specifically, the help module in this embodiment is configured to initiate a student call request under the trigger of the student.
And the request display module is used for displaying the student list of the current request for communication, and agreeing or refusing the student communication request of the specified student side under the trigger of the coach.
And the student display module is used for displaying the information of all student terminals corresponding to the trainer terminal and initiating a coach call request to the appointed student terminal under the trigger of the coach.
And the socket server is used for establishing socket connection between the socket module of the coach end and the socket module of the appointed student end when the coach agrees with the student call request or the coach end initiates the coach call request.
The RTC server is used for establishing RTC connection between the RTC module of the coach end and the RTC module of the appointed student end after the socket connection is successfully established at the socket server, and establishing point-to-point video call between the coach end and the appointed student end after the RTC connection is successfully established, wherein the video call is divided into video viewing and audio-video call according to whether voice is needed.
The video call system of the embodiment establishes a high-efficiency video call between a coach and a student based on the audio and video call characteristics of the Web RTC, and meets the requirement of the coach for remotely assisting the student in completing the driving training. The method is suitable for an application scene that one trainee end corresponds to a plurality of student ends, after the student ends send communication requests, the trainee ends needing communication are displayed on the trainee ends through a trainee list, and a trainee actively selects objects to be communicated, so that the trainee resources are reasonably distributed, and the condition that normal training of other trainees is influenced due to the fact that a certain trainee frequently occupies a communication channel is avoided.
In the whole video call process, the socket module is used for establishing connection with a socket server and sending a communication signaling to the other socket module. The RTC module is used for establishing connection with the RTC server and sending a communication signaling to the RTC module of the other party.
It should be noted that the technology of socket communication and RTC communication is a mature technology in the communication field in this embodiment, and this embodiment focuses on completing the high-efficiency video call between the trainer and the trainee based on socket communication and RTC communication, and details of the socket communication and RTC communication are not repeated.
The student list in this embodiment can be obtained by the socket server terminal by sequencing according to the received student call request, and the student list is fed back to the request display module of the trainer terminal in real time, so that the trainer can preferentially process the student call request with higher demand. The priority of the order in the trainee list can be set according to actual conditions, such as driving familiarity of the trainee, danger degree of the current training program of the trainee and the like.
In order to reduce the computational pressure of the socket server, as shown in fig. 2, in another embodiment, the Web RTC-based driving training video call system further includes an API server. The API server is used for receiving the student call requests sent by the socket server and sequencing the existing student call requests according to a preset priority to obtain a priority queue; and the device is also used for returning a priority queue to the request display module as a latest student list requesting for conversation after receiving a query request sent by the request display module of the coach terminal.
In order to further improve the learning of the trainer to the training state of each student, in another embodiment the trainee end further comprises an OBD acquisition module and a GPS acquisition module, the trainer end further comprises an OBD display module and a GPS display module, wherein:
the OBD acquisition module is used for acquiring OBD data of a vehicle installed at a student end and transmitting the OBD data to the OBD display module of a coach end; and the GPS acquisition module is used for acquiring GPS data of a vehicle installed at the student end and sending the GPS data to the GPS display module at the coach end.
The OBD display module is used for displaying OBD data sent by all student terminals corresponding to the coach terminal; and the GPS display module is used for displaying the GPS data sent by all the student terminals corresponding to the coach terminal.
In this embodiment, the coach terminal can not only carry out the video call with the student terminal, but also can master the state and the positional information of the vehicle of all student terminals that it corresponds in real time, and the student who has abnormality to vehicle state or positional information can in time send the video call to and the time supplementary student carries out the solution of abnormal state, improves the security and the high efficiency of long-range training of driving.
The OBD data comprise vehicle speed, rotating speed, steering wheel rotating angle, gear state, steering lamp state, brake state, safety belt state, vehicle door state and the like; the GPS data is acquired using a differential GPS, including relative coordinates (x, y, z) of the vehicle, and the like.
In order to avoid occupying normal video call resources, in another embodiment, the Web RTC-based driving training video call system further comprises a data server.
The data server receives the OBD data sent by the OBD acquisition module of the student side and the GPS data sent by the GPS acquisition module, forwards the OBD data to the OBD display module of the coach side, and forwards the GPS data to the GPS display module of the coach side.
According to the data receiving and sending rules, the data service end can be generally set to receive the OBD data and the GPS data in real time, but does not actively send the data to the coach end, and the OBD display module and the GPS display module of the coach end poll the API interface of the data service end to acquire the latest OBD data and GPS data.
Based on the GPS data, the information of the trainee end displayed by the trainee display module in the present embodiment may only include trainee information, such as trainee id; the combined information can be displayed in a list form or a map form, namely, the relative coordinates of the vehicle are displayed on the map, and the student id is displayed at the corresponding position of the relative coordinates so as to assist the coach in identifying the position of the vehicle.
In another embodiment, a Web RTC-based driving training video call method is provided, which is implemented based on the Web RTC-based driving training video call system, and includes:
case 1, the coach initiates real-time video viewing:
1) a coach terminal initiates a coach call request for real-time video viewing through a student display module, wherein the coach call request comprises a student id of a student terminal with a specified call;
2) establishing communication connection between a socket module of a coach end and a socket server, and executing the next step if the socket server successfully establishes communication connection with a socket module of a student end corresponding to the student id; otherwise, ending the call;
3) the RTC module of the coach end sends a connection signaling to the RTC server, and the RTC server forwards the connection signaling to the RTC module of the student end corresponding to the student id, establishes RTC connection and closes the microphone;
4) the RTC server establishes a point-to-point video call link, the RTC module of the coach end and the RTC module of the student end add the acquired video stream to the link, and send a video added signaling to the RTC server to carry out point-to-point video call; the RTC server only receives the video added signaling, but does not acquire the video stream on the link, that is, the RTC server does not participate in the transmission or reception of the specific video stream.
Case 2, the coach side initiates audio and video call: on the basis that a coach side initiates real-time video viewing, a microphone is opened, and point-to-point audio and video communication can be carried out; the specific process is as follows:
1) a coach terminal initiates a coach call request of audio and video call through a student display module, wherein the coach call request comprises a student id of a student terminal with specified call;
2) establishing communication connection between a socket module of a coach end and a socket server, and executing the next step if the socket server successfully establishes communication connection with a socket module of a student end corresponding to the student id; otherwise, ending the call;
3) the RTC module of the coach side sends a connection signaling to the RTC server side, and the RTC server side forwards the connection signaling to the RTC module of the student side corresponding to the student id, establishes RTC connection and turns on a microphone;
4) the RTC server establishes a point-to-point video call link, the RTC module of the coach end and the RTC module of the student end add the acquired video stream to the link, and send a video added signaling to the RTC server to carry out point-to-point video call; the RTC server only receives the video added signaling, but does not acquire the video stream on the link, that is, the RTC server does not participate in the transmission or reception of the specific video stream.
It should be noted that the turning on or off of the microphone may be performed manually by the coach terminal based on the video viewing; of course, in other embodiments, the microphone may be automatically turned on or off according to the type of the call to be initiated.
And 3, initiating audio and video call by the student side:
1) the student side initiates a student call request of audio and video call through the help seeking module, wherein the student call request comprises a student id of the student side;
2) the socket module of the student end establishes communication connection with a socket server, and the socket server adds the student call request to a student list consisting of priority queues;
3) the method comprises the steps that a request display module of a coach end displays a student list in real time, if a socket module of the coach end returns a call rejection request to a socket server, the socket server moves a corresponding student id out of the student list, and the call of a student end corresponding to the student id is finished; if the socket module of the coach end returns a call agreement request to the socket server, the socket server moves the corresponding student id out of the student column, returns a call agreement request to the student end corresponding to the student id, and executes the next step;
4) the socket module of the student end is in communication connection with the socket server end, and if the socket server end is in communication connection with the socket module of the coach end successfully, the next step is executed; otherwise, ending the call;
5) the RTC module of the student side sends a connection signaling to the RTC server side, and the RTC server side forwards the connection signaling to the corresponding RTC module of the coach side, establishes RTC connection and turns on a microphone;
6) the RTC server establishes a point-to-point video call link, the RTC module of the coach end and the RTC module of the student end add the acquired video stream to the point-to-point video call link, and send a video added signaling to the RTC server to carry out point-to-point audio and video call.
The video call method provided by the embodiment supports real-time video viewing or audio and video call in different scenes, establishes efficient communication between a coach and a student, establishes a communication basis for remote driving training teaching, and improves driving training efficiency.
The Web RTC technology adopted by the application only needs to use the audio and video functions of the local equipment, has low requirements on the local equipment, does not need to additionally use a network camera and a server, has high audio and video transmission rate and low delay, realizes smoothness and low cost, and only needs to use a video call based on a local area network.
In another embodiment, the socket server adds the student call request to the student list composed of the priority queue, including: the socket server pushes the student call requests to the API server, the API server receives the student call requests sent by the socket server, and the existing student call requests are sequenced according to preset priorities to obtain a priority queue as a student list.
The request display module of the coach terminal displays a student list in real time, and the request display module comprises: and the API server returns a priority queue to the request display module after receiving the query request sent by the request display module of the coach end, and the priority queue serves as a latest student list requesting for conversation at present.
In order to facilitate understanding of the driving training video call method based on the Web RTC of the present embodiment, a specific example is provided below for description.
As shown in fig. 3, the trainer actively communicates with the trainee, and there are two modes of real-time video viewing and audio-video communication, which are as follows:
A. when the real-time video is viewed:
(1) the method comprises the following steps that a coach end establishes communication connection with a socket server, and when a coach selects a student, the coach end sends a room creating message ms _ create _ room (the signaling carries a student id) to the socket server through a socket module;
(2) the socket server creates a room according to the student id, pulls the student end corresponding to the student id into the room, if the student end enters the room and is overtime, the coach end can actively exit the room and sends a room leaving signal ms _ leave _ room to the socket server, and the connection is finished;
(3) if the student side smoothly enters the room, starting to establish RTC connection;
(4) the training side sends an ms _ new _ peer signal to the RTC server side, and the RTC server side forwards the signal to the student side;
(5) both sides acquire their own local video stream, and the local video stream may be failed to acquire (overtime) due to the absence of local hardware equipment or unauthorized browser and other factors. If yes, exiting the room, and sending a room leaving signal ms _ leave _ room to the RTC server, and ending the connection;
(6) and if both sides successfully acquire the local video stream, the both sides add the audio and video stream to the link and send an audio and video stream adding signaling ms _ add _ steam to the RTC server side for point-to-point communication.
After the default RTC connection is successfully established, the microphone of the coach end is closed, and the coach can only observe the conditions in the student car. The audio-video communication is that on the basis of the existing video communication, a microphone is directly turned on, and a coach and a student can normally talk.
As shown in fig. 4, the active communication process between the trainee end and the trainer end is as follows:
(1) the student side establishes connection with the socket server side firstly, when the student clicks a help seeking button, the student side sends a newly-established connection message ms _ new _ connect (including student id) to the socket server side through the socket module, and after the socket server side receives the message, the request is added into a priority queue. The coach end can check the student requests in the priority queue in real time;
(2) when the coach rejects the request, the student is removed from the priority queue and the process ends.
(3) After the coach end agrees with the request, the student end is removed from the priority queue, the coach end sends an accept signal to the student end, and the student end sends a room creating message ms _ create _ room (the message carries the student id) to the socket server end through the socket after receiving the accept;
(4) the socket server creates a room according to the student id, pulls the coach end into the room, if the coach end enters the room and is overtime, the student end actively exits the room and sends an leaving room signaling ms _ leave _ room to the socket server, and the connection is finished.
(5) If the coach terminal smoothly enters the room, starting to establish RTC connection;
(6) the student side sends an ms _ new _ peer signal to the RTC server side, and the RTC server side forwards the signal to the coach side.
(7) Then, both parties acquire their own local video streams, and the audio and video streams may fail to be acquired (overtime) due to the fact that local hardware devices do not exist or a browser is not authorized. If the time is out, the room is exited, and a room leaving signal ms _ leave _ room is sent to the RTC server, and the connection is ended.
(8) And if both sides successfully acquire the local video stream, the both sides add the audio and video stream to the link and send an audio and video stream adding signaling ms _ add _ steam to carry out point-to-point communication.
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (6)
1. A Web RTC-based driving training video call system is characterized by comprising: coach end, student end, socket service end and RTC service end, the student end includes socket module, RTC module and seeks help the module, the coach end includes socket module, RTC module, student display module and request display module, and a coach end corresponds one or more student end, wherein:
the help seeking module is used for initiating a student call request under the trigger of the student;
the request display module is used for displaying a student list of the current request for communication, and agreeing or refusing the student communication request of the specified student under the trigger of a coach;
the trainee display module is used for displaying information of all trainee ends corresponding to the coach end and initiating a coach call request to the appointed trainee end under the trigger of the coach;
the socket server is used for establishing socket connection between a socket module of the coach end and a socket module of the appointed student end when the coach agrees with the student call request or the coach end initiates the coach call request;
the RTC server is used for establishing RTC connection between the RTC module of the coach end and the RTC module of the appointed student end after the socket connection is successfully established at the socket server, and establishing point-to-point video call between the coach end and the appointed student end after the RTC connection is successfully established.
2. The Web RTC-based driving training video call system of claim 1, wherein the Web RTC-based driving training video call system further comprises an API server;
the API server is used for receiving the student call requests sent by the socket server and sequencing the existing student call requests according to a preset priority to obtain a priority queue; and the device is also used for returning a priority queue to the request display module as a latest student list requesting for conversation after receiving a query request sent by the request display module of the coach terminal.
3. The Web RTC-based driving training video call system of claim 1, wherein the trainee end further comprises an OBD acquisition module and a GPS acquisition module, the trainee end further comprises an OBD display module and a GPS display module, wherein:
the OBD acquisition module is used for acquiring OBD data of a vehicle installed at a student end and transmitting the OBD data to the OBD display module of a coach end;
the GPS acquisition module is used for acquiring GPS data of a vehicle installed at a student end and sending the GPS data to the GPS display module of the coach end;
the OBD display module is used for displaying OBD data sent by all student terminals corresponding to the coach terminal;
and the GPS display module is used for displaying the GPS data sent by all the student terminals corresponding to the coach terminal.
4. The Web RTC-based driving training video call system of claim 3, wherein the Web RTC-based driving training video call system further comprises a data server;
the data server receives the OBD data sent by the OBD acquisition module of the student side and the GPS data sent by the GPS acquisition module, forwards the OBD data to the OBD display module of the coach side, and forwards the GPS data to the GPS display module of the coach side.
5. A driving training video call method based on a Web RTC (real-time clock) is characterized in that the driving training video call method based on the Web RTC is realized based on the driving training video call system based on the Web RTC as claimed in any one of claims 1 to 4, and the driving training video call method based on the Web RTC comprises the following steps:
case 1, the coach initiates real-time video viewing:
1) a coach terminal initiates a coach call request for real-time video viewing through a student display module, wherein the coach call request comprises a student id of a student terminal with a specified call;
2) establishing communication connection between a socket module of a coach end and a socket server, and executing the next step if the socket server successfully establishes communication connection with a socket module of a student end corresponding to the student id; otherwise, ending the call;
3) the RTC module of the coach end sends a connection signaling to the RTC server, and the RTC server forwards the connection signaling to the RTC module of the student end corresponding to the student id, establishes RTC connection and closes the microphone;
4) the RTC server establishes a point-to-point video call link, the RTC module of the coach end and the RTC module of the student end add the acquired video stream to the point-to-point video call link, and send a video added signaling to the RTC server for point-to-point real-time video viewing;
case 2, the coach side initiates audio and video call: on the basis that a coach side initiates real-time video viewing, a microphone is opened, and point-to-point audio and video communication can be carried out;
and 3, initiating audio and video call by the student side:
1) the student side initiates a student call request of audio and video call through the help seeking module, wherein the student call request comprises a student id of the student side;
2) the socket module of the student end establishes communication connection with a socket server, and the socket server adds the student call request to a student list consisting of priority queues;
3) the method comprises the steps that a request display module of a coach end displays a student list in real time, if a socket module of the coach end returns a call rejection request to a socket server, the socket server moves a corresponding student id out of the student list, and the call of a student end corresponding to the student id is finished; if the socket module of the coach end returns a call agreement request to the socket server, the socket server moves the corresponding student id out of the student column, returns a call agreement request to the student end corresponding to the student id, and executes the next step;
4) the socket module of the student end is in communication connection with the socket server end, and if the socket server end is in communication connection with the socket module of the coach end successfully, the next step is executed; otherwise, ending the call;
5) the RTC module of the student side sends a connection signaling to the RTC server side, and the RTC server side forwards the connection signaling to the corresponding RTC module of the coach side, establishes RTC connection and turns on a microphone;
6) the RTC server establishes a point-to-point video call link, the RTC module of the coach end and the RTC module of the student end add the acquired video stream to the point-to-point video call link, and send a video added signaling to the RTC server to carry out point-to-point audio and video call.
6. The Web RTC-based driving training video call method of claim 5, wherein the socket server adds the student call request to a student list composed of priority queues, comprising: the socket server pushes the student call requests to an API server, the API server receives the student call requests sent by the socket server, and the existing student call requests are sequenced according to preset priorities to obtain a priority queue as a student list;
the request display module of the coach terminal displays a student list in real time, and the request display module comprises: and the API server returns a priority queue to the request display module after receiving the query request sent by the request display module of the coach end, and the priority queue serves as a latest student list requesting for conversation at present.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110203053.3A CN113014849B (en) | 2021-02-23 | 2021-02-23 | Driving training video call system and method based on Web RTC |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110203053.3A CN113014849B (en) | 2021-02-23 | 2021-02-23 | Driving training video call system and method based on Web RTC |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113014849A true CN113014849A (en) | 2021-06-22 |
| CN113014849B CN113014849B (en) | 2023-03-14 |
Family
ID=76408239
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110203053.3A Active CN113014849B (en) | 2021-02-23 | 2021-02-23 | Driving training video call system and method based on Web RTC |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113014849B (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105407369A (en) * | 2015-11-17 | 2016-03-16 | 青岛海信电器股份有限公司 | Web application based terminal communication method and device |
| CN105931532A (en) * | 2016-06-16 | 2016-09-07 | 永州市金锐科技有限公司 | Intelligent vehicle-mounted driving training system |
| WO2016150235A1 (en) * | 2015-03-26 | 2016-09-29 | 中兴通讯股份有限公司 | Method and device for webrtc p2p audio and video call |
| CN106464697A (en) * | 2014-06-26 | 2017-02-22 | 统有限责任两合公司 | Method for establishing a communication connection which is suitable for transmitting media streams between a first RTC client and a second RTC client |
| CN107316530A (en) * | 2016-04-27 | 2017-11-03 | 深圳市爱丰达盛科技有限公司 | Auxiliary learns method, system and the teaching car of car |
| CN107564364A (en) * | 2017-09-15 | 2018-01-09 | 安徽中瑞通信科技股份有限公司 | A kind of Driving Test tutoring system and teaching method based on Big Dipper embedded navigation systems |
| CN107682657A (en) * | 2017-09-13 | 2018-02-09 | 中山市华南理工大学现代产业技术研究院 | A kind of multi-person speech video call method and system based on WebRTC |
| CN107707533A (en) * | 2017-09-18 | 2018-02-16 | 深圳市迅雷网文化有限公司 | Company's wheat method, system and storage medium based on Web |
| CN107909513A (en) * | 2017-08-04 | 2018-04-13 | 安徽展瑞信息科技有限公司 | A kind of driving school's coach's integrated service management system based on internet |
| CN109741519A (en) * | 2018-12-10 | 2019-05-10 | 深圳市思拓通信系统有限公司 | A kind of unmanned supermarket shelves monitoring system and its control method |
| CN110300150A (en) * | 2019-05-17 | 2019-10-01 | 威比网络科技(上海)有限公司 | Long-range real-time multimedia teaching method, system, electronic equipment, storage medium |
| CN112015574A (en) * | 2020-08-27 | 2020-12-01 | 北京博医时代教育科技有限公司 | Remote medical education training method, device, equipment and storage medium |
-
2021
- 2021-02-23 CN CN202110203053.3A patent/CN113014849B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106464697A (en) * | 2014-06-26 | 2017-02-22 | 统有限责任两合公司 | Method for establishing a communication connection which is suitable for transmitting media streams between a first RTC client and a second RTC client |
| US20170126751A1 (en) * | 2014-06-26 | 2017-05-04 | Unify Gmbh & Co. Kg | Method for establishing a communication connection which is suitable for transmitting media streams between a first rtc client and a second rtc client |
| WO2016150235A1 (en) * | 2015-03-26 | 2016-09-29 | 中兴通讯股份有限公司 | Method and device for webrtc p2p audio and video call |
| CN105407369A (en) * | 2015-11-17 | 2016-03-16 | 青岛海信电器股份有限公司 | Web application based terminal communication method and device |
| CN107316530A (en) * | 2016-04-27 | 2017-11-03 | 深圳市爱丰达盛科技有限公司 | Auxiliary learns method, system and the teaching car of car |
| CN105931532A (en) * | 2016-06-16 | 2016-09-07 | 永州市金锐科技有限公司 | Intelligent vehicle-mounted driving training system |
| CN107909513A (en) * | 2017-08-04 | 2018-04-13 | 安徽展瑞信息科技有限公司 | A kind of driving school's coach's integrated service management system based on internet |
| CN107682657A (en) * | 2017-09-13 | 2018-02-09 | 中山市华南理工大学现代产业技术研究院 | A kind of multi-person speech video call method and system based on WebRTC |
| CN107564364A (en) * | 2017-09-15 | 2018-01-09 | 安徽中瑞通信科技股份有限公司 | A kind of Driving Test tutoring system and teaching method based on Big Dipper embedded navigation systems |
| CN107707533A (en) * | 2017-09-18 | 2018-02-16 | 深圳市迅雷网文化有限公司 | Company's wheat method, system and storage medium based on Web |
| CN109741519A (en) * | 2018-12-10 | 2019-05-10 | 深圳市思拓通信系统有限公司 | A kind of unmanned supermarket shelves monitoring system and its control method |
| CN110300150A (en) * | 2019-05-17 | 2019-10-01 | 威比网络科技(上海)有限公司 | Long-range real-time multimedia teaching method, system, electronic equipment, storage medium |
| CN112015574A (en) * | 2020-08-27 | 2020-12-01 | 北京博医时代教育科技有限公司 | Remote medical education training method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113014849B (en) | 2023-03-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107147709B (en) | Team vehicle management method, vehicle-mounted terminal and server | |
| CN103604436B (en) | Vehicle group air navigation aid and navigational system | |
| CN110233890B (en) | Interaction method and interaction system for multiple systems on chip on vehicle | |
| CN102497443B (en) | Vehicle-mounted station based on Internet, system and communication method thereof | |
| CN110958559B (en) | Vehicle, vehicle-mounted equipment and instant interaction method based on map display | |
| CN113112881A (en) | Remote experiment question answering system based on WebRTC | |
| CN113014849B (en) | Driving training video call system and method based on Web RTC | |
| CN113093811B (en) | Unmanned aerial vehicle control method and system based on intelligent cabin system | |
| CN110689882A (en) | Vehicle, playing equipment thereof and multimedia playing automatic control method | |
| CN112437246B (en) | Video conference method based on intelligent cabin and intelligent cabin | |
| CN107343308A (en) | Permitted and unlicensed communication using cellular protocol management | |
| CN113873199A (en) | Vehicle-mounted camera sharing system and method based on direct connection communication and cellular network communication | |
| CN112776821A (en) | V2X-based method and device for instant messaging between vehicles | |
| CN213199619U (en) | Vehicle rear seat network interconnection device | |
| CN114020020A (en) | Unmanned aerial vehicle system control method and device and remote controller | |
| CN113949720A (en) | Interconnection method, device, equipment and storage medium based on vehicle cabin | |
| CN111162991B (en) | Online interconnection method based on unmanned vehicle intelligent-connection assistance system | |
| CN110211256A (en) | Appearing method is answered in aobvious device and vehicle driving fact again for vehicle and its vehicle driving fact | |
| CN115565412A (en) | Live-broadcast teaching system and method for online and offline fusion training of enterprise | |
| CN218550196U (en) | Tag equipment and OBD equipment supporting voice interaction | |
| CN218217469U (en) | Intelligent motor-driven emergency command system | |
| CN206117863U (en) | On -vehicle conference system of 4G network | |
| CN111181676A (en) | Broadcasting system based on 5G communication technology | |
| CN110189198A (en) | The method for pushing and device of prompting message, head-up display HUD and server | |
| DE102022119070B3 (en) | Media playback device, method for operating a media playback device and vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |