CN116017085A - Method, device, equipment and medium for adding subtitles and barrage to hard disk video recording - Google Patents
Method, device, equipment and medium for adding subtitles and barrage to hard disk video recording Download PDFInfo
- Publication number
- CN116017085A CN116017085A CN202211540774.4A CN202211540774A CN116017085A CN 116017085 A CN116017085 A CN 116017085A CN 202211540774 A CN202211540774 A CN 202211540774A CN 116017085 A CN116017085 A CN 116017085A
- Authority
- CN
- China
- Prior art keywords
- data
- audio
- video
- compressed
- vehicle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 230000006835 compression Effects 0.000 claims abstract description 10
- 238000007906 compression Methods 0.000 claims abstract description 10
- 230000005540 biological transmission Effects 0.000 claims description 9
- 238000006243 chemical reaction Methods 0.000 claims description 9
- 238000012545 processing Methods 0.000 claims description 5
- 238000005538 encapsulation Methods 0.000 claims description 4
- 230000006870 function Effects 0.000 abstract description 11
- 230000000875 corresponding effect Effects 0.000 description 44
- 238000010586 diagram Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 4
- 238000011161 development Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Landscapes
- Signal Processing For Digital Recording And Reproducing (AREA)
Abstract
Description
技术领域technical field
本申请属于硬盘录像字幕和弹幕的技术领域,特别是涉及一种硬盘录像增加字幕和弹幕的方法、装置、设备及介质。The application belongs to the technical field of hard disk video subtitles and barrage, and in particular relates to a method, device, equipment and medium for adding subtitles and barrage to hard disk video.
背景技术Background technique
随着智能汽车的发展,智能化硬盘录像DVR是发展的方向之一,传统DVR以录像取证事后查询为主,而当前随着智能化技术的发展,DVR也用于智能识别,机器视觉分析、预警或行为识别等。然而目前DVR仍以录制视频和语音为主,无字幕和弹幕等趣味性功能,如果DVR增加实时的字幕和弹幕,将给汽车驾驶带来乐趣。With the development of smart cars, intelligent hard disk video recording DVR is one of the development directions. Traditional DVR is mainly used for post-event query of video forensics. With the development of intelligent technology, DVR is also used for intelligent identification, machine vision analysis, Early warning or behavior recognition, etc. However, at present, DVR is still mainly recording video and voice, without interesting functions such as subtitles and barrage. If DVR adds real-time subtitles and barrage, it will bring fun to car driving.
发明内容Contents of the invention
本申请提供硬盘录像增加字幕和弹幕的方法、装置、设备及介质,以增加硬盘录像DVR的字幕和弹幕功能,提升汽车驾驶场景中的趣味性。The application provides a method, device, equipment and medium for adding subtitles and barrage to a hard disk video recording, so as to increase the subtitle and barrage functions of a hard disk video DVR and improve the interest in car driving scenes.
本申请的目的及解决其技术问题是采用以下技术方案来实现的。The purpose of this application and the solution to its technical problems are achieved by adopting the following technical solutions.
本申请提供一种硬盘录像增加字幕和弹幕的方法,该方法包括:This application provides a method for adding subtitles and barrage to hard disk recording, the method includes:
S1,获取车辆内的视频数据、音频数据,以及音频对应的文字数据作为输入数据;S1, acquiring video data, audio data, and text data corresponding to the audio in the vehicle as input data;
S2,将上述输入数据输入至座舱控制器内进行数据编码/压缩获得压缩数据,存储所述压缩数据;S2, input the above input data into the cockpit controller to perform data encoding/compression to obtain compressed data, and store the compressed data;
S3,读取座舱控制器内存储的所述压缩数据,对所述压缩数据进行解压缩和解码,获取解码数据,所述解码数据包含输入数据中的原始车辆内的所述视频数据、音频数据,以及音频对应的文字数据;S3, read the compressed data stored in the cockpit controller, decompress and decode the compressed data, and obtain decoded data, the decoded data includes the video data and audio data in the original vehicle in the input data , and the text data corresponding to the audio;
S4,显示解码数据中的所述视频数据对应的视频图像、所述音频数据对应的音频、所述音频对应的文字数据转化的音频对应的文字字幕及上述解码数据的弹幕。S4, displaying the video image corresponding to the video data in the decoded data, the audio corresponding to the audio data, the text subtitles corresponding to the audio converted from the text data corresponding to the audio, and the barrage of the decoded data.
可选的,获取车辆内的视频数据、音频数据,以及音频对应的文字数据作为输入数据包括:Optionally, obtaining video data, audio data, and text data corresponding to the audio in the vehicle as input data includes:
摄像机将车辆内拍摄的视频模拟数据转化为视频数字数据;The camera converts the video analog data captured in the vehicle into video digital data;
麦克风拾音器获取车辆内音频数据;数字化所述音频数据;acquiring in-vehicle audio data by a microphone pickup; digitizing said audio data;
语音转化设备将麦克风拾音器获取的音频数据转化为文字数据;The voice conversion device converts the audio data acquired by the microphone pickup into text data;
将所述视频数字数据、所述音频数据以及其音频数据转化的文本数据作为输入数据,将所述输入数据传送至座舱控制器进行压缩存储或网络传输。The video digital data, the audio data and the text data converted from the audio data are used as input data, and the input data is sent to the cockpit controller for compressed storage or network transmission.
可选的,将所述输入数据传送至座舱控制器进行压缩存储或网络传输包括:Optionally, transmitting the input data to the cockpit controller for compressed storage or network transmission includes:
将所述输入数据传送至座舱控制器;所述座舱控制器将输入数据进行封装和解封装操作;transmitting the input data to the cockpit controller; the cockpit controller performs encapsulation and decapsulation operations on the input data;
将所述输入数据按对应编码压缩为具有字幕的音视频流媒体,并将音视频流媒体进行再次压缩后存储在座舱控制器的存储单元中;或者通过网络传输至云端的监控中心。The input data is compressed into audio and video streaming media with subtitles according to the corresponding encoding, and the audio and video streaming media is compressed again and stored in the storage unit of the cockpit controller; or transmitted to the cloud monitoring center through the network.
可选的,将音视频流媒体进行再次压缩后存储在座舱控制器的存储单元中包括:Optionally, storing the audio and video streaming media in the storage unit of the cockpit controller after being compressed again includes:
将音视频流媒体进行压缩后,采用通用闪存存储的方式存于座舱控制器的存储单元中。After the audio and video streaming media is compressed, it is stored in the storage unit of the cockpit controller in the way of general flash storage.
可选的,将音视频流媒体进行再次压缩后通过网络传输至云端的监控中心包括:Optionally, the monitoring center that compresses the audio and video streaming media and transmits them to the cloud through the network includes:
音视频流媒体进行压缩后,采用内嵌式存储方式通过网络传输至云端的监控中心存储。After the audio and video streaming media is compressed, it is transmitted to the monitoring center in the cloud for storage through the network using the embedded storage method.
可选的,麦克风拾音器获取车辆内音频数据包括:Optionally, the acquisition of audio data in the vehicle by the microphone pickup includes:
根据车辆内不同座位位置的麦克风采集用户的音频数据。The user's audio data is collected according to the microphones at different seat positions in the vehicle.
可选的,语音转化设备将麦克风拾音器获取的音频数据转化为文字数据包括:Optionally, the voice conversion device converts the audio data acquired by the microphone pickup into text data including:
基于车辆内不同座位位置的麦克风拾音器,获取车辆内不同座位位置的音频数据,将每个座位位置的音频数据转化为与座位位置和音频数据关联的文字数据。Based on the microphone pickups at different seat positions in the vehicle, the audio data of different seat positions in the vehicle is obtained, and the audio data of each seat position is converted into text data associated with the seat position and the audio data.
本申请还提供一种硬盘录像增加字幕和弹幕的装置,包括:The present application also provides a device for adding subtitles and barrage to hard disk recording, including:
输入单元,用于获取车辆内的视频数据、音频数据,以及音频对应的文字数据作为输入数据;The input unit is used to obtain video data, audio data, and text data corresponding to the audio in the vehicle as input data;
处理单元,用于将上述输入数据输入至座舱控制器内进行数据编码/压缩获得压缩数据,存储所述压缩数据;a processing unit, configured to input the above input data into the cockpit controller for data encoding/compression to obtain compressed data, and store the compressed data;
读取单元,用于读取座舱控制器内存储的所述压缩数据,对所述压缩数据进行解压缩和解码,获取解码数据,所述解码数据包含输入数据中的原始车辆内的所述视频数据、音频数据,以及音频对应的文字数据;The reading unit is used to read the compressed data stored in the cockpit controller, decompress and decode the compressed data, and obtain decoded data, the decoded data includes the video in the original vehicle in the input data data, audio data, and text data corresponding to the audio;
显示单元,用于显示解码数据中的所述视频数据对应的视频图像、所述音频数据对应的音频、所述音频对应的文字数据转化的音频对应的文字字幕及上述解码数据的弹幕。The display unit is used to display the video image corresponding to the video data in the decoded data, the audio corresponding to the audio data, the text subtitles corresponding to the audio converted from the text data corresponding to the audio, and the barrage of the decoded data.
本申请还提供一种电子设备,该电子设备包括:The present application also provides an electronic device, which includes:
存储器,用于存储非暂时性计算机可读指令;以及memory for storing non-transitory computer readable instructions; and
处理器,用于运行所述计算机可读指令,使得所述计算机可读指令被所述处理器执行时实现上述所述的方法。A processor, configured to run the computer-readable instructions, so that when the computer-readable instructions are executed by the processor, the above-mentioned method is implemented.
本申请还提供一种计算机可读存储介质,该计算机可读存储介质包括计算机指令,当所述计算机指令在设备上运行时,使得所述设备执行上述所述的方法。The present application also provides a computer-readable storage medium, where the computer-readable storage medium includes computer instructions, and when the computer instructions are run on a device, the device is made to execute the method described above.
本申请与现有技术相比具有明显的优点和有益效果。借由上述技术方案,本申请至少具有以下优点及有益效果之一:Compared with the prior art, the present application has obvious advantages and beneficial effects. By virtue of the above technical solutions, the present application has at least one of the following advantages and beneficial effects:
一、本申请提供的一种硬盘录像增加字幕和弹幕的方法,通过获取车辆内的视频数据、音频数据,以及音频对应的文字数据作为输入数据;将上述输入数据输入至座舱控制器内进行数据编码/压缩获得压缩数据,存储所述压缩数据;读取座舱控制器内存储的所述压缩数据,对所述压缩数据进行解压缩和解码,获取解码数据,所述解码数据包含输入数据中的原始车辆内的所述视频数据、音频数据,以及音频对应的文字数据;显示解码数据中的所述视频数据对应的视频图像、所述音频数据对应的音频、所述音频对应的文字数据转化的音频对应的文字字幕及上述解码数据的弹幕,增加硬盘录像DVR的字幕和弹幕功能,提升汽车驾驶场景中的趣味性。1. A method for adding subtitles and barrage to a hard disk video provided by this application is to obtain the video data, audio data, and text data corresponding to the audio as input data in the vehicle; input the above input data into the cockpit controller to perform Data encoding/compression to obtain compressed data, store the compressed data; read the compressed data stored in the cockpit controller, decompress and decode the compressed data, and obtain decoded data, the decoded data is included in the input data The video data, audio data, and text data corresponding to the audio in the original vehicle; display the conversion of the video image corresponding to the video data, the audio corresponding to the audio data, and the text data corresponding to the audio in the decoded data The text subtitles corresponding to the audio and the barrage of the above-mentioned decoded data increase the subtitle and barrage functions of the hard disk video DVR, and enhance the fun of the car driving scene.
二、本申请通过将所述输入数据传送至座舱控制器;所述座舱控制器将输入数据进行封装和解封装操作,将所述输入数据按对应编码压缩为具有字幕的音视频流媒体,并将音视频流媒体进行再次压缩后存储在座舱控制器的存储单元中;或者通过网络传输至云端的监控中心,通过将输入数据进行封装和解封装操作,将所述输入数据按对应编码压缩为具有字幕的音视频流媒体,实现了将输入数据中视频数据、音频数据,以及音频对应的文字数据三者的融合,将音视频流媒体进行多次压缩,使上述音视频流媒体数据能小数据量的传输和储存;并将音视频流媒体进行压缩后,采用通用闪存存储的方式存于座舱控制器的存储单元中,以及将音视频流媒体进行再次压缩后通过网络传输至云端的监控中心。将上述音视频流媒体多次压缩、传输和储存的方式,一方面节约座舱控制器内资源利用率,另一方面提升了数据传输的效率。Two, the application transmits the input data to the cockpit controller; the cockpit controller performs encapsulation and decapsulation operations on the input data, compresses the input data into audio and video streaming media with subtitles according to the corresponding encoding, and The audio and video streaming media is compressed again and stored in the storage unit of the cockpit controller; or it is transmitted to the monitoring center in the cloud through the network, and the input data is compressed into subtitles according to the corresponding encoding by encapsulating and decapsulating the input data. The audio and video streaming media realizes the integration of video data, audio data, and text data corresponding to the audio in the input data, and compresses the audio and video streaming media multiple times, so that the above audio and video streaming media data can be reduced in size The transmission and storage of audio and video streaming media are compressed and stored in the storage unit of the cockpit controller in the form of general-purpose flash memory, and the audio and video streaming media are compressed again and then transmitted to the monitoring center in the cloud through the network. The method of compressing, transmitting and storing the above-mentioned audio and video streaming media multiple times, on the one hand, saves the utilization rate of resources in the cockpit controller, and on the other hand, improves the efficiency of data transmission.
三、本申请的麦克风拾音器获取车辆内音频数据,通过根据车辆内不同座位位置的麦克风采集用户的音频数据。基于车辆内不同座位位置的麦克风拾音器,获取车辆内不同座位位置的音频数据,将每个座位位置的音频数据转化为与座位位置和音频数据关联的文字数据。不仅将输入数据中视频数据、音频数据,以及音频对应的文字数据三者相互关联对应,同时通过根据车辆内不同座位位置的用户对上述输入数据生成音视频流媒体进行分类,并能根据车辆内不同座位位置的用户进行字幕和弹幕形式的对应播放,进一步提升了车辆内用户在汽车驾驶过程中产生具有互动形式音视频流媒体的字幕和弹幕功能,增强了车辆内用户的趣味性。3. The microphone pickup device of the present application acquires the audio data in the vehicle, and collects the user's audio data through microphones according to different seat positions in the vehicle. Based on the microphone pickups at different seat positions in the vehicle, the audio data of different seat positions in the vehicle is obtained, and the audio data of each seat position is converted into text data associated with the seat position and the audio data. Not only the video data, audio data, and the text data corresponding to the audio in the input data are related to each other, but also the audio and video streaming media generated by the above input data are classified according to the users at different seat positions in the vehicle, and can be classified according to the Users in different seat positions play corresponding subtitles and bullet chats, which further improves the function of subtitles and bullet chats with interactive audio and video streaming media for users in the vehicle during driving, and enhances the fun of users in the vehicle.
上述说明仅是本发明技术方案的概述,为了能够更清楚了解本发明的技术手段,而可依照说明书的内容予以实施,并且为了让本发明的上述和其他目的、特征和优点能够更明显易懂,以下特举较佳实施例,并配合附图,详细说明如下。The above description is only an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention, it can be implemented according to the contents of the description, and in order to make the above and other purposes, features and advantages of the present invention more obvious and understandable , the following preferred embodiments are specifically cited, and in conjunction with the accompanying drawings, the detailed description is as follows.
附图说明Description of drawings
图1是本申请一实施例的一种硬盘录像增加字幕和弹幕方法的流程示意图;Fig. 1 is a schematic flow chart of a method for adding subtitles and barrage to a hard disk video recording according to an embodiment of the present application;
图2是本申请一实施例的一种硬盘录像增加字幕和弹幕装置的结构示意图;Fig. 2 is a schematic structural diagram of a device for adding subtitles and barrage to a hard disk video recording according to an embodiment of the present application;
图3是本申请一实施例的一种硬盘录像增加字幕和弹幕装置的结构示意图;Fig. 3 is a schematic structural diagram of a device for adding subtitles and barrage to a hard disk video recording according to an embodiment of the present application;
图4是本申请一实施例的一种硬盘录像增加字幕和弹幕方法应用的示意图;Fig. 4 is a schematic diagram of the application of a hard disk video adding subtitles and barrage method according to an embodiment of the present application;
图5是本申请一实施例的一种硬盘录像增加字幕和弹幕的电子设备的结构示意图。Fig. 5 is a schematic structural diagram of an electronic device for adding subtitles and barrage to hard disk video recording according to an embodiment of the present application.
具体实施方式Detailed ways
为更进一步阐述本发明为达成预定发明目的所采取的技术手段及功效,以下结合附图及较佳实施例,对依据本发明提出的其具体实施方式、结构、特征及其功效,详细说明如下。In order to further explain the technical means and effects of the present invention to achieve the intended purpose of the invention, the specific implementation, structure, features and effects of the present invention will be described in detail below in conjunction with the accompanying drawings and preferred embodiments. .
本发明提供了本申请提供一种硬盘录像增加字幕和弹幕的方法,如附图1至2所示,附图1为本申请一实施例的一种硬盘录像增加字幕和弹幕方法的流程示意图;附图2为本申请一实施例的一种硬盘录像增加字幕和弹幕装置的结构示意图。该方法包括如下步骤:The present invention provides a method for adding subtitles and barrage to a hard disk video, as shown in accompanying drawings 1 to 2, and accompanying drawing 1 is a process flow of a method for adding subtitles and barrage to a hard disk video according to an embodiment of the present application Schematic diagram; Accompanying drawing 2 is a schematic structural diagram of a device for adding subtitles and barrage to hard disk video recording according to an embodiment of the present application. The method comprises the steps of:
S1,获取车辆内的视频数据、音频数据,以及音频对应的文字数据作为输入数据;S1, acquiring video data, audio data, and text data corresponding to the audio in the vehicle as input data;
S2,将上述输入数据输入至座舱控制器内进行数据编码/压缩获得压缩数据,存储所述压缩数据;S2, input the above input data into the cockpit controller to perform data encoding/compression to obtain compressed data, and store the compressed data;
S3,读取座舱控制器内存储的所述压缩数据,对所述压缩数据进行解压缩和解码,获取解码数据,所述解码数据包含输入数据中的原始车辆内的所述视频数据、音频数据,以及音频对应的文字数据;S3, read the compressed data stored in the cockpit controller, decompress and decode the compressed data, and obtain decoded data, the decoded data includes the video data and audio data in the original vehicle in the input data , and the text data corresponding to the audio;
S4,显示解码数据中的所述视频数据对应的视频图像、所述音频数据对应的音频、所述音频对应的文字数据转化的音频对应的文字字幕及上述解码数据的弹幕。S4, displaying the video image corresponding to the video data in the decoded data, the audio corresponding to the audio data, the text subtitles corresponding to the audio converted from the text data corresponding to the audio, and the barrage of the decoded data.
需要说明的是,可以通过在车辆内部的输入单元进行数据输入,输入单元可包括摄像头、麦克风和按钮,摄像头采用低压差分信号技术接口LVDS与座舱控制器连接,由摄像头采集车辆内部的视频数据,获取车辆内的视频数据;麦克风采用四路麦克风,通过车辆音频A2B Bus与座舱控制器连接,由麦克风采集车辆内部用户的语音中的音频数据,获取车辆内的音频数据,以及通过语文转化装置,可将采集的车辆内部用户的音频数据转化为音频对应的文字数据。按钮可以启动将上述输入设备的启动工作,并将上述输入设备采集和获取的数据上传至云端或网络上安全的数据中心。例如,在车辆内部遇到危险,或需要紧急救援时,用户通过按压按钮,启动按钮中输入输出端口(IO)进行报警操作或呼叫救援,同时将上述输入设备采集和获取的数据传输至响应的报警中心进而救援中心。麦克风可以采用四路麦克风,从麦克风拾音器获取模拟音频信号,数字化后,传送给座舱控制器,座舱控制器采集四路麦克风数据,依据不同驾驶位置的麦克风,将不同用户语音的音频数据对应进行识别,并转换成文字。例如可以在主驾座位位置上进行字幕显示,而副驾或者后排座位位置可将视频的弹幕编码压缩在本地存储,不同座位位置用户的音频数据可以用于在报警操作或呼叫救援时,进行网络监听和呼救对讲,例如作为优选的实施方式,不同座位位置用户的音频数据可以是在汽车碰撞或者按压报警按钮时,座舱控制器获取的报警信息,该报警信息此后通过网络被发送至网络监控中心。在座舱控制器内设置有GPS模块,获取车辆当前的位置信息,包括当前车辆所在位置的经纬度、当前实时速度、当前车辆驱动设备工作时驱动速度的方位矢量角,并储存当前事件及其对应的时间。上述车辆位置和用户不同座位位置的定位采用UART串口与路由器基本调试UART定位连接的方式获得。通过车载T-BOX中的4G模块,实时把车辆状态数据、获取的视频数据、车辆内部和外部的声音数据等信息传至网络上的网络监控中心;同时可获取网络监控中心响应和/或下达的各种命令。对于座舱控制器的显示屏,打开DVR APP可以显示监控画面,回放历史录像。座舱控制器的显示屏可以通过低压差分信号技术接口LVDS与座舱控制器连接。It should be noted that data input can be performed through the input unit inside the vehicle. The input unit can include a camera, a microphone and buttons. The camera uses a low-voltage differential signal technology interface LVDS to connect with the cockpit controller, and the camera collects video data inside the vehicle. Obtain the video data in the vehicle; the microphone uses four-way microphones, which are connected to the cockpit controller through the vehicle audio A2B Bus, and the microphone collects the audio data in the voice of the user in the vehicle, obtains the audio data in the vehicle, and through the language conversion device, The collected audio data of users inside the vehicle can be converted into text data corresponding to the audio. The button can start the work of starting the above-mentioned input device, and upload the data collected and acquired by the above-mentioned input device to the cloud or a secure data center on the network. For example, when there is danger inside the vehicle or emergency rescue is needed, the user presses the button, the input and output port (IO) in the start button performs an alarm operation or calls for rescue, and at the same time transmits the data collected and obtained by the above input device to the corresponding The alarm center and then the rescue center. The microphone can use four-way microphones to obtain analog audio signals from the microphone pickup, digitize them, and send them to the cockpit controller. The cockpit controller collects four-way microphone data, and recognizes the audio data of different user voices according to the microphones in different driving positions. , and convert to text. For example, subtitles can be displayed on the driver's seat, while the co-pilot or rear seat can compress the barrage code of the video and store it locally. The audio data of users in different seat positions can be used for alarm operations or calls for rescue. Network monitoring and call for help intercom, for example, as a preferred implementation, the audio data of users in different seat positions can be the alarm information obtained by the cockpit controller when the car collides or presses the alarm button, and the alarm information is then sent to the network through the network monitoring Center. A GPS module is installed in the cockpit controller to obtain the current location information of the vehicle, including the latitude and longitude of the current vehicle location, the current real-time speed, the azimuth vector angle of the driving speed of the current vehicle driving equipment, and store the current event and its corresponding time. The location of the above-mentioned vehicle position and different seat positions of the user is obtained by connecting the UART serial port to the basic debugging UART location of the router. Through the 4G module in the vehicle T-BOX, the vehicle status data, acquired video data, vehicle internal and external sound data and other information are transmitted to the network monitoring center on the network in real time; at the same time, the network monitoring center can obtain responses and/or release various commands. For the display screen of the cockpit controller, open the DVR APP to display the monitoring screen and playback historical video. The display screen of the cockpit controller can be connected with the cockpit controller through the low-voltage differential signal technology interface LVDS.
可选的,获取车辆内的视频数据、音频数据,以及音频对应的文字数据作为输入数据包括:Optionally, obtaining video data, audio data, and text data corresponding to the audio in the vehicle as input data includes:
摄像机将车辆内拍摄的视频模拟数据转化为视频数字数据;The camera converts the video analog data captured in the vehicle into video digital data;
麦克风拾音器获取车辆内音频数据;数字化所述音频数据;acquiring in-vehicle audio data by a microphone pickup; digitizing said audio data;
语音转化设备将麦克风拾音器获取的音频数据转化为文字数据;The voice conversion device converts the audio data acquired by the microphone pickup into text data;
将所述视频数字数据、所述音频数据以及其音频数据转化的文本数据作为输入数据,将所述输入数据传送至座舱控制器进行压缩存储或网络传输。The video digital data, the audio data and the text data converted from the audio data are used as input data, and the input data is sent to the cockpit controller for compressed storage or network transmission.
可选的,将所述输入数据传送至座舱控制器进行压缩存储或网络传输包括:Optionally, transmitting the input data to the cockpit controller for compressed storage or network transmission includes:
将所述输入数据传送至座舱控制器;所述座舱控制器将输入数据进行封装和解封装操作;transmitting the input data to the cockpit controller; the cockpit controller performs encapsulation and decapsulation operations on the input data;
将所述输入数据按对应编码压缩为具有字幕的音视频流媒体,并将音视频流媒体进行再次压缩后存储在座舱控制器的存储单元中;或者通过网络传输至云端的监控中心。The input data is compressed into audio and video streaming media with subtitles according to the corresponding encoding, and the audio and video streaming media is compressed again and stored in the storage unit of the cockpit controller; or transmitted to the cloud monitoring center through the network.
需要说明的是,在将所述输入数据传送至座舱控制器进行压缩存储或网络传输时,通过ffmpeg的原理和架构采用封装器组件(Muxer)和译码器组件(Encoder),由座舱控制器将输入数据通过封装器组件(Muxer)进行封装,以及译码器组件(Encoder)进行解封装操作。It should be noted that, when the input data is transmitted to the cockpit controller for compressed storage or network transmission, the principle and structure of ffmpeg adopts a packager component (Muxer) and a decoder component (Encoder), and the cockpit controller The input data is encapsulated by the encapsulator component (Muxer), and the decoder component (Encoder) performs decapsulation operation.
将所述输入数据按对应编码压缩为具有字幕的音视频流媒体,可以采用数据编码/压缩H.265编码压缩标准进行编码/压缩,并可将音视频流媒体进行再次数据压缩后再存储在座舱控制器的存储单元中,上述储存单元可以采用emmc/UFS存储器。The input data is compressed into audio and video streaming media with subtitles according to the corresponding encoding, which can be encoded/compressed using the data encoding/compression H.265 encoding compression standard, and the audio and video streaming media can be compressed again and then stored in the In the storage unit of the cockpit controller, the above-mentioned storage unit may use emmc/UFS memory.
可选的,将音视频流媒体进行再次压缩后存储在座舱控制器的存储单元中包括:Optionally, storing the audio and video streaming media in the storage unit of the cockpit controller after being compressed again includes:
将音视频流媒体进行压缩后,采用通用闪存存储的方式存于座舱控制器的存储单元中。After the audio and video streaming media is compressed, it is stored in the storage unit of the cockpit controller in the way of general flash storage.
需要说明的是,采用通用闪存存储的方式可以是采用嵌入式多媒体卡eMMC的内嵌式存储方式将压缩后的音视频流媒体存于座舱控制器的存储单元中。It should be noted that the general flash storage method may be to use the embedded storage method of the embedded multimedia card eMMC to store the compressed audio and video stream media in the storage unit of the cockpit controller.
可选的,将音视频流媒体进行再次压缩后通过网络传输至云端的监控中心包括:Optionally, the monitoring center that compresses the audio and video streaming media and transmits them to the cloud through the network includes:
音视频流媒体进行压缩后,采用内嵌式存储方式通过网络传输至云端的监控中心存储。After the audio and video streaming media is compressed, it is transmitted to the monitoring center in the cloud for storage through the network using the embedded storage method.
需要说明的是,将音视频流媒体进行再次压缩后,采用嵌入式多媒体卡eMMC的内嵌式存储方式通过网络传输至云端的监控中心存储,通过eMMC的内嵌式存储方式简化了座舱控制器的存储单元结构和体积空间,提高了座舱控制器的存储单元储存音视频流媒体的速度。It should be noted that after re-compressing the audio and video streaming media, the built-in storage method of the embedded multimedia card eMMC is used to transmit it to the cloud monitoring center for storage through the network, and the cockpit controller is simplified through the embedded storage method of eMMC. The unique storage unit structure and volume space improve the storage unit storage speed of audio and video streaming media in the cockpit controller.
可选的,麦克风拾音器获取车辆内音频数据包括:Optionally, the acquisition of audio data in the vehicle by the microphone pickup includes:
根据车辆内不同座位位置的麦克风采集用户的音频数据。The user's audio data is collected according to the microphones at different seat positions in the vehicle.
需要说明的是,根据车辆内不同座位位置的麦克风采集用户的音频数据,一方面可以方便的将不同座位位置的用户进行分类。另一方面可以方便的将不同座位位置的用户采集的数据相互的关联在一起。根据车辆内当前座位位置的麦克风采集用户的音频数据,并将当前座位位置的音频数据与当前时段的视频数据相关联匹配。It should be noted that the user's audio data is collected according to the microphones at different seat positions in the vehicle. On the one hand, users at different seat positions can be conveniently classified. On the other hand, the data collected by users at different seat positions can be easily correlated with each other. According to the microphone of the current seat position in the vehicle, the audio data of the user is collected, and the audio data of the current seat position is associated and matched with the video data of the current period.
可选的,语音转化设备将麦克风拾音器获取的音频数据转化为文字数据包括:Optionally, the voice conversion device converts the audio data acquired by the microphone pickup into text data including:
基于车辆内不同座位位置的麦克风拾音器,获取车辆内不同座位位置的音频数据,将每个座位位置的音频数据转化为与座位位置和音频数据关联的文字数据。Based on the microphone pickups at different seat positions in the vehicle, the audio data of different seat positions in the vehicle is obtained, and the audio data of each seat position is converted into text data associated with the seat position and the audio data.
需要说明的是,基于每个座位位置的音频数据,将该座位位置用户当前时段的该音频数据与通过语文转得到的文字数据建立对应联系,使输入数据中的音视频流媒体的视频数据、音频数据,以及由该座位位置用户的音频数据语文转化得到的作为字幕和/或弹幕的文字数据建立一一对应的关联关系。It should be noted that, based on the audio data of each seat position, the audio data of the user at the seat position in the current period is associated with the text data obtained through language conversion, so that the video data of the audio and video streaming media in the input data, A one-to-one relationship is established between the audio data and the text data converted into subtitles and/or barrage from the audio data of the user at the seat position.
本申请还提供一种硬盘录像增加字幕和弹幕的装置,如附图3所示,附图3为本申请一实施例的一种硬盘录像增加字幕和弹幕装置的结构示意图,该硬盘录像增加字幕和弹幕装置300包括:The present application also provides a device for adding subtitles and barrage to hard disk video, as shown in accompanying drawing 3, and accompanying drawing 3 is a schematic structural diagram of a hard disk video adding subtitle and barrage device according to an embodiment of the present application. Adding subtitles and
输入单元310,用于获取车辆内的视频数据、音频数据,以及音频对应的文字数据作为输入数据;The
处理单元320,用于将上述输入数据输入至座舱控制器内进行数据编码/压缩获得压缩数据,存储所述压缩数据;A
读取单元330,用于读取座舱控制器内存储的所述压缩数据,对所述压缩数据进行解压缩和解码,获取解码数据,所述解码数据包含输入数据中的原始车辆内的所述视频数据、音频数据,以及音频对应的文字数据;The
显示单元340,用于显示解码数据中的所述视频数据对应的视频图像、所述音频数据对应的音频、所述音频对应的文字数据转化的音频对应的文字字幕及上述解码数据的弹幕。The
需要说明的是,上述硬盘录像增加字幕和弹幕装置300请参见上述方法说明的阐述,在此不再赘述。It should be noted that, for the above-mentioned
可选的,如附图4所示,附图4为本申请一实施例的一种硬盘录像增加字幕和弹幕方法应用的示意图。在驾驶过程中,车辆内用户互动气氛不友好时,主驾可以通过输入单元310中麦克风设备输入“听一首说明歌曲?”,由后排的用户回应“高昂一点的,哈哈哈!!!”,以及主驾旁边副驾的用户回应说“来首老歌曲吧”。可以由主驾或者后排或者副驾用户协商后,通过座舱控制器挑选对应选择的歌曲上传至车机系统控制显示单元由进行音视频流媒体数据显示,并以字幕和弹幕形式进行展示和播放。Optionally, as shown in FIG. 4, FIG. 4 is a schematic diagram of an application of a method for adding subtitles and barrage to hard disk video recording according to an embodiment of the present application. During the driving process, when the user interaction atmosphere in the vehicle is not friendly, the driver can input “Listen to an explanation song?” through the microphone device in the
本申请还提供一种电子设备,如附图5所示,附图5为本申请一实施例的一种硬盘录像增加字幕和弹幕的电子设备的结构示意图。该电子设备500包括:The present application also provides an electronic device, as shown in FIG. 5 , which is a structural schematic diagram of an electronic device for adding subtitles and barrage to a hard disk video recording according to an embodiment of the present application. The
存储器510,用于存储非暂时性计算机可读指令530;以及
处理器520,用于运行所述计算机可读指令530,使得所述计算机可读指令530被所述处理器520执行时实现上述所述的方法。The
本申请还提供一种计算机可读存储介质,该计算机可读存储介质包括计算机指令,当所述计算机指令在设备上运行时,使得所述设备执行上述所述的方法。The present application also provides a computer-readable storage medium, where the computer-readable storage medium includes computer instructions, and when the computer instructions are run on a device, the device is made to execute the method described above.
需要说明的是,流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为,表示包括一个或多个用于实现特定逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分,并且本申请的优选实施方式的范围包括另外的实现,其中可以不按所示出或讨论的顺序,包括根据所涉及的功能按基本同时的方式或按相反的顺序,来执行功能,这应被本申请的实施例所属技术领域的技术人员所理解。It should be noted that any process or method descriptions in flowcharts or otherwise described herein can be understood as representing a module including one or more codes of executable instructions for implementing specific logical functions or steps of a process , fragments or portions, and the scope of the preferred embodiments of the present application includes additional implementations in which execution may be performed out of the order shown or discussed, including substantially concurrently or in reverse order depending on the functions involved functions, which should be understood by those skilled in the art to which the embodiments of the present application belong.
在流程图中表示或在此以其他方式描述的逻辑和/或步骤,例如,可以被认为是用于实现逻辑功能的可执行指令的定序列表,可以具体实现在任何计算机可读介质中,以供指令执行系统、装置或设备(如基于计算机的系统、包括处理器的系统或其他可以从指令执行系统、装置或设备取指令并执行指令的系统)使用,或结合这些指令执行系统、装置或设备而使用。就本说明书而言,"计算机可读介质"可以是任何可以包含、存储、通信、传播或传输程序以供指令执行系统、装置或设备或结合这些指令执行系统、装置或设备而使用的装置。计算机可读介质的更具体的示例(非穷尽性列表)包括以下:具有一个或多个布线的电连接部(电子装置),便携式计算机盘盒(磁装置),随机存取存储器(RAM),只读存储器(ROM),可擦除可编辑只读存储器(EPROM或闪速存储器),光纤装置,以及便携式光盘只读存储器(CDROM)。另外,计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质,因为可以例如通过对纸或其他介质进行光学扫描,接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序,然后将其存储在计算机存储器中。The logic and/or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium, For use with instruction execution systems, devices, or devices (such as computer-based systems, systems including processors, or other systems that can fetch instructions from instruction execution systems, devices, or devices and execute instructions), or in conjunction with these instruction execution systems, devices or equipment used. For the purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate or transmit a program for use in or in conjunction with an instruction execution system, device or device. More specific examples (non-exhaustive list) of computer-readable media include the following: electrical connection with one or more wires (electronic device), portable computer disk case (magnetic device), random access memory (RAM), Read Only Memory (ROM), Erasable and Editable Read Only Memory (EPROM or Flash Memory), Fiber Optic Devices, and Portable Compact Disc Read Only Memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, since the program can be read, for example, by optically scanning the paper or other medium, followed by editing, interpretation or other suitable processing if necessary. The program is processed electronically and stored in computer memory.
应当理解,本申请的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中,多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。例如,如果用硬件来实现,和在另一实施方式中一样,可用本领域公知的下列技术中的任一项或他们的组合来实现:具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路,具有合适的组合逻辑门电路的专用集成电路,可编程门阵列(PGA),现场可编程门阵列(FPGA)等。It should be understood that each part of the present application may be realized by hardware, software, firmware or a combination thereof. In the embodiments described above, various steps or methods may be implemented by software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques known in the art: Discrete logic circuits, ASICs with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.
本技术领域的普通技术人员可以理解实现上述实施例方法携带的全部或部分步骤是可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,该程序在执行时,包括方法实施例的步骤之一或其组合。Those of ordinary skill in the art can understand that all or part of the steps carried by the methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. During execution, one or a combination of the steps of the method embodiments is included.
此外,在本申请各个实施例中的各功能单元可以集成在一个处理模块中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个模块中。上述集成的模块既可以一部分采用硬件的形式实现,也可以采用软件功能模块的形式实现。所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时,也可以存储在一个计算机可读取存储介质中。In addition, each functional unit in each embodiment of the present application may be integrated into one processing module, each unit may exist separately physically, or two or more units may be integrated into one module. The above-mentioned integrated modules can be partially implemented in the form of hardware, or can be implemented in the form of software function modules. If the integrated modules are realized in the form of software function modules and sold or used as independent products, they can also be stored in a computer-readable storage medium.
上述提到的存储介质可以是只读存储器,磁盘或光盘等。尽管上面已经示出和描述了本申请的实施例,可以理解的是,上述实施例是示例性的,不能理解为对本申请的限制,本领域的普通技术人员在本申请的范围内可以对上述实施例进行变化、修改、替换和变型。The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, and the like. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limitations on the present application, and those skilled in the art can make the above-mentioned The embodiments are subject to changes, modifications, substitutions and variations.
以上,仅是本申请的较佳实施例而已,并非对本申请作任何形式上的限制,虽然本申请已以较佳实施例揭露如上,然而并非用以限定本申请,任何熟悉本专业的技术人员,在不脱离本申请技术方案范围内,当可利用上述揭示的技术内容做出些许更动或修饰为等同变化的等效实施例,但凡是未脱离本申请技术方案内容,依据本申请的技术实质对以上实施例所作的任何简单修改、等同变化与修饰,均仍属于本申请技术方案的范围内。The above are only the preferred embodiments of the application, and do not limit the application in any form. Although the application has disclosed the above with the preferred embodiments, it is not intended to limit the application. Any skilled person familiar with this field , without departing from the scope of the technical solution of the present application, when the technical content disclosed above can be used to make some changes or be modified into equivalent embodiments with equivalent changes, but if it does not deviate from the technical solution of the application, according to the technical content of the application In essence, any simple modifications, equivalent changes and modifications made to the above embodiments still fall within the scope of the technical solutions of the present application.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211540774.4A CN116017085A (en) | 2022-12-02 | 2022-12-02 | Method, device, equipment and medium for adding subtitles and barrage to hard disk video recording |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211540774.4A CN116017085A (en) | 2022-12-02 | 2022-12-02 | Method, device, equipment and medium for adding subtitles and barrage to hard disk video recording |
Publications (1)
Publication Number | Publication Date |
---|---|
CN116017085A true CN116017085A (en) | 2023-04-25 |
Family
ID=86020784
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202211540774.4A Pending CN116017085A (en) | 2022-12-02 | 2022-12-02 | Method, device, equipment and medium for adding subtitles and barrage to hard disk video recording |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN116017085A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117556065A (en) * | 2024-01-11 | 2024-02-13 | 江苏古卓科技有限公司 | Deep learning-based large model data management system and method |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR200337893Y1 (en) * | 2003-09-30 | 2004-01-07 | 이스턴 마스텍 주식회사 | The Digital Video Recorder of vehicles |
CN109495793A (en) * | 2018-12-07 | 2019-03-19 | 武汉斗鱼鱼乐网络科技有限公司 | A kind of barrage wiring method, device, equipment and medium |
CN110493655A (en) * | 2019-08-16 | 2019-11-22 | 深圳市易汇软件有限公司 | A method of customizing subtitle in DVB program |
CN113099282A (en) * | 2021-03-30 | 2021-07-09 | 腾讯科技(深圳)有限公司 | Data processing method, device and equipment |
CN113613025A (en) * | 2020-05-05 | 2021-11-05 | 安徽文徽科技有限公司 | Method and device for real-time voice conversion subtitle data synchronous processing and picture synthesis live broadcasting |
CN114257843A (en) * | 2020-09-24 | 2022-03-29 | 腾讯科技(深圳)有限公司 | Multimedia data processing method, device, equipment and readable storage medium |
-
2022
- 2022-12-02 CN CN202211540774.4A patent/CN116017085A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR200337893Y1 (en) * | 2003-09-30 | 2004-01-07 | 이스턴 마스텍 주식회사 | The Digital Video Recorder of vehicles |
CN109495793A (en) * | 2018-12-07 | 2019-03-19 | 武汉斗鱼鱼乐网络科技有限公司 | A kind of barrage wiring method, device, equipment and medium |
CN110493655A (en) * | 2019-08-16 | 2019-11-22 | 深圳市易汇软件有限公司 | A method of customizing subtitle in DVB program |
CN113613025A (en) * | 2020-05-05 | 2021-11-05 | 安徽文徽科技有限公司 | Method and device for real-time voice conversion subtitle data synchronous processing and picture synthesis live broadcasting |
CN114257843A (en) * | 2020-09-24 | 2022-03-29 | 腾讯科技(深圳)有限公司 | Multimedia data processing method, device, equipment and readable storage medium |
CN113099282A (en) * | 2021-03-30 | 2021-07-09 | 腾讯科技(深圳)有限公司 | Data processing method, device and equipment |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117556065A (en) * | 2024-01-11 | 2024-02-13 | 江苏古卓科技有限公司 | Deep learning-based large model data management system and method |
CN117556065B (en) * | 2024-01-11 | 2024-03-26 | 江苏古卓科技有限公司 | Deep learning-based large model data management system and method |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11257493B2 (en) | Vision-assisted speech processing | |
US9667908B2 (en) | Image recording system | |
US12051397B2 (en) | Audio privacy protection for surveillance systems | |
CN204347938U (en) | Multifunctional running registering instrument | |
CN112954648B (en) | Interaction method, terminal and system of mobile terminal and vehicle-mounted terminal | |
EP4207195A1 (en) | Speech separation method, electronic device, chip and computer-readable storage medium | |
CN103037014A (en) | Vehicle-mounted system | |
CN116017085A (en) | Method, device, equipment and medium for adding subtitles and barrage to hard disk video recording | |
CN113844262A (en) | PCIE-based system, method and device for realizing double-screen interaction of vehicle-mounted system, processor and computer storage medium thereof | |
CN115225817A (en) | Intelligent vehicle shooting system | |
WO2019157917A1 (en) | Processing method for vehicle diagnostic report, device, diagnostic apparatus, and system | |
CN105530458A (en) | Remote companying driving system and remote companying driving method | |
CN113055713B (en) | Video image super-division method and device, storage medium and electronic equipment | |
WO2014201775A1 (en) | Multimedia data transmission method, and apparatus | |
EP4431340A1 (en) | Vehicle entertainment information domain controller and driving record generation method | |
US20190149793A1 (en) | Apparatus and method for recording and storing video | |
CN105469468A (en) | Novel automobile data recorder | |
CN204323099U (en) | A kind of remote vehicle control loop based on mobile Internet | |
CN114414257A (en) | Test system, method, device and storage medium for automobile | |
CN111784871A (en) | Driving recorder, vehicle-mounted multimedia device and vehicle video collection method | |
CN113409788A (en) | Voice wake-up method, system, device and storage medium | |
CN215833949U (en) | A 3D real-time rendering interactive system based on Unreal Engine 4 | |
CN110139051B (en) | Video information acquisition system and car | |
CN206400655U (en) | A new type of driving recorder | |
CN204242254U (en) | A driving recorder with voice wake-up function |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |