WO2024012113A1

WO2024012113A1 - Smart photographic system of vehicle

Info

Publication number: WO2024012113A1
Application number: PCT/CN2023/099198
Authority: WO
Inventors: 杨宇
Original assignee: 中国第一汽车股份有限公司
Priority date: 2022-07-11
Filing date: 2023-06-08
Publication date: 2024-01-18
Also published as: CN115225817A

Abstract

Disclosed in the present application is a smart photographic system of a vehicle. The smart photographic system of a vehicle comprises: a controller and a photographic apparatus, which is in wireless connection with the controller. The controller is configured to generate a startup instruction according to a specified function which is input by a user, and send the startup instruction to the photographic apparatus, wherein the specified function comprises travel planning, road condition recognition or live streaming. The photographic apparatus is configured to capture image information at a specified angle according to the startup instruction, and send the image information to the controller, wherein the photographic apparatus is mounted at a specified position inside a vehicle or at a specified position outside the vehicle. The controller is configured to receive the image information, send the image information to a cloud platform, and achieve the specified function by means of the cloud platform.

Description

Vehicle intelligent shooting system

This application claims priority to the Chinese patent application with application number 202210811751.6, which was submitted to the China Patent Office on July 11, 2022. The entire content of the above application is incorporated into this application by reference.

Technical field

This application relates to the field of vehicle photography, for example, to an intelligent vehicle photography system.

Background technique

Vehicle-mounted shooting devices mostly reuse existing in-car equipment, while outdoor shooting mostly uses four cameras with panoramic images, smart front-view cameras or driving recorders; however, users have more and more requirements. For example, when driving a vehicle, In addition to recording driving conditions, drivers also need to record the beautiful scenery they encounter while driving, so the requirements for in-car photography systems are getting higher and higher.

However, the camera of the shooting device has a single function and cannot meet the needs of the driver and passengers in many aspects.

Contents of the invention

This application provides an intelligent vehicle shooting system.

According to one aspect of the present application, a vehicle intelligent shooting system is provided, including: a controller, and a shooting device wirelessly connected to the controller;

The controller is configured to generate an opening instruction based on a specified function input by the user, and send the opening instruction to the shooting device, where the specified function includes road book, traffic condition recognition or live broadcast;

The shooting device is configured to shoot image information at a specified angle according to the opening instruction and send the image information to the controller, wherein the shooting device is installed at a designated position inside the car or a designated position outside the car;

The controller is configured to receive image information, send the image information to the cloud platform, and implement specified functions through the cloud platform.

It should be understood that the content described in this section is not intended to identify key or important features of the embodiments of the application, nor is it intended to limit the scope of the application. Other features of the present application will become readily understood from the following description.

Description of drawings

The drawings needed to be used in the description of the embodiments will be briefly introduced below. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without exerting creative efforts.

Figure 1 is a schematic structural diagram of a vehicle intelligent photography system provided according to Embodiment 1 of the present application;

Figure 2 is a schematic structural diagram of another vehicle intelligent photography system provided according to Embodiment 1 of the present application;

Figure 3 is a schematic diagram of the interaction logic between various devices of a live broadcast or route book function provided according to Embodiment 1 of the present application;

Figure 4 is a schematic structural diagram of a vehicle intelligent photography system provided according to Embodiment 2 of the present application.

Detailed ways

In order to enable those skilled in the art to better understand the embodiments of the present application, the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts should fall within the scope of protection of this application.

It should be noted that the terms "first", "second", etc. in the description and claims of this application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances so that the embodiments of the application described herein can be practiced in sequences other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, e.g., a process, method, system, product, or apparatus that encompasses a series of steps or units and need not be limited to those explicitly listed. Those steps or elements may instead include other steps or elements not expressly listed or inherent to the process, method, product or apparatus.

Embodiment 1

Figure 1 is a schematic structural diagram of a vehicle intelligent photography system provided according to Embodiment 1 of the present application. This embodiment can be applied when a driver drives a vehicle daily. The system includes: a controller 11, and a photography device wirelessly connected to the controller. 12; The controller 11 is used to generate an opening instruction according to the specified function input by the user, and sends the opening instruction to the shooting device 12, where the specified function includes a road book, road condition recognition or live broadcast; the shooting device 12 is used to shoot the specified function according to the opening instruction. Angle image information, and send the image information to the controller 11, where the shooting device 12 is installed at a designated position inside the car or a designated position outside the car; the controller 11 is used to receive image information and send the image information to the cloud platform , and realize specified functions through the cloud platform.

For example, the controller 11 refers to the vehicle engine and includes a display screen with a touch function. The user can select a specified function by touching the virtual keys on the display screen, or view an image containing a specified function through the display screen. The user is Refers to the person who operates the controller 11 inside the vehicle, which can be a driver or a passenger; designated functions include road book, road condition recognition or live broadcast; road book refers to the place that is passed during driving. Through the process of recording, road books can help drivers record driving routes during self-driving; road condition recognition refers to the process of identifying driving road condition information such as vehicles, indicators, and road signs around the current vehicle during driving. Traffic recognition can improve safety during driving and make the driving process more intelligent; live broadcast can be a live broadcast of the driver or passenger's portrait, or a real-time live broadcast of the road conditions.

In one embodiment, when the user selects a road book, traffic identification or live broadcast by touching the virtual keys on the display screen of the controller 11, the controller 11 will generate an opening instruction and send it to the shooting device 12. The shooting device 12 can be installed in the car at a designated location. position or a designated position outside the vehicle. The designated position outside the vehicle can be fixed by a fixed structure reserved during the development of the vehicle, or it can be fixed using a suction cup. In this embodiment, the shooting device 12 is not fixed at a designated position outside the vehicle. The shooting device 12 can be detached from a designated position outside the car and installed at a designated position inside the car, and capture image information at a designated angle at the designated position, and send the image information to the controller 11, which has a built-in remote communication terminal. (Telematics Box, TBOX). TBOX is a box with communication functions and contains a Subscriber Identity Module (SIM). The controller 11 can achieve networking with the cloud platform by accessing the internal SIM card; the controller 11 receives image information. Afterwards, the image information will be sent to the cloud platform. The cloud platform refers to the cloud server of the car factory, which can process the image information to realize the functions of road book, road condition recognition or live broadcast.

Figure 2 is a schematic structural diagram of another vehicle intelligent shooting system provided in Embodiment 1 of the present application. The system includes: a controller 11, a shooting device 12, including an electric base 121 and a camera 122, a voice input device 13, and a voice output device 14. Storage device 15 and in-vehicle bracket 16 .

For example, the shooting device 12 includes: an electric base 121 and a camera 122 connected to the electric base; the controller 11 is also used to receive angle information input by the user, generate a rotation instruction based on the angle information, and send the rotation instruction to the electric base 121; The electric base 121 is used to receive a rotation instruction and rotate the camera 122 to a specified angle according to the rotation instruction; the camera 122 is used to shoot at a specified angle according to the opening instruction to obtain image information.

For example, the shooting device 12 includes an upper and lower part. The upper part is a camera 122 for shooting images, and the lower part is an electric base 121 connected to the camera 122 through an axis. The user can operate the electric base 121 by inputting angle information on the controller 11. The base 121 rotates. For example, with the central axis of the vehicle as 0 degrees, when the user inputs 50 degrees through the virtual keys on the display screen of the touch controller 11, the controller 11 will generate a rotation instruction and send the rotation instruction to Electric base 121. At this time, after receiving the rotation command, the electric base 121 starts to rotate and drives the camera 122 connected to the axis to turn to the 50-degree direction through its own rotation to capture image information in the 50-degree direction, and send the captured image information to the controller. 11.

For example, the system further includes a voice input device 13 connected to the controller 11, the controller 11 also uses The opening command is sent to the voice input device 13, in which the specified function is live broadcast or road book; the voice input device 13 is used to receive the opening command, and receives the voice information input by the user according to the opening command, and sends the voice information to the controller. 11; Controller 11, used to generate a video stream based on the image information and voice information, send the video stream to the cloud platform, and receive the processed video stream obtained by the cloud platform processing the video stream, and according to the processed video Stream to realize live broadcast or road book.

Figure 3 is a schematic diagram of the interaction logic of various devices for live broadcast or road book functions. As shown in Figure 3, the voice input device 13 sends the collected voice information to the controller 11, and the shooting device 12 sends the collected image information to the controller 11. The controller 11 The image information and voice information are generated into a video stream, and the video stream is sent to the cloud platform. The cloud platform processes the video stream and generates a processed video stream and returns it to the controller 11 .

For example, when the specified function input by the user through the virtual keys on the display screen of the touch controller 11 is live broadcast or road book, the controller 11 will send an opening instruction to the voice input device 13 and the shooting device 12. After the shooting device 12 receives the opening instruction, Start collecting image information, and the voice input device 13 starts to collect the voice information input by the user after receiving the opening instruction. The voice input device 13 can be a microphone, for example, it can be set around the controller 11, that is, on the surface of the vehicle, or it can be connected through a cable and the controller. 11 Establish a connection. In this embodiment, the position and connection method of the voice input device 13 are not limited. As long as the voice input device 13 is connected to the controller 11, it is within the protection scope of this application; for example, the voice information input by the user The method may be that the user speaks into the microphone. At this time, the voice input device 13 will send the collected voice information to the controller 11. The controller 11 will generate a video stream from the received voice information and image information and send it to the cloud platform. The cloud platform will process the video stream to form a processed video stream and then feed it back to the controller 11; for example, when the user selects the road book function, the cloud platform will automatically edit the received video stream into a road book video, for example, The cloud platform can add openings, endings and soundtracks to the video stream based on the internal material library, and then send the road book video back to the controller 11 to help the user implement the road book function.

In one embodiment, the controller 11 is also used to preprocess the image information to obtain the processed image information, and preprocess the voice information to obtain the processed voice information. According to the processed image information and the processed Voice messages generate video streams.

For example, after receiving the image information and voice information, the controller 11 will perform preprocessing respectively; when the controller 11 receives the image information sent by the shooting device 12, it first performs defogging and anti-shake processing on the image information. This step is Since the shooting device 12 is outside the vehicle when shooting, the interference from the external environment is obvious, and the collected image information often degrades significantly, resulting in blurred feature information, low contrast and color distortion, which is not conducive to subsequent processing. Therefore, the collected image information is first The image information is dehazed and anti-shake; after the image information is dehazed and anti-shake, the controller 11 then scales the image information. This step is to adapt the collected image information to the live broadcast application software (Application, app). ) video resolution, scaling Then the image information is encoded, which can be H.264/H.265 encoding. After the encoding is completed, the processed image information can be obtained.

For example, when the controller 11 receives the voice information sent by the voice input device 13, it first performs analog-to-digital conversion on the voice information. This step is to convert the voice information into a digital signal and then perform the next step of processing. The converted digital signal Enter the Digital Signal Processing (DSP) for echo cancellation and noise reduction processing. This step is because the quality of the voice information collected by the voice input device 13 in the car is affected by the noise in the car such as the engine, air conditioner, human voice, multimedia, etc. Therefore, in order to ensure the user's interactive experience and recognition rate of voice information in the car scene, it is necessary to perform echo cancellation and noise reduction processing on the voice information. The implementation method can be divided into hardware noise reduction and software noise reduction. This paper In the embodiment, the method of echo cancellation and noise reduction processing is not limited; finally, the voice information is subjected to Advanced Audio Coding (AAC). After the encoding is completed, the processed voice information can be obtained. Finally, the controller 11 will The processed image information and the processed voice information are synthesized to generate a video stream and sent to the cloud platform. The cloud platform processes the video stream to form a processed video stream and then feeds it back to the controller 11 to implement corresponding functions.

In one embodiment, the system also includes a voice output device 14 connected to the controller, and the controller 11 is used to send image information to the cloud platform to extract traffic information from the image information sent by the shooting device 12 through the cloud platform, Generate traffic prompts based on the traffic information and send the traffic prompts to the voice output device 14, where the shooting device 12 is installed on the roof of the car; the voice output device 14 is used to receive the traffic prompts and make voice broadcasts according to the traffic prompts to implement designated functions. , where the designated function is road condition recognition.

For example, the system also includes a voice output device 14. The voice output device 14 establishes a communication connection with the controller 11 through a bus. The voice output device 14 can be a speaker connected to the controller 11. For example, it can be arranged around the controller 11, that is, on the surface of the vehicle. , when the user selects the function of road condition recognition by touching the virtual keys on the display screen of the controller 11, the controller 11 can send the image information collected by the shooting device 12 to the cloud platform, and the cloud platform can extract the image information based on big data. Key road condition information, such as the distance between the current vehicle and surrounding vehicles, the color and type of indicator lights, and the type of road signs, the controller can generate road condition prompts based on the road condition information, for example, when the distance between the current vehicle and surrounding vehicles is less than 5m , the controller 11 will generate a traffic prompt and send it to the voice output device 14. After receiving the traffic prompt, the voice output device 14 can perform a voice broadcast. The content of the broadcast is: the distance between the vehicles is close; the user can obtain the driving traffic conditions through the broadcast content, so as to proceed Avoidance in advance improves driving safety.

In one embodiment, the system also includes a storage device 15 connected to the controller; the controller 11 is used to send the video stream to the storage device 15, where the designated function is a road book; the storage device 15 is used to receive the video stream, and store the video stream.

For example, the system also includes a storage device 15. The storage device 15 establishes a connection with the controller 11 through a bus. When the user selects the function of the road book by touching the virtual keys on the display screen of the controller 11, the controller 11 will receive the voice information. and image information to generate a video stream and send it to the cloud platform. The cloud platform will process the video stream to form a processed video stream and then feed it back to the controller 11; the controller 11 can send the received processed video stream to the storage device 15 , the storage device 15 can be a portable computer disk, a hard disk, a random access memory (Random Access Memory, RAM), a read-only memory (Read-Only Memory, ROM), an erasable programmable read-only memory (Erasable Programmable Read-Only Memory) , EPROM) or flash memory, optical fiber, portable compact disk read-only memory (Compact Disc Read-Only Memory, CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above; for example, the cloud platform can be based on internal The material library adds openings, endings and soundtracks to the video stream, and then sends the route book video back to the controller, and the controller 11 then sends it to the storage device 15 to realize storage of the video stream.

The storage is convenient for the user to read when needed later; for example, when the user inputs a read instruction through the virtual keys on the display screen of the touch controller 11, the read instruction includes a specified time range of the road book image information, and the specified time range can be The user makes settings according to needs. After receiving the read instruction, the controller 11 will read the road book image information in the corresponding time range in the storage device 15, and then display the corresponding road book image information on the display screen of the controller 11 for the user. Display, for example, the user wants to view the road book image information generated from June 1 to 3, 2022. After inputting the read command by touching the virtual keys on the display screen of the controller 11, the controller 11 will read the read command after receiving the read command. The road book image information stored in the storage device 15 from June 1 to 3, 2022 is fed back to the controller 11 display screen for display to the user. At this time, the user can view it through the controller 11 display screen.

In one embodiment, the system also includes an in-vehicle bracket 16. The in-vehicle bracket 16 is connected to the controller 11 through a bus; the controller 11 is used to receive charging instructions input by the user and charge the in-vehicle bracket installed in the vehicle according to the charging instructions. The shooting device 12 on the mobile phone is charged.

For example, the system also includes an in-vehicle bracket 16. The in-vehicle bracket 16 is connected to the controller 11 through a bus. The in-vehicle bracket 16 can be set at any position in the car. In this embodiment, the position of the in-vehicle bracket is not limited. When the user When the shooting device 12 is removed from the car, it can be fixed on the bracket 16 in the car through the snap-in structure, and the shooting device 12 can be charged through the bracket 16 in the car. When the user touches the virtual keys on the display screen of the controller 11 When a charging instruction is input, the controller 11 can charge the photographing device 12 through the bus to ensure that the photographing device 12 maintains sufficient power to facilitate the collection of image information when needed.

In the embodiment of the present application, the shooting device is installed at a designated position inside the car or a designated position outside the car. The functions of current road book, road condition recognition or live broadcast can meet the needs of drivers and passengers in many aspects, and the shooting device can capture image information from specified angles, realizing multi-functional, multi-angle intelligent shooting inside and outside the car.

Embodiment 2

Figure 4 is a schematic structural diagram of a vehicle intelligent photography system provided in Embodiment 2 of the present application. Based on this embodiment and Embodiment 1, a terminal device 17 is added. Figure 3 includes: a controller 11, a photography device 12, an electric motor Base 121, camera 122, voice input device 13, voice output device 14, storage device 15, in-car bracket 16 and terminal device 17.

For example, the system also includes a terminal device 17 that is communicatively connected to the controller; the controller 11 is used to receive shooting instructions input by the user, extract real-time pictures from the image information according to the shooting instructions, and send the real-time pictures to the terminal device 17; terminal Device 17 is used to receive real-time pictures and display the real-time pictures.

For example, the controller 11 can also establish a connection with the terminal device 17. The connection can be a wired connection or a wireless connection. The wired connection can be connected through the mobile terminal high-definition audio and video standard interface (Mobile High-Definition Link, MHL), and the wireless connection can be through Bluetooth. Connect or connect through wireless broadband (Wireless Fidelity, WIFI); the terminal device 17 can be a mobile terminal device with a car application client installed, and the terminal device 17 includes but is not limited to mobile phones, laptops, digital broadcast receivers, Mobile terminal devices such as Personal Digital Assistant (PDA), Tablet PC (PAD) and Portable Media Player (PMP).

For example, when the user inputs a shooting instruction by touching the virtual keys on the display screen of the controller 11, the controller can extract real-time pictures from the image information according to the shooting instructions, and send the real-time pictures to the terminal device 17; at this time, the user can The captured real-time pictures are viewed through the terminal device 17 .

In one embodiment, the terminal device 17 is also used to receive control instructions input by the user and send the control instructions to the controller 11; the controller 11 is used to perform corresponding functions according to the control instructions.

For example, since the terminal device 17 has a car application client installed, the user can also input control instructions through the terminal device 17, and the terminal device 17 will send the control instructions to the controller 11, that is, the user can also control the control through the terminal device 17. The controller 11 implements corresponding functions; for example, when the user selects the shooting function on the car application client interface on the terminal device 17, the terminal device 17 will send the shooting function control instruction to the controller 11, and the controller can The shooting function control instruction extracts the real-time picture from the image information and sends the real-time picture to the terminal device 17; at this time, the user can view the captured real-time picture through the terminal device 17.

In one embodiment, the controller 11 is also used to send the processed video stream to the terminal device 17; the terminal device 17 is used to receive the processed video stream, and implement live broadcast or route book according to the processed video stream.

For example, after the controller 11 and the terminal device 17 establish a connection, the user can open the car application client. When the terminal device 17 displays the function selection interface to the user, the user can select the live broadcast or road book function. At this time, the user selection method can be The virtual key input on the display screen of the controller 11 can also be input through the vehicle application client interface selection on the terminal device 17. When the controller receives the live broadcast or road book function command, the controller 11 will send an opening command. to the voice input device 13 and the shooting device 12. The shooting device 12 starts collecting image information after receiving the opening command. The voice input device 13 starts collecting the voice information input by the user after receiving the opening command. The controller 11 will combine the received voice information and The image information generates a video stream and sends it to the cloud platform. The cloud platform processes the video stream to form a processed video stream and then feeds it back to the controller 11; the controller 11 sends the processed video stream to the terminal device 17. At this time, the user The screen of the corresponding function can be viewed through the terminal device 17; for example, when the user selects the function of reading historical road book image information on the terminal device 17, the controller 11 can read the road book image information in the user-specified time range in the storage device 15 and Sent to the terminal device 17, at this time the user can view the road book image information through the terminal device 17; when the passenger is too far away from the controller 11 and it is inconvenient to operate, the user can select functions through the terminal device to control the controller 11.

In the embodiment of the present application, the functions of road book, road condition identification or live broadcast are realized by installing the shooting device at a designated position inside the car or outside the car, which can meet the needs of drivers and passengers in many aspects, and can connect to terminal equipment through the controller. The use of the function on the terminal device makes the user's operation more convenient, and the shooting device can capture image information at specified angles, realizing multi-functional, multi-angle intelligent shooting inside and outside the car.

It should be understood that various forms of the process shown above may be used, with steps reordered, added or deleted. For example, each step described in this application can be executed in parallel, sequentially, or in a different order, which is not limited herein.

The above-mentioned specific embodiments do not constitute a limitation on the scope of protection of the present application. It will be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions are possible depending on design requirements and other factors.

Claims

A vehicle intelligent shooting system, including: a controller (11), and a shooting device (12) wirelessly connected to the controller (11);

The controller (11) is configured to generate an opening instruction according to a designated function input by the user, and send the opening instruction to the shooting device (12), wherein the designated function includes a road book, road condition recognition or live broadcast;

The photographing device (12) is configured to capture image information at a specified angle according to the opening instruction and send the image information to the controller (11), wherein the photographing device (12) is installed on the vehicle. Designated location inside or outside the vehicle;

The controller (11) is configured to receive the image information, send the image information to the cloud platform, and implement the specified function through the cloud platform.
The system according to claim 1, wherein the shooting device (12) includes: an electric base (121) and a camera (122) connected to the electric base (121),

The controller (11) is also configured to receive angle information input by the user, generate a rotation instruction based on the angle information, and send the rotation instruction to the electric base (121);

The electric base (121) is configured to receive the rotation instruction and rotate the camera (122) to a specified angle according to the rotation instruction;

The camera (122) is configured to shoot at the specified angle according to the opening instruction to obtain the image information.
The system according to claim 1 or 2, further comprising a voice input device (13) connected to the controller (11),

The controller (11) is also configured to send the opening instruction to the voice input device (13), where the designated function is live broadcast or road book;

The voice input device (13) is configured to receive the opening instruction, receive the voice information input by the user according to the opening instruction, and send the voice information to the controller (11);

The controller (11) is configured to generate a video stream based on the image information and the voice information, send the video stream to the cloud platform, and receive the cloud platform to process the video stream. The obtained processed video stream is used to implement the live broadcast or route book based on the processed video stream.
The system according to claim 1 or 2, further comprising a voice output device (14) connected to the controller (11),

The controller (11) is configured to send the image information to a cloud platform, so as to extract road condition information from the image information sent by the shooting device (12) through the cloud platform, and according to the road condition information Generate traffic prompts and send the traffic prompts to the voice output device (14), which , the shooting device (12) is installed on the roof of the car;

The voice output device (14) is configured to receive the traffic prompt and perform voice broadcast according to the traffic prompt to realize the designated function, wherein the designated function is traffic recognition.
The system according to claim 3, further comprising a storage device (15) connected to the controller (11),

The controller (11) is configured to send the video stream to the storage device (15), where the designated function is a road book;

The storage device (15) is configured to receive the video stream and store the video stream.
The system according to claim 1, further comprising an in-vehicle bracket (16), the in-vehicle bracket (16) is connected to the controller (11) through a bus;

The controller (11) is configured to receive a charging instruction input by a user, and charge the photographing device (12) installed on the in-car bracket (16) according to the charging instruction.
The system according to claim 1, further comprising a terminal device (17) communicatively connected to the controller (11);

The controller (11) is configured to receive a shooting instruction input by the user, extract a real-time picture from the image information according to the shooting instruction, and send the real-time picture to the terminal device (17);

The terminal device (17) is configured to receive the real-time picture and display the real-time picture.
The system according to claim 7, wherein the terminal device (17) is further configured to receive a control instruction input by a user and send the control instruction to the controller (11);

The controller (11) is configured to perform corresponding functions according to the control instructions.
The system according to claim 3, wherein the controller (11) is further configured to send the processed video stream to a terminal device (17);

The terminal device (17) is configured to receive the processed video stream and implement the live broadcast or route book based on the processed video stream.
The system according to claim 3, wherein the controller (11) is further configured to preprocess the image information to obtain processed image information, and preprocess the voice information to obtain the processed image information. Voice information, the video stream is generated according to the processed image information and the processed voice information.