CN115134533A

CN115134533A - Shooting method and equipment for automatically calling vehicle-mounted image acquisition device

Info

Publication number: CN115134533A
Application number: CN202211058799.0A
Authority: CN
Inventors: 郑雪蕾
Original assignee: Ningbo Joynext Technology Corp
Current assignee: Ningbo Joynext Technology Corp
Priority date: 2022-08-30
Filing date: 2022-08-30
Publication date: 2022-09-30
Anticipated expiration: 2042-08-30
Also published as: CN115134533B

Abstract

The application discloses a shooting method and equipment for automatically calling a vehicle-mounted image acquisition device, and relates to the technical field of vehicle-mounted image shooting. The method comprises the following steps: selecting a vehicle-mounted image acquisition device according to schedule information and a vehicle driving mode of a vehicle user to form an alternative vehicle-mounted image acquisition device group; acquiring and judging whether the vehicle-mounted image acquisition devices in the alternative vehicle-mounted image acquisition device group are suitable for shooting a shooting target object or not based on a shooting instruction of a vehicle user; if yes, calling the vehicle-mounted image acquisition device with the shooting direction facing the shooting target object from the alternative vehicle-mounted image acquisition device group to acquire the image of the shooting target object so as to acquire a shooting material; the shooting material is edited to generate a shooting result. By implementing the shooting method for automatically calling the vehicle-mounted image acquisition device, the appropriate vehicle-mounted image acquisition device can be called according to the shooting instruction of the user in the vehicle, the shooting material of the target object can be automatically shot and obtained, and the corresponding shooting result can be further generated.

Description

Shooting method and equipment for automatically calling vehicle-mounted image acquisition device

Technical Field

The application relates to the technical field of vehicle-mounted image shooting, in particular to a shooting method and equipment for automatically calling a vehicle-mounted image acquisition device.

Background

Along with the development of the vehicle industry, the requirement of users on the driving safety is higher and higher, and most vehicles are equipped with a driving recorder and a driver monitoring system nowadays for ensuring the driving safety. With the development of vehicle-mounted intelligent equipment, the camera device is further endowed with an additional function, namely, on the basis of ensuring the basic safety monitoring function, related camera devices are called simultaneously to acquire images or image information required by users in the vehicle. At present, the mode of acquiring images or image information through a vehicle-mounted camera device is single, and a driver or a user generally needs to select a specific vehicle-mounted image acquisition device through a vehicle-mounted key to shoot. If a driver needs to shoot in the driving process, the driver needs to pay attention to the selection of the vehicle-mounted image acquisition device and pay attention to the shooting content, so that the driving safety is seriously influenced. Therefore, a method and an apparatus for smart photographing are needed. The camera device which is most beneficial to material collection can be intelligently selected according to the shooting intention of a driver or a user, the materials are obtained, and automatic editing of the corresponding materials is completed.

Disclosure of Invention

In order to solve the technical problem of how to intelligently obtain a corresponding target shooting result according to the intention of a person in a vehicle on the basis of safe driving, the embodiment of the application provides a shooting method and equipment for automatically calling a vehicle-mounted image acquisition device, so as to solve the problems that the person in the vehicle needs to manually select the vehicle-mounted image acquisition device to shoot, the driving attention is dispersed, and the driving safety is influenced in the prior art.

In order to solve one or more of the above technical problems, the present application adopts the following technical solutions:

in a first aspect, a shooting method for automatically calling a vehicle-mounted image acquisition device is provided, and the method includes:

selecting one or more vehicle-mounted image acquisition devices according to schedule information of a vehicle user and a current vehicle driving mode to form a standby vehicle-mounted image acquisition device group;

acquiring a shooting instruction of a vehicle user, wherein the shooting instruction at least comprises a shooting target object and a shooting type;

judging whether the vehicle-mounted image acquisition devices in the standby vehicle-mounted image acquisition device group are suitable for shooting the shooting target object or not based on the shooting instruction of the vehicle user;

if yes, calling at least one vehicle-mounted image acquisition device with the shooting direction facing the shooting target object from the alternative vehicle-mounted image acquisition device group to acquire the image of the shooting target object so as to acquire a shooting material;

and editing the shooting materials according to the shooting type to generate a shooting result.

Further, the one or more vehicle-mounted image acquisition devices comprise at least one of a driving recorder, an image acquisition device outside the vehicle body and a driver monitoring system, and the one or more vehicle-mounted image acquisition devices are selected according to schedule information of a vehicle user and a current vehicle driving mode to form an alternative vehicle-mounted image acquisition device group, which comprises:

determining the trip purpose of the vehicle user according to the schedule information of the vehicle user and the current vehicle driving mode;

if the trip purpose of the vehicle user is commuting or business trip, selecting a vehicle event data recorder to form an alternative vehicle-mounted image acquisition device group;

if the trip purpose of the vehicle user is going out, selecting an image acquisition device outside the vehicle body to form an alternative vehicle-mounted image acquisition device group; or,

and if the trip purpose of the vehicle user is an in-vehicle meeting, selecting a driver monitoring system to form a standby vehicle-mounted image acquisition device set.

Further, the method for judging whether the vehicle-mounted image acquisition devices in the candidate vehicle-mounted image acquisition device group are suitable for shooting the shooting target object based on the shooting instruction of the vehicle user comprises the following steps:

acquiring vehicle coordinates, a vehicle movement direction, a shooting target relative to a vehicle position and a current time based on a shooting instruction of a vehicle user;

judging whether the shooting target object appears at the current moment or not;

if so, calling at least one vehicle-mounted image acquisition device with a shooting direction facing the shooting target object from the standby vehicle-mounted image acquisition device group according to the position of the shooting target object relative to the vehicle and the motion direction of the vehicle, and pre-shooting the shooting target object to obtain a pre-acquisition image set;

judging whether the pre-collected image set contains a shooting target object or not;

and if one or more pre-collected images in the pre-collected image set contain the shooting target object, determining that the vehicle-mounted image collection devices in the alternative vehicle-mounted image collection device group are suitable for shooting the shooting target object.

Further, at least one vehicle-mounted image acquisition device which calls the shooting direction from the candidate vehicle-mounted image acquisition device group to face the shooting target object carries out image acquisition on the shooting target object so as to obtain a shooting material, and the method comprises the following steps:

determining at least one pre-collected image which accords with a preset composition rule from one or more pre-collected images;

and carrying out image acquisition on the shooting target object by using the target vehicle-mounted image acquisition device which acquires at least one pre-acquired image so as to acquire the shooting material.

Further, the shooting type includes the photography, and the shooting material includes the camera material, uses the on-vehicle image acquisition device of target who gathers at least one pre-harvest image to carry out image acquisition to shooting the target in order to obtain the shooting material, includes:

using a target vehicle-mounted image acquisition device to acquire a static image of a shooting target object according to a preset shooting rule, and using the acquired shooting target object image as a shooting material;

editing the shooting materials according to the shooting types to generate shooting results, and the method comprises the following steps:

and rendering the photographic material according to a preset photographic rendering rule to generate a shooting result.

Further, before rendering the photographic material according to a preset photographic rendering rule to generate a photographic result, the method further includes:

acquiring at least one of emotion information, vehicle external environment information and current weather condition information of a vehicle user;

and matching and determining a preset photography rendering rule from a rendering rule base according to at least one of emotion information of a vehicle user, external environment information of the vehicle and current weather condition information.

Further, the shooting type includes making a video recording, and the shooting material includes the material of making a video recording, uses the on-vehicle image acquisition device of target who gathers at least one pre-harvest image to carry out image acquisition to shooting the target in order to obtain and shoot the material, includes:

using a target vehicle-mounted image acquisition device to acquire video images of a shooting target object according to a preset shooting rule, and taking the acquired shooting target object images as shooting materials;

editing the shooting material according to the shooting type to generate a shooting result, comprising:

and editing the camera shooting material according to a preset video editing rule to generate a shooting result.

Further, before clipping the camera material according to a preset video clipping rule to generate a shooting result, the method further comprises:

determining the number of vehicle-mounted image acquisition devices for acquiring the camera materials, wherein different numbers correspond to different video editing rules;

and matching and determining preset video clip rules from the clip rule base according to the quantity.

Further, acquiring a shooting instruction of a vehicle user comprises:

receiving voice information of a vehicle user;

performing semantic analysis on the voice information, and judging whether the voice information simultaneously contains a type keyword for indicating shooting operation and a target keyword for indicating a shooting target object;

and if so, generating a shooting instruction of the vehicle user according to the type keyword and the target keyword.

In a second aspect, a shooting device for automatically calling a vehicle-mounted image acquisition device is provided, which is characterized by comprising: the system comprises a preselection module, an instruction acquisition module, an instruction processing module, a shooting execution module and a result acquisition module;

the system comprises a preselection module, a display module and a display module, wherein the preselection module is used for selecting one or more vehicle-mounted image acquisition devices according to schedule information of a vehicle user and a current vehicle driving mode to form a standby vehicle-mounted image acquisition device group;

the command acquisition module is used for acquiring a shooting command of a vehicle user, wherein the shooting command at least comprises a shooting target object and a shooting type;

the instruction processing module is used for judging whether the vehicle-mounted image acquisition devices in the alternative vehicle-mounted image acquisition device group are suitable for shooting the shooting target object or not based on the shooting instruction of the vehicle user;

the shooting execution module is used for calling at least one vehicle-mounted image acquisition device with the shooting direction facing the shooting target object from the standby vehicle-mounted image acquisition device group to acquire the image of the shooting target object so as to acquire a shooting material;

and the result acquisition module is used for editing the shooting material according to the shooting type to generate a shooting result.

In a third aspect, a shooting system for automatically invoking a vehicle-mounted image capture device is provided, which includes a memory, a processor, and a computer program stored in the memory and operable on the processor, wherein the steps of the method described in the first aspect are implemented when the processor executes the computer program.

In a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored, wherein the computer program, when being executed by a processor, implements the steps of the method according to the first aspect.

The technical scheme provided by the embodiment of the application has the following beneficial effects:

1. and according to a shooting instruction of a user in the vehicle, calling a proper vehicle-mounted image acquisition device to automatically shoot and acquire a shooting material of the target object, and further generating a corresponding shooting result.

Recognizing a shooting instruction in the voice of a driver or a user in the vehicle through semantic analysis, and calling a corresponding camera to execute a shooting task, so that the relevant camera is controlled to execute the shooting task through the voice;

2. by identifying the target object in the shooting instruction, the vehicle-mounted camera most favorable for shooting the target object is called to shoot the target object, so that the quality of obtaining image materials in a driving environment is improved;

3. according to the obtained information such as the facial expression of the driver, the environment outside the vehicle, the weather and the like, editing and rendering the shot material to obtain an image which is suitable for the driver to view and is beneficial to improving the emotion of the driver;

4. through voice control, shooting, generating and editing, the images are finally obtained, the driving safety of the vehicle is improved, the images which the personnel in the vehicle want to capture can be obtained in time, and the driving experience is improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic diagram of a shooting method for automatically invoking a vehicle-mounted image acquisition device according to an embodiment of the present application;

FIG. 2 is a schematic diagram of a shooting device for automatically invoking a vehicle-mounted image acquisition device according to an embodiment of the present disclosure;

FIG. 3 is a schematic diagram of a shooting system for automatically invoking a vehicle-mounted image capturing device according to an embodiment of the present disclosure;

fig. 4 is a schematic diagram of a method for automatically calling a shooting sunset video of a vehicle-mounted image acquisition device according to an embodiment of the present application;

fig. 5 is a schematic diagram of a method for taking a ancient pagoda photo by automatically invoking a vehicle-mounted image acquisition device according to an embodiment of the present application.

Detailed Description

To make the objects, technical solutions and advantages of the present application more clear, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of examples of the present application, and not all examples. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

Unless defined otherwise, technical or scientific terms used herein shall have the ordinary meaning as understood by one of ordinary skill in the art to which this disclosure belongs. The use of "first," "second," and similar terms in this disclosure is not intended to indicate any order, quantity, or importance, but rather is used to distinguish one element from another. Also, the use of the terms "a," "an," or "the" and similar referents do not denote a limitation of quantity, but rather denote the presence of at least one. The reference numerals in the drawings in the specification merely indicate the distinction between the respective functional components or modules, and do not indicate the logical relationship between the components or modules. The word "comprising" or "comprises", and the like, means that the element or item listed before the word covers the element or item listed after the word and its equivalents, but does not exclude other elements or items. The terms "connected" or "coupled" and the like are not restricted to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "upper", "lower", "left", "right", and the like are used only to indicate relative positional relationships, and when the absolute position of the object being described is changed, the relative positional relationships may also be changed accordingly.

Hereinafter, various embodiments according to the present disclosure will be described in detail with reference to the accompanying drawings. It is to be noted that, in the drawings, the same reference numerals are given to constituent parts having substantially the same or similar structures and functions, and repeated description thereof will be omitted.

The vehicle-mounted image acquisition device aims at solving the problem that in the prior art, when people in a vehicle need to acquire pictures through the vehicle-mounted image acquisition device, the safety of driving is affected by manual setting. The embodiment of the application discloses a shooting method and equipment for automatically calling a vehicle-mounted image acquisition device. The whole process does not need manual operation and control, and the driving safety is greatly improved.

In one embodiment, as shown in fig. 1, a photographing method for automatically invoking an in-vehicle image capturing apparatus includes:

s10: and selecting one or more vehicle-mounted image acquisition devices according to the schedule information of the vehicle user and the current vehicle driving mode to form a standby vehicle-mounted image acquisition device group.

S20: and acquiring a shooting instruction of a vehicle user, wherein the shooting instruction at least comprises a shooting target object and a shooting type.

S30: and judging whether the vehicle-mounted image acquisition devices in the standby vehicle-mounted image acquisition device group are suitable for shooting the shooting target object or not based on the shooting instruction of the vehicle user.

If yes, go to S40: and calling at least one vehicle-mounted image acquisition device with the shooting direction facing the shooting target object from the standby vehicle-mounted image acquisition device group to acquire the image of the shooting target object so as to acquire a shooting material.

S50: and editing the shooting materials according to the shooting type to generate a shooting result.

In another embodiment, S10: and selecting one or more vehicle-mounted image acquisition devices according to the schedule information of the vehicle user and the current vehicle driving mode to form a standby vehicle-mounted image acquisition device group. The one or more vehicle-mounted image acquisition devices include at least one of a drive recorder, an image acquisition device outside the vehicle body, and a Driver Monitor System (DMS).

According to schedule information of a vehicle user and a current vehicle driving mode, one or more vehicle-mounted image acquisition devices are selected to form an alternative vehicle-mounted image acquisition device group, and the method comprises the following steps:

s11: determining the trip purpose of the vehicle user according to the schedule information of the vehicle user and the current vehicle driving mode, specifically:

s111: and if the schedule information of the vehicle user indicates that the working events will occur in the preset future time period or the working events are ended in the preset past time period, and/or the current driving mode of the vehicle is a common mode or an economic mode, determining that the trip purpose of the vehicle user is commuting or business trip.

S112: and if the schedule information of the vehicle user indicates that the trip event will occur in the preset future time period and the current vehicle driving mode is the motion mode, determining that the trip purpose of the vehicle user is the trip.

S113: and if the schedule information of the vehicle user indicates that the vehicle user is in the meeting at present, determining that the trip purpose of the vehicle user is the in-vehicle meeting.

S12: and if the trip purpose of the vehicle user is commuting or business trip, selecting the automobile data recorder to form an alternative vehicle-mounted image acquisition device group.

S13: and if the trip purpose of the vehicle user is going out, selecting the image acquisition devices outside the vehicle body to form an alternative vehicle-mounted image acquisition device group.

Or, S14: and if the trip purpose of the vehicle user is an in-vehicle meeting, selecting a driver monitoring system to form a standby vehicle-mounted image acquisition device set.

Selecting one or more vehicle-mounted image acquisition devices according to schedule information of a vehicle user and a current vehicle driving mode, forming a candidate vehicle-mounted image acquisition device group, and further comprising:

s15: and starting the alternative vehicle-mounted image acquisition device group. According to the method, the vehicle-mounted image acquisition device set is pre-screened and started, and shooting can be performed after voice information of a user is acquired, so that the timeliness of acquiring shooting materials is guaranteed.

S20: the method comprises the steps of obtaining a shooting instruction of a vehicle user, wherein the shooting instruction at least comprises a shooting target object and shooting types, and the shooting types comprise shooting and image pickup. The general form of the shooting instruction is: "shoot _ object _ photo/video", for example: "shoot _ sunset _ video" or "shoot _ guta _ photo". The method specifically comprises the following steps:

s21: voice information of a vehicle user is received.

S22: and performing semantic analysis on the voice information, and judging whether the voice information simultaneously contains a type keyword for indicating shooting operation and a target keyword for indicating a shooting target object. By performing semantic analysis on the received voice information, a type keyword for indicating a photographing operation and a target keyword for indicating a photographing target object are extracted therefrom. Specifically, the type keyword indicating the photographing operation can be recognized by artificial intelligence as a specific photographing operation, for example: "photograph", etc. may be recognized as a "photograph" operation; "taking video", "shooting", and the like are recognized as "shooting" operations. The target keyword may be a person or any object or combination of objects having a shape, such as: sunset, ancient towers, etc. A photographing instruction at least needs to include a photographing operation type and a photographing target for performing a corresponding photographing operation on a certain target once, and if both are used, the photographing instruction can be generated according to the type keyword and the target keyword as in S23.

If yes, go to S23: and generating a shooting instruction of the vehicle user according to the type keyword and the target keyword.

If only the type keywords of the shooting operation are recognized, returning a voice prompt by the vehicle machine, wherein the voice prompt comprises but is not limited to: the specific content of the specific voice prompt is not limited in the application; if only the shooting target object is identified, the corresponding voice information is not considered. When the lack of the keyword is recognized, no matter the shooting type or the shooting target object is lacked, the shooting operation is not triggered.

The shooting instruction is obtained through semantic analysis of voice information of the vehicle user. The vehicle user issues the shooting instruction through voice, so that the manual shooting operation of the vehicle user in the driving process is avoided, the vehicle user is enabled to concentrate on driving, and the driving safety is improved.

S30: whether the vehicle-mounted image acquisition devices in the standby vehicle-mounted image acquisition device group are suitable for shooting the shooting target object or not is judged based on the shooting instruction of the vehicle user, and the method specifically comprises the following steps:

s31: acquiring vehicle coordinates, a vehicle movement direction, a shooting target relative to a vehicle position and a current time based on a shooting instruction of a vehicle user; as for the orientation of the vehicle body and the photographic target, the orientation may be determined by, for example: and the navigation systems such as Beidou, GPS, Glonass, Galileo and the like. According to the departure place and the destination of the vehicle body operation, the direction of the vehicle head and the vehicle operation state are obtained by combining navigation data; and calling the vehicle-mounted image acquisition device with the shooting direction facing the shooting target object to perform image pre-acquisition on the shooting target object according to the orientation of the vehicle head and the direction of the shooting target object. In one embodiment, for the vehicle-mounted image capturing device with an adjustable shooting angle, an initial angle of the relevant vehicle-mounted image capturing device needs to be additionally obtained, so that after the shooting operation is completed, the shooting angle of the relevant vehicle-mounted image capturing device is reset, and the vehicle-mounted image capturing device continues to run the original functions, for example: providing a car backing image, or recording driving.

S32: and judging whether the shooting target object appears at the current moment. For some shooting targets related to time, such as "sunset" and the like, comparison needs to be performed according to the current time and the time period when the corresponding shooting target appears, so that related time information needs to be collected.

If yes, go to S33: and calling at least one vehicle-mounted image acquisition device with a shooting direction facing the shooting target object from the standby vehicle-mounted image acquisition device group according to the position of the shooting target object relative to the vehicle and the motion direction of the vehicle, and pre-shooting the shooting target object to obtain a pre-acquisition image set.

If not, S33 ʹ: the prompt "the shooting target cannot be acquired at the current time period".

Preferably, after the prompt of "the shooting target cannot be acquired in the current time period", a time period in which the next shooting target appears may also be prompted.

S34: judging whether the pre-collected image set contains a shooting target object or not;

if one or more pre-captured images in the pre-captured image set contain the shooting target object, executing S35: and determining that the vehicle-mounted image acquisition devices in the candidate vehicle-mounted image acquisition device group are suitable for shooting the shooting target object.

At the moment, the vehicle-mounted image acquisition devices in the candidate vehicle-mounted image acquisition device group are adopted to meet the current shooting requirement, and when shooting is executed, proper vehicle-mounted image acquisition devices are directly called from the candidate vehicle-mounted image acquisition device group, so that whether other vehicle-mounted image acquisition devices are suitable for executing the current shooting instruction or not is not required to be further screened.

In one embodiment, if the shooting direction of the vehicle-mounted image acquisition devices is not adjustable, at the current moment, the images of the shooting target objects acquired by the vehicle-mounted image acquisition devices are acquired and used as the pre-acquired images to form a pre-acquired image set. If at least one pre-collected image in the pre-collected image set contains the shooting target object, the image collecting device carrier is suitable for shooting the shooting target object.

In another embodiment, taking the shooting direction of the vehicle-mounted camera device as an example, at the current moment, the shooting target images collected by the devices are queried to collect pre-collected images at various angles within the respective maximum visual field range, so as to form a pre-collected image set. If at least one pre-collected image in the pre-collected image set contains the shooting target object, the image collecting device carrier is suitable for shooting the shooting target object.

Preferably, images in the pre-collected image set are screened according to a preset composition rule, a camera with a shooting angle adjusted to meet the preset composition rule is selected to shoot a shooting target, and the obtained shooting material is more suitable for appreciation.

If the shooting target object is not suitable for shooting, for example: "cannot acquire the target", and the like, and the specific presentation form is not limited.

If yes, go to S40: calling at least one vehicle-mounted image acquisition device with a shooting direction facing a shooting target object from the standby vehicle-mounted image acquisition device group to acquire the image of the shooting target object so as to acquire a shooting material, wherein if the camera device configured for the automobile has an angle adjusting function, the shooting direction can be adjusted according to the positions of the target object and the automobile body; if the image pickup device provided in the automobile does not have the angle adjustment function, the image pickup device does not have the angle adjustment function. The method specifically comprises the following steps:

s41: determining at least one pre-collected image which accords with a preset composition rule from one or more pre-collected images;

s42: and carrying out image acquisition on the shooting target object by using the target vehicle-mounted image acquisition device which acquires at least one pre-acquired image so as to acquire the shooting material. Further confirming the vehicle-mounted image acquisition device executing the shooting instruction. For the camera device with adjustable shooting angle, the corresponding vehicle-mounted image acquisition device is acquired, and meanwhile, the shooting angle can be set according to the preset composition rule. The angle enables the shooting direction of the corresponding vehicle-mounted camera device to face the shooting target object, and the shooting target object meets the preset composition rule.

When the shooting type comprises shooting and the corresponding shooting material comprises shooting material, correspondingly executing the following steps:

s421: and using the target vehicle-mounted image acquisition device to acquire a static image of the shooting target object according to a preset shooting rule, and using the acquired image of the shooting target object as a shooting material.

The preset photography rule is as follows: if the shooting instruction comprises the shooting quantity; judging whether the shooting number is more than or equal to 2; if the result of judging whether the shooting quantity is greater than or equal to 2 is yes, after the shooting instruction identification is completed, using the image acquisition devices corresponding to the pre-acquired images according with the preset composition rule, and acquiring the shooting target object images with the shooting quantity as the shooting material by each called vehicle-mounted image acquisition device according to the preset shooting interval time. And if the result of judging whether the shooting quantity is greater than or equal to 2 is negative, respectively shooting a shooting target object image as a shooting material by using the image acquisition devices corresponding to the pre-acquired images according with the preset composition rule after the shooting instruction identification is finished. The user can also edit other shooting rules in advance, and the specific shooting rule is not limited in the application.

S51: editing the shooting material according to the shooting type to generate a shooting result, comprising:

s52: and rendering the photographic material according to a preset photographic rendering rule to generate a shooting result.

The picture corresponding to the shooting instruction can be shot and obtained by executing the steps.

S501: at least one of emotion information of a vehicle user, vehicle external environment information, and current weather condition information is acquired. The emotion information of the vehicle user is obtained by monitoring the expression of the vehicle user at least through the DMS; the external environment information of the vehicle is at least obtained through navigation positioning, and the current weather condition is at least obtained through real-time weather forecast. Data support is provided for rendering rules.

S502: and matching and determining a preset photography rendering rule from a rendering rule base according to at least one of emotion information of a vehicle user, external environment information of the vehicle and current weather condition information. And rendering the shot photo by adopting a corresponding rendering rule, so that the photo is more in line with the emotion of a vehicle user, the environment of the vehicle or the current weather condition.

The rendering rule base at least comprises the following rendering rules:

rendering the photographic materials according to the emotion of personnel inside the image acquisition device carrier and/or the real-time weather outside the image acquisition device carrier; the emotion of the internal personnel is acquired by a camera arranged in the image acquisition device carrier and is obtained through analysis; interior personnel include vehicle drivers and vehicle passenger users. And acquiring facial images of the internal personnel through a DMS camera, and identifying the facial images by adopting artificial intelligence to analyze and obtain the emotion of the internal personnel.

The real-time weather outside the image acquisition device carrier is obtained by data provided by a weather forecast system.

Rendering camera material according to the emotion of a person inside the image acquisition device carrier comprises:

if the emotion of the internal person is sadness, the tone of the photographic material is adjusted to be bright and bright, and the brightness value is increased; if the emotion of the inside person is angry, adjusting the color tone of the photographic material to be a cool color tone, and reducing the brightness value; if the emotion of the insider is happy, adjusting the tone of the photographic material to be a middle tone;

rendering photographic material according to weather external to an image capture device carrier includes:

and adding a filter effect to the photographic material according to real-time weather.

When the shooting type comprises shooting and the corresponding shooting material comprises shooting material, the following steps are correspondingly executed:

s421 ʹ: carrying out video image acquisition on a shooting target object by using a target vehicle-mounted image acquisition device according to a preset shooting rule, and taking the acquired shooting target object image as a shooting material;

the preset shooting rule is as follows: judging whether the shooting instruction contains shooting duration or not; if yes, after the shooting instruction is identified, using image acquisition devices corresponding to pre-acquired images which accord with preset composition rules, and acquiring shooting target object videos with the shooting duration as the shooting duration by each called vehicle-mounted image acquisition device according to the shooting duration as shooting materials. The above photographing or imaging operation is performed within 3 to 10 seconds after the voice information is received, because: the computer needs to perform semantic analysis and corresponding camera invocation. Preferably, shooting is started within 5 seconds after the voice information is received, so that the people in the vehicle have better user experience. After the shooting operation is completed, for the shooting device with the adjustable shooting angle, the angle of the shooting device needs to be restored to the initial state, so that the corresponding device can continuously execute the original function.

S51 ʹ: editing the shooting materials according to the shooting types to generate shooting results, and the method comprises the following steps:

s52 ʹ: and editing the camera shooting material according to a preset video editing rule to generate a shooting result.

And shooting and acquiring the video corresponding to the shooting instruction by executing the steps.

S501 ʹ: determining the number of vehicle-mounted image acquisition devices for acquiring the camera materials, wherein different numbers correspond to different video editing rules;

s502 ʹ: and matching and determining preset video clip rules from the clip rule base according to the quantity. Through editing, the scenes presented by the video are smoother, and the viewing experience of the vehicle user on the scenes in the video is improved.

The clipping rule base at least comprises the following clipping rules:

if the camera shooting material only comprises the camera shooting material of the shooting target object collected by the vehicle-mounted image collecting device, editing the camera shooting material according to a first editing rule; and if the camera shooting materials at least comprise camera shooting materials of the shooting target objects respectively collected by the two vehicle-mounted image collecting devices, the camera shooting materials are edited according to a second editing rule. The first clipping rule includes: editing a section of camera shooting material into a preset duration shooting result, wherein each frame image contained in the shooting result has good matching performance relative to a preset composition rule; the second clipping rule includes: analyzing images acquired by each vehicle-mounted image acquisition device frame by frame in a shooting material, selecting a plurality of one or more frame images with highest image goodness of fit as clipping points, and combining video images before and after the clipping points to form a video with preset duration as a shooting result;

preferably, the second clipping rule may further include: and processing one or more frame images before and after the clipping point by adopting a matching algorithm, so that the video image obtained by clipping is more suitable for viewing.

The camera shooting material can also be directly output as a shooting result, and the vehicle interior personnel can manually clip the camera shooting material as the shooting result.

By executing the steps, the shooting task is executed and the shooting result is obtained by controlling the relevant camera through voice, so that the manual shooting operation of a vehicle user in the driving process is avoided, the vehicle user can drive in a concentrated manner, and the driving safety is improved; through the rendering or clipping of the shooting materials, the visual and sensory experience of the vehicle user on the shooting result is improved.

In another embodiment, the photographing material is edited according to the photographing type to generate a photographing result, and the photographing result may also be obtained by manually editing after the material is derived.

In another embodiment, as shown in fig. 2, a photographing apparatus for automatically invoking an in-vehicle image capturing device includes: the system comprises a preselection module, an instruction acquisition module, an instruction processing module, a shooting execution module and a result acquisition module.

And the preselection module is used for selecting one or more vehicle-mounted image acquisition devices according to the schedule information of the vehicle user and the current vehicle driving mode to form a standby vehicle-mounted image acquisition device group.

The command acquisition module is used for acquiring a shooting command of a vehicle user, and the shooting command at least comprises a shooting target object and a shooting type.

And the instruction processing module is used for judging whether the vehicle-mounted image acquisition devices in the standby vehicle-mounted image acquisition device group are suitable for shooting the shooting target object or not based on the shooting instruction of the vehicle user.

And the shooting execution module is used for calling at least one vehicle-mounted image acquisition device with the shooting direction facing the shooting target object from the standby vehicle-mounted image acquisition device group to acquire the shooting material.

In another embodiment, as shown in fig. 3, a photographing system for automatically invoking an in-vehicle image capturing device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the photographing method for automatically invoking an in-vehicle image capturing device according to the first aspect when executing the computer program.

In another embodiment, a computer-readable storage medium has stored thereon a computer program which, when executed by a processor, implements the steps of the above-mentioned first aspect for automatically invoking the photographing method of the in-vehicle image capturing apparatus.

All the above optional technical solutions may be combined arbitrarily to form optional embodiments of the present application, and are not described herein again.

Example one

As shown in fig. 1, a shooting method for automatically invoking a vehicle-mounted image capturing device includes:

Example two

In the following, referring to fig. 4, taking an example of automatically invoking a shooting method of a vehicle-mounted image capture device to shoot a sunset video, the shooting method described in the present application is described in detail.

According to the travel purpose of the vehicle user and the current vehicle driving mode, the automobile data recorders at the head and the tail of the vehicle are selected to form an alternative vehicle-mounted image acquisition device set.

Voice information of "shooting a video of a sunset" is received. And performing semantic analysis on the voice information, and judging whether the voice information simultaneously contains a type keyword for indicating shooting operation as 'shooting' and a target keyword for indicating a shooting target object as 'sunset'. Generating a shooting instruction according to the type keywords and the target keywords: "shoot _ sunset _ video". And identifying that the shooting target object is the sun, and judging whether an image acquisition device carried by the image acquisition device carrier is suitable for shooting the shooting target object. At least acquiring the coordinates of the image acquisition device carrier, the motion direction of the image acquisition device carrier, the position of the shooting target object relative to the image acquisition device carrier, and the shooting current moment. And judging whether the shooting target object appears at the shooting current moment. And calling one or more shooting directions to a camera device of the shooting target object according to the direction of the shooting target object relative to the image acquisition device carrier and the motion direction of the image acquisition device carrier, and carrying out image pre-acquisition on the shooting target object to obtain a pre-acquisition image set.

If not, prompting that the sunset video cannot be acquired at the current time period.

Judging whether the pre-collected image contains a shooting target object; if the at least one pre-collected image contains the shooting target object, the image collecting device carrier is suitable for shooting the shooting target object. If yes, calling one or more vehicle-mounted image acquisition devices with the shooting direction facing the shooting target object to acquire the shooting material by carrying out image acquisition on the shooting target object, and acquiring the shooting material. And in the pre-collected image set, selecting one or more pre-collected images of the shooting target object which accord with a preset composition rule, and carrying out image collection on the shooting target object by using an image collection device corresponding to the pre-collected images which accord with the preset composition rule to obtain a shooting material.

Editing the shooting material, and generating a shooting result corresponding to the shooting type and containing the shooting target object. And editing the camera shooting materials according to a preset editing rule to obtain a shooting result. The camera shooting material only comprises a camera shooting material of a shooting target object collected by a vehicle-mounted image collecting device, and the camera shooting material is edited according to a first editing rule: and editing a 30-second sunset video into a shooting result with the preset duration of 10 seconds. Each frame of image contained in the shooting result has good matching performance relative to a preset composition rule.

EXAMPLE III

The following describes the photographing method described in the present application in detail by taking an example of automatically invoking the photographing method of the vehicle-mounted image capturing device to take a ancient pagoda photo in conjunction with fig. 5.

And determining the trip purpose as the trip according to the trip purpose of the vehicle user and the current vehicle driving mode, and selecting the vehicle body external image acquisition devices to form a standby vehicle-mounted image acquisition device group.

Voice information of "take a picture of a ancient tower" is received. And performing semantic analysis on the voice information, and judging whether the voice information simultaneously contains a type keyword for indicating shooting operation as 'photography' and a target keyword for indicating a shooting target object as 'ancient tower'. If yes, generating a shooting instruction according to the type keywords and the target keywords: "shoot _ guta _ photo".

The shooting target object is identified as the ancient pagoda, and whether the image acquisition device carried by the image acquisition device carrier is suitable for shooting the shooting target object or not is judged. At least acquiring the coordinates of the image acquisition device carrier, the motion direction of the image acquisition device carrier, the position of the shooting target object relative to the image acquisition device carrier, and the shooting current moment. And judging whether the shooting target object appears at the current shooting moment. If so, calling one or more shooting directions to a camera device for shooting the target object according to the position of the shooting target object relative to the image acquisition device carrier and the motion direction of the image acquisition device carrier, and carrying out image pre-acquisition on the shooting target object to obtain a pre-acquisition image set.

If not, prompting that the shooting target object cannot be obtained in the current time period.

Judging whether the pre-collected image contains a shooting target object or not; if the at least one pre-collected image contains the shooting target object, the image collecting device carrier is suitable for shooting the shooting target object. If yes, calling one or more vehicle-mounted image acquisition devices with the shooting direction facing the shooting target object to acquire the shooting material by carrying out image acquisition on the shooting target object, and acquiring the shooting material. And in the pre-collected image set, selecting one or more pre-collected images of the shooting target object which accord with a preset composition rule, and carrying out image collection on the shooting target object by using an image collection device corresponding to the pre-collected images which accord with the preset composition rule to obtain a shooting material.

Editing the shooting material, and generating a shooting result which corresponds to the shooting type and contains the shooting target object.

And rendering the photographic material according to a preset rendering rule to obtain a shooting result. And when the DMS camera detects that the emotion of the driver is sadness, the color tone of the ancient tower photo serving as the photographic material is adjusted to be bright, and the brightness value is increased to relieve the sadness of the driver.

Example four

As shown in fig. 2, a photographing apparatus for automatically invoking an in-vehicle image capturing device includes: the system comprises a preselection module, an instruction acquisition module, an instruction processing module, a shooting execution module and a result acquisition module.

And the preselection module is used for selecting one or more vehicle-mounted image acquisition devices according to schedule information of a vehicle user and the current vehicle driving mode to form a standby vehicle-mounted image acquisition device group.

EXAMPLE five

With reference to fig. 3, a photographing system for automatically invoking a vehicle-mounted image capturing device is described below, which includes a memory, a processor, and a computer program stored in the memory and running on the processor, and is characterized in that when the processor executes the computer program, the step of automatically invoking the photographing method of the vehicle-mounted image capturing device described in the first aspect is implemented, and specifically includes:

s111: if the schedule information of the vehicle user indicates that working events will occur in a preset future time period or have working events finished in a preset past time period, and/or the current vehicle driving mode is a common mode or an economic mode, determining that the traveling purpose of the vehicle user is commuting or business trip;

s112: if the schedule information of the vehicle user indicates that the travel events will occur in the preset future time period and the current vehicle driving mode is the motion mode, determining that the travel purpose of the vehicle user is travel;

Or, S14: and if the trip purpose of the vehicle user is an in-vehicle meeting, selecting a driver monitoring system to form an alternative vehicle-mounted image acquisition device group.

S15: and starting the alternative vehicle-mounted image acquisition device group.

S20: and acquiring a shooting instruction of a vehicle user. The method specifically comprises the following steps:

s21: voice information of a vehicle user is received.

S22: and performing semantic analysis on the voice information, and judging whether the voice information simultaneously contains a type keyword for indicating shooting operation and a target keyword for indicating a shooting target object.

s31: based on a shooting instruction of a vehicle user, vehicle coordinates, a vehicle movement direction, a shooting target relative to a vehicle position and a current time are acquired.

S32: and judging whether the shooting target object appears at the current moment. For some shooting target objects related to the time, such as "sunset" and the like, comparison needs to be performed according to the current time and the time period when the corresponding shooting target object appears, so that related time information needs to be collected.

If yes, go to S40: and calling at least one vehicle-mounted image acquisition device with the shooting direction facing the shooting target object from the standby vehicle-mounted image acquisition device group to acquire the image of the shooting target object so as to acquire a shooting material. The method specifically comprises the following steps:

s42: and carrying out image acquisition on the shooting target object by using the target vehicle-mounted image acquisition device which acquires at least one pre-acquired image so as to acquire the shooting material.

When the shooting type includes shooting and the corresponding shooting material includes shooting material, the following is correspondingly performed:

S501: at least one of emotion information of a vehicle user, vehicle external environment information, and current weather condition information is acquired.

S502: and matching and determining a preset photography rendering rule from a rendering rule base according to at least one of emotion information of a vehicle user, external environment information of the vehicle and current weather condition information.

s421 ʹ: using a target vehicle-mounted image acquisition device to acquire video images of a shooting target object according to a preset shooting rule, and taking the acquired shooting target object images as shooting materials;

s51 ʹ: editing the shooting material according to the shooting type to generate a shooting result, comprising:

And shooting and acquiring the video corresponding to the shooting instruction by executing the above steps.

s502 ʹ: and matching and determining preset video clip rules from the clip rule base according to the quantity.

EXAMPLE six

A computer-readable storage medium, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the steps of the method for automatically invoking the shooting method of the vehicle-mounted image capturing apparatus described in the first aspect, and specifically includes:

s111: if the schedule information of the vehicle user indicates that a work item will occur in a preset future time period or the work item is finished in a preset past time period, and/or the current vehicle driving mode is a common mode or an economic mode, determining that the trip purpose of the vehicle user is commuting or business trip;

s112: if the schedule information of the vehicle user indicates that the trip event will occur in the preset future time period and the current vehicle driving mode is the motion mode, determining that the trip purpose of the vehicle user is the trip;

s21: voice information of a vehicle user is received.

s421: and using the target vehicle-mounted image acquisition device to acquire static images of the shooting target object according to a preset shooting rule, and taking the acquired shooting target object images as shooting materials.

In particular, according to embodiments of the application, the processes described above with reference to the flow diagrams may be implemented as computer software programs. For example, embodiments of the present application include a computer program product comprising a computer program loaded on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means, or installed from the memory, or installed from the ROM. The computer program, when executed by an external processor, performs the above-described functions defined in the methods of embodiments of the present application.

It should be noted that the computer readable medium of the embodiments of the present application may be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In embodiments of the application, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In embodiments of the present application, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the foregoing.

The computer readable medium may be embodied in the server; or may exist separately and not be assembled into the server. The computer readable medium carries one or more programs which, when executed by the server, cause the server to: when the peripheral mode of the terminal is detected to be not activated, acquiring a frame rate of an application on the terminal; when the frame rate meets the screen-off condition, judging whether a user is acquiring screen information of the terminal; and controlling the screen to enter an immediate dimming mode in response to the judgment result that the user does not acquire the screen information of the terminal.

Computer program code for carrying out operations for embodiments of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, the system or system embodiments are substantially similar to the method embodiments and therefore are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for related points. The above-described system and system embodiments are only illustrative, wherein the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.

The technical solutions provided by the present application are introduced in detail, and specific examples are applied in the description to explain the principles and embodiments of the present application, and the descriptions of the above examples are only used to help understanding the method and the core ideas of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, the specific embodiments and the application range may be changed. In view of the above, the description should not be taken as limiting the application.

The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims

1. A shooting method for automatically calling a vehicle-mounted image acquisition device is characterized by comprising the following steps:

if yes, calling at least one vehicle-mounted image acquisition device with the shooting direction facing the shooting target object from the standby vehicle-mounted image acquisition device group to acquire the image of the shooting target object so as to acquire shooting materials;

and editing the shooting material according to the shooting type to generate a shooting result.

2. The shooting method for automatically invoking the vehicle-mounted image capturing device according to claim 1, wherein the one or more vehicle-mounted image capturing devices comprise at least one of a driving recorder, an image capturing device outside a vehicle body and a driver monitoring system, and the one or more vehicle-mounted image capturing devices are selected according to schedule information of a vehicle user and a current vehicle driving mode to form an alternative vehicle-mounted image capturing device group, comprising:

and if the trip purpose of the vehicle user is an in-vehicle meeting, selecting a driver monitoring system to form an alternative vehicle-mounted image acquisition device group.

3. The shooting method for automatically invoking the vehicle-mounted image capturing device according to claim 1, wherein the determining whether the vehicle-mounted image capturing device in the alternative vehicle-mounted image capturing device group is suitable for shooting the shooting target object based on the shooting instruction of the vehicle user comprises:

acquiring vehicle coordinates, a vehicle motion direction, a shooting target object relative to a vehicle position and a current moment based on the shooting instruction of the vehicle user;

if yes, calling at least one vehicle-mounted image acquisition device with a shooting direction facing the shooting target object from the standby vehicle-mounted image acquisition device group according to the position of the shooting target object relative to the vehicle and the motion direction of the vehicle, and pre-shooting the shooting target object to obtain a pre-acquisition image set;

judging whether the pre-collected image set contains the shooting target object or not;

if one or more pre-collected images in the pre-collected image set contain the shooting target object, determining that the vehicle-mounted image collection devices in the alternative vehicle-mounted image collection device group are suitable for shooting the shooting target object.

4. The shooting method for automatically invoking the vehicle-mounted image capturing device according to claim 3, wherein the invoking of at least one vehicle-mounted image capturing device from the candidate vehicle-mounted image capturing device group, the shooting direction of which is towards the shooting target object, performs image capturing on the shooting target object to obtain shooting materials, comprises:

determining at least one pre-collected image which accords with a preset composition rule from the one or more pre-collected images;

and acquiring the image of the shooting target object by using the target vehicle-mounted image acquisition device which acquires the at least one pre-acquired image so as to acquire the shooting material.

5. The method according to claim 4, wherein the shooting type comprises shooting, the shooting material comprises shooting material, and the image acquisition of the shooting target object by using the target vehicle-mounted image acquisition device acquiring the at least one pre-acquired image to obtain the shooting material comprises:

using the target vehicle-mounted image acquisition device to acquire a static image of the shooting target object according to a preset shooting rule, and using the acquired shooting target object image as a shooting material;

the editing the shooting material according to the shooting type to generate a shooting result includes:

6. The shooting method for automatically invoking the vehicle-mounted image capture device according to claim 5, wherein before the camera material is rendered according to the preset camera rendering rule to generate the shooting result, the method further comprises:

and matching and determining the preset photography rendering rule from a rendering rule base according to at least one of emotion information of a vehicle user, the external environment information of the vehicle and the current weather condition information.

7. The shooting method for automatically invoking the vehicle-mounted image capturing device according to claim 4, wherein the shooting type comprises shooting, the shooting material comprises shooting material, and the image capturing of the shooting target object by using the target vehicle-mounted image capturing device capturing the at least one pre-captured image to obtain the shooting material comprises:

using the target vehicle-mounted image acquisition device to acquire video images of the shooting target object according to a preset shooting rule, and using the acquired shooting target object images as shooting materials;

8. The shooting method for automatically invoking the vehicle-mounted image capturing device according to claim 7, wherein before the shooting material is clipped according to the preset video clipping rule to generate the shooting result, the method further comprises:

and matching and determining the preset video clip rule from a clip rule library according to the number.

9. The shooting method for automatically invoking the vehicle-mounted image acquisition device according to any one of claims 1 to 8, wherein the obtaining of the shooting instruction of the vehicle user comprises:

receiving voice information of a vehicle user;

10. A shooting device for automatically calling a vehicle-mounted image acquisition device, the device comprising: the system comprises a preselection module, an instruction acquisition module, an instruction processing module, a shooting execution module and a result acquisition module;

the preselection module is used for selecting one or more vehicle-mounted image acquisition devices according to schedule information of a vehicle user and a current vehicle driving mode to form a standby vehicle-mounted image acquisition device group;

the instruction acquisition module is used for acquiring a shooting instruction of a vehicle user, wherein the shooting instruction at least comprises a shooting target object and a shooting type;

the instruction processing module is used for judging whether the vehicle-mounted image acquisition devices in the standby vehicle-mounted image acquisition device group are suitable for shooting the shooting target object or not based on the shooting instruction of the vehicle user;

the shooting execution module is used for calling at least one vehicle-mounted image acquisition device with the shooting direction facing the shooting target object from the standby vehicle-mounted image acquisition device group to acquire the shooting material;