WO2023050677A1 - Vehicle, image capture method and apparatus, device, storage medium, and computer program product - Google Patents

Abstract

Embodiments of the present application disclose a vehicle, an image capture method and apparatus, a device, a storage medium, and a computer program product. The method comprises: in response to an interaction terminal located in a vehicle cabin receiving a first instruction, acquiring a first image captured by a camera of a vehicle-mounted camera, the first instruction being used to trigger the vehicle-mounted camera to perform image capture; detecting a key feature of a preset object in the first image, and determining at least one preset object in the first image; performing special effect processing on the at least one preset object in the first image on the basis of set first special effect display information to obtain a second image; and displaying the second image on a capture interface of the vehicle-mounted camera.

Description

A vehicle and image capturing method, device, equipment, storage medium and computer program product

Cross References to Related Applications

This application is based on the Chinese patent application with the application number 202111162365.0, the application date is September 30, 2021, and the application name is "a vehicle and image shooting method, device, equipment, storage medium", and requires the Chinese patent application Priority, the entire content of this Chinese patent application is hereby incorporated into this application as a reference.

technical field

The present application relates to but not limited to the field of information technology, and in particular relates to a vehicle and an image capturing method, device, equipment, storage medium and computer program product.

Background technique

With the development of information technology, the application of smart cars is becoming more and more extensive. However, the smart car in the related art mainly realizes the intelligence of the driving function, and does not fully consider the intelligence of the car's entertainment attributes, so that it cannot well meet the user's experience needs.

Contents of the invention

Embodiments of the present application provide a vehicle and an image capturing method, device, equipment, storage medium, and computer program product.

The technical scheme of the embodiment of the application is realized in this way:

An embodiment of the present application provides an image capturing method, the method comprising:

Responding to the interactive terminal located in the cabin receiving a first instruction, acquiring a first image captured by the camera of the vehicle-mounted camera; wherein, the first instruction is used to trigger the vehicle-mounted camera to take an image;

Detecting key features of preset objects in the first image, and determining at least one preset object in the first image;

performing special effect processing on at least one of the preset objects in the first image based on the set first special effect display information to obtain a second image;

The second image is displayed on the shooting interface of the vehicle-mounted camera.

An embodiment of the present application provides an image capture device, including:

The first acquisition part is configured to acquire a first image captured by the camera of the vehicle-mounted camera in response to the interactive terminal located in the vehicle cabin receiving a first instruction; wherein, the first instruction is used to trigger the vehicle-mounted camera to perform an image shoot;

The first detection part is configured to detect key features of preset objects in the first image, and determine at least one preset object in the first image;

The first processing part is configured to perform special effect processing on at least one of the preset objects in the first image based on the set first special effect display information to obtain a second image;

The display part is configured to display the second image on the shooting interface of the vehicle camera.

An embodiment of the present application provides a computer device, including a memory and a processor, the memory stores a computer program that can run on the processor, and the processor implements the steps in the above method when executing the program.

An embodiment of the present application provides a vehicle, including:

Car camera, used to capture image information in the car cabin;

The vehicle-mounted interactive terminal is connected with the vehicle-mounted camera, and is used to: receive a first instruction triggering the vehicle-mounted camera to take image; send the first instruction to the processor; display the shooting interface of the vehicle-mounted camera;

The processor is configured to: acquire a first image captured by the camera of the vehicle-mounted camera in response to the interactive terminal located in the vehicle cabin receiving a first instruction; wherein, the first instruction is used to trigger the vehicle-mounted camera to take an image; Detecting key features of preset objects in the first image, determining at least one preset object in the first image; displaying information on at least one of the first images based on the set first special effect display information The preset object is subjected to special effect processing to obtain a second image; the second image is sent to the interactive terminal to display the second image on the shooting interface of the vehicle camera.

An embodiment of the present application provides a computer storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps in the above method are implemented.

An embodiment of the present application provides a computer program product. The computer program product includes a non-transitory computer-readable storage medium storing a computer program. When the computer program is read and executed by a computer, the steps in the above method are realized.

In the embodiment of the present application, by responding to the interactive terminal located in the vehicle cabin receiving the first instruction, the first image captured by the camera of the vehicle-mounted camera is obtained; the key features of the preset object in the first image are detected, determining at least one preset object in the first image; performing special effect processing on at least one preset object in the first image based on the set first special effect display information to obtain a second image; The shooting interface of the vehicle-mounted camera displays the second image. In this way, the user can use the set first special effect display information to perform special effect processing on at least one preset object in the first image captured by the camera of the vehicle-mounted camera to obtain a second image, thereby improving the imaging of the image captured by the vehicle-mounted camera Quality and fun, and can improve the mutual entertainment between people and vehicles, so as to better meet the experience needs of users.

Description of drawings

FIG. 1 is a schematic diagram of an implementation flow of an image capturing method provided in an embodiment of the present application;

FIG. 2 is a schematic diagram of an implementation flow of an image capturing method provided in an embodiment of the present application;

FIG. 3 is a schematic diagram of an implementation flow of an image capturing method provided in an embodiment of the present application;

FIG. 4 is a schematic diagram of an implementation flow of an image capturing method provided in an embodiment of the present application;

FIG. 5 is a schematic diagram of the composition and structure of an image capture device provided by an embodiment of the present application;

FIG. 6 is a schematic diagram of a hardware entity of a computer device provided by an embodiment of the present application.

Detailed ways

In order to make the purpose, technical solution and advantages of the application more clear, the technical solution of the application will be further elaborated below in conjunction with the accompanying drawings and embodiments. The described embodiments should not be considered as limiting the application. All other embodiments obtained under the premise of no creative work belong to the scope of protection of this application.

In the following description, references to "some embodiments" describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or a different subset of all possible embodiments, and Can be combined with each other without conflict.

If there is a similar description of "first/second" in the application documents, add the following explanation. In the following description, the terms "first\second\third" are only used to distinguish similar objects and do not mean Regarding the specific ordering of objects, it can be understood that "first\second\third" can be interchanged with specific order or sequence if allowed, so that the embodiment of the application described here can be used in addition to the performed in an order other than that shown or described.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the technical field to which this application belongs. The terminology used herein is for the purpose of describing the application only and is not intended to limit the application.

An embodiment of the present application provides an image capturing method, which can be executed by a computer device, where the computer device can be, for example, an intelligent display device, a vehicle controller, a vehicle interactive device, a user terminal in the vehicle cabin, a server, a network camera, Notebook computers, tablet computers, desktop computers, mobile devices (such as mobile phones, portable video players, personal digital assistants, dedicated messaging devices, portable gaming devices) and other suitable devices with data processing capabilities. As shown in Figure 1, the method includes the following steps S101 to S104:

Step S101 , in response to the interactive terminal in the vehicle cabin receiving a first instruction, acquire a first image captured by a camera of the vehicle-mounted camera; wherein the first instruction is used to trigger the vehicle-mounted camera to take an image.

Here, the interactive terminal in the vehicle cabin may be any suitable electronic device with interactive functions located in the vehicle cabin. During implementation, the interactive terminal can be set at any suitable position in the vehicle cabin, including but not limited to the center console, door or seat of the vehicle, which is not limited in this embodiment of the present application.

In some embodiments, the interactive terminal in the car cabin may be a car machine capable of supporting functions such as in-vehicle information processing and entertainment, and may include a host computer and a display screen. The main unit and the display screen of the car machine can be combined or separated.

Alternatively, the above-mentioned interactive terminal may also be a user terminal, such as a user's mobile terminal. The user terminal may have a display assembly for displaying photos. The user terminal can be installed with an application program for controlling the vehicle camera, which can send shooting instructions to the vehicle camera through the cloud, and can also receive photos taken and uploaded by the vehicle camera through the cloud.

The vehicle-mounted camera is any suitable camera installed in the vehicle, and may be a camera product installed in the vehicle, or a camera application running on an interactive terminal in the vehicle cabin, which is not limited here. In some embodiments, if the vehicle-mounted camera is an independent camera product, the interactive terminal in the vehicle cabin can be the camera product.

The image captured by the car camera can be a photo or a video. In some embodiments, when the vehicle-mounted camera is turned on, the shooting interface of the vehicle-mounted camera can be displayed on the interactive terminal in the vehicle cabin. The shooting interface of the vehicle-mounted camera is a user interface for taking photos or videos, and the user can perform photo or video shooting operations on the shooting interface.

The first instruction is any suitable instruction that can trigger the on-board camera to take image on the shooting interface of the on-board camera. One or more of the shooting trigger gesture command, the input shooting trigger voice command, the input steering wheel shooting button command, the input shooting button command of the interactive terminal, the shooting command of gesture control or expression control in the air, etc. One or more. In response to the interactive terminal located in the vehicle cabin receiving the first instruction, the vehicle-mounted camera may be triggered to capture an image, and the first image captured by the camera of the vehicle-mounted camera may be obtained. Wherein, the shooting instruction of air gesture control or expression control can be obtained by detecting and recognizing gesture images or expression images of passengers on the vehicle by the on-board smart device communicatively connected with the interactive terminal.

In some embodiments, the camera of the vehicle-mounted camera can be set together with the interactive terminal in the vehicle cabin, or can be separated from the interactive terminal, and the vehicle-mounted camera can use the camera to capture images. During implementation, the interactive terminal in the cabin can be connected to any suitable camera installed inside or outside the cabin by means of wired or wireless communication, so as to use the camera to collect images to be captured and realize image shooting. For example, the car camera can be connected with cameras installed in the cabin (such as cameras installed in the center console, doors, etc.), and can also be connected with cameras installed outside the cabin (such as driving recorders, reversing cameras, etc.) The connection may also be made with an external camera (such as a mobile phone with a camera, a tablet computer with a camera, a portable camera, etc.), which is not limited in this embodiment of the present application.

Step S102, detecting key features of preset objects in the first image, and determining at least one preset object in the first image.

Here, the preset object may include any suitable one or more objects to be processed with special effects in the vehicle cabin, for example, people, animals, or human faces, human hands, human bodies, car seats, cat faces, dog faces, and the like. During implementation, the preset object may be preset by the user according to the actual situation, or may be defaulted by the system, which is not limited here.

The key feature of the preset object may include any suitable feature for identifying the preset object. During implementation, the key features suitable for identifying the preset object can be determined according to the preset object actually used, which is not limited in this embodiment of the present application. For example, when the preset object is a human face, the key feature of the preset object can be the key point feature of the human face; when the preset object is a car seat, the key feature of the preset object can be the Contour features; in the case that the preset object is a cat face, the key features of the preset object may be key point features of the cat face.

In some implementations, any suitable target detection model may be used to detect key features of the preset object in the first image to obtain at least one preset object in the first image.

Step S103, performing special effect processing on at least one preset object in the first image based on the set first special effect display information to obtain a second image.

Here, the first special effect display information is any suitable special effect display information set for performing special effect processing on at least one preset object in the first image, which may include but not limited to display of special effect materials and special effect materials. One or more of methods, display parameters of special effect materials, events that trigger the display of special effect materials, overall image transformation methods for preset objects or first images, and the like. Wherein, the display method of the special effect material may be superimposed on the original picture, converting part or all of the original picture to attributes such as image size or color, deleting elements in the original picture, and so on. The display parameters of the special effect material may include but not limited to at least one of a display position parameter, a display size parameter, and a display time parameter. The event that triggers the display of the special effect material may include, but is not limited to, at least one of: preset objects perform a specific action, present a specific state, and the number of preset objects changes. During implementation, the first special effect display information may be the default of the system, or it may be set by the user according to the shooting requirements before or during the image shooting. Those skilled in the art can set an appropriate first effect according to the actual situation. A special effect display information.

Special effect processing may be performed on at least one preset object in the first image based on the first special effect display information. For example, at least one human face in the first image may be beautified based on the set beautifying material; The sticker material is displayed on the face, or based on the position of at least one human face in the first image, the sticker material is displayed in the first image. During implementation, the first image after special effect processing can be directly used as the second image, or the second image can be obtained after image improvement is performed on the first image after special effect processing, which is not limited here.

Here, the processing method for the first image or the preset object in the first image can be determined according to at least one of the display method, image conversion method, display parameter, etc. in the first special effect display information, and according to the processing method The second image is obtained by processing the first image or a preset object in the first image.

In some embodiments, when the first image is a single image frame, special effect processing may be performed on at least one preset object in the single image frame based on the set first special effect display information to obtain of the second image.

In some embodiments, in the case that the first image is a first video containing a plurality of continuous image frames, based on the set first special effect display information, the image in each image frame in the first video may be At least one preset object is subjected to special effect processing to obtain a second video, that is, a second image.

Step S104, displaying the second image on the shooting interface of the vehicle camera.

Here, the second image may be displayed on the shooting interface of the vehicle-mounted camera in an appropriate manner according to actual conditions, which is not limited in this embodiment of the present application.

In some embodiments, the interactive terminal includes at least one of the following: a vehicle interactive terminal, and a user terminal in the vehicle cabin. Here, the vehicle-mounted interactive terminal may be any suitable interactive terminal installed in the vehicle cabin, such as a vehicle machine, a vehicle-mounted display device, and the like. The user terminal in the vehicle cabin may be any suitable user terminal located in the vehicle cabin, including but not limited to a mobile phone, a tablet computer, and the like. During implementation, the user terminal in the vehicle cabin can be held by the user in the vehicle cabin, placed in the vehicle cabin, or fixed in the vehicle cabin in a detachable manner, which is not limited here.

In the embodiment of the present application, by responding to the interactive terminal located in the vehicle cabin receiving the first instruction, the first image captured by the camera of the vehicle-mounted camera is obtained; the key features of the preset object in the first image are detected, determining at least one preset object in the first image; performing special effect processing on at least one preset object in the first image based on the set first special effect display information to obtain a second image; The shooting interface of the vehicle-mounted camera displays the second image. In this way, the user can use the set first special effect display information to perform special effect processing on at least one preset object in the first image captured by the camera of the vehicle-mounted camera to obtain a second image, thereby improving the imaging of the image captured by the vehicle-mounted camera Quality and fun, the camera and image special effects processing is extended to the scene in the car, which enriches the interaction between people and cars, and can improve the mutual entertainment between people and cars, so as to better meet the experience needs of users.

In some embodiments, before the above step S103, it may also include:

Step S111 , in response to the first special effect setting operation performed on the shooting interface, acquire the set first special effect display information.

Here, the user can perform any appropriate first special effect setting operation on the shooting interface of the vehicle-mounted camera according to actual needs, and set appropriate first special effect display information for image shooting, so that the finally obtained second image presents a corresponding special effect. The first special effect setting operation may include, but not limited to, one or more of operations such as adding and deleting special effects, and setting display parameters. The special effects that can be added include but are not limited to one or more of sticker effects, beauty effects, makeup effects, background effects, foreground effects, and lens effects. Different display information can be set for different special effects, and the obtained first special effect display information can include the special effect material of at least one special effect set by the first special effect setting operation and the display parameters of each special effect material. For example, in the case that the special effect set by the first special effect setting operation is a beauty effect, the acquired first special effect display information may include the set beauty type, the effect area, effect strength, transparency, etc. of the beauty type. For another example, when the special effect set by the first special effect setting operation is a sticker special effect, the obtained first special effect display information may include the added sticker material and the display position, display size, transparency, etc. set for the sticker material.

In the above embodiment, in response to the first special effect setting operation performed on the shooting interface, the set first special effect display information is acquired. In this way, the user can set the special effect display information used in shooting according to actual needs, thereby further improving the mutual entertainment between people and vehicles, and thus better meeting the user's experience needs.

In some embodiments, the above method may also include the following steps S121 to S122:

Step S121, in response to the second special effect setting operation performed on the image editing interface of the vehicle camera for the fourth image to be edited, to acquire the set second special effect display information.

Here, the image editing interface of the vehicle-mounted camera may be any suitable interface for editing the fourth image in the vehicle-mounted camera. The fourth image may include, but is not limited to, images captured by the vehicle camera in the past, images currently captured by the vehicle camera, imported images, and the like. In some embodiments, the image editing interface of the vehicle camera can be displayed on the interactive terminal.

The second special effect setting operation may be any suitable operation performed by the user to edit the special effect on the fourth image according to actual needs. The second special effect setting operation may include, but not limited to, one or more of operations such as adding and deleting special effects, and setting display parameters. The special effects that can be added include but are not limited to one or more of sticker effects, beauty effects, makeup effects, background effects, foreground effects, and lens effects. Different display parameters may be set for different special effects, and the obtained second special effect display information may include the special effect material of at least one special effect set by the second special effect setting operation and the display parameters of each special effect material. For example, in the case that the special effect set by the second special effect setting operation is a beautification special effect, the obtained second special effect display information may include the set beautification type, the effect area, effect strength, transparency, etc. of the beautification type. For another example, when the special effect set by the second special effect setting operation is a sticker special effect, the obtained first special effect display information may include the added sticker material and the display position, display size, transparency, etc. set for the sticker material.

Step S122, performing special effect processing on the fourth image based on the second special effect display information.

Here, based on the second special effect display information, special effect processing may be performed on the fourth image. For example, at least one human face in the fourth image can be beautified based on the set beautifying material; the sticker material can also be displayed in the fourth image based on the set sticker material and the display parameters of the sticker material .

In the embodiment of the present application, in response to the second special effect setting operation performed on the fourth image to be edited on the image editing interface of the vehicle-mounted camera, the set second special effect display information is obtained, and based on the second special effect display information, the second special effect display information is displayed. Four images are processed with special effects. In this way, the user can set special effects for the image to be edited on the image editing interface of the vehicle-mounted camera according to actual needs, thereby further improving the pertinence of the interaction between people and the vehicle, thereby better meeting the user's experience needs.

An embodiment of the present application provides an image capturing method, and the method may be executed by a computer device. As shown in Figure 2, the method includes the following steps S201 to S207:

Step S201, when the camera is turned on, acquire a third image captured by the camera.

Here, the third image may be any suitable image captured by the camera when it is turned on.

Step S202, determining position information of at least one preset object based on the third image.

Here, position information of at least one preset object in the third image can be obtained by detecting key features of the preset object in the third image. The position information of the preset object can be any suitable information that can characterize the position of the preset object in the first image, including but not limited to the coordinates of the center point of the preset object in the first image, the position of the preset object in the first image, The pixel area occupied by the image, etc.

Step S203, based on the position information of at least one preset object, adjust the viewing range and/or shooting angle of the camera.

Here, based on the position information of at least one preset object, the viewing range and/or shooting angle of the camera head of the vehicle-mounted camera can be adjusted to an appropriate value, so that the camera head of the vehicle-mounted camera can automatically adapt to the position distribution of the preset objects in the vehicle cabin . During implementation, an appropriate adjustment strategy may be used to adjust the viewing range and/or shooting angle of the camera based on the position information of at least one preset object according to the actual situation, which is not limited here. For example, if only the driver is detected in the third image, based on the location information of the driver, the viewing range of the camera may be reduced and/or the shooting angle of the camera may be adjusted so that the camera only captures the area where the driver is located. As another example, in the case that multiple occupants are detected in the third image, based on the position information of the multiple occupants, the viewing range of the camera may be increased and/or the shooting angle of the camera may be adjusted so that the camera can better The multiple passengers are photographed.

Step S204, in response to the interactive terminal in the vehicle cabin receiving a first instruction, acquire a first image captured by the camera of the vehicle-mounted camera; wherein the first instruction is used to trigger the vehicle-mounted camera to take an image.

Step S205, detecting key features of preset objects in the first image, and determining at least one preset object in the first image.

Step S206, performing special effect processing on at least one preset object in the first image based on the set first special effect display information to obtain a second image.

Step S207, displaying the second image on the shooting interface of the vehicle camera.

Here, the above-mentioned steps S204 to S207 correspond to the above-mentioned steps S101 to S104 respectively, and the specific implementation manners of the above-mentioned steps S101 to S104 can be referred to for implementation.

In the embodiment of the present application, when the camera is turned on, the third image captured by the camera is acquired; the position information of at least one preset object is determined based on the third image; and the viewing range of the camera is adjusted based on the position information of at least one preset object and/or camera angle. In this way, the camera of the vehicle-mounted camera can automatically adapt to the position distribution of preset objects in the cabin, adjust the viewfinder range and/or shooting angle, and realize more flexible control of the shooting viewfinder range and/or shooting angle, which is beneficial Take higher quality pictures.

In some embodiments, the vehicle-mounted camera is set in front of the driver's seat in the vehicle cabin or in front of the front seat in the vehicle cabin, and the position information includes riding position information; the above step S203 may include:

Step S211, when it is determined according to the riding position information that each of the preset objects in the cabin is seated in the front row seat in the cabin, adjust the viewing range of the camera to be the same as the front row seat. The first preset viewing range corresponding to the seat, and/or adjusting the shooting angle of the camera to the first preset angle corresponding to the front seat;

Here, the riding position information may be the seat area where the preset object is located in the cabin, which may include but not limited to the front seat, the second row of seats, the last row of seats, the driver's seat, and the passenger's seat in the cabin. one or more of these.

During implementation, the corresponding relationship between at least one seat area in the cabin and the viewing range and/or shooting angle of the camera can be preset according to the actual situation. Based on the corresponding relationship, the first preset corresponding to the front seat can be determined. Set the viewfinder range, and/or the first preset angle corresponding to the front row of seats; image recognition technology can also be used to automatically identify the area where the front row of seats in the cabin is located, and automatically determine the appropriate first preset based on this area Viewing range and/or first preset angle.

Step S212, when it is determined according to the seating position information that at least two of the preset objects in the cabin are sitting in at least two different rows of seats in the cabin, adjusting the viewing range of the camera It is the second preset viewing range corresponding to all the seating areas in the cabin, and/or adjusting the shooting angle of the camera to be the second preset angle corresponding to all the seating areas in the cabin.

Here, the second preset viewing range and/or the second preset angle corresponding to all the seating areas in the cabin may be preset or automatically determined by image recognition technology, which is not limited here.

In the above embodiment, the viewing range and/or shooting angle of the camera are automatically adjusted according to the passenger seat information of at least one preset object in the vehicle cabin, which can further improve the mutual entertainment between people and vehicles.

In some embodiments, the special effect display information may include display position configuration information of the special effect material. The display position configuration information is information for configuring the display position of the special effect material in the image. In this case, an embodiment of the present application provides an image capturing method, which can be executed by a computer device. As shown in Figure 3, the method includes the following steps S301 to S305:

Step S301, in response to the interactive terminal in the vehicle cabin receiving a first instruction, acquire a first image captured by the camera of the vehicle-mounted camera; wherein the first instruction is used to trigger the vehicle-mounted camera to take an image.

Step S302, detecting key features of preset objects in the first image, and determining at least one preset object in the first image.

Here, the above-mentioned steps S301 to S302 correspond to the above-mentioned steps S101 to S102 respectively, and the specific implementation manners of the above-mentioned steps S101 to S102 can be referred to for implementation.

Step S303, based on the set display position configuration information of the special effect material, perform display effect processing corresponding to the special effect material on at least one of the preset objects in the first image.

Here, the display position configuration information of the special effect material may be configuration information for determining a display position of the special effect material in the first image. During implementation, appropriate display position configuration information can be set for the special effect material according to the actual situation, which is not limited here. For example, the display position configuration information may include the coordinates of the display position of the special effect material in the first image, and may also include a mapping relationship between the coordinates of the display position of the special effect material and the positions of the key points of the preset object.

Based on the display position configuration information of the special effect material, corresponding display effect processing may be performed on the first image. Optionally, the special effect material can be added to at least one preset object in the first image. The added special effect material may be presented on the preset object, or may be presented in other positions in the first image than the preset object. Alternatively, image processing corresponding to the special effect material may be performed on the preset object in the first image according to the display position configuration information of the special effect material. For example, at least one human face in the first image may be beautified based on the set beautifying material; The sticker material is displayed on the face; the sticker material may also be displayed around at least one car seat in the first image based on the set sticker material and display parameters of the sticker material.

In some implementations, the special effect material may be presented in the first image according to the location area of at least one preset object and the display position configuration information of the special effect material. Specifically, the display position configuration information of the special effect material includes the mapping relationship between the coordinates of the display position and the position area of the preset object, and the corresponding position area of at least one preset object in the first image can be determined according to the mapping relationship. at least one display position, and present the special effect material at the display position, for example, superimposing the sunglasses picture material at the position of the human eye to realize the display effect of the person wearing sunglasses; or, for the area corresponding to the display position in the first image, such as Image brightness conversion, chroma conversion, style conversion and other processing to achieve the display effect corresponding to the special effect material. For example, in the beauty special effect processing, the color value of the face area can be adjusted to achieve the display effect corresponding to the "whitening" special effect material.

In step S304, the first image after the display effect processing corresponding to the special effect material is determined as the second image.

Step S305, displaying the second image on the shooting interface of the vehicle camera.

Here, the above-mentioned step S305 is superior to the above-mentioned step S104, and the specific implementation manner of the above-mentioned step S104 can be referred to for implementation.

In the embodiment of the present application, the first special effect display information includes the special effect material and the display position configuration information of the special effect material, based on the set display position configuration information of the special effect material, at least one preset object in the first image is compared with the special effect material Corresponding display effect processing, and determining the image after the display effect processing as the second image. In this way, it is possible to simply and quickly perform special effect processing on at least one preset object in the first image and preview the special effect processing result, thereby improving the flexibility and processing efficiency of the image processing method in the vehicle cabin. .

In some embodiments, the preset object includes at least one of the following: people (human bodies) in the cabin, human body parts, animals; the special effect material includes at least one of the following: beauty material, makeup material, filter Mirror material, sticker material.

Here, the special effect material is the material needed to present the special effect, which may include but not limited to sticker materials (such as cartoon stickers, flower stickers, star stickers, virtual car cabin scene stickers, virtual cabin scene stickers, virtual roller coaster scene stickers, etc.), beauty Make-up materials (such as materials required for special effects such as skin smoothing, face-lifting, and eye enlargement), beauty materials (such as lipstick, mascara, eye shadow, blush, etc.), filter materials (such as nostalgic filters, soft filters, One or more of the materials required for special effects such as haze removal filters), etc.

In some embodiments, the preset object includes a human face, and the display position configuration information includes a first mapping relationship between the display position parameters of the special effect material and the positions of the key points of the human face; the above step S303 may include step S311 And/or step S312:

Step S311, based on the position of at least one face key point in the first image and the first mapping relationship, determine the set display position of the special effect material, and place the set display position of the special effect material according to the display position of the special effect material The special effect material is superimposed on the face of the person.

Step S312: Determine the image processing method corresponding to the set special effect material; determine the set special effect material based on the position of at least one face key point in the first image and the first mapping relationship , and process the image area of the face corresponding to the display position of the special effect material according to the image processing manner.

Here, the key points of human face in the first image may be detected, and the position of at least one key point of human face in the first image may be determined. Based on the first mapping relationship between the display position parameter of the special effect material and the position of the facial key point, the display position of the special effect material corresponding to the position of at least one human face key point can be determined. According to the determined display position of the special effect material, the special effect material can be superimposed on at least one human face in the first image by presenting the special effect material in a manner of overlaying or covering in the first image. The material superimposed on the human face can be one or more of beauty material, makeup material, filter material, sticker material, etc. Or, according to the image processing method corresponding to the pre-configured special effect material, the corresponding image processing can be performed on the face area in the image. For example, according to the pixel value conversion method corresponding to the "whitening" special effect material, The pixel value of the image area corresponding to the display position of the special effect material is transformed, so as to realize the "whitening" processing of the human face in the image.

In some implementations, the first mapping relationship between the display position parameter of the special effect material and the position of the facial key point may include a set correspondence between the display position parameter of the special effect material and the position of the key point of the human face. In some embodiments, the first mapping relationship between the display position parameter of the special effect material and the position of the key point of the face may be the way of mutual conversion between the display position parameter of the special effect material and the position of the key point of the face, for example, The formula used to calculate the display position parameters of the special effect material according to the position of the key points of the face, or the conversion algorithm for converting the position of the key points of the face to the display position parameters of the special effect material, etc.

In some embodiments, the preset object includes people in the cabin, and the special effect material includes virtual driving tool stickers; the above step S303 may include:

Step S321 , based on the set display position configuration information of the sticker of the virtual driving tool, present in the first image at least one special effect scene of a person in the vehicle cabin riding a virtual driving tool.

Here, the people in the cabin may include the driver or passengers in the cabin. During implementation, the face key points in the first image can be detected to determine at least one person in the cabin in the first image; the human body posture in the first image can also be detected to determine the At least one person in the cabin is not limited here.

The sticker of the virtual driving tool may be any suitable sticker showing the riding effect of the virtual driving tool, for example, a sticker of a virtual cabin, a sticker of a virtual cabin, a sticker of a virtual roller coaster, and the like. Based on the set display position configuration information of the virtual driving tool sticker, the display position of the virtual driving tool sticker in the first image can be determined, so that at least one passenger in the cabin can be presented in the first image based on the display position. Special effects scene for driving tools. In this way, the fun of image shooting by the vehicle-mounted camera can be further enhanced.

In some embodiments, the above step S303 may include the following steps S331 to S332:

Step S331 , based on the first image, detect a special effect triggering action matching the special effect material.

Here, each special effect material may have a corresponding special effect triggering action, and the special effect triggering action may include but not limited to one or more of facial movements, gestures, body movements, and the like. During implementation, the special effect triggering action matching the special effect material can be the default, or the special effect triggering action matching the special effect material can be determined by querying the preset correspondence between the special effect material and the special effect triggering action; The special effect trigger action set by the set special effect material before or during image shooting is not limited here.

Step S332, in response to detecting the special effect triggering action, adding the special effect material to at least one of the preset objects in the first image based on the set display position configuration information of the special effect material.

Here, when a special effect triggering action is detected in the first image, based on the set display position configuration information of the special effect material, a special effect material may be added to at least one preset object in the first image. In this way, the fun of image shooting by the vehicle-mounted camera can be further improved, and the mutual entertainment between people and vehicles can be further improved, thereby better satisfying user experience needs.

In some embodiments, the display position configuration information of the virtual driving tool sticker includes a second mapping relationship between the display position of at least one virtual seating area in the virtual driving tool sticker and the position of the person in the image; the above method also May include the following step S341:

Step S341 , detecting the seating position of at least one person in the vehicle cabin based on the first image.

Here, the seating position of the person may be the position where the person is, or the seat where the person is sitting, which is not limited here.

The above step S321 may include the following steps S342 to S343:

Step S342, based on the seating position and the second mapping relationship, determine a first display position of the target virtual seating area corresponding to the seating position.

Here, based on the second mapping relationship between the display position of at least one virtual seating area in the sticker of the virtual driving tool and the position of the person in the image, the target virtual seating position corresponding to the seating position of at least one person in the cabin can be determined. The first display position of the region.

In some implementations, the second mapping relationship between the display position of at least one virtual seating area in the virtual driving tool sticker and the position of the person in the image may include at least one virtual seating area in the set virtual driving tool sticker The correspondence between the display position of the image and the position of the person in the image. In some embodiments, the second mapping relationship between the display position of at least one virtual seating area in the sticker of the virtual driving tool and the position of the person in the image may be the relationship between the display position of the virtual riding area and the position of the person in the image For example, the formula used to calculate the display position of the virtual seating area according to the position of the person in the image, or the conversion algorithm for converting the position of the person in the image to the display position of the virtual seating area, etc.

Step S343, displaying the sticker of the virtual driving tool in the first image based on the first display position, so as to present at least one special effect scene in which the person rides in the virtual riding area.

In the above embodiment, the seating position of at least one person in the cabin is detected based on the first image; The second mapping relationship is to determine the first display position of the target virtual seating area; based on the first display position, the virtual driving tool sticker is displayed in the first image to present a special effect scene of at least one person riding in the virtual seating area. In this way, the virtual driving tool stickers can be automatically displayed at appropriate positions according to the seating positions of the people in the cabin, which can further improve the fun of image capture by the on-board camera, and further improve the mutual entertainment between people and vehicles. Can better meet the user's experience needs.

In some embodiments, the above step S343 may include: step S351, superimposing the sticker of the virtual driving tool on the first image in the following manner: the target virtual riding area is displayed at the first display position . Here, the virtual driving tool stickers can be displayed simply and quickly by superimposing stickers, presenting a special effect scene of at least one person riding in the virtual riding area.

In some embodiments, the virtual driving tool sticker includes at least one virtual element with adjustable display parameters, and the display parameters include display position and/or display size; the display position configuration information of the virtual driving tool sticker includes virtual driving A third mapping relationship between the display position of at least one virtual element in the tool sticker and the position of the person in the image; the above method may also include at least one of the following steps S361 and S362:

Step S361 , detecting the seating position of at least one person in the vehicle cabin based on the first image, and determining a second display position of at least one virtual element based on the seating position and the third mapping relationship.

Here, the seating position of at least one person in the vehicle cabin may be detected based on the first image through any suitable image detection method.

The virtual element is any suitable element with adjustable display parameters in the virtual driving tool sticker, for example, one or more of virtual seat elements, virtual steering wheel elements, virtual window elements, and the like. The display parameters of the virtual element can be automatically adjusted according to the seating position or size of the occupants in the cabin, or manually adjusted by the user, which is not limited here. During implementation, by adjusting the display parameters of the virtual components in the virtual driving tool stickers, the virtual driving tool stickers can completely cover key components such as seats and steering wheels in the cabin under different scenarios. For example, in the roller coaster stickers, you can adjust the virtual The display position and display size of the front graphics of the roller coaster are used to cover the steering wheel and other components of the real scene in the cabin.

Based on the third mapping relationship between the display position of at least one virtual element in the sticker of the virtual driving tool and the position of the person in the image, the first position of the virtual element corresponding to the seating position of at least one person in the cabin can be determined. Two shows the location.

In some implementations, the third mapping relationship between the display position of at least one virtual element in the virtual driving tool sticker and the position of the person in the image may include the display of at least one virtual element in the set virtual driving tool sticker The correspondence between the location and the location of the person in the image. In some embodiments, the third mapping relationship between the display position of at least one virtual element in the virtual driving tool sticker and the position of the person in the image may be the mutual relationship between the display position of the virtual element and the position of the person in the image. The conversion method, for example, a formula used to calculate the display position of the virtual component according to the position of the person in the image, or a conversion algorithm for converting the position of the person in the image to the display position of the virtual component, etc.

Step S362, determining the size of at least one person in the vehicle cabin based on the first image, and determining a target display size of at least one virtual element based on the size.

Here, the size of the person may include but not limited to one or more of the area occupied by the person in the first image, head width, body width, body length, etc., which is not limited here.

The display size of the virtual element may be an appropriate display index determined according to the shape and type of the virtual element, for example, the length, width, area, circumference, diameter, etc. of the virtual element. In some implementations, the virtual element may be two-dimensional or three-dimensional, and when the virtual element is a three-dimensional element, the display size may also include the height of the virtual element.

During implementation, the target display size of at least one virtual element may be determined based on the size of at least one person in the cabin in an appropriate manner according to actual needs, which is not limited here. For example, the corresponding relationship between the size of the person in the vehicle cabin and the display size of the virtual element can be preset, and according to the corresponding relationship, the target display size of at least one virtual element corresponding to the size of at least one person can be determined.

The above step S321 may include the following step S363:

Step S363, based on the second display position and/or target display size of at least one virtual component, display at least one virtual component in the first image to present at least one special effect of the person riding on the virtual driving tool Scenes.

In the above embodiment, the second display position and/or display size of at least one virtual element with adjustable display parameters in the virtual driving tool sticker can be determined according to the seating position and size of the occupants in the cabin, and based on the at least one virtual element The second display position and/or target display size of the corresponding virtual element is displayed in the first image, so that the appropriate virtual driving tool stickers can be displayed according to the seating position and size of the occupants in the cabin, further improving the relationship between people and vehicles. Interactive entertainment, which can better meet the user's experience needs.

In some embodiments, the above step S363 may include one of step S371 to step S373:

Step S371, based on the second display position and/or target display size of at least one virtual component, determine a virtual component drawing area in the first image, and draw at least one virtual component in the virtual component drawing area .

Here, the shape, display effect, etc. of the virtual element drawing area in the first image may be determined in an appropriate manner according to the actual situation, which is not limited in this embodiment of the present application.

Step S372: Render at least one virtual element in the first image based on the second display position and/or the target display size of the at least one virtual element.

Here, any suitable image rendering algorithm may be used to render the virtual element in the first image, which is not limited in this embodiment of the present application.

Step S373, based on the second display position and/or target display size of each of the virtual components, splicing at least one of the virtual components to generate the sticker, and adding the sticker to the first image.

In some embodiments, the above method may further include: Step S381, based on the number of people in the cabin in the first image, determine the number of the virtual elements in the virtual driving tool sticker.

Here, the number of virtual elements in the virtual driving tool sticker may be the same as or related to the number of people in the cabin in the first image, which is not limited here. In some implementations, an appropriate quantity correspondence can be determined according to actual conditions, and the quantity of virtual elements in the virtual driving tool sticker can be determined based on the number of people in the cabin in the first image by using the quantity correspondence.

The above step S363 may include: step S382, based on the number of virtual elements in the virtual driving tool sticker and the second display position and/or target display size of each virtual element, displaying each virtual element in the first image The virtual element is used to present at least one special effect scene in which the person rides a virtual driving tool.

In the above embodiment, based on the number of people in the cabin in the first image, the number of virtual elements in the virtual driving tool sticker is determined, and based on the number of virtual elements and the second display position and target display size of each virtual element , each virtual element is displayed in the first image to present a special effect scene of at least one person riding a virtual driving tool. In this way, in the scene where there are multiple people in the cabin, according to the number of people and the riding position of each person, the number and display parameters of the virtual components in the virtual driving tool can be set in a targeted manner. The number of people in the cabin and the number and position of the virtual seats are the same. The sticker elements of different seats can be spliced into a complete sticker after adjustment, so that the sticker can more accurately fit the number and location of people in the cabin. The seating position can better meet the user's experience needs.

An embodiment of the present application provides an image capturing method, and the method may be executed by a computer device. As shown in Figure 4, the method includes the following steps S401 to S406:

Step S401, in response to the interactive terminal receiving a second instruction, acquire the driving restriction status of the vehicle camera; wherein the second instruction is used to trigger the vehicle camera to start.

Here, the second instruction can be any suitable instruction that can trigger the start-up of the vehicle-mounted camera, and can include but not limited to an operation instruction triggered by a click operation to start the camera on the display screen of the interactive terminal in the cabin, an input voice command to start the camera , one or more of the inputted camera start key command and the like.

The driving restriction state of the vehicle-mounted camera is a state representing whether to restrict the use of the vehicle-mounted camera during driving. The driving restriction status can be on or off. When the driving restriction state is on, the use of the vehicle camera during driving can be restricted; when the driving restriction state is off, there is no need to restrict the use of the vehicle camera during driving. During implementation, the driving restriction state may be preset by the user, may be defaulted by the system, or may be automatically determined based on the current driving state of the vehicle where the interactive terminal is located, which is not limited here.

Step S402, based on the driving restriction state, control the activation state of the vehicle camera.

Here, in response to the interactive terminal receiving the second instruction, the activation state of the vehicle-mounted camera may be controlled based on the acquired driving restriction state. For example, when the driving restriction state is on, it is forbidden to start the vehicle camera, and when the driving restriction state is off, start the vehicle camera; In the case of a certain speed threshold, it is forbidden to activate the on-board camera.

Step S403, in response to the interactive terminal in the vehicle cabin receiving a first instruction, acquire a first image captured by the camera of the vehicle-mounted camera; wherein, the first instruction is used to trigger the vehicle-mounted camera to take an image.

Step S404, detecting key features of preset objects in the first image, and determining at least one preset object in the first image.

Step S405, performing special effect processing on at least one preset object in the first image based on the set first special effect display information to obtain a second image.

Step S406, displaying the second image on the shooting interface of the vehicle camera.

In the embodiment of the present application, in response to the interactive terminal receiving the second instruction triggering the start-up of the vehicle-mounted camera, the driving restriction state of the vehicle-mounted camera is obtained, and the activation state of the vehicle-mounted camera is controlled based on the driving restriction state. In this way, the use of the vehicle-mounted camera can be flexibly controlled according to actual needs, thereby better satisfying the user experience.

In some embodiments, the above step S402 may include the following step S411, step S412 or step S413:

Step S411, when the driving restriction state is on and the driving speed of the vehicle where the interactive terminal is located does not exceed a preset threshold, start the vehicle camera. In this way, it can be ensured that the driving speed of the vehicle does not exceed a preset threshold when the vehicle-mounted camera is used for shooting and entertainment, thereby effectively improving the safety during the use of the vehicle-mounted camera.

Step S412, when the driving restriction state is on and the parking signal of the vehicle where the interactive terminal is located indicates that the vehicle is in a parked state, start the vehicle-mounted camera. In this way, it can be ensured that the vehicle is in a parked state when the vehicle-mounted camera is used for shooting entertainment, thereby effectively improving the safety of the vehicle-mounted camera during use.

Step S413, when the state of the driving restriction is off, start the on-board camera. In this way, the user can set the driving restriction state of the vehicle-mounted camera to off according to actual needs, so that the use of the vehicle-mounted camera is not restricted by the driving state of the vehicle, so as to better meet the user's use requirements.

Exemplary applications of the embodiments of the present application in actual application scenarios will be described below.

In related technologies, automobiles, as representative products in travel scenarios, have begun to surpass the single attribute of means of transportation, and gradually upgraded to intelligent mobile spaces, endowed with more entertainment attributes. In some schemes of related technologies, automobile products have introduced a camera function based on the vehicle-mounted camera, which is used for self-portraiting under the car owner's self-driving tour or family travel scene. However, due to the special scene in the car (such as dark light inside the car, etc.), these selfies usually have low imaging quality, and the car owner cannot take interesting and interactive photos.

In view of this, the embodiment of the present application provides an image capture method, which can use visual recognition technologies such as face detection and gesture recognition in the car cabin to effectively fit the set beauty, filters, stickers and other special effect materials to the human body. Face presentation can effectively improve the low-quality image quality of car camera selfies, and at the same time enhance the interaction and entertainment of car cabins and car owners and users. For example, when a car owner travels by himself and wants to take a selfie with the steering wheel in hand, based on the image capture method provided in the embodiment of this application, the car owner can start the car camera and turn on the one-key beauty function, and after taking a selfie Photo. For another example, when a car owner’s family of four travels by car and wishes to take an interesting family portrait, based on the image shooting method provided in the embodiment of this application, the car owner can activate the car camera and select a sticker, and the whole family At the same time, make a gesture that matches the sticker to trigger the special effect of the sticker, and then you can take an interesting family portrait.

The embodiment of the present application provides an image capturing method that may include the following steps S501 to S504:

In step S501, the user activates the on-board camera in the car cabin by clicking the on-board button or waking up by voice.

In some embodiments, due to the consideration of vehicle safety, a vehicle movement switch (equivalent to the driving restriction state in the foregoing embodiments) may be designed for the vehicle-mounted camera. When the vehicle movement switch is turned on, when the vehicle is stationary, the user can activate the vehicle camera; when the vehicle is moving, the user cannot activate the vehicle camera. When the vehicle movement switch is turned off, the user can activate the on-board camera regardless of whether the vehicle is moving or stationary.

In some embodiments, the vehicle mobility switch may be on by default.

Step S502 , after the vehicle-mounted camera is started, the camera of the vehicle-mounted camera is controlled to start up, and the images captured by the camera are displayed on the shooting interface of the vehicle-mounted camera in real time.

Here, the shooting angle of the camera of the vehicle-mounted camera covers the environment in the entire vehicle cabin. The on-board camera detects and tracks the faces and passengers in the car cabin through the equipped face key point detection and tracking vision algorithm. Since the cabin scene includes the passenger in the co-pilot seat and the passenger in the rear row, the design angle of the field of view (Field of View, FOV) of the camera can be greater than or equal to 120 degrees, and the facial key point detection and tracking vision algorithm can The recognized face pixels can be less than or equal to 64*64.

Step S503, the user uses one or several beautifying materials, sticker materials and/or filter materials in the car camera, and the car camera converts the selected beautifying materials and/or The filter material is pasted on the face of the passenger in the car, and the pasted effect is displayed on the shooting interface of the car camera.

Step S504, the user uses the camera function of the vehicle camera to take photos or videos with beautifying materials, sticker materials and/or filter materials.

In some embodiments, the user can also make corresponding facial movements or gestures according to the selected beauty material, sticker material and/or filter material, and the facial key point detection and tracking vision algorithm detects the corresponding In the case of facial movements, or when the gesture detection and tracking algorithm detects corresponding gestures, trigger the display of corresponding beauty material, sticker material and/or filter material on the shooting interface of the vehicle camera.

In some embodiments, since the positions of the occupants in the car are distributed from near to far and are relatively fixed, the on-board camera can recommend stickers such as luxury cars, airplanes, and roller coasters to the user. Finally, the car camera can virtualize the car cabin scene in the captured photos/videos into more interesting scenes such as corresponding luxury cars, airplanes or roller coasters.

In some embodiments, the user can view and delete the captured photos or videos locally on the vehicle, and at the same time, the user can upload the captured photos or videos to the cloud.

In some embodiments, the user can also edit the photos or videos with special effects based on the beauty material, sticker material and/or filter material in the vehicle camera.

Based on the aforementioned embodiments, this embodiment of the present application provides an image capture device, which includes each unit included, and each part included in each unit, which can be realized by a processor in a computer device; of course, it can also be implemented by Specific logic circuit implementation; in the process of implementation, the processor can be a central processing unit (Central Processing Unit, CPU), a microprocessor (Microprocessor Unit, MPU), a digital signal processor (Digital Signal Processor, DSP) or on-site Programmable gate array (Field-Programmable Gate Array, FPGA), etc.

FIG. 5 is a schematic diagram of the composition and structure of an image capturing device provided in an embodiment of the present application. As shown in FIG. Portion 740 is displayed, wherein:

The first acquisition part 710 is configured to acquire the first image captured by the camera of the vehicle-mounted camera in response to the interactive terminal located in the vehicle cabin receiving a first instruction; wherein the first instruction is used to trigger the vehicle-mounted camera to perform image capture;

The first detection part 720 is configured to detect key features of preset objects in the first image, and determine at least one preset object in the first image;

The first processing part 730 is configured to perform special effect processing on at least one of the preset objects in the first image based on the set first special effect display information to obtain a second image;

The display part 740 is configured to display the second image on the shooting interface of the vehicle camera.

In some embodiments, the device further includes: a second acquiring part configured to acquire a third image captured by the camera when the camera is turned on; a first determining part configured to acquire a third image captured by the camera based on the The third image determines the position information of at least one preset object; the adjustment part is configured to adjust the viewing range and/or shooting angle of the camera based on the position information of at least one preset object.

In some embodiments, the vehicle-mounted camera is arranged in front of the driver's seat in the vehicle cabin or in front of the front seat in the vehicle cabin, and the position information includes riding position information; the adjustment part is further configured It is: when it is determined according to the riding position information that each of the preset objects in the cabin is seated in the frontmost seat in the cabin, adjust the viewing range of the camera to match the frontmost seat The corresponding first preset viewing range, and/or adjust the shooting angle of the camera to the first preset angle corresponding to the front seat; at least two of the seats in the cabin are determined according to the seating position information In the case where the preset object is seated in at least two different rows of seats in the cabin, adjust the viewing range of the camera to a second preset viewing range corresponding to all seating areas in the cabin, and/or Adjusting the shooting angle of the camera to a second preset angle corresponding to all seating areas in the cabin.

In some embodiments, the first special effect display information includes special effect material and display position configuration information of the special effect material; the first processing part is further configured to: based on the set display position configuration of the special effect material information, performing display effect processing corresponding to the special effect material on at least one of the preset objects in the first image; determining the first image after adding the special effect material as a second image.

In some embodiments, the preset object includes at least one of the following: people in the cabin, human body parts, animals; the special effect material includes at least one of the following: beauty material, makeup material, filter material, Sticker material.

In some embodiments, the preset object includes a human face, and the display position configuration information includes a first mapping relationship between the display position parameters of the special effect material and the key points of the human face; the first processing part further It is configured as at least one of the following: based on the position of at least one human face key point in the first image and the first mapping relationship, determine the set display position of the special effect material, and according to the Superimposing the special effect material on the face at the set display position of the special effect material; determining an image processing method corresponding to the set special effect material based on at least one human face in the first image The positions of the key points and the first mapping relationship determine the set display position of the special effect material, and perform image processing on the image area corresponding to the display position of the special effect material in the face according to the image processing method deal with.

In some embodiments, the preset object includes people in the cabin, and the special effect material includes a virtual driving tool sticker; the first processing part is further configured to: based on the set virtual driving tool sticker Position configuration information is displayed, and at least one special effect scene of people in the vehicle cabin riding a virtual driving tool is presented in the first image.

In some embodiments, the display position configuration information of the virtual driving tool sticker includes a second mapping relationship between the display position of at least one virtual seating area in the virtual driving tool sticker and the position of the person in the image; the device It also includes: a second detection part configured to detect the seating position of at least one person in the cabin based on the first image; the first processing part is further configured to: based on the seating position and the The second mapping relationship is to determine the first display position of the target virtual seating area corresponding to the seating position; display the virtual driving tool sticker in the first image based on the first display position, so as to present at least one of the A special effect scene in which the person rides in the virtual ride area.

In some embodiments, the first processing part is further configured to: superimpose the sticker of the virtual driving tool on the first image in the following manner: the target virtual riding area is displayed on the first display location.

In some embodiments, the virtual driving tool sticker includes at least one virtual element with adjustable display parameters, and the display parameters include display position and/or display size; the display position configuration information of the virtual driving tool sticker includes virtual driving A third mapping relationship between the display position of at least one of the virtual elements in the tool sticker and the position of the person in the image; the device further includes: a second determining part configured to detect the detected position based on the first image the seating position of at least one person in the vehicle cabin, and determine the second display position of at least one virtual element based on the seating position and the third mapping relationship, and/or be configured to be based on the first image determining the size of at least one person in the cabin, and determining a target display size of at least one virtual element based on the size; the first processing part is further configured to: based on the first display size of at least one virtual element and secondly, displaying the position and target display size, displaying at least one virtual element in the first image to present at least one special effect scene in which the person rides a virtual driving tool.

In some embodiments, the first processing part is further configured to be one of the following: based on a second display position and/or a target display size of at least one of the virtual elements, determine the rendering of the virtual element in the first image area, and draw at least one virtual element in the virtual element drawing area; based on the second display position and/or target display size of at least one virtual element, render at least one virtual element in the first image Components: based on the second display position and/or target display size of each of the virtual components, splicing at least one of the virtual components to generate the sticker, and adding the sticker to the first image.

In some embodiments, the device further includes: a third determination part configured to determine the number of the virtual element in the virtual driving tool sticker based on the number of people in the cabin in the first image. quantity; the first processing part is further configured to: based on the number of virtual elements in the virtual driving tool sticker and the second display position and/or target display size of each virtual element, in the first image Each of the virtual elements is displayed in to present at least one special effect scene of the person riding on the virtual driving tool.

In some embodiments, the first processing part is further configured to: based on the first image, detect a special effect triggering action matching the special effect material; in response to detecting the special effect triggering action, based on the set The display position configuration information of the special effect material is to add the special effect material to at least one of the preset objects in the first image.

In some embodiments, the device further includes: a third acquisition part configured to acquire the driving restriction status of the vehicle-mounted camera in response to the interaction terminal receiving a second instruction; wherein, the second instruction uses triggering the start-up of the vehicle-mounted camera; the control part is configured to control the start-up state of the vehicle-mounted camera based on the driving restriction state.

In some embodiments, the control part is further configured to: activate the on-board camera when at least one of the following conditions is met: the driving restriction state is on and the driving speed of the vehicle where the interactive terminal is located does not exceed A preset threshold; the state of the driving restriction is on and the parking signal of the vehicle where the interactive terminal is located indicates that the vehicle is in a parked state; the state of the driving restriction is off.

In some embodiments, the interactive terminal includes at least one of the following: a vehicle interactive terminal, and a user terminal in the vehicle cabin.

The description of the above device embodiment is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the device embodiments of the present application, please refer to the description of the method embodiments of the present application for understanding.

In the embodiment of the present application and other embodiments, a "part" may be a part of a circuit, a part of a processor, a part of a program or software, etc., of course it may also be a unit, a module or a non-modular one.

An embodiment of the present application provides a vehicle, including:

Car camera, used to capture image information in the car cabin;

The vehicle-mounted interactive terminal is connected with the vehicle-mounted camera, and is used to: receive a first instruction triggering the vehicle-mounted camera to take image; send the first instruction to the processor; display the shooting interface of the vehicle-mounted camera;

The processor is configured to: acquire a first image captured by the camera of the vehicle-mounted camera in response to the interactive terminal located in the vehicle cabin receiving a first instruction; wherein, the first instruction is used to trigger the vehicle-mounted camera to take an image; Responding to a shooting trigger operation performed on the shooting interface of the vehicle-mounted camera, acquiring a first image captured by the camera of the vehicle-mounted camera; detecting key features of a preset object in the first image, and determining the first image at least one preset object in the first image; perform special effect processing on at least one preset object in the first image based on the set first special effect display information to obtain a second image; send the first image to the interactive terminal and displaying the second image on the shooting interface of the vehicle-mounted camera.

The description of the above vehicle embodiment is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the vehicle embodiments of the present application, please refer to the description of the method embodiments of the present application for understanding.

It should be noted that, in the embodiment of the present application, if the above-mentioned image capturing method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the essence of the technical solution of the embodiment of the present application or the part that contributes to the related technology can be embodied in the form of a software product, the software product is stored in a storage medium, and includes several instructions to make a An electronic device (which may be a vehicle, a personal computer, a server, or a network device, etc.) executes all or part of the methods described in various embodiments of the present application. The aforementioned storage medium includes: various media that can store program codes such as U disk, mobile hard disk, read-only memory (Read Only Memory, ROM), magnetic disk or optical disk. Thus, embodiments of the present application are not limited to any specific combination of hardware and software.

An embodiment of the present application provides a computer device, including a memory and a processor, the memory stores a computer program that can run on the processor, and the processor implements the steps in the above method when executing the program.

An embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps in the above method are implemented.

An embodiment of the present application provides a computer program product. The computer program product includes a non-transitory computer-readable storage medium storing a computer program. When the computer program is read and executed by a computer, the steps in the above method are realized.

It should be pointed out here that: the above descriptions of the storage medium, equipment, vehicle and computer program product embodiments are similar to the descriptions of the above method embodiments, and have similar beneficial effects as the method embodiments. For technical details not disclosed in the embodiments of the storage medium, device, and computer program product of the present application, please refer to the description of the method embodiments of the present application for understanding.

It should be noted that FIG. 6 is a schematic diagram of a hardware entity of a computer device in the embodiment of the present application. As shown in FIG. 6 , the hardware entity of the computer device 800 includes: a processor 801, a communication interface 802, and a memory 803, wherein,

Processor 801 generally controls the overall operation of computer device 800 .

The communication interface 802 enables the computer device to communicate with other terminals or servers through the network.

The memory 803 is configured to store instructions and applications executable by the processor 801, and can also cache data to be processed or processed by the processor 801 and various modules in the computer device 800 (for example, image data, audio data, voice communication data and Video communication data) can be realized by flash memory (FLASH) or random access memory (Random Access Memory, RAM).

It should be understood that reference throughout the specification to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic related to the embodiment is included in at least one embodiment of the present application. Thus, appearances of "in one embodiment" or "in an embodiment" in various places throughout the specification are not necessarily referring to the same embodiment. Furthermore, the particular features, structures or characteristics may be combined in any suitable manner in one or more embodiments. It should be understood that, in various embodiments of the present application, the sequence numbers of the above-mentioned processes do not mean the order of execution, and the execution order of the processes should be determined by their functions and internal logic, and should not be used in the embodiments of the present application. The implementation process constitutes any limitation. The serial numbers of the above embodiments of the present application are for description only, and do not represent the advantages and disadvantages of the embodiments.

It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element.

In the several embodiments provided in this application, it should be understood that the disclosed devices and methods may be implemented in other ways. The device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods, such as: multiple units or components can be combined, or May be integrated into another system, or some features may be ignored, or not implemented. In addition, the coupling, or direct coupling, or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be electrical, mechanical or other forms of.

The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed to multiple network units; Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, or each unit can be used as a single unit, or two or more units can be integrated into one unit; the above-mentioned integration The unit can be realized in the form of hardware or in the form of hardware plus software functional unit.

Those of ordinary skill in the art can understand that all or part of the steps to realize the above method embodiments can be completed by hardware related to program instructions, and the aforementioned programs can be stored in computer-readable storage media. When the program is executed, the execution includes The steps of the foregoing method embodiments; and the foregoing storage media include: removable storage devices, read-only memory (Read Only Memory, ROM), magnetic disks or optical disks and other media that can store program codes.

Alternatively, if the above-mentioned integrated units of the present application are realized in the form of software function modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the essence of the technical solution of this application or the part that contributes to the related technology can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions to make a An electronic device (which may be a personal computer, a server, or a network device, etc.) executes all or part of the methods described in the various embodiments of the present application. The aforementioned storage medium includes various media capable of storing program codes such as removable storage devices, ROMs, magnetic disks or optical disks.

The above is only the embodiment of the present application, but the scope of protection of the present application is not limited thereto. Anyone familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, and should covered within the scope of protection of this application.

Industrial Applicability

The embodiment of the present application discloses a vehicle and image capturing method, device, equipment, storage medium and computer program product, wherein the method includes: in response to the interactive terminal in the vehicle cabin receiving the first instruction, acquiring the vehicle-mounted camera The first image taken by the camera; wherein, the first instruction is used to trigger the on-board camera to take an image; detect the key features of the preset object in the first image, and determine the at least one preset object; based on the set first special effect display information, perform special effect processing on at least one preset object in the first image to obtain a second image; display the set on the shooting interface of the vehicle camera Describe the second image. According to the embodiment of the present application, the user can use the set first special effect display information to perform special effect processing on at least one preset object in the first image captured by the camera of the vehicle-mounted camera to obtain a second image, thereby improving the performance obtained by the vehicle-mounted camera. The imaging quality and interest of the image can be improved, and the mutual entertainment between people and vehicles can be improved, which can better meet the user's experience needs.

Claims (36)

1. An image capture method, the method comprising:

   Responding to the interactive terminal located in the cabin receiving a first instruction, acquiring a first image captured by the camera of the vehicle-mounted camera; wherein, the first instruction is used to trigger the vehicle-mounted camera to take an image;

   Detecting key features of preset objects in the first image, and determining at least one preset object in the first image;

   performing special effect processing on at least one of the preset objects in the first image based on the set first special effect display information to obtain a second image;

   The second image is displayed on the shooting interface of the vehicle-mounted camera.
2. The method according to claim 1, said method further comprising:

   When the camera is turned on, acquire a third image collected by the camera;

   determining position information of at least one preset object based on the third image;

   Adjusting the viewing range and/or shooting angle of the camera based on the position information of at least one preset object.
3. The method according to claim 2, wherein the vehicle-mounted camera is arranged in front of the driver's seat in the vehicle cabin or in front of the frontmost row of seats in the vehicle cabin, and the position information includes passenger position information;

   The adjusting the viewing range and/or shooting angle of the camera based on the position information of at least one preset object includes:

   When it is determined according to the riding position information that each of the preset objects in the cabin is seated in the frontmost seat in the cabin, adjust the viewfinder range of the camera to correspond to the frontmost seat A first preset viewing range, and/or adjusting the shooting angle of the camera to be the first preset angle corresponding to the front seat;

   When it is determined according to the seating position information that at least two of the preset objects in the cabin are seated in at least two rows of different seats in the cabin, adjust the viewing range of the camera to be the same as that of the vehicle. The second preset viewing range corresponding to all the seating areas in the cabin, and/or adjust the shooting angle of the camera to the second preset angle corresponding to all the seating areas in the cabin.
4. The method according to any one of claims 1 to 3, wherein the first special effect display information includes special effect material and display position configuration information of the special effect material;

   Performing special effect processing on at least one of the preset objects in the first image based on the set first special effect display information to obtain a second image, including:

   performing display effect processing corresponding to the special effect material on at least one of the preset objects in the first image based on the set display position configuration information of the special effect material;

   The first image after the display effect processing is determined as the second image.
5. The method according to claim 4, wherein the preset object includes at least one of the following: people in the cabin, human body parts, animals; the special effect material includes at least one of the following: beauty material, makeup material , filter material, sticker material.
6. The method according to claim 4 or 5, wherein the preset object includes a human face, and the display position configuration information includes a first mapping relationship between the display position parameters of the special effect material and the positions of the key points of the human face;

   The display effect processing corresponding to the special effect material is performed on at least one of the preset objects in the first image based on the set display position configuration information of the special effect material, including at least one of the following:

   Based on the position of at least one face key point in the first image and the first mapping relationship, determine the set display position of the special effect material, and display the special effect material according to the display position of the special effect material superimposed on said face;

   Determine the image processing method corresponding to the set special effect material; determine the set display position of the special effect material based on the position of at least one face key point in the first image and the first mapping relationship , and process the image area of the face corresponding to the display position of the special effect material according to the image processing manner.
7. The method according to any one of claims 4 to 6, wherein the preset object includes people in the cabin, and the special effect material includes virtual driving tool stickers;

   The performing display effect processing corresponding to the special effect material on at least one of the preset objects in the first image based on the set display position configuration information of the special effect material includes:

   Based on the set display position configuration information of the sticker of the virtual driving tool, at least one special effect scene of a person in the cabin riding a virtual driving tool is presented in the first image.
8. The method according to claim 7, wherein the display position configuration information of the virtual driving tool sticker includes a second mapping between the display position of at least one virtual seating area in the virtual driving tool sticker and the position of the person in the image relationship; the method also includes:

   detecting a seating position of at least one person in the cabin based on the first image;

   Based on the set display position configuration information of the sticker of the virtual driving tool, presenting in the first image at least one special effect scene of people in the vehicle cabin riding a virtual driving tool, including:

   Based on the seating position and the second mapping relationship, determine a first display position of a target virtual seating area corresponding to the seating position;

   The virtual driving tool sticker is displayed in the first image based on the first display position to present at least one special effect scene in which the person rides in the virtual riding area.
9. The method of claim 8, wherein displaying the virtual vehicle sticker in the first image based on the first display position comprises:

   The sticker of the virtual driving tool is superimposed on the first image in the following manner: the target virtual riding area is displayed at the first display position.
10. The method according to any one of claims 7 to 9, wherein the virtual driving tool sticker includes at least one virtual element with adjustable display parameters, the display parameters including display position and/or display size;

    The display position configuration information of the virtual driving tool sticker includes a third mapping relationship between the display position of at least one virtual element in the virtual driving tool sticker and the position of the person in the image;

    The method further includes: detecting a seating position of at least one person in the cabin based on the first image, and determining a second display of at least one virtual element based on the seating position and the third mapping relationship position; and/or, determining a size of at least one person in the cabin based on the first image, and determining a target display size of at least one virtual element based on the size;

    Based on the set display position configuration information of the sticker of the virtual driving tool, presenting in the first image at least one special effect scene of people in the vehicle cabin riding a virtual driving tool, including:

    Based on the second display position and/or target display size of the at least one virtual component, at least one virtual component is displayed in the first image to present at least one special effect scene in which the person rides a virtual driving tool.
11. The method according to claim 10, wherein said displaying at least one of said virtual elements in said first image based on a second display position and/or a target display size of at least one of said virtual elements comprises the following one:

    determining a virtual element drawing area in the first image based on a second display position and/or a target display size of at least one virtual element, and drawing at least one virtual element in the virtual element drawing area;

    rendering at least one of said virtual elements in said first image based on a second display position and/or a target display size of at least one of said virtual elements;

    Based on the second display position and/or target display size of each of the virtual components, splicing at least one of the virtual components to generate the sticker, and adding the sticker to the first image.
12. The method according to claim 10 or 11, said method further comprising:

    determining the number of virtual elements in the virtual vehicle sticker based on the number of people in the cabin in the first image;

    The displaying at least one virtual element in the first image based on the second display position and/or target display size of at least one virtual element includes:

    Based on the number of virtual elements in the virtual driving tool sticker and the second display position and/or target display size of each virtual element, each of the virtual elements is displayed in the first image to present at least one The special effects scene where the person rides the virtual driving tool.
13. The method according to any one of claims 4 to 12, wherein, based on the set display position configuration information of the special effect material, the at least one preset object in the first image is added with the The above-mentioned special effects materials include:

    Detecting a special effect triggering action matching the special effect material based on the first image;

    In response to detecting the special effect triggering action, based on the set display position configuration information of the special effect material, the special effect material is added to at least one of the preset objects in the first image.
14. The method according to any one of claims 1 to 13, further comprising:

    Responsive to the interactive terminal receiving a second instruction, acquiring the driving restriction status of the vehicle camera; wherein the second instruction is used to trigger the vehicle camera to start;

    Based on the driving restriction state, the activation state of the vehicle camera is controlled.
15. The method according to claim 14, wherein the controlling the activation state of the vehicle camera based on the driving restriction state comprises:

    In the case of meeting at least one of the following conditions, start the vehicle camera:

    The driving restriction state is on and the driving speed of the vehicle where the interactive terminal is located does not exceed a preset threshold;

    The driving restriction state is turned on and the parking signal of the vehicle where the interactive terminal is located indicates that the vehicle is in a parked state;

    The driving restriction state is off.
16. The method according to any one of claims 1 to 15, wherein the interactive terminal includes at least one of the following: a vehicle-mounted interactive terminal, and a user terminal in a vehicle cabin.
17. An image capture device, comprising:

    The first acquisition part is configured to acquire a first image captured by the camera of the vehicle-mounted camera in response to the interactive terminal located in the vehicle cabin receiving a first instruction; wherein, the first instruction is used to trigger the vehicle-mounted camera to perform an image shoot;

    The first detection part is configured to detect key features of preset objects in the first image, and determine at least one preset object in the first image;

    The first processing part is configured to perform special effect processing on at least one of the preset objects in the first image based on the set first special effect display information to obtain a second image;

    The display part is configured to display the second image on the shooting interface of the vehicle camera.
18. The device according to claim 17, wherein the device further comprises: a second acquiring part configured to acquire a third image captured by the camera when the camera is turned on; a first determining part is configured to It is configured to determine the position information of at least one preset object based on the third image; the adjustment part is configured to adjust the viewing range and/or shooting angle of the camera based on the position information of at least one preset object.
19. The device according to claim 18, wherein the vehicle-mounted camera is arranged in front of the driver's seat in the vehicle cabin or in front of the front row of seats in the vehicle cabin, and the position information includes riding position information; The adjustment part is further configured to: adjust the viewing range of the camera when it is determined according to the riding position information that each of the preset objects in the cabin is seated in the front row seat in the cabin It is the first preset framing range corresponding to the front row of seats, and/or adjusting the shooting angle of the camera to the first preset angle corresponding to the front row of seats; In the case where at least two of the preset objects are seated in at least two different rows of seats in the cabin, adjust the viewfinder range of the camera to the second preset viewfinder corresponding to all seating areas in the cabin range, and/or adjust the shooting angle of the camera to a second preset angle corresponding to all seating areas in the cabin.
20. The device according to any one of claims 17 to 19, wherein the first special effect display information includes special effect material and display position configuration information of the special effect material; the first processing part is further configured to: The display position configuration information of the special effect material is set, and the display effect processing corresponding to the special effect material is performed on at least one of the preset objects in the first image; The first image is determined as the second image.
21. The device according to claim 20, wherein the preset object includes at least one of the following: people in the cabin, human body parts, animals; the special effect material includes at least one of the following: beauty material, makeup material , filter material, sticker material.
22. The device according to claim 20 or 21, wherein the preset object includes a human face, and the display position configuration information includes a first mapping relationship between the display position parameters of the special effect material and the key points of the human face; The first processing part is further configured as at least one of the following: based on the position of at least one human face key point in the first image and the first mapping relationship, determine the set display position, and superimpose the special effect material on the face according to the set display position of the special effect material; determine the image processing method corresponding to the set special effect material, based on the first The position of at least one key point of the human face in the image and the first mapping relationship, determine the set display position of the special effect material, and compare the human face and the special effect material according to the image processing method The image area corresponding to the display position is processed.
23. The device according to any one of claims 20 to 22, wherein the preset object includes people in the cabin, and the special effect material includes virtual driving tool stickers; the first processing part is further configured to: Based on the set display position configuration information of the sticker of the virtual driving tool, at least one special effect scene of a person in the cabin riding a virtual driving tool is presented in the first image.
24. The device according to claim 23, wherein the display position configuration information of the virtual driving tool sticker includes a second mapping between the display position of at least one virtual seating area in the virtual driving tool sticker and the position of the person in the image relationship; the device also includes: a second detection part configured to detect the seating position of at least one person in the cabin based on the first image; the first processing part is also configured to: based on the The seating position and the second mapping relationship, determining a first display position of a target virtual seating area corresponding to the seating position; displaying the virtual driving tool sticker in the first image based on the first display position, to present at least one special effect scene in which the person rides in the virtual seating area.
25. The device according to claim 24, wherein the first processing part is further configured to: superimpose the sticker of the virtual driving tool on the first image in the following manner: the target virtual riding area is displayed on at the first display position.
26. The device according to any one of claims 23 to 25, wherein the virtual driving tool sticker includes at least one virtual element with adjustable display parameters, and the display parameters include display position and/or display size; the virtual The display position configuration information of the driving tool sticker includes a third mapping relationship between the display position of at least one virtual element in the virtual driving tool sticker and the position of the person in the image; the device also includes: a second determining part, configured to detect a seating position of at least one person in the vehicle cabin based on the first image, and determine a second display position of at least one virtual element based on the seating position and the third mapping relationship, and /or configured to determine the size of at least one person in the cabin based on the first image, and determine a target display size of at least one virtual element based on the size; the first processing part is further configured It is: based on the second display position and the target display size of at least one virtual component, display at least one virtual component in the first image to present at least one special effect scene in which the person rides a virtual driving tool.
27. The apparatus according to claim 26, wherein the first processing part is further configured as one of: determining the first image based on a second display position and/or a target display size of at least one of the virtual elements in the virtual element drawing area, and draw at least one virtual element in the virtual element drawing area; based on the second display position and/or target display size of at least one virtual element, render in the first image At least one of the virtual components; based on the second display position and/or target display size of each of the virtual components, splicing at least one of the virtual components to generate the sticker, adding the sticker to the second in an image.
28. The device according to claim 26 or 27, wherein the device further comprises: a third determining part configured to determine the virtual driving tool based on the number of people in the cabin in the first image The number of virtual elements in the sticker; the first processing part is further configured to: based on the number of virtual elements in the virtual driving tool sticker and the second display position and/or target display size of each virtual element , displaying each of the virtual elements in the first image to present at least one special effect scene in which the person rides a virtual driving tool.
29. The apparatus according to any one of claims 20 to 28, wherein the first processing part is further configured to: based on the first image, detect a special effect triggering action matching the special effect material; To the special effect trigger action, adding the special effect material to at least one of the preset objects in the first image based on the set display position configuration information of the special effect material.
30. The device according to any one of claims 17 to 29, wherein the device further comprises: a third obtaining part, configured to obtain the driving data of the vehicle-mounted camera in response to the interaction terminal receiving the second instruction. Restricted state; wherein, the second instruction is used to trigger the start-up of the vehicle-mounted camera; the control part is configured to control the start-up state of the vehicle-mounted camera based on the driving restriction state.
31. The device according to claim 30, wherein the control part is further configured to: activate the vehicle-mounted camera when at least one of the following conditions is met: the driving restriction state is on and the vehicle where the interactive terminal is located The driving speed does not exceed the preset threshold; the driving restriction state is on and the parking signal of the vehicle where the interactive terminal is located indicates that the vehicle is in a parked state; the driving restriction state is off.
32. The device according to any one of claims 17 to 31, wherein the interactive terminal includes at least one of the following: a vehicle-mounted interactive terminal, and a user terminal in a vehicle cabin.
33. A computer device, comprising a memory and a processor, the memory stores a computer program that can run on the processor, and the processor implements the steps in the method of any one of claims 1 to 16 when executing the program .
34. A vehicle comprising:

    Car camera, used to capture image information in the car cabin;

    The vehicle-mounted interactive terminal is connected with the vehicle-mounted camera, and is used to: receive a first instruction triggering the vehicle-mounted camera to take image; send the first instruction to the processor; display the shooting interface of the vehicle-mounted camera;

    The processor is configured to: acquire a first image captured by the camera of the vehicle-mounted camera in response to the interactive terminal located in the vehicle cabin receiving a first instruction; wherein, the first instruction is used to trigger the vehicle-mounted camera to take an image; Detecting key features of preset objects in the first image, determining at least one preset object in the first image; displaying information on at least one of the first images based on the set first special effect display information The preset object is subjected to special effect processing to obtain a second image; the second image is sent to the interactive terminal to display the second image on the shooting interface of the vehicle camera.
35. A computer storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps in the method of any one of claims 1 to 16 are realized.
36. A computer program product, the computer program product comprising a non-transitory computer-readable storage medium storing a computer program, when the computer program is read and executed by a computer, the method described in any one of claims 1 to 16 is realized in the steps.

Images