CN114559879B - Streaming media rearview mirror image display method and device, vehicle and storage medium - Google Patents

Streaming media rearview mirror image display method and device, vehicle and storage medium Download PDF

Info

Publication number
CN114559879B
CN114559879B CN202210239327.9A CN202210239327A CN114559879B CN 114559879 B CN114559879 B CN 114559879B CN 202210239327 A CN202210239327 A CN 202210239327A CN 114559879 B CN114559879 B CN 114559879B
Authority
CN
China
Prior art keywords
center
gravity
view
rearview mirror
streaming media
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210239327.9A
Other languages
Chinese (zh)
Other versions
CN114559879A (en
Inventor
罗伍峙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhaoqing Xiaopeng New Energy Investment Co ltd Guangzhou Branch
Original Assignee
Zhaoqing Xiaopeng New Energy Investment Co ltd Guangzhou Branch
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhaoqing Xiaopeng New Energy Investment Co ltd Guangzhou Branch filed Critical Zhaoqing Xiaopeng New Energy Investment Co ltd Guangzhou Branch
Priority to CN202210239327.9A priority Critical patent/CN114559879B/en
Publication of CN114559879A publication Critical patent/CN114559879A/en
Application granted granted Critical
Publication of CN114559879B publication Critical patent/CN114559879B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8066—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring rearward traffic

Abstract

The embodiment of the application discloses a streaming media rearview mirror image display method which is characterized by being applied to a vehicle; the vehicle comprises a streaming media rearview mirror, a seat and a camera device; the method comprises the following steps: the gravity center sensor arranged on the seat is used for collecting gravity center data of an object on the seat; the center of gravity data includes: the position of the center of gravity of the object and/or the weight of the object; determining the central position of the visual field center of the streaming media rearview mirror in the visual field range of the camera according to the gravity center data; and intercepting a second image from the first image shot by the shooting device according to the central position, and displaying the second image in the streaming media rearview mirror. By implementing the embodiment of the application, the image displayed by the CMS can be adjusted according to the gravity center data so as to adjust the visual field of the CMS.

Description

Streaming media rearview mirror image display method and device, vehicle and storage medium
Technical Field
The application relates to the technical field of vehicles, in particular to a method and a device for displaying images of a streaming media rearview mirror, a vehicle and a storage medium.
Background
The streaming rearview mirror system (Camera Monitor System, CMS) can provide a rear, side indirect view (FOV) by a camera and streaming rearview mirror as a monitor instead of the conventional streaming rearview mirror. However, in practice, it is found that the actual image displayed on the CMS at present generally has only a fixed viewing angle, and it is difficult to adjust the visual field of the CMS.
Disclosure of Invention
The embodiment of the application discloses a streaming media rearview mirror image display method, a streaming media rearview mirror image display device, a vehicle and a storage medium, wherein images displayed by a CMS can be adjusted according to collected gravity center data so as to adjust the visual field of the CMS.
The embodiment of the application discloses a streaming media rearview mirror image display method which is applied to a vehicle; the vehicle comprises a streaming media rearview mirror, a seat and a camera device; the method comprises the following steps:
the gravity center sensor arranged on the seat is used for collecting gravity center data of an object on the seat; the center of gravity data includes: the position of the center of gravity of the object and/or the weight of the object;
determining the central position of the visual field center of the streaming media rearview mirror in the visual field range of the camera according to the gravity center data;
and intercepting a second image from the first image shot by the shooting device according to the central position, and displaying the second image in the streaming media rearview mirror.
In one embodiment, the center of gravity data includes: the position of the center of gravity of the object; the determining, according to the gravity center data, a center position of a center of view of the streaming media rearview mirror in a field of view range of the image capturing device includes:
if the acquired gravity center position is changed, according to the gravity center variation corresponding to the gravity center position, adjusting a first center position of the visual field center of the streaming media rearview mirror to obtain a second center position of the visual field center; the first center position is a center position of the field of view center in a field of view range of the image pickup device before the center of gravity position is changed;
and said capturing a second image from said first image based on said center location, comprising:
and intercepting a second image from the first image according to the second center position.
In one embodiment, the adjusting the first center position of the view center of the streaming media rearview mirror according to the gravity center variation corresponding to the gravity center position to obtain the second center position of the view center includes:
calculating the visual field variation corresponding to the streaming media rearview mirror according to the gravity center variation;
Calculating a position offset according to the field of view variation;
and calculating a second center point position of the visual field center according to the first center point position of the visual field center and the position offset.
In one embodiment, the calculating the view variation corresponding to the view of the streaming media rearview mirror according to the gravity center variation includes:
and carrying out normalization calculation on the gravity center variation according to the adjustment gear and the area size of the effective sensing area of the gravity center sensor to obtain the visual field variation corresponding to the visual field of the streaming media rearview mirror.
In one embodiment, the center of gravity variation includes: a first barycentric variation component in a first direction, and a second barycentric variation component in a second direction; the field of view variation includes: a first field of view variation component in the first direction and a second field of view variation component in the second direction; the first direction is perpendicular to the second direction;
and normalizing the gravity center variation according to the adjustment gear and the area size of the effective sensing area of the gravity center sensor to obtain a field variation corresponding to the field of view of the streaming media rearview mirror, including:
Calculating a first initial change component according to the first gravity center change component and the adjusting gear corresponding to the first direction, and normalizing the first initial change component according to the first length of the effective induction area of the gravity center inductor in the first direction to obtain a first visual field change component;
calculating a second initial change component according to the second gravity change component and the adjusting gear corresponding to the second direction, and normalizing the second initial change component according to the second length of the effective induction area in the second direction to obtain a second visual field change component.
In one embodiment, the calculating the positional offset from the field of view variation amount includes:
and performing amplification processing or reduction processing on the visual field variation to obtain a position offset.
In one embodiment, the field of view variation includes: a first field of view variation component in a first direction and a second field of view variation component in a second direction; the positional offset includes: a first offset component in the first direction and a second offset component in the second direction; the first direction is perpendicular to the second direction;
And performing an enlarging process or a reducing process on the field of view variation to obtain a position offset, including:
calculating the first offset component according to the first view variation component and a view scaling factor corresponding to the first direction;
and calculating the second offset component according to the second visual field variation component and the visual field scaling factor corresponding to the second direction.
In one embodiment, the center of gravity data includes: the position of the center of gravity of the object; the determining, according to the gravity center data, a center position of a center of view of the streaming media rearview mirror in a field of view range of the image capturing device includes:
inquiring a target position corresponding to the currently acquired gravity center position according to a preset corresponding relation, and determining the inquired target position as a visual field center of the streaming media rearview mirror in a visual field range of the camera device.
In one embodiment, the center of gravity data includes: the weight of the object; and determining a center position of a field of view center of the streaming media rearview mirror in a field of view range of the image pickup device according to the gravity center data, wherein the method comprises the following steps:
determining a trend of the weight;
And determining the central position of the visual field center of the streaming media rearview mirror in the visual field range of the image pickup device according to the change trend.
In one embodiment, the determining, according to the trend of change, a center position of a center of a field of view of the streaming rearview mirror in a field of view of the image capturing device includes:
if the trend of change belongs to any one of the following trends, determining a center position of the center of view of the streaming rearview mirror in the view range of the image capturing device as a default position:
the weight gradually increases from less than or equal to a first threshold to greater than or equal to a second threshold;
the weight gradually decreases from greater than or equal to the second threshold value to less than or equal to the first threshold value;
the weight is always less than or equal to the first threshold value for a monitoring period.
In one embodiment, the default location comprises: a user default location corresponding to the user identity information; the user identity information is identified based on the weight being greater than the second threshold.
In one embodiment, the center of gravity data further comprises: a center of gravity position; and determining a center position of a field of view center of the streaming media rearview mirror in a field of view range of the image capturing device according to the change trend, including:
And if the change trend is that the weight is always greater than or equal to the second threshold value in the monitoring time period, determining the central position of the visual field center of the streaming media rearview mirror in the visual field range of the image pickup device according to the gravity center position.
The embodiment of the application discloses a streaming media rearview mirror image display device, which comprises:
the acquisition module is used for acquiring the gravity center data of the object on the seat through the gravity center sensor arranged on the seat; the center of gravity data includes: the position of the center of gravity of the object and/or the weight of the object;
the determining module is used for determining the central position of the visual field center of the streaming media rearview mirror in the visual field range of the camera according to the gravity center data;
the intercepting module is used for intercepting a second image from the first image shot by the shooting device according to the central position;
and the display module is used for displaying the second image in the streaming media rearview mirror.
The embodiment of the application discloses a vehicle, which comprises a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor realizes any one of the streaming media rearview mirror image display methods disclosed by the embodiment of the application.
The embodiment of the application discloses a computer readable storage medium, on which a computer program is stored, which when executed by a processor, implements any one of the streaming media rearview mirror image display methods disclosed in the embodiments of the application.
Compared with the related art, the embodiment of the application has the following beneficial effects:
the center of gravity sensor that sets up on the seat can gather the focus data of object, and the vehicle can confirm the central point of vision center in camera device's the visual field scope of CMS according to the focus data that gathers to make the second image that cuts out according to this central point carry out the adaptation according to the difference of focus data, make the image that CMS shows no longer have fixed angle, reaches the visual field's of adjustment CMS effect.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic illustration of a vehicle according to one embodiment of the disclosure;
FIG. 2 is a flow chart of a method for displaying images of a streaming media rearview mirror according to an embodiment of the disclosure;
FIG. 3A is an exemplary diagram of a center position of a center of field of view of an embodiment disclosure;
FIG. 3B is a diagram illustrating a second image displayed in a streaming rearview mirror according to one embodiment of the disclosure;
FIG. 4 is a flow chart of another method for displaying images of a streaming rearview mirror according to an embodiment of the disclosure;
FIG. 5 is a flow chart of another method for displaying images of a streaming rearview mirror according to an embodiment of the disclosure;
FIG. 6 is a diagram showing an example of contrast of an image with a change in the position of the center of gravity according to one embodiment;
FIG. 7 is a flow chart illustrating another method for displaying images of a streaming rearview mirror according to an embodiment of the disclosure;
FIG. 8 is a schematic diagram of a streaming media rearview mirror image display device according to an embodiment of the disclosure;
fig. 9 is a schematic view of a vehicle according to an embodiment of the present disclosure.
Detailed Description
The following description of the technical solutions in the embodiments of the present application will be made clearly and completely with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.
It should be noted that the terms "comprising" and "having" and any variations thereof in the embodiments and figures herein are intended to cover a non-exclusive inclusion. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those listed steps or elements but may include other steps or elements not listed or inherent to such process, method, article, or apparatus.
The embodiment of the application discloses a streaming media rearview mirror image display method, a streaming media rearview mirror image display device, a vehicle and a storage medium, wherein images displayed by a CMS can be adjusted according to collected gravity center data so as to adjust the visual field of the CMS. The following will describe in detail.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a vehicle according to an embodiment of the disclosure. As shown in fig. 1, the vehicle 10 may include: a first CMS system 110, a second CMS system 120, and a seat 130.
Wherein the first CMS system 110 may comprise: a first camera 110a, a first image signal processor 110b (Image Signal Processing, ISP) and a first streaming rearview mirror 110c.
The second CMS system 120 may be similar in structure to the first CMS system 110 and may include a second camera 120a, a second ISP processor 120b, and a second streaming rearview mirror 120c.
Taking the first CMS system 110 as an example, the first camera 110a may capture image data and transmit the captured image data to the first ISP processor 110b may process the image data captured by the first camera 110a in a plurality of formats pixel by pixel. For example, each image pixel may have a bit depth of 8, 10, 12, or 14 bits, and the first ISP processor 110b0 may perform one or more image processing operations on the image data, collecting statistical information about the image data. Wherein the image processing operations may be performed with the same or different bit depth precision. For example, the image processing operations may include temporal filtering operations, image data processing operations in one or more color spaces of the original domain, YUV, RGB, YCbCr, etc. The first ISP processor 110b processes the image data to generate an original image, where the field of view of the original image corresponds to the field of view of the image capturing device, and includes all image information captured by the image capturing device.
The first streaming media mirror 110c may include a display or a display panel for displaying images. Due to regulatory restrictions, the original image generated by the first ISP processor 110b may not be directly transmitted to the first streaming media rearview mirror 110c for display, but the original image generated by the first ISP processor 110b needs to be intercepted, and the intercepted partial image is displayed by the first streaming media rearview mirror 110 c.
The seat 130 may include a center of gravity sensor 130a, and the center of gravity sensor 130a may be disposed on a surface of the seat 130 or may be disposed inside the seat 130, which is not particularly limited. The center of gravity sensor 130a may be used to collect center of gravity data of an object on the seat 130. Wherein the center of gravity data may include: the position of the center of gravity and/or the weight of the object.
The gravity center position may refer to a position of the gravity center of the object in the effective sensing area of the gravity center sensor 130 a. For example, a two-dimensional planar coordinate system may be constructed for the effective sensing area of the barycenter sensor 130, and the barycenter position may be represented by coordinates under the coordinate system.
The object on the seat 130 may be an occupant in the vehicle, and when the occupant in the vehicle makes an action of moving the body, swinging the head, or the like on the seat 130 to change the field of view, the position of the center of gravity and the weight acquired by the center of gravity sensor 130a may be changed.
Referring to fig. 2, fig. 2 is a flow chart of a method for displaying an image of a streaming rearview mirror according to an embodiment of the disclosure. The method is applicable to a vehicle and in particular can be executed by any one of the processors of the vehicle. For example, the method may be performed by the aforementioned first ISP processor 110b, or the method may be performed by a processor such as an electronic control unit (Electronic Control Unit, ECU) or a microcontroller (Micro Control Unit, MCU) that are communicatively connected to the first ISP processor 110b, the first streaming rearview mirror 110c, and the center of gravity sensor 130a, respectively, without limitation. In addition, when the vehicle includes a plurality of CMS streaming rearview mirrors, an image displayed in any one of the streaming rearview mirrors can be determined by the following method.
As shown in fig. 2, the method for displaying the image of the streaming media rearview mirror may include the following steps:
210. and acquiring gravity center data of an object on the seat through a gravity center sensor arranged on the seat.
In this embodiment, the gravity sensor may continuously collect gravity data for a period of time, and each time the gravity data is collected, the vehicle may perform steps 220-230 described below to adjust the image displayed by the streaming rearview mirror according to the gravity data.
220. And determining the central position of the visual field center of the streaming media rearview mirror in the visual field range of the image pickup device according to the gravity center data.
In the embodiment of the present application, the field of view of the image capturing apparatus may be the field of view of the ISP processor, and may be represented by the size of the original image generated by the ISP processor. The center of the view of the streaming rearview mirror in the view range of the imaging device may be the center of the image displayed on the streaming rearview mirror when the user looks at the streaming rearview mirror.
Referring to fig. 3A, fig. 3A is an exemplary diagram illustrating a center position of a center of a field of view according to an embodiment. As shown in fig. 3A, the field of view 310 may be a field of view corresponding to the ISP processor, and the size of the field of view 310 is larger than the size of the image 320 displayed in the streaming rearview mirror. The center of the field of view of the image 320 may be a center point 320a, and the position of the center point 320a in the field of view 310 may be represented as (u 1, v 1), u1 may represent the abscissa, and v1 may represent the ordinate. (u 1, v 1) namely, a center position of a visual field center of the streaming rearview mirror in a visual field range of the image pickup device.
In one embodiment, the center of gravity data may include a center of gravity position of the object, and the vehicle may determine a center position of a center of view of the streaming rearview mirror in a field of view of the camera device based on the center of gravity position. When the human body makes an action of changing the field of view, the position of the center of gravity may be changed. Therefore, the gravity center position can represent the angle of the passenger in the vehicle looking at the streaming media rearview mirror to a certain extent, and the vision center determined according to the gravity center position can simulate the vision center of the traditional optical streaming media rearview mirror, so that the image displayed by the streaming media rearview mirror accords with the angle of the passenger looking at the streaming media rearview mirror.
In one embodiment, the center of gravity data may include a weight of the object, and the vehicle may determine a center position of a center of view of the streaming media rearview mirror in a field of view of the camera based on the acquired weight. When the human body makes an action of changing the field of view, the body and the seat may not be completely attached, and the weight acquired by the gravity center sensor may be changed. Therefore, the weight can also represent the angle of the current human body looking at the streaming media rearview mirror to a certain extent, and the visual field center determined according to the weight can also simulate the visual field center of the traditional optical streaming media rearview mirror, so that the image displayed by the streaming media rearview mirror accords with the angle of the current human body looking at the streaming media rearview mirror.
Alternatively, weight may also be used to determine whether a person is sitting in the seat, which may include, but is not limited to, the following three phases: from standing to sitting, already sitting on the seat, and leaving the seat. In different stages, the streaming media rearview mirror can display images with different visual angles, and provides different information for passengers in the automobile.
Or, the weight can also be used for judging the identities of different passengers, so that the images provided by the streaming media rearview mirror can be changed according to different identity information.
In one embodiment, the center of gravity data may also include the center of gravity position of the object and the weight of the object. The vehicle can combine the weight and the gravity center position to determine the center position of the gravity center of the visual field of the streaming media rearview mirror in the visual field range of the camera device, so as to improve the accuracy of the image displayed by the streaming media rearview mirror.
230. And intercepting a second image from the first image shot by the shooting device according to the central position, and displaying the second image in the streaming media rearview mirror.
The first image may be an original image generated by the ISP processor, and a field of view of the first image may be the same as a field of view of the image capturing apparatus.
The area of the second image and the shape of the image area may be fixed, and may be determined according to the area and shape of the display or the display panel in the streaming rearview mirror. Therefore, after the vehicle performs step 220 to determine that the center of view is within the field of view of the image capturing device, the boundary of the second image with the center position as the center point may be determined, and the second image may be captured from the first image.
Referring to fig. 3B, fig. 3B is an exemplary diagram of a second image displayed in a streaming rearview mirror according to an embodiment of the disclosure. As shown in fig. 3B, it is assumed that at time T1, the vehicle determines, based on the gravity center data acquired at time T1, that the center position of the center of view of the streaming media mirror is shown as center point 320a, and that the second image displayed in the streaming media mirror is shown as image 320. At time T2, the center of gravity data collected by the vehicle may be changed from the center of gravity data collected at time T1, so that the center position of the center of view determined from the center of gravity data collected at time T2 is shown as a center point 330a, and the second image displayed in the streaming rearview mirror is shown as an image 330.
Therefore, in the embodiment of the application, the vehicle can determine the center position of the visual field center of the CMS in the visual field range of the camera according to the collected center-of-gravity data, so that the second image cut according to the center position can be adaptively adjusted according to different center-of-gravity data, the image displayed by the CMS is not only fixed in angle, and the effect of adjusting the visual field of the CMS is achieved.
In one embodiment, the center of gravity data may include a center of gravity position of the object. Referring to fig. 4, fig. 4 is a flow chart illustrating another method for displaying an image of a streaming media rearview mirror according to an embodiment of the invention. As shown in fig. 4, the method may include the steps of:
410. The gravity center sensor arranged on the seat is used for collecting the gravity center position of an object on the seat.
420. And determining the central position of the visual field center of the streaming media rearview mirror in the visual field range of the image pickup device according to the gravity center position.
As an alternative embodiment, when the position of the center of gravity of the vehicle is changed, the center of view of the streaming media rearview mirror may be adjusted at the first center position of the image pickup device according to the amount of change of the center of gravity corresponding to the position of the center of gravity, so as to obtain the second center position of the center of view.
The first center position is a center position of the center of view in the field of view range of the image pickup device before the center of gravity position is changed. The first center position may be a default position stored in the vehicle, or may be a position determined according to a center of gravity position last time, or may be a position determined according to a weight last time.
When the gravity center position acquired at the first moment is different from the gravity center position acquired at the second moment, it can be determined that the gravity center position is changed, and the first moment and the second moment can be any two different moments without limitation.
The gravity center change amount corresponding to the gravity center position can be determined according to the gravity center position acquired by the gravity center sensor at the first moment and the gravity center position acquired by the gravity center sensor at the second moment, and can be the difference value between the gravity center position at the first moment and the gravity center position at the second moment.
Alternatively, the movement of the center of gravity position may be continued for a long period of time, and in order to improve the accuracy of the amount of change in the center of gravity, the vehicle may determine the center of gravity position acquired after the center of gravity position is changed and held stable again as effective data. That is, the second time may be a time when the center of gravity position is changed and then kept stable.
For example, assuming that an occupant sitting in the seat moves the body center of gravity, the center of gravity positions acquired by the center of gravity sensor at the time T3, the time T4 and the time T5 are all different, and the center of gravity position is continuously changed. And at the time T6, the gravity center position acquired by the gravity center sensor is the same as the gravity center position acquired at the time T5, and the gravity center position is kept stable again, so that the second time can be the time T6, and the gravity center change amount can be the difference value between the gravity center position acquired at the time T6 and the gravity center position acquired at the time T3.
That is, when the detected center of gravity position changes, the vehicle can adjust the center position of the center of view of the streaming rearview mirror in the field of view of the imaging device according to the amount of change in the center of gravity position, thereby achieving the effect of adjusting the display image in the streaming rearview mirror with the movement of the center of gravity position.
As another alternative embodiment, the correspondence between each center of gravity position in the effective sensing area of the center of gravity sensor and each target position of the center of view of the streaming rearview mirror in the view angle range of the image pickup device may be calibrated in advance. When the vehicle collects the gravity center position, the target position corresponding to the currently collected gravity center position can be directly inquired according to the preset corresponding relation, and the inquired target position is determined as the center position of the visual field center of the streaming media rearview mirror in the visual field range of the camera device.
That is, whether or not the acquired center of gravity position changes, the center position corresponding to the currently acquired image position can be determined in real time. The target positions corresponding to the different center of gravity positions may be different; alternatively, the target positions corresponding to the two center-of-gravity positions having a smaller distance may be the same, and the target positions corresponding to the two center-of-gravity positions having a larger distance may be different, and the present invention is not limited thereto.
430. And intercepting a second image from the first image shot by the shooting device according to the central position, and displaying the second image in the streaming media rearview mirror.
Therefore, in the foregoing method for displaying an image of a streaming media rearview mirror, the vehicle may adjust the center position of the center of view of the streaming media rearview mirror in the view range of the image capturing device according to the center of gravity position acquired by the center of gravity sensor, so that the second image displayed in the streaming media rearview mirror may change along with the change of the center of gravity position. The passenger on the seat can adjust the visual field of the streaming media rearview mirror through the mode of moving the gravity center position, when the streaming media rearview mirror is conveniently adjusted to display images, the images displayed by the streaming media rearview mirror are consistent with the angles of the passenger looking at the streaming media rearview mirror, the passenger is provided with driving information meeting the requirements, and the driving safety is improved.
In order to more clearly describe the embodiment of adjusting the center position of the view center according to the change amount of the center of gravity in the foregoing step 420, referring to fig. 5, fig. 5 is a flowchart of another method for displaying an image of a streaming rearview mirror according to an embodiment of the present invention, which can be applied to a vehicle. As shown in fig. 5, the method may include the steps of:
510. The gravity center sensor arranged on the seat is used for collecting the gravity center position of an object on the seat.
520. If the collected gravity center position is changed, the visual field variation corresponding to the streaming media rearview mirror is calculated according to the gravity center position variation.
As an alternative embodiment, the value of the field of view variation may be directly determined as the value of the gravity center variation, that is, the field of view variation is equal to the gravity center variation.
As another alternative embodiment, the field of view variation may be scaled down equally, and the scaling down may be determined according to the area ratio between the effective sensing area of the center of gravity sensor and the display area of the streaming rearview mirror.
As another alternative implementation manner, the visual field variation can also be obtained by carrying out normalization calculation on the gravity center variation according to the preset adjustment gear and the area size of the effective sensing area of the gravity center sensor, so as to filter out visual field jitter of the streaming media rearview mirror image possibly caused by the gravity center movement of the distance.
For ease of calculation, the center of gravity variation, the field of view variation, and the area size of the effective sensing area can be expressed by decomposing into two components in the vertical direction.
The two perpendicular directions may include: a first direction and a second direction. For example, the first direction may be an x-axis direction in a two-dimensional planar coordinate system constructed by an effective sensing region of the barycentric sensor, and the second direction may be a y-axis direction in the aforementioned two-dimensional planar coordinate system.
The center of gravity variation may include: a first barycentric variation component in the first direction, and a second barycentric variation component amount in the second direction.
The field of view variation may include: a first field of view variation component in a first direction, and a second field of view variation component in a second direction.
The area size of the effective sensing area may include: a first length in a first direction, and a second length in a second direction.
Accordingly, adjusting the gear may include: the adjustment gear corresponding to the first direction and the adjustment gear corresponding to the second direction may be the same or different, and may be set according to actual service requirements, which is not specifically limited.
Therefore, the normalization calculation of the gravity center variation according to the preset adjustment gear and the area size of the effective sensing area of the gravity center sensor to obtain the visual field variation may include:
Calculating a first initial variation according to the first gravity center variation and the adjustment gear corresponding to the first direction; and normalizing the first initial variation according to the first length of the effective sensing area in the first direction to obtain a first visual field variation.
Calculating a second initial variation according to the second gravity variation and the adjusting gear corresponding to the second direction; and normalizing the second initial variation according to the second length of the first image in the second direction to obtain a second visual field variation.
Illustratively, the first field of view variation may be calculated according to the following formula:
c＝(a*n)/(x max -x min ) The method comprises the steps of carrying out a first treatment on the surface of the Formula (1);
wherein c may represent a first field of view variation component, a may represent a first center of gravity variation component, n may represent an adjustment gear corresponding to a first direction, (x) max -x min ) A first length of the effective sensing region in a first direction may be represented. Alternatively, the first field-of-view variation component c may be an integer, and when the first field-of-view variation component c is calculated by the formula (1), if the calculation result is a non-integer, the first field-of-view variation component c may be rounded up or rounded down.
Illustratively, the second field of view variation may be calculated according to the following formula:
d＝(b*m)/(y max -y min ) The method comprises the steps of carrying out a first treatment on the surface of the Formula (2);
Wherein d may represent a second visual field variation component, b may represent a second gravity variation component, m may represent an adjustment gear corresponding to a second direction, (y) max -y min ) A second length of the effective sensing region in a second direction may be represented. Alternatively, the second field-of-view variation component d may be an integer, and when the second field-of-view variation component d is calculated by the formula (2), if the calculation result is a non-integer, the second field-of-view variation component d may be rounded up or rounded down.
530. The positional shift amount is calculated based on the field of view change amount.
As an alternative embodiment, the value of the positional offset may be directly determined as the value of the field of view variation, that is, the positional offset is equal to the field of view variation.
As another alternative embodiment, the positional offset may be obtained by enlarging or reducing the amount of change in the field of view.
For ease of calculation, the positional shift amount may be expressed by being decomposed into two components in the vertical direction. That is, the positional offset may include: a first offset component in a first direction, and a second offset component in a second direction.
Therefore, the aforementioned enlarging process or reducing process for the view field variation amount is performed to obtain the position offset amount, including:
calculating a first offset component according to the first field of view variation component and a field of view scaling factor corresponding to the first direction;
A second offset component is calculated from the second field of view variation component and a field of view scaling factor corresponding to the second direction.
Wherein the field of view scaling factor is used to zoom in or out the field of view variation: when the value of the visual field scaling factor is larger than 0, the visual field scaling factor can be used for amplifying the visual field variation; when the value of the visual field scaling factor is smaller than 0, the visual field scaling factor can be used for reducing the visual field variation. The field of view scaling factor corresponding to the first direction may be the same as or different from the field of view scaling factor corresponding to the second direction, and may be calibrated according to the real vehicle environment of the vehicle, which is not particularly limited.
540. And calculating the second center point position of the visual field center according to the first center point position of the visual field center and the position offset.
In step 540, the position offset is added to the first center point position to obtain a second center point position.
Exemplary, assume that the first center point position is represented as W (x 3 ,y 3 ) Then the second center point position Z (x 4 ,y 4 ) The method can be calculated by the following formula:
x 4 ＝x 3 ++ (c×e); formula (3);
y 4 ＝y 3 ++ (d x f); formula (4);
where e may represent a field of view scaling factor corresponding to the first direction and f may represent a field of view scaling factor corresponding to the second direction. (c) may represent a first offset component and (d) may represent a second offset component.
550. And intercepting a second image from the first image according to the second center position, and displaying the second image in the streaming media rearview mirror.
Referring to fig. 6, fig. 6 is a diagram illustrating an example of an image comparison after a change in the position of the center of gravity according to an embodiment.
As shown in fig. 6, the center of gravity sensor corresponds to the effective sensing region 650. The coordinates of the active sensing area 650 may range from (0, 0) to (100 ). That is, the size of the effective sensing region 650 is 100×100, and the first length of the effective sensing region 650 in the x-axis direction is 100 and the second length in the y-axis direction is 100. Let n=10 be the adjustment gear corresponding to the x-axis direction and m=5 be the adjustment gear corresponding to the y-axis direction.
It is assumed that at time T7, the coordinates of the center of gravity position 610a in the effective sensing region 650 of the center of gravity sensor may be as shown as point a (x 1 ，y 1 ) As shown. The first center position of the view center 620a of the streaming rearview mirror in the view range 640 of the camera device can be, for example, point W (x 3 ，y 3 ) The second image displayed in the streaming mirror may be shown as image 630 a.
At time T8, the coordinates of the center of gravity position 610B in the effective sensing region 650 of the center of gravity sensor may be as point B (x 2 ，y 2 ) As shown. The center of gravity position 610b corresponding to time T8 is different from the center of gravity position 610a corresponding to time T7, and the center of gravity position is changed. The vehicle may adjust the first center position according to the change of the center of gravity corresponding to the center of gravity, and the adjusted second center position of the center of view 620b may be the same as the Z point (x 4 ，y 4 ) The second image displayed in the streaming mirror may be shown as image 630 b.
Suppose A (x 1 ，y 1 )＝A(50,50)，B(x 2 ，y 2 )＝B(28,70)，W(x 3 ，y 3 ) =w (40, 20), then Z (x 4 ，y 4 ) The calculation can be performed according to the following way:
first barycentric variation component a=x 1 -x 2 ＝50-28＝22；
Second centroid variable component b=y 1 -y 2 ＝50-70＝-20；
First field change component c= (a×n)/(x) max -x min )＝(22*10)/(100)＝2；
Second field of view variation component d= (b x m)/(y) max -y min )＝(-20*5)/(100)＝-1；
Assuming that the field of view scaling factor e=5 corresponding to the first direction, the field of view scaling factor f=2 corresponding to the second direction;
x 4 ＝x 3 +(c*e)＝40+(2*5)＝50；y 4 ＝y 3 +(d*f)＝20+(-1*2)＝18；
that is, the second center position Z (x 4 ，y 4 )＝Z(50,18)。
It can be seen that when the center of gravity position changes, the center position of the visual field center in the visual field range of the image pickup device also changes accordingly, so that the visual field of the CMS also changes relatively.
In another embodiment, the center of gravity data may also include the weight of the object. Referring to fig. 7, fig. 7 is a flow chart of another method for displaying an image of a streaming media rearview mirror according to an embodiment of the invention, which is applicable to a vehicle. As shown in fig. 7, the method may include the steps of:
710. the weight of an object on the seat is collected through a gravity center sensor arranged on the seat.
720. And determining the change trend of the collected weight.
The trend of the weight may refer to the change in the collected weight over a period of time, and may include, for example, but not limited to:
In the first case, the weight gradually increases from the first threshold value to the second threshold value;
in the second case, the weight is gradually reduced from being greater than or equal to the second threshold value to being less than or equal to the first threshold value;
the weight is always larger than or equal to a second threshold value in the monitoring time period;
and in the fourth case, the weight is always smaller than or equal to the first threshold value in the monitoring duration.
The first threshold and the second threshold may be set according to actual service requirements. For example, the first threshold may be set to the weight collected by the center of gravity sensor when no object is present on the seat; the second threshold value may be set as an average weight of the human body, and is not particularly limited. The monitoring time period may be any time period, for example, may be 2 minutes, 1 minute, 30 seconds, etc., and is not particularly limited.
The trend of the collected weight during the seating of the occupant may be as shown in case one; the trend of the collected weight during the occupant's exit from the seat may be as shown in case two; the trend of the collected weight when the occupant sits on the seat may be as shown in case three; in the absence of any object on the seat, the collected weight may trend as shown in case four.
730. And determining the central position of the visual field center of the streaming media rearview mirror in the visual field range of the image pickup device according to the change trend of the weight.
The center position of the view center of the streaming rearview mirror in the view range of the imaging device may be different depending on the trend of the weight change, and the following description will be made.
As an alternative embodiment, if the trend of the change in weight belongs to the first case, the second case, or the fourth case, the center position of the center of view of the streaming rearview mirror in the view range of the image capturing device may be determined as the default position. Default locations may be set according to actual business requirements and may include, but are not limited to: the method comprises the following steps of uniformly setting a factory default position when a vehicle leaves a factory, a final default historical position of a visual field center when a streaming media rearview mirror is used last time, and a user default position corresponding to user identity information.
Optionally, different default positions can be selected according to different conditions of the weight change trend.
For example, if the trend of the change in weight belongs to the third case, the center position of the center of view of the streaming rearview mirror in the view range of the image capturing device may be determined as the factory default position or the default history position.
For example, if the trend of the weight change belongs to the first or second case, the center position of the center of view of the streaming rearview mirror in the view range of the image capturing device may be determined as the user default position corresponding to the user identity information.
The user identity information can be obtained through recognition according to the weight which is greater than a second threshold value and is acquired by the gravity center sensor. The vehicle may have stored therein weight information for different occupants in advance, and when a weight greater than a second threshold is collected, the weight may be compared with the stored weight information in advance, thereby determining user identity information for the occupant currently sitting in the seat. The default positions of the users corresponding to different user identity information may be different or the same, and are not particularly limited.
As another alternative embodiment, if the trend of the change in weight belongs to the third case, the vehicle may further determine the center position of the center of view of the streaming rearview mirror in the field of view of the image pickup device according to the center of gravity position. That is, when the trend of the change in weight belongs to the third case, the vehicle may acquire the center of gravity position acquired by the center of gravity sensor, and determine the center position of the center of view from the center of gravity position. The vehicle may adopt any implementation manner of determining the center position of the center of view according to the center of gravity disclosed in the foregoing embodiment, and the following description will be omitted.
Therefore, in the above method for displaying the image of the streaming media rearview mirror, the vehicle can determine the center position of the center of view of the streaming media rearview mirror by the weight of the object collected by the gravity sensor alone, so that the visual view of the streaming media rearview mirror is correspondingly changed. In addition, the vehicle can also combine the gravity center position and the object weight that the gravity center inductor gathered to confirm the central position in the center of the field of vision for the adjustment of the visual field of streaming media rear-view mirror is more accurate.
Referring to fig. 8, fig. 8 is a schematic structural diagram of a streaming media rearview mirror image display device according to an embodiment of the disclosure. The streaming rearview mirror image display device shown in fig. 8 can be used in the aforementioned vehicle, and can be any type of processor in the vehicle. As shown in fig. 8, the streaming rearview mirror image display device 800 may include: the system comprises an acquisition module 810, a determination module 820, an interception module 830 and a display module 840.
The acquisition module 810 is used for acquiring the gravity center data of the object on the seat through the gravity center sensor arranged on the seat; the center of gravity data includes: the position of the center of gravity of the object and/or the weight of the object;
a determining module 820, configured to determine, according to the gravity center data, a center position of a center of view of the streaming media rearview mirror in a field of view range of the image capturing device;
The intercepting module 830 is configured to intercept a second image from the first image shot by the image capturing device according to the central position;
the display module 840 is configured to display the second image in the streaming rearview mirror.
In one embodiment, the center of gravity data includes: the position of the center of gravity of the object.
The determining module 820 is further configured to adjust, when the collected center of gravity position changes, a first center position of a view center of the streaming media rearview mirror according to a center of gravity variation corresponding to the center of gravity position, so as to obtain a second center position of the view center; the first center position is a center position of the field of view center in a field of view range of the image pickup device before the center of gravity position is changed;
the display module 840 may be further configured to intercept a second image from the first image according to the second center position.
In one embodiment, the determining module 820 may include: the device comprises a first computing unit, a second computing unit and an adjusting unit.
The first calculating unit is used for calculating the visual field variation corresponding to the streaming media rearview mirror according to the gravity variation when the acquired gravity center position is changed;
A second calculation unit operable to calculate a positional shift amount based on the field of view variation amount;
and the adjusting unit is used for calculating the second center point position of the visual field center according to the first center point position of the visual field center and the position offset.
In an embodiment, the first calculating unit may be further configured to normalize the gravity center variation according to the adjustment gear and an area size of the effective sensing area of the gravity center sensor, so as to obtain a field variation corresponding to the field of view of the streaming media rearview mirror.
In one embodiment, the center of gravity variation includes: a first barycentric variation component in a first direction, and a second barycentric variation component in a second direction; the field of view variation includes: a first field of view variation component in the first direction and a second field of view variation component in the second direction; the first direction is perpendicular to the second direction;
the first calculating unit is further configured to calculate a first initial variation component according to the first barycenter variation component and the adjustment gear corresponding to the first direction, and normalize the first initial variation component according to a first length of the effective sensing area of the barycenter sensor in the first direction, so as to obtain a first field of view variation component; the method comprises the steps of,
The first calculating unit is further configured to calculate a second initial variation component according to the second gravity variation component and the adjustment gear corresponding to the second direction, and normalize the second initial variation component according to a second length of the effective sensing area in the second direction, so as to obtain a second field of view variation component.
In one embodiment, the second calculating unit may be further configured to perform an enlarging process or a reducing process on the field of view variation to obtain a position offset.
In one embodiment, the field of view variation includes: a first field of view variation component in a first direction and a second field of view variation component in a second direction; the positional offset includes: a first offset component in the first direction and a second offset component in the second direction;
an adjustment unit configured to calculate the first offset component according to the first field-of-view variation component and a field-of-view scaling factor corresponding to the first direction; and calculating the second offset component from the second field of view variation component and a field of view scaling factor corresponding to the second direction.
In one embodiment, the determining module 820 may be further configured to query, according to a preset correspondence, a target position corresponding to the currently collected center of gravity position, and determine the queried target position as a center position of the view center of the streaming media rearview mirror in the view range of the image capturing device.
In one embodiment, the center of gravity data may include: a weight; the determining module 820 may further include: a first determination unit and a second determination unit.
A first determining unit operable to determine a trend of change in the weight;
and the second determining unit is used for determining the central position of the visual field center of the streaming media rearview mirror in the visual field range of the image pickup device according to the change trend.
In one embodiment, the second determining unit is further configured to determine, as a default position, a center position of the center of view of the streaming rearview mirror in the view range of the image capturing device when the trend of change in weight belongs to any one of the following trends:
the weight gradually increases from less than or equal to a first threshold to greater than or equal to a second threshold;
the weight gradually decreases from greater than or equal to the second threshold value to less than or equal to the first threshold value;
the weight is always less than or equal to the first threshold value for a monitoring period.
Optionally, the default location may include: a user default location corresponding to the user identity information; the user identity information is identified based on the weight being greater than the second threshold.
In an embodiment, the second determining unit may be further configured to determine, when the trend of change is that the weight is always greater than or equal to the second threshold value within the monitoring duration, a center position of a field of view center of the streaming media rearview mirror in a field of view range of the image capturing device according to the center of gravity position.
Therefore, in the foregoing embodiment, the streaming media rearview mirror image display device may determine, according to the collected center of gravity data, a center position of a visual field center of the CMS in a visual field range of the image capturing device, so that the second image captured according to the center position may be adaptively adjusted according to different center of gravity data, so that the image displayed by the CMS is no longer at a fixed angle, and an effect of adjusting a visual field of the CMS is achieved.
Referring to fig. 9, fig. 9 is a schematic diagram of a vehicle according to an embodiment of the disclosure. As shown in fig. 9, the vehicle 900 may include:
a memory 910 storing executable program code;
a processor 920 coupled with the memory 910;
the processor 920 invokes executable program codes stored in the memory 910 to execute any one of the streaming media rearview mirror image display methods disclosed in the embodiments of the present application.
The embodiment of the application discloses a computer readable storage medium storing a computer program, wherein the computer program when executed by a processor causes the processor to realize any one of the streaming media rearview mirror image display methods disclosed in the embodiment of the application.
Embodiments of the present application disclose a computer program product comprising a non-transitory computer readable storage medium storing a computer program, and the computer program is operable to cause a computer to perform any of the streaming rearview mirror image display methods disclosed in the embodiments of the present application.
It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. Those skilled in the art will also appreciate that the embodiments described in the specification are all alternative embodiments and that the acts and modules referred to are not necessarily required in the present application.
In various embodiments of the present application, it should be understood that the size of the sequence numbers of the above processes does not mean that the execution sequence of the processes is necessarily sequential, and the execution sequence of the processes should be determined by the functions and internal logic thereof, and should not constitute any limitation on the implementation process of the embodiments of the present application.
The units described above as separate components may or may not be physically separate, and components shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiment.
In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units described above, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer-accessible memory. Based on such understanding, the technical solution of the present application, or a part contributing to the prior art or all or part of the technical solution, may be embodied in the form of a software product stored in a memory, including several requests for a computer device (which may be a personal computer, a server or a network device, etc., in particular may be a processor in the computer device) to perform part or all of the steps of the above-mentioned method of the various embodiments of the present application.
Those of ordinary skill in the art will appreciate that all or part of the steps of the various methods of the above embodiments may be implemented by a program that instructs associated hardware, the program may be stored in a computer readable storage medium including Read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), programmable Read-Only Memory (Programmable Read-Only Memory, PROM), erasable programmable Read-Only Memory (Erasable Programmable Read Only Memory, EPROM), one-time programmable Read-Only Memory (OTPROM), electrically erasable programmable Read-Only Memory (EEPROM), compact disc Read-Only Memory (Compact Disc Read-Only Memory, CD-ROM) or other optical disk Memory, magnetic disk Memory, tape Memory, or any other medium that can be used for carrying or storing data that is readable by a computer.
The method, the device, the vehicle and the storage medium for displaying the streaming media rearview mirror image disclosed in the embodiment of the application are described in detail, and specific examples are applied to explain the principles and the implementation mode of the application, and the description of the above examples is only used for helping to understand the method and the core idea of the application. Meanwhile, as those skilled in the art will have modifications in the specific embodiments and application scope in accordance with the ideas of the present application, the present description should not be construed as limiting the present application in view of the above.

Claims (12)

1. A streaming media rearview mirror image display method is characterized by being applied to a vehicle; the vehicle comprises a streaming media rearview mirror, a seat and a camera device; the method comprises the following steps:
the gravity center sensor arranged on the seat is used for collecting gravity center data of an object on the seat; the center of gravity data includes: the position of the center of gravity of the object and/or the weight of the object;
determining the central position of the visual field center of the streaming media rearview mirror in the visual field range of the image pickup device according to the gravity center data, wherein the central position of the visual field center of the streaming media rearview mirror in the visual field range of the image pickup device is the position of the central point of the image displayed in the streaming media rearview mirror in the visual field range;
intercepting a second image from the first image shot by the shooting device according to the central position, and displaying the second image in the streaming media rearview mirror;
wherein the center of gravity data includes: the position of the center of gravity of the object; the determining, according to the gravity center data, a center position of a center of view of the streaming media rearview mirror in a field of view range of the image capturing device includes:
If the acquired gravity center position is changed, according to the gravity center variation corresponding to the gravity center position, adjusting a first center position of the visual field center of the streaming media rearview mirror to obtain a second center position of the visual field center; the first center position is a center position of the field of view center in a field of view range of the image pickup device before the center of gravity position is changed;
and said capturing a second image from said first image based on said center location, comprising:
intercepting a second image from the first image according to the second center position;
and/or the number of the groups of groups,
the center of gravity data includes: the position of the center of gravity of the object; the determining, according to the gravity center data, a center position of a center of view of the streaming media rearview mirror in a field of view range of the image capturing device includes:
inquiring a target position corresponding to the currently acquired gravity center position according to a preset corresponding relation, and determining the inquired target position as the central position of the visual field center of the streaming media rearview mirror in the visual field range of the camera;
and/or the number of the groups of groups,
the center of gravity data includes: the weight of the object; and determining a center position of a field of view center of the streaming media rearview mirror in a field of view range of the image pickup device according to the gravity center data, wherein the method comprises the following steps:
Determining a trend of the weight;
and determining the central position of the visual field center of the streaming media rearview mirror in the visual field range of the image pickup device according to the change trend.
2. The method according to claim 1, wherein the adjusting the first center position of the view center of the streaming media rearview mirror according to the gravity center variation corresponding to the gravity center position to obtain the second center position of the view center includes:
calculating the visual field variation corresponding to the streaming media rearview mirror according to the gravity center variation;
calculating a position offset according to the field of view variation;
and calculating a second center point position of the visual field center according to the first center point position of the visual field center and the position offset.
3. The method according to claim 2, wherein the calculating the view variation corresponding to the view of the streaming rearview mirror according to the gravity center variation includes:
and carrying out normalization calculation on the gravity center variation according to the adjustment gear and the area size of the effective sensing area of the gravity center sensor to obtain the visual field variation corresponding to the visual field of the streaming media rearview mirror.
4. A method according to claim 3, wherein the center of gravity variation comprises: a first barycentric variation component in a first direction, and a second barycentric variation component in a second direction; the field of view variation includes: a first field of view variation component in the first direction and a second field of view variation component in the second direction; the first direction is perpendicular to the second direction;
and normalizing the gravity center variation according to the adjustment gear and the area size of the effective sensing area of the gravity center sensor to obtain a field variation corresponding to the field of view of the streaming media rearview mirror, including:
calculating a first initial change component according to the first gravity center change component and the adjusting gear corresponding to the first direction, and normalizing the first initial change component according to the first length of the effective induction area of the gravity center inductor in the first direction to obtain a first visual field change component;
calculating a second initial change component according to the second gravity change component and the adjusting gear corresponding to the second direction, and normalizing the second initial change component according to the second length of the effective induction area in the second direction to obtain a second visual field change component.
5. The method according to claim 2, wherein the calculating a positional offset from the field of view variation amount includes:
and performing amplification processing or reduction processing on the visual field variation to obtain a position offset.
6. The method of claim 5, wherein the field of view variation comprises: a first field of view variation component in a first direction and a second field of view variation component in a second direction; the positional offset includes: a first offset component in the first direction and a second offset component in the second direction; the first direction is perpendicular to the second direction;
and performing an enlarging process or a reducing process on the field of view variation to obtain a position offset, including:
calculating the first offset component according to the first view variation component and a view scaling factor corresponding to the first direction;
and calculating the second offset component according to the second visual field variation component and the visual field scaling factor corresponding to the second direction.
7. The method according to claim 1, wherein the determining a center position of a center of view of the streaming rearview mirror in a field of view of the image pickup device according to the change trend includes:
If the trend of change belongs to any one of the following trends, determining a center position of the center of view of the streaming rearview mirror in the view range of the image capturing device as a default position:
the weight gradually increases from less than or equal to a first threshold to greater than or equal to a second threshold;
the weight gradually decreases from greater than or equal to the second threshold value to less than or equal to the first threshold value;
the weight is always less than or equal to the first threshold value for a monitoring period.
8. The method of claim 7, wherein the default position comprises: a user default location corresponding to the user identity information; the user identity information is identified based on the weight being greater than the second threshold.
9. The method of claim 1, wherein the center of gravity data further comprises: a center of gravity position; and determining a center position of a field of view center of the streaming media rearview mirror in a field of view range of the image capturing device according to the change trend, including:
and if the change trend is that the weight is always greater than or equal to a second threshold value in the monitoring time period, determining the central position of the visual field center of the streaming media rearview mirror in the visual field range of the image pickup device according to the gravity center position.
10. A streaming media rearview mirror image display device is characterized by being applied to a vehicle; the vehicle comprises a streaming media rearview mirror, a seat and a camera device; the device comprises:
the acquisition module is used for acquiring the gravity center data of the object on the seat through the gravity center sensor arranged on the seat; the center of gravity data includes: the position of the center of gravity of the object and/or the weight of the object;
a determining module, configured to determine, according to the gravity center data, a center position of a view center of the streaming media rearview mirror in a view range of the image capturing device, where the center position of the view center of the streaming media rearview mirror in the view range of the image capturing device is a position of a center point of an image displayed in the streaming media rearview mirror in the view range;
the intercepting module is used for intercepting a second image from the first image shot by the shooting device according to the central position;
the display module is used for displaying the second image in the streaming media rearview mirror;
wherein the center of gravity data includes: the position of the center of gravity of the object;
the determining module is further configured to adjust a first center position of a view center of the streaming media rearview mirror according to a gravity center variation corresponding to the gravity center position when the acquired gravity center position is changed, so as to obtain a second center position of the view center; the first center position is a center position of the field of view center in a field of view range of the image pickup device before the center of gravity position is changed;
The display module is further used for intercepting a second image from the first image according to the second center position;
and/or the number of the groups of groups,
the center of gravity data includes: the position of the center of gravity of the object;
the determining module is further configured to query a target position corresponding to the currently acquired center of gravity according to a preset corresponding relationship, and determine the queried target position as a center position of a view center of the streaming media rearview mirror in a view range of the camera;
and/or the number of the groups of groups,
the center of gravity data includes: the weight of the object, the determining module comprises a first determining unit and a second determining unit;
the first determining unit is used for determining the change trend of the weight;
the second determining unit is configured to determine, according to the change trend, a center position of a field center of the streaming media rearview mirror in a field range of the image capturing device.
11. A vehicle comprising a memory and a processor, the memory having stored therein a computer program which, when executed by the processor, causes the processor to implement the method of any of claims 1 to 9.
12. A computer readable storage medium, on which a computer program is stored, which computer program, when being executed by a processor, implements the method according to any one of claims 1 to 9.
CN202210239327.9A 2022-03-11 2022-03-11 Streaming media rearview mirror image display method and device, vehicle and storage medium Active CN114559879B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210239327.9A CN114559879B (en) 2022-03-11 2022-03-11 Streaming media rearview mirror image display method and device, vehicle and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210239327.9A CN114559879B (en) 2022-03-11 2022-03-11 Streaming media rearview mirror image display method and device, vehicle and storage medium

Publications (2)

Publication Number Publication Date
CN114559879A CN114559879A (en) 2022-05-31
CN114559879B true CN114559879B (en) 2023-12-29

Family

ID=81717821

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210239327.9A Active CN114559879B (en) 2022-03-11 2022-03-11 Streaming media rearview mirror image display method and device, vehicle and storage medium

Country Status (1)

Country Link
CN (1) CN114559879B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013216286A (en) * 2012-04-12 2013-10-24 Suzuki Motor Corp Monitoring device for confirming vehicle surroundings
JP2014045265A (en) * 2012-08-24 2014-03-13 Kyocera Corp On-vehicle imaging system
CN107303848A (en) * 2016-04-25 2017-10-31 本田技研工业株式会社 Image display device
US10116873B1 (en) * 2015-11-09 2018-10-30 Ambarella, Inc. System and method to adjust the field of view displayed on an electronic mirror using real-time, physical cues from the driver in a vehicle
JP2019217970A (en) * 2018-06-21 2019-12-26 日本電産コパル株式会社 Electronic mirror device and image display method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102183133B1 (en) * 2019-05-21 2020-11-25 엘지전자 주식회사 How to control an autonomous vehicle

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013216286A (en) * 2012-04-12 2013-10-24 Suzuki Motor Corp Monitoring device for confirming vehicle surroundings
JP2014045265A (en) * 2012-08-24 2014-03-13 Kyocera Corp On-vehicle imaging system
US10116873B1 (en) * 2015-11-09 2018-10-30 Ambarella, Inc. System and method to adjust the field of view displayed on an electronic mirror using real-time, physical cues from the driver in a vehicle
CN107303848A (en) * 2016-04-25 2017-10-31 本田技研工业株式会社 Image display device
JP2019217970A (en) * 2018-06-21 2019-12-26 日本電産コパル株式会社 Electronic mirror device and image display method

Also Published As

Publication number Publication date
CN114559879A (en) 2022-05-31

Similar Documents

Publication Publication Date Title
US11854276B2 (en) Vehicle driver monitoring system for determining driver workload
JP6245398B2 (en) State estimation device, state estimation method, and state estimation program
US7835834B2 (en) Method of mitigating driver distraction
JP4355341B2 (en) Visual tracking using depth data
US7613357B2 (en) Method for warped image object recognition
US11856330B2 (en) Vehicular driver monitoring system
WO2013094588A1 (en) Image processing device, image processing method, program for image processing device, storage medium, and image display device
US20190100156A1 (en) System and method for controlling a display
JP7369184B2 (en) Driver attention state estimation
US11034305B2 (en) Image processing device, image display system, and image processing method
CN109153353B (en) Vehicle display with selective image data display
EP2060993B1 (en) An awareness detection system and method
CN112714720B (en) Rearview mirror control method and related equipment
CN114007054B (en) Method and device for correcting projection of vehicle-mounted screen picture
EP1703462A1 (en) System or method for enhancing an image
WO2017101292A1 (en) Autofocusing method, device and system
CN114559879B (en) Streaming media rearview mirror image display method and device, vehicle and storage medium
WO2017209225A1 (en) State estimation apparatus, state estimation method, and state estimation program
CN109334517A (en) A kind of method and apparatus of automotive seat position
CN109426797A (en) Doze detection device and doze detection method thereof
KR101434072B1 (en) Stabilisation method and computer system
WO2022113275A1 (en) Sleep detection device and sleep detection system
CN114475434B (en) Control and adjustment method for reversing outside rearview mirror, system and storage medium thereof
CN113298041A (en) Method and system for calibrating driver distraction reference direction
CN115471395A (en) Image adjusting method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20231130

Address after: Room 708, Room 406, No.1 Yichuang Street, Huangpu District (Zhongxin Guangzhou Knowledge City), Guangzhou City, Guangdong Province, 510000

Applicant after: Zhaoqing Xiaopeng New Energy Investment Co.,Ltd. Guangzhou Branch

Address before: 510000 No.8 Songgang street, Cencun, Tianhe District, Guangzhou City, Guangdong Province

Applicant before: GUANGZHOU XIAOPENG MOTORS TECHNOLOGY Co.,Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant