WO2022142331A1 - 车载显示屏的控制方法及装置、电子设备和存储介质 - Google Patents
车载显示屏的控制方法及装置、电子设备和存储介质 Download PDFInfo
- Publication number
- WO2022142331A1 WO2022142331A1 PCT/CN2021/109821 CN2021109821W WO2022142331A1 WO 2022142331 A1 WO2022142331 A1 WO 2022142331A1 CN 2021109821 W CN2021109821 W CN 2021109821W WO 2022142331 A1 WO2022142331 A1 WO 2022142331A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- occupant
- target part
- angle range
- preset
- display screen
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 74
- 230000004044 response Effects 0.000 claims abstract description 66
- 238000004590 computer program Methods 0.000 claims description 20
- 238000001514 detection method Methods 0.000 claims description 12
- 210000003128 head Anatomy 0.000 abstract description 5
- 238000012545 processing Methods 0.000 description 25
- 238000010586 diagram Methods 0.000 description 18
- 230000006870 function Effects 0.000 description 15
- 238000005516 engineering process Methods 0.000 description 13
- 238000004891 communication Methods 0.000 description 10
- 230000003993 interaction Effects 0.000 description 7
- 238000010295 mobile communication Methods 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 238000013528 artificial neural network Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 238000012544 monitoring process Methods 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 230000001902 propagating effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 229910052802 copper Inorganic materials 0.000 description 1
- 239000010949 copper Substances 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000002996 emotional effect Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
Definitions
- the present disclosure relates to the technical field of vehicles, and in particular, to a control method and device for a vehicle-mounted display screen, an electronic device, and a storage medium.
- Human-computer interaction is a core technology in the development of the automotive industry.
- the human-machine interaction of the vehicle can bring convenience to the driver and make the cabin more intelligent.
- most of the human-computer interaction programs of vehicles are installed in the center console area, and the driver wakes up the screen to interact with it by touching the screen. To a certain extent, this kind of interaction causes the driver's attention to be distracted by the action of clicking on the screen, which may easily cause safety hazards.
- the present disclosure provides a technical solution for controlling a vehicle-mounted display screen.
- a method for controlling a vehicle-mounted display screen including:
- the target part is a head, a face or an eye
- the vehicle-mounted display screen In response to determining that the target part is turned to the vehicle-mounted display screen in the vehicle cabin according to the rotation angle of the target part, the vehicle-mounted display screen is controlled to light up.
- controlling the on-board display screen to light up in response to determining that the target part is turned to the on-board display screen in the vehicle cabin according to the rotation angle of the target part includes:
- the rotation angle of the target part includes the heading angle of the target part and/or the pitch angle of the target part;
- the preset angle range includes a preset heading angle range and/or a preset pitch angle range
- the controlling the on-board display to light up in response to determining that the rotation angle of the target part belongs to a preset angle range according to the rotation angle of the target part includes: in response to determining the target part according to the rotation angle of the target part; The heading angle of the target part belongs to the preset heading angle range and/or the pitch angle of the target part belongs to the preset pitch angle range, and the onboard display screen is controlled to light up.
- the preset angle range includes a preset angle range corresponding to the occupant
- the controlling the on-board display to light up in response to determining that the rotation angle of the target part belongs to a preset angle range according to the rotation angle of the target part includes: in response to determining the target part according to the rotation angle of the target part; The rotation angle of the target part belongs to the preset angle range corresponding to the occupant, and the vehicle display screen is controlled to light up.
- the method before the on-board display screen is controlled to light up in response to determining that the rotation angle of the target part belongs to a preset angle range corresponding to the occupant according to the rotation angle of the target part , the method also includes:
- a preset angle range corresponding to the occupant is determined.
- the position information of the occupant includes position information of the target part of the occupant
- the determining the preset angle range corresponding to the occupant according to the position information of the occupant includes: determining the preset angle range corresponding to the occupant according to the position information of the target part of the occupant.
- the preset angle range corresponding to the occupant includes a preset heading angle range corresponding to the occupant and/or a preset pitch angle range corresponding to the occupant;
- the determining the preset angle range corresponding to the occupant according to the position information of the target part of the occupant includes:
- a preset pitch angle range corresponding to the occupant is determined.
- the method before the determining the preset angle range corresponding to the occupant according to the position information of the target part of the occupant, the method further includes:
- position information of the target part of the occupant is specified.
- the position information of the occupant includes position information of the seat of the occupant;
- the determining the preset angle range corresponding to the occupant according to the position information of the occupant includes: determining the preset angle range corresponding to the occupant according to the position information of the seat of the occupant.
- the preset angle range corresponding to the occupant includes a preset heading angle range corresponding to the occupant and/or a preset pitch angle range corresponding to the occupant;
- the determining the preset angle range corresponding to the occupant according to the position information of the occupant's seat includes:
- a preset pitch angle range corresponding to the occupant is determined.
- the determining a preset angle range corresponding to the occupant according to the position information of the occupant includes:
- the preset angle range corresponding to the occupant is determined according to the position information of the occupant and the correspondence between the position information and the preset angle range.
- the determining a preset angle range corresponding to the occupant according to the position information of the occupant includes:
- the position information of the occupant is input into a pre-trained model, and a preset angle range corresponding to the occupant is output via the pre-trained model.
- the method further includes:
- the preset angle range corresponding to the occupant is re-determined according to the position information of the occupant after the seat is adjusted.
- the method further includes:
- a preset angle range corresponding to the detected occupant is determined according to the detected position information of the occupant.
- controlling the on-board display screen to light up in response to determining that the target part is turned to the on-board display screen in the vehicle cabin according to the rotation angle of the target part includes:
- the occupant includes a driver.
- a control device for a vehicle-mounted display screen comprising:
- a first acquisition module used for acquiring image information of the occupants in the cabin
- a detection module configured to detect a rotation angle of a target part of the occupant based on the image information, wherein the target part is a head, a face or an eye;
- the control module is configured to control the on-board display screen to light up in response to determining that the target part turns to the on-board display screen in the vehicle cabin according to the rotation angle of the target part.
- control module is used to:
- the rotation angle of the target part includes the heading angle of the target part and/or the pitch angle of the target part;
- the preset angle range includes a preset heading angle range and/or a preset pitch angle range
- the control module is configured to: in response to determining according to the rotation angle of the target part that the heading angle of the target part belongs to the preset heading angle range and/or the pitch angle of the target part belongs to the preset pitch angle range, control the vehicle display screen to light up.
- the preset angle range includes a preset angle range corresponding to the occupant
- the control module is configured to: in response to determining that the rotation angle of the target part belongs to a preset angle range corresponding to the occupant according to the rotation angle of the target part, control the vehicle display screen to light up.
- the apparatus further includes:
- the first determination module is configured to determine the preset angle range corresponding to the occupant according to the position information of the occupant.
- the position information of the occupant includes position information of the target part of the occupant
- the first determining module is configured to: determine a preset angle range corresponding to the occupant according to the position information of the target part of the occupant.
- the preset angle range corresponding to the occupant includes a preset heading angle range corresponding to the occupant and/or a preset pitch angle range corresponding to the occupant;
- the first determining module is used for:
- a preset pitch angle range corresponding to the occupant is determined.
- the apparatus further includes:
- the second determining module is configured to determine the position information of the target part of the occupant according to the image information.
- the position information of the occupant includes position information of the seat of the occupant;
- the first determining module is configured to: determine a preset angle range corresponding to the occupant according to the position information of the occupant's seat.
- the preset angle range corresponding to the occupant includes a preset heading angle range corresponding to the occupant and/or a preset pitch angle range corresponding to the occupant;
- the first determining module is used for:
- a preset pitch angle range corresponding to the occupant is determined.
- the first determining module is used for:
- the preset angle range corresponding to the occupant is determined according to the position information of the occupant and the correspondence between the position information and the preset angle range.
- the first determining module is used for:
- the position information of the occupant is input into a pre-trained model, and a preset angle range corresponding to the occupant is output via the pre-trained model.
- the apparatus further includes:
- the third determining module is configured to, in response to detecting the adjustment information of the occupant's seat, re-determine the preset angle range corresponding to the occupant according to the position information of the occupant after the seat is adjusted.
- the apparatus further includes:
- a second acquiring module configured to acquire position information of the detected occupant in response to detecting the occupant in the vehicle cabin
- the fourth determination module is configured to determine a preset angle range corresponding to the detected occupant according to the detected position information of the occupant.
- control module is used to:
- the vehicle display screen In response to determining that the target part faces the vehicle display screen after the rotation according to the orientation of the target part before the rotation and the rotation angle of the target part, the vehicle display screen is controlled to light up, wherein the target part
- the rotation angle of is the reference direction of the orientation of the target part before rotation.
- the occupant includes a driver.
- an electronic device comprising: one or more processors; a memory for storing executable instructions; wherein the one or more processors are configured to invoke the memory storage executable instructions to perform the above method.
- a computer-readable storage medium having computer program instructions stored thereon, the computer program instructions implementing the above method when executed by a processor.
- a computer program comprising computer-readable code, which when the computer-readable code is executed in an electronic device, is executed by a processor in the electronic device for implementing the above method.
- the image information of the occupant in the vehicle cabin is acquired, the rotation angle of the target part of the occupant is detected based on the image information, and the target part is determined in response to the rotation angle of the target part
- the on-board display screen in the cabin and controlling the on-board display screen to light up, the on-board display screen can be lit and controlled by the rotation of the target part of the occupant, without the need for the occupant to wake up the on-board display screen by manual touch , which can improve the convenience of vehicle display control and help improve driving safety.
- FIG. 1 shows a flowchart of a method for controlling a vehicle-mounted display screen provided by an embodiment of the present disclosure.
- FIG. 2 shows a schematic diagram of different preset heading angle ranges corresponding to different horizontal distances between the seat and the vehicle display screen in an embodiment of the present disclosure.
- FIG. 3 shows a block diagram of a control device of a vehicle-mounted display screen provided by an embodiment of the present disclosure.
- FIG. 4 shows a block diagram of an electronic device 800 provided by an embodiment of the present disclosure.
- FIG. 5 shows a block diagram of an electronic device 1900 provided by an embodiment of the present disclosure.
- the image information of the occupant in the vehicle cabin is acquired, the rotation angle of the target part of the occupant is detected based on the image information, and the target part is determined in response to the rotation angle of the target part
- the on-board display screen can be illuminated and controlled by the rotation of the target part of the occupant, without the need for the occupant to wake up the on-board display screen by manual touch , which can improve the convenience of vehicle display control and help improve driving safety.
- FIG. 1 shows a flowchart of a method for controlling a vehicle-mounted display screen provided by an embodiment of the present disclosure.
- the control method of the vehicle display screen may be executed by a terminal device or a server or other processing device.
- the terminal device may be a vehicle-mounted device, a user equipment (User Equipment, UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (Personal Digital Assistant, PDA), a handheld device, a computing device or a wearable devices, etc.
- UE user equipment
- PDA Personal Digital Assistant
- the in-vehicle device may be an in-vehicle machine, a domain controller or a processor, or may be a DMS (Driver Monitor System, driver monitoring system) or an OMS (Occupant Monitoring System, occupant monitoring system) used to execute images Device host, etc. for data processing operations.
- the method for controlling the vehicle-mounted display screen may be implemented by the processor calling computer-readable instructions stored in the memory. As shown in FIG. 1 , the control method of the vehicle-mounted display screen includes steps S11 to S13.
- step S11 video information of the occupant in the cabin is acquired.
- step S12 a rotation angle of a target part of the occupant is detected based on the image information, wherein the target part is a head, a face or an eye.
- step S13 in response to determining that the target part is turned to the vehicle-mounted display screen in the vehicle cabin according to the rotation angle of the target part, the vehicle-mounted display screen is controlled to light up.
- the vehicle may be a vehicle, or may be a vehicle for carrying people or goods, such as a ship or an airplane.
- the vehicle can be a private car or a commercial vehicle.
- the commercial vehicle can be a shared car, an online car-hailing car, a taxi, a bus, a school bus, a long-distance truck, a short-distance truck, a long-distance bus, a short-distance bus, a train, a subway, a railroad Tram etc.
- the image information of the occupants in the vehicle cabin may be collected through a camera disposed in the vehicle cabin.
- the image information may be a video stream, or may be an image or an image sequence, etc., which is not limited herein.
- the cameras provided in the cabin may include DMS cameras, OMS cameras, and the like.
- the image information of the driver may be collected by the DMS camera, and the image information of the occupants other than the driver may be collected by the OMS camera.
- DMS can also perform other driver detection functions, such as fatigue detection, attention detection, etc.
- the OMS may also perform other occupant detection functions, such as detection of occupant attributes (eg, at least one of age, gender, emotional state, physical state, etc.), occupant speech motion detection, and the like.
- the cameras arranged in the cabin may also include ordinary cameras that do not have other detection functions.
- the image information of the occupants in the vehicle cabin can also be collected through a common camera.
- the image information of the occupant in the cabin can be collected in real time through the camera disposed in the cabin, so that the rotation of the target part of the occupant can be detected in time based on the image information collected in real time.
- the number of on-board display screens in the vehicle cabin may be one or more than two.
- the control method for the on-board display screens provided by the embodiments of the present disclosure may be respectively executed for each on-board display screen in the vehicle cabin.
- the method for controlling the on-board display screen may also be executed only for some on-board display screens in the vehicle cabin, which is not limited herein.
- the vehicle-mounted display screen may be any display screen provided in the vehicle cabin.
- the in-vehicle display screen may be a center console screen, an instrument panel, an A-pillar display screen, a rear display screen for passengers, and the like.
- the target part represents the part on the occupant where the rotation angle detection is performed.
- the rotation angle of the target part of the occupant may be detected based on one or more images in the image information of the occupant in the vehicle cabin.
- a neural network for detecting the rotation angle of the target part may be pre-trained. After the neural network is trained, at least one image in the image information is input into the neural network, and the neural network is used to obtain the The rotation angle of the target part of the occupant.
- a function for determining the rotation angle of the target part may be designed in advance, and the rotation angle of the target part corresponding to the image information can be obtained through the predesigned function.
- the orientation of the target part can be determined according to the rotation angle of the target part.
- the target part can be determined. Turn to the onboard display.
- the vehicle display screen can be controlled to light up.
- it can be determined that the target part is turned to the vehicle-mounted display screen. In this implementation manner, regardless of whether the orientation of the target part changes, in response to the current orientation of the target part being toward the vehicle-mounted display screen, the vehicle-mounted display screen is controlled to light up.
- the vehicle-mounted display screen can be woken up by controlling the vehicle-mounted display screen to light up, so that the vehicle-mounted display screen can be switched from the off state to the on-board state ; If the vehicle-mounted display screen is in the lit state, by controlling the vehicle-mounted display screen to be lit, the vehicle-mounted display screen can be controlled to remain in the lit state or to increase the brightness. In a possible implementation manner, when the on-board display screen is in a lit state, the brightness of the on-board display screen may be automatically adjusted according to ambient light brightness.
- the occupant may include any person in the vehicle cabin.
- the occupant includes a driver.
- image information of the driver in the vehicle cabin eg, image information of the driving area
- the rotation angle of the target part of the driver is detected based on the image information of the driver, and the rotation angle of the target part of the driver is detected according to the The rotation angle of the target part determines that the target part turns to the on-board display screen in the cabin, and controls the on-board display screen to light up, so that the rotation of the driver's target part can be used to click the on-board display screen.
- the occupants may also include non-drivers.
- the controlling the on-board display screen to light up in response to determining that the target part is turned to the vehicle-mounted display screen in the vehicle cabin according to the rotation angle of the target part includes: responding to According to the rotation angle of the target part, it is determined that the rotation angle of the target part belongs to a preset angle range, and the vehicle display screen is controlled to light up, wherein the rotation angle of the target part takes the direction toward the front of the vehicle as a reference direction.
- the rotation angle of the target part can be 0.
- the on-board display screen is controlled to light up, thereby enabling precise control of the on-board display screen.
- the rotation angle of the target part includes a yaw angle of the target part and/or a pitch angle (pitch) of the target part
- the preset angle range includes a preset heading an angular range and/or a preset pitch angle range
- the controlling the on-board display screen to light up in response to determining that the rotation angle of the target part belongs to the preset angle range according to the rotation angle of the target part includes: responding to According to the rotation angle of the target part, it is determined that the heading angle of the target part belongs to the preset heading angle range and/or the pitch angle of the target part belongs to the preset pitch angle range; Bright.
- the rotation angle of the target part includes a heading angle of the target part and a pitch angle of the target part;
- the preset angle range includes a preset heading angle range and a preset pitch angle range;
- controlling the vehicle display screen to light up includes: in response to determining the target part according to the rotation angle of the target part The heading angle of the target part belongs to the preset heading angle range and the pitch angle of the target part belongs to the preset pitch angle range, and the on-board display screen is controlled to light up.
- the preset heading angle range is [ ⁇ 1 , ⁇ 2 ], and the preset pitch angle range is [ ⁇ 1 , ⁇ 2 ], where ⁇ 1 ⁇ 2 , ⁇ 1 ⁇ 2 .
- the heading angle of the target part is ⁇ u
- the pitch angle of the target part is ⁇ u . If ⁇ 1 ⁇ u ⁇ 2 and ⁇ 1 ⁇ u ⁇ 2 , the vehicle display screen can be controlled to light up; if any one of the following is satisfied, the vehicle display screen may not be controlled to light up: ⁇ u ⁇ 1 , ⁇ u > ⁇ 2 , ⁇ u ⁇ 1 , ⁇ u > ⁇ 2 . For example, if the occupant includes the driver, when the driver's target part turns to the right rear-view mirror, ⁇ u > ⁇ 2 , and the vehicle display screen is not controlled to light up at this time.
- the rotation angle of the target part includes a heading angle of the target part; the preset angle range includes a preset heading angle range; the response is determined according to the rotation angle of the target part.
- the rotation angle of the target part belongs to the preset angle range, and controlling the on-board display screen to light up includes: in response to determining that the heading angle of the target part belongs to the preset heading angle range according to the rotation angle of the target part, controlling The on-board display lights up.
- the preset heading angle range is [ ⁇ 1 , ⁇ 2 ]
- the heading angle of the target part is ⁇ u . If ⁇ 1 ⁇ u ⁇ 2 , the vehicle display screen may be controlled to light up; if ⁇ u ⁇ 1 or ⁇ u > ⁇ 2 , the vehicle display screen may not be controlled to light up.
- the rotation angle of the target part includes a pitch angle of the target part; the preset angle range includes a preset pitch angle range; the response is determined according to the rotation angle of the target part.
- the rotation angle of the target part belongs to the preset angle range, and controlling the on-board display screen to light up includes: in response to determining that the pitch angle of the target part belongs to the preset pitch angle range according to the rotation angle of the target part, controlling The on-board display lights up.
- the preset pitch angle range is [ ⁇ 1 , ⁇ 2 ]
- the pitch angle of the target part is ⁇ u . If ⁇ 1 ⁇ u ⁇ 2 , the vehicle display screen can be controlled to light up; if ⁇ u ⁇ 1 or ⁇ u > ⁇ 2 , the vehicle display screen may not be controlled to light up.
- the preset angle range includes a preset angle range corresponding to the occupant; the response to determining the rotation angle of the target part according to the rotation angle of the target part belongs to the preset angle range , controlling the on-board display screen to light up includes: in response to determining that the rotation angle of the target part belongs to a preset angle range corresponding to the occupant according to the rotation angle of the target part, controlling the on-board display screen to light up.
- the lighting control of the vehicle display screen may be performed based on the preset angle range corresponding to the occupant and the rotation of the target part of the occupant.
- different occupants may correspond to different preset angle ranges, thereby enabling precise control of the vehicle display screen for different occupants.
- the method before the on-board display screen is controlled to light up in response to determining that the rotation angle of the target part belongs to a preset angle range corresponding to the occupant according to the rotation angle of the target part, the method It also includes: determining a preset angle range corresponding to the occupant according to the position information of the occupant.
- the position information of the occupant may be information that can indicate the position of at least one part of the occupant.
- the at least one part may include the target part, and may also include other parts other than the target part, which is not limited herein.
- the preset angle range corresponding to the occupant is determined according to the position information of the occupant, and the vehicle display screen is controlled for the occupant based on the preset angle range corresponding to the occupant determined thereby, which can improve the vehicle display.
- the accuracy of the screen control is determined according to the position information of the occupant, and the vehicle display screen is controlled for the occupant based on the preset angle range corresponding to the occupant determined thereby, which can improve the vehicle display.
- the position information of the occupant includes the position information of the target part of the occupant; the determining the preset angle range corresponding to the occupant according to the position information of the occupant includes: according to the position information of the occupant
- the position information of the target part determines the preset angle range corresponding to the occupant.
- the position information of the target part of the occupant can be the coordinates of the target part in the world coordinate system, the coordinates of the target part in the image coordinate system, the target part relative to the first reference at least one of the relative position of the position and the like.
- the image coordinate system represents an image coordinate system corresponding to the image information.
- the first reference position may be a fixed position in the cabin, such as a roof, a steering wheel, or the like.
- a preset angle range corresponding to the occupant is determined according to the position information of the target part of the occupant, and whether the target part is turned is determined based on the preset angle range corresponding to the occupant determined thereby
- the vehicle-mounted display screen can further control the vehicle-mounted display screen, which can further improve the control accuracy of the vehicle-mounted display screen and improve the interaction experience of the occupant with the vehicle-mounted display screen.
- the preset angle range corresponding to the occupant includes a preset heading angle range corresponding to the occupant and/or a preset pitch angle range corresponding to the occupant; the determining according to the position information of the target part of the occupant
- the preset angle range corresponding to the occupant includes: determining the preset heading angle range corresponding to the occupant according to the horizontal distance between the target part of the occupant and the onboard display screen; and/or, according to the The height of the target part of the occupant determines the preset pitch angle range corresponding to the occupant.
- the horizontal distance between the target part of the occupant and the in-vehicle display screen may represent the horizontal distance between the target part of the occupant and the in-vehicle display screen.
- the height of the target part of the occupant can be the distance between the target part of the occupant and the top of the cabin, the coordinates of the target part of the occupant in the world coordinate system (eg z coordinate), the target part of the occupant It is represented by at least one of the coordinates in the image coordinate system, etc., which is not limited here.
- an occupant with a smaller horizontal distance between the target part and the on-board display can correspond to a larger preset heading angle range; a occupant with a larger horizontal distance between the target part and the on-board display can correspond to a larger range of heading angles. Small preset heading angle range.
- an occupant with a higher target position may correspond to a larger preset pitch angle range
- an occupant with a lower target position may correspond to a smaller preset pitch angle range.
- the preset heading angle range corresponding to the occupant is determined according to the horizontal distance between the target part of the occupant and the onboard display screen, and/or according to the height of the target part of the occupant , determine the preset pitch angle range corresponding to the occupant, so that the preset angle range corresponding to the occupant can be adaptively determined for the occupants with different heights or different seat adjustment position habits, so that the central control screen can be performed more accurately. Automatic lighting control.
- the rotation angle of the target part includes the heading angle of the target part and the pitch angle of the target part;
- the preset angle range corresponding to the occupant includes the preset heading angle range corresponding to the occupant and the occupant
- the determining the preset angle range corresponding to the occupant according to the position information of the target part of the occupant includes: according to the difference between the target part of the occupant and the vehicle display screen The horizontal distance is used to determine the preset heading angle range corresponding to the occupant; and the preset pitch angle range corresponding to the occupant is determined according to the height of the target part of the occupant.
- the rotation angle of the target part includes the heading angle of the target part;
- the preset angle range corresponding to the occupant includes the preset heading angle range corresponding to the occupant;
- determining the preset angle range corresponding to the occupant includes: determining the preset heading angle range corresponding to the occupant according to the horizontal distance between the target part of the occupant and the vehicle-mounted display screen.
- the rotation angle of the target part includes the pitch angle of the target part;
- the preset angle range corresponding to the occupant includes the preset pitch angle range corresponding to the occupant;
- determining the preset angle range corresponding to the occupant includes: determining the preset pitch angle range corresponding to the occupant according to the height of the target part of the occupant.
- the preset heading angle range corresponding to the occupant may also be determined according to the horizontal distance between the target part of the occupant and the steering wheel or the instrument panel, which is not limited herein.
- the method before determining the preset angle range corresponding to the occupant according to the position information of the target part of the occupant, the method further includes: determining the position information of the target part of the occupant according to the image information .
- the position information of the target part of the occupant can be accurately determined based on the computer vision technology.
- the method before determining the preset angle range corresponding to the occupant according to the position information of the target part of the occupant, the method further includes: determining the position information of the target part of the occupant by using a distance sensor.
- the position information of the occupant includes position information of the seat of the occupant; the determining, according to the position information of the occupant, a preset angle range corresponding to the occupant includes: according to the occupant's position information The position information of the seat is determined, and the preset angle range corresponding to the occupant is determined.
- the position information of the occupant's seat may be acquired from a body controller (Body Control Module, BCM), or the position information of the occupant's seat may be determined according to the image information.
- BCM Body Control Module
- the position information of the occupant's seat can be the relative position of the occupant's seat relative to the second reference position, the coordinates of the occupant's seat in the world coordinate system, the occupant's seat
- the seat is represented by at least one of the coordinates in the image coordinate system, etc.
- the second reference position may be a fixed position in the cabin, such as a steering wheel, an instrument panel, and the ground of the cabin.
- the image coordinate system represents an image coordinate system corresponding to the image information.
- the preset angle range corresponding to the occupant can be determined by using the seat habits corresponding to different occupants. Based on the thus determined preset angle range corresponding to the occupant, it is determined whether the target part turns to the vehicle display screen to further control the vehicle display screen, which can further improve the control accuracy of the vehicle display screen.
- the preset angle range corresponding to the occupant includes a preset heading angle range corresponding to the occupant and/or a preset pitch angle range corresponding to the occupant; the determining according to the position information of the occupant's seat The preset angle range corresponding to the occupant includes: determining the preset heading angle range corresponding to the occupant according to the horizontal distance between the occupant's seat and the vehicle display screen; and/or, according to the The height of the occupant's seat determines the preset pitch angle range corresponding to the occupant.
- the horizontal distance between the occupant's seat and the in-vehicle display screen may represent the horizontal distance between the occupant's seat and the in-vehicle display screen.
- the height of the occupant's seat may be the distance between the occupant's seat and the bottom of the cabin, the distance between the occupant's seat and the top of the cabin, and the position of the occupant's seat in the world coordinate system. It is represented by at least one of the coordinates (eg, z-coordinates) in , the coordinates of the occupant's seat in the image coordinate system, and the like, which is not limited here.
- an occupant with a relatively forward seat position may correspond to a larger preset heading angle range
- an occupant with a relatively rear seat position may correspond to a smaller preset heading angle range.
- an occupant with a higher seat may correspond to a larger preset pitch angle range
- an occupant with a lower seat may correspond to a smaller preset pitch angle range.
- the preset heading angle range corresponding to the occupant is determined according to the horizontal distance between the occupant's seat and the in-vehicle display screen, and/or according to the height of the occupant's seat , and the preset pitch angle range corresponding to the occupant is determined, so that the preset angle range corresponding to the occupant can be accurately determined.
- the rotation angle of the target part includes the heading angle of the target part and the pitch angle of the target part;
- the preset angle range corresponding to the occupant includes the preset heading angle range corresponding to the occupant and the occupant
- the determining the preset angle range corresponding to the occupant according to the position information of the occupant's seat includes: according to the difference between the occupant's seat and the on-board display screen The horizontal distance is used to determine the preset heading angle range corresponding to the occupant; and the preset pitch angle range corresponding to the occupant is determined according to the height of the occupant's seat.
- the rotation angle of the target part includes the heading angle of the target part;
- the preset angle range corresponding to the occupant includes the preset heading angle range corresponding to the occupant;
- determining the preset angle range corresponding to the occupant includes: determining the preset heading angle range corresponding to the occupant according to the horizontal distance between the occupant's seat and the onboard display screen.
- the rotation angle of the target part includes the pitch angle of the target part;
- the preset angle range corresponding to the occupant includes the preset pitch angle range corresponding to the occupant;
- determining the preset angle range corresponding to the occupant includes: determining the preset pitch angle range corresponding to the occupant according to the height of the occupant's seat.
- the preset heading angle range corresponding to the occupant may also be determined according to the horizontal distance between the occupant's seat and the steering wheel or the instrument panel, which is not limited herein.
- FIG. 2 shows a schematic diagram of different preset heading angle ranges corresponding to different horizontal distances between the seat and the vehicle display screen in an embodiment of the present disclosure.
- the horizontal distance d 1 corresponds to the first preset heading angle range
- the horizontal distance d 2 corresponds to the second preset heading angle range
- the horizontal distance d 3 corresponds to the third heading angle range
- the first preset heading angle range The median of the heading angle range is ⁇ 1
- the median of the second preset heading angle range is ⁇ 2
- the median of the third preset heading angle range is ⁇ 3 .
- the determining the preset angle range corresponding to the occupant according to the position information of the occupant includes: according to the position information of the occupant and the correspondence between the position information and the preset angle range, A preset angle range corresponding to the occupant is determined.
- the correspondence between the position information and the preset angle range may be preset.
- the first coordinate interval corresponds to the first preset angle range
- the second coordinate interval corresponds to the second preset angle range
- the third coordinate interval corresponds to the third preset angle range.
- the preset angle range corresponding to the occupant is the first preset angle range; if the position information of the occupant belongs to the second coordinate range, the preset angle range corresponding to the occupant can be determined as the second preset angle range; if the position information of the occupant belongs to the second coordinate range, the preset angle corresponding to the occupant can be determined
- the range is the second preset angle range.
- the preset angle range corresponding to the occupant is determined according to the position information of the occupant and the corresponding relationship between the position information and the preset angle range, so that the preset angle range corresponding to the occupant can be quickly determined .
- the determining the preset angle range corresponding to the occupant according to the position information of the occupant includes: inputting the position information of the occupant into a pre-trained model, and outputting via the pre-trained model The preset angle range corresponding to the occupant.
- the relationship between the position information and the preset angle range can be fitted by the model, that is, the parameters of the model can be optimized by training the model, and after the model training is completed, it can be used to more flexibly determine the position information of the occupant The corresponding preset angle range.
- the correspondence between the face information and the preset angle range may be pre-stored, and after the occupant is detected, the face information of the occupant may be acquired based on the image information, and the occupant's face information may be obtained according to the and the corresponding relationship between the face information and the preset angle range, to determine the preset angle range corresponding to the occupant.
- the face information may include at least one of identity information, face images, and face features.
- the method further includes: in response to detecting the adjustment information of the occupant's seat, re-determining the preset angle range corresponding to the occupant according to the position information of the occupant after the seat is adjusted.
- the adjustment information of the occupant's seat is detected, it can be re-determined according to the position information of the target part of the occupant after the seat adjustment or the position information of the occupant's seat after adjustment
- the preset angle range corresponding to the occupant For example, the occupant includes a driver, and the seat may be adjusted before the driver begins driving.
- the position information of the target part of the driver after the seat adjustment or the position information of the adjusted seat of the driver can be used according to , and re-determine the preset angle range corresponding to the driver.
- the preset angle range corresponding to the occupant by re-determining the preset angle range corresponding to the occupant according to the position information of the occupant after seat adjustment in response to the detection of the adjustment information of the occupant's seat, it is possible to further improve the vehicle-mounted The accuracy of the control of the display.
- the method further includes: in response to detecting an occupant in the vehicle cabin, acquiring location information of the detected occupant; determining a relationship with the detected occupant according to the detected location information of the occupant The corresponding preset angle range.
- the occupant in the vehicle cabin may be detected based on the image information.
- the occupant may also be detected based on a seat sensor or the like, which is not limited here.
- position information of the newly boarded occupant may be acquired, and a preset angle range corresponding to the newly boarded occupant may be determined according to the position information of the newly boarded occupant.
- the preset angle range corresponding to the occupant can be quickly determined, so that accurate control of the on-board display screen can be realized.
- the controlling the on-board display screen to light up in response to determining that the target part is turned to the on-board display screen in the vehicle cabin according to the rotation angle of the target part includes: responding to According to the orientation of the target part before the rotation and the rotation angle of the target part, it is determined that the target part faces the vehicle display screen after the rotation, and the vehicle display screen is controlled to light up, wherein the target part is The rotation angle takes the orientation of the target part before rotation as a reference direction.
- the rotation angle of the target part may represent the rotation angle of the target part relative to the orientation before rotation.
- the orientation of the target part after rotation can be determined according to the orientation of the target part before rotation and the rotation angle of the target part.
- the vehicle display screen is controlled to light up.
- the vehicle display screen is controlled to light up , so that precise control of the vehicle display can be achieved.
- the target part may be determined that the target part does not face the vehicle display screen according to the rotation angle of the target part, and the duration that the target part does not face the vehicle display screen reaches a predetermined duration. Set the duration to control the on-board display screen to turn off. According to this implementation manner, the power consumption of the vehicle-mounted display screen can be reduced, and the interference of the vehicle-mounted display screen to the occupants can be reduced.
- the vehicle display screen in response to determining that the target part is not facing the vehicle display screen according to the rotation angle of the target part, the vehicle display screen may be controlled to be turned off. According to this implementation manner, the power consumption of the vehicle-mounted display screen can be reduced, and the interference of the vehicle-mounted display screen to the occupants can be reduced.
- the driver's image information can be collected through the DMS camera. After it is detected that the driver is seated, the preset heading angle range and the preset pitch angle range corresponding to the driver may be determined according to the position information of the driver. Based on the image information of the driver, the heading angle and pitch angle of the driver's face can be detected. If the heading angle of the driver's face belongs to the preset heading angle range corresponding to the driver, and the pitch angle of the driver's face belongs to the preset pitch angle range corresponding to the driver, then Controls the on-board display to light up. If the heading angle of the driver's face does not belong to the preset heading angle range corresponding to the driver, or the pitch angle of the driver's face belongs to the preset pitch angle range corresponding to the driver, then It is possible not to wake up the car display.
- the present disclosure also provides a control device, electronic equipment, computer-readable storage medium, and program for a vehicle-mounted display screen, all of which can be used to implement any of the vehicle-mounted display screen control methods provided by the present disclosure, and the corresponding technical solutions and technical effects. Please refer to the corresponding records in the method section, and will not be repeated here.
- FIG. 3 shows a block diagram of a control device of a vehicle-mounted display screen provided by an embodiment of the present disclosure.
- the control device of the vehicle display screen includes:
- the first acquisition module 31 is used to acquire the image information of the occupants in the cabin;
- a detection module 32 configured to detect the rotation angle of the target part of the occupant based on the image information, wherein the target part is the head, face or eyes;
- the control module 33 is configured to control the on-board display screen to light up in response to determining that the target part is turned to the on-board display screen in the vehicle cabin according to the rotation angle of the target part.
- control module 33 is used for:
- the rotation angle of the target part includes the heading angle of the target part and/or the pitch angle of the target part;
- the preset angle range includes a preset heading angle range and/or a preset pitch angle range
- the control module 33 is configured to: in response to determining according to the rotation angle of the target part that the heading angle of the target part belongs to the preset heading angle range and/or the pitch angle of the target part belongs to the preset pitch Angle range, control the vehicle display screen to light up.
- the preset angle range includes a preset angle range corresponding to the occupant
- the control module 33 is configured to control the vehicle display screen to light up in response to determining that the rotation angle of the target part belongs to a preset angle range corresponding to the occupant according to the rotation angle of the target part.
- the apparatus further includes:
- the first determination module is configured to determine the preset angle range corresponding to the occupant according to the position information of the occupant.
- the position information of the occupant includes position information of the target part of the occupant
- the first determining module is configured to: determine a preset angle range corresponding to the occupant according to the position information of the target part of the occupant.
- the preset angle range corresponding to the occupant includes a preset heading angle range corresponding to the occupant and/or a preset pitch angle range corresponding to the occupant;
- the first determining module is used for:
- a preset pitch angle range corresponding to the occupant is determined.
- the apparatus further includes:
- the second determining module is configured to determine the position information of the target part of the occupant according to the image information.
- the position information of the occupant includes position information of the seat of the occupant;
- the first determining module is configured to: determine a preset angle range corresponding to the occupant according to the position information of the occupant's seat.
- the preset angle range corresponding to the occupant includes a preset heading angle range corresponding to the occupant and/or a preset pitch angle range corresponding to the occupant;
- the first determining module is used for:
- a preset pitch angle range corresponding to the occupant is determined.
- the first determining module is used for:
- the preset angle range corresponding to the occupant is determined according to the position information of the occupant and the correspondence between the position information and the preset angle range.
- the first determining module is used for:
- the position information of the occupant is input into a pre-trained model, and a preset angle range corresponding to the occupant is output via the pre-trained model.
- the apparatus further includes:
- the third determining module is configured to, in response to detecting the adjustment information of the occupant's seat, re-determine the preset angle range corresponding to the occupant according to the position information of the occupant after the seat is adjusted.
- the apparatus further includes:
- a second acquiring module configured to acquire position information of the detected occupant in response to detecting the occupant in the vehicle cabin
- the fourth determination module is configured to determine a preset angle range corresponding to the detected occupant according to the detected position information of the occupant.
- control module 33 is used for:
- the vehicle display screen In response to determining that the target part faces the vehicle display screen after the rotation according to the orientation of the target part before the rotation and the rotation angle of the target part, the vehicle display screen is controlled to light up, wherein the target part
- the rotation angle of is the reference direction of the orientation of the target part before rotation.
- the occupant includes a driver.
- the image information of the occupant in the vehicle cabin is acquired, the rotation angle of the target part of the occupant is detected based on the image information, and the target part is determined in response to the rotation angle of the target part
- the on-board display screen can be illuminated and controlled by the rotation of the target part of the occupant, without the need for the occupant to wake up the on-board display screen by manual touch , which can improve the convenience of vehicle display control and help improve driving safety.
- the functions or modules included in the apparatus provided in the embodiments of the present disclosure may be used to execute the methods described in the above method embodiments, and the specific implementation and technical effects may refer to the above method embodiments. It is concise and will not be repeated here.
- Embodiments of the present disclosure further provide a computer-readable storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the foregoing method is implemented.
- the computer-readable storage medium may be a non-volatile computer-readable storage medium, or may be a volatile computer-readable storage medium.
- Embodiments of the present disclosure further provide a computer program, including computer-readable codes, when the computer-readable codes are executed in an electronic device, the processor in the electronic device executes the above method.
- Embodiments of the present disclosure further provide a computer program product for storing computer-readable instructions, which, when executed, cause the computer to execute the operations of the method for controlling a vehicle-mounted display screen provided by any of the foregoing embodiments.
- Embodiments of the present disclosure further provide an electronic device, including: one or more processors; a memory for storing executable instructions; wherein the one or more processors are configured to invoke executable instructions stored in the memory instruction to execute the above method.
- the electronic device may be provided as a terminal, server or other form of device.
- the electronic device may be a vehicle machine, a domain controller, or a processor in the vehicle cabin, and may also be a device host in a DMS or an OMS for performing data processing operations such as images.
- FIG. 4 shows a block diagram of an electronic device 800 provided by an embodiment of the present disclosure.
- electronic device 800 may be a mobile phone, computer, digital broadcast terminal, messaging device, game console, tablet device, medical device, fitness device, personal digital assistant, etc. terminal.
- the electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814 , and the communication component 816 .
- the processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations.
- the processing component 802 can include one or more processors 820 to execute instructions to perform all or some of the steps of the methods described above.
- processing component 802 may include one or more modules that facilitate interaction between processing component 802 and other components.
- processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.
- Memory 804 is configured to store various types of data to support operation at electronic device 800 . Examples of such data include instructions for any application or method operating on electronic device 800, contact data, phonebook data, messages, pictures, videos, and the like. Memory 804 may be implemented by any type of volatile or nonvolatile storage device or combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.
- SRAM static random access memory
- EEPROM electrically erasable programmable read only memory
- EPROM erasable Programmable Read Only Memory
- PROM Programmable Read Only Memory
- ROM Read Only Memory
- Magnetic Memory Flash Memory
- Magnetic or Optical Disk Magnetic Disk
- Power supply assembly 806 provides power to various components of electronic device 800 .
- Power supply components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 800.
- Multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user.
- the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user.
- the touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense the boundaries of a touch or swipe action, but also detect the duration and pressure associated with the touch or swipe action.
- the multimedia component 808 includes a front-facing camera and/or a rear-facing camera. When the electronic device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each of the front and rear cameras can be a fixed optical lens system or have focal length and optical zoom capability.
- Audio component 810 is configured to output and/or input audio signals.
- audio component 810 includes a microphone (MIC) that is configured to receive external audio signals when electronic device 800 is in operating modes, such as calling mode, recording mode, and voice recognition mode.
- the received audio signal may be further stored in memory 804 or transmitted via communication component 816 .
- audio component 810 also includes a speaker for outputting audio signals.
- the I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module, which may be a keyboard, a click wheel, a button, or the like. These buttons may include, but are not limited to: home button, volume buttons, start button, and lock button.
- Sensor assembly 814 includes one or more sensors for providing status assessment of various aspects of electronic device 800 .
- the sensor assembly 814 can detect the on/off state of the electronic device 800, the relative positioning of the components, such as the display and the keypad of the electronic device 800, the sensor assembly 814 can also detect the electronic device 800 or one of the electronic device 800 Changes in the position of components, presence or absence of user contact with the electronic device 800 , orientation or acceleration/deceleration of the electronic device 800 and changes in the temperature of the electronic device 800 .
- Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact.
- Sensor assembly 814 may also include a light sensor, such as a complementary metal oxide semiconductor (CMOS) or charge coupled device (CCD) image sensor, for use in imaging applications.
- CMOS complementary metal oxide semiconductor
- CCD charge coupled device
- the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
- Communication component 816 is configured to facilitate wired or wireless communication between electronic device 800 and other devices.
- the electronic device 800 can access a wireless network based on communication standards, such as wireless network (Wi-Fi), second generation mobile communication technology (2G), third generation mobile communication technology (3G), fourth generation mobile communication technology (4G) )/Long Term Evolution (LTE) of Universal Mobile Communications Technology, Fifth Generation Mobile Communications Technology (5G), or a combination thereof.
- the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel.
- the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication.
- the NFC module may be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
- RFID radio frequency identification
- IrDA infrared data association
- UWB ultra-wideband
- Bluetooth Bluetooth
- electronic device 800 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A programmed gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation is used to perform the above method.
- ASICs application specific integrated circuits
- DSPs digital signal processors
- DSPDs digital signal processing devices
- PLDs programmable logic devices
- FPGA field programmable A programmed gate array
- controller microcontroller, microprocessor or other electronic component implementation is used to perform the above method.
- a non-volatile computer-readable storage medium such as a memory 804 comprising computer program instructions executable by the processor 820 of the electronic device 800 to perform the above method is also provided.
- FIG. 5 shows a block diagram of an electronic device 1900 provided by an embodiment of the present disclosure.
- the electronic device 1900 may be provided as a server.
- electronic device 1900 includes processing component 1922, which further includes one or more processors, and a memory resource represented by memory 1932 for storing instructions executable by processing component 1922, such as applications.
- An application program stored in memory 1932 may include one or more modules, each corresponding to a set of instructions.
- the processing component 1922 is configured to execute instructions to perform the above-described methods.
- the electronic device 1900 may also include a power supply assembly 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input output (I/O) interface 1958 .
- the electronic device 1900 can operate based on an operating system stored in the memory 1932, such as a Microsoft server operating system (Windows Server TM ), a graphical user interface based operating system (Mac OS X TM ) introduced by Apple, a multi-user multi-process computer operating system (Unix TM ), Free and Open Source Unix-like Operating System (Linux TM ), Open Source Unix-like Operating System (FreeBSD TM ) or the like.
- Microsoft server operating system Windows Server TM
- Mac OS X TM graphical user interface based operating system
- Uniix TM multi-user multi-process computer operating system
- Free and Open Source Unix-like Operating System Linux TM
- FreeBSD TM Open Source Unix-like Operating System
- a non-volatile computer-readable storage medium such as memory 1932 comprising computer program instructions executable by processing component 1922 of electronic device 1900 to perform the above-described method.
- the present disclosure may be a system, method and/or computer program product.
- the computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of the present disclosure.
- a computer-readable storage medium may be a tangible device that can hold and store instructions for use by the instruction execution device.
- the computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing.
- Non-exhaustive list of computer readable storage media include: portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM) or flash memory), static random access memory (SRAM), portable compact disk read only memory (CD-ROM), digital versatile disk (DVD), memory sticks, floppy disks, mechanically coded devices, such as printers with instructions stored thereon Hole cards or raised structures in grooves, and any suitable combination of the above.
- RAM random access memory
- ROM read only memory
- EPROM erasable programmable read only memory
- flash memory static random access memory
- SRAM static random access memory
- CD-ROM compact disk read only memory
- DVD digital versatile disk
- memory sticks floppy disks
- mechanically coded devices such as printers with instructions stored thereon Hole cards or raised structures in grooves, and any suitable combination of the above.
- Computer-readable storage media are not to be construed as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (eg, light pulses through fiber optic cables), or through electrical wires transmitted electrical signals.
- the computer readable program instructions described herein may be downloaded to various computing/processing devices from a computer readable storage medium, or to an external computer or external storage device over a network such as the Internet, a local area network, a wide area network, and/or a wireless network.
- the network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers.
- a network adapter card or network interface in each computing/processing device receives computer-readable program instructions from a network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing/processing device .
- Computer program instructions for carrying out operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or instructions in one or more programming languages.
- Source or object code written in any combination, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as the "C" language or similar programming languages.
- the computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server implement.
- the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider through the Internet connect).
- LAN local area network
- WAN wide area network
- custom electronic circuits such as programmable logic circuits, field programmable gate arrays (FPGAs), or programmable logic arrays (PLAs) can be personalized by utilizing state information of computer readable program instructions.
- Computer readable program instructions are executed to implement various aspects of the present disclosure.
- These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer or other programmable data processing apparatus to produce a machine that causes the instructions when executed by the processor of the computer or other programmable data processing apparatus , resulting in means for implementing the functions/acts specified in one or more blocks of the flowchart and/or block diagrams.
- These computer readable program instructions can also be stored in a computer readable storage medium, these instructions cause a computer, programmable data processing apparatus and/or other equipment to operate in a specific manner, so that the computer readable medium on which the instructions are stored includes An article of manufacture comprising instructions for implementing various aspects of the functions/acts specified in one or more blocks of the flowchart and/or block diagrams.
- Computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other equipment to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other equipment to produce a computer-implemented process , thereby causing instructions executing on a computer, other programmable data processing apparatus, or other device to implement the functions/acts specified in one or more blocks of the flowcharts and/or block diagrams.
- each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more functions for implementing the specified logical function(s) executable instructions.
- the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
- each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations can be implemented in dedicated hardware-based systems that perform the specified functions or actions , or can be implemented in a combination of dedicated hardware and computer instructions.
- the computer program product can be specifically implemented by hardware, software or a combination thereof.
- the computer program product is embodied as a computer storage medium, and in another optional embodiment, the computer program product is embodied as a software product, such as a software development kit (Software Development Kit, SDK), etc. Wait.
- a software development kit Software Development Kit, SDK
Abstract
Description
Claims (20)
- 一种车载显示屏的控制方法,其特征在于,包括:获取车舱内的乘员的影像信息;基于所述影像信息检测所述乘员的目标部位的旋转角,其中,所述目标部位为头部、脸部或者眼睛;响应于根据所述目标部位的旋转角确定所述目标部位转向所述车舱内的车载显示屏,控制所述车载显示屏点亮。
- 根据权利要求1所述的方法,其特征在于,所述响应于根据所述目标部位的旋转角确定所述目标部位转向所述车舱内的车载显示屏,控制所述车载显示屏点亮,包括:响应于根据所述目标部位的旋转角确定所述目标部位的旋转角属于预设角度范围,控制所述车载显示屏点亮,其中,所述目标部位的旋转角以朝向车头的方向为参考方向。
- 根据权利要求2所述的方法,其特征在于,所述目标部位的旋转角包括所述目标部位的航向角和/或所述目标部位的俯仰角;所述预设角度范围包括预设航向角范围和/或预设俯仰角范围;所述响应于根据所述目标部位的旋转角确定所述目标部位的旋转角属于预设角度范围,控制所述车载显示屏点亮,包括:响应于根据所述目标部位的旋转角确定所述目标部位的航向角属于所述预设航向角范围和/或所述目标部位的俯仰角属于所述预设俯仰角范围,控制所述车载显示屏点亮。
- 根据权利要求2或3所述的方法,其特征在于,所述预设角度范围包括所述乘员对应的预设角度范围;所述响应于根据所述目标部位的旋转角确定所述目标部位的旋转角属于预设角度范围,控制所述车载显示屏点亮,包括:响应于根据所述目标部位的旋转角确定所述目标部位的旋转角属于所述乘员对应的预设角度范围,控制所述车载显示屏点亮。
- 根据权利要求4所述的方法,其特征在于,在所述响应于根据所述目标部位的旋转角确定所述目标部位的旋转角属于所述乘员对应的预设角度范围,控制所述车载显示屏点亮之前,所述方法还包括:根据所述乘员的位置信息,确定所述乘员对应的预设角度范围。
- 根据权利要求5所述的方法,其特征在于,所述乘员的位置信息包括所述乘员的目标部位的位置信息;所述根据所述乘员的位置信息,确定所述乘员对应的预设角度范围,包括:根据所述乘员的目标部位的位置信息,确定所述乘员对应的预设角度范围。
- 根据权利要求6所述的方法,其特征在于,所述乘员对应的预设角度范围包括所述乘员对应的预设航向角范围和/或所述乘员对应的预设俯仰角范围;所述根据所述乘员的目标部位的位置信息,确定所述乘员对应的预设角度范围,包括:根据所述乘员的目标部位与所述车载显示屏之间的水平距离,确定所述乘员对应的预设航向角范围;和/或,根据所述乘员的目标部位的高度,确定所述乘员对应的预设俯仰角范围。
- 根据权利要求6或7所述的方法,其特征在于,在所述根据所述乘员的目标部位的位置信息,确定所述乘员对应的预设角度范围之前,所述方法还包括:根据所述影像信息,确定所述乘员的目标部位的位置信息。
- 根据权利要求5所述的方法,其特征在于,所述乘员的位置信息包括所述乘员的座椅的位置信息;所述据所述乘员的位置信息,确定所述乘员对应的预设角度范围,包括:根据所述乘员的座椅的位置信息,确定所述乘员对应的预设角度范围。
- 根据权利要求9所述的方法,其特征在于,所述乘员对应的预设角度范围包括所述乘员对应的预设航向角范围和/或所述乘员对应的预设俯仰角范围;所述根据所述乘员的座椅的位置信息,确定所述乘员对应的预设角度范围,包括:根据所述乘员的座椅与所述车载显示屏之间的水平距离,确定所述乘员对应的预设航向角范围;和/或,根据所述乘员的座椅的高度,确定所述乘员对应的预设俯仰角范围。
- 根据权利要求5至10中任意一项所述的方法,其特征在于,所述根据所述乘员的位置信息,确定所述乘员对应的预设角度范围,包括:根据所述乘员的位置信息,以及位置信息与预设角度范围之间的对应关系,确定所述乘员对应的预设角度范围。
- 根据权利要求5至10中任意一项所述的方法,其特征在于,所述根据所述乘员的位置信息,确定所述乘员对应的预设角度范围,包括:将所述乘员的位置信息输入预先训练的模型,经由所述预先训练的模型输出所述乘员对应的预设角度范围。
- 根据权利要求4至12中任意一项所述的方法,其特征在于,所述方法还包括:响应于检测到所述乘员的座椅的调节信息,根据座椅调节后所述乘员的位置信息,重新确定所述乘员对应的预设角度范围。
- 根据权利要求4至13中任意一项所述的方法,其特征在于,所述方法还包括:响应于在所述车舱内检测到乘员,获取检测到的乘员的位置信息;根据所述检测到的乘员的位置信息确定与所述检测到的乘员对应的预设角度范围。
- 根据权利要求1所述的方法,其特征在于,所述响应于根据所述目标部位的旋转角确定所述目标部位转向所述车舱内的车载显示屏,控制所述车载显示屏点亮,包括:响应于根据所述目标部位在旋转前的朝向以及所述目标部位的旋转角确定所述目标部位在旋转后朝向所述车载显示屏,控制所述车载显示屏点亮,其中,所述目标部位的旋转角以所述目标部位在旋转前的朝向为参考方向。
- 根据权利要求1至15中任意一项所述的方法,其特征在于,所述乘员包括驾驶员。
- 一种车载显示屏的控制装置,其特征在于,包括:第一获取模块,用于获取车舱内的乘员的影像信息;检测模块,用于基于所述影像信息检测所述乘员的目标部位的旋转角,其中,所述目标部位为头 部、脸部或者眼睛;控制模块,用于响应于根据所述目标部位的旋转角确定所述目标部位转向所述车舱内的车载显示屏,控制所述车载显示屏点亮。
- 一种电子设备,其特征在于,包括:一个或多个处理器;用于存储可执行指令的存储器;其中,所述一个或多个处理器被配置为调用所述存储器存储的可执行指令,以执行权利要求1至16中任意一项所述的方法。
- 一种计算机可读存储介质,其上存储有计算机程序指令,其特征在于,所述计算机程序指令被处理器执行时实现权利要求1至16中任意一项所述的方法。
- 一种计算机程序,包括计算机可读代码,其特征在于,当所述计算机可读代码在电子设备中运行时,所述电子设备中的处理器执行用于实现权利要求1至16中的任一权利要求所述的方法。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020227006773A KR20220098339A (ko) | 2020-12-31 | 2021-07-30 | 차량용 스크린의 제어 방법 및 장치, 전자 기기 및 저장 매체 |
US17/680,376 US20220206567A1 (en) | 2020-12-31 | 2022-02-25 | Method and apparatus for controlling vehicle display screen, and storage medium |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011632094.6 | 2020-12-31 | ||
CN202011632094.6A CN112667084B (zh) | 2020-12-31 | 2020-12-31 | 车载显示屏的控制方法及装置、电子设备和存储介质 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/680,376 Continuation US20220206567A1 (en) | 2020-12-31 | 2022-02-25 | Method and apparatus for controlling vehicle display screen, and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022142331A1 true WO2022142331A1 (zh) | 2022-07-07 |
Family
ID=75413085
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2021/109821 WO2022142331A1 (zh) | 2020-12-31 | 2021-07-30 | 车载显示屏的控制方法及装置、电子设备和存储介质 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN112667084B (zh) |
WO (1) | WO2022142331A1 (zh) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112667084B (zh) * | 2020-12-31 | 2023-04-07 | 上海商汤临港智能科技有限公司 | 车载显示屏的控制方法及装置、电子设备和存储介质 |
CN113361361B (zh) * | 2021-05-31 | 2023-04-07 | 上海商汤临港智能科技有限公司 | 与乘员交互的方法及装置、车辆、电子设备和存储介质 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105912903A (zh) * | 2016-04-06 | 2016-08-31 | 上海斐讯数据通信技术有限公司 | 一种移动终端的解锁方法及移动终端 |
US20180011543A1 (en) * | 2016-07-05 | 2018-01-11 | Ricoh Company, Ltd. | Information processing apparatus, position information generation method, and information processing system |
CN107678539A (zh) * | 2017-09-07 | 2018-02-09 | 歌尔科技有限公司 | 用于头戴显示设备的显示方法及头戴显示设备 |
CN109710080A (zh) * | 2019-01-25 | 2019-05-03 | 华为技术有限公司 | 一种屏幕控制和语音控制方法及电子设备 |
CN109835260A (zh) * | 2019-03-07 | 2019-06-04 | 百度在线网络技术(北京)有限公司 | 一种车辆信息显示方法、装置、终端和存储介质 |
CN112667084A (zh) * | 2020-12-31 | 2021-04-16 | 上海商汤临港智能科技有限公司 | 车载显示屏的控制方法及装置、电子设备和存储介质 |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104461005B (zh) * | 2014-12-15 | 2018-01-02 | 东风汽车公司 | 一种车载屏幕开关控制方法 |
US9994125B2 (en) * | 2016-01-12 | 2018-06-12 | Ford Global Technologies, Llc | System and method for vehicle seat monitoring |
CN105739705A (zh) * | 2016-02-04 | 2016-07-06 | 重庆邮电大学 | 一种车载系统人眼控制方法及装置 |
US10259345B2 (en) * | 2016-10-07 | 2019-04-16 | Dali, Llc | Integrated safety seat |
JP6669182B2 (ja) * | 2018-02-27 | 2020-03-18 | オムロン株式会社 | 乗員監視装置 |
CN108919982B (zh) * | 2018-06-14 | 2020-10-20 | 北京理工大学 | 一种基于人脸朝向识别的自动键鼠切换方法 |
US10894476B2 (en) * | 2018-11-06 | 2021-01-19 | Honda Motor Co., Ltd. | Display system in a vehicle and a method for control thereof |
CN111824036A (zh) * | 2020-07-23 | 2020-10-27 | 戴姆勒股份公司 | 车载显示装置调节方法及系统 |
CN112001348A (zh) * | 2020-08-31 | 2020-11-27 | 上海商汤临港智能科技有限公司 | 车舱内的乘员检测方法及装置、电子设备和存储介质 |
-
2020
- 2020-12-31 CN CN202011632094.6A patent/CN112667084B/zh active Active
-
2021
- 2021-07-30 WO PCT/CN2021/109821 patent/WO2022142331A1/zh active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105912903A (zh) * | 2016-04-06 | 2016-08-31 | 上海斐讯数据通信技术有限公司 | 一种移动终端的解锁方法及移动终端 |
US20180011543A1 (en) * | 2016-07-05 | 2018-01-11 | Ricoh Company, Ltd. | Information processing apparatus, position information generation method, and information processing system |
CN107678539A (zh) * | 2017-09-07 | 2018-02-09 | 歌尔科技有限公司 | 用于头戴显示设备的显示方法及头戴显示设备 |
CN109710080A (zh) * | 2019-01-25 | 2019-05-03 | 华为技术有限公司 | 一种屏幕控制和语音控制方法及电子设备 |
CN109835260A (zh) * | 2019-03-07 | 2019-06-04 | 百度在线网络技术(北京)有限公司 | 一种车辆信息显示方法、装置、终端和存储介质 |
CN112667084A (zh) * | 2020-12-31 | 2021-04-16 | 上海商汤临港智能科技有限公司 | 车载显示屏的控制方法及装置、电子设备和存储介质 |
Also Published As
Publication number | Publication date |
---|---|
CN112667084A (zh) | 2021-04-16 |
CN112667084B (zh) | 2023-04-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3072710B1 (en) | Vehicle, mobile terminal and method for controlling the same | |
WO2022048119A1 (zh) | 车辆控制方法及装置、电子设备、存储介质和车辆 | |
WO2022041671A1 (zh) | 方向盘脱手检测方法及装置、电子设备和存储介质 | |
WO2022062659A1 (zh) | 智能驾驶控制方法及装置、车辆、电子设备和存储介质 | |
KR101730315B1 (ko) | 영상을 공유하는 전자 기기 및 방법 | |
WO2022142331A1 (zh) | 车载显示屏的控制方法及装置、电子设备和存储介质 | |
US10209832B2 (en) | Detecting user interactions with a computing system of a vehicle | |
WO2022041670A1 (zh) | 车舱内的乘员检测方法及装置、电子设备和存储介质 | |
CN111137278B (zh) | 汽车的泊车控制方法、装置及存储介质 | |
CN112026790B (zh) | 车载机器人的控制方法及装置、车辆、电子设备和介质 | |
WO2022057212A1 (zh) | 后备箱的控制方法及装置、车辆、电子设备和存储介质 | |
KR20170014586A (ko) | 이동 단말기 및 그 제어방법 | |
CN113486760A (zh) | 对象说话检测方法及装置、电子设备和存储介质 | |
WO2023273060A1 (zh) | 危险动作的识别方法及装置、电子设备和存储介质 | |
WO2022198907A1 (zh) | 车辆显示屏的控制方法及装置、设备、介质及车辆 | |
WO2022188362A1 (zh) | 分心提醒方法及装置、电子设备和存储介质 | |
CN113488043B (zh) | 乘员说话检测方法及装置、电子设备和存储介质 | |
CN114407630A (zh) | 车门控制方法及装置、电子设备和存储介质 | |
JP2018194976A (ja) | メッセージ表示用プログラム、メッセージ表示装置、及びメッセージ表示方法 | |
US11381950B2 (en) | In-vehicle detection of a charge-only connection with a mobile computing device | |
CN113911054A (zh) | 车辆个性化配置方法及装置、电子设备和存储介质 | |
US20220206567A1 (en) | Method and apparatus for controlling vehicle display screen, and storage medium | |
CN113361361B (zh) | 与乘员交互的方法及装置、车辆、电子设备和存储介质 | |
EP4328765A1 (en) | Method and apparatus for recommending vehicle driving strategy | |
CN116796057A (zh) | 用于车辆的车载玻璃的呈现控制方法、装置以及车辆 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 2022513838 Country of ref document: JP Kind code of ref document: A |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21913079 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21913079 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 24.11.2023) |