CN117261705A - Vehicle cabin control method, system, equipment and vehicle - Google Patents

Vehicle cabin control method, system, equipment and vehicle Download PDF

Info

Publication number
CN117261705A
CN117261705A CN202311488095.1A CN202311488095A CN117261705A CN 117261705 A CN117261705 A CN 117261705A CN 202311488095 A CN202311488095 A CN 202311488095A CN 117261705 A CN117261705 A CN 117261705A
Authority
CN
China
Prior art keywords
target
seat
vehicle cabin
user
screen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311488095.1A
Other languages
Chinese (zh)
Inventor
王禄娜
胡海波
赵荣
修世诚
吴坚强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Great Wall Motor Co Ltd
Original Assignee
Great Wall Motor Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Great Wall Motor Co Ltd filed Critical Great Wall Motor Co Ltd
Priority to CN202311488095.1A priority Critical patent/CN117261705A/en
Publication of CN117261705A publication Critical patent/CN117261705A/en
Pending legal-status Critical Current

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60NSEATS SPECIALLY ADAPTED FOR VEHICLES; VEHICLE PASSENGER ACCOMMODATION NOT OTHERWISE PROVIDED FOR
    • B60N2/00Seats specially adapted for vehicles; Arrangement or mounting of seats in vehicles
    • B60N2/02Seats specially adapted for vehicles; Arrangement or mounting of seats in vehicles the seat or part thereof being movable, e.g. adjustable
    • B60N2/0224Non-manual adjustments, e.g. with electrical operation
    • B60N2/0244Non-manual adjustments, e.g. with electrical operation with logic circuits
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/29Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area inside the vehicle, e.g. for viewing passengers or cargo
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/023Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/037Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for occupant comfort, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Multimedia (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Transportation (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)

Abstract

The invention discloses a vehicle cabin control method, a system, equipment and a vehicle, wherein the method comprises the following steps: responding to an interaction instruction of a user, and acquiring a vehicle cabin image; the interaction instruction is an instruction of using the target ceiling screen by a user; determining a target seat and corresponding target adjusting parameters according to the vehicle cabin image and the range of the adjusting parameters of each seat in the vehicle cabin; and controlling and adjusting the target seat according to the target adjusting parameters. According to the method, when a user uses the ceiling screen, according to the vehicle cabin image, the range of the adjusting parameters of each seat in the vehicle cabin can automatically determine the target seat to be adjusted and the target adjusting parameters thereof, and accordingly, the target seat is automatically adjusted, and the user experience is improved.

Description

Vehicle cabin control method, system, equipment and vehicle
Technical Field
The present invention relates to the field of control technologies, and in particular, to a method, a system, an apparatus, and a vehicle for controlling a cabin of a vehicle.
Background
With the continuous development of technology, vehicle entertainment systems are also being continuously upgraded and improved. The vehicle-mounted ceiling screen becomes a standard of a plurality of vehicle types. These overhead screens not only provide entertainment audio-visual enjoyment to passengers, but also become a highlight for vehicle interior decoration.
The vehicle roof screen is usually mounted on top of the vehicle cabin and is fixed to the roof by a bracket. It can typically play multimedia content such as music, movies, television programs, etc. In order to meet the viewing needs of a plurality of different passengers, it is becoming more common for a vehicle to be provided with a double ceiling, however, for rear passengers, the viewing effect may be poor due to the front seat or the passenger blocking his or her view.
Disclosure of Invention
Based on the problems, the invention provides a vehicle cabin control method, a system, equipment and a vehicle, which can automatically solve the problem that a rear-row audience is blocked when watching a ceiling screen according to the adjustment parameters of each seat in a cabin.
The invention discloses the following technical scheme:
a first aspect of the present invention provides a vehicle cabin control method, the method comprising:
responding to an interaction instruction of a user, and acquiring a vehicle cabin image; the interaction instruction is an instruction of using the target ceiling screen by a user;
determining a target seat and corresponding target adjusting parameters according to the vehicle cabin image and the range of the adjusting parameters of each seat in the vehicle cabin;
and controlling and adjusting the target seat according to the target adjusting parameters.
In one possible implementation manner, the interaction instruction of the user is an interaction instruction of a rear seat position user, and the determining, according to the vehicle cabin image and the range of adjustment parameters of each seat in the vehicle cabin, the target seat and the corresponding target adjustment parameters includes:
determining a visual field range of the rear seat position user according to the vehicle cabin image; the visual field range is a space range formed by the pupil position of the rear seat position user and the edge position of the target ceiling screen;
detecting whether a shielding object exists in the visual field range according to the vehicle cabin image;
when a shielding object exists in the visual field range, determining a target seat and corresponding target adjusting parameters according to the range of the adjusting parameters of each seat in the vehicle cabin;
and controlling and adjusting the target seat according to the target adjusting parameters.
In one possible implementation manner, the determining the target seat and the corresponding target adjustment parameters according to the range of the adjustment parameters of each seat in the vehicle cabin includes: determining whether a first target height exists according to the adjustment range of the height of the rear seat, so that no shielding object exists in the visual field range of a user when the height of the rear seat is the first target height;
And if the first target height exists, determining that the rear seat is a target seat, wherein the first target height is a target adjusting parameter.
In one possible implementation manner, the determining the target seat and the corresponding target adjustment parameters according to the range of the adjustment parameters of each seat in the vehicle cabin further includes:
if the first target height does not exist, determining whether a target angle and/or a second target height exists according to an angle adjusting range and a height adjusting range of the front seat when the shielding object is a front seat and the front seat has no passengers, and enabling the angle of the front seat to be the target angle and/or the height to be the second target height, wherein the shielding object does not exist in the visual field range of the user;
and if the target angle and/or the second target height exist, determining that the front seat is the target seat, and determining that the target angle and/or the second target height are target adjustment parameters.
In one possible implementation, the method further includes:
if the target angle and/or the second target height do not exist, determining whether the adjacent seat position of the rear seat position user has no passengers or not according to the vehicle cabin image;
If no passenger exists at the adjacent seat position, generating first prompt information; the first prompting information is used for prompting the rear seat position user to move to the adjacent seat position.
In one possible implementation, the method further includes: if passengers exist at the adjacent seat positions, generating second prompt information and controlling the non-target ceiling screen to display target contents; the second prompting information is used for prompting the rear seat position user to watch a non-target ceiling screen; the target content is content to be watched by the rear seat position user.
In one possible implementation manner, the controlling the non-target ceiling screen to display target content includes:
if the non-target ceiling screen is in an unopened state, controlling to open the non-target ceiling screen and displaying target content;
if the non-target ceiling screen is in an open state, controlling the non-target ceiling screen to be partitioned into a plurality of partition screens, and determining an amplification factor according to the position of the rear seat position user and the number of the partition screens; determining the resolution of the target partition screen according to the amplification factor; displaying the target content in the target partition screen according to the resolution ratio of the target partition screen; the amplification factor is the ratio of the display resolution of the partitioned screen to the display resolution of the non-partitioned screen; the target partition screen is a partition screen corresponding to the rear seat position user.
A second aspect of the invention provides a vehicle cabin control system, the system comprising:
the cabin image acquisition module is used for responding to the interaction instruction of the user and acquiring a vehicle cabin image; the interaction instruction is an instruction of using the target ceiling screen by a user;
the adjusting target determining module is used for determining a target seat and corresponding target adjusting parameters according to the vehicle cabin image and the range of the adjusting parameters of each seat in the vehicle cabin;
and the adjusting module is used for controlling and adjusting the target seat according to the target adjusting parameters.
A third aspect of the invention provides a vehicle comprising: a controller and two ceiling screens;
the upper edges of the two ceiling screens are fixed at the top of the vehicle cabin, and the upper edges of the two ceiling screens are positioned on the same straight line perpendicular to the running direction of the vehicle;
the controller is configured to execute the vehicle cabin control method according to the first aspect of the invention.
A fourth aspect of the invention provides a vehicle cabin control apparatus comprising: the vehicle cabin control method according to the first aspect of the invention is implemented by a memory, a processor, and a computer program stored on the memory and executable on the processor, which when executed by the processor.
A fifth aspect of the present invention provides a computer-readable storage medium having stored thereon a computer program, characterized in that the program, when executed by a processor, implements the vehicle cabin control method according to the first aspect of the present invention.
Compared with the prior art, the invention has the following beneficial effects:
the invention provides a vehicle cabin control method, a system, equipment and a vehicle, wherein the method comprises the following steps: responding to an interaction instruction of a user, and acquiring a vehicle cabin image; the interaction instruction is an instruction of using the target ceiling screen by a user; determining a target seat and corresponding target adjusting parameters according to the vehicle cabin image and the range of the adjusting parameters of each seat in the vehicle cabin; and controlling and adjusting the target seat according to the target adjusting parameters. According to the method, when a user uses the ceiling screen, according to the vehicle cabin image, the range of the adjusting parameters of each seat in the vehicle cabin can be automatically determined, the target seat and the target adjusting parameters thereof to be adjusted can be automatically adjusted according to the range, for example, when the user vision at the back seat position is blocked, the back seat is controlled and adjusted to change the user vision at the back seat position, or the front seat is adjusted to move a blocking object out of the user vision range at the back seat position, so that the user experience is improved.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions of the prior art, the drawings which are used in the description of the embodiments or the prior art will be briefly described, it being obvious that the drawings in the description below are only some embodiments of the invention, and that other drawings can be obtained according to these drawings without inventive faculty for a person skilled in the art.
FIG. 1 is a flow chart of a method for controlling a cabin of a vehicle according to an embodiment of the present invention;
FIG. 2a is a schematic illustration of an in-cabin layout of a vehicle according to an embodiment of the present invention;
FIG. 2b is a schematic illustration of another vehicle cabin interior layout according to an embodiment of the present invention;
FIG. 2c is a schematic illustration of yet another in-cabin layout of a vehicle according to an embodiment of the present invention;
FIG. 2d is a flowchart of another vehicle cabin control method according to an embodiment of the present invention;
FIG. 3 is a flowchart of a vehicle start control method according to an embodiment of the present invention;
fig. 4 is a block diagram of a computer device according to an embodiment of the present invention.
Detailed Description
In order that the above-recited objects, features and advantages of the present invention will become more readily apparent, a more particular description of embodiments of the invention will be rendered by reference to the appended drawings and appended drawings.
As previously described, in-vehicle entertainment systems are also continually upgraded and improved. The vehicle-mounted ceiling screen becomes a standard of a plurality of vehicle types. These overhead screens not only provide entertainment audio-visual enjoyment to passengers, but also become a highlight for vehicle interior decoration.
The vehicle roof screen is typically mounted on top of the vehicle interior and secured to the roof by brackets. It can typically play multimedia content such as music, movies, television programs, etc. In order to meet the viewing needs of a plurality of different passengers, double ceiling screens are becoming more common, however, for rear passengers, the viewing effect may be worse due to the front seat or the passenger blocking his view.
In view of this, the embodiments of the present invention provide a vehicle cabin control method, a system, a device and a vehicle, where the method may be applied to a central controller of a vehicle, and the method includes: responding to an interaction instruction of a user, and acquiring a vehicle cabin image; the interaction instruction is an instruction of using the target ceiling screen by a user; determining a target seat and corresponding target adjusting parameters according to the vehicle cabin image and the range of the adjusting parameters of each seat in the vehicle cabin; and controlling and adjusting the target seat according to the target adjusting parameters. According to the method, when a user uses the ceiling screen, according to the vehicle cabin image, the range of the adjusting parameters of each seat in the vehicle cabin can be automatically determined, the target seat and the target adjusting parameters thereof to be adjusted can be automatically adjusted according to the range, for example, when the user vision at the back seat position is blocked, the back seat is controlled and adjusted to change the user vision at the back seat position, or the front seat is adjusted to move a blocking object out of the user vision range at the back seat position, so that the user experience is improved.
Fig. 1 is a flowchart of a vehicle cabin control method according to an embodiment of the present invention. As shown in fig. 1, the method includes:
s101, responding to an interaction instruction of a user, and acquiring a vehicle cabin image; the interaction instruction is an instruction of using the target ceiling screen by a user.
In this embodiment, the user who sends the interaction instruction may be a user of any seat position in the vehicle cabin. The interaction instruction can be an action instruction, a voice instruction and the like, the action instruction can be acquired through a camera in the vehicle, the voice instruction can be acquired through a sound sensor, and the interaction instruction can be sent to a corresponding ceiling screen controller through voice equipment, hand control equipment (such as a touch screen controller and a key controller) and the like which are arranged on a seat. The ceiling screen controller transmits the interaction instruction to the central controller after receiving the interaction instruction, and the central controller can determine the seat on which the user sits according to the interaction instruction.
S102, determining a target seat and corresponding target adjustment parameters according to the vehicle cabin image and the adjustment parameter ranges of each seat in the vehicle cabin.
In one example, if the interaction instruction is issued by the user at the driver's seat, the co-driver's seat, or a position of the seat next to the overhead screen, whether the rear row has passengers can be detected according to the vehicle cabin image, and if the rear row has no passengers, the user seat can be adjusted backward to the target position, or the user is prompted to move to the rear row seat position, so that the comfort level of the user for watching the target overhead screen is improved.
The embodiment of the invention provides a specific implementation mode of a vehicle cabin control method when a rear-row user has a requirement of watching a ceiling screen, and the specific implementation mode is shown in S201-S205.
S103, controlling and adjusting the target seat according to the target adjusting parameters.
According to the embodiment of the invention, when a user uses the ceiling screen, the target seat and the target adjusting parameters thereof which need to be adjusted can be automatically determined according to the range of the adjusting parameters of each seat in the vehicle cabin according to the vehicle cabin image, and the ceiling screen is automatically adjusted accordingly, so that the user experience of watching the ceiling screen is improved.
Fig. 2a is a schematic diagram of an in-cabin layout of a vehicle according to an embodiment of the present invention. As shown in fig. 2a, the embodiment of the present invention is illustrated by taking a 7-seat vehicle as an example, having a first row of seats 205a for the driver's seat and 205b for the passenger's seat, 2 seats (202 a, 202 b) for the rear 1 row, and 3 seats (204 a, 204b, 204 c) for the rear 2 row. Fig. 2b is a schematic diagram of another layout in a vehicle cabin according to an embodiment of the present invention. As shown in fig. 2b, the cabin roof 203 is provided with two roof panels, a left roof panel 201a and a right roof panel 201b, respectively, the upper edges of which lie on the same straight line perpendicular to the vehicle travelling direction. Fig. 2c is a schematic illustration of a layout in a cabin of a vehicle according to an embodiment of the present invention. As shown in fig. 2c, the user of the left seat 204a of the rear 2 rows is blocked from view by the top of the left seat 202a of the rear 1 rows and the head of his or her passengers while viewing the left overhead screen 201 a. In the embodiment of the invention, when a user of the left seat 204a of the rear 2 rows of 7 seats wants to watch the left ceiling screen 201a or a user of the right seat 204c of the rear 2 rows wants to watch the right ceiling screen 201b, the method for controlling the cabin of the vehicle provided by the embodiment of the invention is described. It should be noted that, if the vehicle space increases, when the vehicle has a rear 3 rows, a rear 4 rows and a rear multi-row, the method for controlling the cabin of the vehicle provided by the embodiment of the invention is still applicable.
Fig. 2d is a flowchart of a vehicle cabin control method according to an embodiment of the present invention. As shown in fig. 2d, a vehicle cabin control method includes:
s201, responding to an interaction instruction of a rear seat position user, and acquiring a vehicle cabin image; the interaction instruction is an instruction of using the target ceiling screen by a user.
The back seat mentioned in the embodiment of the invention is a seat on which a user watching the ceiling screen is seated and the front seat is a seat corresponding to a shielding object shielding the user watching the ceiling screen.
In one example, S201 includes: responding to an interaction instruction of a user, and acquiring the seat position of the user; if the seat position of the user is the back seat position, determining that the user is a back seat position user; acquiring a vehicle cabin image; and acquiring the pupil position of the rear seat position user according to the vehicle cabin image.
In one example, the interaction instruction may be an action instruction, a voice instruction, or the like, and the action instruction may be acquired through a camera in the vehicle, the voice instruction may be acquired through a sound sensor, and the interaction instruction may be sent to a corresponding ceiling controller through a voice device, a hand control device (e.g., a touch screen controller, a key controller), or the like, which are installed on the seat. The ceiling screen controller transmits the interaction instruction to the central controller after receiving the interaction instruction, the central controller can determine a seat on which a user sits according to the interaction instruction, and when the user determines that the user is a seat of which the rear row 2 or more is close to the side wall of the cabin, the vehicle cabin image is acquired through a camera in the vehicle to determine whether the view of the user is blocked by a front seat or a passenger of the user.
S202, determining the visual field range of the rear seat position user according to the vehicle cabin image. The visual field range is a space range formed by the pupil position of the rear seat position user and the edge position of the target ceiling screen.
And detecting the pupil position of the rear seat position user according to the vehicle cabin image. And determining the visual field range of the rear seat position user according to the pupil position and the edge position of the target ceiling screen.
In one example, a vehicle cabin image is acquired through a camera installed in a vehicle, and in combination with a pre-established vehicle coordinate system and each seat position coordinate in the vehicle coordinate system, target detection is performed, the eye area position of a rear seat position user is detected, and the coordinate (namely, the pupil center position coordinate) of the pupil position in the vehicle coordinate system is further determined. According to the coordinates of the pupil position in the vehicle coordinate system and the coordinates of the edge position of the target ceiling screen in the vehicle coordinate system, a coordinate range can be determined, and the coordinates of the positions of the points in the space range are included.
S203, detecting whether a shielding object exists in the visual field range according to the vehicle cabin image.
The covering includes the top of the front seat and/or the head of the front seat occupant.
In one possible implementation manner, the detecting whether the view range has a shielding object according to the vehicle cabin image includes: detecting a top position of a front seat and/or a head position of a front seat passenger from the vehicle cabin image; if the top position of the front row of seats is in the visual field range, determining that a shielding object exists in the visual field range; and/or determining that the view range is covered by the shielding object if the head position of the front seat passenger is within the view range.
Along with the above example, according to the vehicle cabin image, the front seat or the front seat passenger is detected, and the coordinates in the vehicle coordinate system of the head of the front seat top or the front seat passenger can be obtained by combining the position coordinates of each seat, and if the coordinates of the head of the front seat top or the front seat passenger in the vehicle coordinate system are in the above coordinate range, it can be determined that the view range has a blocking object, that is, the front seat top or the head of the front seat passenger blocks the view of the ceiling screen by the rear seat position user.
S204, when a shielding object exists in the visual field range, determining a target seat and a corresponding target adjusting parameter according to the range of the adjusting parameter of each seat in the vehicle cabin.
In the case where the top of the front seat or the head of the front seat occupant obstructs the view of the overhead screen by the rear seat position user, the height of the rear seat may be adjusted, or the height or angle of the front seat may be adjusted when the front seat is free of the occupant. It is therefore necessary to determine which seat to adjust, and the specific adjustment parameters, from the range of adjustment parameters for each seat in the vehicle cabin. The specific implementation mode is as follows:
in order to reduce the influence on other passengers as much as possible, the embodiment of the invention firstly determines whether the shielding problem of a rear seat user can be solved only by adjusting the rear seat. Specific implementations are as follows A1-A2.
In one possible implementation manner, the step S204 of determining the target seat and the corresponding target adjustment parameter according to the range of adjustment parameters of each seat in the vehicle cabin includes:
a1, determining whether a first target height exists according to the adjusting range of the height of the rear seat, so that no shielding object exists in the view field range of a user when the height of the rear seat is the first target height.
A2, if the first target height exists, determining that the rear seat is a target seat, and the first target height is a target adjusting parameter.
In one example, the height of the rear seat is adjusted to be 0-20 cm, the current height is 5 cm, pupil position coordinates of the corresponding rear seat position user are calculated when the height of the rear seat is respectively adjusted to be 5-20 cm, then coordinate ranges of the corresponding visual field ranges in a vehicle coordinate system are calculated, if the coordinate ranges are calculated to not contain coordinates of the top of the front seat or coordinates of the head of a front seat passenger when the height of the rear seat is respectively adjusted to be 15-20 cm, the visual field of the rear seat position user (namely, an included angle between a connecting line of the pupil position and the central position of the target ceiling screen) is calculated, and the height of the largest visual field is taken as a target adjusting parameter.
In one example, after the back seat is adjusted in height, an adjusted pupil position of the back seat position user is obtained; adjusting the angle of the target ceiling screen according to the adjusted pupil position and the optimal observation angle; and the optimal observation angle is the angle between a preset connecting line of the pupil position of the rear seat position user and the central position of the target ceiling screen and the target ceiling screen.
The embodiment of the invention further determines whether the front seat has passengers or not under the condition that the problem that the view of the rear seat position user is blocked can not be solved by adjusting the rear seat, and determines whether the problem that the view of the rear seat position user is blocked or not by adjusting the front seat under the condition that the front seat has no passengers. Specific implementations are as follows A3-A4.
A3, if the first target height does not exist, determining whether a target angle and/or a second target height exists according to the angle adjusting range and the height adjusting range of the front seat when the shielding object is the front seat and the front seat has no passengers, and enabling the angle of the front seat to be the target angle and/or the height to be the second target height, wherein no shielding object exists in the view field of the user.
In one example, if the first target height is not present, it is stated that the adjustment of the rear seat height to the maximum adjustment limit is still not possible to solve the occlusion problem. At this time, whether the front row has a passenger or not is detected, and if the front row has no passenger, the coordinates of the top of the front row seat or the coordinates of the head of the front row seat passenger corresponding to the angles and heights in the angle adjustment range and the height adjustment range of the front row seat are calculated, and whether the front row seat is within the field of view of the user or not is judged.
A4, if the target angle and/or the second target height exist, determining that the front seat is the target seat, and determining that the target angle and/or the second target height are target adjusting parameters.
In one example, the front seat is adjusted with a current height of 10 cm, a seat back angle of 90 °, if it is determined that the front seat height is adjusted to 0-6 cm and/or the seat back angle is 0-60 ° without being blocked after calculation, the front seat is adjusted with any value of the height of 0-6 cm and/or any value of the seat back angle of 0-60 ° as a target adjustment parameter.
According to the embodiment of the invention, when passengers are present in the front seat, a mode of adjusting the front seat is not adopted, so that comfort experience of the passengers in the front seat is not affected.
S205, controlling and adjusting the target seat according to the target adjustment parameters.
According to the embodiment of the invention, when a rear seat position user uses the ceiling screen, whether the view of the ceiling screen is blocked or not by the rear seat position user is detected according to the vehicle cabin image, when the view of the rear seat position user is blocked, the target seat and the target adjusting parameters which need to be adjusted are determined according to the seat adjusting parameters in the cabin, and the target seat is controlled and adjusted according to the target adjusting parameters, so that no blocking object exists in the view range of the rear seat position user, for example, the rear seat position user seat is controlled and adjusted to change the view of the user, or the front seat is adjusted to remove the blocking object from the view range of the rear seat position user, and further the problem that the rear seat audience is blocked when watching the ceiling screen is automatically solved, and the user experience is improved. The problem that a rear-row audience watches the ceiling screen and is shielded can be automatically solved, and user experience is improved.
The embodiment of the invention also provides an auxiliary technical scheme to solve the shielding problem under the condition that the problem that the view of a user at the position of the back row seat is blocked can not be solved by adjusting the back row seat or the front row seat. Specific implementations are as follows B1-B2.
In one possible implementation, the method further includes: b1, if the target angle and/or the second target height do not exist, determining whether the adjacent seat position of the rear seat position user has no passengers or not according to the vehicle cabin image; if no passenger exists at the adjacent seat position, generating first prompt information; the first prompting information is used for prompting the rear seat position user to move to the adjacent seat position.
In the embodiment of the invention, if the calculation finds that the shielding problem can not be solved by adjusting the back seat and the front seat. Whether the blocked back seat position user has passengers in the adjacent seats or not can be detected through the vehicle cabin image, and if the user cannot be prompted to shift to the adjacent seats, the field of view of the user is changed, so that the blocking problem is solved. If there is a passenger in the adjacent seat, no indication of displacement is made so as not to cause complaints from the passenger because of the large displacement across the position.
In one possible implementation, the method further includes: b2, if passengers exist at the adjacent seat positions, generating second prompt information and controlling the non-target ceiling screen to display target contents; the second prompting information is used for prompting the rear seat position user to watch a non-target ceiling screen; the target content is content to be watched by the rear seat position user.
According to the embodiment of the invention, under the condition that the problem that the view of a user at the back seat position is blocked in a displacement mode cannot be solved, a passenger is prompted to watch the non-target ceiling screen, and the view range of the user is changed, so that the blocking problem is solved.
The specific implementation mode for controlling the non-target ceiling screen to display target content comprises the following steps:
b21, if the non-target ceiling screen is in an unopened state, controlling to open the non-target ceiling screen and displaying target content; if the non-target ceiling screen is in an open state, controlling the non-target ceiling screen to be partitioned into a plurality of partition screens, and determining an amplification factor according to the position of the rear seat position user and the number of the partition screens; determining the resolution of the target partition screen according to the amplification factor; displaying the target content in the target partition screen according to the resolution ratio of the target partition screen; the amplification factor is the ratio of the display resolution of the partitioned screen to the display resolution of the non-partitioned screen; the target partition screen is a partition screen corresponding to the rear seat position user.
After the passengers in the adjacent seats are determined, the current state of the non-target ceiling screen is obtained, if the non-target ceiling screen is in an open state, other passengers are shown to watch the non-target ceiling screen, and therefore the non-target ceiling screen needs to be subjected to screen division multiplexing so as to meet the watching requirements of different passengers. The amplification factors corresponding to different seat positions under the condition of different partition screen numbers can be preset, and under the condition of unchanged partition screen numbers, the amplification factors corresponding to different user seat positions are different, namely the amplification factor is larger when the user seat positions are closer to the rear, namely the horizontal distance between the user positions and the central position of the non-target ceiling screen is larger. Under the condition that the position of the user seat is unchanged, the more the number of the partition screens is, the smaller the area of each partition screen is, the larger the corresponding amplification factor of the position of the user seat is, and the larger the corresponding display resolution of the partition screen is.
According to the embodiment, the amplification factor is determined according to the position of the user and the number of the subareas, so that the resolution of the subarea screen is controlled, and the screen content can still be clearly observed by the remote user.
In one example, to solve the problem that the view of the target ceiling (left ceiling) is blocked for the rear 3 left seat users of the vehicle and the rear 4 left seat users, all adopt a mode of using a non-target ceiling (right ceiling), and the target ceiling (right ceiling) is watched by the rear 4 right seat users. At this time, the right side ceiling screen is divided into 3 partition screens, the distance between the rear 4 rows of left seat positions and the non-target ceiling screen center position is greater than the distance between the rear 3 rows of left seat positions and the non-target ceiling screen center position, the magnification factor a1 corresponding to the rear 4 rows of left seat positions is greater than the magnification factor b1 corresponding to the rear 3 rows of left seat positions, the magnification factor c1 corresponding to the users of the rear 4 rows of right seats is smaller than or equal to a1, and the partition screen display resolution m1 corresponding to the users of the rear 4 rows of left seats is greater than the partition screen display resolution m2 corresponding to the users of the rear 3 rows of left seats. The partition screen display resolution m3 of the users of the rear 4-row right-side seats is smaller than or equal to the partition screen display resolution m1 corresponding to the users of the rear 4-row left-side seats.
In one example, the problem of a user of the rear 4 left seat looking at the target ceiling (left ceiling) being obscured is solved by adjusting the seat, only the rear 3 left seat users solve the obscuration problem by using non-target ceiling (right ceiling), while a user of the rear 4 right seat is looking at their target ceiling (right ceiling). At this time, the right side ceiling screen is divided into 2 divided screens, each divided screen has an area larger than that in the above example, the magnification coefficient b2 corresponding to the rear 3 rows of left side seat positions is smaller than b1 in the above example, and the display resolution n1 of the corresponding divided screen is smaller than m2 in the above example. The magnification factor c2 corresponding to the user of the rear 4-row right seat is smaller than c1 in the above example, and the display resolution n3 of the corresponding partition screen is smaller than m3 in the above example.
According to the embodiment of the invention, whether the user has a ceiling screen or not is responded to the observation requirement of the rear seat position, whether the user currently has a view shielding problem is analyzed in real time according to the acquired image information, the view shielding problem of the user is solved by providing a rear seat or front seat adjusting mode, and the shielding problem is solved by an auxiliary mode under the condition that the seat adjusting mode can not solve the problem. And (3) calculating and analyzing according to the positions of the seats, the adjustment parameters of the seats and the positions of passengers, determining the optimal solution, and executing the optimal solution. The method is carried out automatically after calculation, unnecessary adjusting actions and influences on other passengers are reduced as much as possible, and the best adjusting effect is achieved as soon as possible.
Fig. 3 is a block diagram of a vehicle cabin control system according to an embodiment of the present invention. As shown in fig. 3, the system includes:
a cabin image obtaining module 301, configured to obtain a vehicle cabin image in response to an interaction instruction of a user; the interaction instruction is an instruction of using the target ceiling screen by a user;
an adjustment target determining module 302, configured to determine a target seat and a corresponding target adjustment parameter according to the vehicle cabin image and a range of adjustment parameters of each seat in the vehicle cabin;
the adjusting module 303 is configured to control and adjust the target seat according to the target adjusting parameter.
The cabin image obtaining module 301 is specifically configured to obtain a cabin image of a vehicle in response to an interaction instruction of a rear seat position user;
the adjustment target determination module 302 includes:
the visual field range determining module is used for determining the visual field range of the rear seat position user according to the vehicle cabin image; the visual field range is a space range formed by the pupil position of the rear seat position user and the edge position of the target ceiling screen;
the shielding detection module is used for detecting whether a shielding object exists in the visual field range according to the vehicle cabin image;
And the adjusting target determining sub-module is used for determining a target seat and corresponding target adjusting parameters according to the range of the adjusting parameters of each seat in the vehicle seat cabin when the shielding object exists in the visual field range.
In one possible implementation, the adjustment target determination submodule is specifically configured to: determining whether a first target height exists according to the adjustment range of the height of the rear seat, so that no shielding object exists in the visual field range of a user when the height of the rear seat is the first target height;
and if the first target height exists, determining that the rear seat is a target seat, wherein the first target height is a target adjusting parameter.
In one possible implementation, the adjustment target determination submodule is specifically configured to:
if the first target height does not exist, determining whether a target angle and/or a second target height exists according to an angle adjusting range and a height adjusting range of the front seat when the shielding object is a front seat and the front seat has no passengers, and enabling the angle of the front seat to be the target angle and/or the height to be the second target height, wherein the shielding object does not exist in the visual field range of the user; and if the target angle and/or the second target height exist, determining that the front seat is the target seat, and determining that the target angle and/or the second target height are target adjustment parameters.
In one possible implementation, the system further includes: the auxiliary adjusting module is used for determining whether the adjacent seat position of the rear seat position user has no passengers according to the vehicle cabin image if the target angle and/or the second target height do not exist; if no passenger exists at the adjacent seat position, generating first prompt information; the first prompting information is used for prompting the rear seat position user to move to the adjacent seat position.
In a possible implementation manner, the auxiliary adjusting module is further configured to generate a second prompt message and control the non-target ceiling screen to display target content if the passenger exists at the adjacent seat position; the second prompting information is used for prompting the rear seat position user to watch a non-target ceiling screen; the target content is content to be watched by the rear seat position user.
In a possible implementation manner, the auxiliary adjusting module is specifically configured to control the non-target ceiling screen to be partitioned into a plurality of partition screens if the non-target ceiling screen is in an open state, and determine an amplification factor according to the position of the rear seat position user and the number of partition screens; determining the resolution of the target partition screen according to the amplification factor; displaying the target content in the target partition screen according to the resolution ratio of the target partition screen; the amplification factor is the ratio of the display resolution of the partitioned screen to the display resolution of the non-partitioned screen; the target partition screen is a partition screen corresponding to the rear seat position user.
An embodiment of the present invention provides a vehicle including: a controller and two ceiling screens;
the upper edges of the two ceiling screens are fixed at the top of the vehicle cabin, and the upper edges of the two ceiling screens are positioned on the same straight line perpendicular to the running direction of the vehicle; the controller is used for executing the vehicle cabin control method according to the embodiment of the invention.
An embodiment of the present invention provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the vehicle cabin control method according to the embodiment of the present invention.
In practical applications, the computer-readable storage medium may take the form of any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this embodiment, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
As shown in fig. 4, a schematic structural diagram of a computer device is provided in an embodiment of the present invention. The computer device is applicable as a vehicle cabin control device. The computer device 12 shown in fig. 4 is merely an example and should not be construed as limiting the functionality and scope of use of embodiments of the present invention.
As shown in FIG. 4, the computer device 12 is in the form of a general purpose computing device. Components of computer device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, a bus 18 that connects the various system components, including the system memory 28 and the processing units 16.
Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, and a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, micro channel architecture (MAC) bus, enhanced ISA bus, video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.
Computer device 12 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by computer device 12 and includes both volatile and nonvolatile media, removable and non-removable media.
The system memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM) 30 and/or cache memory 32. The computer device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from or write to non-removable, nonvolatile magnetic media (not shown in FIG. 4, commonly referred to as a "hard disk drive"). Although not shown in fig. 4, a magnetic disk drive for reading from and writing to a removable non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In such cases, each drive may be coupled to bus 18 through one or more data medium interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to carry out the functions of embodiments of the invention.
A program/utility 40 having a set (at least one) of program modules 42 may be stored in, for example, memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment. Program modules 42 generally perform the functions and/or methods of the embodiments described herein.
The computer device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), one or more devices that enable a user to interact with the computer device 12, and/or any devices (e.g., network card, modem, etc.) that enable the computer device 12 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 22. Moreover, computer device 12 may also communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN) and/or a public network, such as the Internet, through network adapter 20. As shown in fig. 4, the network adapter 20 communicates with other modules of the computer device 12 via the bus 18. It should be appreciated that although not shown in fig. 4, other hardware and/or software modules may be used in connection with computer device 12, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.
The processor unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, for example, to implement the vehicle cabin control method provided by the embodiment of the present invention.
It should be noted that the term "comprising" and variants thereof as used herein is open ended, i.e., including, but not limited to. The term "based on" is based at least in part on. The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments. Related definitions of other terms will be given in the description below.
It should be noted that the terms "first," "second," and the like herein are merely used for distinguishing between different devices, modules, or units and not for limiting the order or interdependence of the functions performed by such devices, modules, or units.
It is to be understood that, although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are example forms of implementing the claims.
While several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the invention. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
The above description is only illustrative of the preferred embodiments of the present invention and of the principles of the technology employed. It will be appreciated by persons skilled in the art that the scope of the disclosure referred to in the present invention is not limited to the specific combinations of technical features described above, but also covers other technical features formed by any combination of the technical features described above or their equivalents without departing from the spirit of the disclosure. Such as the above-mentioned features and the technical features disclosed in the present invention (but not limited to) having similar functions are replaced with each other.

Claims (10)

1. A vehicle cabin control method, characterized in that the method comprises:
responding to an interaction instruction of a user, and acquiring a vehicle cabin image; the interaction instruction is an instruction of using the target ceiling screen by a user;
determining a target seat and corresponding target adjusting parameters according to the vehicle cabin image and the range of the adjusting parameters of each seat in the vehicle cabin;
and controlling and adjusting the target seat according to the target adjusting parameters.
2. The method of claim 1, wherein the user interaction instruction is a rear seat position user interaction instruction, and the determining the target seat and the corresponding target adjustment parameter according to the vehicle cabin image and the range of adjustment parameters of each seat in the vehicle cabin comprises:
Determining a visual field range of the rear seat position user according to the vehicle cabin image; the visual field range is a space range formed by the pupil position of the rear seat position user and the edge position of the target ceiling screen;
detecting whether a shielding object exists in the visual field range according to the vehicle cabin image;
and when the shielding object is arranged in the visual field range, determining the target seat and the corresponding target adjusting parameters according to the range of the adjusting parameters of each seat in the vehicle cabin.
3. The method of claim 2, wherein determining the target seat and the corresponding target adjustment parameter based on the range of adjustment parameters for each seat in the vehicle cabin comprises: determining whether a first target height exists according to the adjustment range of the height of the rear seat, so that no shielding object exists in the visual field range of a user when the height of the rear seat is the first target height;
and if the first target height exists, determining that the rear seat is a target seat, wherein the first target height is a target adjusting parameter.
4. A method according to claim 3, wherein the determining the target seat and the corresponding target adjustment parameter based on the range of adjustment parameters for each seat in the vehicle cabin further comprises:
If the first target height does not exist, determining whether a target angle and/or a second target height exists according to an angle adjusting range and a height adjusting range of the front seat when the shielding object is a front seat and the front seat has no passengers, and enabling the angle of the front seat to be the target angle and/or the height to be the second target height, wherein the shielding object does not exist in the visual field range of the user;
and if the target angle and/or the second target height exist, determining that the front seat is the target seat, and determining that the target angle and/or the second target height are target adjustment parameters.
5. The method according to claim 4, wherein the method further comprises:
if the target angle and/or the second target height do not exist, determining whether the adjacent seat position of the rear seat position user has no passengers or not according to the vehicle cabin image;
if no passenger exists at the adjacent seat position, generating first prompt information; the first prompting information is used for prompting the rear seat position user to move to the adjacent seat position.
6. The method of claim 5, wherein the method further comprises: if passengers exist at the adjacent seat positions, generating second prompt information and controlling the non-target ceiling screen to display target contents; the second prompting information is used for prompting the rear seat position user to watch a non-target ceiling screen; the target content is content to be watched by the rear seat position user.
7. The method of claim 6, wherein the controlling the non-target ceiling screen to display target content comprises:
if the non-target ceiling screen is in an unopened state, controlling to open the non-target ceiling screen and displaying target content;
if the non-target ceiling screen is in an open state, controlling the non-target ceiling screen to be partitioned into a plurality of partition screens, and determining an amplification factor according to the position of the rear seat and the number of the partition screens; determining the resolution of the target partition screen according to the amplification factor; displaying the target content in the target partition screen according to the resolution ratio of the target partition screen; the amplification factor is the ratio of the display resolution of the partitioned screen to the display resolution of the non-partitioned screen; the target partition screen is a partition screen corresponding to the rear seat position user.
8. A vehicle cabin control system, the system comprising:
the cabin image acquisition module is used for responding to the interaction instruction of the user and acquiring a vehicle cabin image; the interaction instruction is an instruction of using the target ceiling screen by a user;
the adjusting target determining module is used for determining a target seat and corresponding target adjusting parameters according to the vehicle cabin image and the range of the adjusting parameters of each seat in the vehicle cabin;
And the adjusting module is used for controlling and adjusting the target seat according to the target adjusting parameters.
9. A vehicle, characterized by comprising: a controller and two ceiling screens;
the upper edges of the two ceiling screens are fixed at the top of the vehicle cabin, and the upper edges of the two ceiling screens are positioned on the same straight line perpendicular to the running direction of the vehicle;
the controller is configured to execute the vehicle cabin control method according to any one of claims 1 to 7.
10. A vehicle cabin control apparatus characterized by comprising: a memory, a processor, and a computer program stored on the memory and executable on the processor, which processor, when executing the computer program, implements the vehicle cabin control method according to any one of claims 1-7.
CN202311488095.1A 2023-11-09 2023-11-09 Vehicle cabin control method, system, equipment and vehicle Pending CN117261705A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311488095.1A CN117261705A (en) 2023-11-09 2023-11-09 Vehicle cabin control method, system, equipment and vehicle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311488095.1A CN117261705A (en) 2023-11-09 2023-11-09 Vehicle cabin control method, system, equipment and vehicle

Publications (1)

Publication Number Publication Date
CN117261705A true CN117261705A (en) 2023-12-22

Family

ID=89219863

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311488095.1A Pending CN117261705A (en) 2023-11-09 2023-11-09 Vehicle cabin control method, system, equipment and vehicle

Country Status (1)

Country Link
CN (1) CN117261705A (en)

Similar Documents

Publication Publication Date Title
US7557800B2 (en) Display apparatus, and method for controlling the same
US11573678B2 (en) Content sharing system and method
US7969423B2 (en) Display control system, operation input apparatus, and display control method
US20080129684A1 (en) Display system having viewer distraction disable and method
US20070262953A1 (en) Multiple-view display system having user manipulation control and method
KR101309401B1 (en) Image display system for displaying different images on separate display devices
US20070182721A1 (en) Display Device, User Interface, and Method for Providing Menus
EP1564582A2 (en) Display system having electronically controlled viewing window
WO2017075386A1 (en) Content sharing system and method
US11034242B2 (en) Motor vehicle with a display arrangement and method for operating a display arrangement of a motor vehicle
JP2013125540A (en) Method and apparatus for executing menu of vehicle
JP2008195142A (en) Operation supporting device and method for on-vehicle equipment
JPH10222287A (en) Information input device
JP2008195141A (en) Operation supporting device and method for on-vehicle equipment
JP2019182150A (en) Vehicular display device
CN113459975B (en) Intelligent cabin system
CN117261705A (en) Vehicle cabin control method, system, equipment and vehicle
JP2007212342A (en) Display device for vehicle
US11068054B2 (en) Vehicle and control method thereof
CN111638786A (en) Display control method, device and equipment of vehicle-mounted rear projection display system and storage medium
EP4215401A1 (en) System for controlling vehicle display
KR20160140033A (en) A transparent display device for a vehicle
CN115373539A (en) Display system
TW201926050A (en) Vehicle multi-display control system and vehicle multi-display control method
CN106289305A (en) Display device for mounting on vehicle

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination