CN113071511A - Method and device for displaying reverse image, electronic equipment and storage medium - Google Patents
Method and device for displaying reverse image, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113071511A CN113071511A CN202110429813.2A CN202110429813A CN113071511A CN 113071511 A CN113071511 A CN 113071511A CN 202110429813 A CN202110429813 A CN 202110429813A CN 113071511 A CN113071511 A CN 113071511A
- Authority
- CN
- China
- Prior art keywords
- microprocessor
- reversing
- image
- instruction
- vehicle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000002441 reversible effect Effects 0.000 title claims abstract description 78
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000003384 imaging method Methods 0.000 claims abstract description 36
- 230000001960 triggered effect Effects 0.000 claims abstract description 28
- 230000006870 function Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000002045 lasting effect Effects 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
- B60W30/08—Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/146—Display means
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- User Interface Of Digital Computer (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
Abstract
The invention discloses a method and a device for displaying a reverse image, electronic equipment and a storage medium, wherein the method comprises the following steps: when the vehicle is detected to be in a cold starting state and the reversing control is detected to be triggered, a reversing instruction sent to the first microprocessor is generated; receiving the reversing instruction based on the first microprocessor, and sending the reversing instruction to a second microprocessor so that the second microprocessor sends a shooting instruction to a camera device; the camera device shoots the reversing image in the target area based on the received shooting instruction, and sends the reversing image to the second microprocessor, so that the reversing image is displayed on the display interface by the imaging system arranged in the second microprocessor, the reversing image is obtained by the second microprocessor in the cold starting state of the vehicle, and the reversing image is displayed on the display interface, and the problem that the reversing image is displayed slowly due to slow starting of an android system in the cold starting state of the existing vehicle is solved.
Description
Technical Field
The embodiment of the invention relates to the technical field of vehicles, in particular to a method and a device for displaying a reverse image, electronic equipment and a storage medium.
Background
Nowadays, for the design of the backing function of the vehicle, the backing video is an important part, and a user can conveniently check the road condition behind the vehicle in the backing process. However, in a cold start state of a vehicle based on the android system, the start time is long, correspondingly, the display waiting time of the reverse video is prolonged, a user needs to perform a reverse operation in a state that the vehicle is just started, the vehicle cannot display the reverse video in time, and the risk of accidents caused by the fact that the user backs the vehicle when the user cannot view detailed road conditions behind the vehicle is possibly caused.
Disclosure of Invention
The embodiment of the invention provides a method and a device for displaying a car backing image, electronic equipment and a storage medium, which are used for rapidly displaying the car backing image in a cold start state of an automobile with an android system and improving the speed of displaying the car backing image.
In a first aspect, an embodiment of the present invention provides a method for displaying a car backing image, where the method includes:
when the vehicle is detected to be in a cold starting state and the reversing control is detected to be triggered, a reversing instruction sent to the first microprocessor is generated;
receiving the reversing instruction based on the first microprocessor, and sending the reversing instruction to a second microprocessor so that the second microprocessor sends a shooting instruction to a camera device;
the camera device shoots a reversing image in a target area based on the received shooting instruction, and sends the reversing image to the second microprocessor, so that an imaging system arranged in the second microprocessor displays the reversing image on a display interface.
In a second aspect, an embodiment of the present invention further provides a reverse image display device, where the device includes:
the reversing instruction generating module is used for generating a reversing instruction sent to the first microprocessor when detecting that the vehicle is in a cold starting state and detecting that a reversing control is triggered;
the shooting instruction sending module is used for receiving the reversing instruction based on the first microprocessor and sending the reversing instruction to the second microprocessor so as to enable the second microprocessor to send a shooting instruction to the camera device;
and the reversing image display module is used for shooting a reversing image in a target area by the camera device based on the received shooting instruction and sending the reversing image to the second microprocessor so that an imaging system arranged in the second microprocessor displays the reversing image on a display interface.
In a third aspect, an embodiment of the present invention further provides an electronic device, where the electronic device includes:
one or more processors;
a storage device for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors implement the method for displaying the reverse image according to any embodiment of the present invention.
In a fourth aspect, an embodiment of the present invention further provides a storage medium containing computer-executable instructions, where the computer-executable instructions are executed by a computer processor to perform the method for displaying a reverse image according to any one of the embodiments of the present invention.
According to the technical scheme of the embodiment of the invention, when the vehicle is detected to be in a cold start state and the reversing control is detected to be triggered, the reversing instruction sent to the first microprocessor is generated, the reversing instruction is sent to the second microprocessor based on the reversing instruction received by the first microprocessor, the second microprocessor generates a shooting instruction based on the reversing instruction, and the shooting instruction is sent to the camera device, so that the camera device shoots the reversing image in the target area based on the received shooting instruction. And then, sending the reverse image to a second microprocessor so that an imaging system arranged in the second microprocessor displays the reverse image on a display interface. According to the technical scheme of the embodiment of the invention, the reverse image is acquired through the second microprocessor in the cold starting state of the vehicle, and the reverse image is displayed on the display interface. The problem of current vehicle cold start, the android system starts slowly and causes the image of backing a car to show slowly is solved.
Drawings
In order to more clearly illustrate the technical solutions of the exemplary embodiments of the present invention, a brief description is given below of the drawings used in describing the embodiments. It should be clear that the described figures are only views of some of the embodiments of the invention to be described, not all, and that for a person skilled in the art, other figures can be derived from these figures without inventive effort.
Fig. 1 is a schematic flowchart of a method for displaying a car-backing image according to a first embodiment of the present invention;
fig. 2 is a flowchart illustrating a method for displaying a car backing image according to a second embodiment of the present invention;
fig. 3 is a schematic view of a method for displaying a reverse image according to a third embodiment of the present invention;
FIG. 4 is a schematic diagram of a start sequence of a processor during a cold start of a vehicle according to a third embodiment of the present invention;
fig. 5 is a schematic structural diagram of a reverse image display device according to a fourth embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device in a fifth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
Fig. 1 is a schematic flow chart of a method for displaying a car backing image according to an embodiment of the present invention, where the embodiment is applicable to a situation where a car backing control is triggered to display a car backing image when an automobile is cold started.
Before explaining the technical solution of the embodiment of the present invention, an application scenario of the embodiment of the present invention is first exemplarily explained: the vehicle reversing image display method provided by the embodiment of the invention is applied to the vehicle with the android system, and when the vehicle is in cold start and performs reversing operation, the reversing image is displayed.
As shown in fig. 1, the method for displaying a car-backing image according to the embodiment of the present invention specifically includes the following steps:
and S110, generating a reversing instruction sent to the first microprocessor when the vehicle is detected to be in a cold starting state and the reversing control is detected to be triggered.
The cold start of the vehicle means that the vehicle is started when the flameout duration of an engine in the vehicle is longer than a preset duration or the temperature of the engine is reduced to be lower than the normal working temperature. For example, when the ambient temperature is lower than minus 5 degrees, and the engine of the vehicle is turned off for about 8 hours, the temperature of the engine is reduced to be lower than the normal operating temperature, and at this time, the vehicle is started in a cold state. And after the vehicle is flamed out, the android system enters a shutdown state, and when the vehicle is in cold start, the android system is started. The reversing control is a function key which can generate a reversing instruction in the vehicle. The reverse control may be in the form of hardware, such as a key on a central control display console in the vehicle, or in the form of software, such as a reverse gear based on an operation handle triggers the reverse control to generate a reverse instruction. The first microprocessor is used for processing various instructions generated by the trigger function control in the vehicle and analyzing and processing the instructions. The first microprocessor may be a Microcontroller Unit (MCU). The instructions include broadcast playing instructions, backing instructions, call making instructions, and the like.
Specifically, when the vehicle is detected to be in a cold start state and the reversing control is detected to be triggered, a reversing instruction is generated based on the triggering operation of the reversing control and is sent to the first microprocessor, so that the first microprocessor performs subsequent operation based on the reversing instruction.
In the embodiment of the present invention, at least two ways of detecting that the vehicle is in a cold start state and detecting that the reversing control is triggered are included, and optionally, when the vehicle is detected to be in a cold start state and the reversing control is detected to be triggered, the generating of the reversing instruction sent to the first microprocessor includes: and when the vehicle is detected to be in a cold starting state and the reversing control is detected to be triggered within a preset time length, a reversing instruction sent to the first microprocessor is generated.
The preset duration refers to the starting duration of an android system of the vehicle. And in the preset time length, the android system is in the starting process and is not started yet.
Specifically, when the cold start of the vehicle is detected, the triggering operation of the reversing control is detected within a preset time, a reversing instruction is generated based on the triggering operation, and the reversing instruction is sent to the first microprocessor, so that the first microprocessor performs subsequent operations based on the reversing instruction.
Optionally, when the reversing control is detected to be triggered, target pin information corresponding to the reversing control is detected; and when the level of the target pin information is in a preset level state, generating a reversing instruction sent to the first microprocessor.
The pin refers to a pin leading from an internal circuit to an external circuit on the chip. The target pin is a pin which is in one-to-one correspondence with the backing control, triggers the backing control and sends a level signal to the target pin so as to change the level signal of the target pin. The level states include a high level and a low level. The preset level state includes a high level lasting for a preset period, an alternate signal of a high level and a low level forming for a preset period, and the like.
Specifically, when the reversing control is detected to be triggered, target pin information corresponding to reversing is detected, and when the target pin information is in a preset level state, a reversing instruction is generated and sent to the first microprocessor. It should be noted that, after the vehicle is started, the level state of the target pin needs to be continuously monitored.
In the embodiment of the present invention, after the detecting that the vehicle is in the cold start state, the method further includes: and guiding the starting of a second microprocessor based on the first microprocessor so that the started second microprocessor guides the starting of the imaging system.
The imaging system is a system for acquiring a reverse image and displaying the reverse image on a display interface. Such as a Rear View imaging system (real View Camera, RVC). The second microprocessor is a system with a reverse function, for example, an RVC is provided in an R7 processor in the SOC to acquire and display a reverse image.
Specifically, when the automobile is in cold start, power is supplied to the first microprocessor so that the first microprocessor is started, and then the first microprocessor guides the second microprocessor to be started so that the second microprocessor guides the imaging system to be started.
And S120, receiving the reversing instruction based on the first microprocessor, and sending the reversing instruction to a second microprocessor so that the second microprocessor sends a shooting instruction to a camera device.
The camera device is a device mounted on a vehicle and having a function of capturing an image or a video. The camera device may be understood as a camera, and it should be understood that one or more camera devices may be installed on the vehicle, and the number of the camera devices is not specifically limited herein. The shooting command is a command to be sent to the imaging device to shoot a video.
Specifically, the first microprocessor sends the backing instruction to the second microprocessor so that the second microprocessor sends a shooting instruction to the camera device based on the backing instruction, and the camera device can perform subsequent image shooting work together with the shooting instruction.
It should be noted that the vehicle in the embodiment of the present invention is provided with an android system, and is also provided with a system for acquiring and displaying a reversing image based on a reversing instruction, when the vehicle is cold started and the android system is in a starting process, and a reversing instruction generated based on a triggering operation is detected when a triggering operation of a reversing control is detected, the reversing instruction is sent to the first microprocessor, and the first microprocessor sends the reversing instruction to the second microprocessor.
S130, the camera device shoots a reversing image in a target area based on the received shooting instruction, and sends the reversing image to the second microprocessor, so that an imaging system arranged in the second microprocessor displays the reversing image on a display interface.
The target area refers to an area related to a reversing path. The reversing image in the target area is acquired, so that a user can conveniently reverse based on the reversing image, and the safety and the accuracy of reversing are improved. The image of backing a car is an image related to backing a car, and may be an image of the periphery of the car or only an image of the back of the car. The reverse image comprises continuous multiframe images to form a reverse video. The display interface is an interface with a display function, and can be a display screen on a vehicle center console or a display screen which is independently arranged based on a reversing system.
Specifically, the camera device obtains a reversing image in the target area based on the received shooting instruction, and sends the reversing image to the second microprocessor, and an imaging system in the second microprocessor displays the reversing image on a display interface.
It should be noted that, when a plurality of image capturing devices are provided, the reverse images at different angles are acquired in the target area, the reverse images captured by the plurality of image capturing devices are all sent to the second microprocessor, and the second microprocessor splices and integrates the images to form an image finally displayed on the display interface. For example, the images may be merged and integrated by merging and integrating a plurality of image frames at the same time in accordance with the position information of the image pickup device that acquired the image frames.
Optionally, the first microprocessor is an MCU, the second microprocessor is an R7 processor, the ROS system is provided in the R7 processor, and the imaging system is provided in the ROS system.
The ROS System is a Robot Operating System (Robot Operating System). ROS can quick start, and the start duration of ROS system is far less than the start duration of tall and erect system, consequently, when the vehicle cold start, detects the trigger operation of the control of backing a car, and tall and erect system of ann at this moment has not completely started yet, can't realize when MCU receives the instruction of backing a car, will backing a car instruction and send R7 treater, and imaging system in the R7 treater can be fast with the image display of backing a car on display interface, for example, imaging system can back a car APP.
According to the technical scheme of the embodiment of the invention, when the vehicle is detected to be in a cold start state and the reversing control is detected to be triggered, the reversing instruction sent to the first microprocessor is generated, the reversing instruction is sent to the second microprocessor based on the reversing instruction received by the first microprocessor, the second microprocessor generates a shooting instruction based on the reversing instruction, and the shooting instruction is sent to the camera device, so that the camera device shoots the reversing image in the target area based on the received shooting instruction. And then, sending the reverse image to a second microprocessor so that an imaging system arranged in the second microprocessor displays the reverse image on a display interface. According to the technical scheme of the embodiment of the invention, the reverse image is acquired through the second microprocessor in the cold starting state of the vehicle, and the reverse image is displayed on the display interface. The problem of current vehicle cold start, the android system starts slowly and causes the image of backing a car to show slowly is solved.
Example two
Fig. 2 is a schematic flow chart of a method for displaying a reverse image according to an embodiment of the present invention, where the embodiment of the present invention refines step 130 on the basis of the alternative solutions of the above embodiments, and plays a prompt message while displaying a reverse image in step 130. The detailed refinement process will be explained in detail in the embodiment of the present invention. Technical terms identical or similar to those of the above embodiments will not be described again.
As shown in fig. 2, the method for displaying a car backing image according to the embodiment of the present invention specifically includes the following steps:
s210, when the vehicle is detected to be in a cold starting state and the reversing control is detected to be triggered, a reversing instruction sent to the first microprocessor is generated.
And S220, receiving the reversing instruction based on the first microprocessor, and sending the reversing instruction to a second microprocessor so that the second microprocessor sends a shooting instruction to a camera device.
And S230, shooting a reversing image in a target area by the camera device based on the received shooting instruction, and sending the reversing image to the second microprocessor so that an imaging system arranged in the second microprocessor displays the reversing image on a display interface.
S240, acquiring radar ranging information on the bus based on the second microprocessor, and playing prompt information corresponding to the radar ranging information based on a preset playing device.
The bus is used for information transmission, and the information transmission is faster in a bus mode. Alternatively, the bus may be a CAN bus. The radar ranging information refers to distance information between a current vehicle and an object in front of and/or behind the current vehicle (hereinafter, the front of the vehicle is simply referred to as the front, and the rear of the vehicle is simply referred to as the rear) acquired by a reverse radar when the current vehicle and the object in front of and/or behind the vehicle are within a preset distance range. The playing device is a device for playing audio, and may be a meter with a speaker (the meter is set in association with the imaging system) or a playing device set separately in association with the imaging system. The prompt message may be a sound prompt at intervals, such as a sound effect like a droplet. The prompt message may also be a voice broadcast of the distance between the current vehicle and the front object and/or the rear object, for example, the distance between the current vehicle and the rear object is 1.5 meters. Optionally, when the prompt sound is a sound effect, the sound effect at a long time interval can be set when the distance between the current vehicle and the front object and/or the rear object is greater than the preset distance, and the sound effect at a short time interval can be set when the distance between the current vehicle and the front object and/or the rear object is less than or equal to the preset distance. Or whether the distance between the current vehicle and the front object and/or the rear object is larger than the preset distance or not is distinguished according to the difference of sound volume, so that the user can be reminded conveniently.
Specifically, based on the radar range finding information on the second microprocessor acquisition bus, later, there is the one-to-one correspondence between radar range finding information and the prompt message, for example, when radar range finding information is less than 1 meter, the prompt message is the continuous prompt tone of "dripping", and the interval broadcast time of prompt tone is 0.2 seconds. When the radar ranging information is greater than or equal to 1 meter and less than 2 meters, the prompt information is a continuous prompt tone of 'beep', and the interval playing of the prompt tone is 0.5 second. And determining corresponding prompt information according to the currently acquired radar ranging information, and sending the prompt information to the playing device by the second microprocessor so as to play by the playing device. Or the second microprocessor sends the radar ranging information to the playing device, the playing device determines the prompt information based on the corresponding relation and the current radar ranging information, and the prompt information is played. Prompt information is generated based on the radar ranging information, and the prompt information is played based on the playing device so as to prompt a user in the vehicle, provide service for the backing operation of the user and improve user experience.
In this embodiment of the present invention, the acquiring, based on the second microprocessor, radar ranging information on a bus, and playing, based on a preset playing device, prompt information corresponding to the radar ranging information includes: when detecting that the android system is started and the playing device plays the prompt information, after the prompt information is played, the playing device is closed, so that the audio information is played based on the android system when the audio information is (re-) received.
The audio information is prompt information generated when the reversing control is detected to be triggered again after the reversing is finished.
Specifically, when the operation of backing the vehicle in the cold start state of the vehicle is finished, the prompt message is played to be finished, and the playing device is turned off. When the control that backs a car is detected once more to trigger, the image of backing a car is shown through the imaging system of second microprocessor, but through the tall and erect system broadcast audio information (prompt message), because the volume that play device's that sets up in the tall and erect system loudspeaker etc. set up volume etc. and are superior to the instrument and send the volume of audio frequency to the tone quality effect is better, so through the play device in the tall and erect system, user experience feels better.
According to the technical scheme of the embodiment of the invention, when the vehicle is detected to be in a cold start state and the reversing control is detected to be triggered, the reversing instruction sent to the first microprocessor is generated, the reversing instruction is sent to the second microprocessor based on the reversing instruction received by the first microprocessor, the second microprocessor generates a shooting instruction based on the reversing instruction, and the shooting instruction is sent to the camera device, so that the camera device shoots the reversing image in the target area based on the received shooting instruction. And then, sending the reverse image to a second microprocessor so that an imaging system arranged in the second microprocessor displays the reverse image on a display interface. And acquiring radar ranging information on the bus based on the second microprocessor, and playing prompt information corresponding to the radar ranging information based on the playing device. According to the technical scheme of the embodiment of the invention, the reverse image is acquired through the second microprocessor in the cold starting state of the vehicle, and the reverse image is displayed on the display interface. And different prompt information is determined based on different radar ranging information and is played based on the playing device so as to prompt the user. The embodiment of the invention solves the problem that the reversing image display is slow due to slow starting of an android system when the existing vehicle is in cold start, and realizes fast imaging during reversing and prompt information sending through the playing device, thereby assisting a user in reversing from the perspective of images and sound and reducing the occurrence of accidents.
EXAMPLE III
Fig. 3 is a schematic view of a method for displaying a reverse image according to an embodiment of the present invention. The embodiment of the invention is an alternative proposal based on the embodiment. The following will specifically illustrate embodiments of the present invention:
firstly, an ROS System is set on a central processing unit of an android System and an R7 processor of a System On Chip (SOC), and an RVC (reverse imaging APP) is installed based on the ROS System to realize a reverse imaging function. For the ROS system, the time from start-up until RVC processing can occur is within 2 seconds. The SOC comprises an A53/A57 processor, wherein an android system is arranged in the A57/A53 processor.
In the embodiment of the invention, a vehicle uses an M3 SOC chip, and two sets of systems are operated on the M3 SOC chip: the system starting process of the ROS system and the Android system is as follows: 1. the MCU is powered first, the SOC is booted, and then the bootloader of R7 is booted. 2. The ROS boot start and boot loader start of the android system are guided by R7 boot loader. The ROS system and the android system are started at the same time, but the starting of the ROS system is finished quickly. Because, when the Android system is started, many processors, such as BL2/BL31, U-Boot (Boot loader), Kernel (real-time operating system), Android, etc., need to be booted, so that the startup of the Android system is completed, see fig. 4.
When detecting the cold start of the vehicle and detecting that the reversing control is triggered, a reversing instruction is generated and sent to the MCU, the MCU sends the reversing instruction to the R7 processor, the R7 processor generates a shooting instruction based on the received reversing instruction and sends the shooting instruction to the camera device, so that the camera device shoots a reversing image based on the shooting instruction. The camera device sends the reverse image to the R7 processor, so that the R7 processor processes the reverse image, and the reverse image is displayed on the display screen through the imaging system.
In the embodiment of the invention, the image data in the R7 processor with the ROS system and the A57/A53 with the android system can be shared in a resource sharing mode preset in the SOC, so that the SOC manages the application of each system, when the reverse image is displayed on the current display screen and the triggering operation of an e-call key under the android system is detected, a telephone image display instruction is generated, and for the vehicle control system, the priority of e-call telephone image display is higher than that of the reverse image. Therefore, the SOC can replace the reverse image displayed on the display interface with the e-call telephone image display.
In the embodiment of the invention, before the vehicle is cold started and the android system is not started, if the reverse gear triggering operation or the triggering operation of a reverse related key is detected, the reverse imaging APP processes the radar ranging information on the CAN bus and sends the processed information to the instrument, and the independent loudspeaker of the instrument plays the radar alarm sound. After the android system is started, if the instrument plays the radar alarm sound at the moment, the radar alarm sound is still output by the instrument at the moment, after the backing of the car is finished, the audio information is processed by the android system every time, and the audio information is played, for example, the audio information is played by an audio player in the android system.
According to the technical scheme of the embodiment of the invention, when the vehicle is detected to be in a cold start state and the reversing control is detected to be triggered, the reversing instruction sent to the first microprocessor is generated, the reversing instruction is sent to the second microprocessor based on the reversing instruction received by the first microprocessor, the second microprocessor generates a shooting instruction based on the reversing instruction, and the shooting instruction is sent to the camera device, so that the camera device shoots the reversing image in the target area based on the received shooting instruction. And then, sending the reverse image to a second microprocessor so that an imaging system arranged in the second microprocessor displays the reverse image on a display interface. According to the technical scheme of the embodiment of the invention, the reverse image is acquired through the second microprocessor in the cold starting state of the vehicle, and the reverse image is displayed on the display interface. The problem of current vehicle cold start, the android system starts slowly and causes the image of backing a car to show slowly is solved.
Example four
Fig. 5 is a schematic structural diagram of a reverse image display device according to an embodiment of the present invention, where the reverse image display device according to an embodiment of the present invention can execute a reverse image display method according to any embodiment of the present invention, and has functional modules and beneficial effects corresponding to the execution method. The device includes: a reversing instruction generating module 510, a shooting instruction sending module 520 and a reversing image display module 530; wherein:
the reversing instruction generating module 510 is configured to generate a reversing instruction sent to the first microprocessor when detecting that the vehicle is in a cold start state and detecting that a reversing control is triggered; a shooting instruction sending module 520, configured to receive the reverse instruction based on the first microprocessor, and send the reverse instruction to a second microprocessor, so that the second microprocessor sends a shooting instruction to a camera device; the reverse image display module 530 is configured to capture a reverse image in a target area based on the received shooting instruction by the camera device, and send the reverse image to the second microprocessor, so that an imaging system disposed in the second microprocessor displays the reverse image on a display interface.
Further, the apparatus further comprises:
and the imaging system starting module is used for guiding the starting of the second microprocessor based on the first microprocessor so as to lead the started second microprocessor to guide the starting of the imaging system.
Further, the reverse order generating module 510 includes:
and the backing instruction generating module is used for generating a backing instruction sent to the first microprocessor when the vehicle is detected to be in a cold starting state and the backing control is detected to be triggered within a preset time length.
Further, the reverse order generating module 510 includes:
the target pin information detection submodule is used for detecting target pin information corresponding to the backing control when the backing control is detected to be triggered; and the backing instruction sending submodule is used for generating a backing instruction sent to the first microprocessor when the level of the target pin information is in a preset level state.
Further, the apparatus comprises:
and the prompt information playing module is used for acquiring the radar ranging information on the bus based on the second microprocessor and playing the prompt information corresponding to the radar ranging information based on a preset playing device.
Further, the prompt message playing module includes:
and the audio information playing submodule is used for closing the playing device after the prompt information is played when the android system is detected to be started and the playing device plays the prompt information, so that the audio information is played based on the android system when the audio information is received.
Further, the first microprocessor is an MCU, the second microprocessor is an R7 processor, an ROS system is arranged in the R7 processor, and the imaging system is arranged in the ROS system.
According to the technical scheme of the embodiment of the invention, when the vehicle is detected to be in a cold start state and the reversing control is detected to be triggered, the reversing instruction sent to the first microprocessor is generated, the reversing instruction is sent to the second microprocessor based on the reversing instruction received by the first microprocessor, the second microprocessor generates a shooting instruction based on the reversing instruction, and the shooting instruction is sent to the camera device, so that the camera device shoots the reversing image in the target area based on the received shooting instruction. And then, sending the reverse image to a second microprocessor so that an imaging system arranged in the second microprocessor displays the reverse image on a display interface. According to the technical scheme of the embodiment of the invention, the display of the reversing image is realized based on the triggering operation of the reversing control in the cold starting state of the vehicle. The problem of current vehicle cold start, the android system starts slowly and causes the image of backing a car to show slowly is solved.
It should be noted that, the units and modules included in the apparatus are merely divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the embodiment of the invention.
EXAMPLE five
Fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention. FIG. 6 illustrates a block diagram of an exemplary electronic device 60 suitable for use in implementing embodiments of the present invention. The electronic device 60 shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiment of the present invention.
As shown in fig. 6, the electronic device 60 is in the form of a general purpose computing device. The components of the electronic device 60 may include, but are not limited to: one or more processors or processing units 601, a system memory 602, and a bus 603 that couples various system components including the system memory 602 and the processing unit 601.
The system memory 602 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)604 and/or cache memory 605. The electronic device 60 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 606 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 6, commonly referred to as a "hard drive"). Although not shown in FIG. 6, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to the bus 603 by one or more data media interfaces. Memory 602 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.
A program/utility 608 having a set (at least one) of program modules 607 may be stored, for example, in memory 602, such program modules 607 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. The program modules 607 generally perform the functions and/or methods of the described embodiments of the invention.
The processing unit 601 executes various functional applications and data processing by running the program stored in the system memory 602, for example, implementing the method for displaying a reverse image according to the embodiment of the present invention.
EXAMPLE six
An embodiment of the present invention further provides a storage medium containing computer-executable instructions, where the computer-executable instructions are executed by a computer processor to perform a method for displaying a car-back image, and the method includes:
when the vehicle is detected to be in a cold starting state and the reversing control is detected to be triggered, a reversing instruction sent to the first microprocessor is generated; receiving the reversing instruction based on the first microprocessor, and sending the reversing instruction to a second microprocessor so that the second microprocessor sends a shooting instruction to a camera device; the camera device shoots a reversing image in a target area based on the received shooting instruction, and sends the reversing image to the second microprocessor, so that an imaging system arranged in the second microprocessor displays the reversing image on a display interface.
Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for embodiments of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (10)
1. The method for displaying the reverse image is applied to a vehicle with an android system, and comprises the following steps:
when the vehicle is detected to be in a cold starting state and the reversing control is detected to be triggered, a reversing instruction sent to the first microprocessor is generated;
receiving the reversing instruction based on the first microprocessor, and sending the reversing instruction to a second microprocessor so that the second microprocessor sends a shooting instruction to a camera device;
the camera device shoots a reversing image in a target area based on the received shooting instruction, and sends the reversing image to the second microprocessor, so that an imaging system arranged in the second microprocessor displays the reversing image on a display interface.
2. The method of claim 1, further comprising, after said detecting that the vehicle is in a cold start condition:
and guiding the starting of a second microprocessor based on the first microprocessor so that the started second microprocessor guides the starting of the imaging system.
3. The method of claim 1, wherein generating a reverse command to the first microprocessor upon detecting that the vehicle is in a cold start state and detecting that a reverse control is triggered comprises:
and when the vehicle is detected to be in a cold starting state and the reversing control is detected to be triggered within a preset time length, a reversing instruction sent to the first microprocessor is generated.
4. The method of claim 1, wherein generating a reverse command to the first microprocessor upon detecting triggering of the reverse control comprises:
when the reversing control is detected to be triggered, target pin information corresponding to the reversing control is detected;
and when the level of the target pin information is in a preset level state, generating a reversing instruction sent to the first microprocessor.
5. The method of claim 1, further comprising:
and acquiring radar ranging information on a bus based on the second microprocessor, and playing prompt information corresponding to the radar ranging information based on a preset playing device.
6. The method of claim 5, wherein the obtaining of the radar ranging information on the bus based on the second microprocessor and playing the prompt message corresponding to the radar ranging information based on a preset playing device comprises:
when detecting that the android system is started and the playing device plays the prompt information, after the prompt information is played, the playing device is closed, so that the audio information is played based on the android system when the audio information is received.
7. The method of any of claims 1-6, wherein the first microprocessor is a MCU, the second microprocessor is a R7 processor, a ROS system disposed in the R7 processor, and the imaging system is disposed in the ROS system.
8. A reverse image display device, comprising:
the reversing instruction generating module is used for generating a reversing instruction sent to the first microprocessor when detecting that the vehicle is in a cold starting state and detecting that a reversing control is triggered;
the shooting instruction sending module is used for receiving the reversing instruction based on the first microprocessor and sending the reversing instruction to the second microprocessor so as to enable the second microprocessor to send a shooting instruction to the camera device;
and the reversing image display module is used for shooting a reversing image in a target area by the camera device based on the received shooting instruction and sending the reversing image to the second microprocessor so that an imaging system arranged in the second microprocessor displays the reversing image on a display interface.
9. An electronic device, characterized in that the electronic device comprises:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the method of displaying reverse images as claimed in any one of claims 1 to 7.
10. A storage medium containing computer executable instructions for performing the method of displaying reverse images according to any one of claims 1 to 7 when executed by a computer processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110429813.2A CN113071511A (en) | 2021-04-21 | 2021-04-21 | Method and device for displaying reverse image, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110429813.2A CN113071511A (en) | 2021-04-21 | 2021-04-21 | Method and device for displaying reverse image, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113071511A true CN113071511A (en) | 2021-07-06 |
Family
ID=76618204
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110429813.2A Pending CN113071511A (en) | 2021-04-21 | 2021-04-21 | Method and device for displaying reverse image, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113071511A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115871560A (en) * | 2023-01-29 | 2023-03-31 | 蔚来汽车科技(安徽)有限公司 | Reverse image display method, control device, vehicle and computer storage medium |
| WO2023185168A1 (en) * | 2022-04-02 | 2023-10-05 | 合肥杰发科技有限公司 | Display method for vehicle detection image, and in-car entertainment apparatus |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103522949A (en) * | 2012-12-21 | 2014-01-22 | Tcl康钛汽车信息服务（深圳）有限公司 | Method and car machine system for rapidly starting car backing up images |
| US20170339375A1 (en) * | 2016-05-19 | 2017-11-23 | GM Global Technology Operations LLC | Redundant video path for vehicle rear view camera system |
| CN107920204A (en) * | 2017-11-29 | 2018-04-17 | 珠海亿智电子科技有限公司 | A kind of cold start-up quickly shows the apparatus and method of back-up video |
| CN108248509A (en) * | 2018-01-17 | 2018-07-06 | 深圳市路畅科技股份有限公司 | A kind of method, apparatus that reverse image is controlled to show and automatic navigator |
| US20180251067A1 (en) * | 2017-03-03 | 2018-09-06 | Verizon Patent And Licensing Inc. | Systems and methods for streaming video from a rear view backup camera |
| CN109532721A (en) * | 2018-12-12 | 2019-03-29 | 珠海全志科技股份有限公司 | A method of fast implementing the cold start-up panorama reversing of Android vehicle device |
| CN110134448A (en) * | 2019-05-17 | 2019-08-16 | 上海航盛实业有限公司 | A kind of method, system, equipment and the storage medium of display reversing monitored picture |
| CN110245585A (en) * | 2019-05-28 | 2019-09-17 | 艾贝科技(深圳)有限公司 | Reverse backsight system implementation method, device, computer equipment and its storage medium |
| CN111114469A (en) * | 2019-12-31 | 2020-05-08 | 长城汽车股份有限公司 | Reversing image starting method and system and vehicle |
| CN111169381A (en) * | 2019-10-10 | 2020-05-19 | 中国第一汽车股份有限公司 | Vehicle image display method and device, vehicle and storage medium |
| CN111746400A (en) * | 2020-06-29 | 2020-10-09 | 珠海全志科技股份有限公司 | Method for rapidly displaying reverse cold start image, computer device and computer readable storage medium |
| CN112040173A (en) * | 2020-07-20 | 2020-12-04 | 南斗六星系统集成有限公司 | Method for rapidly displaying reversing video through Android car machine system |
| CN112199222A (en) * | 2020-12-03 | 2021-01-08 | 湖北芯擎科技有限公司 | Video display method and device, electronic equipment and storage medium |
| CN112660026A (en) * | 2020-12-30 | 2021-04-16 | 广州路派电子科技有限公司 | Method and system for displaying images of vehicle-mounted multipath radar and camera in combined manner |
-
2021
- 2021-04-21 CN CN202110429813.2A patent/CN113071511A/en active Pending
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103522949A (en) * | 2012-12-21 | 2014-01-22 | Tcl康钛汽车信息服务（深圳）有限公司 | Method and car machine system for rapidly starting car backing up images |
| US20170339375A1 (en) * | 2016-05-19 | 2017-11-23 | GM Global Technology Operations LLC | Redundant video path for vehicle rear view camera system |
| US20180251067A1 (en) * | 2017-03-03 | 2018-09-06 | Verizon Patent And Licensing Inc. | Systems and methods for streaming video from a rear view backup camera |
| CN107920204A (en) * | 2017-11-29 | 2018-04-17 | 珠海亿智电子科技有限公司 | A kind of cold start-up quickly shows the apparatus and method of back-up video |
| CN108248509A (en) * | 2018-01-17 | 2018-07-06 | 深圳市路畅科技股份有限公司 | A kind of method, apparatus that reverse image is controlled to show and automatic navigator |
| CN109532721A (en) * | 2018-12-12 | 2019-03-29 | 珠海全志科技股份有限公司 | A method of fast implementing the cold start-up panorama reversing of Android vehicle device |
| CN110134448A (en) * | 2019-05-17 | 2019-08-16 | 上海航盛实业有限公司 | A kind of method, system, equipment and the storage medium of display reversing monitored picture |
| CN110245585A (en) * | 2019-05-28 | 2019-09-17 | 艾贝科技(深圳)有限公司 | Reverse backsight system implementation method, device, computer equipment and its storage medium |
| CN111169381A (en) * | 2019-10-10 | 2020-05-19 | 中国第一汽车股份有限公司 | Vehicle image display method and device, vehicle and storage medium |
| CN111114469A (en) * | 2019-12-31 | 2020-05-08 | 长城汽车股份有限公司 | Reversing image starting method and system and vehicle |
| CN111746400A (en) * | 2020-06-29 | 2020-10-09 | 珠海全志科技股份有限公司 | Method for rapidly displaying reverse cold start image, computer device and computer readable storage medium |
| CN112040173A (en) * | 2020-07-20 | 2020-12-04 | 南斗六星系统集成有限公司 | Method for rapidly displaying reversing video through Android car machine system |
| CN112199222A (en) * | 2020-12-03 | 2021-01-08 | 湖北芯擎科技有限公司 | Video display method and device, electronic equipment and storage medium |
| CN112660026A (en) * | 2020-12-30 | 2021-04-16 | 广州路派电子科技有限公司 | Method and system for displaying images of vehicle-mounted multipath radar and camera in combined manner |
Non-Patent Citations (2)
| Title |
|---|
| 孙德生: "快速处理倒车影像的设计研究与实现", 《汽车电器》 * |
| 胡鼎等: "车载Android操作系统快速倒车启动技术研究", 《企业科技与发展》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023185168A1 (en) * | 2022-04-02 | 2023-10-05 | 合肥杰发科技有限公司 | Display method for vehicle detection image, and in-car entertainment apparatus |
| CN115871560A (en) * | 2023-01-29 | 2023-03-31 | 蔚来汽车科技(安徽)有限公司 | Reverse image display method, control device, vehicle and computer storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20170300503A1 (en) | Method and apparatus for managing video data, terminal, and server | |
| CN110162343B (en) | Application starting method and device, electronic equipment and storage medium | |
| CN111107421B (en) | Video processing method and device, terminal equipment and storage medium | |
| CN113071511A (en) | Method and device for displaying reverse image, electronic equipment and storage medium | |
| CN111833460B (en) | Augmented reality image processing method and device, electronic equipment and storage medium | |
| CN110044638B (en) | Method and device for testing lane keeping function and storage medium | |
| CN111541919A (en) | Video frame transmission method and device, electronic equipment and readable storage medium | |
| CN107305561B (en) | Image processing method, device and equipment and user interface system | |
| CN115720253B (en) | Video processing method, device, vehicle and storage medium | |
| US11685320B2 (en) | Vehicular recording control apparatus, vehicular recording apparatus, vehicular recording control method, and computer program | |
| US12069111B2 (en) | Video processing method and apparatus | |
| CN109889877A (en) | Car multi-screen display control method and device | |
| CN111741444A (en) | Display method, device, equipment and storage medium | |
| CN114025116B (en) | Video generation method, device, readable medium and electronic equipment | |
| CN112333518B (en) | Function configuration method and device for video and electronic equipment | |
| CN111354216A (en) | Vehicle parking position identification method and device and related equipment | |
| CN110189242B (en) | Image processing method and device | |
| CN117061727A (en) | Reversing image fluency testing method, device and reversing image system | |
| CN116866521A (en) | Camera monitoring and playback checking method, device, equipment and medium | |
| CN116610392A (en) | HDMI screen control method, device, computer equipment and storage medium | |
| CN116527978A (en) | Multi-screen interaction control method and device | |
| CN115437346A (en) | Diagnosis method and device of vehicle-mounted system and electronic equipment | |
| CN115604132A (en) | Remote control method and device for server, electronic equipment and readable storage medium | |
| CN108845565B (en) | Vehicle diagnosis method and vehicle diagnosis instrument | |
| CN112861612A (en) | Method and device for shooting image, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210706 |
|
| RJ01 | Rejection of invention patent application after publication |