CN111645521B - Control method and device for intelligent rearview mirror, electronic equipment and storage medium - Google Patents

Control method and device for intelligent rearview mirror, electronic equipment and storage medium Download PDF

Info

Publication number
CN111645521B
CN111645521B CN202010474596.4A CN202010474596A CN111645521B CN 111645521 B CN111645521 B CN 111645521B CN 202010474596 A CN202010474596 A CN 202010474596A CN 111645521 B CN111645521 B CN 111645521B
Authority
CN
China
Prior art keywords
interface
application program
rearview mirror
intelligent rearview
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010474596.4A
Other languages
Chinese (zh)
Other versions
CN111645521A (en
Inventor
陈建哲
欧阳能钧
程新强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apollo Zhilian Beijing Technology Co Ltd
Original Assignee
Apollo Zhilian Beijing Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Apollo Zhilian Beijing Technology Co Ltd filed Critical Apollo Zhilian Beijing Technology Co Ltd
Priority to CN202010474596.4A priority Critical patent/CN111645521B/en
Publication of CN111645521A publication Critical patent/CN111645521A/en
Priority to KR1020210041997A priority patent/KR102501293B1/en
Priority to JP2021065849A priority patent/JP7230093B2/en
Application granted granted Critical
Publication of CN111645521B publication Critical patent/CN111645521B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/02—Rear-view mirror arrangements
    • B60R1/04—Rear-view mirror arrangements mounted inside vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/22—Display screens
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/29—Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/60—Instruments characterised by their location or relative disposition in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/80—Arrangements for controlling instruments
    • B60K35/81—Arrangements for controlling instruments for controlling displays
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/85—Arrangements for transferring vehicle- or driver-related data
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/12—Mirror assemblies combined with other articles, e.g. clocks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/18—Information management
    • B60K2360/184—Displaying the same information on different displays
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/583—Data transfer between instruments
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/12—Mirror assemblies combined with other articles, e.g. clocks
    • B60R2001/1215—Mirror assemblies combined with other articles, e.g. clocks with information displays

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Transportation (AREA)
  • Combustion & Propulsion (AREA)
  • Chemical & Material Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application discloses a control method and device for an intelligent rearview mirror, electronic equipment and a storage medium, and relates to the technical field of vehicle networking. The specific implementation scheme is as follows: acquiring interface display information of the intelligent rearview mirror; sending interface display information to at least one external device in communication connection with the intelligent rearview mirror; and controlling the intelligent rearview mirror to perform corresponding operation in response to user operation information from the at least one external device, wherein the user operation information is used for describing the operation of the user on the at least one external device. According to the technical scheme, the screen-projecting interface of the intelligent rearview mirror can be controlled by the user on the screen-projecting external equipment, the operation is convenient, and the driving safety of the user can be guaranteed.

Description

Control method and device for intelligent rearview mirror, electronic equipment and storage medium
Technical Field
The application relates to the field of data processing, in particular to a control method and device for an intelligent rearview mirror in the Internet of vehicles technology, electronic equipment and a storage medium.
Background
With the development of vehicle intellectualization, the number of vehicle-mounted electronic devices is increasing. The rearview mirror is also developed into an intelligent rearview mirror with an auxiliary reversing function from the initial rearview function, and an application program can be further arranged on the existing intelligent rearview mirror to realize numerous functions such as music playing, map navigation and the like. However, in the driving process, when the user operates and watches the intelligent rearview mirror, attention needs to be transferred to the overhead direction, the operation is inconvenient, and the driving safety of the user is damaged.
In order to solve the problems, a technical scheme of projecting the interface of the intelligent rearview mirror to a car machine is provided in the prior art, so that a user can obtain the content displayed by the intelligent rearview mirror by watching the car machine, and the problem that the driving safety is affected when the user watches the intelligent rearview mirror is avoided. The intelligent rearview mirror continuously captures the screen, namely records the content needing screen projection into a video, and encodes the video into a video stream to be transmitted to the vehicle machine, so that the vehicle machine can decode the video stream to display the interface of the intelligent rearview mirror, and the screen projection scheme of the interface of the intelligent rearview mirror on the vehicle machine is further realized.
However, in the prior art, after the interface of the intelligent rearview mirror is projected to the vehicle, if a user needs to operate the interface after the screen projection, the user can only operate the interface on the intelligent rearview mirror, and the problems of inconvenient operation and harm to the driving safety of the user also exist.
Disclosure of Invention
The application provides a control method and device for an intelligent rearview mirror, electronic equipment and a storage medium, and can realize that a user can control an application program projected on the intelligent rearview mirror on external equipment.
The application provides a control method for an intelligent rearview mirror in a first aspect, which comprises the following steps: acquiring interface display information of the intelligent rearview mirror; sending the interface display information to at least one external device in communication connection with the intelligent rearview mirror; and responding to user operation information from the at least one external device, and controlling the intelligent rearview mirror to perform corresponding operation, wherein the user operation information is used for describing the operation of the user on the at least one external device.
A second aspect of the present application provides a control method for an intelligent rearview mirror, including: receiving interface display information from the screen projection control equipment; displaying an interface of a projection screen on the intelligent rearview mirror according to the interface display information; if the operation of the user on the interface is detected, generating user operation information; and sending the user operation information to the screen projection control equipment.
A third aspect of the present application provides a control device for an intelligent rearview mirror, comprising:
and the processing module is used for acquiring interface display information of the intelligent rearview mirror.
And the transceiver module is used for sending the interface display information to at least one external device in communication connection with the intelligent rearview mirror.
The processing module is further configured to control the intelligent rearview mirror to perform a corresponding operation in response to user operation information from the at least one external device, where the user operation information is used to describe an operation of the user on the at least one external device.
A fourth aspect of the present application provides a control device for an intelligent rearview mirror, comprising:
and the transceiving module is used for receiving interface display information from the screen projection control equipment.
And the display module is used for displaying the screen projection interface on the intelligent rearview mirror according to the interface display information.
And the processing module is used for generating user operation information if the operation of the user on the interface is detected.
And the transceiver module is used for sending the user operation information to the screen projection control equipment.
A fifth aspect of the present application provides an electronic device, comprising: an output device of the at least one processor, memory; the memory stores computer-executable instructions; the at least one processor executes the computer-executable instructions stored in the memory, so that the electronic device executes the control method for the intelligent rearview mirror according to the first aspect and the second aspect, and the output device is used for displaying an interface of the electronic device.
A sixth aspect of the present application provides a computer-readable storage medium having stored thereon computer-executable instructions that, when executed by a processor, implement the control method for an intelligent rearview mirror of the first and second aspects described above.
Advantageous effects of the above-described aspects may specifically refer to advantageous effects described in the following detailed description.
The application provides a control method, a control device, electronic equipment and a storage medium for an intelligent rearview mirror, and the specific implementation scheme is as follows: acquiring interface display information of the intelligent rearview mirror; sending interface display information to at least one external device in communication connection with the intelligent rearview mirror; and controlling the intelligent rearview mirror to perform corresponding operation in response to user operation information from the at least one external device, wherein the user operation information is used for describing the operation of the user on the at least one external device. According to the technical scheme, the screen-projecting interface on the intelligent rearview mirror can be controlled by the user on the screen-projecting external equipment, the operation is convenient, and the driving safety of the user can be ensured.
Drawings
The drawings are included to provide a better understanding of the present solution and are not intended to limit the present application. Wherein:
fig. 1 is a diagram illustrating an exemplary system architecture of a control method for an intelligent rearview mirror according to an embodiment of the present disclosure;
FIG. 2 is a schematic flow chart of a control method for an intelligent rearview mirror provided by the present application;
FIG. 3 is a first schematic view of an interface change of the intelligent rearview mirror provided by the present application;
FIG. 4 is a first schematic diagram illustrating an interface change of a first external device according to the present disclosure;
fig. 5 is a schematic view illustrating an interface change of the intelligent rearview mirror provided by the present application;
FIG. 6 is a second schematic diagram illustrating an interface change of the first external device according to the present disclosure;
FIG. 7 is a schematic interface diagram of a first external device provided herein;
FIG. 8 is a schematic view of an interface for the intelligent rearview mirror provided herein;
fig. 9 is a third schematic diagram illustrating an interface change of the first external device provided in the present application;
FIG. 10 is a schematic view of a scene in which the control method for the intelligent rearview mirror provided by the present application is applied;
fig. 11 is a first structural schematic diagram of the control device for the intelligent rearview mirror provided by the present application;
fig. 12 is a schematic structural diagram ii of the control device for an intelligent rearview mirror provided in the present application;
fig. 13 is a schematic structural diagram of an electronic device provided in the present application.
Detailed Description
The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Fig. 1 is a diagram illustrating an exemplary system architecture of a control method for an intelligent rearview mirror according to an embodiment of the present disclosure. As shown in fig. 1, the method involves an intelligent rearview mirror and at least one external device. It should be understood that the intelligent rearview mirror in this embodiment can be disposed in a vehicle, and the intelligent rearview mirror can be installed inside the vehicle near the center of the windshield, and the intelligent rearview mirror in this embodiment can be, but is not limited to, a rearview mirror with only a rearview function, or an intelligent rearview mirror with an auxiliary reversing function, or an intelligent rearview mirror with other functions, such as navigation, music playing, and the like.
The external device in this embodiment may be a vehicle machine in a vehicle, or a terminal device of a user located in the vehicle, or the like. The car machine in the embodiment can be installed in a center console of a vehicle, and a screen of the car machine is arranged on the surface of the center console to display various information for a user. The intelligent rearview mirror and the vehicle machine can be connected through a wired connection, for example, through a Universal Serial Bus (USB for short), or can also be connected through a Wireless connection, for example, through a bluetooth connection, or a Wireless Fidelity (Wi-Fi for short). The intelligent rearview mirror in the embodiment can assist the vehicle to back, and an application program can be further arranged on the intelligent rearview mirror to realize numerous functions such as music playing, map navigation and the like. The terminal device of the user in this embodiment may be, but is not limited to, a mobile phone, a Personal Digital Assistant (PDA), a tablet computer, a portable device (e.g., a laptop computer, a pocket computer, or a handheld computer), and the like. It should be understood that fig. 1 illustrates an external device, and the external device is a vehicle.
Because the intelligent rearview mirror is mostly arranged in the vehicle at a position close to the center of the windshield, as shown in fig. 1, when a user operates and watches the interface of the intelligent rearview mirror, attention needs to be transferred to the overhead direction, the operation is inconvenient, and the driving safety of the user is endangered. In the prior art, in order to solve the problem, the technical scheme that the interface of the intelligent rearview mirror is projected to the external device such as a car machine is adopted, so that the user can obtain the content displayed by the intelligent rearview mirror by watching the car machine, and the problem that the driving safety is influenced when the user watches the intelligent rearview mirror is avoided.
However, in the prior art, if a user needs to operate the interface after screen projection after the interface of the intelligent rearview mirror is projected to the vehicle, the user can only operate the interface on the intelligent rearview mirror, and cannot control the interface on the intelligent rearview mirror on the vehicle, so that the problems that the operation is inconvenient and the driving safety of the user is damaged also exist after the interface of the existing intelligent rearview mirror is projected to the vehicle.
In order to solve the above problems, the present application provides a control method for an intelligent rearview mirror, in which after an interface of the intelligent rearview mirror is projected to an external device, a user can control the interface of the intelligent rearview mirror by operating the interface projected on the external device, the operation is convenient, and the driving safety of the user can be ensured.
The following describes a control method for an intelligent rearview mirror provided by the present application with reference to specific embodiments. Fig. 2 is a schematic flow chart of a control method for an intelligent rearview mirror provided by the present application. It should be understood that the executing subject of the method flow shown in fig. 2 may be a control device for an intelligent rearview mirror, the control device for an intelligent rearview mirror may be an intelligent rearview mirror or a screen projection control device in an intelligent rearview mirror, the screen projection control device may be a processor or a chip, and the like, the screen projection control device may be implemented by any software and/or hardware, and the following description will take the control device of an intelligent rearview mirror as a screen projection control device as an example.
As shown in fig. 2, the control method for the intelligent rearview mirror provided by the present embodiment may include:
s201, the screen projection control equipment acquires interface display information of the intelligent rearview mirror.
S202, the screen projection control equipment sends interface display information to at least one external device in communication connection with the intelligent rearview mirror.
And S203, the first external equipment displays the screen projection interface on the intelligent rearview mirror according to the interface display information.
And S204, if the first external equipment detects the operation of the user on the interface, generating user operation information.
S205, the first external device sends user operation information to the screen projection control device.
S206, the screen projection control device responds to user operation information from at least one external device and controls the intelligent rearview mirror to execute corresponding operation, and the user operation information is used for describing the operation of the user on the at least one external device.
In S201, when the interface of the intelligent rearview mirror is projected, the screen projection control device may obtain interface display information of the intelligent rearview mirror. In this embodiment, the screen projection control device can record the screen of the interface displayed on the intelligent rearview mirror, so as to obtain the interface display information of the intelligent rearview mirror. Or, the screen projection control device may further obtain display information of a current interface of the intelligent rearview mirror, and the display information of the current interface is used as interface display information.
In the above S202, at least one external device in this embodiment may refer to the above description, which is not described herein again. When the intelligent rearview mirror is projected to at least one external device, the interface display information of the intelligent rearview mirror can be sent to the at least one external device, so that each external device can determine the interface on the intelligent rearview mirror according to the interface display information of the intelligent rearview mirror, and then the interface projected on the intelligent rearview mirror is displayed on the external device.
In the above S203, in this embodiment, the first external device is any one of the above at least one external device, and an operation process of each external device in the at least one external device is described below by taking the first external device as an example. It should be understood that the operation process of each external device is the same as that of the first external device.
In this embodiment, the first external device may display the screen-projecting interface on the intelligent rearview mirror according to the interface display information from the screen-projecting control device. The interface display information of the intelligent rearview mirror can be main interface display information of the intelligent rearview mirror or interface display information of an application program on the intelligent rearview mirror. It should be understood that the primary interface of the smart rearview mirror may be the interface of a previous smart rearview mirror that did not enter the application.
Optionally, a screen projection control may be displayed on the interface of the intelligent rearview mirror in this embodiment, and after the user selects the screen projection control, the screen projection control device controls the interface of the intelligent rearview mirror to project a screen to at least one external device.
Fig. 3 is a schematic view of a first interface change of the intelligent rearview mirror provided by the present application. As shown in an interface 301 in fig. 3, the interface 301 is a main interface of the smart rearview mirror, and information such as icons, dates, times, and settings of applications on the smart rearview mirror is displayed on the main interface. A screen-projecting control is also displayed on the interface 301, and if the user clicks the screen-projecting control, the interface 301 jumps to the interface 302, and an identifier of the external device that is being projected, such as "external device 1", is displayed on the interface 302, and information in the interface 301 is displayed. Optionally, the interface 302 may also not display the information in the interface 301, and display the identifier of the external device that is projected, such as "external device 1", and the text reminding information that "the main interface has projected to the external device". It should be appreciated that the smart rearview mirror establishes a wired or wireless connection with the external device before the interface of the smart rearview mirror is projected to the external device.
After the screen projection control device controls the interface of the intelligent rearview mirror to project the screen to the external device, the interface of the screen projected on the intelligent rearview mirror can be correspondingly displayed on the external device.
Illustratively, fig. 4 is a first schematic diagram of an interface change of a first external device provided in the present application. As shown in the interface 401 in fig. 4, the interface 401 is an interface before the first external device is dropped, and the interface may be a main interface of the first external device, for example, information such as date, time, setting, and the like may be displayed on the interface 401. After controlling the interface of the smart rearview mirror to be projected to the first external device, the first external device interface 401 jumps to an interface 402, and the interface 402 may be the same as the interface 301 in fig. 3, but no projection control is displayed in the interface 402.
In S204 and S205, the first external device may detect an operation of the user on the screen-projected interface displayed on the first external device, and generate user operation information. It should be understood that the user operation information is used to describe operation information of the first external device by the user. The user operation information may describe an operation of a user on a mechanical control provided on the first external device, or an operation of a user on a screen-projecting interface displayed on the first external device. In addition, in this embodiment, the first external device further sends user operation information to the screen projection control device, and the user operation information instructs the screen projection control device to control the intelligent rearview mirror, so that the screen projection control device controls the intelligent rearview mirror to execute corresponding operations.
For example, in the interface 402, if the user clicks the setting control, the first external device may detect an operation of the user on the interface 402, and generate user operation information, where the user operation information is used to describe that the user has clicked the setting control.
In S206, after receiving the user operation information, the screen projection control device may determine the operation of the user on the screen projection interface of the external device. That is, the screen projection control device in the present embodiment may control the intelligent rearview mirror to perform a corresponding operation in response to user operation information from at least one external device.
Illustratively, if the user operation information is used for describing that the user clicks the setting control, the screen projection control device controls the intelligent rearview mirror to perform an operation of entering the setting interface, and correspondingly, the interface 302 of the intelligent rearview mirror jumps to the interface 303, and the interface 303 is the setting interface of the intelligent rearview mirror. For example, the interface 303 may display connection modes, such as bluetooth connection, more connection settings, and interface brightness and wallpaper settings. Because the interface of the smart rearview mirror is projected to the first external device, the interface 402 of the external device jumps to the interface 403, and the interface 403 is the same as the interface 303.
The control method for the intelligent rearview mirror provided in the embodiment includes: acquiring interface display information of the intelligent rearview mirror; sending interface display information to at least one external device in communication connection with the intelligent rearview mirror; and controlling the intelligent rearview mirror to perform corresponding operation in response to user operation information from the at least one external device, wherein the user operation information is used for describing the operation of the user on the at least one external device. In this embodiment, the external device may detect an operation of the user on the interface from the screen projection to the external device, and then send the operation information of the user to the screen projection control device of the intelligent rearview mirror, so as to control the interface by the intelligent rearview mirror, that is, in this embodiment, the user may control the interface from the screen projection of the intelligent rearview mirror on the external device, so that the operation is convenient, and the driving safety of the user is ensured.
On the basis of the above-described embodiments, the following embodiments are described with respect to a screen projection control process of an application on an intelligent rearview mirror, and it should be understood that the control method for an intelligent rearview mirror in the following embodiments is also applicable to the above-described embodiments. The interface of the intelligent rearview mirror is an interface of an application program on the intelligent rearview mirror, such as a music application program, a navigation application program, or a weather application program, which is shown in the interface 301. Correspondingly, the user operates the screen-projecting interface on the external device, namely the screen-projecting application program interface on the external device, and the screen-projecting control device can control the application program on the intelligent rearview mirror to execute corresponding operation according to the user operation information.
The control method for the intelligent rearview mirror provided by the application is further described in detail with reference to fig. 4. Fig. 4 is a schematic flowchart of a second embodiment of the control method for the intelligent rearview mirror provided by the present application. As shown in fig. 4, the control method for the intelligent rearview mirror provided by the present embodiment may include:
s401, the screen projection control device receives a screen projection instruction input by a user, records an interface of an application program on the intelligent rearview mirror to obtain a video to be projected, and the screen projection instruction is used for indicating to project the interface of the application program to at least one external device.
S402, the screen projection control device sends the video to be projected to at least one external device.
And S403, displaying an interface of the application program on the intelligent rearview mirror by the first external device according to the video to be projected.
S404, if the first external device detects the operation of the user on the interface, the first external device generates user operation information.
S405, the first external device sends user operation information to the screen projection control device.
S406, the screen projection control device generates a trigger event according to the interface layout of the application program and the user operation information, and the trigger event instructs the application program to execute corresponding operation.
And S407, controlling the application program on the intelligent rearview mirror to execute corresponding operation according to the trigger event.
In S401, when the interface of the intelligent rearview mirror is the interface of the application program on the intelligent rearview mirror, the screen projection control may be displayed on the interface of the application program, and the user may trigger the screen projection control device in the intelligent rearview mirror to input the screen projection instruction. It should be understood that, in the present embodiment, the user may also input the screen projection indication by means of a voice command or an action command.
Exemplarily, fig. 5 is a schematic view of an interface change of the intelligent rearview mirror provided by the present application. As shown in the interface 501 in fig. 5, the interface 501 displays an interface of a music application program that the intelligent rearview mirror projects a screen to at least one external device, and an interface for playing songs is displayed on the interface.
In this embodiment, the manner of projecting the screen to the interface of the application program is as follows: the screen projection control device records the interface of the application program on the intelligent rearview mirror to obtain a video to be projected, and then sends the video to be projected to at least one external device, so that each external device projects the screen to the interface of the application program.
In the above S402, after the screen projection control device obtains the video to be screen projected, the video to be screen projected may be encoded, and the encoded video to be screen projected is sent to at least one external device.
Accordingly, in S403, the first external device may decode the video to be projected on the screen received from the screen projection control device, so as to display the interface of the application program on the first external device. Fig. 6 is a schematic diagram illustrating an interface change of the first external device according to the present application. As shown in interface 601 in fig. 6, the interface 601 is displayed as an interface of a music application on the smart rearview mirror, and an interface for playing songs is displayed on the interface.
In the above S404, for example, the user may perform operations such as song cutting, volume adjustment, fast forwarding, and the like on the interface 601, and it should be understood that the operations performed by the user on the interface may be different for different applications. And if the first external equipment detects the operation of the user on the interface, generating user operation information. The operation information of the user may include: and the coordinate position of the operation of the user on the interface currently displayed by the first external device. It should be understood that, as shown in the interface 601, if the a position of the first external device is taken as the origin and the horizontal and vertical directions are taken as the X axis and the Y axis, respectively, then the coordinate position of the operation on the interface currently displayed by the first external device by the user is the position under the coordinate system. Optionally, the operation information of the user may further include: and (4) operation actions of the user. The operation action of the user can be, for example, a single click, a double click, a sliding action, and the like.
For example, in this embodiment, if the user clicks the pause control on the interface 601, the operation information of the user may include the coordinate position of the user click, and the operation action is a single click.
In S406, after receiving the user operation information from the first external device, the screen projection control device may generate a trigger event according to the interface layout of the application program and the user operation information. Wherein the trigger event instructs the application program to execute the corresponding operation.
The following describes a possible implementation manner of generating the trigger event in this embodiment:
the first mode is as follows: the user operation information in this embodiment includes: and the coordinate position of the user on the current interface of the first external device. The screen projection control device can convert the coordinate position operated by the user on the current interface of the first external device into the coordinate position on the current interface of the intelligent rearview mirror.
In this manner, if the interface of the first external device displays all the interfaces of the application programs that are projected on the screen, as shown in the interface 601, and the interface of the smart rearview mirror displays all the interfaces of the application programs that are projected on the screen, as shown in the interface 501, in this embodiment, the relative position of the user that operates on the interface of the application program that is displayed on the first external device may be determined according to the coordinate position of the user that operates on the current interface of the first external device and the size of the interface of the application program that is displayed on the first external device.
For example, if the user clicks a pause control on the interface 601, the operation information of the user may include a coordinate position of the user click. In this embodiment, the relative position of the coordinate position with respect to the interface of the application program may be determined according to the coordinate position and the size of the interface of the application program displayed on the first external device. Such as the coordinate location being at a location to the lower left of the interface of the application.
In this embodiment, the coordinate position on the current interface of the intelligent rearview mirror can be determined according to the above relative position and the size of the interface of the application program displayed on the intelligent rearview mirror. For example, the coordinate position is located at a position below and to the left of the interface of the application program, and then the position clicked by the user can be determined to be at a position below and to the left of the interface of the application program on the smart rearview mirror according to the size of the interface of the application program on the smart rearview mirror.
In this manner, if the interface portion of the first external device displays the interface of the application program for screen projection, the other portion displays information such as time, as shown in fig. 7, and the interface portion of the smart rearview mirror displays the interface of the application program for screen projection, and the other portion displays information such as time, as shown in fig. 8. Fig. 7 is a schematic interface diagram of a first external device provided in the present application. Fig. 8 is an interface schematic diagram of the intelligent rearview mirror provided by the present application. In this embodiment, the relative position of the user operating on the interface of the application program displayed on the first external device may be determined according to the coordinate position of the user operating on the current interface of the first external device, and the coordinate position and size of the interface of the application program displayed on the first external device. It should be understood that, in view of the fact that the interface of the first external device does not all display the interface of the application, when determining the relative position of the user operating on the interface of the application displayed on the first external device, the coordinate position of the interface of the application displayed on the first external device is also determined. It should be understood that the coordinate position of the interface of the application displayed on the first external device refers to a set of positions of the interface of the application on the interface of the first external device, such as the coordinate position to the left of the first external device in fig. 7.
For example, if the user clicks a pause control on the interface 601, the operation information of the user may include a coordinate position of the user click. In this embodiment, the relative position of the coordinate position with respect to the interface of the application program may be determined according to the coordinate position and size of the interface of the application program displayed on the first external device. Such as the coordinate location being at a location to the lower left of the interface of the application.
Correspondingly, the screen projection control equipment can determine the coordinate position on the current interface of the intelligent rearview mirror according to the relative position and the coordinate position and the size of the interface of the application program displayed on the intelligent rearview mirror. For example, the coordinate position is located at a position below and to the left of the interface of the application program, and then a position clicked by the user can be determined to be at a position below and to the left of the interface of the application program on the smart rearview mirror according to the coordinate position and the size of the interface of the application program on the smart rearview mirror. It should be appreciated that the two ways of translating the coordinate position of the user's operation on the current interface of the first external device to the coordinate position on the current interface of the smart rearview mirror as described above may be used in combination.
In this embodiment, after the screen projection control device converts the coordinate position operated by the user on the current interface of the external device into the coordinate position on the current interface of the intelligent rearview mirror, the trigger event may be generated according to the interface layout of the application program and the coordinate position on the current interface of the intelligent rearview mirror.
The method comprises the steps of determining an operation control corresponding to a coordinate position on a current interface of the intelligent rearview mirror according to the interface layout of an application program, and generating a trigger event according to the operation control. For example, if it is determined that the operation control corresponding to the coordinate position on the current interface of the intelligent rearview mirror is the pause control according to the interface layout of the application program, a trigger event is generated according to the pause control, and the trigger event indicates that the music application program pauses playing.
The second mode is as follows: the user operation information includes: the coordinate position of the user operation on the current interface of the first external device and the operation action of the user. In this embodiment, the trigger event may be generated according to the interface layout of the application program, the coordinate position on the current interface of the intelligent rearview mirror, and the operation action of the user.
It should be understood that, in the present embodiment, a manner of converting the coordinate position operated by the user on the current interface of the first external device into the coordinate position on the current interface of the smart rearview mirror may specifically refer to the related description in the first manner. In this embodiment, after the coordinate position on the current interface of the intelligent rearview mirror is determined, the operation position of the user in the application program can be determined according to the interface layout of the application program and the coordinate position on the current interface of the intelligent rearview mirror, and then the trigger event is generated according to the operation action of the user. If the user clicks to indicate that the playing is paused, and clicks to indicate that the song is cut, correspondingly, the trigger event generated in this embodiment indicates to control the music application to pause the playing, or to control the music application to cut the song.
Accordingly, in S407, the screen projection control device may control the application program on the intelligent rearview mirror to perform corresponding operations according to the trigger event. Illustratively, if the user clicks a pause control on the first external device, the screen projection control device controls the music application to pause playing, and correspondingly, the interface 501 of the intelligent rearview mirror jumps to the interface 502, where the interface 502 is an interface where the music application pauses playing, for example, an identifier of a music pause may be on the interface 502. Because the interface of the smart rearview mirror is projected to the first external device, the interface 601 of the first external device jumps to the interface 602, and the interface 602 is the same as the interface 502.
In this embodiment, the screen projection control device may determine an intention of the user operation according to the coordinate position of the user operation on the current interface of the first external device in the user operation information and the operation action of the user, and further generate a corresponding trigger event, thereby implementing control over the application program on the intelligent rearview mirror.
In the above embodiments, the process of implementing the counter control (i.e. implementing the control on the application program on the intelligent rearview mirror on the first external device) for the application program on the intelligent rearview mirror projected to the first external device is described. It should be noted that the control method for the intelligent rearview mirror in the application can realize simultaneous screen projection of multiple applications. Correspondingly, when the interfaces of the multiple application programs are simultaneously projected to the first external device, the target application program displayed on the current interface of the first external device can be determined, and then the trigger event is generated according to the interface layout and the user operation information of the target application program. It should be understood that, in this embodiment, a manner of generating a trigger event according to the interface layout and the user operation information of the target application program may specifically refer to a related description of "generating a trigger event according to the interface layout and the user operation information of the application program" in the second embodiment. The screen projection control device can determine the application program displayed on the current interface of the intelligent rearview mirror and take the application program displayed on the current interface of the intelligent rearview mirror as a target application program.
Under the scene that the interface of multiple application programs is simultaneously projected to the first external device, a switching control is also displayed on the current interface of the first external device, and the switching control indicates to switch the target application program displayed on the current interface of the first external device. Optionally, the toggle control can be an identification of the other applications that are being screened in addition to the target application.
Correspondingly, if the user clicks the switching control, the user operation information generated by the first external device comprises the coordinate position of the switching control on the current interface of the first external device and the identifier of the switched application program; or the user operation information generated by the first external device includes a coordinate position of the switching control on the current interface of the first external device, an operation action of the user, and an identifier of the switched application program. Correspondingly, the screen projection control equipment generates a trigger event indicating that the target application program is switched to the switched application program according to the operation action of the user. Correspondingly, the screen projection control equipment controls the application program on the intelligent rearview mirror to be switched to the switched application program according to the trigger event.
Exemplarily, fig. 9 is a third schematic diagram of an interface change of the first external device provided in the present application. As shown in fig. 9, the interface 901 is an interface for a music application to screen, and a switching control is displayed on the interface 901, where the switching control is an identifier of a navigation application and an identifier of a weather application. After the user clicks the identifier of the navigation application, the interface 901 jumps to the interface 902, and the interface 902 displays the interface of the navigation application. It should be understood that the interface changes of the smart rearview mirror corresponding to fig. 9 may be the same as those of fig. 9.
To illustrate that the control method for the intelligent rearview mirror in the embodiment can realize screen projection of multiple applications, a control method for the intelligent rearview mirror in the prior art is first described.
In the screen projection mode in the prior art, a screen projection application program is set on an intelligent rearview mirror, and when a boundary of the application program is projected to an external device, the screen projection application program needs to be started to realize screen projection of an interface of the application program. The screen projection application program is integrated with a service logic code of the application program on the intelligent rearview mirror, and the service logic code of the application program and the screen projection code need to be called to realize screen projection. If an application program is added to the intelligent rearview mirror, the service logic code of the added application program needs to be copied to the screen projection application program, specifically to the installation package apk of the screen projection application program. In addition, in the prior art, the screen projection of each application program is realized in one process (namely, the screen projection application program), and in the prior art, the screen projection of an interface of one application program can be allowed only at the same time. In the prior art, when a user performs screen projection of an application program, the current screen-projected application program needs to be quitted and another application program needs to be projected, and therefore, multiple application programs cannot be projected to an external device at the same time.
In this embodiment, a Software Development Kit (SDK) is set in each application program in the smart rearview mirror, and the SDK is integrated with an operation for implementing a back-control service logic and controlling each application program to execute a corresponding operation. In the embodiment, when the application program is added, only the SDK needs to be integrated in the added application program, and the service logic code copy of the added application program is not needed, so that events are saved, and the screen projection reverse control expansion can be rapidly realized for other subsequent application programs.
Correspondingly, in this embodiment, the control method for the intelligent rearview mirror provided by the present application is further described with reference to fig. 10. Fig. 10 is a schematic view of a scenario in which the control method for an intelligent rearview mirror provided in the present application is applied, and as shown in fig. 10, the scenario includes a first external device and the intelligent rearview mirror. The intelligent rearview mirror comprises a screen projection control device and a plurality of application programs, such as a music application program, a navigation application program and a weather application program. The first external device is used for executing the action executed by the first external device in the embodiment, and the screen projection control device is used for executing the action executed by the screen projection control device.
After the screen projection control device receives a screen projection instruction, an application program needing screen projection is firstly registered in the screen projection control device, the screen projection control device creates a screen projection process of each screen projection application program, then the interface of the application program is controlled to project a screen to a first external device, and the state of the application program is stored as a screen projection state.
After the screen projection control device receives the user operation information from the first external device, a trigger Event MotionEvent may be generated according to the user operation information and the interface layout of the application program, and the trigger Event may be distributed to a screen projection process of a target application program (an application program displayed on a current interface of the first external device), and specifically may be distributed to an Event injection window (Event) in the screen projection process of the target application program, so as to control the target application program to implement counter control on the target application program by using counter control service logic in the SDK.
Correspondingly, when the application program exits the screen projection, the screen projection control device can modify the screen projection state of the application program into an exit state.
The control method for the intelligent rearview mirror provided by the embodiment can realize simultaneous screen projection of a plurality of application programs of the intelligent rearview mirror and switching of the plurality of screen projection application programs, so that the problems that when a user projects a screen of an application program in the prior art, the current screen projection application program needs to be quitted and another application program needs to be projected are solved, and the user experience is improved.
Fig. 11 is a first structural schematic diagram of the control device for the intelligent rearview mirror provided by the present application. The control device for the intelligent rearview mirror is screen projection control equipment in the embodiment. As shown in fig. 11, the control apparatus 1100 for the intelligent rear view mirror includes: a processing module 1101 and a transceiver module 1102.
The processing module 1101 is configured to obtain interface display information of the intelligent rearview mirror.
And the transceiver module 1102 is configured to send interface display information to at least one external device in communication connection with the intelligent rearview mirror.
Correspondingly, the processing module 1101 is further configured to control the intelligent rearview mirror to perform a corresponding operation in response to user operation information from the at least one external device, where the user operation information is used for describing an operation of the at least one external device by a user.
In one possible implementation manner, the interface display information of the intelligent rearview mirror is interface display information of an application program on the intelligent rearview mirror.
Accordingly, the processing module 1101 is specifically configured to control an application on the intelligent rearview mirror to perform a corresponding operation based on the user operation information.
In a possible implementation manner, the processing module 1101 is specifically configured to generate a trigger event according to the interface layout and the user operation information of the application program, where the trigger event instructs the application program to execute a corresponding operation; and controlling an application program on the intelligent rearview mirror to execute corresponding operation according to the trigger event.
In one possible implementation, the user operation information includes: and the coordinate position of the user on the current interface of the first external device, wherein the first external device is any one of the at least one external device.
Correspondingly, the processing module 1101 is specifically configured to convert the coordinate position of the user on the current interface of the first external device into the coordinate position on the current interface of the intelligent rearview mirror; and generating a trigger event according to the interface layout of the application program and the coordinate position on the current interface of the intelligent rearview mirror.
In a possible implementation manner, the processing module 1101 is specifically configured to determine, according to an interface layout of an application program, an operation control corresponding to a coordinate position on a current interface of the intelligent rearview mirror; and generating a trigger event according to the operation control.
In one possible implementation, the user operation information includes: and (4) operation actions of the user.
Correspondingly, the processing module 1101 is specifically configured to generate a trigger event according to the interface layout of the application program, the coordinate position on the current interface of the intelligent rearview mirror, and the operation action of the user.
In a possible implementation manner, the processing module 1101 is specifically configured to determine, according to a coordinate position of a user on a current interface of the first external device and a size of an interface of an application program displayed on the first external device, a relative position of the user on the interface of the application program displayed on the first external device; and determining the coordinate position of the current interface of the intelligent rearview mirror according to the relative position and the size of the interface of the application program displayed on the intelligent rearview mirror.
In a possible implementation manner, the processing module 1101 is specifically configured to determine, according to a coordinate position of a user operating on a current interface of the first external device and a coordinate position and a size of an interface of an application program displayed on the first external device, a relative position of the user operating on the interface of the application program displayed on the first external device; and determining the coordinate position of the current interface of the intelligent rearview mirror according to the relative position and the coordinate position and size of the interface of the application program displayed on the intelligent rearview mirror.
In one possible implementation, the application is multiple.
Correspondingly, the processing module 1101 is specifically configured to determine a target application program displayed on the current interface of the first external device; and generating a trigger event according to the interface layout of the target application program and the user operation information.
In a possible implementation manner, the processing module 1101 is specifically configured to use an application program displayed on the current interface of the intelligent rearview mirror as a target application program.
In a possible implementation manner, a switching control is further displayed on the current interface of the first external device, and the switching control indicates to switch a target application program displayed on the current interface of the first external device; correspondingly, the user operation information includes a coordinate position of the switching control on the current interface of the first external device and an identifier of the switched application program, and the trigger event indicates switching from the target application program to the switched application program.
Correspondingly, the processing module 1101 is specifically configured to control the target application on the intelligent rearview mirror to be switched to the switched application according to the trigger event.
In a possible implementation, the processing module 1101 is further configured to create a screen projection process for the application program.
In a possible implementation manner, the processing module 1101 is specifically configured to receive a screen projection instruction input by a user, record an interface of an application program on the intelligent rearview mirror, and obtain a video to be projected with a screen, where the screen projection instruction is used to instruct to project the interface of the application program to a first external device; and sending the video to be projected to the first external equipment.
In a possible implementation manner, the processing module 1101 is further configured to store the state of the application program as a screen projection state, modify the screen projection state of the application program into an exit state when the application program exits screen projection, and end the screen projection process of the application program.
Fig. 12 is a schematic structural diagram of a control device for an intelligent rearview mirror according to the present application. The control device for the intelligent rearview mirror is the first external device in the above embodiment. As shown in fig. 12, the control apparatus 1200 for an intelligent rear view mirror includes: a display module 1201, a processing module 1202 and a transceiving module 1203.
And the transceiver module 1203 is configured to receive interface display information from the screen projection control device.
And the display module 1201 is used for displaying the screen projection interface on the intelligent rearview mirror according to the interface display information.
The processing module 1202 is configured to generate user operation information if an operation of the user on the interface is detected.
The transceiver module 1203 is further configured to send user operation information to the screen projection control device.
In one possible implementation manner, the interface display information of the intelligent rearview mirror is interface display information of an application program on the intelligent rearview mirror.
In a possible implementation manner, the processing module 1202 is specifically configured to detect a coordinate position of an operation performed by a user on a current interface of the first external device, and generate user operation information.
In a possible implementation manner, the processing module 1202 is specifically configured to detect a coordinate position and an operation action of a user on a current interface of the first external device, and generate user operation information.
In a possible implementation manner, the number of the application programs is multiple, a switching control is further displayed on the current interface of the first external device, the switching control indicates to switch the target application program displayed on the current interface of the first external device, and the user operation information includes a coordinate position of the switching control on the current interface of the first external device and an identifier of the switched application program.
In a possible implementation manner, the transceiver module 1203 is further configured to receive a video to be screen-projected from the screen projection control device after being connected to the screen projection control device, where the video to be screen-projected is a video obtained by recording an interface of an application program.
Correspondingly, the display module 1201 is specifically configured to display an interface of an application program on the intelligent rearview mirror according to a video to be projected.
The principle and technical effect of the control device for the intelligent rearview mirror provided by the embodiment are similar to those of the control method for the intelligent rearview mirror, and are not repeated herein.
According to an embodiment of the present application, an electronic device and a readable storage medium are also provided. There is also provided, in accordance with an embodiment of the present application, a computer program product, including: a computer program, stored in a readable storage medium, from which at least one processor of the electronic device can read the computer program, the at least one processor executing the computer program causing the electronic device to perform the solution provided by any of the embodiments described above. Fig. 13 is a schematic structural diagram of an electronic device provided in the present application, where the electronic device may be an intelligent rearview mirror in the above embodiment. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.
As shown in fig. 13, the electronic apparatus includes: one or more processors 1301, memory 1302, and interfaces for connecting the various components, including high speed interfaces and low speed interfaces. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display graphical information of a GUI on an external input/output apparatus (such as a display device coupled to the interface). In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). Fig. 13 illustrates an example of a processor 1301.
Memory 1302 is a non-transitory computer readable storage medium as provided herein. Wherein the memory stores instructions executable by the at least one processor to cause the at least one processor to perform the control method for an intelligent rearview mirror provided herein. The non-transitory computer-readable storage medium of the present application stores computer instructions for causing a computer to execute the control method for an intelligent rearview mirror provided by the present application.
The memory 1302, as a non-transitory computer readable storage medium, may be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules corresponding to the control method for the intelligent rearview mirror in the embodiments of the present application. The processor 1301 executes various functional applications of the server and data processing by running non-transitory software programs, instructions, and modules stored in the memory 1302, that is, implements the control method for the intelligent rearview mirror in the above method embodiment.
The memory 1302 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of an electronic device for performing a control method for the intelligent rear view mirror, and the like. Further, the memory 1302 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, memory 1302 may optionally include memory located remotely from processor 1301, which may be connected via a network to an electronic device for performing the control method for the intelligent rearview mirror. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device for the control method of the intelligent rear view mirror may further include: an input device 1303 and an output device 1304. The processor 1301, the memory 1302, the input device 1303 and the output device 1304 may be connected by a bus or other means, and fig. 13 illustrates the bus connection.
The input device 1303 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic apparatus for performing the control method for the intelligent rearview mirror, such as an input device of a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointing stick, one or more mouse buttons, a track ball, a joystick, or the like. The output devices 1304 may include a display device, auxiliary lighting devices (e.g., LEDs), tactile feedback devices (e.g., vibrating motors), and the like. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device can be a touch screen.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, application specific ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present application may be executed in parallel, sequentially, or in different orders, as long as the desired results of the technical solutions disclosed in the present application can be achieved, and the present invention is not limited herein.
The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims (23)

1. A control method for an intelligent rearview mirror, comprising:
acquiring interface display information of an application program on the intelligent rearview mirror, wherein a software development tool (SDK) is arranged in the application program, and a service logic for realizing inverse control is integrated in the SDK so as to control the application program to execute corresponding operation;
sending the interface display information to at least one external device in communication connection with the intelligent rearview mirror;
responding to user operation information from the at least one external device, and controlling the intelligent rearview mirror to perform corresponding operation, wherein the user operation information is used for describing the operation of the user on the at least one external device, and the at least one external device comprises a first external device;
if the number of the application programs is multiple, a switching control is displayed on the current interface of the first external equipment, and the switching control indicates to switch the target application program displayed on the current interface of the first external equipment; the user operation information comprises a coordinate position of the switching control on the current interface of the first external device and an identifier of the switched application program.
2. The method of claim 1, wherein the controlling the smart rearview mirror to perform respective operations comprises:
and controlling the application program on the intelligent rearview mirror to execute corresponding operation based on the user operation information.
3. The method according to claim 2, wherein the controlling the application program on the smart rearview mirror to perform corresponding operations based on the user operation information comprises:
generating a trigger event according to the interface layout of the application program and the user operation information, wherein the trigger event indicates the application program to execute corresponding operation;
and controlling the application program on the intelligent rearview mirror to execute corresponding operation according to the trigger event.
4. The method of claim 3, wherein the user operation information comprises: the coordinate position of the user on the current interface of the first external device;
generating a trigger event according to the interface layout of the application program and the user operation information, wherein the trigger event comprises:
converting the coordinate position of the user operating on the current interface of the first external device into the coordinate position on the current interface of the intelligent rearview mirror;
and generating the trigger event according to the interface layout of the application program and the coordinate position on the current interface of the intelligent rearview mirror.
5. The method of claim 4, wherein the generating the trigger event according to the interface layout of the application program and the coordinate position on the current interface of the intelligent rearview mirror comprises:
determining an operation control corresponding to the coordinate position on the current interface of the intelligent rearview mirror according to the interface layout of the application program;
and generating the trigger event according to the operation control.
6. The method of claim 4, wherein the user operation information further comprises: the generating of the trigger event according to the interface layout of the application program and the coordinate position on the current interface of the intelligent rearview mirror by the operation action of the user includes:
and generating the trigger event according to the interface layout of the application program, the coordinate position on the current interface of the intelligent rearview mirror and the operation action of the user.
7. The method according to any one of claims 4-6, wherein the converting the coordinate position of the user operation on the first external device current interface to the coordinate position on the smart rearview mirror current interface comprises:
determining the relative position of the user operating on the interface of the application program displayed on the first external equipment according to the coordinate position of the user operating on the current interface of the first external equipment and the size of the interface of the application program displayed on the first external equipment;
and determining the coordinate position of the current interface of the intelligent rearview mirror according to the relative position and the size of the interface of the application program displayed on the intelligent rearview mirror.
8. The method of claim 7, wherein determining the relative position of the user operating on the interface of the application displayed on the first external device comprises:
determining the relative position of the user operating on the interface of the application program displayed on the first external equipment according to the coordinate position of the user operating on the current interface of the first external equipment and the coordinate position and the size of the interface of the application program displayed on the first external equipment;
correspondingly, the determining the coordinate position on the current interface of the intelligent rearview mirror comprises:
and determining the coordinate position of the current interface of the intelligent rearview mirror according to the relative position and the coordinate position and the size of the interface of the application program displayed on the intelligent rearview mirror.
9. The method according to any one of claims 3-6 and 8, wherein when the number of the application programs is multiple, the generating a trigger event according to the interface layout of the application program and the user operation information comprises:
determining a target application program displayed on a current interface of first external equipment;
and generating the trigger event according to the interface layout of the target application program and the user operation information.
10. The method of claim 9, wherein determining the target application displayed on the current interface of the first external device comprises:
and taking the application program displayed on the current interface of the intelligent rearview mirror as the target application program.
11. The method of claim 9, wherein the triggering event indicates a switch from the target application to the switched application;
the controlling the application program on the intelligent rearview mirror to execute corresponding operations according to the trigger event comprises the following steps:
and controlling the target application program on the intelligent rearview mirror to be switched to the switched application program according to the trigger event.
12. The method according to any one of claims 2-6 and 8, wherein before the obtaining the interface display information of the intelligent rearview mirror, the method further comprises:
and creating a screen projection process of the application program.
13. The method according to claim 12, wherein before the obtaining the interface display information of the intelligent rearview mirror, the method further comprises:
receiving a screen projection indication input by a user;
the interface display information of the application program is a video to be projected of the application program, and the acquiring of the interface display information of the intelligent rearview mirror comprises the following steps:
recording an interface of an application program on the intelligent rearview mirror to obtain the video to be projected.
14. The method of claim 13, wherein prior to recording the interface of the application on the smart rearview mirror, further comprising:
storing the state of the application program as a screen projection state;
the method further comprises the following steps:
and when the application program exits screen projection, modifying the screen projection state of the application program into an exit state, and finishing the screen projection process of the application program.
15. A control method for an intelligent rearview mirror, comprising:
receiving interface display information of an application program from screen projection control equipment, wherein a software development tool (SDK) is arranged in the application program, and a service logic for realizing inverse control is integrated in the SDK so as to control the application program to execute corresponding operation;
displaying an interface of a projection screen on the intelligent rearview mirror according to the interface display information;
if the operation of the user on the current interface of the first external equipment is detected, generating user operation information;
sending the user operation information to the screen projection control equipment;
if the number of the application programs is multiple, a switching control is displayed on the current interface of the first external equipment, and the switching control indicates to switch the target application program displayed on the current interface of the first external equipment; the user operation information comprises a coordinate position of the switching control on the current interface of the first external device and an identifier of the switched application program.
16. The method of claim 15, wherein detecting the user operation on the current interface of the first external device generates user operation information, including:
and detecting the coordinate position of the user on the current interface of the first external device, and generating the user operation information.
17. The method of claim 15, wherein detecting the user operation on the current interface of the first external device generates user operation information, including:
and detecting the coordinate position and the operation action of the user on the current interface of the first external device, and generating the user operation information.
18. The method of claim 15, further comprising:
after the screen projection control device is connected, receiving a video to be projected from the screen projection control device, wherein the video to be projected is a video obtained by recording an interface of the application program;
and displaying an interface of an application program on the intelligent rearview mirror according to the video to be projected.
19. A control device for an intelligent rearview mirror, comprising:
the system comprises a processing module, a display module and a control module, wherein the processing module is used for acquiring interface display information of an application program on the intelligent rearview mirror, a software development tool (SDK) is arranged in the application program, and a service logic for realizing inverse control is integrated in the SDK so as to control the application program to execute corresponding operation;
the receiving and transmitting module is used for sending the interface display information to at least one external device in communication connection with the intelligent rearview mirror;
the processing module is further configured to control the intelligent rearview mirror to perform a corresponding operation in response to user operation information from the at least one external device, where the user operation information is used to describe an operation of the user on the at least one external device, and the at least one external device includes a first external device;
if the number of the application programs is multiple, a switching control is displayed on the current interface of the first external equipment, and the switching control indicates to switch the target application program displayed on the current interface of the first external equipment; the user operation information comprises a coordinate position of the switching control on the current interface of the first external device and an identifier of the switched application program.
20. A control device for an intelligent rearview mirror, comprising:
the screen projection control device comprises a transceiving module, a display module and a display module, wherein the transceiving module is used for receiving interface display information of an application program from the screen projection control device, a software development tool (SDK) is arranged in the application program, and a service logic for realizing inverse control is integrated in the SDK so as to control the application program to execute corresponding operation;
the display module is used for displaying the screen projection interface on the intelligent rearview mirror according to the interface display information;
the processing module is used for generating user operation information if the operation of a user on the current interface of the first external equipment is detected;
the receiving and sending module is used for sending the user operation information to the screen projection control equipment;
if the number of the application programs is multiple, a switching control is displayed on the current interface of the first external equipment, and the switching control indicates to switch the target application program displayed on the current interface of the first external equipment; the user operation information comprises a coordinate position of the switching control on the current interface of the first external device and an identifier of the switched application program.
21. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; and
an output device; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the electronic device to perform the method of any of claims 1-18, the output device to display an interface of the electronic device.
22. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-18.
23. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-18.
CN202010474596.4A 2020-05-29 2020-05-29 Control method and device for intelligent rearview mirror, electronic equipment and storage medium Active CN111645521B (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN202010474596.4A CN111645521B (en) 2020-05-29 2020-05-29 Control method and device for intelligent rearview mirror, electronic equipment and storage medium
KR1020210041997A KR102501293B1 (en) 2020-05-29 2021-03-31 Control method and apparatus for smart rearview mirror, electronic device and storage medium
JP2021065849A JP7230093B2 (en) 2020-05-29 2021-04-08 Method, device, electronic device and storage medium for controlling smart rearview mirror

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010474596.4A CN111645521B (en) 2020-05-29 2020-05-29 Control method and device for intelligent rearview mirror, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN111645521A CN111645521A (en) 2020-09-11
CN111645521B true CN111645521B (en) 2022-01-18

Family

ID=72341537

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010474596.4A Active CN111645521B (en) 2020-05-29 2020-05-29 Control method and device for intelligent rearview mirror, electronic equipment and storage medium

Country Status (3)

Country Link
JP (1) JP7230093B2 (en)
KR (1) KR102501293B1 (en)
CN (1) CN111645521B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112379954A (en) * 2020-11-16 2021-02-19 北京百度网讯科技有限公司 Data processing method, device and equipment of application program and storage medium
CN113138737B (en) * 2021-04-16 2023-11-03 阿波罗智联(北京)科技有限公司 Display control method, device, equipment, medium and program product for screen-throwing scene
CN115941728A (en) * 2021-05-26 2023-04-07 阿波罗智联(北京)科技有限公司 Time delay estimation method and device for intelligent rearview mirror and electronic equipment
CN114153542A (en) * 2021-11-30 2022-03-08 阿波罗智联(北京)科技有限公司 Screen projection method and device, electronic equipment and computer readable storage medium
CN114228489A (en) * 2021-12-20 2022-03-25 广州小鹏汽车科技有限公司 Vehicle function information display processing method and device and vehicle
CN115550498B (en) * 2022-08-03 2024-04-02 阿波罗智联(北京)科技有限公司 Screen projection method, device, equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104883588A (en) * 2015-05-28 2015-09-02 广东好帮手电子科技股份有限公司 Vehicle multi-screen interconnection system and realization method thereof
CN105915978A (en) * 2015-12-14 2016-08-31 乐视致新电子科技（天津）有限公司 Vehicle-mounted display control method and device thereof
CN205890710U (en) * 2016-08-17 2017-01-18 北京高科中天技术股份有限公司 Multi -function vehicle carries intelligent rearview mirror system
CN108337667A (en) * 2018-02-12 2018-07-27 武汉卡比特信息有限公司 Mobile phone is throwing the device and method for shielding connection status bluetooth automatic matching and connecting with vehicle-mounted display terminal
US10338397B1 (en) * 2018-04-18 2019-07-02 Hyundai Mobis Co., Ltd. Vehicle head-up display device and control method thereof
CN110588346A (en) * 2019-08-22 2019-12-20 上海赫千电子科技有限公司 Multi-screen interaction system applied to automobile

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4837594B2 (en) 2007-02-16 2011-12-14 三菱電機株式会社 In-vehicle multimedia device
CN109240633B (en) * 2013-03-13 2021-10-22 歌乐株式会社 Display device and information terminal operation method
TWI535585B (en) * 2013-06-03 2016-06-01 鴻海精密工業股份有限公司 Car, driving assistance system and driving assistance device for car
JP2015187787A (en) * 2014-03-26 2015-10-29 船井電機株式会社 Car onboard device, portable terminal, and car onboard device system
JP2015219228A (en) 2014-05-21 2015-12-07 株式会社ナビタイムジャパン Information processing system, information processing device, information processing method, information processing program, and terminal device
KR101648022B1 (en) * 2015-01-09 2016-08-12 현대자동차주식회사 Vehicle and controlling method thereof
JP6775381B2 (en) * 2016-10-25 2020-10-28 クラリオン株式会社 In-vehicle device, mobile terminal identification method
US20180222391A1 (en) 2017-02-03 2018-08-09 Da Xiang CHEN Multi-function, Network Linked Smart Rearview Mirror
CN108447472B (en) 2017-02-16 2022-04-05 腾讯科技（深圳）有限公司 Voice wake-up method and device
US10482801B2 (en) 2017-03-22 2019-11-19 Solera Holdings, Inc. Start and stop methods for a vehicle smart mirror
US10596970B2 (en) 2017-08-25 2020-03-24 Panasonic Automotive Systems Company Of America, Division Of Panasonic Corporation Of North America Auto-switch display intelligent rearview mirror system
CN108501809A (en) 2018-03-26 2018-09-07 京东方科技集团股份有限公司 Vehicular display control device, display system based on Eye-controlling focus and display methods

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104883588A (en) * 2015-05-28 2015-09-02 广东好帮手电子科技股份有限公司 Vehicle multi-screen interconnection system and realization method thereof
CN105915978A (en) * 2015-12-14 2016-08-31 乐视致新电子科技（天津）有限公司 Vehicle-mounted display control method and device thereof
CN205890710U (en) * 2016-08-17 2017-01-18 北京高科中天技术股份有限公司 Multi -function vehicle carries intelligent rearview mirror system
CN108337667A (en) * 2018-02-12 2018-07-27 武汉卡比特信息有限公司 Mobile phone is throwing the device and method for shielding connection status bluetooth automatic matching and connecting with vehicle-mounted display terminal
US10338397B1 (en) * 2018-04-18 2019-07-02 Hyundai Mobis Co., Ltd. Vehicle head-up display device and control method thereof
CN110588346A (en) * 2019-08-22 2019-12-20 上海赫千电子科技有限公司 Multi-screen interaction system applied to automobile

Also Published As

Publication number Publication date
CN111645521A (en) 2020-09-11
KR102501293B1 (en) 2023-02-16
KR20210042862A (en) 2021-04-20
JP7230093B2 (en) 2023-02-28
JP2021108187A (en) 2021-07-29

Similar Documents

Publication Publication Date Title
CN111645521B (en) Control method and device for intelligent rearview mirror, electronic equipment and storage medium
CN111432070B (en) Application screen projection control method, device, equipment and medium
CN111666056B (en) Screen switching display method and device, intelligent rearview mirror and readable storage medium
CN111541919B (en) Video frame transmission method and device, electronic equipment and readable storage medium
CN111367452B (en) Equipment interaction method, device, equipment, system and medium
CN110297550B (en) Label display method and device, screen throwing equipment, terminal and storage medium
WO2019041982A1 (en) Display content control method, apparatus and system, storage medium, and electronic device
US20140282204A1 (en) Key input method and apparatus using random number in virtual keyboard
CN111688580B (en) Method and device for picking up sound by intelligent rearview mirror
CN111736785A (en) Control method, device and equipment for screen projection playing and computer storage medium
US10511700B2 (en) Communication terminal with first application displaying status of second application
KR20210033873A (en) Speech recognition control method, apparatus, electronic device and readable storage medium
KR20210038812A (en) Speech control method and apparatus, electronic device, and readable storage medium
CN111966939A (en) Page skipping method and device
CN110717999B (en) Communication method, communication device, electronic equipment and storage medium
CN113419452B (en) Vehicle, control method thereof and mobile terminal
CN106462352A (en) Fingerprint event processing method, apparatus, and terminal
CN112181582A (en) Method, apparatus, device and storage medium for device control
CN111707286A (en) Method and device for planning route
CN111881005A (en) Information display method, device, equipment and storage medium
CN114153542A (en) Screen projection method and device, electronic equipment and computer readable storage medium
CN112492520A (en) Positioning method, device, equipment and storage medium
CN112579032A (en) Intelligent equipment guiding method and device
CN110672112B (en) Guide wire switching method, device, apparatus, and medium
CN112017528B (en) Vehicle-mounted machine map configuration method and device and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20211026

Address after: 100176 101, floor 1, building 1, yard 7, Ruihe West 2nd Road, Beijing Economic and Technological Development Zone, Daxing District, Beijing

Applicant after: Apollo Zhilian (Beijing) Technology Co.,Ltd.

Address before: 2 / F, baidu building, 10 Shangdi 10th Street, Haidian District, Beijing 100085

Applicant before: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY Co.,Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant