CN114115673A - Control method of vehicle-mounted screen - Google Patents

Control method of vehicle-mounted screen Download PDF

Info

Publication number
CN114115673A
CN114115673A CN202111413839.4A CN202111413839A CN114115673A CN 114115673 A CN114115673 A CN 114115673A CN 202111413839 A CN202111413839 A CN 202111413839A CN 114115673 A CN114115673 A CN 114115673A
Authority
CN
China
Prior art keywords
touch
touch event
time
vehicle
attribute information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111413839.4A
Other languages
Chinese (zh)
Other versions
CN114115673B (en
Inventor
王本强
王树利
杨鹏
姚巧丽
刘延峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hisense Visual Technology Co Ltd
Original Assignee
Hisense Group Holding Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hisense Group Holding Co Ltd filed Critical Hisense Group Holding Co Ltd
Priority to CN202111413839.4A priority Critical patent/CN114115673B/en
Publication of CN114115673A publication Critical patent/CN114115673A/en
Application granted granted Critical
Publication of CN114115673B publication Critical patent/CN114115673B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485—Scrolling or panning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Navigation (AREA)

Abstract

The embodiment of the application discloses a control method of a vehicle-mounted screen, and belongs to the field of automobiles. The method comprises the following steps: the method comprises the steps that a vehicle-mounted host receives a touch event data packet sent by a mobile terminal, the touch event data packet comprises attribute information of a first touch event triggered on a screen of the mobile terminal by a user in a first time period, and screen display content of the mobile terminal is consistent with screen display content of the vehicle-mounted host. And the vehicle-mounted host determines the attribute information of the second touch event based on the attribute information of the first touch event and the historical touch event data packet received before the current time. And updating the screen display content of the vehicle-mounted host computer based on the attribute information of the second touch event, wherein the display screen of the vehicle-mounted host computer displays the second touch event when the current time is the touch time of the recombined touch point in the second touch event. In the embodiment of the application, the vehicle-mounted host can completely display the second touch event, and the problem that part of touch points are lost in the second touch event can be avoided.

Description

Control method of vehicle-mounted screen
Technical Field
The embodiment of the application relates to the field of automobiles, in particular to a control method of a vehicle-mounted screen.
Background
The vehicle-mounted screen is controlled by a passenger on the vehicle to remotely control a central control host computer screen of the vehicle through a mobile terminal, so that a picture which the passenger wants to display is displayed on the central control host computer screen, and the central control host computer screen is a display screen which is connected with a central control system on the vehicle and is controlled by the central control system.
In the related art, a connection may be established between the central control host and the mobile terminal, and the content of the screen of the central control host is displayed on the mobile terminal, so that the screen of the central control host is controlled by the mobile terminal. When a finger slides on the mobile terminal, a touch event is generated, and information associated with the touch event includes touch time of each touch point generated by the finger sliding, x and y coordinates of each touch point, and the like. The touch time of each touch point in the touch event information may be collectively referred to as the occurrence time of the touch event. The mobile terminal obtains the touch event information and transmits the touch event information to the central control host, the central control host sequentially searches each touch point with the same current time as the central control host according to the time sequence based on the touch time of each touch point, and displays the touch points on the screen of the central control host according to the x and y coordinates of each touch point.
However, due to the difference between the occurrence time of the touch event transmitted by the mobile terminal and the current time of the central control host, when the central control host searches for the touch point, some touch points with the touch time earlier than the current time of the central control host may be lost, resulting in the loss of some events, and further causing the screen of the central control host to be stuck or broken down.
Disclosure of Invention
The embodiment of the application provides a control method of a vehicle-mounted screen, which can solve the problem that part of touch events are lost in the related technology. The technical scheme is as follows:
in one aspect, a method for controlling a vehicle-mounted screen is provided, and the method includes:
the method comprises the steps that a vehicle-mounted host receives a touch event data packet sent by a mobile terminal, wherein the touch event data packet comprises attribute information of a first touch event triggered on a screen of the mobile terminal by a user in a first time period, the attribute information of the first touch event comprises attribute information of each initial touch point in at least one initial touch point, the attribute information of each initial touch point comprises touch time, the first time period is a time period from the time when the mobile terminal sends a touch event data packet last time before the current time to the time when the mobile terminal sends the touch event data packet currently, and screen display content of the mobile terminal is consistent with screen display content of the vehicle-mounted host;
the vehicle-mounted host determines attribute information of a second touch event based on the attribute information of the first touch event and a historical touch event data packet received before the current time, wherein the second touch event indicates that a first touch event triggered by a user on the screen of the mobile terminal is recombined into a touch event triggered by the user on the screen of the vehicle-mounted host, the attribute information of the second touch event comprises attribute information of each recombined touch point in at least one recombined touch point, each recombined touch point corresponds to an initial touch point, the attribute information of each recombined touch point comprises touch time, and the touch time of each recombined touch point is corrected based on the touch time of the corresponding initial touch point and the deviation between the touch system time of the mobile terminal and the system time of the vehicle-mounted host;
and updating the screen display content of the vehicle-mounted host computer by the vehicle-mounted host computer based on the attribute information of the second touch event, wherein the second touch event is displayed on the display screen of the vehicle-mounted host computer when the current time is the touch time of the recombined touch point in the second touch event.
Optionally, the method further comprises:
the method comprises the steps that when a touch event data packet sent by a mobile terminal is received for the first time, the vehicle-mounted host acquires touch time in the touch event data packet received for the first time;
and determining the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host machine based on the touch time in the touch event data packet received for the first time and the time of receiving the touch event data packet for the first time.
Optionally, the attribute information of the first touch event includes an event identifier of the first touch event;
the on-board host determines attribute information of a second touch event based on the attribute information of the first touch event and a historical touch event data packet received before the current time, and the determining includes:
judging whether an event identifier of the first touch event exists in a historical touch event data packet received before the current time;
if the event identifier of the first touch event does not exist in the historical touch event data packet received before the current time, generating a second touch event corresponding to the first touch event;
traversing each initial touch point of at least one initial touch point in the first touch event, and executing the following operations on each initial touch point to obtain attribute information of the second touch event:
and correcting the touch time of each initial touch point based on the touch time of each initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, and determining the corrected touch time of each initial touch point and other attribute information of each initial touch point as attribute information of a recombined touch point.
Optionally, the method further comprises:
if the event identifier of the first touch event exists in the historical touch event data packet received before the current time, traversing each initial touch point in at least one initial touch point in the first touch event, and executing the following operations on each initial touch point: correcting the touch time of each initial touch point based on the touch time of each initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, and determining the corrected touch time of each initial touch point and other attribute information of each initial touch point as attribute information of a recombined touch point;
and adding the obtained attribute information of at least one recombined touch point to the attribute information of the second touch event generated before the current time to obtain the updated attribute information of the second touch event.
Optionally, the attribute information of each initial touch point further includes position information and direction information; correspondingly, the attribute information of each recombined touch point also comprises position information and direction information;
the vehicle-mounted host updates the screen display content of the vehicle-mounted host based on the attribute information of the second touch event, and the updating comprises the following steps:
if the number of at least one recombined touch point corresponding to the second touch event is one, determining that the second touch event is a click operation, determining a click area on the vehicle-mounted host computer screen corresponding to the click operation based on the position information of the recombined touch point corresponding to the click operation, and updating the display content of the vehicle-mounted host computer screen based on the click area;
if the number of the at least one recombination touch point corresponding to the second touch event is multiple, determining that the second touch event is a sliding operation, determining a sliding area on the vehicle-mounted host screen corresponding to the sliding operation based on the position information of each recombination touch point corresponding to the sliding operation and the direction information of each corresponding recombination touch point, and updating the display content of the vehicle-mounted host screen based on the sliding area.
Optionally, the touch event data packet further includes attribute information of a third touch event triggered on the screen of the mobile terminal within a first time period by the user, where the third touch event and the first touch event are different touch events, the attribute information of the third touch event includes attribute information of each initial touch point in at least one initial touch point, and the attribute information of each initial touch point includes touch time;
the method further comprises the following steps:
the vehicle-mounted host determines attribute information of a fourth touch event based on the attribute information of the third touch event and a historical touch event data packet received before the current time, wherein the fourth touch event indicates that the third touch event triggered by the user on the screen of the mobile terminal is recombined into the touch event triggered by the user on the screen of the vehicle-mounted host, the attribute information of the fourth touch event comprises the attribute information of each recombined touch point in at least one recombined touch point, and the touch time of each recombined touch point in the fourth touch event is corrected based on the touch time of the corresponding initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host;
and updating the screen display content of the vehicle-mounted host computer by the vehicle-mounted host computer based on the attribute information of the fourth touch event, wherein the fourth touch event is displayed on the display screen of the vehicle-mounted host computer when the current time is the touch time of the recombined touch point in the fourth touch event.
In another aspect, there is provided another control method of an in-vehicle screen, the method including:
the method is realized by an operating system of a vehicle-mounted host, wherein the operating system of the vehicle-mounted host comprises a local layer and an application layer, and the method comprises the following steps:
the application layer receives a touch event data packet sent by a mobile terminal, wherein the touch event data packet comprises attribute information of a first touch event triggered on a screen of the mobile terminal by a user within a first time period, the attribute information of the first touch event comprises attribute information of each initial touch point in at least one initial touch point, the attribute information of each initial touch point comprises touch time, the first time period is a time period from the time when the mobile terminal sends the touch event data packet last time before the current time to the time when the mobile terminal sends the touch event data packet currently, and screen display content of the mobile terminal is consistent with screen display content of the vehicle-mounted host;
the application layer sends the attribute information of the first touch event to the local layer, the local layer stores the attribute information of the first touch event into a container of the local layer, and the local layer is provided with a time correction algorithm module;
the local layer calls the time correction algorithm module to correct the touch time of each initial touch point in the at least one initial touch point based on the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer, so as to obtain the updated attribute information of the first touch event;
and the local layer sends the updated attribute information of the first touch event to the application layer, and the application layer updates the screen display content of the vehicle-mounted host based on the updated attribute information of the first touch event.
Optionally, the method further comprises:
the method comprises the steps that when a touch event data packet sent by a mobile terminal is received for the first time, the application layer obtains touch time in the touch event data packet received for the first time;
the application layer determines the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer based on the touch time in the touch event data packet received for the first time and the time of receiving the touch event data packet for the first time;
and the application layer sends the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host to the local layer.
Optionally, the attribute information of each initial touch point further includes position information and direction information;
the application layer updates the screen display content of the vehicle-mounted host based on the updated attribute information of the first touch event, and the updating comprises the following steps:
if the number of at least one initial touch point corresponding to the first touch event in the updated attribute information is one, determining that the first touch event is a click operation, determining a click area on the vehicle-mounted host computer screen corresponding to the click operation based on the position information of the initial touch point corresponding to the click operation, and updating the display content of the vehicle-mounted host computer screen based on the click area;
if the number of at least one initial touch point corresponding to the first touch event in the updated attribute information is multiple, determining that the first touch event is a sliding operation, determining a sliding area on the vehicle-mounted host computer screen corresponding to the sliding operation based on the position information of each initial touch point corresponding to the sliding operation and the direction information of each corresponding initial touch point, and updating the display content of the vehicle-mounted host computer screen based on the sliding area.
Optionally, the touch event data packet further includes attribute information of a third touch event triggered on the screen of the mobile terminal within a first time period by the user, where the third touch event and the first touch event are different touch events;
the method further comprises the following steps:
the application layer sends the attribute information of the third touch event to the local layer, the local layer stores the attribute information of the third touch event into a container of the local layer, and the local layer is provided with a time correction algorithm module;
the local layer calls the time correction algorithm module to correct the touch time of each initial touch point in at least one initial touch point included in the third touch event based on the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer, so as to obtain the updated attribute information of the third touch event;
and the local layer sends the updated attribute information of the third touch event to the application layer, and the application layer updates the screen display content of the vehicle-mounted host based on the updated attribute information of the third touch event.
In another aspect, an electronic device is provided, which includes a processor configured to:
the method comprises the steps that a vehicle-mounted host receives a touch event data packet sent by a mobile terminal, wherein the touch event data packet comprises attribute information of a first touch event triggered on a screen of the mobile terminal by a user in a first time period, the attribute information of the first touch event comprises attribute information of each initial touch point in at least one initial touch point, the attribute information of each initial touch point comprises touch time, the first time period is a time period from the time when the mobile terminal sends a touch event data packet last time before the current time to the time when the mobile terminal sends the touch event data packet currently, and screen display content of the mobile terminal is consistent with screen display content of the vehicle-mounted host;
the vehicle-mounted host determines attribute information of a second touch event based on the attribute information of the first touch event and a historical touch event data packet received before the current time, wherein the second touch event indicates that a first touch event triggered by a user on the screen of the mobile terminal is recombined into a touch event triggered by the user on the screen of the vehicle-mounted host, the attribute information of the second touch event comprises attribute information of each recombined touch point in at least one recombined touch point, each recombined touch point corresponds to an initial touch point, the attribute information of each recombined touch point comprises touch time, and the touch time of each recombined touch point is corrected based on the touch time of the corresponding initial touch point and the deviation between the touch system time of the mobile terminal and the system time of the vehicle-mounted host;
and updating the screen display content of the vehicle-mounted host computer by the vehicle-mounted host computer based on the attribute information of the second touch event, wherein the second touch event is displayed on the display screen of the vehicle-mounted host computer when the current time is the touch time of the recombined touch point in the second touch event.
In another aspect, another electronic device is provided, which includes a processor configured to:
the application layer receives a touch event data packet sent by a mobile terminal, wherein the touch event data packet comprises attribute information of a first touch event triggered on a screen of the mobile terminal by a user within a first time period, the attribute information of the first touch event comprises attribute information of each initial touch point in at least one initial touch point, the attribute information of each initial touch point comprises touch time, the first time period is a time period from the time when the mobile terminal sends the touch event data packet last time before the current time to the time when the mobile terminal sends the touch event data packet currently, and screen display content of the mobile terminal is consistent with screen display content of the vehicle-mounted host;
the application layer sends the attribute information of the first touch event to the local layer, the local layer stores the attribute information of the first touch event into a container of the local layer, and the local layer is provided with a time correction algorithm module;
the local layer calls the time correction algorithm module to correct the touch time of each initial touch point in the at least one initial touch point based on the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer, so as to obtain the updated attribute information of the first touch event;
and the local layer sends the updated attribute information of the first touch event to the application layer, and the application layer updates the screen display content of the vehicle-mounted host based on the updated attribute information of the first touch event.
The technical scheme provided by the embodiment of the application can at least bring the following beneficial effects:
in the embodiment of the application, the vehicle-mounted host firstly receives a touch event data packet sent by the mobile terminal, the touch event data packet includes attribute information of a first touch event triggered on a screen of the mobile terminal by a user within a period of time, and the attribute information of the first touch event includes touch time of each initial touch point in at least one initial touch point. Attribute information for a second touch event is then determined based on the attribute information for the first touch event and historical touch event data packets received prior to the current time. And updating the screen display content of the vehicle-mounted host computer based on the attribute information of the second touch event. The second touch event is a recombination of the first touch event and the historical touch event, the attribute information of the second touch event comprises touch time of each recombined touch point, and the touch time of each recombined touch point is obtained by correcting the touch time based on the touch time of the corresponding initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, so that the touch time of the recombined touch points can be corrected to be time under an operating system of the vehicle-mounted host.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a schematic illustration of an implementation environment provided by an embodiment of the present application;
FIG. 2 is a schematic diagram of a connection relationship between screens provided in an embodiment of the present application;
fig. 3 is a schematic diagram of an initial state of a screen of a mobile terminal according to an embodiment of the present application;
FIG. 4 is a diagram illustrating an initial state of a main screen of a vehicle-mounted host according to an embodiment of the present disclosure;
fig. 5 is a schematic diagram of a pop-up screen selection icon of a mobile terminal according to an embodiment of the present application;
fig. 6 is a schematic diagram of a screen state of a mobile terminal according to an embodiment of the present application;
FIG. 7 is a diagram illustrating a main screen state of an in-vehicle host provided in an embodiment of the present application;
FIG. 8 is a flowchart of a control method for a vehicle-mounted screen according to an embodiment of the present disclosure;
FIG. 9 is a flowchart of another control method for a vehicle screen according to an embodiment of the present disclosure;
FIG. 10 is a flowchart of another control method for a vehicle screen according to an embodiment of the present disclosure;
fig. 11 is a schematic structural diagram of a mobile terminal according to an embodiment of the present application.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present application more clear, the embodiments of the present application will be further described in detail with reference to the accompanying drawings.
Before explaining the control method of the on-board screen provided in the embodiment of the present application in detail, an application scenario and an implementation environment provided in the embodiment of the present application are introduced.
In the field of automobiles, by connecting the on-board host computer with the mobile terminal of a user in a communication manner, the user can control the screen of the on-board host computer by using the mobile terminal in the hand, so that the screen of the on-board host computer displays the picture desired by the user.
At present, a method for controlling a screen of a vehicle-mounted host computer is to set an Application Program in a special API (Application Program Interface) layer on a mobile terminal, and control the screen of the vehicle-mounted host computer by using the Application Program. The application has a plurality of virtual buttons on its interface, and these different virtual buttons indicate different operation information, such as a "screen zoom-in" virtual button indicating a screen zoom-in operation and a "screen zoom-out" virtual button indicating a screen zoom-out operation. For example, when the user clicks a virtual button of "screen zoom" on the interface of the application program, the mobile terminal receives operation information of a screen zoom indicated by the virtual button of "screen zoom" and transmits the operation information to the in-vehicle host, and after receiving the operation information, the in-vehicle host displays the content of the screen zoom on the screen of the in-vehicle host. However, in this case, the screen content of the in-vehicle host is not displayed on the mobile terminal of the user, that is, the user can only click the virtual button of the application on the mobile terminal, and cannot see the picture displayed by the corresponding operation on the mobile terminal in real time.
In order to solve the problem that the content same as that of the screen of the vehicle-mounted host computer cannot be displayed on the screen of the mobile terminal in real time, a method is also provided in the prior art. The method comprises the steps of establishing connection between a vehicle-mounted host and a mobile terminal of a user, displaying the content of a screen of the vehicle-mounted host on the mobile terminal of the user, and further controlling the screen of the vehicle-mounted host by the user through the mobile terminal. When a user slides on the mobile terminal, the mobile terminal transmits information of the user sliding, namely, generated touch event information to the vehicle-mounted host, wherein the touch event information comprises touch time of each touch point. And the vehicle-mounted host displays the touch event on the screen of the vehicle-mounted host based on the touch time of each touch point in the touch event information at the current time of the vehicle-mounted host based on the received touch event information. However, due to the difference between the touch time of each touch point in the touch event information transmitted by the mobile terminal and the current time of the vehicle-mounted host, when the vehicle-mounted host displays the touch event, some touch points with the touch time earlier than the current time of the vehicle-mounted host may be lost, and the screen of the vehicle-mounted host may be stuck.
Moreover, both methods only support single-click operation, the first method for setting a virtual button on an application program interface can only control single-finger click of a screen of the vehicle-mounted host computer, and the second method can only support that the vehicle-mounted host computer can display a picture corresponding to corresponding operation when a user touches the mobile terminal with a single finger.
In the embodiment of the present application, the touch time of each recombined touch point is corrected to be the operating system down time of the vehicle-mounted host by correcting the touch time of each initial touch point in the touch event data packet received by the vehicle-mounted host, so that the touch event can be completely displayed on the screen of the vehicle-mounted host. In addition, the control method of the vehicle-mounted host provided by the embodiment of the application can support a click or slide event generated by multi-finger operation of a user on the mobile terminal.
Referring to FIG. 1, FIG. 1 is a schematic diagram illustrating an implementation environment in accordance with an example embodiment. The implementation environment comprises at least one mobile terminal 101 and a vehicle-mounted host 102, and the mobile terminal 101 can be in communication connection with the vehicle-mounted host 102. The communication connection may be a wired connection or a wireless connection, which is not limited in this embodiment of the present application.
The mobile terminal 101 is configured to request a control management service for a screen of the in-vehicle host 102, and request a screen of the in-vehicle host 102 that needs to be controlled. The in-vehicle host 102 is used to run a screen control management service of the in-vehicle host 102.
Specifically, after the communication connection between the mobile terminal 101 and the vehicle-mounted host 102 is established, the mobile terminal 101 may send a screen control request to the vehicle-mounted host 102, where the screen control request carries information that the mobile terminal 101 controls a screen of the vehicle-mounted host 102, and when the vehicle-mounted host 102 receives the screen control request, the vehicle-mounted host 102 sends the screen content corresponding to the vehicle-mounted host 102 to the mobile terminal 101 according to the information carried in the screen control request, and the mobile terminal 101 receives and displays the screen content transmitted by the vehicle-mounted host 102 on the screen of the mobile terminal 101. As shown in fig. 2, the screens of this in-vehicle host 102 include a main screen located near the driver's seat, a sub-screen 1 located near the sub-driver's seat, and a sub-screen 2 located near the rear seat. For example, the mobile terminal 101 may transmit a screen control request to the in-vehicle host 102, the screen control request carrying information that the mobile terminal 101 controls the main screen of the in-vehicle host 102, and after the in-vehicle host 102 receives the information carried in the screen control request, that is, the content of the main screen of the in-vehicle host 102 is transmitted to the mobile terminal 101, and the mobile terminal 101 receives and displays the content of the main screen of the in-vehicle host 102 on the screen of the mobile terminal 101.
When a user clicks or slides a screen on the mobile terminal 101, the operation is a touch event, information associated with the touch event may be referred to as touch event information, the mobile terminal 101 converts the touch event information into binary data in a serialized manner, and then encodes the binary data into a character string and transmits the character string to the vehicle-mounted host 102. The vehicle-mounted host 102 receives the character string transmitted by the mobile terminal 101, decodes the character string, performs deserialization analysis on the decoded binary data, and finally obtains the touch event information. The in-vehicle host 102 reproduces the touch event on the screen of the in-vehicle host 102 based on the touch event information.
Illustratively, initially, the screen of the mobile terminal 101 is in a most initial state as shown in fig. 3, with icons of various applications on the screen of the mobile terminal 101. For example, the main screen of the in-vehicle host 102 is also in the initial state as shown in fig. 4, and in this case, the screen contents of the main screen and the sub-screen of the in-vehicle host 102 may be the same or different. The screen content of the mobile terminal 101 is different from that of the in-vehicle host 102.
The user clicks the "screen control" icon on the right side of the "application" icon in the lower right corner of the mobile terminal 101 in fig. 3, and at this time, as shown in fig. 5, screen selection icons of "main control screen" and "sub control screen" pop up on the screen of the mobile terminal 101, and the user can select the main screen or the sub screen for controlling the in-vehicle host 102.
When the user selects "control the home screen", the mobile terminal 101 receives information that the user selects "control the home screen", and transmits the information to the in-vehicle host 102. After receiving the information, the in-vehicle host 102 transmits the contents of the main screen of the in-vehicle host 102 to the mobile terminal 101. The mobile terminal 101 receives the contents of the main screen of the in-vehicle host 102 and displays the contents of the main screen of the in-vehicle host 102 on the screen of the mobile terminal 101. That is, the screen of the mobile terminal 101 enters the same screen state as the main screen of the in-vehicle host 102, and the user can generate the same operation effect on the main screen of the in-vehicle host 102 as that on the mobile terminal 101 by operating the mobile terminal 101. The screen contents of the mobile terminal 101 are as shown in fig. 6, and the screen contents of the main screen of the in-vehicle host 102 are as shown in fig. 7, and the screen contents of both are kept identical. At this time, the driver or other users near the main screen can also operate in parallel on the main screen, and the content of the corresponding operation triggered on the main screen of the in-vehicle host computer is also displayed on the screen of the mobile terminal. That is, the content on the main screen of the in-vehicle host is displayed on the screen of the mobile terminal in real time.
After the user selects the "control sub screen", icons of the "control sub screen 1" and the "control sub screen 2" pop up on the screen of the mobile terminal 101, the user selects and clicks the icon, and the mobile terminal 101 receives information of the icon clicked by the user and sends the information to the vehicle-mounted host 102. After receiving the information, the in-vehicle host 102 transmits the contents of the corresponding sub-screen of the in-vehicle host 102 to the mobile terminal 101. The mobile terminal 101 receives the contents of the sub-screen of the in-vehicle host 102 and displays the contents of the sub-screen of the in-vehicle host 102 on the screen of the mobile terminal 101. That is, the screen of the mobile terminal 101 enters the same screen state as the sub-screen interface under the corresponding operation by the user. If "control the sub-screen 1", the screen of the mobile terminal 101 enters the same screen state as the sub-screen 1 of the in-vehicle host 102, and then, the user operates the mobile terminal 101 to generate the same operation effect on the sub-screen 1 of the in-vehicle host 102 as that on the mobile terminal 101, and the screen contents of the two are kept consistent. At this time, other users near the sub-screen 1 may also perform parallel operations on the sub-screen, and the content of the corresponding operation triggered on the sub-screen of the in-vehicle host is also displayed on the screen of the mobile terminal. That is, the content on the secondary screen of the vehicle-mounted host computer can be displayed on the screen of the mobile terminal in real time.
The mobile terminal 101 may be any electronic product capable of performing human-computer interaction with a user through one or more modes such as a keyboard, a touch pad, a touch screen, a remote controller, voice interaction, or a handwriting device, and the electronic product is configured with an android system. Examples of the PC include a Personal Computer (PC), a mobile phone, a smart phone, a Personal Digital Assistant (PDA), a Personal Digital Assistant (ppc) (pocket PC), and a tablet PC.
The in-vehicle host 102 may be an electronic computer controlled by the central control system of the automobile.
In addition, the operating system of the vehicle-mounted host can be an android system or other operating systems. Under the scene that the operating system of the vehicle-mounted host is an android system, the operating system of the vehicle-mounted host comprises an application layer, a framework layer, a JNI (Java Native Interface, object-oriented local Interface), a local layer and a core layer.
The application layer mainly runs various application programs. The application programs comprise an instant messaging client, a short message program, a calendar, a map, a browser, a contact management program and the like, and all the application programs in the application layer are written by using java language.
The framework layer is primarily to provide developers with full access to the API framework used by the core application, which is actually an application framework. Because the application program in the application layer is written by java, the architecture layer is also written by java language, and the architecture layer comprises various controls required in the application program, such as embedded browser, buttons, text boxes and other controls.
The local layer comprises an android operating environment and various program libraries. The android operating environment mainly refers to a Dalvik virtual machine. Various libraries are used by different controls in the framework layer, and further services are provided for developers through the framework layer. In the android system, running of various applications requires support of libraries in the local layer, and then the applications are run through Dalvik virtual machines in the running environment. The native layer is written in the C/C + + language.
The JNI layer is a native programming interface in the android system. The application layer and the framework layer are realized by java language, the local layer is realized by C/C + + language, and the JNI layer is used as a bridge for interaction among the layer structures using different languages.
The kernel layer provides underlying drivers for various hardware of the android device, and the android device provides kernel system services based on the kernel layer, such as basic service capabilities of operating systems of file management, memory management, process management, network stack, driver models and the like.
Those skilled in the art should understand that the mobile terminal 101 and the vehicle-mounted host 102 are only examples, and other existing or future mobile terminals or vehicle-mounted hosts may be applicable to the embodiments of the present application, and are included in the scope of the embodiments of the present application and are herein incorporated by reference.
The following explains the control method of the in-vehicle screen provided in the embodiment of the present application in detail.
Fig. 8 is a flowchart of a control method for an in-vehicle screen provided in an embodiment of the present application, where the method is applied to an in-vehicle host. Referring to fig. 8, the method includes the following steps.
Step 801: the method comprises the steps that a vehicle-mounted host receives a touch event data packet sent by a mobile terminal, the touch event data packet comprises attribute information of a first touch event triggered on a screen of the mobile terminal by a user in a first time period, the attribute information of the first touch event comprises attribute information of each initial touch point in at least one initial touch point, the attribute information of each initial touch point comprises touch time, the first time period is a time period from the time when the mobile terminal sends the touch event data packet last time before the current time to the time when the mobile terminal sends the touch event data packet currently, and screen display content of the mobile terminal is consistent with screen display content of the vehicle-mounted host.
When a user starts to touch the screen with a single finger until the user leaves the screen with the single finger, the operation of the user on the mobile terminal in the time period is called a touch event, namely a first touch event. Correspondingly, when the user touches the screen with two fingers and leaves the screen with two fingers, the mobile terminal obtains two touch events according to respective operations of the two fingers in the time period, wherein the operation of each finger is one touch event.
When a single finger of a user starts to touch the screen, that is, a touch point is generated on the screen of the mobile terminal, the mobile terminal starts to acquire information carried by the touch point, wherein the touch point is a contact point between a center point of the finger of the user and the screen of the mobile terminal. When a user single finger continuously slides on a screen, the user finger continuously moves on the screen of the mobile terminal in the sliding process, a new touch point is generated when the user finger continuously moves once, the mobile terminal continuously acquires information carried by the touch points until the user single finger leaves the screen, the mobile terminal acquires information carried by the touch points generated when the user finger finally touches the screen, the mobile terminal acquires information carried by all the touch points generated under the sliding operation of the user in the time period, and the information carried by each touch point can be called as attribute information of the touch point. All touch points constitute the touch event, and therefore the attribute information of all touch points is taken as the attribute information of the touch event.
When a user touches the screen with a single finger to generate a touch point, the attribute information of the touch point includes touch time, position information, direction information, pressure information, touch type and other information of the touch point.
Specifically, the touch time of a touch point is the time for generating the touch point, the position information of the touch point includes x and y coordinates where the touch point is located and the size of an area where a whole finger covers a screen when a user touches the screen of the mobile terminal, the direction information of the touch point is the moving direction indicated by the touch point, such as left and right, the pressure information of the touch point is the pressure of the touch point touching the screen of the mobile terminal, and the touch type of the touch point is single click, double click, long press, short press and the like of the touch point.
The mobile terminal senses the operation of a user on a screen of the mobile terminal in real time and sends attribute information of a touch event formed by the operation to the vehicle-mounted host in real time. In real time, namely, the mobile terminal packs the attribute information of the touch event acquired in a fixed time period into a touch event data packet and sends the touch event data packet to the vehicle-mounted host at regular intervals. The attribute information of the touch event is attribute information of all touch points generated by the user during the period of time. This fixed period of time is referred to as a first period of time.
For real-time purposes, the first time period is a shorter time period. For example, the mobile terminal sends the attribute information of all touch points generated within 10 milliseconds to the vehicle-mounted host computer as a touch event data packet every 10 milliseconds. During this period, the operation process of touching the screen of the mobile terminal by the finger of the user may not be finished yet, and therefore, the in-vehicle host receives the touch event data packet sent by the mobile terminal and only includes the attribute information of a part of the touch events generated during the operation process of the user, that is, the touch event data packet may only include the attribute information of a part of the touch events in the first touch event.
In addition, when the mobile terminal sends the touch event data packet, identification information capable of uniquely identifying the touch event is generated, and the identification information may also be referred to as an event identifier of the touch event. Therefore, when the mobile terminal sequentially sends the touch event data packets to the vehicle-mounted host, some touch event data packets with the same event identifier may exist in the sequentially sent touch event data packets.
Step 802: the vehicle-mounted host determines attribute information of a second touch event based on the attribute information of the first touch event and a historical touch event data packet received before the current time, wherein the second touch event indicates that the first touch event triggered by a user on a mobile terminal screen is recombined into the touch event triggered by the user on the vehicle-mounted host screen, the attribute information of the second touch event comprises the attribute information of each recombined touch point in at least one recombined touch point, each recombined touch point corresponds to an initial touch point, the attribute information of each recombined touch point comprises touch time, and the touch time of each recombined touch point is corrected based on the touch time of the corresponding initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host.
And the mobile terminal sends the touch event data packet generated in the period of time to the vehicle-mounted host every other fixed period of time. In this way, the on-board host can obtain a plurality of touch event data packets. In addition to the touch event data packets received at the current time, other touch event data packets of the plurality of touch event data packets are also referred to as historical touch event data packets.
Because one touch event data packet sent by the mobile terminal may only include a part of touch events in the first touch event, when the mobile terminal sends the touch event data packets to the vehicle-mounted host in sequence, some touch event data packets with the same event identification may exist in the touch event data packets sent in sequence, in step 802, the touch events in the touch event data packets sent by the mobile terminal are firstly recombined to obtain a new touch event, and the new touch event is determined as the second touch event. Each touch point in the first touch event is called an initial touch point, and each touch point in the second touch event is called a recombination touch point.
Further, since there may be a difference between the system time of the mobile terminal and the system time of the in-vehicle host, illustratively, as shown in fig. 6 and 7, the system time on the screen of the mobile terminal in fig. 6 is 11:20, and the system time on the main screen of the in-vehicle host in fig. 7 is 11:21, which are different in time. Under the condition that the transmission delay generated in the process that the mobile terminal sends the touch event data packet to the vehicle-mounted host is not considered, the touch time in the touch event data packet received by the vehicle-mounted host and the time for the vehicle-mounted host to receive the touch event data packet may be different, so that the touch time in the touch event data packet received by the vehicle-mounted host needs to be corrected, that is, the touch time of each initial touch point in the touch event data packet is corrected.
Thus, in some embodiments, the implementation process of determining the attribute information of the second touch event based on the attribute information of the first touch event and the historical touch event data packet received before the current time can be divided into the following two steps.
The method comprises the following steps: and judging whether the event identification of the first touch event exists in the historical touch event data packet received before the current time.
Step two: if the event identifier of the first touch event does not exist in the historical touch event data packet received before the current time, generating a second touch event corresponding to the first touch event, traversing each initial touch point in at least one initial touch point in the first touch event, and executing the following operation on each initial touch point to obtain attribute information of the second touch event: and correcting the touch time of each initial touch point based on the touch time of each initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, and determining the corrected touch time of each initial touch point and other attribute information of each initial touch point as attribute information of a recombined touch point.
Step three: if the event identifier of the first touch event exists in the historical touch event data packet received before the current time, traversing each initial touch point in at least one initial touch point in the first touch event, and executing the following operations on each initial touch point: and correcting the touch time of each initial touch point based on the touch time of each initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, and determining the corrected touch time of each initial touch point and other attribute information of each initial touch point as attribute information of a recombined touch point. And adding the obtained attribute information of at least one recombined touch point to the attribute information of the second touch event generated before the current time to obtain the updated attribute information of the second touch event.
In the first step, the vehicle-mounted host judges whether event identifiers identical to the event identifiers of the first touch events exist in the historical touch event data packets or not according to the event identifiers of the first touch events in the touch event data packets received at the current time and the event identifiers of the touch events in the historical touch event data packets received before the current time. Thus, the operations in step two and step three are obtained.
In step two, if there is no event identifier in the historical touch event data packet that is the same as the event identifier of the first touch event in the touch event data packet received at the current time, that is, the touch event in the touch event data packet received at the current time is a new first touch event. At this time, a second touch event corresponding to the first touch event is generated, and each initial touch point in the first touch event is traversed to regenerate the attribute information of the recombined touch point corresponding to each initial touch point.
For each initial touch point, the attribute information of each recombined touch point corresponding to each initial touch point can be regenerated according to the following method. Therefore, the following embodiments take the first initial touch point in the first touch event as an example to illustrate, and based on the first initial touch point in the first touch event, the attribute information of the first recombined touch point corresponding to the first initial touch point is regenerated.
Based on the first initial touch point in the first touch event, the specific operation of regenerating the attribute information of the first recombined touch point corresponding to the first initial touch point is as follows: and correcting the touch time of the first initial touch point, subtracting the touch time of the first initial touch point from the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host to obtain the touch time of the first recombined touch point corresponding to the first initial touch point, and determining the touch time of the first recombined touch point and other attribute information of the first initial touch point as the attribute information of the first recombined touch point in the second touch event.
In addition, generating the second touch event corresponding to the first touch event specifically includes: and generating an event identification of a second touch event based on the event identification of the first touch event. The event identifier of the second touch event may also be directly the event identifier of the first touch event.
In step three, if an event identifier identical to the event identifier of the first touch event in the touch event data packet received at the current time exists in the historical touch event data packet, that is, the touch event in the touch event data packet received at the current time and the touch event having the identical event identifier in the historical touch event data packet are the same touch event. At this time, traversing each initial touch point in the first touch event to regenerate the attribute information of the recombined touch point corresponding to each initial touch point, and adding the obtained attribute information of each recombined touch point to the attribute information of the second touch event which has been generated before the current time to obtain the updated attribute information of the second touch event.
Since the vehicle-mounted host processes the received touch event data packet in real time, when the vehicle-mounted host receives the historical touch event data packet sent by the mobile terminal, the vehicle-mounted host will immediately process the attribute information of the touch event in the historical touch event data packet. Therefore, if the on-board host has generated the second touch event based on the historical touch event data packet before the current time, when the on-board host receives one touch event data packet at the current time, the on-board host may directly traverse each initial touch point in the touch event data packet received at the current time to regenerate the attribute information of the reformed touch point corresponding to each initial touch point. And finally, adding the attribute information of each recombined touch point to the generated attribute information of the second touch event one by one to finally obtain the updated attribute information of the second touch event.
The specific operation of traversing each initial touch point in the touch event data packet received at the current time and regenerating the attribute information of the recombined touch point corresponding to each initial touch point is completely the same as the method for regenerating the attribute information of the recombined touch point corresponding to each initial touch point in the step two, and details are not repeated here.
For example, if the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host is 1s, the touch time of the first initial touch point in the first touch event in the touch event data packet received at the current time is 10:00:50, the touch time of the second initial touch point is 10:00:55, and based on the deviation of 1s between the system time of the mobile terminal and the system time of the vehicle-mounted host, the touch time of the first recombined touch point is 10:00:49, and the touch time of the second recombined touch point is 10:00: 54.
For example, if the event identifier of the first touch event in the touch event data packet received by the user at the current time is a, if the event identifier of the first touch event does not exist in the historical touch event data packet, the second touch event corresponding to the first touch event in the touch event data packet received at the current time is generated. If the historical touch event data packet has the touch event with the event identifier A, it is indicated that the touch event with the event identifier A in the historical touch event data packet and the touch event in the touch event data packet received at the current time are the same touch event, the touch time of each initial touch point in the first touch event in the touch event data packet received at the current time is corrected to obtain the touch time of the recombination touch point corresponding to each initial touch point, then the touch time of each recombination touch point and other attribute information of the corresponding initial touch point are used as the attribute information of the recombination touch point to obtain the attribute information of each recombination touch point, and finally the attribute information of each recombination touch point is added to the previously generated attribute information of the second touch event.
In addition, the implementation process of determining the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host may be as follows: when the vehicle-mounted host receives the touch event data packet sent by the mobile terminal for the first time, the vehicle-mounted host acquires the touch time of the touch event data packet received for the first time. And determining the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host machine based on the touch time in the touch event data packet received for the first time and the time of receiving the touch event data packet for the first time.
The mobile terminal sends the touch event data packet to the vehicle-mounted host at a fixed time interval, so that the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host can be obtained only based on the touch time in the touch event data packet received by the vehicle-mounted host for the first time and the time for receiving the touch event data packet for the first time.
When the touch event data packet received by the vehicle-mounted host for the first time only comprises one touch point, acquiring the time of the touch event data packet received by the vehicle-mounted host, namely the touch time of the touch point and the time of the vehicle-mounted host for receiving the touch event data packet, and subtracting the touch time of the touch event data packet received by the vehicle-mounted host from the time of the vehicle-mounted host for receiving the touch event data packet, so as to obtain the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host.
When the touch event data packet received by the vehicle-mounted host for the first time comprises a plurality of touch points, acquiring the touch time of the last touch point in the touch event data packet received by the vehicle-mounted host and the time of the vehicle-mounted host for receiving the touch event data packet, and subtracting the touch time of the last touch point in the touch event data packet received by the vehicle-mounted host from the time of the vehicle-mounted host for receiving the touch event data packet, so as to obtain the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host.
For example, if the touch event data packet received by the vehicle-mounted host for the first time only includes one touch point, the touch time of the touch point in the touch event data packet received by the vehicle-mounted host is 10:00:10, the time of the vehicle-mounted host receiving the touch event data packet is 10:00:09, and the difference between the touch time of the touch point in the touch event data packet received by the vehicle-mounted host and the time of the vehicle-mounted host receiving the touch event data packet is obtained to obtain the deviation 1s between the system time of the mobile terminal and the system time of the vehicle-mounted host.
If the touch event data packet received by the vehicle-mounted host for the first time comprises three touch points, the touch time of the three touch points is respectively as follows: 10:00:09, 10:00:11 and 10:00:15, namely, taking the touch time 10:00:15 of the last touch point as the touch time in the touch event data packet received by the vehicle-mounted host, wherein the time for the vehicle-mounted host to receive the touch event data packet is 10:00:14, and subtracting the touch time of the last touch point in the touch event data packet received by the vehicle-mounted host from the time for the vehicle-mounted host to receive the touch event data packet to obtain the deviation 1s between the system time of the mobile terminal and the system time of the vehicle-mounted host.
Step 803: and updating the screen display content of the vehicle-mounted host computer based on the attribute information of the second touch event, wherein the display screen of the vehicle-mounted host computer displays the second touch event when the current time is the touch time of the recombined touch point in the second touch event.
The above step 801 describes the attribute information of the first touch event in detail, and since the first touch event may include one initial touch point or a plurality of initial touch points, the attribute information of the first touch event includes attribute information of at least one initial touch point corresponding to the first touch event. Correspondingly, the attribute information of the second touch event also includes attribute information of at least one reorganization touch point corresponding to the second touch event.
After the attribute information of the second touch event is obtained, the implementation process of updating the screen display content of the vehicle-mounted host may be as follows: and if the number of the at least one recombined touch point corresponding to the second touch event is one, determining that the second touch event is a click operation, determining a click area on the screen of the vehicle-mounted host corresponding to the click operation based on the position information of the touch point corresponding to the click operation, and updating the display content of the screen of the vehicle-mounted host based on the click area. And if the number of the at least one recombination touch point corresponding to the second touch event is multiple, determining that the second touch event is a sliding operation, determining a sliding area on the vehicle-mounted host screen corresponding to the sliding operation based on the position information of each recombination touch point corresponding to the sliding operation and the direction information of each corresponding recombination touch point, and updating the display content of the vehicle-mounted host screen based on the sliding area.
The position information of the touch point comprises the x and y coordinates of the touch point and the size of the area of the screen covered by the whole finger when the user touches the screen of the mobile terminal. In this scenario, based on the position information of the touch point corresponding to the click operation, the implementation process of determining the click area on the screen of the vehicle-mounted host corresponding to the click operation may be: and taking the position corresponding to the x and y coordinates of the recombined touch point as a geometric center, determining a screen area which takes the geometric center as a circle center and comprises a position when the user finger covers the circle center so as to obtain a click area corresponding to the recombined touch point, and determining the click area on the screen of the vehicle-mounted host corresponding to the click operation.
Optionally, when the attribute information of the second touch event further includes pressure information, at this time, after the click area of the reorganization touch point is determined, the display content of the in-vehicle host screen may be updated on the click area based on the pressure information of the reorganization touch point.
For example, when the pressure information of the reformed touch point indicates that the user lightly clicks on the mobile terminal, the on-board host screen displays the screen content of the reformed touch point lightly clicked. And when the pressure information of the recombined touch point indicates that the user clicks on the mobile terminal again, the screen of the vehicle-mounted host displays the picture content of the touch point which is clicked again.
The position information of the touch point comprises the x and y coordinates of the touch point and the size of the area of the screen covered by the whole finger when the user touches the screen of the mobile terminal. In this scenario, based on the position information of each touch point corresponding to the sliding operation and the direction information of each corresponding recombined touch point, the implementation process of determining the sliding area on the screen of the vehicle-mounted host corresponding to the sliding operation may be: and then according to the direction information of each recombined touch point and the moving direction indicated by each recombined touch point, connecting the click areas of each recombined touch point together to determine a sliding area on the screen of the vehicle-mounted host corresponding to the sliding operation of the user.
Optionally, when the attribute information of the second touch event further includes pressure information, at this time, after determining a sliding region on the in-vehicle host screen corresponding to the user sliding operation, the display content of the in-vehicle host screen may be further updated on the sliding region based on the pressure information of each reformed touch point.
For example, if the second touch event includes five reformed touch points, the positions corresponding to the x and y coordinates of the five reformed touch points are obtained according to the position information of the five reformed touch points, the position corresponding to the x and y coordinates of each reformed touch point is taken as a geometric center, and then the screen area with the geometric center as the center of a circle and including the center of the circle covered by the user's finger is determined, obtaining the click areas corresponding to the five recombined touch points respectively, connecting the click areas of the five recombined touch points according to the moving direction indicated by each recombined touch point according to the direction information of the five recombined touch points to form a sliding area, then determining the pressure intensity of each recombined touch point according to the pressure information of the five recombined touch points, and displaying a sliding picture formed by the five recombined touch points according to the pressure of each recombined touch point in the sliding area.
In the embodiment of the application, the on-board host recombines the attribute information of the historical touch event data packet which has the same event identifier as the first touch event and the attribute information of the first touch event by judging whether the event identifier of the first touch event exists in the historical touch event data packet received before the current time to generate the attribute information of the second touch event, the touch time of each recombined touch point in the attribute information of the second touch event is obtained by correcting the touch time of each initial touch point in the first touch event and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, therefore, the vehicle-mounted host can correctly display the recombined touch point on the screen of the vehicle-mounted host when the current time is the touch time of the recombined touch point in the second touch time, and further can completely display the second touch event on the screen of the vehicle-mounted host.
The control method of the in-vehicle screen in fig. 8 is directed to a single-finger operation of a user on a mobile terminal, and the embodiment of the present application may also support a multi-finger operation of the user on the mobile terminal. Referring to fig. 9, the method includes the following steps.
Step 901: the method comprises the steps that a vehicle-mounted host receives a touch event data packet sent by a mobile terminal, the touch event data packet comprises attribute information of a first touch event triggered on a screen of the mobile terminal by a user in a first time period, and also comprises attribute information of a third touch event triggered on the screen of the mobile terminal by the user in the first time period, and the third touch event and the first touch event are different touch events.
Illustratively, when a user operates the screen on the mobile terminal with two fingers, each finger operation generates one touch event, namely a first touch event and a third touch event. The third touch event and the first touch event are different touch events, that is, in the first time period, the touch event data packet received by the vehicle-mounted host includes two different touch events and attribute information corresponding to the two touch events respectively.
Based on the description in step 801, the on-board host receives the touch event data packet in the first time period, where the touch event data packet includes attribute information of the first touch event, the attribute information of the first touch event includes an event identifier of the first touch event and attribute information of at least one initial touch point in the first touch event, and the attribute information of the initial touch point in the first touch event includes information such as position information of the initial touch point, pressure information of the initial touch point, and direction information of the initial touch point. Correspondingly, when the touch event data packet further includes attribute information of a third touch event, the attribute information of the third touch event also includes an event identifier of the third touch event and attribute information of at least one initial touch point in the third touch event, and the attribute information of the initial touch point in the third touch event includes information such as position information of the initial touch point, pressure information of the initial touch point, and direction information of the initial touch point. Of course, the touch event data packet received by the in-vehicle host may further include a plurality of touch events and attribute information of the touch events.
Step 902: the vehicle-mounted host determines the attribute information of a second touch event based on the attribute information of the first touch event and a historical touch event data packet received before the current time, and determines the attribute information of a fourth touch event based on the attribute information of a third touch event and the historical touch event data packet received before the current time.
The fourth touch event indicates that a third touch event triggered by the user on the screen of the mobile terminal is recombined into a touch event triggered by the user on the screen of the vehicle-mounted host, the attribute information of the fourth touch event comprises the attribute information of each recombined touch point in at least one recombined touch point, and the touch time of each recombined touch point in the fourth touch event is obtained by correcting based on the touch time of the corresponding initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host.
The detailed description of the attribute information of the second touch event is determined based on the attribute information of the first touch event and the historical touch event data packet received before the current time in step 802, and the method for determining the attribute information of the fourth touch event by the vehicle-mounted host based on the attribute information of the third touch event and the historical touch event data packet received before the current time is completely the same as that in step 802, and is not repeated here.
The vehicle-mounted host determines the attribute information of a second touch event based on the attribute information of the first touch event and a historical touch event data packet received before the current time, and determines the attribute information of a fourth touch event based on the attribute information of a third touch event and the historical touch event data packet received before the current time. That is, the on-board host obtains the attribute information of the second touch event and the attribute information of the fourth touch event at the same time.
Step 903: and updating the screen display content of the vehicle-mounted host computer based on the attribute information of the second touch event and the attribute information of the fourth touch event.
The display screen of the vehicle-mounted host displays the second touch event when the current time is the touch time of the recombined touch point in the second touch event, and displays the fourth touch event when the current time is the touch time of the recombined touch point in the fourth touch event.
Based on the detailed description of updating the screen display content of the vehicle-mounted host in the step 803, correspondingly, the implementation process of updating the screen display content of the vehicle-mounted host based on the attribute information of the fourth touch event is completely the same as the implementation process in the step 803. However, in step 903, the on-board host updates the screen display content of the on-board host based on the attribute information of the second touch event and the attribute information of the fourth touch event at the same time. At this time, the second touch event and the fourth touch event are simultaneously displayed on the screen of the vehicle-mounted host.
The final screen displayed on the in-vehicle host screen in the above step 803 is a click or slide operation by a single finger of the user. And the final picture displayed on the screen of the vehicle-mounted host computer in the step 903 is clicking or sliding operation of two fingers of the user.
For example, when the second touch event and the fourth touch event respectively correspond to a reorganization touch point, it indicates that the user double-fingered clicks the screen on the mobile terminal, and the in-vehicle host displays the content corresponding to the double-fingered click screen on the in-vehicle host screen. When the second touch event and the fourth touch event respectively correspond to the plurality of recombined touch points, the user indicates that the screen is slid by two fingers on the mobile terminal, and the vehicle-mounted host displays the operation of the screen by two fingers on the screen of the vehicle-mounted host.
For example, when the user slides the screen on the mobile terminal with two fingers, the user performs an operation of enlarging or reducing the screen picture on the mobile terminal, and accordingly, the screen displayed on the vehicle-mounted host computer is enlarged or reduced.
In this embodiment of the application, the touch time data packet received by the vehicle-mounted host includes attribute information of a first touch event and attribute information of a third touch event, and then the attribute information of the historical touch event data packet having the same event identifier as the first touch event is recombined with the attribute information of the first touch event to generate attribute information of a second touch event, where the touch time of each recombined touch point in the attribute information of the second touch event is obtained by correcting the touch time of each initial touch point in the first touch event and a deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host. And recombining the attribute information of the historical touch event data packet with the same event identification as the third touch event and the attribute information of the third touch event to generate attribute information of a fourth touch event, wherein the touch time of each recombined touch point in the attribute information of the fourth touch event is obtained by correcting the touch time of each initial touch point in the third touch event and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host. And finally, updating the display content of the screen of the vehicle-mounted host computer by the vehicle-mounted host computer based on the attribute information of the second touch event and the attribute information of the fourth touch event. Therefore, when a user clicks or slides the screen on the mobile terminal by two fingers, the operation of clicking or sliding by two fingers can be correspondingly displayed on the screen of the vehicle-mounted host computer.
The above-mentioned embodiments of fig. 8 and 9 are a control method of the in-vehicle screen proposed based on the operating system of the in-vehicle host, and these two methods have strong adaptability and do not depend on the modification of the operating system of the in-vehicle host. However, the two methods need to correct the touch time of each initial touch point in the first touch event and the third touch event one by one, the calculation amount is large, the time consumption is also large, and the embodiments of fig. 8 and 9 are applicable to a scenario in which the local layer of the on-board host is not modifiable. Therefore, the application provides another control method of the vehicle-mounted screen, the vehicle-mounted host supported by the method has the autonomous controllable right, the operating system of the vehicle-mounted host can be autonomously modified according to the requirement, and the method is suitable for the scene that the local layer of the vehicle-mounted host can be modified. As shown in fig. 10, the method includes the following steps.
Step 1001: the application layer receives a touch event data packet sent by the mobile terminal, the touch event data packet comprises attribute information of a first touch event triggered on a screen of the mobile terminal by a user in a first time period, the attribute information of the first touch event comprises attribute information of each initial touch point in at least one initial touch point, the attribute information of each initial touch point comprises touch time, the first time period is a time period from the time when the mobile terminal sends the touch event data packet last time before the current time to the time when the touch event data packet is sent currently, and screen display content of the mobile terminal is consistent with screen display content of the vehicle-mounted host.
Based on the above description of the respective layer structures of the operating system of the in-vehicle host, the in-vehicle host receives the touch event data packet at the application layer. The touch event data packet includes attribute information of a first touch event, and the attribute information of the first touch event includes attribute information of all touch points in the first touch event. The touch point in the first touch event is referred to as an initial touch point.
The attribute information of the initial touch point may refer to the related content in the embodiment of fig. 8.
In addition, in a scene that a user operates the screen on the mobile terminal with two fingers, the touch event data packet received by the vehicle-mounted host computer on the application layer further includes attribute information of a third touch event triggered by the user on the screen of the mobile terminal within the first time period, and the third touch event and the first touch event are different touch events.
Step 1002: the application layer sends the attribute information of the first touch event to the local layer, the local layer stores the attribute information of the first touch event into a container of the local layer, and the local layer is provided with a time correction algorithm module.
Since the touch time of the first touch event received by the vehicle-mounted host is the time under the mobile terminal system, the time when the application layer receives the touch event is the time under the vehicle-mounted host system, and there may be a deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, in the embodiment of the present application, a time correction algorithm module is configured at the local layer, and the touch time of the initial touch point in the touch event sent by the application layer is corrected to the touch time of each initial touch point under the vehicle-mounted host system by using the module.
The layer structure of the operating system of the vehicle-mounted host computer sequentially comprises a local layer, a JNI layer, a framework layer and an application layer from the bottom layer. Based on the above description of the layer structure of the operating system of the vehicle-mounted host, interaction is performed between the local layer and the application layer, and if the local layer is configured with the time correction algorithm module, interfaces of the time correction algorithm module need to be added to the middle architecture layer and the JNI layer, so that information can be conveniently transmitted.
Specifically, the application layer sends the attribute information of the first touch event to the local layer through the interfaces of the time correction algorithm modules added in the framework layer and the JNI layer, and the local layer stores the attribute information of the first touch event into a container of the local layer. And after determining the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, the application layer transmits the deviation to the local layer. And the local stratum is provided with a time correction algorithm module, and the updated attribute information of the first touch event is obtained by utilizing the time correction algorithm module.
The application layer sends the attribute information of the first touch event to the local layer in real time, the local layer stores the attribute information of the first touch event into the local layer by using a linear (vector) container, and the linear container can automatically store the attribute information of the first touch event and can automatically increase or reduce the storage space, so that the attribute information of the first touch event sent by the application layer in real time can be stored in a vector mode.
The implementation process of the application layer for determining the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host is as follows: the application layer acquires the touch time of the touch event data packet received for the first time when receiving the touch event data packet sent by the mobile terminal for the first time. And the application layer determines the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer based on the touch time in the touch event data packet received for the first time and the time of receiving the touch event data packet for the first time.
A specific manner of determining the deviation between the system time of the mobile terminal and the system time of the in-vehicle host may refer to relevant contents in the embodiment of fig. 8.
In addition, under the scene that a user operates a screen on a mobile terminal with two fingers to generate a first touch event and a third touch event, the application layer can simultaneously send attribute information of the first touch event and attribute information of the third touch event to the local layer, the local layer stores the attribute information of the first touch event and the attribute information of the third touch event into a container of the local layer, and the local layer is provided with a time correction algorithm module.
The method for the application layer to send the attribute information of the third touch event to the local layer and the local layer to store the attribute information of the third touch event is completely the same as the method for the application layer to send the attribute information of the first touch event to the local layer and the local layer to store the attribute information of the first touch event, and details are not repeated here.
Step 1003: the local layer calling time correction algorithm module corrects the touch time of each initial touch point in at least one initial touch point based on the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer to obtain the updated attribute information of the first touch event.
Because there may be a difference between the system time of the mobile terminal and the system time of the vehicle-mounted host, and under the condition that the transmission delay generated in the process of sending the touch event data packet to the application layer of the vehicle-mounted host by the mobile terminal is not considered, the touch time in the touch event data packet received by the application layer of the vehicle-mounted host and the time for receiving the touch event data packet by the application layer of the vehicle-mounted host may be different, so the touch time of the touch event data packet received by the application layer needs to be corrected, that is, the touch time of each initial touch point in the touch event data packet is corrected.
The local layer stores attribute information of a first touch event in a container of the local layer, wherein the attribute information of the first touch event comprises touch time of all touch points in the first touch event. And after the local layer obtains the deviation between the system time of the mobile terminal sent by the application layer and the system time of the vehicle-mounted host, the local layer corrects the touch time of all initial touch points at one time by using the deviation and a time correction algorithm module.
The implementation process of correcting the touch time of all the initial touch points by using the time correction algorithm module may be as follows: and subtracting the deviation between the touch time of all the initial touch points and the system time of the mobile terminal and the system time of the vehicle-mounted host computer to obtain the corrected touch time of all the touch points, namely to obtain the updated attribute information of the first touch event.
In addition, under the scenario that a user performs double-finger operation on the mobile terminal and simultaneously generates the first touch event and the third touch event, the local layer may further invoke the time correction algorithm module to correct the touch time of each initial touch point in the at least one initial touch point included in the first touch event and the touch time of each initial touch point in the at least one initial touch point included in the third touch event based on the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, and obtain the updated attribute information of the first touch event and the updated attribute information of the third touch event at the same time.
The method for obtaining the updated attribute information of the third touch event by the local layer is completely the same as the method for obtaining the updated attribute information of the first touch event by the local layer, and is not described herein again.
Step 1004: the local layer sends the updated attribute information of the first touch event to the application layer, and the application layer updates the screen display content of the vehicle-mounted host based on the updated attribute information of the first touch event.
After obtaining the updated attribute information of the first touch event, the local layer sends the updated attribute information of the first touch event to the application layer, and the application layer updates the screen display content of the vehicle-mounted host by using the updated attribute information of the first touch event.
The above step 1001 describes the attribute information of the first touch event in detail, and the first touch event may include one initial touch point or a plurality of initial touch points, so that the attribute information of the first touch event includes the attribute information of at least one initial touch point corresponding to the first touch event.
After the updated attribute information of the first touch event is obtained, the implementation process of updating the screen display content of the vehicle-mounted host may be as follows: and if the number of at least one initial touch point corresponding to the first touch event in the updated attribute information is one, determining that the first touch event is a click operation, determining a click area on the screen of the vehicle-mounted host corresponding to the click operation based on the position information of the touch point corresponding to the click operation, and updating the display content of the screen of the vehicle-mounted host based on the click area. And if the number of at least one initial touch point corresponding to the first touch event in the updated attribute information is multiple, determining that the first touch event is a sliding operation, determining a sliding area on the screen of the vehicle-mounted host corresponding to the sliding operation based on the position information of each initial touch point corresponding to the sliding operation and the direction information of each corresponding initial touch point, and updating the display content of the screen of the vehicle-mounted host based on the sliding area.
The specific manner of updating the screen display content of the on-board host may refer to the related content in the embodiment of fig. 8.
In addition, under the scene that a user operates the screen on the mobile terminal in a double-finger mode to generate a first touch event and a third touch event, the local layer can also send the updated attribute information of the first touch event and the updated attribute information of the third touch event to the application layer at the same time, and the application layer updates the screen display content of the vehicle-mounted host based on the updated attribute information of the first touch event and the updated attribute information of the third touch event at the same time.
Correspondingly, the method for updating the screen display content of the vehicle-mounted host machine by the application layer based on the attribute information updated by the third touch event is completely the same as the method for updating the screen display content of the vehicle-mounted host machine by the application layer based on the attribute information updated by the first touch event. However, when the application layer updates the screen display content of the on-board host based on the updated attribute information of the first touch event and the updated attribute information of the third touch event at the same time, at this time, the first touch event and the third touch event are simultaneously displayed on the screen of the on-board host.
And the application layer updates the screen display content of the vehicle-mounted host computer based on the updated attribute information of the first touch event, and finally, the picture displayed on the screen of the vehicle-mounted host computer is the clicking or sliding operation of a single finger of a user. And the application layer updates the screen display content of the vehicle-mounted host computer based on the updated attribute information of the first touch event and the updated attribute information of the third touch event, and finally, the picture displayed on the screen of the vehicle-mounted host computer is the clicking or sliding operation of the two fingers of the user.
The embodiment of the application supports the vehicle-mounted host to have the autonomous controllable right, and the operating system of the vehicle-mounted host can be autonomously modified according to the requirement. Under the condition, a time correction algorithm module is configured at a local layer of the vehicle-mounted host, the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host is determined at an application layer, the deviation is transmitted to the local layer, the local layer directly calls the time correction algorithm module, the touch time of each touch point in all touch events is corrected at one time, and the updated attribute information of the touch events is obtained. The local layer sends the updated attribute information of the touch event to the application layer, and the application layer updates the screen display content of the vehicle-mounted host based on the updated attribute information of the touch event. Compared with the embodiments of fig. 8 and 9 in which the vehicle-mounted host corrects the touch time of each touch point in the touch event one by one, the control method of the vehicle-mounted screen provided by the embodiment of the application can greatly increase the processing speed of the touch event and reduce the time consumption.
The embodiment of the application provides a controlling means of on-vehicle screen, and the device includes: the device comprises a receiving module, a first determining module and a first updating module.
The receiving module is used for receiving a touch event data packet sent by the mobile terminal by the vehicle-mounted host, wherein the touch event data packet comprises attribute information of a first touch event triggered on a screen of the mobile terminal by a user in a first time period, the attribute information of the first touch event comprises attribute information of each initial touch point in at least one initial touch point, the attribute information of each initial touch point comprises touch time, the first time period is a time period from the time when the mobile terminal sends the touch event data packet last time before the current time to the time when the touch event data packet is sent currently, and the screen display content of the mobile terminal is consistent with the screen display content of the vehicle-mounted host;
the first determining module is used for determining attribute information of a second touch event by the vehicle-mounted host based on attribute information of the first touch event and a historical touch event data packet received before the current time, wherein the second touch event indicates that the first touch event triggered by a user on a mobile terminal screen is recombined into the touch event triggered by the user on the vehicle-mounted host screen, the attribute information of the second touch event comprises attribute information of each recombined touch point in at least one recombined touch point, each recombined touch point corresponds to an initial touch point, the attribute information of each recombined touch point comprises touch time, and the touch time of each recombined touch point is obtained by correction based on the touch time of the corresponding initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host;
and the first updating module is used for updating the screen display content of the vehicle-mounted host computer based on the attribute information of the second touch event, wherein the display screen of the vehicle-mounted host computer displays the second touch event when the current time is the touch time of the recombined touch point in the second touch event.
Optionally, the apparatus further comprises:
the acquisition module is used for acquiring the touch time of the touch event data packet received for the first time when the vehicle-mounted host receives the touch event data packet sent by the mobile terminal for the first time;
and the second determining module is used for determining the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer based on the touch time in the touch event data packet received for the first time and the time of receiving the touch event data packet for the first time.
Optionally, the attribute information of the first touch event includes an event identifier of the first touch event;
the first determining module is specifically configured to:
judging whether an event identifier of a first touch event exists in a historical touch event data packet received before the current time;
if the event identifier of the first touch event does not exist in the historical touch event data packet received before the current time, generating a second touch event corresponding to the first touch event;
traversing each initial touch point of at least one initial touch point in the first touch event, and executing the following operations on each initial touch point to obtain attribute information of the second touch event:
and correcting the touch time of each initial touch point based on the touch time of each initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, and determining the corrected touch time of each initial touch point and other attribute information of each initial touch point as attribute information of a recombined touch point.
Optionally, the first determining module is further specifically configured to:
if the event identifier of the first touch event exists in the historical touch event data packet received before the current time, traversing each initial touch point in at least one initial touch point in the first touch event, and executing the following operations on each initial touch point: correcting the touch time of each initial touch point based on the touch time of each initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, and determining the corrected touch time of each initial touch point and other attribute information of each initial touch point as attribute information of a recombined touch point;
and adding the obtained attribute information of at least one recombined touch point to the attribute information of the second touch event generated before the current time to obtain the updated attribute information of the second touch event.
Optionally, the attribute information of each initial touch point further includes position information and direction information; correspondingly, the attribute information of each recombined touch point also comprises position information and direction information;
the first update module is specifically configured to:
if the number of the at least one recombined touch point corresponding to the second touch event is one, determining that the second touch event is a click operation, determining a click area on the screen of the vehicle-mounted host corresponding to the click operation based on the position information of the recombined touch point corresponding to the click operation, and updating the display content of the screen of the vehicle-mounted host based on the click area;
and if the number of the at least one recombination touch point corresponding to the second touch event is multiple, determining that the second touch event is a sliding operation, determining a sliding area on the vehicle-mounted host screen corresponding to the sliding operation based on the position information of each recombination touch point corresponding to the sliding operation and the direction information of each corresponding recombination touch point, and updating the display content of the vehicle-mounted host screen based on the sliding area.
Optionally, the touch event data packet further includes attribute information of a third touch event triggered on the screen of the mobile terminal within the first time period by the user, where the third touch event and the first touch event are different touch events, the attribute information of the third touch event includes attribute information of each initial touch point in at least one initial touch point, and the attribute information of each initial touch point includes touch time;
the device also includes:
the third determining module is used for determining attribute information of a fourth touch event by the vehicle-mounted host computer based on the attribute information of the third touch event and a historical touch event data packet received before the current time, wherein the fourth touch event indicates that the third touch event triggered by the user on the screen of the mobile terminal is recombined into the touch event triggered by the user on the screen of the vehicle-mounted host computer, the attribute information of the fourth touch event comprises the attribute information of each recombined touch point in at least one recombined touch point, and the touch time of each recombined touch point in the fourth touch event is obtained by correcting the touch time of the corresponding initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer;
and the second updating module is used for updating the screen display content of the vehicle-mounted host computer based on the attribute information of the fourth touch event, wherein the fourth touch event is displayed on the display screen of the vehicle-mounted host computer when the current time is the touch time of the recombined touch point in the fourth touch event.
In this embodiment of the application, the touch event data packet received by the vehicle-mounted host includes attribute information of a first touch event and attribute information of a third touch event, and then the attribute information of the historical touch event data packet having the same event identifier as the first touch event and the attribute information of the first touch event are recombined to generate attribute information of a second touch event, where the touch time of each recombined touch point in the attribute information of the second touch event is obtained by correcting the touch time of each initial touch point in the first touch event and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host. And recombining the attribute information of the historical touch event data packet with the same event identification as the third touch event and the attribute information of the third touch event to generate attribute information of a fourth touch event, wherein the touch time of each recombined touch point in the attribute information of the fourth touch event is obtained by correcting the touch time of each initial touch point in the third touch event and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host. And finally, updating the display content of the screen of the vehicle-mounted host computer by the vehicle-mounted host computer based on the attribute information of the second touch event and the attribute information of the fourth touch event. Therefore, when a user clicks or slides the screen on the mobile terminal by two fingers, the operation of clicking or sliding by two fingers can be correspondingly displayed on the screen of the vehicle-mounted host computer.
The embodiment of the application also provides another control device for the vehicle-mounted screen, which comprises: the device comprises a receiving module, a first storage module, a first correction module and a first updating module.
The receiving module is used for receiving a touch event data packet sent by the mobile terminal by the application layer, wherein the touch event data packet comprises attribute information of a first touch event triggered on a screen of the mobile terminal by a user in a first time period, the attribute information of the first touch event comprises attribute information of each initial touch point in at least one initial touch point, the attribute information of each initial touch point comprises touch time, the first time period is a time period from the time when the mobile terminal sends the touch event data packet last time before the current time to the time when the mobile terminal sends the touch event data packet currently, and the screen display content of the mobile terminal is consistent with the screen display content of the vehicle-mounted host;
the first storage module is used for the application layer to send the attribute information of the first touch event to the local layer, the local layer stores the attribute information of the first touch event into a container of the local layer, and the local layer is provided with a time correction algorithm module;
the first correction module is used for correcting the touch time of each initial touch point in at least one initial touch point based on the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host by the local layer calling time correction algorithm module to obtain the updated attribute information of the first touch event;
and the first updating module is used for sending the updated attribute information of the first touch event to the application layer by the local layer, and the application layer updates the screen display content of the vehicle-mounted host based on the updated attribute information of the first touch event.
Optionally, the apparatus further comprises:
the acquisition module is used for acquiring the touch time of the touch event data packet received for the first time when the application layer receives the touch event data packet sent by the mobile terminal for the first time;
the determining module is used for determining the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host by the application layer based on the touch time in the touch event data packet received for the first time and the time of receiving the touch event data packet for the first time;
and the sending module is used for sending the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host to the local layer by the application layer.
Optionally, the attribute information of each initial touch point further includes position information and direction information;
the first update module is specifically configured to:
if the number of at least one initial touch point corresponding to the first touch event in the updated attribute information is one, determining that the first touch event is a click operation, determining a click area on the screen of the vehicle-mounted host corresponding to the click operation based on the position information of the initial touch point corresponding to the click operation, and updating the display content of the screen of the vehicle-mounted host based on the click area;
and if the number of at least one initial touch point corresponding to the first touch event in the updated attribute information is multiple, determining that the first touch event is a sliding operation, determining a sliding area on the screen of the vehicle-mounted host corresponding to the sliding operation based on the position information of each initial touch point corresponding to the sliding operation and the direction information of each corresponding initial touch point, and updating the display content of the screen of the vehicle-mounted host based on the sliding area.
Optionally, the touch event data packet further includes attribute information of a third touch event triggered on the screen of the mobile terminal within the first time period by the user, where the third touch event and the first touch event are different touch events;
the device also includes:
the second storage module is used for the application layer to send the attribute information of the third touch event to the local layer, the local layer stores the attribute information of the third touch event into a container of the local layer, and the local layer is provided with a time correction algorithm module;
the second correction module is used for correcting the touch time of each initial touch point in at least one initial touch point included in the third touch event based on the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host by the local layer calling time correction algorithm module to obtain updated attribute information of the third touch event;
and the second updating module is used for sending the updated attribute information of the third touch event to the application layer by the local layer, and the application layer updates the screen display content of the vehicle-mounted host based on the updated attribute information of the third touch event.
The embodiment of the application supports the vehicle-mounted host to have the autonomous controllable right, and the operating system of the vehicle-mounted host can be autonomously modified according to the requirement. Under the condition, a time correction algorithm module is configured at a local layer of the vehicle-mounted host, the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host is determined at an application layer, the deviation is transmitted to the local layer, the local layer directly calls the time correction algorithm module, the touch time of each touch point in all touch events is corrected at one time, and the updated attribute information of the touch events is obtained. The local layer sends the updated attribute information of the touch event to the application layer, and the application layer updates the screen display content of the vehicle-mounted host based on the updated attribute information of the touch event. Compared with the method that the vehicle-mounted host corrects the touch time of each touch point in the touch event one by one, the method for controlling the vehicle-mounted screen can greatly increase the processing speed of the touch event and reduce the time consumption.
It should be noted that: in the control device for the on-board screen provided in the above embodiment, when controlling the screen of the on-board host, only the division of the above functional modules is exemplified, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the above described functions. In addition, the control device of the vehicle-mounted screen provided by the above embodiment and the control method embodiment of the vehicle-mounted screen belong to the same concept, and the specific implementation process is detailed in the method embodiment and is not described herein again.
Fig. 11 is a block diagram of a mobile terminal 1100 according to an embodiment of the present disclosure. Generally, mobile terminal 1100 includes: a processor 1101 and a memory 1102.
Processor 1101 may include one or more processing cores, such as a 4-core processor, an 8-core processor, or the like. The processor 1101 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 1101 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 1101 may be integrated with a GPU (Graphics Processing Unit) that is responsible for rendering and drawing the content that the display screen needs to display. In some embodiments, the processor 1101 may further include an AI (Artificial Intelligence) processor for processing computing operations related to machine learning.
Memory 1102 may include one or more computer-readable storage media, which may be non-transitory. Memory 1102 can also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 1102 is used to store at least one instruction for execution by processor 1101 to implement the control method for the in-vehicle screen provided by the method embodiments herein.
In some embodiments, mobile terminal 1100 may also optionally include: a peripheral interface 1103 and at least one peripheral. The processor 1101, memory 1102 and peripheral interface 1103 may be connected by a bus or signal lines. Various peripheral devices may be connected to the peripheral interface 1103 by buses, signal lines, or circuit boards. Specifically, the peripheral device includes: at least one of radio frequency circuitry 1104, touch display screen 1105, camera 1106, audio circuitry 1107, positioning component 1108, and power supply 1109.
Those skilled in the art will appreciate that the configuration illustrated in fig. 11 does not constitute a limitation of mobile terminal 1100, and may include more or fewer components than those illustrated, or may combine certain components, or may employ a different arrangement of components.
In some embodiments, a computer-readable storage medium is also provided, in which a computer program is stored, which, when executed by a processor, implements the steps of the control method of the in-vehicle screen in the above embodiments. For example, the computer readable storage medium may be a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
It is noted that the computer-readable storage medium referred to in the embodiments of the present application may be a non-volatile storage medium, in other words, a non-transitory storage medium.
It should be understood that all or part of the steps for implementing the above embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The computer instructions may be stored in the computer-readable storage medium described above.
That is, in some embodiments, there is also provided a computer program product containing instructions which, when run on a computer, cause the computer to perform the steps of the method for controlling an in-vehicle screen described above.
It is to be understood that reference herein to "at least one" means one or more and "a plurality" means two or more. In the description of the embodiments of the present application, "/" means "or" unless otherwise specified, for example, a/B may mean a or B; "and/or" herein is merely an association describing an associated object, and means that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, in order to facilitate clear description of technical solutions of the embodiments of the present application, in the embodiments of the present application, terms such as "first" and "second" are used to distinguish the same items or similar items having substantially the same functions and actions. Those skilled in the art will appreciate that the terms "first," "second," etc. do not denote any order or quantity, nor do the terms "first," "second," etc. denote any order or importance.
The above-mentioned embodiments are provided not to limit the present application, and any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims (10)

1. A control method of an in-vehicle screen, the method comprising:
the method comprises the steps that a vehicle-mounted host receives a touch event data packet sent by a mobile terminal, wherein the touch event data packet comprises attribute information of a first touch event triggered on a screen of the mobile terminal by a user in a first time period, the attribute information of the first touch event comprises attribute information of each initial touch point in at least one initial touch point, the attribute information of each initial touch point comprises touch time, the first time period is a time period from the time when the mobile terminal sends a touch event data packet last time before the current time to the time when the mobile terminal sends the touch event data packet currently, and screen display content of the mobile terminal is consistent with screen display content of the vehicle-mounted host;
the vehicle-mounted host determines attribute information of a second touch event based on the attribute information of the first touch event and a historical touch event data packet received before the current time, wherein the second touch event indicates that a first touch event triggered by a user on the screen of the mobile terminal is recombined into a touch event triggered by the user on the screen of the vehicle-mounted host, the attribute information of the second touch event comprises attribute information of each recombined touch point in at least one recombined touch point, each recombined touch point corresponds to an initial touch point, the attribute information of each recombined touch point comprises touch time, and the touch time of each recombined touch point is corrected based on the touch time of the corresponding initial touch point and the deviation between the touch system time of the mobile terminal and the system time of the vehicle-mounted host;
and updating the screen display content of the vehicle-mounted host computer by the vehicle-mounted host computer based on the attribute information of the second touch event, wherein the second touch event is displayed on the display screen of the vehicle-mounted host computer when the current time is the touch time of the recombined touch point in the second touch event.
2. The method of claim 1, wherein the method further comprises:
the method comprises the steps that when a touch event data packet sent by a mobile terminal is received for the first time, the vehicle-mounted host acquires touch time in the touch event data packet received for the first time;
and determining the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host machine based on the touch time in the touch event data packet received for the first time and the time of receiving the touch event data packet for the first time.
3. The method of claim 1, wherein the attribute information of the first touch event comprises an event identification of the first touch event;
the on-board host determines attribute information of a second touch event based on the attribute information of the first touch event and a historical touch event data packet received before the current time, and the determining includes:
judging whether an event identifier of the first touch event exists in a historical touch event data packet received before the current time;
if the event identifier of the first touch event does not exist in the historical touch event data packet received before the current time, generating a second touch event corresponding to the first touch event;
traversing each initial touch point of at least one initial touch point in the first touch event, and executing the following operations on each initial touch point to obtain attribute information of the second touch event:
and correcting the touch time of each initial touch point based on the touch time of each initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, and determining the corrected touch time of each initial touch point and other attribute information of each initial touch point as attribute information of a recombined touch point.
4. The method of claim 3, wherein the method further comprises:
if the event identifier of the first touch event exists in the historical touch event data packet received before the current time, traversing each initial touch point in at least one initial touch point in the first touch event, and executing the following operations on each initial touch point: correcting the touch time of each initial touch point based on the touch time of each initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, and determining the corrected touch time of each initial touch point and other attribute information of each initial touch point as attribute information of a recombined touch point;
and adding the obtained attribute information of at least one recombined touch point to the attribute information of the second touch event generated before the current time to obtain the updated attribute information of the second touch event.
5. The method of claim 1, wherein the attribute information of each initial touch point further comprises position information and direction information; correspondingly, the attribute information of each recombined touch point also comprises position information and direction information;
the vehicle-mounted host updates the screen display content of the vehicle-mounted host based on the attribute information of the second touch event, and the updating comprises the following steps:
if the number of at least one recombined touch point corresponding to the second touch event is one, determining that the second touch event is a click operation, determining a click area on the vehicle-mounted host computer screen corresponding to the click operation based on the position information of the recombined touch point corresponding to the click operation, and updating the display content of the vehicle-mounted host computer screen based on the click area;
if the number of the at least one recombination touch point corresponding to the second touch event is multiple, determining that the second touch event is a sliding operation, determining a sliding area on the vehicle-mounted host screen corresponding to the sliding operation based on the position information of each recombination touch point corresponding to the sliding operation and the direction information of each corresponding recombination touch point, and updating the display content of the vehicle-mounted host screen based on the sliding area.
6. The method of claim 1, wherein the touch event data packet further includes attribute information of a third touch event triggered by the user on the screen of the mobile terminal within a first time period, the third touch event and the first touch event being different touch events, the attribute information of the third touch event including attribute information of each of at least one initial touch point, the attribute information of each initial touch point including touch time;
the method further comprises the following steps:
the vehicle-mounted host determines attribute information of a fourth touch event based on the attribute information of the third touch event and a historical touch event data packet received before the current time, wherein the fourth touch event indicates that the third touch event triggered by the user on the screen of the mobile terminal is recombined into the touch event triggered by the user on the screen of the vehicle-mounted host, the attribute information of the fourth touch event comprises the attribute information of each recombined touch point in at least one recombined touch point, and the touch time of each recombined touch point in the fourth touch event is corrected based on the touch time of the corresponding initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host;
and updating the screen display content of the vehicle-mounted host computer by the vehicle-mounted host computer based on the attribute information of the fourth touch event, wherein the fourth touch event is displayed on the display screen of the vehicle-mounted host computer when the current time is the touch time of the recombined touch point in the fourth touch event.
7. A control method of a vehicle-mounted screen is characterized in that the method is realized by an operating system of a vehicle-mounted host, the operating system of the vehicle-mounted host comprises a local layer and an application layer, and the method comprises the following steps:
the application layer receives a touch event data packet sent by a mobile terminal, wherein the touch event data packet comprises attribute information of a first touch event triggered on a screen of the mobile terminal by a user within a first time period, the attribute information of the first touch event comprises attribute information of each initial touch point in at least one initial touch point, the attribute information of each initial touch point comprises touch time, the first time period is a time period from the time when the mobile terminal sends the touch event data packet last time before the current time to the time when the mobile terminal sends the touch event data packet currently, and screen display content of the mobile terminal is consistent with screen display content of the vehicle-mounted host;
the application layer sends the attribute information of the first touch event to the local layer, the local layer stores the attribute information of the first touch event into a container of the local layer, and the local layer is provided with a time correction algorithm module;
the local layer calls the time correction algorithm module to correct the touch time of each initial touch point in the at least one initial touch point based on the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer, so as to obtain the updated attribute information of the first touch event;
and the local layer sends the updated attribute information of the first touch event to the application layer, and the application layer updates the screen display content of the vehicle-mounted host based on the updated attribute information of the first touch event.
8. The method of claim 7, wherein the method further comprises:
the method comprises the steps that when a touch event data packet sent by a mobile terminal is received for the first time, the application layer obtains touch time in the touch event data packet received for the first time;
the application layer determines the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer based on the touch time in the touch event data packet received for the first time and the time of receiving the touch event data packet for the first time;
and the application layer sends the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host to the local layer.
9. The method of claim 7, wherein the attribute information of each initial touch point further comprises position information and direction information;
the application layer updates the screen display content of the vehicle-mounted host based on the updated attribute information of the first touch event, and the updating comprises the following steps:
if the number of at least one initial touch point corresponding to the first touch event in the updated attribute information is one, determining that the first touch event is a click operation, determining a click area on the vehicle-mounted host computer screen corresponding to the click operation based on the position information of the initial touch point corresponding to the click operation, and updating the display content of the vehicle-mounted host computer screen based on the click area;
if the number of at least one initial touch point corresponding to the first touch event in the updated attribute information is multiple, determining that the first touch event is a sliding operation, determining a sliding area on the vehicle-mounted host computer screen corresponding to the sliding operation based on the position information of each initial touch point corresponding to the sliding operation and the direction information of each corresponding initial touch point, and updating the display content of the vehicle-mounted host computer screen based on the sliding area.
10. The method of claim 7, wherein the touch event data packet further includes attribute information of a third touch event triggered by the user on the screen of the mobile terminal within a first time period, the third touch event and the first touch event being different touch events;
the method further comprises the following steps:
the application layer sends the attribute information of the third touch event to the local layer, the local layer stores the attribute information of the third touch event into a container of the local layer, and the local layer is provided with a time correction algorithm module;
the local layer calls the time correction algorithm module to correct the touch time of each initial touch point in at least one initial touch point included in the third touch event based on the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer, so as to obtain the updated attribute information of the third touch event;
and the local layer sends the updated attribute information of the third touch event to the application layer, and the application layer updates the screen display content of the vehicle-mounted host based on the updated attribute information of the third touch event.
CN202111413839.4A 2021-11-25 2021-11-25 Control method of vehicle-mounted screen Active CN114115673B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111413839.4A CN114115673B (en) 2021-11-25 2021-11-25 Control method of vehicle-mounted screen

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111413839.4A CN114115673B (en) 2021-11-25 2021-11-25 Control method of vehicle-mounted screen

Publications (2)

Publication Number Publication Date
CN114115673A true CN114115673A (en) 2022-03-01
CN114115673B CN114115673B (en) 2023-10-27

Family

ID=80373116

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111413839.4A Active CN114115673B (en) 2021-11-25 2021-11-25 Control method of vehicle-mounted screen

Country Status (1)

Country Link
CN (1) CN114115673B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115033163A (en) * 2022-06-06 2022-09-09 广州小鹏汽车科技有限公司 Control method of in-vehicle system, vehicle, and storage medium
CN118132294A (en) * 2024-05-06 2024-06-04 海马云（天津）信息技术有限公司 Trigger event information processing method and device

Citations (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104301507A (en) * 2013-07-15 2015-01-21 Lg电子株式会社 Mobile terminal and control method thereof
US20150098653A1 (en) * 2013-10-07 2015-04-09 Kabushiki Kaisha Toshiba Method, electronic device and storage medium
CN105045584A (en) * 2015-07-07 2015-11-11 东风汽车有限公司 Touch control method and system for screen of vehicle machine
CN105260112A (en) * 2015-09-14 2016-01-20 百度在线网络技术（北京）有限公司 Method and device for controlling screen between terminals
US20180052564A1 (en) * 2016-08-18 2018-02-22 Fujitsu Ten Limited Input control apparatus, input control method, and input control system
CN108206836A (en) * 2016-12-16 2018-06-26 乐视汽车（北京）有限公司 The dynamic menu of synchronous terminal screen to vehicle device method, terminal and system
CN109495263A (en) * 2018-11-16 2019-03-19 上海银基信息安全技术股份有限公司 Clock synchronizing method, system, device, intelligent terminal, vehicle termination and medium
CN110588346A (en) * 2019-08-22 2019-12-20 上海赫千电子科技有限公司 Multi-screen interaction system applied to automobile
CN111176698A (en) * 2014-05-30 2020-05-19 苹果公司 Dynamically adjusting mobile devices based on peer event data
CN111275797A (en) * 2020-02-26 2020-06-12 腾讯科技（深圳）有限公司 Animation display method, device, equipment and storage medium
AU2017445389A1 (en) * 2017-12-28 2020-06-25 Huawei Technologies Co., Ltd. Touch method and terminal
CN111770368A (en) * 2020-05-15 2020-10-13 广州视源电子科技股份有限公司 Control method and device for large-screen display equipment, storage medium and electronic equipment
CN112414400A (en) * 2019-08-21 2021-02-26 浙江商汤科技开发有限公司 Information processing method and device, electronic equipment and storage medium
CN112540696A (en) * 2019-09-23 2021-03-23 中兴通讯股份有限公司 Screen touch control management method, intelligent terminal, device and readable storage medium
WO2021092768A1 (en) * 2019-11-12 2021-05-20 深圳市欢太科技有限公司 Touch event processing method and apparatus, mobile terminal and storage medium
CN112887939A (en) * 2019-11-29 2021-06-01 北京百度网讯科技有限公司 Vehicle information determination method and device, electronic equipment and storage medium
CN112911543A (en) * 2021-01-04 2021-06-04 深圳市领航威科技有限公司 Vehicle-mounted terminal, time synchronization method thereof and storage medium
CN113014349A (en) * 2021-03-01 2021-06-22 北京嘀嘀无限科技发展有限公司 Time calibration method, device, electronic equipment, storage medium and program product
CN113391749A (en) * 2020-03-11 2021-09-14 上海达龙信息科技有限公司 Mouse click simulation method and device, computer readable storage medium and electronic equipment
US20210286499A1 (en) * 2019-03-26 2021-09-16 Denso Corporation Touch position detection system
CN113419452A (en) * 2021-06-29 2021-09-21 海信集团控股股份有限公司 Vehicle, control method thereof and mobile terminal
CN113467644A (en) * 2021-07-21 2021-10-01 无锡变格新材料科技有限公司 Calibration method and device of touch equipment, terminal equipment and storage medium
CN113489632A (en) * 2021-06-11 2021-10-08 深圳市海邻科信息技术有限公司 Touch control method, system and computer readable storage medium
CN113590000A (en) * 2020-04-30 2021-11-02 京东方科技集团股份有限公司 Handwriting processing method, handwriting processing device and storage medium

Patent Citations (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104301507A (en) * 2013-07-15 2015-01-21 Lg电子株式会社 Mobile terminal and control method thereof
US20150098653A1 (en) * 2013-10-07 2015-04-09 Kabushiki Kaisha Toshiba Method, electronic device and storage medium
CN111176698A (en) * 2014-05-30 2020-05-19 苹果公司 Dynamically adjusting mobile devices based on peer event data
CN105045584A (en) * 2015-07-07 2015-11-11 东风汽车有限公司 Touch control method and system for screen of vehicle machine
CN105260112A (en) * 2015-09-14 2016-01-20 百度在线网络技术（北京）有限公司 Method and device for controlling screen between terminals
US20180052564A1 (en) * 2016-08-18 2018-02-22 Fujitsu Ten Limited Input control apparatus, input control method, and input control system
CN108206836A (en) * 2016-12-16 2018-06-26 乐视汽车（北京）有限公司 The dynamic menu of synchronous terminal screen to vehicle device method, terminal and system
AU2017445389A1 (en) * 2017-12-28 2020-06-25 Huawei Technologies Co., Ltd. Touch method and terminal
CN109495263A (en) * 2018-11-16 2019-03-19 上海银基信息安全技术股份有限公司 Clock synchronizing method, system, device, intelligent terminal, vehicle termination and medium
US20210286499A1 (en) * 2019-03-26 2021-09-16 Denso Corporation Touch position detection system
CN112414400A (en) * 2019-08-21 2021-02-26 浙江商汤科技开发有限公司 Information processing method and device, electronic equipment and storage medium
CN110588346A (en) * 2019-08-22 2019-12-20 上海赫千电子科技有限公司 Multi-screen interaction system applied to automobile
CN112540696A (en) * 2019-09-23 2021-03-23 中兴通讯股份有限公司 Screen touch control management method, intelligent terminal, device and readable storage medium
WO2021092768A1 (en) * 2019-11-12 2021-05-20 深圳市欢太科技有限公司 Touch event processing method and apparatus, mobile terminal and storage medium
CN112887939A (en) * 2019-11-29 2021-06-01 北京百度网讯科技有限公司 Vehicle information determination method and device, electronic equipment and storage medium
CN111275797A (en) * 2020-02-26 2020-06-12 腾讯科技（深圳）有限公司 Animation display method, device, equipment and storage medium
CN113391749A (en) * 2020-03-11 2021-09-14 上海达龙信息科技有限公司 Mouse click simulation method and device, computer readable storage medium and electronic equipment
CN113590000A (en) * 2020-04-30 2021-11-02 京东方科技集团股份有限公司 Handwriting processing method, handwriting processing device and storage medium
CN111770368A (en) * 2020-05-15 2020-10-13 广州视源电子科技股份有限公司 Control method and device for large-screen display equipment, storage medium and electronic equipment
CN112911543A (en) * 2021-01-04 2021-06-04 深圳市领航威科技有限公司 Vehicle-mounted terminal, time synchronization method thereof and storage medium
CN113014349A (en) * 2021-03-01 2021-06-22 北京嘀嘀无限科技发展有限公司 Time calibration method, device, electronic equipment, storage medium and program product
CN113489632A (en) * 2021-06-11 2021-10-08 深圳市海邻科信息技术有限公司 Touch control method, system and computer readable storage medium
CN113419452A (en) * 2021-06-29 2021-09-21 海信集团控股股份有限公司 Vehicle, control method thereof and mobile terminal
CN113467644A (en) * 2021-07-21 2021-10-01 无锡变格新材料科技有限公司 Calibration method and device of touch equipment, terminal equipment and storage medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
吕皓;: "轻松行万里 世界任遨游 车载GPS、GPS手机的乐趣体验", 科学生活, no. 10, pages 92 - 96 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115033163A (en) * 2022-06-06 2022-09-09 广州小鹏汽车科技有限公司 Control method of in-vehicle system, vehicle, and storage medium
CN118132294A (en) * 2024-05-06 2024-06-04 海马云（天津）信息技术有限公司 Trigger event information processing method and device

Also Published As

Publication number Publication date
CN114115673B (en) 2023-10-27

Similar Documents

Publication Publication Date Title
CN107273083B (en) Interaction method, device, equipment and storage medium between terminal equipment
CN114115673B (en) Control method of vehicle-mounted screen
CN107341016B (en) Focus state implementation method and device under split screen mechanism, terminal and storage medium
CN109460233A (en) Primary interface display update method, device, terminal device and the medium of the page
CN113824842B (en) Notification message display method, electronic equipment and computer-readable storage medium
CN111459586A (en) Remote assistance method, device, storage medium and terminal
CN113268212A (en) Screen projection method and device, storage medium and electronic equipment
CN112835485A (en) Application interface processing method and device, electronic equipment and readable storage medium
CN112295219A (en) Game control method, mobile terminal, car machine and storage medium
WO2024061088A1 (en) Display method and apparatus, electronic device, and storage medium
CN115357173A (en) Screen control method and device and electronic equipment
CN115079680A (en) Vehicle control state processing method and device, storage medium and electronic equipment
CN114327087A (en) Input event processing method and device, electronic equipment and storage medium
CN114265653A (en) Interface display method, device, equipment, storage medium and program product
WO2024051639A1 (en) Image processing method, apparatus and device, and storage medium and product
CN111666023B (en) Interface display method and device, electronic equipment and readable storage medium
CN117555459A (en) Application group processing method and device, storage medium and electronic equipment
CN113282213A (en) Interface display method and device
CN109491732B (en) Virtual control display method and device and vehicle-mounted display screen
CN115904514B (en) Method for realizing cloud rendering pixel flow based on three-dimensional scene and terminal equipment
CN110806830A (en) User interaction method and electronic equipment
CN107015874B (en) Data transmission control method, device and terminal
CN115599484A (en) Screen capturing method, screen capturing device, screen capturing equipment and computer storage medium
CN115421846A (en) Cross-device control method, control device, electronic device and readable storage medium
CN105229607A (en) Display control unit and display control method and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20240429

Address after: 266555, No. 218, Bay Road, Qingdao economic and Technological Development Zone, Shandong

Patentee after: Hisense Visual Technology Co., Ltd.

Country or region after: China

Address before: 266555, No. 218, Bay Road, Qingdao economic and Technological Development Zone, Shandong

Patentee before: Hisense Group Holding Co.,Ltd.

Country or region before: China