CN114115673B - Control method of vehicle-mounted screen - Google Patents

Control method of vehicle-mounted screen Download PDF

Info

Publication number
CN114115673B
CN114115673B CN202111413839.4A CN202111413839A CN114115673B CN 114115673 B CN114115673 B CN 114115673B CN 202111413839 A CN202111413839 A CN 202111413839A CN 114115673 B CN114115673 B CN 114115673B
Authority
CN
China
Prior art keywords
touch
touch event
time
vehicle
attribute information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111413839.4A
Other languages
Chinese (zh)
Other versions
CN114115673A (en
Inventor
王本强
王树利
杨鹏
姚巧丽
刘延峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hisense Visual Technology Co Ltd
Original Assignee
Hisense Group Holding Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hisense Group Holding Co Ltd filed Critical Hisense Group Holding Co Ltd
Priority to CN202111413839.4A priority Critical patent/CN114115673B/en
Publication of CN114115673A publication Critical patent/CN114115673A/en
Application granted granted Critical
Publication of CN114115673B publication Critical patent/CN114115673B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485Scrolling or panning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Navigation (AREA)

Abstract

The embodiment of the application discloses a control method of a vehicle-mounted screen, and belongs to the field of automobiles. The method comprises the following steps: the method comprises the steps that a vehicle-mounted host receives a touch event data packet sent by a mobile terminal, the touch event data packet comprises attribute information of a first touch event triggered by a user on a screen of the mobile terminal in a first time period, and screen display content of the mobile terminal is consistent with that of the vehicle-mounted host. The vehicle-mounted host determines attribute information of a second touch event based on the attribute information of the first touch event and a historical touch event data packet received before the current time. And updating the screen display content of the vehicle-mounted host based on the attribute information of the second touch event, wherein the display screen of the vehicle-mounted host displays the second touch event when the current time is the touch time of the recombination touch point in the second touch event. In the embodiment of the application, the vehicle-mounted host can completely display the second touch event, and the problem that part of touch points in the second touch event are lost can be avoided.

Description

Control method of vehicle-mounted screen
Technical Field
The embodiment of the application relates to the field of automobiles, in particular to a control method of a vehicle-mounted screen.
Background
The control of the vehicle-mounted screen is that a passenger on the automobile remotely controls a central control host screen of the automobile through the mobile terminal, so that the central control host screen presents a picture which the passenger wants to display, and the central control host screen is connected with a central control system on the automobile and is controlled by the central control system.
In the related art, a connection may be established between a central control host and a mobile terminal, and content of a screen of the central control host is displayed on the mobile terminal, so that the screen of the central control host is controlled through the mobile terminal. When a finger slides on the mobile terminal, a touch event is generated, and information related to the touch event includes information such as touch time of each touch point generated under the sliding of the finger, x and y coordinates of each touch point, and the like. The touch time of each touch point in the touch event information may be collectively referred to as an occurrence time of the touch event. The mobile terminal acquires the touch event information, transmits the touch event information to the central control host, and the central control host sequentially searches each touch point which is the same as the current time of the central control host according to the time sequence based on the touch time of each touch point and displays the touch points on a screen of the central control host according to the x and y coordinates of each touch point.
However, due to the difference between the occurrence time of the touch event transmitted by the mobile terminal and the current time of the central control host, when the central control host searches for the touch point, some touch points with touch time earlier than the current time of the central control host may be lost, so that part of the event is lost, and further, the screen of the central control host is blocked or crashed.
Disclosure of Invention
The embodiment of the application provides a control method of a vehicle-mounted screen, which can solve the problem that part of touch events are lost in the related technology. The technical scheme is as follows:
in one aspect, a control method of a vehicle-mounted screen is provided, the method including:
the method comprises the steps that a vehicle-mounted host receives a touch event data packet sent by a mobile terminal, wherein the touch event data packet comprises attribute information of a first touch event triggered by a user on a screen of the mobile terminal in a first time period, the attribute information of the first touch event comprises attribute information of each initial touch point in at least one initial touch point, the attribute information of each initial touch point comprises touch time, and the first time period is a time period from the last time the mobile terminal sends the touch event data packet to the current time the mobile terminal sends the touch event data packet, and screen display content of the mobile terminal is consistent with that of the vehicle-mounted host;
The vehicle-mounted host computer determines attribute information of a second touch event based on the attribute information of the first touch event and a historical touch event data packet received before the current time, the second touch event indicates that the first touch event triggered by a user on the mobile terminal screen is recombined into a touch event triggered by the user on the vehicle-mounted host computer screen, the attribute information of the second touch event comprises attribute information of each recombined touch point in at least one recombined touch point, each recombined touch point corresponds to an initial touch point, the attribute information of each recombined touch point comprises touch time, and the touch time of each recombined touch point is obtained by correcting deviation between the touch time of the corresponding initial touch point, the system time of the mobile terminal and the system time of the vehicle-mounted host computer;
and updating the screen display content of the vehicle-mounted host based on the attribute information of the second touch event, wherein the display screen of the vehicle-mounted host displays the second touch event when the current time is the touch time of the recombination touch point in the second touch event.
Optionally, the method further comprises:
When the vehicle-mounted host receives the touch event data packet sent by the mobile terminal for the first time, acquiring touch time in the touch event data packet received for the first time;
and determining the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host based on the touch time in the touch event data packet received for the first time and the time for receiving the touch event data packet for the first time.
Optionally, the attribute information of the first touch event includes an event identifier of the first touch event;
the vehicle-mounted host determines attribute information of a second touch event based on the attribute information of the first touch event and a historical touch event data packet received before the current time, and the method comprises the following steps:
judging whether an event identifier of the first touch event exists in a historical touch event data packet received before the current time;
if the event identification of the first touch event does not exist in the historical touch event data packet received before the current time, generating a second touch event corresponding to the first touch event;
traversing each initial touch point in at least one initial touch point in the first touch event, and executing the following operations on each initial touch point to obtain attribute information of the second touch event:
Correcting the touch time of each initial touch point based on the touch time of each initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, and determining the corrected touch time of each initial touch point and other attribute information of each initial touch point as attribute information of a recombined touch point.
Optionally, the method further comprises:
if the event identifier of the first touch event exists in the historical touch event data packet received before the current time, traversing each initial touch point in at least one initial touch point in the first touch event, and executing the following operations on each initial touch point: correcting the touch time of each initial touch point based on the touch time of each initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, and determining the corrected touch time of each initial touch point and other attribute information of each initial touch point as attribute information of a recombined touch point;
and adding the obtained attribute information of at least one recombined touch point into the attribute information of the second touch event generated before the current time to obtain updated attribute information of the second touch event.
Optionally, the attribute information of each initial touch point further includes position information and direction information; correspondingly, the attribute information of each recombined touch point also comprises position information and direction information;
the on-vehicle host computer updates the screen display content of the on-vehicle host computer based on the attribute information of the second touch event, and the method comprises the following steps:
if the number of at least one recombination touch point corresponding to the second touch event is one, determining that the second touch event is a click operation, determining a click region on the vehicle-mounted host screen corresponding to the click operation based on the position information of the recombination touch point corresponding to the click operation, and updating the display content of the vehicle-mounted host screen based on the click region;
and if the number of at least one recombination touch point corresponding to the second touch event is a plurality of, determining that the second touch event is a sliding operation, determining a sliding area on the vehicle-mounted host screen corresponding to the sliding operation based on the position information of each recombination touch point corresponding to the sliding operation and the direction information of each corresponding recombination touch point, and updating the display content of the vehicle-mounted host screen based on the sliding area.
Optionally, the touch event data packet further includes attribute information of a third touch event triggered by a user on the mobile terminal screen in a first period of time, where the third touch event and the first touch event are different touch events, and the attribute information of the third touch event includes attribute information of each initial touch point in at least one initial touch point, and the attribute information of each initial touch point includes touch time;
the method further comprises the steps of:
the vehicle-mounted host computer determines attribute information of a fourth touch event based on the attribute information of the third touch event and a historical touch event data packet received before the current time, the fourth touch event indicates that the third touch event triggered by a user on the screen of the mobile terminal is recombined into a touch event triggered by the user on the screen of the vehicle-mounted host computer, the attribute information of the fourth touch event comprises attribute information of each recombined touch point in at least one recombined touch point, and the touch time of each recombined touch point in the fourth touch event is obtained by correcting deviation between the touch time of a corresponding initial touch point and the system time of the mobile terminal and the system time of the vehicle-mounted host computer;
And updating the screen display content of the vehicle-mounted host based on the attribute information of the fourth touch event, wherein the display screen of the vehicle-mounted host displays the fourth touch event when the current time is the touch time of the recombination touch point in the fourth touch event.
In another aspect, another method for controlling an in-vehicle screen is provided, the method including:
the method is realized by an operating system of a vehicle-mounted host, the operating system of the vehicle-mounted host comprises a local layer and an application layer, and the method comprises the following steps:
the application layer receives a touch event data packet sent by a mobile terminal, wherein the touch event data packet comprises attribute information of a first touch event triggered by a user on a screen of the mobile terminal in a first time period, the attribute information of the first touch event comprises attribute information of each initial touch point in at least one initial touch point, the attribute information of each initial touch point comprises touch time, and the first time period is a time period from the last time the mobile terminal sends the touch event data packet to the current time the mobile terminal sends the touch event data packet, and screen display content of the mobile terminal is consistent with that of the vehicle-mounted host;
The application layer sends the attribute information of the first touch event to the local layer, the local layer stores the attribute information of the first touch event into a container of the local layer, and the local layer is configured with a time correction algorithm module;
the local layer calls the time correction algorithm module to correct the touch time of each initial touch point in the at least one initial touch point based on the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer, and the updated attribute information of the first touch event is obtained;
and the local layer sends the updated attribute information of the first touch event to the application layer, and the application layer updates the screen display content of the vehicle-mounted host based on the updated attribute information of the first touch event.
Optionally, the method further comprises:
when the application layer receives a touch event data packet sent by the mobile terminal for the first time, acquiring touch time in the touch event data packet received for the first time;
the application layer determines the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host based on the touch time in the touch event data packet received for the first time and the time for receiving the touch event data packet for the first time;
And the application layer sends the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host to the local layer.
Optionally, the attribute information of each initial touch point further includes position information and direction information;
the application layer updates the screen display content of the vehicle-mounted host based on the attribute information updated by the first touch event, and the method comprises the following steps:
if the number of at least one initial touch point corresponding to the first touch event in the updated attribute information is one, determining that the first touch event is a click operation, determining a click region on the vehicle-mounted host screen corresponding to the click operation based on the position information of the initial touch point corresponding to the click operation, and updating the display content of the vehicle-mounted host screen based on the click region;
and if the number of at least one initial touch point corresponding to the first touch event in the updated attribute information is a plurality of, determining that the first touch event is a sliding operation, determining a sliding area on the vehicle-mounted host screen corresponding to the sliding operation based on the position information of each initial touch point corresponding to the sliding operation and the direction information of each corresponding initial touch point, and updating the display content of the vehicle-mounted host screen based on the sliding area.
Optionally, the touch event data packet further includes attribute information of a third touch event triggered by the user on the mobile terminal screen in a first period of time, where the third touch event and the first touch event are different touch events;
the method further comprises the steps of:
the application layer sends the attribute information of the third touch event to the local layer, the local layer stores the attribute information of the third touch event into a container of the local layer, and the local layer is configured with a time correction algorithm module;
the local layer calls the time correction algorithm module to correct the touch time of each initial touch point in at least one initial touch point included in the third touch event based on the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer, so as to obtain updated attribute information of the third touch event;
and the local layer sends the attribute information updated by the third touch event to the application layer, and the application layer updates the screen display content of the vehicle-mounted host based on the attribute information updated by the third touch event.
In another aspect, an electronic device is provided that includes a processor configured to:
The method comprises the steps that a vehicle-mounted host receives a touch event data packet sent by a mobile terminal, wherein the touch event data packet comprises attribute information of a first touch event triggered by a user on a screen of the mobile terminal in a first time period, the attribute information of the first touch event comprises attribute information of each initial touch point in at least one initial touch point, the attribute information of each initial touch point comprises touch time, and the first time period is a time period from the last time the mobile terminal sends the touch event data packet to the current time the mobile terminal sends the touch event data packet, and screen display content of the mobile terminal is consistent with that of the vehicle-mounted host;
the vehicle-mounted host computer determines attribute information of a second touch event based on the attribute information of the first touch event and a historical touch event data packet received before the current time, the second touch event indicates that the first touch event triggered by a user on the mobile terminal screen is recombined into a touch event triggered by the user on the vehicle-mounted host computer screen, the attribute information of the second touch event comprises attribute information of each recombined touch point in at least one recombined touch point, each recombined touch point corresponds to an initial touch point, the attribute information of each recombined touch point comprises touch time, and the touch time of each recombined touch point is obtained by correcting deviation between the touch time of the corresponding initial touch point, the system time of the mobile terminal and the system time of the vehicle-mounted host computer;
And updating the screen display content of the vehicle-mounted host based on the attribute information of the second touch event, wherein the display screen of the vehicle-mounted host displays the second touch event when the current time is the touch time of the recombination touch point in the second touch event.
In another aspect, another electronic device is provided that includes a processor configured to:
the application layer receives a touch event data packet sent by a mobile terminal, wherein the touch event data packet comprises attribute information of a first touch event triggered by a user on a screen of the mobile terminal in a first time period, the attribute information of the first touch event comprises attribute information of each initial touch point in at least one initial touch point, the attribute information of each initial touch point comprises touch time, and the first time period is a time period from the last time the mobile terminal sends the touch event data packet to the current time the mobile terminal sends the touch event data packet, and screen display content of the mobile terminal is consistent with that of the vehicle-mounted host;
the application layer sends the attribute information of the first touch event to the local layer, the local layer stores the attribute information of the first touch event into a container of the local layer, and the local layer is configured with a time correction algorithm module;
The local layer calls the time correction algorithm module to correct the touch time of each initial touch point in the at least one initial touch point based on the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer, and the updated attribute information of the first touch event is obtained;
and the local layer sends the updated attribute information of the first touch event to the application layer, and the application layer updates the screen display content of the vehicle-mounted host based on the updated attribute information of the first touch event.
The technical scheme provided by the embodiment of the application at least has the following beneficial effects:
in the embodiment of the application, a vehicle-mounted host firstly receives a touch event data packet sent by a mobile terminal, wherein the touch event data packet comprises attribute information of a first touch event triggered by a user on a screen of the mobile terminal within a period of time, and the attribute information of the first touch event comprises touch time of each initial touch point in at least one initial touch point. Then, based on the attribute information of the first touch event and the historical touch event data packet received before the current time, the attribute information of the second touch event is determined. And updating the screen display content of the vehicle-mounted host based on the attribute information of the second touch event. Because the second touch event is the recombination of the first touch event and the historical touch event, and the attribute information of the second touch event comprises the touch time of each recombination touch point, the touch time of each recombination touch point is obtained based on the touch time of the corresponding initial touch point and the deviation correction between the system time of the mobile terminal and the system time of the vehicle-mounted host, the touch time of the recombination touch point can be corrected to be the time under the operating system of the vehicle-mounted host, and therefore the vehicle-mounted host can display the corresponding recombination touch point under the condition that the current time is the touch time of each recombination touch point in the second touch event, and further the second touch event can be completely displayed, and the problem that part of touch points in the second touch event are lost can not occur.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic illustration of an implementation environment provided by an embodiment of the present application;
FIG. 2 is a schematic diagram of a connection relationship between screens according to an embodiment of the present application;
fig. 3 is a schematic diagram of an initial state of a mobile terminal screen according to an embodiment of the present application;
fig. 4 is a schematic diagram of an initial state of a main screen of a vehicle-mounted host according to an embodiment of the present application;
fig. 5 is a schematic diagram of a pop-up screen selection icon of a mobile terminal according to an embodiment of the present application;
fig. 6 is a schematic diagram of a mobile terminal screen state according to an embodiment of the present application;
FIG. 7 is a schematic diagram of a status of a main screen of a vehicle-mounted host according to an embodiment of the present application;
fig. 8 is a flowchart of a control method of a vehicle-mounted screen according to an embodiment of the present application;
Fig. 9 is a flowchart of another control method of the vehicle-mounted screen provided by the embodiment of the application;
fig. 10 is a flowchart of another control method of the vehicle-mounted screen provided by the embodiment of the application;
fig. 11 is a schematic structural diagram of a mobile terminal according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the following detailed description of the embodiments of the present application will be given with reference to the accompanying drawings.
Before explaining the control method of the vehicle-mounted screen provided by the embodiment of the application in detail, an application scene and an implementation environment provided by the embodiment of the application are introduced.
In the field of automobiles, a user can control a screen of a vehicle-mounted host by using a mobile terminal in a hand by connecting the vehicle-mounted host with the mobile terminal of the user in a communication manner, so that the screen of the vehicle-mounted host displays a picture which the user wants to display.
Currently, a method for controlling a screen of an in-vehicle host computer is to set an application program of a special API (Application Program Interface ) layer on a mobile terminal, and control the screen of the in-vehicle host computer by using the application program. The interface of the application program is provided with a plurality of virtual buttons, and the different virtual buttons indicate different operation information, for example, a virtual button of 'screen enlarging' indicates an operation of enlarging a screen and a virtual button of 'screen reducing' indicates an operation of reducing the screen. For example, when the user clicks the virtual button of "screen zoom-in" on the interface of the application program, the mobile terminal receives the operation information of the zoom-in screen indicated by the virtual button of "screen zoom-in" and transmits the operation information to the vehicle-mounted host, and after receiving the operation information, the vehicle-mounted host displays the content of the screen zoom-in on the screen of the vehicle-mounted host. However, in this case, the screen content of the in-vehicle host is not displayed on the mobile terminal of the user, that is, the user can only click the virtual button of the application program on the mobile terminal, and cannot see the screen displayed by the corresponding operation on the mobile terminal in real time.
In order to solve the problem that the same content as the screen of the vehicle-mounted host computer cannot be displayed on the screen of the mobile terminal in real time, a method is also provided in the prior art. The method is that connection is established between a vehicle-mounted host and a mobile terminal of a user, the content of a screen of the vehicle-mounted host is displayed on the mobile terminal of the user, and then the screen of the vehicle-mounted host is controlled by the user through the mobile terminal. When the user slides on the mobile terminal, the mobile terminal transmits the sliding information of the user, namely, generated touch event information to the vehicle-mounted host, wherein the touch event information comprises the touch time of each touch point. And the vehicle-mounted host computer displays the touch event on the screen of the vehicle-mounted host computer based on the touch time of each touch point in the touch event information under the current time of the vehicle-mounted host computer based on the received touch event information. However, due to the difference between the touch time of each touch point in the touch event information transmitted by the mobile terminal and the current time of the vehicle-mounted host, when the vehicle-mounted host displays the touch event, some touch points with touch time earlier than the current time of the vehicle-mounted host may be lost, so that the screen of the vehicle-mounted host is blocked.
In addition, the two methods only support single click operation, the first method is to set a virtual button on an interface of an application program, only control single click of a vehicle-mounted host computer screen, and the second method only supports single-finger touch of a user on a mobile terminal, and the vehicle-mounted host computer can display a picture corresponding to the corresponding operation.
Therefore, in the embodiment of the application, the touch time of each initial touch point in the touch event data packet received by the vehicle-mounted host is corrected, so that the touch time of each recombined touch point is corrected to be the time under the operating system of the vehicle-mounted host, and the touch event can be completely displayed on the screen of the vehicle-mounted host. In addition, the control method of the vehicle-mounted host provided by the embodiment of the application can support clicking or sliding events generated by multi-finger operation of the user on the mobile terminal.
Referring to fig. 1, fig. 1 is a schematic diagram illustrating an implementation environment according to an exemplary embodiment. The implementation environment includes at least one mobile terminal 101 and an in-vehicle host 102, the mobile terminal 101 being communicatively connectable to the in-vehicle host 102. The communication connection may be a wired or wireless connection, which is not limited by the embodiments of the present application.
The mobile terminal 101 is configured to request a control management service for a screen of the in-vehicle host 102, and request a screen of the in-vehicle host 102 that needs to be controlled. The in-vehicle host 102 is used to run a screen control management service of the in-vehicle host 102.
Specifically, after the communication connection between the mobile terminal 101 and the vehicle-mounted host 102 is established, the mobile terminal 101 may send a screen control request to the vehicle-mounted host 102, where the screen control request carries information that the mobile terminal 101 controls a screen of the vehicle-mounted host 102, and when the vehicle-mounted host 102 receives the screen control request, that is, the corresponding screen content of the vehicle-mounted host 102 is sent to the mobile terminal 101 according to the information carried in the screen control request, the mobile terminal 101 receives and displays the content of the screen transmitted by the vehicle-mounted host 102 on the screen of the mobile terminal 101. As shown in fig. 2, the screen of the in-vehicle main body 102 includes a main screen located near the driver's seat, a sub-screen 1 located near the passenger's seat, and a sub-screen 2 located near the rear seat. For example, the mobile terminal 101 may send a screen control request to the vehicle-mounted host 102, where the screen control request carries information that the mobile terminal 101 controls the main screen of the vehicle-mounted host 102, and after the vehicle-mounted host 102 receives the information carried in the screen control request, the content of the main screen of the vehicle-mounted host 102 is sent to the mobile terminal 101, and the mobile terminal 101 receives and displays the content of the main screen of the vehicle-mounted host 102 on the screen of the mobile terminal 101.
When the user clicks or slides the screen on the mobile terminal 101, this operation is a touch event, and the information associated with the touch event may be referred to as touch event information, where the mobile terminal 101 converts the touch event information into binary data in a serialized manner, and then encodes the binary data into a character string and transmits the character string to the vehicle-mounted host 102. The vehicle-mounted host 102 receives the character string transmitted by the mobile terminal 101, decodes the character string, and performs inverse sequence analysis on the binary data obtained after decoding to finally obtain the touch event information. The in-vehicle host 102 reproduces the touch event on the screen of the in-vehicle host 102 based on the touch event information.
For example, at the beginning, as shown in fig. 3, the screen of the mobile terminal 101 is in the most initial state, and icons of various applications are on the screen of the mobile terminal 101. For example, as shown in fig. 4, the main screen of the in-vehicle host 102 is also in the initial state, and at this time, the screen contents of the main screen and the sub-screen of the in-vehicle host 102 may be the same or different. The screen content of the mobile terminal 101 is different from that of the in-vehicle host 102.
The user clicks the "control screen" icon on the right lower corner "application" icon of the mobile terminal 101 in fig. 3, and at this time, as shown in fig. 5, the screen selection icons of the "control main screen" and the "control sub-screen" pop up on the screen of the mobile terminal 101, and the user can select and control the main screen or the sub-screen of the in-vehicle host 102.
When the user selects the "control home screen", the mobile terminal 101 receives the information of the user selecting the "control home screen" and transmits the information to the in-vehicle host 102. After receiving this information, the in-vehicle host 102 transmits the content of the main screen of the in-vehicle host 102 to the mobile terminal 101. The mobile terminal 101 receives the content of the main screen of the in-vehicle host 102, and displays the content of the main screen of the in-vehicle host 102 on the screen of the mobile terminal 101. That is, the screen of the mobile terminal 101 enters the same screen state as the main screen of the in-vehicle host 102, and the user can produce the same operation effect as that on the mobile terminal 101 on the main screen of the in-vehicle host 102 by operating the mobile terminal 101. The screen contents of the mobile terminal 101 are as shown in fig. 6, and the screen contents of the main screen of the in-vehicle host 102 are as shown in fig. 7, and the screen contents of both are kept identical. At this time, a driver or other users near the home screen can also operate in parallel on the home screen, and the content of the corresponding operation triggered on the home screen of the vehicle-mounted host computer can also be displayed on the screen of the mobile terminal. That is, the contents on the main screen of the in-vehicle host computer are displayed on the screen of the mobile terminal in real time.
When the user selects the "control sub-screen", icons of the "control sub-screen 1" and the "control sub-screen 2" are popped up on the screen of the mobile terminal 101, the user selects to click on the icons, and the mobile terminal 101 receives information of the icons clicked by the user and sends the information to the in-vehicle host 102. After receiving the information, the in-vehicle host 102 transmits the content of the corresponding sub-screen of the in-vehicle host 102 to the mobile terminal 101. The mobile terminal 101 receives the content of the sub-screen of the in-vehicle host 102, and displays the content of the sub-screen of the in-vehicle host 102 on the screen of the mobile terminal 101. That is, the screen of the mobile terminal 101 enters the same screen state as the sub-screen interface under the corresponding operation of the user. If the "control sub-screen 1" is selected, the screen of the mobile terminal 101 enters the same screen state as the sub-screen 1 of the in-vehicle host 102, and further, the user operates the mobile terminal 101 to generate the same operation effect on the sub-screen 1 of the in-vehicle host 102 as that on the mobile terminal 101, and the screen contents of the two are kept consistent. At this time, other users near the secondary screen 1 can operate in parallel on the secondary screen, and the content of the corresponding operation triggered on the secondary screen of the vehicle-mounted host computer can be displayed on the screen of the mobile terminal. That is, the contents on the sub-screen of the host computer in the vehicle are displayed on the screen of the mobile terminal in real time.
The mobile terminal 101 may be any electronic product that can perform man-machine interaction with a user through one or more modes of a keyboard, a touch pad, a touch screen, a remote controller, a voice interaction or a handwriting device, and the electronic product configures an android system. Such as a PC (Personal Computer ), cell phone, smart phone, PDA (Personal Digital Assistant ), palm top computer PPC (Pocket PC), tablet computer, etc.
The in-vehicle host 102 may be an electronic computer controlled by the central control system of the automobile.
In addition, the operating system of the vehicle-mounted host computer can be an android system or other operating systems. In a scenario where the operating system of the on-board host is an android system, the operating system of the on-board host includes an application layer, an architecture layer, a JNI layer (Java Native Interface, object-oriented local interface), a native layer, and a core layer.
The application layer is mainly the running of various application programs. The application programs comprise an instant messaging client, a short message program, a calendar, a map, a browser, a contact management program and the like, and all the application programs in the application layer are written by using java language.
The architecture layer is mainly to provide the developer with an API framework that can be used to fully access the core application, which is actually the framework of one application. Because the application program in the application layer is written by java, the architecture layer is also written by java language, and comprises various controls required in the application program, such as controls of embedded browser, buttons, text boxes and the like.
The local layer includes an android operating environment and various libraries. The android running environment mainly refers to a Dalvik virtual machine. Various libraries are used by different controls in the architecture layer to provide services to developers through the framework layer. In the android system, various applications need support of libraries in the local layer, and then the applications are run through the Dalvik virtual machine in the running environment. The native layer is written in the C/C++ language.
The JNI layer is a local programming interface in the android system. Because the application layer and the framework layer are realized by java language, the local layer is realized by C/C++ language, and the JNI layer is used as a bridge for interaction between layer structures using different languages.
The core layer provides the bottom layer drive for various hardware of the android device, and the android device provides core system services based on the core layer, such as basic service capabilities of an operating system including file management, memory management, process management, network stack, drive model and the like.
It should be understood by those skilled in the art that the mobile terminal 101 and the in-vehicle host 102 are merely examples, and that other mobile terminals or in-vehicle hosts that may be present in the present application or may be present in the future are also included within the scope of the embodiments of the present application and are incorporated herein by reference.
Next, a detailed explanation will be given of a control method of the vehicle-mounted screen provided by the embodiment of the present application.
Fig. 8 is a flowchart of a control method of a vehicle-mounted screen according to an embodiment of the present application, where the method is applied to a vehicle-mounted host. Referring to fig. 8, the method includes the following steps.
Step 801: the method comprises the steps that a vehicle-mounted host receives a touch event data packet sent by a mobile terminal, the touch event data packet comprises attribute information of a first touch event triggered by a user on a screen of the mobile terminal in a first time period, the attribute information of the first touch event comprises attribute information of each initial touch point in at least one initial touch point, the attribute information of each initial touch point comprises touch time, the first time period is a time period from the last time the mobile terminal sends the touch event data packet to the current time the mobile terminal sends the touch event data packet, and screen display content of the mobile terminal is consistent with that of the vehicle-mounted host.
When the user single finger starts touching the screen until the user single finger leaves the screen, the operation of the user on the mobile terminal in the period of time can be called a touch event, namely a first touch event. Correspondingly, when the user touches the screen with two fingers and the user leaves the screen with two fingers, the mobile terminal obtains two touch events according to respective operations of the two fingers in the time period, wherein the operation of each finger is one touch event.
When a user starts to touch the screen by a single finger, namely a touch point is generated on the screen of the mobile terminal, the mobile terminal starts to acquire information carried by the touch point, wherein the touch point is a contact point between the central point of the user finger and the screen of the mobile terminal. When a single finger of a user continuously slides on a screen, in the sliding process, the finger of the user continuously moves on the screen of the mobile terminal, a new touch point can be generated every time the finger moves, the mobile terminal continuously acquires information carried by the touch points until the single finger of the user leaves the screen, the mobile terminal acquires information carried by the touch points generated when the finger of the user finally touches the screen, and the mobile terminal acquires information carried by all the touch points generated under the sliding operation of the user in the period of time, wherein the information carried by each touch point can be called attribute information of the touch point. All touch points form the touch event, so that the attribute information of all touch points is used as the attribute information of the touch event.
When a user touches the screen with a single finger, and a touch point is generated, the attribute information of the touch point includes information such as touch time, position information, direction information, pressure information, touch type and the like of the touch point.
Specifically, the touch time of the touch point is the time of generating the touch point, the position information of the touch point includes x and y coordinates of the touch point and the area size of the whole finger covered by the screen when the user touches the mobile terminal screen, the direction information of the touch point is the moving direction indicated by the touch point, such as left and right, the pressure information of the touch point is the pressure of the touch point touching the mobile terminal screen, and the touch type of the touch point is the type of single click, double click, long press, short press, and the like of the touch point.
The mobile terminal senses the operation of a user on a screen of the mobile terminal in real time, and sends attribute information of a touch event formed by the operation to the vehicle-mounted host in real time. And the mobile terminal packages the attribute information of the touch event acquired in the fixed time period into a touch event data packet and sends the touch event data packet to the vehicle-mounted host. The attribute information of the touch event is attribute information of all touch points generated by the operation of the user in the period of time. This fixed period of time is referred to as a first period of time.
For real-time purposes, the first time period is a short time period. For example, the mobile terminal sends the attribute information of all touch points generated in 10 ms to the vehicle-mounted host computer as a touch event data packet every 10 ms. In this period of time, the operation process that the user's finger touches the mobile terminal screen may not be finished yet, so the on-vehicle host receives the attribute information of only a part of the touch events generated in the operation process of the user from the touch event data packet sent by the mobile terminal, that is, the touch event data packet may only include the attribute information of a part of the touch events in the first touch event.
In addition, when the mobile terminal sends the touch event data packet, the mobile terminal generates identification information which can uniquely identify the touch event, and the identification information can also be called as an event identification of the touch event. Therefore, when the mobile terminal sequentially sends the touch event data packets to the vehicle-mounted host, some touch event data packets with the same event identification may exist in the sequentially sent touch event data packets.
Step 802: the method comprises the steps that a vehicle-mounted host determines attribute information of a second touch event based on attribute information of a first touch event and a historical touch event data packet received before current time, the second touch event indicates that the first touch event triggered by a user on a mobile terminal screen is recombined into a touch event triggered by the user on a vehicle-mounted host screen, the attribute information of the second touch event comprises attribute information of each recombined touch point in at least one recombined touch point, each recombined touch point corresponds to an initial touch point, the attribute information of each recombined touch point comprises touch time, and the touch time of each recombined touch point is obtained by correcting deviation between the touch time of the corresponding initial touch point and the system time of the mobile terminal and the system time of the vehicle-mounted host.
The mobile terminal sends the touch event data packet generated in the fixed time period to the vehicle-mounted host computer. Thus, the vehicle-mounted host can obtain a plurality of touch event data packets. In addition to the touch event data packets received at the current time, other touch event data packets in the plurality of touch event data packets are also referred to as historical touch event data packets.
Because one touch event data packet sent by the mobile terminal may only include part of the touch events in the first touch event, when the mobile terminal sequentially sends the touch event data packets to the vehicle-mounted host, some touch event data packets with the same event identifier may exist in the sequentially sent touch event data packets, so in step 802, the touch events in the touch event data packets sent by the mobile terminal are recombined to obtain a new touch event, and the new touch event is determined to be the second touch event. Each touch point in the first touch event is called an initial touch point, and each touch point in the second touch event is called a reorganization touch point.
In addition, since there may be a difference between the system time of the mobile terminal and the system time of the in-vehicle host, for example, as shown in fig. 6 and 7, the system time on the screen of the mobile terminal in fig. 6 is 11:20, and the system time on the main screen of the in-vehicle host in fig. 7 is 11:21, which are different in time. Under the condition that transmission time delay generated in the process that the mobile terminal sends the touch event data packet to the vehicle-mounted host is not considered, touch time in the touch event data packet received by the vehicle-mounted host and time for the vehicle-mounted host to receive the touch event data packet may be different, so that the touch time in the touch event data packet received by the vehicle-mounted host needs to be corrected, that is, the touch time of each initial touch point in the touch event data packet is corrected.
Thus, in some embodiments, the implementation process of determining the attribute information of the second touch event may be divided into the following two steps based on the attribute information of the first touch event and the historical touch event data packet received before the current time.
Step one: and judging whether an event identifier of the first touch event exists in the historical touch event data packet received before the current time.
Step two: if the event identification of the first touch event does not exist in the historical touch event data packet received before the current time, generating a second touch event corresponding to the first touch event, traversing each initial touch point in at least one initial touch point in the first touch event, and executing the following operations on each initial touch point to obtain attribute information of the second touch event: correcting the touch time of each initial touch point based on the touch time of each initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, and determining the corrected touch time of each initial touch point and other attribute information of each initial touch point as attribute information of a recombined touch point.
Step three: if the event identification of the first touch event exists in the historical touch event data packet received before the current time, traversing each initial touch point in at least one initial touch point in the first touch event, and executing the following operations on each initial touch point: correcting the touch time of each initial touch point based on the touch time of each initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, and determining the corrected touch time of each initial touch point and other attribute information of each initial touch point as attribute information of a recombined touch point. And adding the obtained attribute information of at least one recombined touch point into the attribute information of the second touch event generated before the current time to obtain updated attribute information of the second touch event.
In the first step, the vehicle-mounted host determines whether the event identification identical to the event identification of the first touch event exists in each historical touch event data packet according to the event identification of the first touch event in the touch event data packet received at the current time and the event identification of the touch event in the historical touch event data packet received before the current time. Thus, the operations in the second and third steps are obtained.
In the second step, if the event identifier which is the same as the event identifier of the first touch event in the touch event data packet received at the current time does not exist in the historical touch event data packet, that is, the touch event in the touch event data packet received at the current time is a new first touch event. At this time, a second touch event corresponding to the first touch event is generated, and each initial touch point in the first touch event is traversed, so as to regenerate attribute information of the reorganized touch point corresponding to each initial touch point.
And traversing each initial touch point in the first touch event, and for each initial touch point, regenerating attribute information of each recombined touch point corresponding to each initial touch point according to the following method. Therefore, the following embodiments take a first initial touch point in the first touch event as an example to reproduce attribute information of the first recombined touch point corresponding to the first initial touch point based on the first initial touch point in the first touch event.
Based on a first initial touch point in the first touch event, the specific operation of regenerating the attribute information of the first recombined touch point corresponding to the first initial touch point is as follows: correcting the touch time of the first initial touch point, performing difference on the deviation between the touch time of the first initial touch point and the system time of the mobile terminal and the system time of the vehicle-mounted host computer to obtain the touch time of the first recombination touch point corresponding to the first initial touch point, and determining the touch time of the first recombination touch point and other attribute information of the first initial touch point as the attribute information of the first recombination touch point in the second touch event.
In addition, generating a second touch event corresponding to the first touch event specifically refers to: and generating an event identifier of the second touch event based on the event identifier of the first touch event. The event identification of the second touch event may also be, for example, the event identification of the first touch event directly.
In the third step, if the event identifier which is the same as the event identifier of the first touch event in the touch event data packet received at the current time exists in the historical touch event data packet, that is, the touch event in the touch event data packet received at the current time and the touch event with the same event identifier in the historical touch event data packet are the same touch event. At this time, traversing each initial touch point in the first touch event to regenerate attribute information of a reorganization touch point corresponding to each initial touch point, adding the obtained attribute information of each reorganization touch point to the attribute information of the second touch event generated before the current time, and obtaining updated attribute information of the second touch event.
Because the vehicle-mounted host processes the received touch event data packet in real time, when the vehicle-mounted host receives the historical touch event data packet sent by the mobile terminal, the vehicle-mounted host immediately processes attribute information of touch events in the historical touch event data packet. Therefore, if the vehicle-mounted host computer generates the second touch event based on the historical touch event data packet before the current time, when the vehicle-mounted host computer receives one touch event data packet at the current time, the vehicle-mounted host computer can directly traverse each initial touch point in the touch event data packet received at the current time so as to regenerate the attribute information of the recombined touch point corresponding to each initial touch point. And finally, adding the attribute information of each recombined touch point into the attribute information of the generated second touch event one by one, and finally obtaining the updated attribute information of the second touch event.
The specific operation of traversing each initial touch point in the touch event data packet received at the current time and regenerating the attribute information of the reconstructed touch point corresponding to each initial touch point is identical to the method of regenerating the attribute information of the reconstructed touch point corresponding to each initial touch point in the step two, and is not repeated here.
For example, if the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host is 1s, the touch time of the first initial touch point in the first touch event received in the touch event data packet at the current time is 10:00:50, the touch time of the second initial touch point is 10:00:55, based on the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host for 1s, the touch time of the first recombined touch point is 10:00:49, and the touch time of the second recombined touch point is 10:00:54.
For example, if the event identifier of the first touch event in the touch event data packet received by the user at the current time is a, if the event identifier of the first touch event does not exist in the historical touch event data packet, a second touch event corresponding to the first touch event in the touch event data packet received at the current time is generated. If the historical touch event data packet has the touch event with the event mark being A, the fact that the touch event with the event mark being A in the historical touch event data packet and the touch event in the touch event data packet received at the current time are the same touch event is indicated, after the touch time of each initial touch point in the first touch event in the touch event data packet received at the current time is corrected, the touch time of a recombination touch point corresponding to each initial touch point is obtained, then the touch time of each recombination touch point and other attribute information of the corresponding initial touch point are used as the attribute information of the recombination touch point, so that the attribute information of each recombination touch point is obtained, and finally the attribute information of each recombination touch point is added into the attribute information of a second touch event which is generated before.
In addition, the implementation process of determining the deviation between the system time of the mobile terminal and the system time of the in-vehicle host may be: when the vehicle-mounted host receives the touch event data packet sent by the mobile terminal for the first time, the vehicle-mounted host acquires the touch time of the touch event data packet received for the first time. And determining the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host based on the touch time in the touch event data packet received for the first time and the time for receiving the touch event data packet for the first time.
Because the mobile terminal sends the touch event data packet to the vehicle-mounted host computer every time at a fixed time interval, the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer is obtained only based on the touch time in the touch event data packet received by the vehicle-mounted host computer for the first time and the time for receiving the touch event data packet for the first time.
When the touch event data packet received by the vehicle-mounted host for the first time only comprises one touch point, acquiring the time of the touch event data packet received by the vehicle-mounted host, namely the touch time of the touch point and the time of the vehicle-mounted host for receiving the touch event data packet, and differentiating the touch time of the touch event data packet received by the vehicle-mounted host and the time of the vehicle-mounted host for receiving the touch event data packet to obtain the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host.
When the touch event data packet received by the vehicle-mounted host for the first time comprises a plurality of touch points, acquiring the touch time of the last touch point in the touch event data packet received by the vehicle-mounted host and the time of the vehicle-mounted host for receiving the touch event data packet, and making a difference between the touch time of the last touch point in the touch event data packet received by the vehicle-mounted host and the time of the vehicle-mounted host for receiving the touch event data packet, so as to obtain the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host.
For example, if the touch event data packet received by the vehicle-mounted host for the first time includes only one touch point, the touch time of the touch point in the touch event data packet received by the vehicle-mounted host is 10:00:10, the time for the vehicle-mounted host to receive the touch event data packet is 10:00:09, and the difference between the touch time of the touch point in the touch event data packet received by the vehicle-mounted host and the time for the vehicle-mounted host to receive the touch event data packet is obtained, so as to obtain a deviation of 1s between the system time of the mobile terminal and the system time of the vehicle-mounted host.
If the touch event data packet received by the vehicle-mounted host for the first time includes three touch points, the touch time of the three touch points is respectively: 10:00:09, 10:00:11 and 10:00:15, namely, the touch time of the last touch point is 10:00:15 as the touch time in a touch event data packet received by the vehicle-mounted host, the time of the vehicle-mounted host receiving the touch event data packet is 10:00:14, the touch time of the last touch point in the touch event data packet received by the vehicle-mounted host is differenced from the time of the vehicle-mounted host receiving the touch event data packet, and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host is 1s.
Step 803: and updating the screen display content of the vehicle-mounted host based on the attribute information of the second touch event, wherein the display screen of the vehicle-mounted host displays the second touch event when the current time is the touch time of the recombination touch point in the second touch event.
In the above step 801, the attribute information of the first touch event is described in detail, and since the first touch event may include one initial touch point or may include a plurality of initial touch points, the attribute information of the first touch event includes the attribute information of at least one initial touch point corresponding to the first touch event. Correspondingly, the attribute information of the second touch event also comprises the attribute information of at least one recombination touch point corresponding to the second touch event.
After obtaining the attribute information of the second touch event, the implementation process of updating the screen display content of the vehicle-mounted host machine may be: if the number of at least one recombination touch point corresponding to the second touch event is one, determining that the second touch event is a clicking operation, determining a clicking area on the vehicle-mounted host screen corresponding to the clicking operation based on the position information of the touch point corresponding to the clicking operation, and updating the display content of the vehicle-mounted host screen based on the clicking area. If the number of at least one recombination touch point corresponding to the second touch event is multiple, determining that the second touch event is a sliding operation, determining a sliding area on the vehicle-mounted host screen corresponding to the sliding operation based on the position information of each recombination touch point corresponding to the sliding operation and the direction information of each corresponding recombination touch point, and updating the display content of the vehicle-mounted host screen based on the sliding area.
The position information of the touch point includes x and y coordinates of the touch point and a size of an area of the whole finger covered screen when the user touches the mobile terminal screen. In this scenario, based on the position information of the touch point corresponding to the clicking operation, the implementation process of determining the clicking area on the vehicle-mounted host screen corresponding to the clicking operation may be: and taking the position corresponding to the x and y coordinates of the recombined touch point as a geometric center, determining that the geometric center is taken as a circle center, and including a screen area when a user finger covers the circle center so as to obtain a clicking area corresponding to the recombined touch point, and determining a clicking area on a vehicle-mounted host screen corresponding to clicking operation.
Optionally, when the attribute information of the second touch event further includes pressure information, after determining the click region of the reorganization touch point, the display content of the vehicle-mounted host screen may be updated on the click region based on the pressure information of the reorganization touch point.
For example, when the pressure information of the recombination touch point indicates that the user clicks on the mobile terminal, the on-vehicle host screen displays the picture content of the recombination touch point clicked. When the pressure information of the recombined touch point indicates that the user clicks on the mobile terminal, the vehicle-mounted host screen displays the picture content under the key click of the touch point.
The position information of the touch point includes x and y coordinates of the touch point and a size of an area of the whole finger covered screen when the user touches the mobile terminal screen. In this scenario, based on the position information of each touch point corresponding to the sliding operation and the direction information of each corresponding reorganization touch point, the implementation process of determining the sliding area on the vehicle-mounted host screen corresponding to the sliding operation may be: the method comprises the steps of taking the positions corresponding to the x and y coordinates of each recombined touch point as a geometric center, respectively determining a screen area taking the geometric center as a circle center, covering the circle center by a user finger to obtain clicking areas corresponding to the recombined touch points, and connecting the clicking areas of the recombined touch points according to the direction information of the recombined touch points and the moving direction indicated by each recombined touch point to determine a sliding area on a vehicle-mounted host screen corresponding to the sliding operation of the user.
Optionally, when the attribute information of the second touch event further includes pressure information, after determining a sliding area on the on-vehicle host screen corresponding to the sliding operation of the user, display content of the on-vehicle host screen may be updated on the sliding area based on the pressure information of each reorganization touch point.
If the second touch event includes five recombination touch points, the positions corresponding to the x and y coordinates of the five recombination touch points are obtained according to the position information of the five recombination touch points, the positions corresponding to the x and y coordinates of each recombination touch point are respectively used as a geometric center, the screen area when the geometric center is used as a circle center and a user finger covers the circle center is respectively determined, so that click areas corresponding to the five recombination touch points are obtained, the click areas of the five recombination touch points are connected according to the direction information of the five recombination touch points and the indicated moving direction of each recombination touch point to form a sliding area, then the pressure weight of each recombination touch point is determined according to the pressure information of the five recombination touch points, and a sliding picture formed by the five recombination touch points is displayed in the sliding area according to the pressure weight of each recombination touch point.
In the embodiment of the application, the vehicle-mounted host computer judges whether the event identification of the first touch event exists in the historical touch event data packet received before the current time, and recombines the attribute information of the historical touch event data packet which is the same as the event identification of the first touch event with the attribute information of the first touch event to generate the attribute information of the second touch event, wherein the touch time of each recombined touch point in the attribute information of the second touch event is obtained after correction according to the touch time of each initial touch point in the first touch event and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer, so that the recombined touch point can be correctly displayed on the vehicle-mounted host computer screen when the current time is the touch time of the recombined touch point in the second touch time, and the second touch event can be completely displayed on the vehicle-mounted host computer screen.
The control method of the vehicle-mounted screen in fig. 8 aims at the single-finger operation of the user on the mobile terminal, and the embodiment of the application can also support the multi-finger operation of the user on the mobile terminal. Referring to fig. 9, the method includes the following steps.
Step 901: the method comprises the steps that a vehicle-mounted host receives a touch event data packet sent by a mobile terminal, wherein the touch event data packet comprises attribute information of a first touch event triggered by a user on a mobile terminal screen in a first time period, and further comprises attribute information of a third touch event triggered by the user on the mobile terminal screen in the first time period, and the third touch event and the first touch event are different touch events.
For example, when a user double-finger operates a screen on a mobile terminal, each finger is operated to generate a touch event, which is a first touch event and a third touch event. The third touch event and the first touch event are different touch events, that is, in the first time period, the touch event data packet received by the vehicle-mounted host computer includes two different touch events and attribute information corresponding to the two touch events respectively.
Based on the description in step 801, the vehicle-mounted host receives a touch event data packet in a first period, where the touch event data packet includes attribute information of a first touch event, the attribute information of the first touch event includes an event identifier of the first touch event and attribute information of at least one initial touch point in the first touch event, and the attribute information of the initial touch point in the first touch event includes information such as position information of the initial touch point, pressure information of the initial touch point, and direction information of the initial touch point. Correspondingly, when the touch event data packet further includes attribute information of a third touch event, the attribute information of the third touch event also includes an event identifier of the third touch event and attribute information of at least one initial touch point in the third touch event, and the attribute information of the initial touch point in the third touch event includes information such as position information of the initial touch point, pressure information of the initial touch point, direction information of the initial touch point, and the like. Of course, the touch event data packet received by the vehicle-mounted host may further include a plurality of touch events and attribute information of the touch events.
Step 902: the vehicle-mounted host determines attribute information of a second touch event based on the attribute information of the first touch event and a historical touch event data packet received before the current time, and determines attribute information of a fourth touch event based on the attribute information of a third touch event and a historical touch event data packet received before the current time.
The fourth touch event indication reorganizes a third touch event triggered by a user on a screen of the mobile terminal into a touch event triggered by the user on a screen of the vehicle-mounted host, wherein the attribute information of the fourth touch event comprises attribute information of each reorganization touch point in at least one reorganization touch point, and the touch time of each reorganization touch point in the fourth touch event is obtained by correcting deviation between the touch time of the corresponding initial touch point, the system time of the mobile terminal and the system time of the vehicle-mounted host.
Based on the above-mentioned step 802, the detailed description of the attribute information of the second touch event is determined based on the attribute information of the first touch event and the historical touch event data packet received before the current time by the vehicle-mounted host, and the method for determining the attribute information of the fourth touch event based on the attribute information of the third touch event and the historical touch event data packet received before the current time by the vehicle-mounted host is identical to the method in the above-mentioned step 802, and is not repeated here.
The vehicle-mounted host determines attribute information of a second touch event based on the attribute information of the first touch event and a historical touch event data packet received before the current time, and determines attribute information of a fourth touch event based on the attribute information of a third touch event and a historical touch event data packet received before the current time. That is, the vehicle-mounted host obtains the attribute information of the second touch event and the attribute information of the fourth touch event at the same time.
Step 903: and updating the screen display content of the vehicle-mounted host based on the attribute information of the second touch event and the attribute information of the fourth touch event.
The display screen of the vehicle-mounted host displays the second touch event when the current time is the touch time of the recombination touch point in the second touch event, and displays the fourth touch event when the current time is the touch time of the recombination touch point in the fourth touch event.
Based on the above detailed description of updating the screen display content of the on-vehicle host in step 803, correspondingly, the implementation process of updating the screen display content of the on-vehicle host based on the attribute information of the fourth touch event is identical to the implementation process in step 803. However, in step 903, the on-vehicle host updates the screen display content of the on-vehicle host based on the attribute information of the second touch event and the attribute information of the fourth touch event. At this time, the second touch event and the fourth touch event are displayed on the screen of the vehicle-mounted host computer at the same time.
The screen finally displayed on the in-vehicle host computer screen in step 803 is a click or slide operation by a single finger of the user. And the screen finally displayed on the on-vehicle host computer screen in step 903 is a click or slide operation by the user with two fingers.
For example, when the second touch event and the fourth touch event respectively correspond to one recombination touch point, the user indicates that the user double points to click the screen on the mobile terminal, and the vehicle-mounted host displays the content corresponding to the double points to click screen on the vehicle-mounted host screen. When the second touch event and the fourth touch event respectively correspond to the plurality of recombination touch points, the operation of displaying the double-finger sliding screen on the mobile terminal by the vehicle-mounted host computer is indicated.
For example, when the user slides the screen in two fingers on the mobile terminal, the user performs an operation of zooming in or zooming out the screen of the mobile terminal, and accordingly, the zooming in or zooming out of the screen of the vehicle-mounted host is displayed on the screen of the vehicle-mounted host.
In the embodiment of the application, the touch time data packet received by the vehicle-mounted host computer comprises attribute information of a first touch event and attribute information of a third touch event, then the attribute information of a historical touch event data packet with the same event identification as the first touch event and the attribute information of the first touch event are recombined to generate attribute information of a second touch event, and the touch time of each recombined touch point in the attribute information of the second touch event is obtained after correction according to the touch time of each initial touch point in the first touch event and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer. And recombining attribute information of the historical touch event data packet with the same event identification as the third touch event and attribute information of the third touch event to generate attribute information of a fourth touch event, wherein the touch time of each recombined touch point in the attribute information of the fourth touch event is obtained after correction according to the touch time of each initial touch point in the third touch event and deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer. And finally, the vehicle-mounted host updates the display content of the vehicle-mounted host screen based on the attribute information of the second touch event and the attribute information of the fourth touch event. Thus, when the user clicks or slides the screen with two fingers on the mobile terminal, the operation of clicking or sliding with two fingers can be correspondingly displayed on the screen of the vehicle-mounted host computer.
The embodiments of fig. 8 and 9 are control methods for a vehicle-mounted screen based on an operating system of a vehicle-mounted host, and the two methods have strong adaptability and do not depend on modification of the operating system of the vehicle-mounted host. However, the two methods need to correct the touch time of each initial touch point in the first touch event and the third touch event one by one, so that the calculation amount is large, the time consumption is also large, and the embodiments of fig. 8 and fig. 9 are suitable for the scene that the local layer of the vehicle-mounted host is not modifiable. Therefore, the application provides another control method of the vehicle-mounted screen, and the vehicle-mounted host supported by the method has independent controllable right, can independently modify the operating system of the vehicle-mounted host according to the requirement, and is suitable for a scene in which the local layer of the vehicle-mounted host can be modified. As shown in fig. 10, the method includes the following steps.
Step 1001: the application layer receives a touch event data packet sent by the mobile terminal, wherein the touch event data packet comprises attribute information of a first touch event triggered by a user on a screen of the mobile terminal in a first time period, the attribute information of the first touch event comprises attribute information of each initial touch point in at least one initial touch point, the attribute information of each initial touch point comprises touch time, and the first time period is a time period from the last time the mobile terminal sends the touch event data packet to the current time the mobile terminal sends the touch event data packet, and screen display content of the mobile terminal is consistent with that of a vehicle-mounted host.
Based on the above description of each layer structure of the operating system of the vehicle-mounted host, the vehicle-mounted host receives the touch event data packet at the application layer. The touch event data packet comprises attribute information of a first touch event, and the attribute information of the first touch event comprises attribute information of all touch points in the first touch event. The touch point in the first touch event is referred to as an initial touch point.
The attribute information of the initial touch point may refer to the related content in the embodiment of fig. 8.
In addition, in a scene that a user double-finger operates a screen on the mobile terminal, the touch event data packet received by the vehicle-mounted host computer at the application layer further comprises attribute information of a third touch event triggered by the user on the screen of the mobile terminal in a first time period, wherein the third touch event and the first touch event are different touch events.
Step 1002: the application layer sends the attribute information of the first touch event to the local layer, the local layer stores the attribute information of the first touch event into a container of the local layer, and the local layer is configured with a time correction algorithm module.
Because the touch time of the first touch event received by the vehicle-mounted host is the time under the mobile terminal system, and the time of the application layer receiving the touch event is the time under the vehicle-mounted host system, and a deviation may exist between the system time of the mobile terminal and the system time of the vehicle-mounted host, in the embodiment of the application, the time correction algorithm module is configured in the local layer, and the touch time of the initial touch point in the touch event sent by the application layer is corrected to the touch time of each initial touch point under the vehicle-mounted host system by using the module.
The layer structure of the operating system of the vehicle-mounted host is a local layer, a JNI layer, a framework layer and an application layer in sequence from the bottom layer. Based on the above description of the layer structure of the operating system of the vehicle-mounted host, interaction is performed between the local layer and the application layer, and if the local layer is configured with the time correction algorithm module, the intermediate architecture layer and the JNI layer both need to be added with interfaces of the time correction algorithm module, so that information can be conveniently transferred.
Specifically, the application layer sends the attribute information of the first touch event to the local layer through interfaces of the time correction algorithm modules added in the architecture layer and the JNI layer, and the local layer stores the attribute information of the first touch event in a container of the local layer. After determining the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, the application layer sends the deviation to the local layer. And configuring a time correction algorithm module by the local layer, and obtaining updated attribute information of the first touch event by using the time correction algorithm module.
The application layer sends the attribute information of the first touch event to the local layer in real time, the local layer stores the attribute information of the first touch event into the local layer by using a linear (vector) container, and the linear container can automatically store the attribute information of the first touch event and can automatically increase or reduce the storage space, so that the attribute information of the first touch event sent by the application layer in real time can be stored in a vector mode.
The implementation process of the application layer for determining the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host machine is as follows: when the application layer receives the touch event data packet sent by the mobile terminal for the first time, the application layer obtains the touch time of the touch event data packet received for the first time. The application layer determines the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host based on the touch time in the touch event data packet received for the first time and the time of receiving the touch event data packet for the first time.
The specific manner of determining the deviation between the system time of the mobile terminal and the system time of the in-vehicle host may refer to the related content in the embodiment of fig. 8.
In addition, under the condition that a user generates a first touch event and a third touch event by double-finger operation screens on the mobile terminal, the application layer can also send the attribute information of the first touch event and the attribute information of the third touch event to a local layer at the same time, the local layer stores the attribute information of the first touch event and the attribute information of the third touch event into a container of the local layer, and the local layer is configured with a time correction algorithm module.
The method for the application layer to send the attribute information of the third touch event to the local layer and the method for the local layer to store the attribute information of the third touch event are identical to the method for the application layer to send the attribute information of the first touch event to the local layer and the method for the local layer to store the attribute information of the first touch event, and are not repeated here.
Step 1003: the local layer calling time correction algorithm module corrects the touch time of each initial touch point in at least one initial touch point based on the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer, and acquires the updated attribute information of the first touch event.
Because there may be a difference between the system time of the mobile terminal and the system time of the vehicle-mounted host, under the condition of not considering the transmission delay generated in the process that the mobile terminal sends the touch event data packet to the application layer of the vehicle-mounted host, the touch time in the touch event data packet received by the application layer of the vehicle-mounted host and the time when the application layer of the vehicle-mounted host receives the touch event data packet may be different, so that the touch time of the touch event data packet received by the application layer needs to be corrected, that is, the touch time of each initial touch point in the touch event data packet needs to be corrected.
The local layer stores attribute information of a first touch event in a container of the local layer, wherein the attribute information of the first touch event comprises touch time of all touch points in the first touch event. After the local layer obtains the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer, which are sent by the application layer, the touch time of all the initial touch points is corrected at one time by utilizing the deviation and time correction algorithm module.
The implementation process of correcting the touch time of all the initial touch points by using the time correction algorithm module may be: and taking the difference between the touch time of all the initial touch points and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer to obtain corrected touch time of all the touch points, namely obtaining the attribute information updated by the first touch event.
In addition, under the scene that the user performs double-finger operation on the mobile terminal and simultaneously generates the first touch event and the third touch event, the local layer can also call a time correction algorithm module to correct the touch time of each initial touch point in at least one initial touch point included in the first touch event and the touch time of each initial touch point in at least one initial touch point included in the third touch event based on the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, and meanwhile obtain the attribute information updated by the first touch event and the attribute information updated by the third touch event.
The method for obtaining the updated attribute information of the third touch event by the local layer is completely the same as the method for obtaining the updated attribute information of the first touch event by the local layer, and will not be described herein.
Step 1004: the local layer sends the attribute information updated by the first touch event to the application layer, and the application layer updates the screen display content of the vehicle-mounted host based on the attribute information updated by the first touch event.
After the local layer obtains the updated attribute information of the first touch event, the updated attribute information of the first touch event is sent to the application layer, and the application layer updates the screen display content of the vehicle-mounted host by using the updated attribute information of the first touch event.
In the above step 1001, the attribute information of the first touch event is described in detail, and since the first touch event may include one initial touch point or may include a plurality of initial touch points, the attribute information of the first touch event includes the attribute information of at least one initial touch point corresponding to the first touch event.
After the updated attribute information of the first touch event is obtained, the implementation process of updating the screen display content of the vehicle-mounted host machine can be as follows: if the number of at least one initial touch point corresponding to the first touch event in the updated attribute information is one, determining that the first touch event is a clicking operation, determining a clicking area on the vehicle-mounted host screen corresponding to the clicking operation based on the position information of the touch point corresponding to the clicking operation, and updating the display content of the vehicle-mounted host screen based on the clicking area. And if the number of at least one initial touch point corresponding to the first touch event in the updated attribute information is a plurality of, determining the first touch event as a sliding operation, determining a sliding area on the vehicle-mounted host screen corresponding to the sliding operation based on the position information of each initial touch point corresponding to the sliding operation and the direction information of each corresponding initial touch point, and updating the display content of the vehicle-mounted host screen based on the sliding area.
The specific manner of updating the screen display content of the in-vehicle host machine may refer to the related content in the embodiment of fig. 8.
In addition, under the scene that the user generates the first touch event and the third touch event by double-finger operation screens on the mobile terminal, the local layer can also send the attribute information updated by the first touch event and the attribute information updated by the third touch event to the application layer at the same time, and the application layer updates the screen display content of the vehicle-mounted host based on the attribute information updated by the first touch event and the attribute information updated by the third touch event at the same time.
Based on the description of the application layer updating the screen display content of the vehicle-mounted host based on the attribute information updated by the first touch event, correspondingly, the method of updating the screen display content of the vehicle-mounted host based on the attribute information updated by the third touch event by the application layer is completely the same as the method of updating the screen display content of the vehicle-mounted host based on the attribute information updated by the application layer. However, when the application layer updates the screen display content of the vehicle-mounted host based on the updated attribute information of the first touch event and the updated attribute information of the third touch event at the same time, at this time, the first touch event and the third touch event are displayed on the screen of the vehicle-mounted host at the same time.
And updating the screen display content of the vehicle-mounted host based on the updated attribute information of the first touch event by the application layer, wherein finally, the picture displayed on the screen of the vehicle-mounted host is the clicking or sliding operation of a single finger of a user. And the application layer updates the screen display content of the vehicle-mounted host based on the updated attribute information of the first touch event and the updated attribute information of the third touch event, and finally the screen displayed on the screen of the vehicle-mounted host is clicked or slid by double fingers of a user.
The embodiment of the application supports the autonomous controllable right of the vehicle-mounted host, and can autonomously modify the operating system of the vehicle-mounted host according to the requirement. Under the condition, a time correction algorithm module is configured in the local layer of the vehicle-mounted host, the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host is determined in the application layer, and after the deviation is transmitted to the local layer, the local layer directly calls the time correction algorithm module to correct the touch time of each touch point in all touch events at one time, and the updated attribute information of the touch events is obtained. The local layer sends the attribute information updated by the touch event to the application layer, and the application layer updates the screen display content of the vehicle-mounted host based on the attribute information updated by the touch event. Compared with the embodiment of fig. 8 and 9, the method for controlling the vehicle-mounted screen provided by the embodiment of the application can greatly accelerate the processing speed of the touch event and reduce the time consumption.
The embodiment of the application provides a control device of a vehicle-mounted screen, which comprises the following components: the device comprises a receiving module, a first determining module and a first updating module.
The mobile terminal comprises a receiving module, a receiving module and a display module, wherein the receiving module is used for receiving a touch event data packet sent by a mobile terminal, the touch event data packet comprises attribute information of a first touch event triggered by a user on a screen of the mobile terminal in a first time period, the attribute information of the first touch event comprises attribute information of each initial touch point in at least one initial touch point, the attribute information of each initial touch point comprises touch time, the first time period is a time period from the last time the mobile terminal sends the touch event data packet before the current time to the current time when the mobile terminal sends the touch event data packet, and the screen display content of the mobile terminal is consistent with the screen display content of the vehicle-mounted host;
the first determining module is used for determining attribute information of a second touch event based on the attribute information of the first touch event and a historical touch event data packet received before the current time by the vehicle-mounted host, the second touch event indicates that the first touch event triggered by a user on the mobile terminal screen is recombined into the touch event triggered by the user on the vehicle-mounted host screen, the attribute information of the second touch event comprises attribute information of each recombined touch point in at least one recombined touch point, each recombined touch point corresponds to an initial touch point, the attribute information of each recombined touch point comprises touch time, and the touch time of each recombined touch point is obtained by correcting deviation between the touch time of the corresponding initial touch point and the system time of the mobile terminal and the system time of the vehicle-mounted host;
The first updating module is used for updating the screen display content of the vehicle-mounted host based on the attribute information of the second touch event, wherein the display screen of the vehicle-mounted host displays the second touch event when the current time is the touch time of the recombination touch point in the second touch event.
Optionally, the apparatus further comprises:
the acquisition module is used for acquiring the touch time of the touch event data packet received for the first time when the vehicle-mounted host receives the touch event data packet sent by the mobile terminal for the first time;
the second determining module is used for determining deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host based on the touch time in the touch event data packet received for the first time and the time for receiving the touch event data packet for the first time.
Optionally, the attribute information of the first touch event includes an event identifier of the first touch event;
the first determining module is specifically configured to:
judging whether an event identifier of a first touch event exists in a historical touch event data packet received before the current time;
if the event identification of the first touch event does not exist in the historical touch event data packet received before the current time, generating a second touch event corresponding to the first touch event;
Traversing each initial touch point in at least one initial touch point in the first touch event, and executing the following operations on each initial touch point to obtain attribute information of the second touch event:
correcting the touch time of each initial touch point based on the touch time of each initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, and determining the corrected touch time of each initial touch point and other attribute information of each initial touch point as attribute information of a recombined touch point.
Optionally, the first determining module is further specifically configured to:
if the event identification of the first touch event exists in the historical touch event data packet received before the current time, traversing each initial touch point in at least one initial touch point in the first touch event, and executing the following operations on each initial touch point: correcting the touch time of each initial touch point based on the touch time of each initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, and determining the corrected touch time of each initial touch point and other attribute information of each initial touch point as attribute information of a recombined touch point;
And adding the obtained attribute information of at least one recombined touch point into the attribute information of the second touch event generated before the current time to obtain updated attribute information of the second touch event.
Optionally, the attribute information of each initial touch point further includes position information and direction information; correspondingly, the attribute information of each recombined touch point also comprises position information and direction information;
the first updating module is specifically configured to:
if the number of at least one recombination touch point corresponding to the second touch event is one, determining the second touch event as a clicking operation, determining a clicking area on the vehicle-mounted host screen corresponding to the clicking operation based on the position information of the recombination touch point corresponding to the clicking operation, and updating the display content of the vehicle-mounted host screen based on the clicking area;
if the number of at least one recombination touch point corresponding to the second touch event is multiple, determining that the second touch event is a sliding operation, determining a sliding area on the vehicle-mounted host screen corresponding to the sliding operation based on the position information of each recombination touch point corresponding to the sliding operation and the direction information of each corresponding recombination touch point, and updating the display content of the vehicle-mounted host screen based on the sliding area.
Optionally, the touch event data packet further includes attribute information of a third touch event triggered by the user on the mobile terminal screen in the first period, where the third touch event and the first touch event are different touch events, and the attribute information of the third touch event includes attribute information of each initial touch point in at least one initial touch point, and the attribute information of each initial touch point includes touch time;
the apparatus further comprises:
the third determining module is configured to determine attribute information of a fourth touch event based on attribute information of a third touch event and a historical touch event data packet received before the current time, where the fourth touch event indicates that the third touch event triggered by the user on the screen of the mobile terminal is reorganized into a touch event triggered by the user on the screen of the vehicle-mounted host, the attribute information of the fourth touch event includes attribute information of each reorganization touch point in at least one reorganization touch point, and touch time of each reorganization touch point in the fourth touch event is obtained by correcting deviation between touch time of a corresponding initial touch point and system time of the mobile terminal and system time of the vehicle-mounted host;
The second updating module is used for updating the screen display content of the vehicle-mounted host based on the attribute information of the fourth touch event, wherein the display screen of the vehicle-mounted host displays the fourth touch event when the current time is the touch time of the recombination touch point in the fourth touch event.
In the embodiment of the application, the touch event data packet received by the vehicle-mounted host computer comprises attribute information of a first touch event and attribute information of a third touch event, then the attribute information of a historical touch event data packet with the same event identification as the first touch event and the attribute information of the first touch event are recombined to generate attribute information of a second touch event, and the touch time of each recombined touch point in the attribute information of the second touch event is obtained after correction according to the touch time of each initial touch point in the first touch event and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer. And recombining attribute information of the historical touch event data packet with the same event identification as the third touch event and attribute information of the third touch event to generate attribute information of a fourth touch event, wherein the touch time of each recombined touch point in the attribute information of the fourth touch event is obtained after correction according to the touch time of each initial touch point in the third touch event and deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer. And finally, the vehicle-mounted host updates the display content of the vehicle-mounted host screen based on the attribute information of the second touch event and the attribute information of the fourth touch event. Thus, when the user clicks or slides the screen with two fingers on the mobile terminal, the operation of clicking or sliding with two fingers can be correspondingly displayed on the screen of the vehicle-mounted host computer.
The embodiment of the application also provides another control device of the vehicle-mounted screen, which comprises the following components: the device comprises a receiving module, a first storage module, a first correction module and a first updating module.
The mobile terminal comprises a receiving module, a receiving module and a display module, wherein the receiving module is used for receiving a touch event data packet sent by the mobile terminal, the touch event data packet comprises attribute information of a first touch event triggered by a user on a screen of the mobile terminal in a first time period, the attribute information of the first touch event comprises attribute information of each initial touch point in at least one initial touch point, the attribute information of each initial touch point comprises touch time, the first time period is a time period from the last time the mobile terminal sends the touch event data packet before the current time to the current time the mobile terminal sends the touch event data packet, and the screen display content of the mobile terminal is consistent with the screen display content of a vehicle-mounted host;
the first storage module is used for transmitting the attribute information of the first touch event to the local layer by the application layer, the local layer stores the attribute information of the first touch event into a container of the local layer, and the local layer is configured with a time correction algorithm module;
the first correction module is used for correcting the touch time of each initial touch point in at least one initial touch point based on the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer by the local layer calling time correction algorithm module to obtain attribute information updated by the first touch event;
The first updating module is used for sending the attribute information updated by the first touch event to the application layer by the local layer, and updating the screen display content of the vehicle-mounted host based on the attribute information updated by the first touch event by the application layer.
Optionally, the apparatus further comprises:
the acquisition module is used for acquiring the touch time of the touch event data packet received for the first time when the application layer receives the touch event data packet sent by the mobile terminal for the first time;
the determining module is used for determining the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host based on the touch time in the touch event data packet received for the first time and the time for receiving the touch event data packet for the first time by the application layer;
and the sending module is used for sending the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer to the local layer by the application layer.
Optionally, the attribute information of each initial touch point further includes position information and direction information;
the first updating module is specifically configured to:
if the number of at least one initial touch point corresponding to the first touch event in the updated attribute information is one, determining the first touch event as a clicking operation, determining a clicking area on a vehicle-mounted host screen corresponding to the clicking operation based on the position information of the initial touch point corresponding to the clicking operation, and updating the display content of the vehicle-mounted host screen based on the clicking area;
If the number of at least one initial touch point corresponding to the first touch event in the updated attribute information is multiple, determining that the first touch event is a sliding operation, determining a sliding area on the vehicle-mounted host screen corresponding to the sliding operation based on the position information of each initial touch point corresponding to the sliding operation and the direction information of each corresponding initial touch point, and updating the display content of the vehicle-mounted host screen based on the sliding area.
Optionally, the touch event data packet further includes attribute information of a third touch event triggered by the user on the mobile terminal screen in the first period of time, where the third touch event and the first touch event are different touch events;
the apparatus further comprises:
the second storage module is used for transmitting the attribute information of the third touch event to the local layer by the application layer, the local layer stores the attribute information of the third touch event into a container of the local layer, and the local layer is configured with a time correction algorithm module;
the second correction module is used for correcting the touch time of each initial touch point in at least one initial touch point included in the third touch event based on the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer by the local layer calling time correction algorithm module to obtain updated attribute information of the third touch event;
The second updating module is used for sending the attribute information updated by the third touch event to the application layer by the local layer, and updating the screen display content of the vehicle-mounted host based on the attribute information updated by the third touch event by the application layer.
The embodiment of the application supports the autonomous controllable right of the vehicle-mounted host, and can autonomously modify the operating system of the vehicle-mounted host according to the requirement. Under the condition, a time correction algorithm module is configured in the local layer of the vehicle-mounted host, the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host is determined in the application layer, and after the deviation is transmitted to the local layer, the local layer directly calls the time correction algorithm module to correct the touch time of each touch point in all touch events at one time, and the updated attribute information of the touch events is obtained. The local layer sends the attribute information updated by the touch event to the application layer, and the application layer updates the screen display content of the vehicle-mounted host based on the attribute information updated by the touch event. Compared with the method that the vehicle-mounted host corrects the touch time of each touch point in the touch events one by one, the control method of the vehicle-mounted screen provided by the embodiment of the application can greatly accelerate the processing speed of the touch events and can reduce the time consumption.
It should be noted that: the control device for the vehicle-mounted screen provided in the above embodiment only illustrates the division of the above functional modules when controlling the screen of the vehicle-mounted host, and in practical application, the above functional allocation may be performed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the functions described above. In addition, the control device of the vehicle-mounted screen provided in the above embodiment and the control method embodiment of the vehicle-mounted screen belong to the same concept, and the specific implementation process is detailed in the method embodiment, which is not repeated here.
Fig. 11 is a block diagram illustrating a mobile terminal 1100 according to an embodiment of the present application. Generally, the mobile terminal 1100 includes: a processor 1101 and a memory 1102.
The processor 1101 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 1101 may be implemented in at least one hardware form of DSP (Digital Signal Processing ), FPGA (Field-Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array ). The processor 1101 may also include a main processor, which is a processor for processing data in an awake state, also called a CPU (Central Processing Unit ), and a coprocessor; a coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 1101 may integrate a GPU (Graphics Processing Unit, image processor) for rendering and drawing of content required to be displayed by the display screen. In some embodiments, the processor 1101 may also include an AI (Artificial Intelligence ) processor for processing computing operations related to machine learning.
Memory 1102 may include one or more computer-readable storage media, which may be non-transitory. Memory 1102 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 1102 is used to store at least one instruction for execution by processor 1101 to implement the method of controlling an on-board screen provided by the method embodiments of the present application.
In some embodiments, the mobile terminal 1100 may further optionally include: a peripheral interface 1103 and at least one peripheral. The processor 1101, memory 1102, and peripheral interface 1103 may be connected by a bus or signal lines. The individual peripheral devices may be connected to the peripheral device interface 1103 by buses, signal lines or circuit boards. Specifically, the peripheral device includes: at least one of radio frequency circuitry 1104, touch display 1105, camera 1106, audio circuitry 1107, positioning component 1108, and power supply 1109.
Those skilled in the art will appreciate that the architecture shown in fig. 11 is not limiting and that mobile terminal 1100 may include more or fewer components than shown, or may combine certain components, or may employ a different arrangement of components.
In some embodiments, there is also provided a computer-readable storage medium having stored therein a computer program which, when executed by a processor, implements the steps of the control method of the in-vehicle screen in the above embodiments. For example, the computer readable storage medium may be ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
It is noted that the computer readable storage medium mentioned in the embodiments of the present application may be a non-volatile storage medium, in other words, may be a non-transitory storage medium.
It should be understood that all or part of the steps to implement the above-described embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The computer instructions may be stored in the computer-readable storage medium described above.
That is, in some embodiments, there is also provided a computer program product containing instructions that, when run on a computer, cause the computer to perform the steps of the above-described method of controlling an on-vehicle screen.
It should be understood that references herein to "at least one" mean one or more, and "a plurality" means two or more. In the description of the embodiments of the present application, unless otherwise indicated, "/" means or, for example, a/B may represent a or B; "and/or" herein is merely an association relationship describing an association object, and means that three relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. In addition, in order to facilitate the clear description of the technical solution of the embodiments of the present application, in the embodiments of the present application, the words "first", "second", etc. are used to distinguish the same item or similar items having substantially the same function and effect. It will be appreciated by those of skill in the art that the words "first," "second," and the like do not limit the amount and order of execution, and that the words "first," "second," and the like do not necessarily differ.
The above embodiments are not intended to limit the present application, and any modifications, equivalent substitutions, improvements, etc. within the spirit and principle of the present application should be included in the scope of the present application.

Claims (10)

1. A control method of an in-vehicle screen, the method comprising:
the method comprises the steps that a vehicle-mounted host receives a touch event data packet sent by a mobile terminal, wherein the touch event data packet comprises attribute information of a first touch event triggered by a user on a screen of the mobile terminal in a first time period, the attribute information of the first touch event comprises attribute information of each initial touch point in at least one initial touch point, the attribute information of each initial touch point comprises touch time, and the first time period is a time period from the last time the mobile terminal sends the touch event data packet to the current time the mobile terminal sends the touch event data packet, and screen display content of the mobile terminal is consistent with that of the vehicle-mounted host;
the vehicle-mounted host computer determines attribute information of a second touch event based on the attribute information of the first touch event and a historical touch event data packet received before the current time, the second touch event indicates that the first touch event triggered by a user on the mobile terminal screen is recombined into a touch event triggered by the user on the vehicle-mounted host computer screen, the attribute information of the second touch event comprises attribute information of each recombined touch point in at least one recombined touch point, each recombined touch point corresponds to an initial touch point, the attribute information of each recombined touch point comprises touch time, and the touch time of each recombined touch point is obtained by correcting deviation between the touch time of the corresponding initial touch point, the system time of the mobile terminal and the system time of the vehicle-mounted host computer;
And updating the screen display content of the vehicle-mounted host based on the attribute information of the second touch event, wherein the display screen of the vehicle-mounted host displays the second touch event when the current time is the touch time of the recombination touch point in the second touch event.
2. The method of claim 1, wherein the method further comprises:
when the vehicle-mounted host receives the touch event data packet sent by the mobile terminal for the first time, acquiring touch time in the touch event data packet received for the first time;
and determining the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host based on the touch time in the touch event data packet received for the first time and the time for receiving the touch event data packet for the first time.
3. The method of claim 1, wherein the attribute information of the first touch event comprises an event identification of the first touch event;
the vehicle-mounted host determines attribute information of a second touch event based on the attribute information of the first touch event and a historical touch event data packet received before the current time, and the method comprises the following steps:
Judging whether an event identifier of the first touch event exists in a historical touch event data packet received before the current time;
if the event identification of the first touch event does not exist in the historical touch event data packet received before the current time, generating a second touch event corresponding to the first touch event;
traversing each initial touch point in at least one initial touch point in the first touch event, and executing the following operations on each initial touch point to obtain attribute information of the second touch event:
correcting the touch time of each initial touch point based on the touch time of each initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, and determining the corrected touch time of each initial touch point and other attribute information of each initial touch point as attribute information of a recombined touch point.
4. A method as claimed in claim 3, wherein the method further comprises:
if the event identifier of the first touch event exists in the historical touch event data packet received before the current time, traversing each initial touch point in at least one initial touch point in the first touch event, and executing the following operations on each initial touch point: correcting the touch time of each initial touch point based on the touch time of each initial touch point and the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host, and determining the corrected touch time of each initial touch point and other attribute information of each initial touch point as attribute information of a recombined touch point;
And adding the obtained attribute information of at least one recombined touch point into the attribute information of the second touch event generated before the current time to obtain updated attribute information of the second touch event.
5. The method of claim 1, wherein the attribute information of each initial touch point further includes position information and direction information; correspondingly, the attribute information of each recombined touch point also comprises position information and direction information;
the on-vehicle host computer updates the screen display content of the on-vehicle host computer based on the attribute information of the second touch event, and the method comprises the following steps:
if the number of at least one recombination touch point corresponding to the second touch event is one, determining that the second touch event is a click operation, determining a click region on the vehicle-mounted host screen corresponding to the click operation based on the position information of the recombination touch point corresponding to the click operation, and updating the display content of the vehicle-mounted host screen based on the click region;
and if the number of at least one recombination touch point corresponding to the second touch event is a plurality of, determining that the second touch event is a sliding operation, determining a sliding area on the vehicle-mounted host screen corresponding to the sliding operation based on the position information of each recombination touch point corresponding to the sliding operation and the direction information of each corresponding recombination touch point, and updating the display content of the vehicle-mounted host screen based on the sliding area.
6. The method of claim 1, wherein the touch event data packet further includes attribute information of a third touch event triggered by the user on the mobile terminal screen within a first period of time, the third touch event and the first touch event being different touch events, the attribute information of the third touch event including attribute information of each of at least one initial touch point, the attribute information of each initial touch point including touch time;
the method further comprises the steps of:
the vehicle-mounted host computer determines attribute information of a fourth touch event based on the attribute information of the third touch event and a historical touch event data packet received before the current time, the fourth touch event indicates that the third touch event triggered by a user on the screen of the mobile terminal is recombined into a touch event triggered by the user on the screen of the vehicle-mounted host computer, the attribute information of the fourth touch event comprises attribute information of each recombined touch point in at least one recombined touch point, and the touch time of each recombined touch point in the fourth touch event is obtained by correcting deviation between the touch time of a corresponding initial touch point and the system time of the mobile terminal and the system time of the vehicle-mounted host computer;
And updating the screen display content of the vehicle-mounted host based on the attribute information of the fourth touch event, wherein the display screen of the vehicle-mounted host displays the fourth touch event when the current time is the touch time of the recombination touch point in the fourth touch event.
7. The control method of the vehicle-mounted screen is characterized in that the method is realized by an operating system of a vehicle-mounted host, the operating system of the vehicle-mounted host comprises a local layer and an application layer, and the method comprises the following steps:
the application layer receives a touch event data packet sent by a mobile terminal, wherein the touch event data packet comprises attribute information of a first touch event triggered by a user on a screen of the mobile terminal in a first time period, the attribute information of the first touch event comprises attribute information of each initial touch point in at least one initial touch point, the attribute information of each initial touch point comprises touch time, and the first time period is a time period from the last time the mobile terminal sends the touch event data packet to the current time the mobile terminal sends the touch event data packet, and screen display content of the mobile terminal is consistent with that of the vehicle-mounted host;
The application layer sends the attribute information of the first touch event to the local layer, the local layer stores the attribute information of the first touch event into a container of the local layer, and the local layer is configured with a time correction algorithm module;
the local layer calls the time correction algorithm module to correct the touch time of each initial touch point in the at least one initial touch point based on the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer, and the updated attribute information of the first touch event is obtained;
and the local layer sends the updated attribute information of the first touch event to the application layer, and the application layer updates the screen display content of the vehicle-mounted host based on the updated attribute information of the first touch event.
8. The method of claim 7, wherein the method further comprises:
when the application layer receives a touch event data packet sent by the mobile terminal for the first time, acquiring touch time in the touch event data packet received for the first time;
the application layer determines the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host based on the touch time in the touch event data packet received for the first time and the time for receiving the touch event data packet for the first time;
And the application layer sends the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host to the local layer.
9. The method of claim 7, wherein the attribute information of each initial touch point further includes position information and direction information;
the application layer updates the screen display content of the vehicle-mounted host based on the attribute information updated by the first touch event, and the method comprises the following steps:
if the number of at least one initial touch point corresponding to the first touch event in the updated attribute information is one, determining that the first touch event is a click operation, determining a click region on the vehicle-mounted host screen corresponding to the click operation based on the position information of the initial touch point corresponding to the click operation, and updating the display content of the vehicle-mounted host screen based on the click region;
and if the number of at least one initial touch point corresponding to the first touch event in the updated attribute information is a plurality of, determining that the first touch event is a sliding operation, determining a sliding area on the vehicle-mounted host screen corresponding to the sliding operation based on the position information of each initial touch point corresponding to the sliding operation and the direction information of each corresponding initial touch point, and updating the display content of the vehicle-mounted host screen based on the sliding area.
10. The method of claim 7, wherein the touch event data packet further includes attribute information of a third touch event triggered by a user on the mobile terminal screen within a first period of time, the third touch event and the first touch event being different touch events;
the method further comprises the steps of:
the application layer sends the attribute information of the third touch event to the local layer, the local layer stores the attribute information of the third touch event into a container of the local layer, and the local layer is configured with a time correction algorithm module;
the local layer calls the time correction algorithm module to correct the touch time of each initial touch point in at least one initial touch point included in the third touch event based on the deviation between the system time of the mobile terminal and the system time of the vehicle-mounted host computer, so as to obtain updated attribute information of the third touch event;
and the local layer sends the attribute information updated by the third touch event to the application layer, and the application layer updates the screen display content of the vehicle-mounted host based on the attribute information updated by the third touch event.
CN202111413839.4A 2021-11-25 2021-11-25 Control method of vehicle-mounted screen Active CN114115673B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111413839.4A CN114115673B (en) 2021-11-25 2021-11-25 Control method of vehicle-mounted screen

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111413839.4A CN114115673B (en) 2021-11-25 2021-11-25 Control method of vehicle-mounted screen

Publications (2)

Publication Number Publication Date
CN114115673A CN114115673A (en) 2022-03-01
CN114115673B true CN114115673B (en) 2023-10-27

Family

ID=80373116

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111413839.4A Active CN114115673B (en) 2021-11-25 2021-11-25 Control method of vehicle-mounted screen

Country Status (1)

Country Link
CN (1) CN114115673B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115033163A (en) * 2022-06-06 2022-09-09 广州小鹏汽车科技有限公司 Control method of in-vehicle system, vehicle, and storage medium

Citations (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104301507A (en) * 2013-07-15 2015-01-21 Lg电子株式会社 Mobile terminal and control method thereof
CN105045584A (en) * 2015-07-07 2015-11-11 东风汽车有限公司 Touch control method and system for screen of vehicle machine
CN105260112A (en) * 2015-09-14 2016-01-20 百度在线网络技术(北京)有限公司 Method and device for controlling screen between terminals
CN108206836A (en) * 2016-12-16 2018-06-26 乐视汽车(北京)有限公司 The dynamic menu of synchronous terminal screen to vehicle device method, terminal and system
CN109495263A (en) * 2018-11-16 2019-03-19 上海银基信息安全技术股份有限公司 Clock synchronizing method, system, device, intelligent terminal, vehicle termination and medium
CN110588346A (en) * 2019-08-22 2019-12-20 上海赫千电子科技有限公司 Multi-screen interaction system applied to automobile
CN111176698A (en) * 2014-05-30 2020-05-19 苹果公司 Dynamically adjusting mobile devices based on peer event data
CN111275797A (en) * 2020-02-26 2020-06-12 腾讯科技(深圳)有限公司 Animation display method, device, equipment and storage medium
AU2017445389A1 (en) * 2017-12-28 2020-06-25 Huawei Technologies Co., Ltd. Touch method and terminal
CN111770368A (en) * 2020-05-15 2020-10-13 广州视源电子科技股份有限公司 Control method and device for large-screen display equipment, storage medium and electronic equipment
CN112414400A (en) * 2019-08-21 2021-02-26 浙江商汤科技开发有限公司 Information processing method and device, electronic equipment and storage medium
CN112540696A (en) * 2019-09-23 2021-03-23 中兴通讯股份有限公司 Screen touch control management method, intelligent terminal, device and readable storage medium
WO2021092768A1 (en) * 2019-11-12 2021-05-20 深圳市欢太科技有限公司 Touch event processing method and apparatus, mobile terminal and storage medium
CN112887939A (en) * 2019-11-29 2021-06-01 北京百度网讯科技有限公司 Vehicle information determination method and device, electronic equipment and storage medium
CN112911543A (en) * 2021-01-04 2021-06-04 深圳市领航威科技有限公司 Vehicle-mounted terminal, time synchronization method thereof and storage medium
CN113014349A (en) * 2021-03-01 2021-06-22 北京嘀嘀无限科技发展有限公司 Time calibration method, device, electronic equipment, storage medium and program product
CN113391749A (en) * 2020-03-11 2021-09-14 上海达龙信息科技有限公司 Mouse click simulation method and device, computer readable storage medium and electronic equipment
CN113419452A (en) * 2021-06-29 2021-09-21 海信集团控股股份有限公司 Vehicle, control method thereof and mobile terminal
CN113467644A (en) * 2021-07-21 2021-10-01 无锡变格新材料科技有限公司 Calibration method and device of touch equipment, terminal equipment and storage medium
CN113489632A (en) * 2021-06-11 2021-10-08 深圳市海邻科信息技术有限公司 Touch control method, system and computer readable storage medium
CN113590000A (en) * 2020-04-30 2021-11-02 京东方科技集团股份有限公司 Handwriting processing method, handwriting processing device and storage medium

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150098653A1 (en) * 2013-10-07 2015-04-09 Kabushiki Kaisha Toshiba Method, electronic device and storage medium
JP2018028804A (en) * 2016-08-18 2018-02-22 株式会社デンソーテン Input control device, input control method, input control program, and input control system
JP2020160712A (en) * 2019-03-26 2020-10-01 株式会社デンソー Touch position detection system

Patent Citations (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104301507A (en) * 2013-07-15 2015-01-21 Lg电子株式会社 Mobile terminal and control method thereof
CN111176698A (en) * 2014-05-30 2020-05-19 苹果公司 Dynamically adjusting mobile devices based on peer event data
CN105045584A (en) * 2015-07-07 2015-11-11 东风汽车有限公司 Touch control method and system for screen of vehicle machine
CN105260112A (en) * 2015-09-14 2016-01-20 百度在线网络技术(北京)有限公司 Method and device for controlling screen between terminals
CN108206836A (en) * 2016-12-16 2018-06-26 乐视汽车(北京)有限公司 The dynamic menu of synchronous terminal screen to vehicle device method, terminal and system
AU2017445389A1 (en) * 2017-12-28 2020-06-25 Huawei Technologies Co., Ltd. Touch method and terminal
CN109495263A (en) * 2018-11-16 2019-03-19 上海银基信息安全技术股份有限公司 Clock synchronizing method, system, device, intelligent terminal, vehicle termination and medium
CN112414400A (en) * 2019-08-21 2021-02-26 浙江商汤科技开发有限公司 Information processing method and device, electronic equipment and storage medium
CN110588346A (en) * 2019-08-22 2019-12-20 上海赫千电子科技有限公司 Multi-screen interaction system applied to automobile
CN112540696A (en) * 2019-09-23 2021-03-23 中兴通讯股份有限公司 Screen touch control management method, intelligent terminal, device and readable storage medium
WO2021092768A1 (en) * 2019-11-12 2021-05-20 深圳市欢太科技有限公司 Touch event processing method and apparatus, mobile terminal and storage medium
CN112887939A (en) * 2019-11-29 2021-06-01 北京百度网讯科技有限公司 Vehicle information determination method and device, electronic equipment and storage medium
CN111275797A (en) * 2020-02-26 2020-06-12 腾讯科技(深圳)有限公司 Animation display method, device, equipment and storage medium
CN113391749A (en) * 2020-03-11 2021-09-14 上海达龙信息科技有限公司 Mouse click simulation method and device, computer readable storage medium and electronic equipment
CN113590000A (en) * 2020-04-30 2021-11-02 京东方科技集团股份有限公司 Handwriting processing method, handwriting processing device and storage medium
CN111770368A (en) * 2020-05-15 2020-10-13 广州视源电子科技股份有限公司 Control method and device for large-screen display equipment, storage medium and electronic equipment
CN112911543A (en) * 2021-01-04 2021-06-04 深圳市领航威科技有限公司 Vehicle-mounted terminal, time synchronization method thereof and storage medium
CN113014349A (en) * 2021-03-01 2021-06-22 北京嘀嘀无限科技发展有限公司 Time calibration method, device, electronic equipment, storage medium and program product
CN113489632A (en) * 2021-06-11 2021-10-08 深圳市海邻科信息技术有限公司 Touch control method, system and computer readable storage medium
CN113419452A (en) * 2021-06-29 2021-09-21 海信集团控股股份有限公司 Vehicle, control method thereof and mobile terminal
CN113467644A (en) * 2021-07-21 2021-10-01 无锡变格新材料科技有限公司 Calibration method and device of touch equipment, terminal equipment and storage medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
轻松行万里 世界任遨游 车载GPS、GPS手机的乐趣体验;吕皓;;科学生活(第10期);92-96 *

Also Published As

Publication number Publication date
CN114115673A (en) 2022-03-01

Similar Documents

Publication Publication Date Title
CN107273083B (en) Interaction method, device, equipment and storage medium between terminal equipment
EP3567479A1 (en) Method for establishing application prediction model, storage medium, and terminal
CN104335148A (en) Display device
CN108681427B (en) Access right control method and terminal equipment
CN110244884B (en) Desktop icon management method and terminal equipment
CN111459586A (en) Remote assistance method, device, storage medium and terminal
CN111026464A (en) Identification method and electronic equipment
CN110070496A (en) Generation method, device and the hardware device of image special effect
CN102855648A (en) Method and device for processing image
CN112295219A (en) Game control method, mobile terminal, car machine and storage medium
CN113824842B (en) Notification message display method, electronic equipment and computer-readable storage medium
CN110404252A (en) Information displaying method and device, electronic equipment, storage medium
CN113268212A (en) Screen projection method and device, storage medium and electronic equipment
CN112835485A (en) Application interface processing method and device, electronic equipment and readable storage medium
CN115357173A (en) Screen control method and device and electronic equipment
CN109147022A (en) VR data rendering method and system, computer equipment, computer storage medium
WO2024061088A1 (en) Display method and apparatus, electronic device, and storage medium
CN106843794A (en) A kind of multi-screen display method and system based on Android
CN114115673B (en) Control method of vehicle-mounted screen
CN113127128B (en) Interface control method, device, computer equipment and storage medium
CN113038273B (en) Video frame processing method and device, storage medium and electronic equipment
CN114327087A (en) Input event processing method and device, electronic equipment and storage medium
CN117555459A (en) Application group processing method and device, storage medium and electronic equipment
CN115904514B (en) Method for realizing cloud rendering pixel flow based on three-dimensional scene and terminal equipment
CN115501588A (en) Image rendering method and device, storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20240429

Address after: 266555, No. 218, Bay Road, Qingdao economic and Technological Development Zone, Shandong

Patentee after: Hisense Video Technology Co.,Ltd.

Country or region after: China

Address before: 266555, No. 218, Bay Road, Qingdao economic and Technological Development Zone, Shandong

Patentee before: Hisense Group Holding Co.,Ltd.

Country or region before: China