WO2023241506A1 - 一种汽车座舱屏幕的操作方法及相关设备 - Google Patents
一种汽车座舱屏幕的操作方法及相关设备 Download PDFInfo
- Publication number
- WO2023241506A1 WO2023241506A1 PCT/CN2023/099658 CN2023099658W WO2023241506A1 WO 2023241506 A1 WO2023241506 A1 WO 2023241506A1 CN 2023099658 W CN2023099658 W CN 2023099658W WO 2023241506 A1 WO2023241506 A1 WO 2023241506A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- screen
- cursor
- user
- screens
- sliding
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 76
- 230000004044 response Effects 0.000 claims description 48
- 238000012545 processing Methods 0.000 claims description 38
- 230000015654 memory Effects 0.000 claims description 33
- 238000004590 computer program Methods 0.000 claims description 16
- 230000005236 sound signal Effects 0.000 claims 4
- 238000010586 diagram Methods 0.000 description 25
- 230000006870 function Effects 0.000 description 19
- 230000008569 process Effects 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 8
- 238000010079 rubber tapping Methods 0.000 description 7
- 230000001360 synchronised effect Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 238000000926 separation method Methods 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000011017 operating method Methods 0.000 description 3
- 238000007667 floating Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000003205 fragrance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04812—Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
Definitions
- the present application relates to the field of smart car technology, and in particular to an operating method of a car cockpit screen and related equipment.
- Embodiments of the present application provide a method of operating a car cockpit screen and related equipment, which is beneficial to improving the convenience of screen operation in the car cockpit.
- embodiments of the present application provide a method for operating a car cockpit screen, which is applied to vehicle equipment.
- the method includes:
- the first screen may be any one of multiple screens. In some scenarios, it may be the central control screen by default.
- the second screen may be any other screen among the plurality of screens except the first screen.
- the operation on the first screen may be an operation performed directly by the user on the first screen, or it may be an operation performed by the vehicle device on the first screen in response to the user's operation on other mobile terminals, such as: controlling the first screen.
- the cursor on the screen slides, etc.
- the on-board device can parse and identify the operation on the first screen and obtain the attribute information of the operation.
- the attribute information can be the starting position of the cursor, sliding direction, etc.
- the on-board device can select from multiple The second screen that the user wants to operate is determined on the screen, and then the mirror interface of the second screen is displayed on the first screen. Based on this, the vehicle equipment can perform operations related to the second screen through the mirror interface. , for example: when the cursor is in the mirror interface, the vehicle-mounted device can implement the corresponding function on the second screen based on user operations. In this way, when you need to operate different screens in the cockpit, you only need to switch the mirror images of different screens without the user changing positions, which can improve the convenience of screen operations in the car cockpit. In addition, there is no need to add physical hardware to operate different screens in the cockpit, which can reduce hardware costs.
- the operation on the first screen includes a gesture sliding operation
- the attribute information includes the starting position, the end position and the sliding direction of the gesture sliding
- the second screen is determined from multiple screens based on the attribute information, include:
- the second screen is determined from the plurality of screens based on at least two of the starting position, the end position and the sliding direction.
- the car-machine device can determine the second screen that the user needs to operate based on at least two of the starting position, end position and sliding direction of the gesture sliding operation.
- the starting position is the middle of the screen
- the end position is If the position is the right edge of the screen and the sliding direction is sliding from the middle of the screen to the right edge of the screen, it can be determined that the co-pilot screen is the screen that the user needs to operate, and the vehicle equipment will determine the co-pilot screen as the second screen, which will facilitate subsequent operations.
- the mirrored interface of the co-pilot screen is displayed on the first screen, thereby facilitating the execution of operations related to the co-pilot screen.
- the operation on the first screen includes sliding the cursor on the first screen.
- the attribute information includes the end position of the cursor, the sliding direction and whether the cursor is deformed. According to the attribute information, it is determined from multiple screens. Out the second screen, including:
- the second screen is determined from the plurality of screens based on at least two of the end position, the sliding direction and whether the cursor is deformed.
- the sliding of the cursor on the first screen can be caused by the user directly controlling the cursor to slide on the first screen, or it can be caused by the vehicle-mounted device responding to the user's sliding operation on the screen of other mobile terminals, driving the second screen. Slide the cursor on the screen.
- the attribute information of the cursor sliding can also include whether the cursor is deformed. For example, the circular cursor is slid to the right edge of the first screen, and the vehicle-mounted device still receives the control of the cursor to the third screen.
- the car-machine device deforms the cursor (for example, adjusts the cursor from a circle to an ellipse).
- the vehicle-machine device can determine the second screen that the user needs to operate based on at least two of the end position of the cursor, the sliding direction, and whether deformation occurs.
- the vehicle device Determining the co-pilot screen as the second screen facilitates subsequent display of the mirror interface of the co-pilot screen on the first screen, thereby facilitating the execution of operations related to the co-pilot screen.
- the method further includes:
- the vehicle-machine device can also determine the execution object of the user's operation based on the position of the cursor. For example, if the cursor is located in an area outside the mirrored interface on the first screen, it is determined that the user is operating on the first screen, and the cursor is located on the first screen. In the mirror interface or the cursor is located in the second screen, it is determined that the user is operating on the second screen. After determining the execution object of the user's operation, the vehicle-mounted device can implement the corresponding function on the execution object.
- obtaining the sliding direction includes:
- a line segment can be determined based on the starting position and end position in its attribute information. This line segment can be used to calculate the component sum of the sliding distance in the horizontal direction. The vertical component of the sliding distance. If the component of the sliding distance in the horizontal direction is greater than the component of the sliding distance in the vertical direction, the sliding direction can be determined to be horizontal sliding. According to the sliding in the horizontal direction and the end position being the right edge of the first screen, the final sliding can be determined. The direction is sliding to the right; if the component of the sliding distance in the vertical direction is greater than the sliding distance in the horizontal direction The component of the moving distance can be determined to be the sliding direction in the vertical direction.
- the final sliding direction can be determined to be the lower right edge of the first screen. Swipe toward the center of the screen.
- the sliding direction is determined using at least one of the starting position and the end position, the component of the sliding distance in the horizontal direction and the component of the sliding distance in the vertical direction, so as to quickly determine the second screen.
- the method before obtaining the attribute information of the operation on the first screen among the multiple screens in the cockpit, the method further includes:
- the operation signal is generated based on the user's operation on the simulated touch panel of the mobile terminal.
- the simulated touch panel includes part or all of the screen of the mobile terminal;
- the cursor is controlled to slide on the first screen based on the operation signal.
- operations related to the first screen are performed, including:
- the first audio controller of the first speaker connected to the first screen is displayed, so that the user performs audio attributes on the first speaker through the first audio controller. adjust.
- performing operations related to the second screen includes:
- the first preset gesture may be a shortcut gesture for taking a screenshot
- the second preset gesture may be a shortcut gesture for brightness adjustment
- the third preset gesture may be a gesture for calling up the audio adjustment control.
- the car-machine device can determine the execution object of these preset gestures (such as the first screen or the second screen) based on the position of the cursor, and then implement these on the execution object.
- Preset functions or commands corresponding to gestures For example: the user performs the shortcut gesture of knuckle tapping on the simulated touch pad, and the car-machine device responds to the knuckle tapping.
- the second screen is considered to be the execution object, and the car-machine device is in On the second screen, execute commands corresponding to the shortcut gesture of tapping your knuckles, such as taking a screenshot. That is, according to different operations performed by the user on the analog touch panel, the vehicle-mounted device can implement the function corresponding to the operation on different screens according to the position of the cursor.
- the method further includes:
- the vehicle-mounted device when it is detected that the cursor slides into the mirror interface, can directly lock the cursor in the mirror interface, or it can lock the cursor in the mirror interface after receiving a certain operation from the user. Being locked in the mirror interface helps prevent misoperations from moving it out of the mirror interface, and facilitates related operations on the mirror interface through the cursor.
- the second screen is determined from multiple screens based on at least two of the end position, the sliding direction, and whether the cursor is deformed, including:
- the second screen is determined from the plurality of screens based on at least two of the end position, the sliding direction, and whether the cursor is deformed, as well as the spatial position relationship.
- the vehicle-mounted equipment stores the position of each screen in multiple screens, and constructs a spatial position map of multiple screens based on the position of each screen. That is to say, the spatial position map can represent the spatial position map between multiple screens. Spatial location relationship. Based on at least two of the end position, the sliding direction and whether the cursor is deformed, and combined with the spatial position relationship between multiple screens, the vehicle-mounted device can determine the second screen that the user needs to operate from the multiple screens.
- the vehicle-machine device may move the cursor from the first screen to the second screen based on the residence time of the cursor and/or the duration of the deformation of the cursor, for example: combined with The spatial position relationship of multiple screens, continue to move the cursor in the central control screen to the right, and the cursor stays on the right edge of the central control screen for more than the preset stay time, you can move the cursor from the central control screen to the co-pilot screen, so that the user can drive the cursor to perform the same operation on the second screen by operating on the simulated touch pad.
- inventions of the present application provide an operating device for a car cockpit screen.
- the device is applied to vehicle equipment and includes an acquisition unit and a processing unit, wherein,
- the acquisition unit is used to acquire the attribute information of the operation on the first screen among the multiple screens in the cockpit;
- the second aspect is a device corresponding to the above-mentioned first aspect, which is used to implement each embodiment of the method provided in the first aspect, and can achieve the same or similar beneficial effects.
- the operation on the first screen includes a gesture sliding operation
- the attribute information includes the starting position, the end position and the sliding direction of the gesture sliding
- the second screen is determined from the multiple screens according to the attribute information.
- the processing unit is specifically used for:
- the second screen is determined from the plurality of screens based on at least two of the starting position, the end position and the sliding direction.
- the operation on the first screen includes sliding the cursor on the first screen
- the attribute information includes the end position of the cursor, the sliding direction, and whether the cursor is deformed.
- the cursor is selected from multiple screens.
- the processing unit is specifically used to:
- the second screen is determined from the plurality of screens based on at least two of the end position, the sliding direction and whether the cursor is deformed.
- the processing unit is also used to:
- the operation signal is generated based on the user's operation on the simulated touch panel of the mobile terminal.
- the simulated touch panel includes part or all of the screen of the mobile terminal;
- the processing unit in performing operations related to the first screen, is specifically configured to:
- the first audio controller of the first speaker connected to the first screen is displayed, so that the user performs audio attributes on the first speaker through the first audio controller. adjust.
- the processing unit in performing operations related to the second screen, is specifically configured to:
- the processing unit is also used to:
- the cursor In response to the cursor sliding into the mirror interface, the cursor is locked in the mirror interface.
- the processing unit in determining the second screen from multiple screens based on at least two of the end position, the sliding direction, and whether the cursor is deformed, is specifically configured to:
- the second screen is determined from the plurality of screens based on at least two of the end position, the sliding direction, and whether the cursor is deformed, as well as the spatial position relationship.
- the attribute information also includes the residence time of the cursor at the end position and the duration of deformation when the cursor deforms.
- the processing unit is also used to:
- the cursor is moved from the first screen to the second screen.
- embodiments of the present application provide a vehicle-mounted device, including a processor, a memory, and one or more programs.
- the processor is connected to the memory, and the one or more programs are stored in the memory and configured to The method in the above first aspect is implemented when executed by a processor.
- embodiments of the present application provide a computer-readable storage medium.
- the computer-readable storage medium stores a computer program for device execution. When the computer program is executed, the method in the first aspect is implemented.
- embodiments of the present application provide a computer program product.
- the computer program product When the computer program product is run by an electronic device, the electronic device executes the method in the first aspect.
- Figure 1 is a schematic diagram of a related technology proposed to interact with the central control screen by adding physical hardware
- Figure 3 is a schematic flowchart of a method of operating a car cockpit screen provided by an embodiment of the present application
- Figure 4 is a schematic diagram of the position definition of each edge of a screen provided by an embodiment of the present application.
- Figure 5A is a schematic diagram of determining a second screen based on the sliding direction and end position provided by an embodiment of the present application
- Figure 5B is a schematic diagram of determining the second screen according to the sliding direction and starting position according to the embodiment of the present application.
- Figure 6 is a schematic diagram of a spatial position map of each screen in a cockpit provided by an embodiment of the present application.
- Figure 7A is a schematic diagram of a mirror interface of a co-pilot screen provided by an embodiment of the present application.
- Figure 7C is a schematic diagram of performing shortcut gestures on the central control screen through a simulated touch pad according to an embodiment of the present application
- Figure 8 is a schematic diagram of moving the cursor into the co-pilot screen provided by an embodiment of the present application.
- Figure 9A is a schematic diagram of a central control screen and an instrument panel screen after a mobile terminal is connected to a vehicle device according to an embodiment of the present application;
- Figure 9C is a schematic diagram of moving the cursor into the instrument panel screen according to an embodiment of the present application.
- Figure 9D is a schematic diagram of a simulated touch panel driving a cursor to operate an instrument panel screen according to an embodiment of the present application.
- Figure 11 is a schematic diagram of a simulated touch panel and cursor position provided by an embodiment of the present application.
- Figure 12A is a schematic diagram of the central control screen and the co-pilot screen after a mobile terminal has established a connection with the vehicle equipment provided by an embodiment of the present application;
- Figure 12B is a schematic diagram of another method of controlling cursor deformation provided by an embodiment of the present application.
- Figure 12C is a schematic diagram of mirroring the music playback interface of the co-pilot screen to the central control screen according to an embodiment of the present application
- Figure 12D is a schematic diagram of operating the co-pilot screen through a simulated touch panel according to an embodiment of the present application.
- Figure 13 is a schematic structural diagram of an operating device for a car cockpit screen provided by an embodiment of the present application.
- FIG. 14 is a schematic structural diagram of a vehicle equipment provided by an embodiment of the present application.
- an embodiment means that a particular feature, structure or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application.
- the appearances of this phrase in various places in the specification are not necessarily all referring to the same embodiment. Neither are independent or alternative embodiments mutually exclusive of other embodiments. Those skilled in the art understand, both explicitly and implicitly, that the embodiments described herein may be combined with other embodiments.
- a component may, for example, be based on a signal having one or more data packets (eg, data from two components interacting with another component, a local system, a distributed system, and/or a network, such as the Internet, which interacts with other systems via signals) Communicate through local and/or remote processes.
- data packets eg, data from two components interacting with another component, a local system, a distributed system, and/or a network, such as the Internet, which interacts with other systems via signals
- Figure 1 is a solution proposed by a related technology to implement interaction with the central control screen by adding physical hardware.
- the related technology sets four keys on the steering wheel and in the main driving position. Set up knobs/touchpads, etc. between the passenger seat and the passenger seat. It should be understood that the four keys are usually used to operate the central control screen, and there are multiple screens in a smart car/smart cockpit. It is difficult for the four keys to operate screens other than the central control screen.
- the location of the hardware is usually fixed. During actual operation, the user may need to get up and move near the hardware, resulting in inconvenient operation and increased hardware cost.
- the technical problems to be solved by the embodiments of this application are mainly as follows: realizing the operation of the vehicle screen through hardware fixed somewhere in the cockpit, on the one hand, will lead to an increase in cost investment, and there will be inconvenience in operation. Problem; on the other hand, when there are multiple screens, it is difficult to operate screens other than the central control screen.
- Figure 2 is a diagram of a car cockpit screen provided by the embodiment of the present application.
- a schematic diagram of the application scenario of the operation method is shown in Figure 2.
- This scenario may include a mobile terminal 201, a vehicle-mounted device 202 and a user 203.
- the mobile terminal 201 may be a portable device carried by the user 203, such as a mobile phone, a tablet computer, etc.
- the mobile terminal 201 has a touchpad mode.
- the touchpad mode the screen of the mobile terminal 201 can be used as a simulated touchpad for a certain screen (such as a central control screen) in the vehicle device 202 to control the touch through the simulated touchpad.
- the board operates the screen in the vehicle equipment 202.
- At least two screens are configured in the vehicle device 202.
- the vehicle device 202 and the mobile terminal 201 can establish a connection through Bluetooth, wireless network, etc.
- the screen in the vehicle device 202 For example: a cursor can be displayed on the central control screen, and the vehicle-mounted device 202 can respond to operations on the simulated touch panel of the mobile terminal 201 by controlling the cursor to operate the screen in the vehicle-mounted device 202 .
- the user 203 can be a car owner or a passenger in the car, and has the need to operate multiple screens.
- the user 203 can manually operate to establish a connection between the mobile terminal 201 and the vehicle-machine device 202.
- Figure 3 is a schematic flowchart of a method of operating a car cockpit screen provided by an embodiment of the present application. This method can be applied to the scenario shown in Figure 2, and can be specifically executed by the vehicle equipment, as shown in Figure 3 As shown, the method may include steps 301-303:
- the first screen may be any one of multiple screens. In some scenarios, it may be the central control screen by default.
- the second screen may be any other screen among the plurality of screens except the first screen.
- the operation on the first screen may be an operation performed directly by the user on the first screen, or it may be an operation performed by the vehicle device on the first screen in response to the user's operation on other mobile terminals, such as: controlling the first screen.
- the cursor on the screen slides, etc.
- the car-machine device parses and identifies the operation to obtain the attribute information of the operation.
- the operation can be a gesture sliding operation, and the attribute information can include the starting position of the gesture sliding.
- the operation can also be the sliding of the cursor on the first screen
- the attribute information can include the starting position of the cursor, the end position, the sliding direction, whether the cursor deforms, the time the cursor stays at the end position, and the time when the cursor deforms. duration, etc.
- the operations on the first screen include but are not limited to gesture sliding operations, cursor sliding, and may also include other screen operation methods.
- the second screen is determined from multiple screens according to the attribute information, including:
- the second screen is determined from the plurality of screens based on at least two of the starting position, the end position and the sliding direction. It should be understood that in addition to the first screen (such as the central control screen), the multiple screens also include the instrument panel screen, the co-pilot screen, the left rear seat screen, and the right rear seat screen. The mirroring conditions of each screen can be as shown in Table 1. Show:
- the definitions of the left edge of the screen, the right edge of the screen, the lower left edge of the screen, the lower right edge of the screen, and the upper left edge of the screen and the upper right edge of the screen in Table 1 can be seen in the rectangular shaded area in Figure 4.
- the vehicle-machine device can determine the second screen that the user needs to operate based on at least two of the starting position, end position and sliding direction of the gesture sliding operation. For example, if the starting position is the middle of the screen, the end position is the right edge of the screen, and the sliding direction is sliding to the right, then the second screen can be determined to be the co-pilot screen.
- Figure 5A gives an example of determining the second screen based on the sliding direction and the end position. If the sliding direction is left sliding and the end position is the left edge of the screen, then the second screen can be determined to be the dashboard screen; If the sliding direction is to the right and the end position is the right edge of the screen, the second screen can be determined to be the co-pilot screen; if the sliding direction is to the lower left and the end position is the lower left edge of the screen, the second screen can be determined is the left rear seat screen; if the sliding direction is sliding to the lower right and the end position is the lower right edge of the screen, it can be determined that the second screen is the right rear seat screen. Please refer to Figure 5B.
- Figure 5B shows an example of determining the second screen based on the sliding direction and starting position. If the sliding direction is from the left edge of the screen to the middle of the screen, and the starting position is the left edge of the screen, then it can be determined The second screen is the instrument panel screen; if the sliding direction is from the right edge of the screen to the middle of the screen, and the starting position is the right edge of the screen, it can be determined that the second screen is the co-pilot screen; if the sliding direction is from the bottom left of the screen If the edge slides toward the middle of the screen and the starting position is the lower left edge of the screen, then the second screen can be determined to be the left rear seat screen; if the sliding direction is from the lower right edge of the screen to the middle of the screen and the starting position is the lower right edge of the screen, Then it can be determined that the second screen is the right rear seat screen.
- FIG. 5A and FIG. 5B give an example of determining the second screen based on two of the starting position, the end position and the sliding direction.
- the vehicle-mounted device can also determine the second screen based on three of the starting position, the end position and the sliding direction. This confirms the second screen.
- the second screen is determined from multiple screens according to the attribute information, including:
- the vehicle-mounted device stores the position of each screen in multiple screens, and constructs a spatial position map of multiple screens based on the position of each screen. That is to say, the spatial position map can represent the spatial position relationship between multiple screens.
- the spatial location map of the central control screen, instrument panel screen, passenger screen, left rear seat screen, and right rear seat screen can be shown in Figure 6. Two adjacent screens are connected by a straight line. Among the five screens shown in Figure 6, since the instrument panel screen and the passenger screen are separated by the central control screen, they cannot determine each other as the second screen.
- this spatial position relationship can represent the separation distance of each screen in multiple screens in each direction.
- the separation distance of the central control screen in the horizontal right direction of the instrument panel screen is 1, and the passenger screen is 1 in the instrument panel screen.
- the horizontal distance to the right of the dashboard screen is 2, the vertical distance of the right rear seat screen below the passenger screen is 1, the central control screen is 1 to the upper right of the left rear seat screen, and so on.
- the vehicle-machine device may also determine the second screen based on at least two of the end position, the sliding direction, and whether the cursor is deformed, and the separation distance. For example: the distance between the passenger screen and the instrument panel screen is 2.
- the vehicle equipment can learn that the screen that needs to be mirrored is not the central control screen, but the co-pilot screen, and the mirror interface of the co-pilot screen can be displayed on the instrument panel screen.
- first screen and the second screen are not central control screens
- switching between multiple screens needs to be relayed through the central control screen. That is to say, you need to switch from the first screen to the central control screen, and then display the mirror interface of other screens on the central control screen based on the attribute information of the operation on the central control screen. For example, you can switch the first screen to the central control screen by sliding the cursor through operations on the simulated touchpad.
- Table 3 The specific switching rules are shown in Table 3:
- the screen where the cursor is currently located is the instrument panel screen.
- the vehicle equipment needs to first be based on the switching conditions from the instrument panel screen to the central control screen (swipe right, right edge of the screen, (the cursor deforms), move the cursor from the instrument panel screen to the central control screen, and then display the mirror interface of the left rear seat screen on the central control screen based on the attribute information of the cursor operation on the central control screen, that is, the screen where the cursor is located It has transitioned from the instrument panel screen to the central control screen, and based on the central control screen, other screens can be operated.
- the steps for obtaining the sliding direction may be:
- the starting position and end point in its attribute information can be The position determines a line segment, and the components of the sliding distance in the horizontal direction and the component of the sliding distance in the vertical direction can be calculated using this line segment. If the component of the sliding distance in the horizontal direction is greater than the component of the sliding distance in the vertical direction, the sliding direction can be determined to be horizontal sliding. According to the sliding in the horizontal direction and the end position being the right edge of the first screen, the final sliding can be determined.
- the method further includes:
- the cursor In response to the cursor sliding into the mirror interface, the cursor is locked in the mirror interface.
- the car-machine device can directly lock the cursor in the mirror interface, or it can lock the cursor after receiving a certain operation (such as a double-click) from the user.
- the cursor In the mirror interface, the cursor is locked in the mirror interface, which helps prevent misoperation from moving it out of the mirror interface, and facilitates related operations on the mirror interface through the cursor.
- the method further includes: detecting whether the cursor is deformed at the edge of the mirror interface or whether there is a preset gesture on the mirror interface, and if so, unlocking the cursor in the mirror interface. For example: when the cursor is in the mirror window, the user's finger slides on the simulated touch pad. When sliding to the edge of the mirror interface, it will be blocked by the edge of the mirror window. When the user slides the cursor to the edge of the mirror interface, it continues to move outward. Sliding causes the cursor to deform, and the cursor slides out of the mirror interface and enters the first screen; the preset gesture may be, for example, an arc gesture.
- Exemplary perform operations related to the first screen, including:
- performing operations related to the second screen includes:
- the co-pilot screen can also be determined as the second screen by considering the residence time of the cursor at the end position and/or the duration of the deformation, for example: the residence time of the cursor at the end position and /or the duration of the deformation exceeds the preset time (for example: 3 seconds).
- the cursor's residence time and/or deformation duration are used as preconditions for screen mirroring, which can reduce accidental touch operations to a certain extent.
- Figure 7B shows another example where the second screen is the co-pilot screen.
- some shortcut gestures can be used to control the shortcut functions on the co-pilot screen.
- tap your knuckles to take a screenshot slide two fingers to adjust the screen brightness, press and hold to bring up the volume adjustment control, etc.
- the first preset gesture can be a shortcut gesture for taking a screenshot (for example, tapping the knuckles to take a screenshot)
- the second preset gesture can be a shortcut gesture for adjusting the brightness (for example, sliding with two fingers)
- the third preset gesture can be It can be a gesture that brings up the audio adjustment controls (for example: long press).
- the vehicle device determines the execution object of the shortcut gesture based on the position of the cursor. For example, if the cursor is in the mirror interface, the shortcut gesture of tapping the knuckle will be executed. Determined to be an operation on the co-pilot's screen, the car-machine device executes the screenshot command on the co-pilot's screen and synchronizes the screenshot interface on the co-pilot's screen with the mirror interface. For example, as shown in Figure 7C, if the cursor is in an area outside the mirror interface in the central control screen, the shortcut gesture of tapping the knuckles is determined as an operation on the central control screen, and the vehicle equipment is on the central control screen. Execute the screenshot command.
- the vehicle device will execute the brightness increase command corresponding to the two-finger slide-up gesture on the passenger screen; if The user performs a two-finger slide-up gesture on the simulated touch pad. If the cursor is in an area outside the mirrored interface on the central control screen, the vehicle device executes the brightness increase command corresponding to the two-finger slide-up gesture on the central control screen. .
- the vehicle device will execute the audio controller corresponding to the long press gesture on the co-pilot screen (the audio controller of the co-pilot screen audio ) calls up the command to call up the audio controller (second audio controller) of the speaker (i.e.
- the method further includes:
- the vehicle-mounted device can move the cursor from the first screen to the second screen. For example, combining the spatial position relationships of multiple screens, continuously moving the cursor in the central control screen to the right, You can move the cursor from the central control screen to the secondary
- the driving screen allows the user to perform the same operation on the second screen by driving the cursor by operating on the simulated trackpad.
- whether the cursor moves into the second screen can also be used as a condition for displaying the mirror interface of the second screen on the first screen.
- the vehicle device can control (actively control or respond to the user's operation on the simulated touch panel) the cursor to move to the co-pilot screen.
- step 303 is executed to move the co-pilot screen.
- the screen mirroring interface is displayed on the central control screen. It should be noted that in this embodiment, the actual position of the cursor is within the co-pilot screen. What is shown in Figure 8 is the mirror interface of the co-pilot screen. In this scenario, the cursor in Figure 8 cannot be controlled to move out of the mirror interface.
- the car device responds to the signal of continuing to slide to the left, causing the cursor to deform.
- the cursor moves to the instrument screen. See Figure 9C.
- the cursor no longer deforms and returns to a circular shape.
- the simulated touchpad is no longer used to control the central control screen, but is used to control the instrument panel screen. For example, move the cursor to the left side of the instrument panel screen, and then Perform an upward swipe gesture on the touch panel, and the vehicle information on the left side of the dashboard screen will switch from tire information to the fragrance control interface.
- Figure 10 is a schematic flowchart of another method of operating a car cockpit screen provided by an embodiment of the present application. As shown in Figure 10, the method may include steps 1001-1005:
- the 1001 Receive an operation signal sent by the mobile terminal.
- the operation signal is generated based on the user's operation on the simulated touch panel of the mobile terminal.
- the simulated touch panel includes part or all of the screen of the mobile terminal;
- the vehicle-mounted device and the mobile terminal can also establish a connection through the user's manual operation, for example: searching for the vehicle-mounted device on the mobile terminal, and establishing a connection after pairing.
- the vehicle equipment and mobile terminal can still be operated independently by the user. If you want to operate the screen in the vehicle device through the mobile terminal, the mobile terminal needs to enter the touchpad mode. In touchpad mode, part or all of the mobile terminal screen serves as a simulated touchpad. Users can click, slide, tap with their knuckles and other operations on the simulated touchpad to operate the vehicle screen.
- the user can enter the touchpad mode of the mobile terminal through manual operation. For example: through a menu in "Control Center”, “Settings”, or through the operation of "Phone Physical Buttons".
- the connection between the vehicle device and the mobile terminal can be established at the same time as the mobile terminal enters the touchpad mode. For example, when the mobile phone is placed in the wireless charging slot, the account verification is performed and the connection is established at the same time.
- the user puts the mobile terminal into the slot, and the vehicle-machine device establishes a connection with the mobile terminal.
- the vehicle-machine device verifies whether the mobile terminal has logged in the same account through interaction with the mobile terminal. If the result returned by the mobile terminal indicates that the same account has been logged in, account, the car-machine device sends a signal to the mobile terminal to instruct it to enter the touchpad mode, or the mobile terminal responds to the account verification result and automatically enters the touchpad mode.
- the cursor is displayed on the central control screen. If there is no operation, the cursor is displayed for 5 seconds and then hidden. And the co-pilot screen runs the music player program in the normal way, and displays the lyrics of song one and other related information.
- the user inserts his finger into the placement slot, or picks up the mobile terminal from the placement slot, and performs a right sliding gesture on the simulated touch pad, causing the cursor on the central control screen to slide to the right.
- the user can perform the right swipe gesture continuously and multiple times on the simulated trackpad (theoretically, when the phone screen is large enough, it can also slide to the edge with one swipe, but it may usually require multiple operations), slide the cursor to Then, when the user continues to perform a right sliding gesture on the simulated touch pad, the cursor is driven to continue sliding to the right.
- the car device responds to the signal of continuing to slide to the right. Deform the cursor.
- FIG. 13 is a schematic structural diagram of an operating device 1300 for a car cockpit screen provided by an embodiment of the present application.
- the operating device 1300 of the car cockpit screen is applied to the above-mentioned vehicle equipment.
- the device includes an acquisition unit 1301 and a processing unit 1302; wherein,
- the acquisition unit 1301 is used to acquire the attribute information of the operation on the first screen among the multiple screens in the cockpit;
- the second screen is determined from the plurality of screens based on at least two of the end position, the sliding direction and whether the cursor is deformed.
- the operation signal is generated based on the user's operation on the simulated touch panel of the mobile terminal.
- the simulated touch panel includes part or all of the screen of the mobile terminal;
- the processing unit 1302 is specifically configured to:
- the method can be implemented by including a central processing unit (Central Processing Unit, CPU), a random access storage medium (Random Access Memory, RAM), a read-only storage medium (Read-Only Memory, ROM), etc.
- a computer program (including program code) capable of executing the steps involved in the corresponding method as shown in Figure 3 or Figure 10 is run on a general computing device such as a computer with processing elements and storage elements to construct the structure as shown in Figure 13 of An operating device 1300 for a car cockpit screen, and a method for operating a car cockpit screen according to the embodiment of the present application.
- the computer program may be recorded on, for example, a computer-readable recording medium, loaded into the above-mentioned computing device through the computer-readable recording medium, and run therein.
- the memory 1402 includes, but is not limited to, RAM, ROM, erasable programmable read only memory (EPROM), or portable read-only memory (compact disc read-only memory, CD-ROM).
- the memory 1402 Used to store related computer programs and data.
- the processor 1401 can analyze and identify the operation on the first screen, and obtain the attribute information of the operation.
- the attribute information can be the starting position of the cursor, Sliding direction, etc.
- the vehicle-mounted device can determine the second screen that the user wants to operate on from multiple screens, and then display the mirror interface of the second screen on the first screen. Based on this, The on-board device can perform operations related to the second screen through the mirror interface. For example, when the cursor is within the mirror interface, the on-board device can implement corresponding functions on the second screen based on user operations.
- each operation may also correspond to the corresponding description with reference to the method embodiment shown in FIG. 3 .
- vehicle device 1400 shown in Figure 14 only shows the processor 1401, the memory 1402, the input device 1403, the output device 1404 and the bus 1405, during the specific implementation process, those skilled in the art will understand that the vehicle Machinery equipment 1400 also includes other components necessary for normal operation. At the same time, based on specific needs, those skilled in the art should understand that the vehicle equipment 1400 may also include hardware devices that implement other additional functions. In addition, those skilled in the art should understand that the vehicle equipment 1400 may only include components necessary to implement the embodiments of the present application, and does not necessarily include all components shown in FIG. 14 .
- Embodiments of the present application also provide a computer program product.
- the computer program product is run by vehicle equipment, the method flow shown in Figure 3 or Figure 10 is implemented.
- processors mentioned in the embodiments of this application may be a CPU, or other general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), or an off-the-shelf processor.
- DSP Digital Signal Processor
- ASIC Application Specific Integrated Circuit
- FPGA Field Programmable Gate Array
- a general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.
- the memory mentioned in the embodiments of the present application may be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory.
- the non-volatile memory can be ROM, programmable ROM (PROM), EPROM, electrically erasable programmable read-only memory (Electrically EPROM, EEPROM) or flash memory.
- Volatile memory can be RAM, which acts as an external cache.
- RAM static random access memory
- DRAM dynamic random access memory
- DRAM synchronous dynamic random access memory
- SDRAM double data rate synchronous dynamic random access memory
- Double Data Rate SDRAM DDR SDRAM
- ESDRAM enhanced synchronous dynamic random access memory
- Synchlink DRAM SLDRAM
- Direct Rambus RAM Direct Rambus RAM
- the processor is a general-purpose processor, DSP, ASIC, FPGA or other programmable logic device, discrete gate or transistor logic device, or discrete hardware component
- the memory storage module
- the size of the sequence numbers of the above-mentioned processes does not mean the order of execution.
- the execution order of each process should be determined by its functions and internal logic, and should not be used in the embodiments of the present application.
- the implementation process constitutes any limitation.
- the disclosed systems, devices and methods can be implemented in other ways.
- the device embodiments described above are only exemplary.
- the division of the units is only a logical function division. In actual implementation, there may be other division methods.
- multiple units or components may be combined or can be integrated into another system, or some features can be ignored, or not implemented.
- the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms.
- the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
- each functional unit in each embodiment of the present application may be integrated into one processing unit, or may be each The unit physically exists alone, or two or more units can be integrated into one unit. If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium.
- Modules in the device of the embodiment of the present application can be merged, divided, and deleted according to actual needs.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
本申请实施例公开了一种汽车座舱屏幕的操作方法及相关设备,其中,该方法包括:车机设备获取座舱内多个屏幕中的第一屏幕上的操作的属性信息;车机设备根据属性信息,从多个屏幕中确定出第二屏幕;车机设备在第一屏幕上显示第二屏幕的镜像界面。本申请实施例中,当需要操作座舱内不同的屏幕时,只需要切换不同屏幕的镜像即可,无需用户改变位置,从而能够提升汽车座舱内屏幕操作的便捷性。另外,无需增加物理硬件来实现对座舱内不同屏幕的操作,能够降低硬件成本投入。
Description
本申请要求于2022年06月13日提交中国专利局、申请号为202210662846.6、申请名称为“一种汽车座舱屏幕的操作方法及相关设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
本申请涉及智能汽车技术领域,尤其涉及一种汽车座舱屏幕的操作方法及相关设备。
随着汽车研发技术的不断发展,各地区智能汽车的保有量在持续增加。智能汽车与普通汽车的区别之一在于智能汽车上通常会设置多个屏幕,将以往通过物理按键等形式操作的一些功能通过屏幕上的软件操作实现。以中控屏为例,用户可以通过与中控屏的交互实现车辆控制或者娱乐影音控制等功能。然而,中控屏一般设置在车辆的中部,位于主驾驶位和副驾驶位的中间,因此,多数场景中,主驾驶位或副驾驶位上的用户可能需要稍微移动位置才能对中控屏进行相应操作。但是汽车座舱内还可能设置副驾驶屏幕,以及在后座设置左后座屏幕和右后座屏幕,用户需要起身才能实现对这些屏幕进行操作,可见,汽车座舱内存在屏幕操作不便的问题。
发明内容
本申请实施例提供了一种汽车座舱屏幕的操作方法及相关设备,有利于提升汽车座舱内屏幕操作的便捷性。
第一方面,本申请实施例提供一种汽车座舱屏幕的操作方法,应用于车机设备,该方法包括:
获取座舱内多个屏幕中的第一屏幕上的操作的属性信息;
根据属性信息,从多个屏幕中确定出第二屏幕;
在第一屏幕上显示第二屏幕的镜像界面。
本申请实施例中,第一屏幕可以是多个屏幕中的任意一个屏幕,在一些场景中,可以默认其为中控屏。第二屏幕可以是多个屏幕中除第一屏幕外的其他任意屏幕。第一屏幕上的操作可以是用户直接在第一屏幕上进行的操作,也可以是车机设备响应于用户在其他移动终端上的操作,在第一屏幕上执行的操作,比如:控制第一屏幕上的光标进行滑动等。车机设备可对第一屏幕上的操作进行解析识别,得到该操作的属性信息,比如该属性信息可以是光标的起始位置、滑动方向等,基于该属性信息,车机设备可从多个屏幕中确定出用户想要进行操作的第二屏幕,然后在述第一屏幕上显示所述第二屏幕的镜像界面,基于此,车机设备即可通过镜像界面执行与第二屏幕相关的操作,比如:当光标在镜像界面内时,车机设备可基于用户操作在第二屏幕上实现对应的功能。这样当需要操作座舱内不同的屏幕时,只需要切换不同屏幕的镜像即可,无需用户改变位置,从而能够提升汽车座舱内屏幕操作的便捷性。另外,无需增加物理硬件来实现对座舱内不同屏幕的操作,能够降低硬件成本投入。
在一些可能的实施方式中,第一屏幕上的操作包括手势滑动操作,属性信息包括手势滑动的起始位置、终点位置和滑动方向,根据属性信息,从多个屏幕中确定出第二屏幕,包括:
根据起始位置、终点位置和滑动方向中的至少两种,从多个屏幕中确定出第二屏幕。
本申请实施例中,车机设备根据手势滑动操作的起始位置、终点位置和滑动方向中的至少两种即可确定出用户需要操作的第二屏幕,比如:起始位置为屏幕中间、终点位置为屏幕右侧边缘、滑动方向为由屏幕中间向屏幕右侧边缘滑动,即可确定副驾驶屏幕为用户需要操作的屏幕,则车机设备将副驾驶屏幕确定为第二屏幕,便于后续将副驾驶屏幕的镜像界面显示在第一屏幕上,从而有利于执行与副驾驶屏幕相关的操作。
在一些可能的实施方式中,第一屏幕上的操作包括第一屏幕上的光标的滑动,属性信息包括光标的终点位置、滑动方向和光标是否产生形变,根据属性信息,从多个屏幕中确定出第二屏幕,包括:
根据终点位置、滑动方向和光标是否产生形变中的至少两种,从多个屏幕中确定出第二屏幕。
本申请实施例中,第一屏幕上的光标的滑动可以是用户直接在第一屏幕上控制光标进行滑动,也可以是车机设备响应于用户在其他移动终端的屏幕上的滑动操作,带动第一屏幕上的光标进行滑动。光标的滑动的属性信息除了光标的终点位置、滑动方向外,还可以包括光标是否产生形变,比如:圆形光标被滑动至第一屏幕右侧边缘,且车机设备仍然接收到控制光标向第一屏幕右侧边缘滑动的信号,则车机设备使光标发生形变(例如:将光标从圆形调整为椭圆形)。车机设备根据光标的终点位置、滑动方向和是否产生形变中的至少两种即可确定出用户需要操作的第二屏幕。比如:终点位置为屏幕右侧边缘、滑动方向为由屏幕中间向屏幕右侧边缘滑动、光标在屏幕右侧边缘产生了形变,即可确定副驾驶屏幕为用户需要操作的屏幕,则车机设备将副驾驶屏幕确定为第二屏幕,便于后续将副驾驶屏幕的镜像界面显示在第一屏幕上,从而有利于执行与副驾驶屏幕相关的操作。
在一些可能的实施方式中,在第一屏幕上显示第二屏幕的镜像界面之后,该方法还包括:
若光标位于第一屏幕中镜像界面外的区域,则执行与第一屏幕相关的操作;
若光标位于镜像界面内,则执行与第二屏幕相关的操作;
若光标位于第二屏幕内,则执行与第二屏幕相关的操作。
本申请实施例中,车机设备还可根据光标的位置来确定用户操作的执行对象,比如:光标位于第一屏幕中镜像界面外的区域,则确定用户是对第一屏幕进行操作,光标位于镜像界面内或光标位于第二屏幕内,则确定用户是对第二屏幕进行操作,在确定出用户操作的执行对象后,车机设备即可在该执行对象上实现相应的功能。
在一些可能的实施方式中,获取滑动方向,包括:
根据起始位置和终点位置确定出的线段,得到水平方向的滑动距离的分量和竖直方向的滑动距离的分量;
根据起始位置和终点位置中的至少一种、水平方向的滑动距离的分量和竖直方向的滑动距离的分量,确定滑动方向。
本申请实施例中,不论是手势滑动操作,还是光标的滑动,均可根据其属性信息中的起始位置和终点位置确定出一条线段,利用该线段可以计算得到水平方向的滑动距离的分量和竖直方向的滑动距离的分量。若水平方向的滑动距离的分量大于竖直方向的滑动距离的分量,则可以确定滑动方向为水平方向的滑动,根据水平方向的滑动和终点位置为第一屏幕右侧边缘,可以确定最终的滑动方向为向右滑动;若竖直方向的滑动距离的分量大于水平方向的滑
动距离的分量,则可以确定滑动方向为竖直方向的滑动,根据竖直方向的滑动和起始位置为第一屏幕右下侧边缘,可以确定最终的滑动方向为第一屏幕右下侧边缘向屏幕中间滑动。利用起始位置和终点位置中的至少一种、水平方向的滑动距离的分量和竖直方向的滑动距离的分量确定滑动方向,便于快速确定出第二屏幕。
在一些可能的实施方式中,在获取座舱内多个屏幕中的第一屏幕上的操作的属性信息之前,该方法还包括:
接收移动终端发送的操作信号,操作信号是基于用户在移动终端的模拟触控板上的操作而生成的,模拟触控板包括移动终端的屏幕的部分或全部;
基于操作信号控制光标在第一屏幕上进行滑动。
本申请实施例中,通过移动终端与车机设备之间的连接,将移动终端的屏幕作为第一屏幕的模拟触控板,移动终端响应于用户在模拟触控板上的操作生成对应的操作信号,将该操作信号发送给车机设备,车机设备可以基于该操作信号控制光标在第一屏幕上进行滑动。移动终端的屏幕作为第一屏幕的模拟触控板,由于移动终端可以放置在车内任意位置,便于用户操作,通过模拟触控板上的操作带动第一屏幕上的操作,无需用户起身移动至第一屏幕附近才能完成操作,提升了操作的便捷性,且移动终端作为已经普及的设备,无需额外的硬件成本投入。另外,相比传统的四键项,一个操作需要多次组合动作来完成,模拟触控板的方式通过移动光标实现用户的操作目的,操作方式更为简单。
在一些可能的实施方式中,执行与第一屏幕相关的操作,包括:
响应于用户在模拟触控板上的第一预设手势操作,对第一屏幕进行截屏;
和/或,
响应于用户在模拟触控板上的第二预设手势操作,对第一屏幕进行亮度调节;
和/或,
响应于用户在模拟触控板上的第三预设手势操作,显示与第一屏幕连接的第一音响的第一音频控制器,以使得用户通过第一音频控制器对第一音响进行音频属性调节。
在一些可能的实施方式中,执行与第二屏幕相关的操作,包括:
响应于用户在模拟触控板上的第一预设手势操作,对第二屏幕进行截屏;
和/或,
响应于用户在模拟触控板上的第二预设手势操作,对第二屏幕进行亮度调节;
和/或,
响应于用户在模拟触控板上的第三预设手势操作,显示与第二屏幕连接的第二音响的第二音频控制器,以使得用户通过第二音频控制器对第二音响进行音频属性调节。
本申请实施例中,第一预设手势可以是执行截屏的快捷手势,第二预设手势可以是进行亮度调节的快捷手势,第三预设手势可以是唤出音频调节控件的手势。用户在模拟触控板上执行这些预设手势时,车机设备可以根据光标的位置确定这些预设手势的执行对象(比如:第一屏幕或第二屏幕),然后在该执行对象上实现这些预设手势对应的功能或命令。比如:用户在模拟触控板上执行指关节敲击这一快捷手势,车机设备响应于该指关节敲击,若光标位于镜像界面内,则认为第二屏幕为执行对象,车机设备在第二屏幕上执行指关节敲击这一快捷手势对应的命令,比如:截屏。即根据用户在模拟触控板上的不同操作,车机设备可以根据光标的位置在不同屏幕上实现该操作对应的功能。
在一些可能的实施方式中,在第一屏幕上显示第二屏幕的镜像界面之后,该方法还包括:
响应于光标滑动至镜像界面内,将光标锁定在镜像界面内。
本申请实施例中,当检测到光标滑动至镜像界面内,车机设备可以直接将光标锁定在镜像界面内,也可以在接收到用户的某个操作后,将光标锁定在镜像界面内,光标被锁定在镜像界面内,有利于防止误操作将其移出镜像界面,且便于通过光标对镜像界面进行相关操作。
在一些可能的实施方式中,根据终点位置、滑动方向和光标是否产生形变中的至少两种,从多个屏幕中确定出第二屏幕,包括:
获取预先构建的多个屏幕的空间位置图谱,空间位置图谱用于表征多个屏幕间的空间位置关系;
根据终点位置、滑动方向和光标是否产生形变中的至少两种及空间位置关系,从多个屏幕中确定出第二屏幕。
本申请实施例中,车机设备存储有多个屏幕中各屏幕的位置,并基于各屏幕的位置构建了多个屏幕的空间位置图谱,也就是说该空间位置图谱能够表征多个屏幕间的空间位置关系。根据终点位置、滑动方向和光标是否产生形变中的至少两种,再结合多个屏幕间的空间位置关系,车机设备可以从多个屏幕中确定出用户需要操作的第二屏幕。
在一些可能的实施方式中,属性信息还包括光标在所述终点位置的停留时间和光标产生形变的情况下形变的持续时间,在根据属性信息,从多个屏幕中确定出第二屏幕之后,该方法还包括:
在停留时间大于或等于预设停留时间和/或持续时间大于或等于预设持续时间的情况下,将光标从第一屏幕移动至第二屏幕内。
本申请实施例中,在确定出第二屏幕的情况下,车机设备可以基于光标的停留时间和/或光标产生形变的持续时间将光标从第一屏幕移动至第二屏幕内,比如:结合多个屏幕的空间位置关系,持续将中控屏中的光标向右移动,且光标在中控屏的右侧边缘停留的时间超过预设停留时间,即可将光标从中控屏穿越到副驾驶屏幕,以便于用户通过在模拟触控板上操作带动光标在第二屏幕上进行相同的操作。
第二方面,本申请实施例提供了一种汽车座舱屏幕的操作装置,该装置应用于车机设备,包括获取单元和处理单元,其中,
获取单元,用于获取座舱内多个屏幕中的第一屏幕上的操作的属性信息;
处理单元,用于根据属性信息,从多个屏幕中确定出第二屏幕;
处理单元,还用于在第一屏幕上显示第二屏幕的镜像界面。
需要说明的是,第二方面是上述第一方面对应的装置,用于实现第一方面提供的方法中的各个实施例,且能达到相同或相似的有益效果。
在一些可能的实施方式中,第一屏幕上的操作包括手势滑动操作,属性信息包括手势滑动的起始位置、终点位置和滑动方向,在根据属性信息,从多个屏幕中确定出第二屏幕方面,处理单元具体用于:
根据起始位置、终点位置和滑动方向中的至少两种,从多个屏幕中确定出第二屏幕。
在一些可能的实施方式中,第一屏幕上的操作包括第一屏幕上的光标的滑动,属性信息包括光标的终点位置、滑动方向和光标是否产生形变,在根据属性信息,从多个屏幕中确定出第二屏幕方面,处理单元具体用于:
根据终点位置、滑动方向和光标是否产生形变中的至少两种,从多个屏幕中确定出第二屏幕。
在一些可能的实施方式中,获取单元还用于:
若光标位于第一屏幕中镜像界面外的区域,则执行与第一屏幕相关的操作;
若光标位于镜像界面内,则执行与第二屏幕相关的操作;
若光标位于第二屏幕内,则执行与第二屏幕相关的操作。
在一些可能的实施方式中,处理单元还用于:
接收移动终端发送的操作信号,操作信号是基于用户在移动终端的模拟触控板上的操作而生成的,模拟触控板包括移动终端的屏幕的部分或全部;
基于操作信号控制光标在第一屏幕上进行滑动。
在一些可能的实施方式中,在执行与第一屏幕相关的操作方面,处理单元具体用于:
响应于用户在模拟触控板上的第一预设手势操作,对第一屏幕进行截屏;
和/或,
响应于用户在模拟触控板上的第二预设手势操作,对第一屏幕进行亮度调节;
和/或,
响应于用户在模拟触控板上的第三预设手势操作,显示与第一屏幕连接的第一音响的第一音频控制器,以使得用户通过第一音频控制器对第一音响进行音频属性调节。
在一些可能的实施方式中,在执行与第二屏幕相关的操作方面,处理单元具体用于:
响应于用户在模拟触控板上的第一预设手势操作,对第二屏幕进行截屏;
和/或,
响应于用户在模拟触控板上的第二预设手势操作,对第二屏幕进行亮度调节;
和/或,
响应于用户在模拟触控板上的第三预设手势操作,显示与第二屏幕连接的第二音响的第二音频控制器,以使得用户通过第二音频控制器对第二音响进行音频属性调节。
在一些可能的实施方式中,处理单元还用于:
响应于光标滑动至镜像界面内,将光标锁定在镜像界面内。
在一些可能的实施方式中,在根据终点位置、滑动方向和光标是否产生形变中的至少两种,从多个屏幕中确定出第二屏幕方面,处理单元具体用于:
获取预先构建的多个屏幕的空间位置图谱,空间位置图谱用于表征多个屏幕间的空间位置关系;
根据终点位置、滑动方向和光标是否产生形变中的至少两种及空间位置关系,从多个屏幕中确定出第二屏幕。
在一些可能的实施方式中,属性信息还包括光标在终点位置的停留时间和光标产生形变的情况下形变的持续时间,处理单元还用于:
在停留时间大于或等于预设停留时间和/或持续时间大于或等于预设持续时间的情况下,将光标从第一屏幕移动至第二屏幕内。
第三方面,本申请实施例提供了一种车机设备,包括处理器、存储器,以及一个或多个程序,处理器与存储器相连,一个或多个程序被存储在存储器中,并且被配置为由处理器执行时实现上述第一方面中的方法。
第四方面,本申请实施例提供了一种计算机可读存储介质,计算机可读存储介质存储有用于设备执行的计算机程序,计算机程序被执行时实现上述第一方面中的方法。
第五方面,本申请实施例提供了一种计算机程序产品,当计算机程序产品被电子设备运行,使得电子设备执行上述第一方面中的方法。
为了更清楚地说明本发明实施例或背景技术中的技术方案,下面将对本发明实施例或背景技术中所需要使用的附图进行说明。
图1为一种相关技术提出的通过增加物理硬件与中控屏进行交互的示意图;
图2为一种汽车座舱屏幕的操作方法的应用场景示意图;
图3为本申请实施例提供的一种汽车座舱屏幕的操作方法的流程示意图;
图4为本申请实施例提供的一种屏幕各边缘的位置定义示意图;
图5A为本申请实施例提供的一种根据滑动方向和终点位置确定第二屏幕的示意图;
图5B为本申请实施例提供的一种根据滑动方向和起始位置确定第二屏幕的示意图;
图6为本申请实施例提供的一种座舱内各屏幕的空间位置图谱的示意图;
图7A为本申请实施例提供的一种副驾驶屏幕的镜像界面的示意图;
图7B为本申请实施例提供的一种通过模拟触控板对副驾驶屏幕执行快捷手势的示意图;
图7C为本申请实施例提供的一种通过模拟触控板对中控屏执行快捷手势的示意图;
图8为本申请实施例提供的一种将光标移动至副驾驶屏幕内的示意图;
图9A为本申请实施例提供的一种移动终端与车机设备建立连接后的中控屏和仪表盘屏幕的示意图;
图9B为本申请实施例提供的一种控制光标产生形变的示意图;
图9C为本申请实施例提供的一种将光标移动至仪表盘屏幕内的示意图;
图9D为本申请实施例提供的一种通过模拟触控板带动光标对仪表盘屏幕进行操作的示意图;
图10为本申请实施例提供的另一种汽车座舱屏幕的操作方法的流程示意图;
图11为本申请实施例提供的一种模拟触控板和光标位置的示意图;
图12A为本申请实施例提供的一种移动终端与车机设备建立连接后中控屏和副驾驶屏幕的示意图;
图12B为本申请实施例提供的另一种控制光标产生形变的示意图;
图12C为本申请实施例提供的一种将副驾驶屏幕的音乐播放界面镜像至中控屏上的示意图;
图12D为本申请实施例提供的一种通过模拟触控板对副驾驶屏幕进行操作的示意图;
图13为本申请实施例提供的一种汽车座舱屏幕的操作装置的结构示意图;
图14为本申请实施例提供的一种车机设备的结构示意图。
本申请的说明书和权利要求书及所述附图中的术语“第一”、“第二”、“第三”和“第四”等是用于区别不同对象,而不是用于描述特定顺序。此外,术语“包括”和“具有”以及它们任何变形,意图在于覆盖不排他的包含。例如包含了一系列步骤或单元的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元,而是可选地还包括没有列出的步骤或单元,或可选地还包括对于这些过程、方法、产品或设备固有的其它步骤或单元。
在本文中提及“实施例”意味着,结合实施例描述的特定特征、结构或特性可以包含在本申请的至少一个实施例中。在说明书中的各个位置出现该短语并不一定均是指相同的实施例,
也不是与其它实施例互斥的独立的或备选的实施例。本领域技术人员显式地和隐式地理解的是,本文所描述的实施例可以与其它实施例相结合。
在本说明书中使用的术语“部件”、“模块”、“系统”等用于表示计算机相关的实体、硬件、固件、硬件和软件的组合、软件、或执行中的软件。例如,部件可以是但不限于,在处理器上运行的进程、处理器、对象、可执行文件、执行线程、程序和/或计算机。通过图示,在终端设备上运行的应用和终端设备都可以是部件。一个或多个部件可驻留在进程和/或执行线程中,部件可位于一个计算机上和/或分布在2个或更多个计算机之间。此外,这些部件可从在上面存储有各种数据结构的各种计算机可读介质执行。部件可例如根据具有一个或多个数据分组(例如来自与本地系统、分布式系统和/或网络间的另一部件交互的二个部件的数据,例如通过信号与其它系统交互的互联网)的信号通过本地和/或远程进程来通信。
为了便于理解本申请实施例,进一步分析并提出本申请所具体要解决的技术问题,下面对本申请的相关技术方案进行简要介绍。
请参见图1,图1为一种相关技术提出的通过增加物理硬件的方式来实现与中控屏交互的方案,如图1所示,相关技术在方向盘上设置四项键、在主驾驶位和副驾驶位之间设置旋钮/触控板等。应理解,四项键通常是用于操作中控屏的,而智能汽车/智能座舱内存在多个屏幕,四项键难以实现对中控屏以外的屏幕的操作。另外,若采用物理硬件去操作其他屏幕,则硬件的位置通常是固定的,在实际操作时可能需要用户起身,移动到硬件附近,导致操作不便,且增加了硬件成本投入。
综合相关技术的缺陷和不足,本申请实施例所要解决的技术问题主要如下:通过固定在座舱内某个地方的硬件实现车载屏幕的操作,一方面会导致成本投入的提升,且存在操作不便的问题;另一方面当存在多个屏幕时,难以实现对中控屏以外的屏幕的操作。
基于上述技术问题,本申请实施例主要应用于用户与车机设备交互以对座舱内多个屏幕进行操作的场景,请参见图2,图2为本申请实施例提供的一种汽车座舱屏幕的操作方法的应用场景示意图,如图2所示,该场景中可以包括移动终端201、车机设备202和用户203。
其中,移动终端201可以是用户203随身的便携设备,比如手机、平板电脑等。移动终端201具有触控板模式,在触控板模式下,移动终端201的屏幕可以作为车机设备202内某个屏幕(比如:中控屏)的模拟触控板,以通过该模拟触控板对车机设备202内的屏幕进行操作。
其中,车机设备202内配置至少两个屏幕,车机设备202和移动终端201可以通过蓝牙、无线网络等方式建立连接,移动终端201进入触控板模式后,车机设备202内的屏幕(比如:中控屏)上可以显示光标,车机设备202可以响应于移动终端201的模拟触控板上的操作,控制光标对车机设备202内的屏幕进行操作。
其中,用户203可以是车主,也可以是车上的乘客,具有操作多个屏幕的需求。当移动终端201和车机设备202登陆不同的账号时,用户203可以手动操作以在移动终端201和车机设备202之间建立连接。
以下结合附图对本申请实施例提供的汽车座舱屏幕的操作方法及相关设备进行详细描述。
请参见图3,图3为本申请实施例提供的一种汽车座舱屏幕的操作方法的流程示意图,该方法可应用于图2所示的场景中,具体可由车机设备执行,如图3所示,该方法可以包括步骤301-303:
301:获取座舱内多个屏幕中的第一屏幕上的操作的属性信息。
本申请实施例中,第一屏幕可以是多个屏幕中的任意一个屏幕,在一些场景中,可以默认其为中控屏。第二屏幕可以是多个屏幕中除第一屏幕外的其他任意屏幕。第一屏幕上的操作可以是用户直接在第一屏幕上进行的操作,也可以是车机设备响应于用户在其他移动终端上的操作,在第一屏幕上执行的操作,比如:控制第一屏幕上的光标进行滑动等。车机设备在第一屏幕上存在操作的情况下,对该操作进行解析和识别,得到该操作的属性信息,比如:该操作可以是手势滑动操作,则属性信息可以包括手势滑动的起始位置、终点位置、滑动方向、在起始位置的停留时间、在终点位置的停留时间,等等。比如:该操作还可以是第一屏幕上的光标的滑动,则属性信息可以包括光标的起始位置、终点位置、滑动方向、光标是否产生形变、光标在终点位置的停留时间、光标产生形变的持续时间,等等。应理解,第一屏幕上的操作包括但不限于手势滑动操作、光标的滑动,还可以包括其他屏幕操作方式。
302:根据属性信息,从多个屏幕中确定出第二屏幕。
本申请实施例中,对应于手势滑动操作,根据属性信息,从多个屏幕中确定出第二屏幕,包括:
根据起始位置、终点位置和滑动方向中的至少两种,从多个屏幕中确定出第二屏幕。应理解,除第一屏幕(比如:中控屏)外,多个屏幕中还包括仪表盘屏幕、副驾驶屏幕、左后座屏幕和右后座屏幕,各屏幕的镜像条件可如表1所示:
表1
其中,表1中屏幕左侧边缘、屏幕右侧边缘、屏幕左下方边缘、屏幕右下方边缘,以及屏幕左上方边缘、屏幕右上方边缘的定义可参见图4中的矩形阴影区域,对于左上方和右上方、左下方和右下方,以屏幕中线作为分界线。车机设备根据手势滑动操作的起始位置、终点位置和滑动方向中的至少两种即可确定出用户需要操作的第二屏幕。比如:起始位置为屏幕中间、终点位置为屏幕右侧边缘、滑动方向为向右滑动,则可确定第二屏幕为副驾驶屏幕。请参见图5A,图5A给出了根据滑动方向和终点位置确定第二屏幕的示例,若滑动方向为向左滑动、终点位置为屏幕左侧边缘,则可以确定第二屏幕为仪表盘屏幕;若滑动方向为向右滑动、终点位置为屏幕右侧边缘,则可以确定第二屏幕为副驾驶屏幕;若滑动方向为向左下方滑动、终点位置为屏幕左下方边缘,则可以确定第二屏幕为左后座屏幕;若滑动方向为向右下方滑动、终点位置为屏幕右下方边缘,则可以确定第二屏幕为右后座屏幕。请参见图5B,图5B给出了根据滑动方向和起始位置确定第二屏幕的示例,若滑动方向为由屏幕左侧边缘向屏幕中间滑动、起始位置为屏幕左侧边缘,则可以确定第二屏幕为仪表盘屏幕;若滑动方向为由屏幕右侧边缘向屏幕中间滑动、起始位置为屏幕右侧边缘,则可以确定第二屏幕为副驾驶屏幕;若滑动方向为由屏幕左下方边缘向屏幕中间滑动、起始位置为屏幕左下方边缘,则可以确定第二屏幕为左后座屏幕;若滑动方向为由屏幕右下方边缘向屏幕中间滑动、起始位置为屏幕右下方边缘,则可以确定第二屏幕为右后座屏幕。应理解,图5A和图5B给出了根据起始位置、终点位置和滑动方向中的两种确定第二屏幕的示例,车机设备还可以根据起始位置、终点位置和滑动方向中的三种确定出第二屏幕。
本申请实施例中,对应于光标的滑动,根据属性信息,从多个屏幕中确定出第二屏幕,包括:
根据终点位置、滑动方向和光标是否产生形变中的至少两种,从多个屏幕中确定出第二屏幕。需要说明的是,第一屏幕上的光标的滑动可以是用户直接在第一屏幕上控制光标进行滑动,也可以是车机设备响应于用户在其他移动终端的屏幕上的滑动操作,带动第一屏幕上的光标进行滑动。此场景中,仪表盘屏幕、副驾驶屏幕、左后座屏幕和右后座屏幕的镜像条件可如表2所示:
表2
其中,光标产生形变可以是当光标被滑动至第一屏幕边缘,且继续接收到向边缘外滑动的指令,则车机设备使光标发生形变。例如:用户在移动终端的模拟触控板上持续向左滑动,车机设备基于与移动终端的连接接收到移动终端的信号,响应该信号将光标向左边滑动,当滑动到屏幕左侧边缘时,车机设备仍然接收到向左滑动光标的信号,则车机设备使光标产生形状的变化。例如,将光标从圆形调整为椭圆形,随着持续时间的延长,椭圆形的长轴增大,短轴减小,逐渐由椭圆形向条状变化。应理解,光标的滑动场景中,根据终点位置、滑动方向和光标是否产生形变中的至少两种确定第二屏幕的方式,可参照手势滑动操作。该实施方式中,车机设备基于属性信息从多个屏幕中确定出第二屏幕,便于后续将第二屏幕的镜像界面显示在第一屏幕上,从而有利于执行与第二屏幕相关的操作。
示例性的,根据终点位置、滑动方向和光标是否产生形变中的至少两种,从多个屏幕中确定出第二屏幕,包括:
获取预先构建的多个屏幕的空间位置图谱,空间位置图谱用于表征多个屏幕间的空间位置关系;
根据终点位置、滑动方向和光标是否产生形变中的至少两种及空间位置关系,从多个屏幕中确定出第二屏幕。
具体的,车机设备存储有多个屏幕中各屏幕的位置,并基于各屏幕的位置构建了多个屏幕的空间位置图谱,也就是说该空间位置图谱能够表征多个屏幕间的空间位置关系。例如,中控屏、仪表盘屏幕、副驾驶屏幕、左后座屏幕和右后座屏幕的空间位置图谱可如图6所示,相邻的两个屏幕通过直线连接。图6所示的五个屏幕中,由于仪表盘屏幕和副驾驶屏幕之间隔着中控屏,不能互相确定为第二屏幕,也就是说当第一屏幕为仪表盘屏幕的情况下,不能通过单次操作确定副驾驶屏幕为第二屏幕;当第一屏幕为副驾驶屏幕的情况下,不能通过单次操作确定仪表盘屏幕为第二屏幕;而直接相邻的两个屏幕可以互相确定为待操作或待镜像的屏幕。车机设备根据光标的终点位置、滑动方向和光标是否产生形变中的至少两种,再结合多个屏幕间的空间位置关系,可以从多个屏幕中确定出用户需要操作的第二屏幕。一种可能的示例中,基于多个屏幕的空间位置关系,光标朝向某个屏幕滑动、停留在靠近该屏幕的边缘且产生形变,就可以将该屏幕确定为第二屏幕。例如,当前光标在左后座屏幕(此时,左后座屏幕为第一屏幕)上,光标的移动方向为向上移动,则光标在屏幕位置空间图谱中是朝向仪表盘屏幕移动,如果光标停留在上方边缘,且光标产生形变,由于仪表盘屏幕位于左
后座屏幕的上方,即可确定第二屏幕为仪表盘屏幕。
进一步的,该空间位置关系可以表征多个屏幕中各屏幕在各个方向的间隔距离,比如:图6中,中控屏在仪表盘屏幕水平右侧方向的间隔距离为1、副驾驶屏幕在仪表盘屏幕水平右侧方向的间隔距离为2、右后座屏幕在副驾驶屏幕下竖直方向的间隔为1、中控屏在左后座屏幕的右上方的间隔为1,等等。车机设备还可基于终点位置、滑动方向和光标是否产生形变中的至少两种及该间隔距离,确定出第二屏幕。比如:副驾驶屏幕与仪表盘屏幕的间隔距离为2,若光标在仪表盘屏幕上向右滑动的属性信息已经可以将中控屏确定为第二屏幕,但是光标还在持续向右滑动,则基于空间位置图谱表征的间隔距离,车机设备可以获知需要镜像的屏幕并不是中控屏,而是副驾驶屏幕,就可以将副驾驶屏幕的镜像界面显示在仪表盘屏幕上。
进一步的,若第一屏幕和第二屏幕不是中控屏,则多个屏幕之间的切换需要通过中控屏中转。也就是说需要先从第一屏幕切换到中控屏,再基于中控屏上的操作的属性信息,将其他屏幕的镜像界面显示在中控屏上。比如可以通过在模拟触控板上的操作带动光标滑动,以将第一屏幕切换至中控屏。具体切换规则可如表3所示:
表3
例如表3中,光标当前所在屏幕为仪表盘屏幕,若用户需要操作左后座屏幕,则车机设备需要先基于仪表盘屏幕到中控屏的切换条件(向右滑动、屏幕右侧边缘、光标产生形变),将光标从仪表盘屏幕移动至中控屏内,再基于光标在中控屏上的操作的属性信息将左后座屏幕的镜像界面显示在中控屏上,即光标所在屏幕从仪表盘屏幕过渡到了中控屏,基于中控屏再实现对其他屏幕的操作。
示例性的,在识别出起始位置、终点位置的基础上,滑动方向的获取步骤可以是:
根据起始位置和终点位置确定出的线段,得到水平方向的滑动距离的分量和竖直方向的滑动距离的分量;
根据起始位置和终点位置中的至少一种、水平方向的滑动距离的分量和竖直方向的滑动距离的分量,确定滑动方向。
应理解,由于用户的手势不可能为标准的水平滑动或者竖直滑动,则第一屏幕上的手势滑动操作或光标的滑动通常是曲线,因此,可以根据其属性信息中的起始位置和终点位置确定出一条线段,利用该线段可以计算得到水平方向的滑动距离的分量和竖直方向的滑动距离的分量。若水平方向的滑动距离的分量大于竖直方向的滑动距离的分量,则可以确定滑动方向为水平方向的滑动,根据水平方向的滑动和终点位置为第一屏幕右侧边缘,可以确定最终的滑动方向为向右滑动;若竖直方向的滑动距离的分量大于水平方向的滑动距离的分量,则可以确定滑动方向为竖直方向的滑动,根据竖直方向的滑动和起始位置为第一屏幕右下侧边缘,可以确定最终的滑动方向为第一屏幕右下侧边缘向屏幕中间滑动。该实施方式中,利用起始位置和终点位置中的至少一种、水平方向的滑动距离的分量和竖直方向的滑动距离的分量确定滑动方向,便于快速确定出第二屏幕。
303:在第一屏幕上显示第二屏幕的镜像界面。
示例性的,镜像的方式可以是双通道传输,即第二屏幕的处理器在计算出第二屏幕上的显示数据后,车机设备控制第二屏幕的处理器将显示数据分成两路传输,一路仍然传输至第二屏幕进行显示,另一路则传输至第一屏幕进行显示。镜像的方式还可以是投屏,即第二屏幕将显示数据发送至第二屏幕进行显示,车机设备控制第二屏幕的处理器将第二屏幕上的界面投屏至第一屏幕上进行显示。该实施方式中,采用双通道传输或投屏的方式实现第二屏幕在第一屏幕上的镜像,进而便于用户通过镜像界面实现对第二屏幕的相关操作。
示例性的,镜像界面可以是以悬浮窗口的方式在第一屏幕上进行显示,也可以以分屏的方式进行显示。悬浮窗口即在第一屏幕原有的显示界面层上,建立一个新的镜像窗口,来显示镜像界面,镜像窗口会遮挡部分第一屏幕。分屏的方式即通过调整第一屏幕的显示界面布局,缩小原来的显示界面的显示面积,空出一部分显示区域来显示镜像界面,即镜像窗口和第一屏幕的原窗口在同一界面层上显示。
示例性的,在第一屏幕上显示第二屏幕的镜像界面之后,该方法还包括:
响应于光标滑动至镜像界面内,将光标锁定在镜像界面内。该实施方式中,当车机设备检测到光标滑动至镜像界面内,车机设备可以直接将光标锁定在镜像界面内,也可以在接收到用户的某个操作(比如双击)后,将光标锁定在镜像界面内,光标被锁定在镜像界面内,有利于防止误操作将其移出镜像界面,且便于通过光标对镜像界面进行相关操作。
示例性的,该方法还包括:检测光标是否在镜像界面的边缘产生形变或者镜像界面上是否存在预设手势,若是则解除光标在镜像界面内的锁定。比如:光标在镜像窗口内时,用户的手指在模拟触控板上滑动,当滑动到镜像界面边缘时,会被镜像窗口的边缘阻挡,当用户将光标滑动到镜像界面边缘,并持续向外滑动,光标产生形变,则光标滑出镜像界面,进入到第一屏幕内;其中,预设手势例如可以是:圆弧手势。
示例性的,该方法还包括:
若光标位于第一屏幕中镜像界面外的区域,则执行与第一屏幕相关的操作;
若光标位于镜像界面内,则执行与第二屏幕相关的操作;
若光标位于第二屏幕内,则执行与第二屏幕相关的操作。
示例性的,执行与第一屏幕相关的操作,包括:
响应于用户在模拟触控板上的第一预设手势操作,对第一屏幕进行截屏;
和/或,
响应于用户在模拟触控板上的第二预设手势操作,对第一屏幕进行亮度调节;
和/或,
响应于用户在模拟触控板上的第三预设手势操作,显示与第一屏幕连接的第一音响的第一音频控制器,以使得用户通过第一音频控制器对第一音响进行音频属性调节。
示例性的,执行与第二屏幕相关的操作,包括:
响应于用户在模拟触控板上的第一预设手势操作,对第二屏幕进行截屏;
和/或,
响应于用户在模拟触控板上的第二预设手势操作,对第二屏幕进行亮度调节;
和/或,
响应于用户在模拟触控板上的第三预设手势操作,显示与第二屏幕连接的第二音响的第二音频控制器,以使得用户通过第二音频控制器对第二音响进行音频属性调节。
具体的,请参见图7A,图7A给出了第二屏幕为副驾驶屏幕的示例,当用户在模拟触控板上通过多次向右滑动的手势,将光标滑动到中控屏的边缘,用户继续滑动,中控屏上的光
标产生形变,确定第二屏幕为副驾驶屏幕,将副驾驶屏幕镜像到中控屏上,并以小窗的方式显示。此时,光标仍然在中控屏中镜像界面外的区域,用户可以通过在移动终端的模拟触控板上的操作,控制光标在中控屏上执行一些动作,以将光标移动至副驾驶屏幕的镜像界面内。车机设备可以响应于用户在模拟触控板上的操作,控制光标在镜像界面执行相同的操作,比如:对某些图标执行相同的点击、滑动等操作,基于镜像界面上的操作,车机设备生成操作指令,将镜像界面上的操作同步至副驾驶屏幕,从而使副驾驶屏幕的页面产生变化。副驾驶页面变化后,页面变化内容会同步镜像到镜像界面。比如:图7A中,当光标移动到音乐播放控件上,响应于用户的点击,在副驾驶屏幕的镜像界面中点击下一首,则车机设备响应光标的操作,播放列表中的下一首歌曲,副驾驶屏幕执行相同的操作,音乐播放界面对应产生变化,例如:显示的专辑封面、歌词、歌手、歌曲名称等都对应变化,并将该变化同步到镜像界面。其中,图7A所示的实施例中,还可以考虑光标在终点位置的停留时间和/或形变的持续时间,来将副驾驶屏幕确定为第二屏幕,比如:光标在终点位置的停留时间和/或形变的持续时间超过预设时间(例如:3秒)。该实施方式中,将光标的停留时间和/或形变的持续时间作为屏幕镜像的前置条件,在一定程度上能够减少误触操作。
请参见图7B,图7B给出了第二屏幕为副驾驶屏幕的另一个示例,当副驾驶屏幕的界面镜像到第一屏幕后,可以通过一些快捷手势来实现副驾驶屏幕上快捷功能的控制,例如,指关节敲击截屏、双指滑动调节屏幕亮度、长按唤出音量调节控件等。例如:第一预设手势可以是执行截屏的快捷手势(比如:指关节敲击截屏),第二预设手势可以是进行亮度调节的快捷手势(比如:双指滑动),第三预设手势可以是唤出音频调节控件的手势(比如:长按)。当用户在模拟触控板上执行指关节敲击这一快捷手势,则车机设备根据光标的位置确定快捷手势的执行对象,比如光标在镜像界面内,则将指关节敲击这一快捷手势确定为对副驾驶屏幕的操作,车机设备在副驾驶屏幕上执行截屏命令,并在镜像界面上同步副驾驶屏幕上的截屏界面。示例性的,如图7C所示,若光标在中控屏中镜像界面外的区域,则将指关节敲击这一快捷手势确定为对中控屏的操作,车机设备在中控屏上执行截屏命令。
应理解,若用户在模拟触控板上执行的是双指上滑手势,若光标在镜像界面内,则车机设备在副驾驶屏幕上执行双指上滑手势对应的亮度调高命令;若用户在模拟触控板上执行的是双指上滑手势,若光标在中控屏中镜像界面外的区域,则车机设备在中控屏上执行双指上滑手势对应的亮度调高命令。若用户在模拟触控板上执行的是长按手势,且光标在镜像界面内,则车机设备在副驾驶屏幕上执行长按手势对应的音频控制器(副驾驶屏幕的音响的音频控制器)调出命令,调出与副驾驶屏幕连接的音响(即第二音响)的音频控制器(第二音频控制器),则用户可以通过第二音频控制器对第二音响进行音频属性调节;若用户在模拟触控板上执行的是长按手势,且光标在中控屏中镜像界面外的区域,则车机设备在中控屏上执行长按手势对应的音频控制器(中控屏的音响的音频控制器)调出命令,调出与中控屏连接的音响(即第一音响)的音频控制器(第一音频控制器),则用户可以通过第一音频控制器对第一音响进行音频属性调节,基于此,车机设备可以对不同屏幕连接的音响进行音频属性的调节,从而实现对车内不同位置的音场的调节。
示例性的,在根据属性信息,从多个屏幕中确定出第二屏幕之后,该方法还包括:
在光标在终点位置的停留时间大于或等于预设停留时间和/或光标产生形变的情况下形变的持续时间大于或等于预设持续时间的情况下,将光标从第一屏幕移动至第二屏幕内。在确定出第二屏幕的情况下,车机设备可以将光标从第一屏幕移动至第二屏幕内,比如:结合多个屏幕的空间位置关系,持续将中控屏中的光标向右移动,即可将光标从中控屏穿越到副
驾驶屏幕,以便于用户通过在模拟触控板上操作带动光标在第二屏幕上进行相同的操作。可选的,也可以将光标是否移动至第二屏幕内作为将第二屏幕的镜像界面显示在第一屏幕上的条件。如图8所示,基于步骤302确定出副驾驶屏幕为第二屏幕,且光标在终点位置的停留时间大于或等于预设停留时间和/或光标产生形变的情况下形变的持续时间大于或等于预设持续时间,车机设备可以控制(主动控制或者响应于用户在模拟触控板上的操作)光标移动至副驾驶屏幕内,当光标出现在副驾驶屏幕内,则执行步骤303将副驾驶屏幕的镜像界面显示在中控屏上。需要说明的是,该实施例中光标实际所在的位置为副驾驶屏幕内,图8中显示的是副驾驶屏幕的镜像界面,此场景中,无法控制图8中的光标移出镜像界面。
为便于理解,以下提供一个将光标从中控屏移动至仪表盘屏幕的示例:
请参见图9A,移动终端与车机设备建立连接后,移动终端进入触控板模式,移动终端显示模拟触控板,光标显示在中控屏的中间,光标可在显示5秒后隐藏,仪表盘屏幕显示了车辆的各种信息,比如左侧显示的车辆轮胎信息等。请参见图9B,用户在模拟触控板上执行向左滑的手势,车机设备控制中控屏中的光标向左滑动,用户继续在模拟触控板上向左滑动,光标被滑动至屏幕左侧边缘,当用户再次在模拟触控板上执行向左滑动手势时,车机设备响应继续向左滑动的信号,使光标产生形变。当光标的形变持续时间超过3秒后,光标移动到仪表屏幕。请参见图9C,当光标移动到仪表盘屏幕后,光标不再产生形变,恢复为圆形。请参见图9D,光标移动到仪表盘屏幕后,模拟触控板不再用于控制中控屏,而是用于控制仪表盘屏幕,例如,将光标移动到仪表盘屏幕的左边,然后在模拟触控板上执行向上滑动手势,仪表盘屏幕左侧的车辆信息将由轮胎信息切换为香氛控制界面。
可以看出,车机设备可对第一屏幕上的操作进行解析识别,得到该操作的属性信息,比如该属性信息可以是光标的起始位置、滑动方向等,基于该属性信息,车机设备可从多个屏幕中确定出用户想要进行操作的第二屏幕,然后在述第一屏幕上显示所述第二屏幕的镜像界面,基于此,车机设备即可通过镜像界面执行与第二屏幕相关的操作,比如:当光标在镜像界面内时,车机设备可以基于用户操作在第二屏幕上实现对应的功能。这样当需要操作座舱内不同的屏幕时,只需要切换不同屏幕的镜像即可,无需用户改变位置,从而能够提升汽车座舱内屏幕操作的便捷性。另外,无需增加物理硬件来实现对座舱内不同屏幕的操作,能够降低硬件成本投入。
请参见图10,图10为本申请实施例提供的另一种汽车座舱屏幕的操作方法的流程示意图,如图10所示,该方法可以包括步骤1001-1005:
1001:接收移动终端发送的操作信号,操作信号是基于用户在移动终端的模拟触控板上的操作而生成的,模拟触控板包括移动终端的屏幕的部分或全部;
1002:基于操作信号控制光标在座舱内多个屏幕中的第一屏幕上进行滑动;
1003:获取第一屏幕上的操作的属性信息;
1004:根据属性信息,从多个屏幕中确定出第二屏幕;
1005:在第一屏幕上显示第二屏幕的镜像界面。
本申请实施例中,当车机设备和移动终端未建立连接时,车机设备和移动终端可以独立进行操作。用户在移动终端上操作实现移动终端的功能,在车机设备上操作实现车机设备的功能。车机设备的操作可以通过触屏、方向盘上的四项导航键来实现。车机设备和移动终端可以通过蓝牙、无线网络或者通用串行总线等方式建立连接,建立连接后,二者可进行户数通信。在一种示例中,车机设备和移动终端可以自动连接,例如:移动终端可以在判断用户
进入车内时,自动启动驾驶模式,在启动驾驶模式时/启动驾驶模式后,车机设备和移动终端自动建立连接。在另一种示例中,车机设备和移动终端也可以通过用户的手动操作来建立连接,例如:在移动终端上搜索车机设备,配对后建立连接。建立连接后,车机设备和移动终端仍然可以独立的被用户所操作。若要通过移动终端操作车机设备内的屏幕,则移动终端需要进入触控板模式。触控板模式下,移动终端屏幕的部分或全部作为模拟触控板,用户可以在模拟触控板上进行点击、滑动、指关节敲击等操作,来实现对车机屏幕的操作。
示例性的,用户可以先操作移动终端进入触控板模式,再将移动终端与车机设备进行连接。比如:座舱内设置有放置槽,放置槽可以集成无线充电模组,以对放置槽内的移动终端进行无线充电,放置槽还可以集成短距离通信模组,当移动终端被放入放置槽内时,车机设备和移动终端通过短距离通信模组进行通信。在一种示例中,车机设备可验证和移动终端是否登录了同一账号,若是则移动终端直接出发触控板模式,即移动终端主动进入触控板模式。若移动终端与车机设备登录的是不同账号,则用户可通过手动操作的方式使移动终端进入触控板模式。例如:通过“控制中心”、“设置项”中的某一菜单,或者是“手机物理按键”的操作等。车机设备和移动终端建立连接可以与移动终端进入触控板模式同时进行,例如:手机放入无线充电槽内时,即进行账号验证,同时建立连接。
请参见图11,图11给出了车机设备和移动终端建立连接后的一种示例,移动终端位于放置槽内,自动进入触控板模式,移动终端屏幕中的阴影区域作为第一屏幕(默认连接中控屏)的模拟触控面板A01。当移动终端与车机设备建立连接,中控屏上显示光标A02,以提示用户可以通过模拟触控板对中控屏进行操作。光标显示的位置可以是中控屏的中间或上一次操作后光标最后所在的位置。若用户没有操作,则光标在中控屏上显示预设时间(比如:3秒)后隐藏。当用户在模拟触控面板A01上执行手势操作时,光标取消隐藏,重新显示在中控屏上,用户停止操作后预设时间,光标再次隐藏。在用户的两次操作间隔很久的情况下,响应于用户在模拟触控板上的再次操作,光标将被回复到初始位置(比如:屏幕中间),当然,光标仍然可以显示在上一次操作后所在的位置。移动终端与车机设备建立连接后,用户将其从放置槽取出,仍然可以通过移动终端上的模拟触控板对车机屏幕进行操作。也就是说,移动终端与车机设备保持连接的情况下,可以在车内的任意位置通过模拟触控板实现对车机屏幕的操作,而不需要用户移动位置到屏目前。
需要说明的是,步骤1003-1005的具体实施方式可以参见图3所示的实施例中通过模拟触控板带动光标滑动的实现方式,且能达到相同或相似的有益效果,此处不再赘述。
为便于理解,以下提供一个对副驾驶屏幕进行镜像的示例:
(1)用户将移动终端放入放置槽,车机设备与移动终端建立连接,车机设备通过与移动终端的交互验证移动终端是否登录了相同的账号,若移动终端返回的结果表示登录了相同的账号,车机设备向移动终端发送信号以指示其进入触控板模式或者移动终端响应账号验证的结果,自动进入触控板模式。移动终端进入触控板模式后,如图12A所示,中控屏上显示光标,若没有操作,光标显示5秒后隐藏。且副驾驶屏幕以正常方式运行音乐播放程序,并显示歌曲一的歌词等相关信息。
(2)用户将手指伸入到放置槽内,或者将移动终端从放置槽中拿起,在模拟触控板上执行向右滑动的手势,带动中控屏上的光标向右滑动。用户可以在模拟触控板上持续、多次执行向右滑动手势(理论上,手机屏幕足够大时,也可以通过一次滑动就滑动到边缘,但通常可能需要多次操作),将光标滑动到屏幕右侧边缘,然后,当用户继续在模拟触控板上执行向右滑动手势时,带动光标继续向右滑动,如图12B所示,车机设备响应继续向右滑动的信号,
使光标产生形变。
(3)当光标的形变持续时间超过3秒,如图12C所示,将副驾驶屏幕的镜像界面显示在中控屏上。
(4)屏幕镜像成功后,用户手指可脱离模拟触控板,光标可以显示在原位置,例如:显示在屏幕右侧边缘;也可以显示在镜像窗口的指定位置,例如:显示在镜像窗口的中间。若光标显示在中控屏上,则用户可以在模拟触控板上滑动,将光标移动到镜像窗口内,并且进一步可将光标锁定在镜像窗口内。如图12C所示,用户在模拟触控板上滑动,带动光标移动至下一曲播放控件上,响应于用户在模拟触控板上的点击操作,点击下一曲播放控件。车机设备接收到该点击信号后,生成下一曲切换指令,将该指令发送给音乐播放器,音乐播放器从歌曲一切换至歌曲二,并将歌曲二的相关信息发送至副驾驶屏幕的处理器,处理器经过计算后,确定副驾驶屏幕的显示数据,并将显示数据分两路传输,一路发送至副驾驶屏幕。另一路发送至中控屏,显示在镜像界面的窗口,具体可如图12D所示。
以上详细阐述了本申请实施例的方法,下面提供了本申请实施例的装置。
请参见图13,图13为本申请实施例提供的一种汽车座舱屏幕的操作装置1300的结构示意图。该汽车座舱屏幕的操作装置1300应用于上述车机设备,如图13所示,该装置包括获取单元1301和处理单元1302;其中,
获取单元1301,用于获取座舱内多个屏幕中的第一屏幕上的操作的属性信息;
处理单元1302,用于根据属性信息,从多个屏幕中确定出第二屏幕;
处理单元1302,还用于在第一屏幕上显示第二屏幕的镜像界面。
可以看出,在图13所示的装置中,车机设备可对第一屏幕上的操作进行解析识别,得到该操作的属性信息,比如该属性信息可以是光标的起始位置、滑动方向等,基于该属性信息,车机设备可从多个屏幕中确定出用户想要进行操作的第二屏幕,然后在述第一屏幕上显示所述第二屏幕的镜像界面,基于此,车机设备即可通过镜像界面执行与第二屏幕相关的操作,比如:当光标在镜像界面内时,车机设备可基于用户操作在第二屏幕上实现对应的功能。这样当需要操作座舱内不同的屏幕时,只需要切换不同屏幕的镜像即可,无需用户改变位置,从而能够提升汽车座舱内屏幕操作的便捷性。另外,无需增加物理硬件来实现对座舱内不同屏幕的操作,能够降低硬件成本投入。
在一种可能的实施方式中,第一屏幕上的操作包括手势滑动操作,属性信息包括手势滑动的起始位置、终点位置和滑动方向,在根据属性信息,从多个屏幕中确定出第二屏幕方面,处理单元1302具体用于:
根据起始位置、终点位置和滑动方向中的至少两种,从多个屏幕中确定出第二屏幕。
在一种可能的实施方式中,第一屏幕上的操作包括第一屏幕上的光标的滑动,属性信息包括光标的终点位置、滑动方向和光标是否产生形变,在根据属性信息,从多个屏幕中确定出第二屏幕方面,处理单元1302具体用于:
根据终点位置、滑动方向和光标是否产生形变中的至少两种,从多个屏幕中确定出第二屏幕。
在一种可能的实施方式中,获取单元1301还用于:
若光标位于第一屏幕中镜像界面外的区域,则执行与第一屏幕相关的操作;
若光标位于镜像界面内,则执行与第二屏幕相关的操作;
若光标位于第二屏幕内,则执行与第二屏幕相关的操作。
在一种可能的实施方式中,处理单元1302还用于:
接收移动终端发送的操作信号,操作信号是基于用户在移动终端的模拟触控板上的操作而生成的,模拟触控板包括移动终端的屏幕的部分或全部;
基于操作信号控制光标在第一屏幕上进行滑动。
在一种可能的实施方式中,在执行与第一屏幕相关的操作方面,处理单元1302具体用于:
响应于用户在模拟触控板上的第一预设手势操作,对第一屏幕进行截屏;
和/或,
响应于用户在模拟触控板上的第二预设手势操作,对第一屏幕进行亮度调节;
和/或,
响应于用户在模拟触控板上的第三预设手势操作,显示与第一屏幕连接的第一音响的第一音频控制器,以使得用户通过第一音频控制器对第一音响进行音频属性调节。
在一种可能的实施方式中,在执行与第二屏幕相关的操作方面,处理单元1302具体用于:
响应于用户在模拟触控板上的第一预设手势操作,对第二屏幕进行截屏;
和/或,
响应于用户在模拟触控板上的第二预设手势操作,对第二屏幕进行亮度调节;
和/或,
响应于用户在模拟触控板上的第三预设手势操作,显示与第二屏幕连接的第二音响的第二音频控制器,以使得用户通过第二音频控制器对第二音响进行音频属性调节。
在一种可能的实施方式中,处理单元1302还用于:
响应于光标滑动至镜像界面内,将光标锁定在镜像界面内。
在一种可能的实施方式中,在根据终点位置、滑动方向和光标是否产生形变中的至少两种,从多个屏幕中确定出第二屏幕方面,处理单元1302具体用于:
获取预先构建的多个屏幕的空间位置图谱,空间位置图谱用于表征多个屏幕间的空间位置关系;
根据终点位置、滑动方向和光标是否产生形变中的至少两种及空间位置关系,从多个屏幕中确定出第二屏幕。
在一种可能的实施方式中,属性信息还包括光标在终点位置的停留时间和光标产生形变的情况下形变的持续时间,处理单元1302还用于:
在停留时间大于或等于预设停留时间和/或持续时间大于或等于预设持续时间的情况下,将光标从第一屏幕移动至第二屏幕内。
根据本申请的一个实施例,图13所示的汽车座舱屏幕的操作装置1300中的各个单元可以分别或全部合并为一个或若干个另外的单元来构成,或者其中的某个(些)单元还可以再拆分为功能上更小的多个单元来构成,这可以实现同样的操作,而不影响本申请的实施例的技术效果的实现。上述单元是基于逻辑功能划分的,在实际应用中,一个单元的功能也可以由多个单元来实现,或者多个单元的功能由一个单元实现。在本申请的其它实施例中,汽车座舱屏幕的操作装置1300也可以包括其它单元,在实际应用中,这些功能也可以由其它单元协助实现,并且可以由多个单元协作实现。
根据本申请的另一个实施例,可以通过在包括中央处理单元(Central Processing Unit,CPU)、随机存取存储介质(Random Access Memory,RAM)、只读存储介质(Read-Only Memory,ROM)等处理元件和存储元件的例如计算机的通用计算设备上运行能够执行如图3或图10中所示的相应方法所涉及的各步骤的计算机程序(包括程序代码),来构造如图13中所示的
汽车座舱屏幕的操作装置1300,以及来实现本申请实施例的汽车座舱屏幕的操作方法。所述计算机程序可以记载于例如计算机可读记录介质上,并通过计算机可读记录介质装载于上述计算设备中,并在其中运行。
基于上述方法实施例以及装置实施例的描述,本申请实施例还提供一种车机设备。请参见图14,图14为本申请实施例提供的一种车机设备的结构示意图,该车机设备1400至少包括处理器1401、存储器1402、输入设备1403和输出设备1404,以及一个或多个程序,一个或多个程序被存储在存储器1402中,各个部分通过总线1405或其他方式相互连接,其中,输入设备1403和输出设备1404可以为同一设备,输入设备1403可用于接收其他设备的输入,输出设备1404可用于输出车机设备与其他设备的交互信息和车机设备内各个屏幕的显示信息,图13以及图13所示的各个单元可以通过上述处理器1401、存储器1402、输入设备1403和输出设备1404实现。
存储器1402包括但不限于是RAM、ROM、可擦除可编程只读存储器(erasable programmable read only memory,EPROM)、或便携式只读存储器(compact disc read-only memory,CD-ROM),该存储器1402用于存储相关计算机程序及数据。
处理器1401可以是一个或多个CPU,在处理器1401是一个CPU的情况下,该CPU可以是单核CPU,也可以是多核CPU。
该车机设备1400中的处理器1401用于读取上述存储器1402中存储的一个或多个程序,执行以下操作:
获取座舱内多个屏幕中的第一屏幕上的操作的属性信息;
根据属性信息,从多个屏幕中确定出第二屏幕;
在第一屏幕上显示第二屏幕的镜像界面。
可以看出,在图14所示的车机设备1400中,处理器1401可对第一屏幕上的操作进行解析识别,得到该操作的属性信息,比如该属性信息可以是光标的起始位置、滑动方向等,基于该属性信息,车机设备可从多个屏幕中确定出用户想要进行操作的第二屏幕,然后在述第一屏幕上显示所述第二屏幕的镜像界面,基于此,车机设备即可通过镜像界面执行与第二屏幕相关的操作,比如:当光标在镜像界面内时,车机设备可基于用户操作在第二屏幕上实现对应的功能。这样当需要操作座舱内不同的屏幕时,只需要切换不同屏幕的镜像即可,无需用户改变位置,从而能够提升汽车座舱内屏幕操作的便捷性。另外,无需增加物理硬件来实现对座舱内不同屏幕的操作,能够降低硬件成本投入。
需要说明的是,各个操作的实现还可以对应参照图3所示的方法实施例的相应描述。
应注意,尽管图14所示车机设备1400仅仅示出了处理器1401、存储器1402、输入设备1403、输出设备1404和总线1405,但是在具体实现过程中,本领域的技术人员应当理解,车机设备1400还包括实现正常运行所必须的其他器件。同时,根据具体需要,本领域的技术人员应当理解,车机设备1400还可包括实现其他附加功能的硬件器件。此外,本领域的技术人员应当理解,车机设备1400也可仅仅包括实现本申请实施例所必须的器件,而不必包括图14中所示的全部器件。
本申请实施例还提供一种计算机可读存储介质(Memory),计算机可读存储介质是车机设备1400中的记忆设备,用于存储用于设备执行的计算机程序,当其在车机设备1400上运行时,图3或图10所示的方法流程得以实现。可以理解的是,此处的计算机可读存储介质既
可以包括车机设备1400中的内置存储介质,当然也可以包括车机设备1400所支持的扩展存储介质。计算机可读存储介质提供存储空间,该存储空间存储了车机设备1400的操作系统。并且,在该存储空间中还存放了适于被处理器1401加载并执行的一个或多个计算机程序。需要说明的是,此处的计算机可读存储介质可以是高速RAM,也可以是非不稳定的存储器(non-volatile memory),例如至少一个磁盘存储器;可选地,还可以是至少一个位于远离前述处理器1401的计算机可读存储介质。
本申请实施例还提供一种计算机程序产品,当计算机程序产品被车机设备运行时,图3或图10所示的方法流程得以实现。
在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其它实施例的相关描述。
应理解,本申请实施例中提及的处理器可以是CPU,还可以是其他通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现成可编程门阵列(Field Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。
还应理解,本申请实施例中提及的存储器可以是易失性存储器或非易失性存储器,或可包括易失性和非易失性存储器两者。其中,非易失性存储器可以是ROM、可编程只读存储器(Programmable ROM,PROM)、EPROM、电可擦除可编程只读存储器(Electrically EPROM,EEPROM)或闪存。易失性存储器可以是RAM,其用作外部高速缓存。通过示例性但不是限制性说明,许多形式的RAM可用,例如静态随机存取存储器(Static RAM,SRAM)、动态随机存取存储器(Dynamic RAM,DRAM)、同步动态随机存取存储器(Synchronous DRAM,SDRAM)、双倍数据速率同步动态随机存取存储器(Double Data Rate SDRAM,DDR SDRAM)、增强型同步动态随机存取存储器(Enhanced SDRAM,ESDRAM)、同步连接动态随机存取存储器(Synchlink DRAM,SLDRAM)和直接内存总线随机存取存储器(Direct Rambus RAM,DR RAM)。
需要说明的是,当处理器为通用处理器、DSP、ASIC、FPGA或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件时,存储器(存储模块)集成在处理器中。
应注意,本文描述的存储器旨在包括但不限于这些和任意其它适合类型的存储器。
应理解,在本申请的各种实施例中,上述各过程的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。
在本申请所提供的几个实施例中,应该理解到,所揭露的系统、装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示例性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个
单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。
本申请中,“至少一个”是指一个或者多个,“多个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B的情况,其中A,B可以是单数或者复数。在本申请的文字描述中,字符“/”,一般表示前后关联对象是一种“或”的关系。
本申请实施例方法中的步骤可以根据实际需要进行顺序调整、合并和删减。
本申请实施例装置中的模块可以根据实际需要进行合并、划分和删减。
以上所述,以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。
Claims (23)
- 一种汽车座舱屏幕的操作方法,其特征在于,应用于车机设备,所述方法包括:获取座舱内多个屏幕中的第一屏幕上的操作的属性信息;根据所述属性信息,从所述多个屏幕中确定出第二屏幕;在所述第一屏幕上显示所述第二屏幕的镜像界面。
- 根据权利要求1所述的方法,其特征在于,所述第一屏幕上的操作包括手势滑动操作,所述属性信息包括手势滑动的起始位置、终点位置和滑动方向,所述根据所述属性信息,从所述多个屏幕中确定出第二屏幕,包括:根据所述起始位置、所述终点位置和所述滑动方向中的至少两种,从所述多个屏幕中确定出所述第二屏幕。
- 根据权利要求1所述的方法,其特征在于,所述第一屏幕上的操作包括所述第一屏幕上的光标的滑动,所述属性信息包括所述光标的终点位置、滑动方向和所述光标是否产生形变,所述根据所述属性信息,从所述多个屏幕中确定出第二屏幕,包括:根据所述终点位置、所述滑动方向和所述光标是否产生形变中的至少两种,从所述多个屏幕中确定出所述第二屏幕。
- 根据权利要求3所述的方法,其特征在于,在所述第一屏幕上显示所述第二屏幕的镜像界面之后,所述方法还包括:若所述光标位于所述第一屏幕中所述镜像界面外的区域,则执行与所述第一屏幕相关的操作;若所述光标位于所述镜像界面内,则执行与所述第二屏幕相关的操作;若所述光标位于所述第二屏幕内,则执行与所述第二屏幕相关的操作。
- 根据权利要求3或4所述的方法,其特征在于,在获取座舱内多个屏幕中的第一屏幕上的操作的属性信息之前,所述方法还包括:接收移动终端发送的操作信号,所述操作信号是基于用户在所述移动终端的模拟触控板上的操作而生成的,所述模拟触控板包括所述移动终端的屏幕的部分或全部;基于所述操作信号控制所述光标在所述第一屏幕上进行滑动。
- 根据权利要求5所述的方法,其特征在于,所述执行与所述第一屏幕相关的操作,包括:响应于用户在所述模拟触控板上的第一预设手势操作,对所述第一屏幕进行截屏;和/或,响应于用户在所述模拟触控板上的第二预设手势操作,对所述第一屏幕进行亮度调节;和/或,响应于用户在所述模拟触控板上的第三预设手势操作,显示与所述第一屏幕连接的第一音响的第一音频控制器,以使得用户通过所述第一音频控制器对所述第一音响进行音频属性调节。
- 根据权利要求5所述的方法,其特征在于,所述执行与所述第二屏幕相关的操作,包括:响应于用户在所述模拟触控板上的第一预设手势操作,对所述第二屏幕进行截屏;和/或,响应于用户在所述模拟触控板上的第二预设手势操作,对所述第二屏幕进行亮度调节;和/或,响应于用户在所述模拟触控板上的第三预设手势操作,显示与所述第二屏幕连接的第二音响的第二音频控制器,以使得用户通过所述第二音频控制器对所述第二音响进行音频属性调节。
- 根据权利要求3所述的方法,其特征在于,在所述第一屏幕上显示所述第二屏幕的镜像界面之后,所述方法还包括:响应于所述光标滑动至所述镜像界面内,将所述光标锁定在所述镜像界面内。
- 根据权利要求3-7任一项所述的方法,其特征在于,所述根据所述终点位置、所述滑动方向和所述光标是否产生形变中的至少两种,从所述多个屏幕中确定出所述第二屏幕,包括:获取预先构建的所述多个屏幕的空间位置图谱,所述空间位置图谱用于表征所述多个屏幕间的空间位置关系;根据所述终点位置、所述滑动方向和所述光标是否产生形变中的至少两种及所述空间位置关系,从所述多个屏幕中确定出所述第二屏幕。
- 根据权利要求3所述的方法,其特征在于,所述属性信息还包括所述光标在所述终点位置的停留时间和所述光标产生形变的情况下形变的持续时间,在根据所述属性信息,从所述多个屏幕中确定出第二屏幕之后,所述方法还包括:在所述停留时间大于或等于预设停留时间和/或所述持续时间大于或等于预设持续时间的情况下,将所述光标从所述第一屏幕移动至所述第二屏幕内。
- 一种汽车座舱屏幕的操作装置,其特征在于,应用于车机设备,所述装置包括获取单元和处理单元,其中,所述获取单元,用于获取座舱内多个屏幕中的第一屏幕上的操作的属性信息;所述处理单元,用于根据所述属性信息,从所述多个屏幕中确定出第二屏幕;所述处理单元,还用于在所述第一屏幕上显示所述第二屏幕的镜像界面。
- 根据权利要求11所述的装置,其特征在于,所述第一屏幕上的操作包括手势滑动操作,所述属性信息包括手势滑动的起始位置、终点位置和滑动方向,在根据所述属性信息,从所述多个屏幕中确定出第二屏幕方面,所述处理单元具体用于:根据所述起始位置、所述终点位置和所述滑动方向中的至少两种,从所述多个屏幕中确定出所述第二屏幕。
- 根据权利要求11所述的装置,其特征在于,所述第一屏幕上的操作包括所述第一屏幕上的光标的滑动,所述属性信息包括所述光标的终点位置、滑动方向和所述光标是否产生形变,在根据所述属性信息,从所述多个屏幕中确定出第二屏幕方面,所述处理单元具体用于:根据所述终点位置、所述滑动方向和所述光标是否产生形变中的至少两种,从所述多个屏幕中确定出所述第二屏幕。
- 根据权利要求11-13任一项所述的装置,其特征在于,所述处理单元还用于:若所述光标位于所述第一屏幕中所述镜像界面外的区域,则执行与所述第一屏幕相关的操作;若所述光标位于所述镜像界面内,则执行与所述第二屏幕相关的操作;若所述光标位于所述第二屏幕内,则执行与所述第二屏幕相关的操作。
- 根据权利要求13或14所述的装置,其特征在于,所述处理单元还用于:接收移动终端发送的操作信号,所述操作信号是基于用户在所述移动终端的模拟触控板 上的操作而生成的,所述模拟触控板包括所述移动终端的屏幕的部分或全部;基于所述操作信号控制所述光标在所述第一屏幕上进行滑动。
- 根据权利要求15所述的装置,其特征在于,在执行与所述第一屏幕相关的操作方面,所述处理单元具体用于:响应于用户在所述模拟触控板上的第一预设手势操作,对所述第一屏幕进行截屏;和/或,响应于用户在所述模拟触控板上的第二预设手势操作,对所述第一屏幕进行亮度调节;和/或,响应于用户在所述模拟触控板上的第三预设手势操作,显示与所述第一屏幕连接的第一音响的第一音频控制器,以使得用户通过所述第一音频控制器对所述第一音响进行音频属性调节。
- 根据权利要求15所述的装置,其特征在于,在执行与所述第二屏幕相关的操作方面,所述处理单元具体用于:响应于用户在所述模拟触控板上的第一预设手势操作,对所述第二屏幕进行截屏;和/或,响应于用户在所述模拟触控板上的第二预设手势操作,对所述第二屏幕进行亮度调节;和/或,响应于用户在所述模拟触控板上的第三预设手势操作,显示与所述第二屏幕连接的第二音响的第二音频控制器,以使得用户通过所述第二音频控制器对所述第二音响进行音频属性调节。
- 根据权利要求13所述的装置,其特征在于,所述处理单元还用于:响应于所述光标滑动至所述镜像界面内,将所述光标锁定在所述镜像界面内。
- 根据权利要求13-17任一项所述的装置,其特征在于,在根据所述终点位置、所述滑动方向和所述光标是否产生形变中的至少两种,从所述多个屏幕中确定出所述第二屏幕方面,所述处理单元具体用于:获取预先构建的所述多个屏幕的空间位置图谱,所述空间位置图谱用于表征所述多个屏幕间的空间位置关系;根据所述终点位置、所述滑动方向和所述光标是否产生形变中的至少两种及所述空间位置关系,从所述多个屏幕中确定出所述第二屏幕。
- 根据权利要求13所述的装置,其特征在于,所述属性信息还包括所述光标在所述终点位置的停留时间和所述光标产生形变的情况下形变的持续时间,所述处理单元还用于:在所述停留时间大于或等于预设停留时间和/或所述持续时间大于或等于预设持续时间的情况下,将所述光标从所述第一屏幕移动至所述第二屏幕内。
- 一种车机设备,其特征在于,包括处理器、存储器,以及一个或多个程序,所述处理器与所述存储器相连,所述一个或多个程序被存储在所述存储器中,并且被配置为由所述处理器执行时实现如权利要求1-10中任一项所述的方法。
- 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质存储有用于设备执行的计算机程序,所述计算机程序被执行时实现权利要求1-10中任一项所述的方法。
- 一种计算机程序产品,其特征在于,当所述计算机程序产品被电子设备运行,使得所述电子设备执行如权利要求1-10中任一项所述的方法。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210662846.6A CN117270801A (zh) | 2022-06-13 | 2022-06-13 | 一种汽车座舱屏幕的操作方法及相关设备 |
CN202210662846.6 | 2022-06-13 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023241506A1 true WO2023241506A1 (zh) | 2023-12-21 |
Family
ID=89192223
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2023/099658 WO2023241506A1 (zh) | 2022-06-13 | 2023-06-12 | 一种汽车座舱屏幕的操作方法及相关设备 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN117270801A (zh) |
WO (1) | WO2023241506A1 (zh) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180081614A1 (en) * | 2016-09-22 | 2018-03-22 | Toyota Motor Sales, U.S.A., Inc. | Human machine interface (hmi) control unit for multiple vehicle display devices |
FR3067669A1 (fr) * | 2017-06-16 | 2018-12-21 | Peugeot Citroen Automobiles Sa | Systeme de retrovision numerique pour vehicule automobile a reglage facilite |
CN114546239A (zh) * | 2021-12-28 | 2022-05-27 | 浙江零跑科技股份有限公司 | 一种智能座舱副驾投屏手势操作方法 |
CN114721615A (zh) * | 2022-02-11 | 2022-07-08 | 浙江零跑科技股份有限公司 | 一种汽车液晶仪表设置方法 |
-
2022
- 2022-06-13 CN CN202210662846.6A patent/CN117270801A/zh active Pending
-
2023
- 2023-06-12 WO PCT/CN2023/099658 patent/WO2023241506A1/zh unknown
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180081614A1 (en) * | 2016-09-22 | 2018-03-22 | Toyota Motor Sales, U.S.A., Inc. | Human machine interface (hmi) control unit for multiple vehicle display devices |
FR3067669A1 (fr) * | 2017-06-16 | 2018-12-21 | Peugeot Citroen Automobiles Sa | Systeme de retrovision numerique pour vehicule automobile a reglage facilite |
CN114546239A (zh) * | 2021-12-28 | 2022-05-27 | 浙江零跑科技股份有限公司 | 一种智能座舱副驾投屏手势操作方法 |
CN114721615A (zh) * | 2022-02-11 | 2022-07-08 | 浙江零跑科技股份有限公司 | 一种汽车液晶仪表设置方法 |
Also Published As
Publication number | Publication date |
---|---|
CN117270801A (zh) | 2023-12-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10459545B2 (en) | All-in-one machine and method and computer memory medium for realizing quick touch in all channels thereof | |
US10845871B2 (en) | Interaction and management of devices using gaze detection | |
US9176651B2 (en) | Pushing a user interface to a remote device | |
GB2534274B (en) | Gaze triggered voice recognition | |
US9311115B2 (en) | Pushing a graphical user interface to a remote device with display rules provided by the remote device | |
US9875006B2 (en) | Pushing a graphical user interface to a remote device with display rules provided by the remote device | |
AU2009246654B2 (en) | Pushing a user interface to a remote device | |
US9189073B2 (en) | Transition mechanism for computing system utilizing user sensing | |
JP2021509742A (ja) | コンテキスト認識ボタンフリーのスクリーン関節動作 | |
WO2022053057A1 (zh) | 一种车载屏幕调节方法、装置、车辆和可读存储介质 | |
CN110932888A (zh) | 用于协商对共享音频或视觉资源的控制的系统和方法 | |
US11594193B2 (en) | Automatic input style selection or augmentation for an external display device | |
US20240126503A1 (en) | Interface control method and apparatus, and system | |
WO2023241506A1 (zh) | 一种汽车座舱屏幕的操作方法及相关设备 | |
GB2502595A (en) | Touch sensitive input device compatibility notification when a mobile device is connected to an In-Vehicle device | |
US12125456B2 (en) | Automatic input style selection or augmentation for an external display device | |
TWI841159B (zh) | 車載行爲控制方法、系統、電子設備及計算機存儲介質 | |
US11074024B2 (en) | Mobile device for interacting with docking device and method for controlling same | |
US20240308344A1 (en) | Method and device for screen projection in in-vehicle information system | |
CN116347400A (zh) | 用于通过移动终端设备控制车机终端设备的方法和系统 | |
KR20240050224A (ko) | 전자 장치 및 이의 포스 터치 동작 개선 방법 | |
CN116176432A (zh) | 车载设备控制方法、装置、车辆和存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23823074 Country of ref document: EP Kind code of ref document: A1 |