CN115437590A - Display system, determination method, display device, medium, and apparatus - Google Patents

Display system, determination method, display device, medium, and apparatus Download PDF

Info

Publication number
CN115437590A
CN115437590A CN202210664816.9A CN202210664816A CN115437590A CN 115437590 A CN115437590 A CN 115437590A CN 202210664816 A CN202210664816 A CN 202210664816A CN 115437590 A CN115437590 A CN 115437590A
Authority
CN
China
Prior art keywords
trigger
controller
displayed
vehicle
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210664816.9A
Other languages
Chinese (zh)
Inventor
丁彬
傅强
李可然
帅一帆
范皓宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Co Wheels Technology Co Ltd
Original Assignee
Beijing Co Wheels Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Co Wheels Technology Co Ltd filed Critical Beijing Co Wheels Technology Co Ltd
Priority to CN202210664816.9A priority Critical patent/CN115437590A/en
Publication of CN115437590A publication Critical patent/CN115437590A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/10Interpretation of driver requests or demands
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present disclosure relates to a display system, a determination method, a display method, a device, a medium, and an apparatus. The display system includes: the vehicle-mounted wearable display device comprises a vehicle machine, a vehicle-mounted wearable display device and a controller; the controller sends the pose data to the vehicle machine; the vehicle-mounted wearable display equipment sends the trigger surface data to the vehicle machine; the vehicle machine is used for determining the positive direction of the controller based on the pose data and the trigger surface data. According to the technical scheme, the position and pose data sent by the controller and the trigger surface data sent by the vehicle-mounted wearable display device are received through the vehicle-mounted machine, the positive direction of the controller is automatically determined by utilizing a built-in software program based on the position and pose data and the trigger surface data, therefore, after a user takes and wears the controller, the vehicle-mounted machine can directly and automatically determine the positive direction of the controller according to the position and pose data under the condition that the position and pose of the controller are determined, the process does not need the user to distinguish the direction based on the appearance of the vehicle-mounted machine, the time is saved, the vehicle-mounted machine is simple and convenient, and the user experience is favorably improved.

Description

Display system, determination method, display apparatus, medium, and device
Technical Field
The present disclosure relates to the field of virtual reality technologies, and in particular, to a display system, a determination method, a display apparatus, a medium, and a device.
Background
With the development of vehicles and computer technologies, vehicles are gradually developing toward automation and intellectualization. Applications of vehicle-mounted wearable display technologies, such as Virtual Reality (VR), augmented Reality (AR), and Mixed Reality (MR) technologies, are becoming widespread.
Generally, wearable display devices need to be used in conjunction with a controller. The controller is used as an interactive tool, and generally has a positive direction, and the positive direction is used for pointing to a picture in a display field. However, based on the current controller structure design, it is difficult for the user to determine the forward direction of the controller, for example, if the reverse direction of the controller is used as the forward direction, the user experience is poor because the user cannot operate the screen in the display field of view.
Disclosure of Invention
In order to solve the technical problems, the present disclosure provides a display system, a determination method, a display apparatus, a medium, and a device, which are capable of automatically determining a positive direction of a controller by using a software program, are simple and convenient, do not require a user to distinguish the direction based on an appearance, and are beneficial to improving user experience.
In a first aspect, an embodiment of the present disclosure provides a vehicle-mounted wearable display system, which includes: the vehicle-mounted wearable display device comprises a vehicle machine, a vehicle-mounted wearable display device and a controller;
the controller sends pose data to the vehicle machine;
the vehicle-mounted wearable display equipment sends triggering surface data to the vehicle machine; the triggering surface is a visual field picture displayed by the display equipment;
the vehicle machine is used for determining the positive direction of the controller based on the pose data and the trigger surface data.
In some embodiments, the controller comprises: the controller comprises a controller main body, a circuit board and an inertia measuring unit;
the controller main body comprises an operation plane used for sensing the control operation of a user;
the circuit board is used for responding to control operation of a user, generating an operation signal and transmitting the operation signal to the vehicle machine;
the inertial measurement unit is arranged on the circuit board and used for detecting the pose of the controller so as to generate pose data;
the plane where the circuit board is located and the operating plane form a first preset included angle, and the reference plane of the inertia measurement unit and the plane where the circuit board is located form a second preset included angle.
In some embodiments, the first predetermined angle and the second predetermined angle are both 0 degrees.
In a second aspect, an embodiment of the present disclosure further provides a positive direction determination method for a controller of a vehicle-mounted wearable display device, which is applied to any one of the systems provided in the first aspect and executed by the vehicle machine; the determination method comprises the following steps:
acquiring the pose data and the trigger surface data;
determining a positive direction of the controller based on the pose data and the trigger surface data.
In some embodiments, the determining a positive direction of the controller based on the pose data and the trigger surface data comprises:
determining data of a trigger line to be displayed controlled by the controller based on the pose data; the trigger lines to be displayed comprise two trigger lines which take the controller as a starting point and are in parallel in an opposite direction;
judging that the target trigger line to be displayed meeting preset conditions is the trigger line to be displayed corresponding to the positive direction of the controller on the basis of the data of the trigger line to be displayed and the trigger surface data;
the positive direction of the controller is determined based on the orientation of the trigger line to be displayed corresponding to the positive direction of the controller.
In some embodiments, the preset conditions include: the trigger line is contacted with the trigger surface; the trigger line is determined based on the data of the trigger line to be displayed, and the trigger surface is determined based on the data of the trigger surface;
based on treat that the data that show the trigger line with trigger surface data, judge that the target that satisfies the preset condition treats that show the trigger line and treat that to show the trigger line for the positive direction that corresponds to the controller, include:
determining a corresponding trigger line to be displayed based on the data of the trigger line to be displayed;
determining a corresponding trigger surface based on the trigger surface data;
judging whether the trigger line to be displayed contacts the trigger surface;
when the target is to be displayed the trigger line and is contacted with the trigger surface, judge that the target is to be displayed the trigger line for the positive direction that corresponds to the controller.
In some embodiments, after determining whether the trigger line to be displayed contacts the trigger surface, the method further includes:
and when the target trigger line to be displayed is not in contact with the trigger surface, judging that the target trigger line to be displayed is the trigger line to be displayed corresponding to the opposite direction of the controller.
In some embodiments, the trigger line is in contact with a trigger surface, comprising: the spatial coordinates of the trigger line coincide with the spatial coordinates of the contact surface.
In some embodiments, after the determining the positive direction of the controller based on the pose data and the trigger surface data, the method further comprises:
generating a display control instruction;
the display control instruction is used for indicating the vehicle-mounted wearable display device to display a target trigger line to be displayed and a trigger surface in contact with the target trigger line to be displayed.
In a third aspect, an embodiment of the present disclosure further provides a display method of a vehicle-mounted wearable display device, where the display method includes:
receiving a display control instruction;
displaying target content based on the display control instruction; the target content comprises a trigger surface and a target trigger line to be displayed;
wherein the display control instruction is generated based on the positive direction determination method provided in the second aspect.
In a fourth aspect, an embodiment of the present disclosure further provides a positive direction determination device for a controller of a vehicle-mounted wearable display device, which is applied to any one of the systems provided in the first aspect, and the positive direction determination device is disposed in the vehicle machine; the positive direction determination device includes:
the data acquisition module is used for acquiring the pose data and the trigger surface data;
and the direction judging module is used for determining the positive direction of the controller based on the pose data and the trigger surface data. In some embodiments, the direction determination module is specifically configured to:
determining data of a trigger line to be displayed, which is determined by the controller, based on the pose data; the trigger lines to be displayed comprise two trigger lines which take the controller as a starting point and are in parallel in an opposite direction;
judging that the target trigger line to be displayed meeting preset conditions is the trigger line to be displayed corresponding to the positive direction of the controller on the basis of the data of the trigger line to be displayed and the trigger surface data;
the positive direction of the controller is determined based on the orientation of the trigger line to be displayed corresponding to the positive direction of the controller.
In some embodiments, the preset conditions include: the trigger line is contacted with the trigger surface; the trigger line is determined based on the data of the trigger line to be displayed, and the trigger surface is determined based on the data of the trigger surface;
based on this, the direction determination module is used for determining that the target to-be-displayed trigger line meeting the preset condition is the to-be-displayed trigger line corresponding to the positive direction of the controller based on the data of the to-be-displayed trigger line and the trigger surface data, and includes:
determining a corresponding trigger line to be displayed based on the data of the trigger line to be displayed;
determining a corresponding trigger surface based on the trigger surface data;
judging whether the trigger line to be displayed contacts the trigger surface;
when the target is to be displayed the trigger line and is contacted with the trigger surface, judge that the target is to be displayed the trigger line for the positive direction that corresponds to the controller.
In some embodiments, the direction determination module is further configured to:
after judging whether the trigger line to be displayed contacts the trigger surface or not, when the target trigger line to be displayed does not contact the trigger surface, judging that the target trigger line to be displayed is the trigger line to be displayed corresponding to the opposite direction of the controller.
In some embodiments, the trigger line is in contact with a trigger surface, comprising: the spatial coordinates of the trigger line coincide with the spatial coordinates of the contact surface.
In some embodiments, the positive direction determination means further includes:
an instruction generation module for generating a display control instruction after the positive direction of the controller is determined based on the pose data and the trigger surface data;
the display control instruction is used for indicating the vehicle-mounted wearable display device to display a target trigger line to be displayed and a trigger surface in contact with the target trigger line to be displayed.
In a fifth aspect, an embodiment of the present disclosure further provides a display device of a vehicle-mounted wearable display apparatus, where the display device includes:
the instruction receiving module is used for receiving a display control instruction;
the content display module is used for displaying target content based on the display control instruction; the target content comprises a trigger surface and a target trigger line to be displayed;
wherein the display control instruction is generated based on any one of the positive direction determination means provided in the fourth aspect.
In a sixth aspect, the disclosed embodiments also provide a computer-readable storage medium storing a program or instructions for causing a computer to perform the steps of any one of the methods provided in the second aspect, or to perform the steps of any one of the methods provided in the third aspect.
In a seventh aspect, an embodiment of the present disclosure further provides an electronic device, including: a processor and a memory;
the processor is adapted to perform the steps of any of the methods as provided in the second aspect, or to perform the steps of any of the methods as provided in the third aspect, by calling a program or instructions stored by the memory.
Compared with the prior art, the technical scheme provided by the embodiment of the disclosure has the following advantages:
the vehicle-mounted wearable display system comprises a vehicle machine, a vehicle-mounted wearable display device and a controller, wherein the vehicle machine acquires pose data of the controller and acquires trigger surface data of the vehicle-mounted wearable display device, and the positive direction of the controller can be determined based on the pose data and the trigger surface data. Therefore, the position and pose data sent by the controller can be received through the vehicle-mounted machine, the triggering surface data sent by the vehicle-mounted wearable display device is received, the positive direction of the controller is automatically determined by utilizing a built-in software program based on the position and pose data and the triggering surface data, and a user does not need to distinguish the direction based on the appearance of the controller after taking the controller but can directly wear the controller.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure.
In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present disclosure, the drawings used in the embodiments or technical solutions in the prior art description will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.
Fig. 1 is a schematic structural diagram of a vehicle-mounted wearable display system according to an embodiment of the present disclosure;
fig. 2 is a schematic structural diagram of a controller of a vehicle-mounted wearable display device according to an embodiment of the present disclosure;
fig. 3 is an application scenario diagram of a controller of a vehicle-mounted wearable display device according to an embodiment of the present disclosure;
fig. 4 is a schematic side view of a controller of a vehicle-mounted wearable display device according to an embodiment of the present disclosure;
fig. 5 is a schematic flowchart of a positive direction determination method for a controller of a vehicle-mounted wearable display device according to an embodiment of the present disclosure;
fig. 6 is a schematic flowchart of another positive direction determination method for a controller of a vehicle-mounted wearable display device according to an embodiment of the present disclosure;
FIG. 7 is an orientation diagram of a trigger line to be displayed associated with a controller according to an embodiment of the present disclosure;
FIG. 8 is a schematic diagram of an orientation of a trigger line to be displayed corresponding to a positive direction of a controller according to an embodiment of the disclosure;
fig. 9 is a schematic flowchart of a display method of a vehicle-mounted wearable display device according to an embodiment of the present disclosure;
fig. 10 is a schematic structural diagram of a positive direction determination device of a controller of a vehicle-mounted wearable display device according to an embodiment of the present disclosure;
fig. 11 is a schematic structural diagram of a display device of a vehicle-mounted wearable display device according to an embodiment of the present disclosure;
fig. 12 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present disclosure.
Detailed Description
In order that the above objects, features and advantages of the present disclosure may be more clearly understood, aspects of the present disclosure will be further described below. It should be noted that, in the case of no conflict, the embodiments and features in the embodiments of the present disclosure may be combined with each other.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure may be practiced in other ways than those described herein; it is to be understood that the embodiments disclosed in the specification are only a few embodiments of the present disclosure, and not all embodiments.
The display system, the positive direction determination method, the display method, the device, the medium and the equipment of the vehicle-mounted wearable display equipment provided by the embodiment of the disclosure can be applied to vehicles and used for display control of the vehicle-mounted wearable display equipment. The positive direction of the controller can be determined based on the pose data and the trigger surface data by acquiring the pose data of the controller and the trigger surface data of the vehicle-mounted wearable display device. Therefore, according to the vehicle-mounted wearable display system provided by the embodiment of the disclosure, after a user takes the controller, the user does not need to divide the positive direction in the front wearable area, the positive direction of the controller can be automatically determined based on the pose of the controller after wearing, the system is simple and convenient, and the user experience can be improved.
The following describes a display system, a positive direction determination method, a display method, a positive direction determination device (may be simply referred to as "determination device"), a display device computer-readable storage medium, and an electronic device of a vehicle-mounted wearable display apparatus according to an embodiment of the present disclosure, with reference to the drawings.
In some embodiments, fig. 1 is a schematic structural diagram of a vehicle-mounted wearable display system provided in an embodiment of the present disclosure. As shown in fig. 1, the system includes: the vehicle-mounted display device comprises a vehicle machine 10, a vehicle-mounted wearable display device 11 and a controller 12; the controller 12 sends the pose data to the vehicle machine; the vehicle-mounted wearable display device 11 sends the trigger surface data to the vehicle machine 10; the vehicle machine 10 is configured to determine a positive direction of the controller 12 based on the pose data and the trigger surface data.
An infinite trigger surface, which may also be referred to as a display field of view screen and may be represented by trigger surface data, is provided in the vehicle-mounted wearable display device 11. The vehicle-mounted wearable display device 11 sends the trigger surface data to the vehicle machine 10, and correspondingly, the vehicle machine 10 receives the trigger surface data.
Wherein after the controller 12 is worn by the user, the pose of the controller is determined, which can be characterized by pose data. The controller 12 sends its own pose data to the in-vehicle machine 10, and correspondingly, the in-vehicle machine 10 receives the pose data.
The car machine 10 determines the direction in which the controller 12 points to the trigger surface as the positive direction of the controller 12 based on the received pose data and the trigger surface data, so as to respond to the operation of the user based on the controller 12, change or switch the picture displayed by the wearable display device 11, and realize human-computer interaction.
Illustratively, the pose data may include spatial coordinate information of the controller and the trigger surface data may include spatial coordinate information of the trigger surface, such that the in-vehicle machine 10 may determine the positive direction of the controller 12 based on the spatial coordinate relationship.
The on-vehicle wearable display system that this disclosed embodiment provided includes: the vehicle-mounted device 10, the vehicle-mounted wearable display device 11 and the controller 12 acquire pose data of the controller 12 and acquire trigger surface data of the vehicle-mounted wearable display device 11 through the vehicle-mounted device 10, and can automatically determine the positive direction of the controller 10 by using a built-in software program based on the pose data and the trigger surface data. Therefore, after the user takes the controller 12, the vehicle machine 10 can be directly worn without being in the forward direction of the worn front area, after the user wears the controller 12, namely under the condition that the pose of the controller 12 is determined, the vehicle machine can directly determine the forward direction of the controller according to the pose data and the triggering surface data, the vehicle machine is simple and convenient, the user experience can be improved, and the vehicle machine can be suitable for various different wearing modes.
In some embodiments, fig. 2 is a schematic structural diagram of a controller of a vehicle-mounted wearable display device provided in an embodiment of the present disclosure, and fig. 3 is a schematic application scenario diagram of the controller of the vehicle-mounted wearable display device provided in an embodiment of the present disclosure. On the basis of fig. 1, referring to fig. 2 and 3, the controller 12 includes: a controller main body 120, a circuit board 121, and an inertia measurement unit 122; the controller main body 120 includes an operation plane for sensing a control operation of a user; the circuit board is used for responding to the control operation of a user, generating an operation signal and transmitting the operation signal to the car machine 10; the inertial measurement unit 122 is provided on the circuit board 121, and is configured to detect an attitude angle and an acceleration of the controller 12 to generate pose data; the plane of the circuit board 121 and the operating plane form a first predetermined included angle (not shown), and the reference plane of the inertia measurement unit 122 and the plane of the circuit board 121 form a second predetermined included angle (not shown).
The circuit board 121 may generate an operation signal in response to a control operation of the user, and transmit the operation signal to the car machine 10, so that the car machine 10 generates a display control instruction based on the operation signal to control the wearable display device 11 to display.
Based on the above, when the user presses the operation plane, the operation plane senses the pressing operation of the user, and performs electrical conversion based on a response principle, such as a pressure signal, a capacitance-inductance signal or an optical signal, to generate a corresponding electrical signal; further, the circuit board 121 generates an operation signal based on the electrical signal, that is, based on the electrical signal corresponding to the control operation of the user, and transmits the operation signal to the in-vehicle device 10, for example, a processor therein, and the processor in the in-vehicle device 10 performs signal processing based on the received operation signal, so as to implement display control on the in-vehicle wearable display device 11.
Further, an inertial measurement unit 122 is provided on the circuit board 121, and the inertial measurement unit 122 is capable of detecting the attitude angle and acceleration of the controller 12 based on the detection of the attitude angle and acceleration thereof to generate attitude data of the controller 12.
The operation plane and the circuit board 121 form a first preset included angle, and the reference plane of the inertia measurement unit 122 and the plane where the circuit board 121 is located form a second preset included angle, so that on the basis that the inertia measurement unit 23 detects the attitude angle and the acceleration of the reference plane of the inertia measurement unit, the first preset included angle and the second preset included angle are combined to perform spatial angle and spatial coordinate transformation, and the attitude angle and the acceleration of the controller 12 can be obtained, that is, the attitude data of the controller 12 can be obtained.
It can be appreciated that the first predetermined included angle and the second predetermined included angle may be the same or different. If the first preset included angle is the same as the second preset included angle, the pose data measured by the inertia measurement unit 122 can be directly used for acquiring the pose of the controller; if the first preset included angle and the second preset included angle are different, based on the pose data measured by the inertial measurement unit 122, the pose of the controller 12 can be obtained by performing spatial angle and spatial coordinate transformation according to the first preset included angle and the second preset included angle.
In some embodiments, fig. 4 is a schematic side view of a controller of a vehicle-mounted wearable display device according to an embodiment of the present disclosure. Referring to fig. 2 and 4, the first predetermined angle and the second predetermined angle are both 0 degrees, that is, the circuit board 22 is parallel to the operation plane 24, and the reference plane of the inertial measurement unit 122 is parallel to the circuit board 121, so that the reference plane of the inertial measurement unit 122 is also parallel to the operation plane of the controller 12.
Based on this, on the basis that the inertial measurement unit 122 detects the attitude angle and the acceleration of the self reference surface, due to the parallel relationship, the attitude angle and the acceleration of the operation plane of the controller 12, that is, the attitude data of the controller 12 can be directly determined without angle transformation, so that the detection mode is simple, convenient and high in accuracy.
In some embodiments, the controller 12 may be in the shape of a ring (as shown in fig. 4), a bracelet, or other shape having a wearable structure, but is not limited thereto.
Based on any one of the vehicle-mounted wearable display systems in the above embodiments, the embodiment of the present disclosure further provides a positive direction determination method for a controller of a vehicle-mounted wearable display device, and the method can be applied to any one of the vehicle-mounted wearable display systems, so as to automatically determine the positive direction of the controller based on the pose of the controller.
In some embodiments, fig. 5 is a schematic flowchart of a positive direction determination method of a controller of a vehicle-mounted wearable display device according to an embodiment of the present disclosure, where the determination method is executed by a vehicle-mounted device. As shown in fig. 5, the determination method includes:
s401, pose data and trigger surface data are obtained.
S402, determining the positive direction of the controller based on the pose data and the trigger surface data.
Specifically, the pose data includes attitude angle and acceleration data of the controller, which contains spatial coordinate information of the controller; the trigger surface data is screen data of a display field of view, and includes spatial coordinate information of the trigger surface.
In combination with the above, the controller sends the pose data to the car machine, and correspondingly, the car machine receives the pose data, so that the car machine acquires the pose data; and the vehicle-mounted wearable display device sends the trigger surface data to the vehicle machine, and correspondingly, the vehicle machine receives the trigger surface data, so that the vehicle machine acquires the trigger surface data.
Based on the method, the vehicle machine processes the acquired pose data and the acquired trigger surface data, and the positive direction of the controller can be determined.
The positive direction judgment method of the controller of the vehicle-mounted wearable display device can be executed by a vehicle machine, specifically, the positive direction of the controller is determined based on pose data and trigger surface data by acquiring the pose data and the trigger surface data, so that when a user takes the controller, the user can directly wear the controller without distinguishing directions based on the appearance of the controller before wearing the controller, and then the vehicle machine acquires the pose data of the controller and combines the pose data and the trigger surface data of the controller, so that the positive direction of the controller can be automatically determined, the method is simple and convenient, the user experience can be improved, and the method can be suitable for various different wearing modes.
In some embodiments, fig. 6 is a flowchart illustrating a positive direction determination method for a controller of another vehicle-mounted wearable display device according to an embodiment of the present disclosure. With reference to fig. 5 and 6, determining the positive direction of the controller based on the pose data and the trigger surface data in S402 includes:
s4021, determining data of the trigger line to be displayed, which is controlled by the controller, based on the pose data.
The trigger lines to be displayed comprise two trigger lines which take the controller as a starting point and are in antiparallel.
Illustratively, fig. 7 is an orientation diagram of a trigger line to be displayed associated with a controller according to an embodiment of the present disclosure. Referring to fig. 7, or referring to fig. 2, the trigger line to be displayed includes two trigger lines that are respectively emitted in two parallel and opposite directions with the controller 12 as a starting point, that is, the two trigger lines are antiparallel, that is, the two trigger lines are on a straight line, but opposite directions.
Illustratively, in conjunction with the above, a circuit board 121 is disposed inside the controller 12, and an inertial measurement unit 122 is disposed on the circuit board 121, wherein a reference plane of the inertial measurement unit 122 is parallel to a plane where the circuit board 121 is located, and is parallel to an operation plane of the controller 12. Based on this, when the trigger line set in the software program in the in-vehicle machine is generated using a plane parallel to the reference plane of the inertial measurement unit 122, a bundle of trigger lines to be displayed that passes through the controller 12 and is parallel to the operation plane of the controller 12 can be displayed in the display view screen of the on-vehicle wearable display device 11.
However, in the related art, the trigger lines displayed in the display view frame are usually bidirectional, that is, both of the two trigger lines to be displayed are displayed, which does not meet the requirement of interactive operation. During the interaction, it is necessary to send a single-sided trigger line from the controller 12, that is, one display is selected from the two trigger lines to be displayed, so it is necessary to determine and display the trigger line to be displayed in the same direction as the positive direction of the controller, so as to implement human-computer interaction.
In view of this, the embodiment of the present disclosure provides the determination method. Specifically, the car machine 10 processes the pose data sent by the controller 12, and controls the on-vehicle wearable display device 11 to display only one of the two trigger lines to be displayed, specifically, to display the trigger line in the same direction as the positive direction of the controller 12, where a specific processing manner is exemplarily described later.
Thus, by processing the pose data of the controller, it is possible to determine the data of the two trigger lines to be displayed emitted by the controller, i.e. to enable the determination of the data of the trigger lines to be displayed associated with the controller based on the pose data.
It will be appreciated that although the two anti-parallel trigger lines to be displayed are shown in figure 7, they are not displayed until the display control instructions are generated; but after generating the display control instructions; the trigger line in the same direction as the positive direction of the controller is displayed by the vehicle-mounted wearable display device.
S4022, based on the data of the trigger line to be displayed and the data of the trigger surface, judging that the target trigger line to be displayed meeting the preset conditions is the trigger line to be displayed corresponding to the positive direction of the controller.
The preset condition is used for judging whether the target trigger line to be displayed is a trigger line to be displayed corresponding to the positive direction of the controller, and if the preset condition is met, the target trigger line to be displayed is the trigger line to be displayed corresponding to the positive direction of the controller; if the preset condition is not met, it is determined that the target trigger line to be displayed is not a trigger line to be displayed corresponding to the positive direction of the controller, specifically, the target trigger line to be displayed is a trigger line to be displayed corresponding to the negative direction of the controller.
The target trigger line to be displayed is one of the trigger lines to be displayed.
Therefore, whether the target trigger line to be displayed is the trigger line to be displayed corresponding to the positive direction of the controller can be judged based on the data of the trigger line to be displayed and the data of the trigger surface in combination with preset conditions.
S4023, determining the positive direction of the controller based on the orientation of the trigger line to be displayed corresponding to the positive direction of the controller.
Specifically, the orientation of the trigger line to be displayed corresponding to the positive direction of the controller is the same as the orientation of the positive direction of the controller. Thus, after the trigger line to be displayed corresponding to the positive direction of the controller is determined in S4022, the positive direction of the controller can be determined based on the trigger line to be displayed corresponding to the positive direction of the controller.
Illustratively, fig. 8 is a schematic orientation diagram of a trigger line to be displayed, which corresponds to a positive direction of the controller according to an embodiment of the present disclosure. As shown in fig. 8, or as shown in fig. 2, the trigger lines to be displayed that correspond to the positive direction of the controller can be used to indicate the positive direction of the controller, shown in the Y direction.
In some embodiments, the preset conditions include: the trigger line is in contact with the trigger surface.
The trigger line is determined based on data of the trigger line to be displayed, and the trigger surface is determined based on the data of the trigger surface.
Based on this, in conjunction with fig. 5 and 6, the determining, in S4022, that a target trigger line to be displayed that meets a preset condition is a trigger line to be displayed corresponding to the positive direction of the controller includes:
s40221, determining the corresponding trigger line to be displayed based on the data of the trigger line to be displayed.
S40222, determining the corresponding trigger surface based on the trigger surface data.
S40223, judging whether the trigger line to be displayed contacts the trigger surface.
S40224, when the target trigger line to be displayed is in contact with the trigger surface, determining that the target trigger line to be displayed is a trigger line to be displayed corresponding to the positive direction of the controller.
Wherein, can confirm the trigger line that waits to show that corresponds based on waiting to show the data of trigger line, can confirm the trigger face that corresponds based on the data of trigger face, after confirming waiting to show trigger line and trigger face, can judge, specifically: judging whether the trigger line to be displayed contacts the trigger surface; and further, based on the judgment result, the trigger line to be displayed corresponding to the positive direction of the controller is determined. Specifically, if the target trigger line to be displayed is in contact with the trigger surface, it may be determined that the target trigger line to be displayed in contact with the trigger surface is a trigger line to be displayed corresponding to the positive direction of the controller. Thereby, a trigger line to be displayed corresponding to the positive direction of the controller is obtained.
Illustratively, with reference to fig. 7 and 8, for an example of a vehicle VR display with a controller as a ring, the method may include:
set up an unlimited trigger face in the sky box in VR field of vision the place ahead, the ring has two antiparallel trigger lines, and only one in these two trigger lines can contact with the trigger face, the positive direction of controller is confirmed with the pointing to of this trigger line that the trigger face contacted, thereby the direction that does not have the trigger line that contacts with the trigger face is confirmed as the reverse direction of controller, in the follow-up display process, only show the trigger line who instructs the positive direction, and the trigger line who instructs the reverse direction does not show.
Furthermore, when the user takes off the ring and rotates the ring by 180 degrees, the trigger line which is not originally in contact with the trigger surface in the two trigger lines of the ring is in contact with the trigger surface, so that the direction of the trigger line is determined as the positive direction; the activation line, which was originally in contact with the activation surface, is now no longer in contact with the activation surface, so that its orientation is considered to be the opposite direction.
In other embodiments, the method provided by the embodiment of the present disclosure may also be applied to other display control scenarios, which are not limited herein.
In some embodiments, on the basis of fig. 6, after determining whether the trigger line to be displayed contacts the trigger surface in S40223, the method further includes:
and when the target trigger line to be displayed is not in contact with the trigger surface, judging that the target trigger line to be displayed is the trigger line to be displayed corresponding to the opposite direction of the controller.
Specifically, when the target trigger line to be displayed is not in contact with the trigger surface, it may be directly determined that the target trigger line to be displayed is the trigger line to be displayed corresponding to the opposite direction of the controller.
In some embodiments, the trigger line is in contact with a trigger surface, comprising: the spatial coordinates of the trigger line coincide with the spatial coordinates of the contact surface.
Based on the above, whether the trigger line is contacted with the trigger surface can be judged by judging whether the space coordinate of the trigger line is superposed with the space coordinate of the contact surface, so that the trigger line to be displayed corresponding to the positive direction of the controller is judged, and the positive direction of the controller is determined.
In some embodiments, on the basis of the above embodiment, after determining the positive direction of the controller based on the pose data and the trigger surface data, the method may further include:
and generating a display control instruction.
The display control instruction is used for indicating the vehicle-mounted wearable display equipment to display a target trigger line to be displayed and a trigger surface in contact with the target trigger line to be displayed. The system comprises a vehicle machine, a controller, a display control unit and a display control unit, wherein the vehicle machine performs rendering display processing on a trigger line to be displayed corresponding to the positive direction of the controller and performs hiding processing on the trigger line to be displayed corresponding to the negative direction of the controller; based on this, a display control instruction is generated to instruct the on-vehicle wearable display device to display a trigger line corresponding to a positive direction of the controller.
Specifically, in combination with the above, the in-vehicle machine may generate the display control instruction and transmit the display control instruction to the in-vehicle wearable display device, on the basis that the positive direction of the controller has been determined. Correspondingly, the vehicle-mounted wearable display equipment receives the display control instruction, and displays the trigger line to be displayed in the positive direction of the trigger surface and the display controller based on the display control instruction.
Based on any positive direction determination method of the controller of the vehicle-mounted wearable display device in the above embodiments, the embodiment of the present disclosure further provides a display method of the vehicle-mounted wearable display device, where the display method is applied based on any positive direction determination method.
In some embodiments, fig. 9 is a schematic flowchart of a display method of a vehicle-mounted wearable display device according to an embodiment of the present disclosure. Referring to fig. 9, the display method includes:
s801, receiving a display control instruction.
Wherein, show that control command is generated by the car machine to send to on-vehicle wearable display device. Correspondingly, the display device receives the display control instruction.
S802, displaying target content based on a display control instruction; the target content comprises a trigger surface and a target trigger line to be displayed.
Specifically, after receiving the display control instruction, the vehicle-mounted wearable display device can display the target content based on the display control instruction. The target content comprises a trigger surface and a target trigger line to be displayed, namely the display visual field image seen by the user comprises the trigger surface with operability and the target trigger line to be displayed, wherein the trigger surface is operated by the user.
It will be appreciated that the trigger line may be displayed as a beam, a spot, or other objective form, and is not limited thereto.
The display method of the vehicle-mounted wearable display device provided by the embodiment of the disclosure is applied based on any positive direction determination method provided by the above embodiment, has the same or corresponding beneficial effects, and is not repeated herein.
On the basis of the above embodiments, the embodiments of the present disclosure further provide a determination device for a positive direction determination method based on a controller of a vehicle-mounted wearable display device, which is used for executing the steps of any one of the positive direction determination methods provided by the above embodiments, and has the same or corresponding beneficial effects.
In some embodiments, fig. 10 is a schematic structural diagram of a positive direction determination device of a controller of a vehicle-mounted wearable display device according to an embodiment of the present disclosure, where the positive direction determination device is applied to any one of the systems provided in the foregoing embodiments and is disposed in a vehicle.
As shown in fig. 10, the positive direction determination device includes: the data acquisition module 91 is used for acquiring pose data and trigger surface data; and the direction judging module 92 is used for determining the positive direction of the controller based on the pose data and the trigger surface data.
In some embodiments, the direction determination module 92 is specifically configured to: determining data of the trigger line to be displayed controlled by the controller based on the pose data; the trigger lines to be displayed comprise two trigger lines which take the controller as a starting point and are in parallel in an opposite direction; judging that the target trigger line to be displayed meeting the preset condition is the trigger line to be displayed corresponding to the positive direction of the controller based on the data of the trigger line to be displayed and the trigger surface data; the positive direction of the controller is determined based on the pointing direction of the trigger line to be displayed, which corresponds to the positive direction of the controller.
In some embodiments, the preset conditions include: the trigger line is contacted with the trigger surface; the trigger line is determined based on data of the trigger line to be displayed, and the trigger surface is determined based on the data of the trigger surface.
Based on this, the direction determination module 92 determines, based on the data of the trigger line to be displayed and the trigger surface data, that the target trigger line to be displayed that satisfies the preset condition is the trigger line to be displayed corresponding to the positive direction of the controller, and includes: determining a corresponding trigger line to be displayed based on the data of the trigger line to be displayed; determining a corresponding trigger surface based on the trigger surface data; judging whether the trigger line to be displayed contacts the trigger surface; and when the target trigger line to be displayed is in contact with the trigger surface, judging that the target trigger line to be displayed is the trigger line to be displayed corresponding to the positive direction of the controller.
In some embodiments, the direction determining module 92 is further configured to determine that the target to-be-displayed trigger line is a to-be-displayed trigger line corresponding to an opposite direction of the controller when the target to-be-displayed trigger line is not in contact with the trigger surface.
In some embodiments, the trigger line is in contact with a trigger surface, comprising: the spatial coordinates of the trigger line coincide with the spatial coordinates of the contact surface.
In some embodiments, the determination apparatus further comprises an instruction generation module for generating a display control instruction after determining a positive direction of the controller based on the pose data and the trigger surface data; the display control instruction is used for indicating the vehicle-mounted wearable display device to display a target trigger line to be displayed and a trigger surface in contact with the target trigger line to be displayed.
On the basis of the above embodiment, the embodiment of the present disclosure further provides a display device based on the display method of the vehicle-mounted wearable display device, which is used for executing the steps of the display method provided by the above embodiment, and has the same or corresponding beneficial effects.
In some embodiments, fig. 11 is a schematic structural diagram of a display device provided in an embodiment of the present disclosure, where the display device includes: an instruction receiving module 21, configured to receive a display control instruction; a content display module 22 for displaying the target content based on the display control instruction; the target content comprises a trigger surface and a target trigger line to be displayed; the display control command is generated based on any one of the positive direction determination devices provided in the above embodiments.
The embodiments of the present disclosure also provide a computer-readable storage medium, which stores a program or instructions that cause a computer to execute the steps of any one of the positive direction determination methods provided in the above embodiments, or execute the steps of the display method provided in the above embodiments.
Illustratively, the program or the instructions cause a computer to execute a positive direction determination method of a controller of a vehicle-mounted wearable display apparatus, the determination method including:
acquiring pose data and trigger surface data;
based on the pose data and the trigger surface data, a positive direction of the controller is determined.
In some embodiments, when executed by a computer processor, the computer executable instruction may be further configured to implement any of the above-mentioned positive direction determination methods provided in the embodiments of the present disclosure, so as to achieve corresponding beneficial effects.
An embodiment of the present disclosure further provides an electronic device, including: a processor and a memory; the processor is used for executing any one of the steps of the control method by calling the program or the instruction stored in the memory, so that the corresponding beneficial effects are realized.
Fig. 12 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present disclosure. As shown in fig. 12, the electronic device includes one or more processors 601 and memory 602.
The processor 601 may be a Central Processing Unit (CPU) or other form of processing unit having data processing capabilities and/or instruction execution capabilities, and may control other components in the electronic device to perform desired functions.
The memory 602 may include one or more computer program products that may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. Volatile memory can include, for example, random Access Memory (RAM), cache memory (cache), and/or the like. The non-volatile memory may include, for example, read Only Memory (ROM), a hard disk, flash memory, and the like. One or more computer program instructions may be stored on a computer readable storage medium and executed by the processor 601 to implement the positive direction determination method or the display method of the embodiments of the present disclosure above, and/or other desired functions. Various contents such as an input signal, a signal component, a noise component, etc. may also be stored in the computer-readable storage medium.
In one example, the electronic device may further include: an input device 603 and an output device 604, which are interconnected by a bus system and/or other form of connection mechanism (not shown).
The input device 603 may also include, for example, a keyboard, a mouse, and the like.
The output device 604 may output various information including the determined distance information, direction information, and the like to the outside. The output devices 604 may include, for example, a display, speakers, a printer, and a communication network and remote output devices connected thereto, among others.
Of course, for simplicity, only some of the components of the electronic device relevant to the present disclosure are shown in fig. 12, omitting components such as buses, input/output interfaces, and the like. In addition, the electronic device may include any other suitable components, depending on the particular application.
It is noted that, in this document, relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising a … …" does not exclude the presence of another identical element in a process, method, article, or apparatus that comprises the element.
The previous description is only for the purpose of describing particular embodiments of the present disclosure, so as to enable those skilled in the art to understand or implement the present disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the disclosure. Thus, the present disclosure is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (15)

1. An on-vehicle wearable display system, characterized in that includes: the system comprises a vehicle-mounted machine, a vehicle-mounted wearable display device and a controller;
the controller sends pose data to the vehicle machine;
the vehicle-mounted wearable display equipment sends triggering surface data to the vehicle machine; the triggering surface is a visual field picture displayed by the display equipment;
the car machine is used for determining the positive direction of the controller based on the pose data and the trigger surface data.
2. The system of claim 1, wherein the controller comprises: the controller comprises a controller main body, a circuit board and an inertia measuring unit;
the controller main body comprises an operation plane used for sensing the control operation of a user;
the circuit board is used for responding to the control operation of a user, generating an operation signal and transmitting the operation signal to the vehicle machine;
the inertial measurement unit is arranged on the circuit board and used for detecting the pose of the controller so as to generate pose data;
the plane where the circuit board is located and the operating plane form a first preset included angle, and the reference plane of the inertia measurement unit and the plane where the circuit board is located form a second preset included angle.
3. The system of claim 1, wherein the first predetermined included angle and the second predetermined included angle are both 0 degrees.
4. A positive direction determination method of a controller of a vehicle-mounted wearable display device is applied to the system of any one of claims 1 to 3 and executed by a vehicle machine; the method comprises the following steps:
acquiring the pose data and the trigger surface data;
determining a positive direction of the controller based on the pose data and the trigger surface data.
5. The method according to claim 4, wherein the determining a positive direction of the controller based on the pose data and the trigger surface data comprises:
determining data of a trigger line to be displayed controlled by the controller based on the pose data; the trigger lines to be displayed comprise two trigger lines which take the controller as a starting point and are in parallel in an opposite direction;
judging that the target trigger line to be displayed meeting preset conditions is the trigger line to be displayed corresponding to the positive direction of the controller on the basis of the data of the trigger line to be displayed and the trigger surface data;
the positive direction of the controller is determined based on the orientation of the trigger line to be displayed corresponding to the positive direction of the controller.
6. The method of claim 5, wherein the preset condition comprises: the trigger line is contacted with the trigger surface; the trigger line is determined based on the data of the trigger line to be displayed, and the trigger surface is determined based on the data of the trigger surface;
based on treat the data that show the trigger line with trigger surface data, judge that the target that satisfies the preset condition treats to show the trigger line and be the trigger line that treats to show that corresponds to the positive direction of controller, include:
determining a corresponding trigger line to be displayed based on the data of the trigger line to be displayed;
determining a corresponding trigger surface based on the trigger surface data;
judging whether the trigger line to be displayed contacts the trigger surface;
when the target is to be displayed the trigger line and is contacted with the trigger surface, judge that the target is to be displayed the trigger line for the positive direction that corresponds to the controller.
7. The method according to claim 6, wherein after determining whether the trigger line to be displayed contacts the trigger surface, the method further comprises:
and when the target trigger line to be displayed is not in contact with the trigger surface, judging that the target trigger line to be displayed is the trigger line to be displayed corresponding to the opposite direction of the controller.
8. The method according to claim 6 or 7, wherein the trigger line is in contact with a trigger surface, comprising: the spatial coordinates of the trigger line coincide with the spatial coordinates of the contact surface.
9. The method according to any one of claims 4-7, wherein after determining the positive direction of the controller based on the pose data and the trigger surface data, the method further comprises:
generating a display control instruction;
the display control instruction is used for indicating the vehicle-mounted wearable display device to display a target trigger line to be displayed and a trigger surface in contact with the target trigger line to be displayed.
10. A display method of a vehicle-mounted wearable display device is characterized by comprising the following steps:
receiving a display control instruction;
displaying target content based on the display control instruction; the target content comprises a trigger surface and a target trigger line to be displayed;
wherein the display control instructions are generated based on the method of claim 9.
11. A positive direction determination device of a controller of a vehicle-mounted wearable display device is applied to the system of any one of claims 1 to 3, and is arranged in a vehicle machine; the positive direction determination device includes:
the data acquisition module is used for acquiring the pose data and the trigger surface data;
and the direction judging module is used for determining the positive direction of the controller based on the pose data and the trigger surface data.
12. The positive direction determination device according to claim 11, further comprising:
and the instruction generating module is used for generating a display control instruction after the positive direction of the controller is determined.
13. The utility model provides a display device of on-vehicle wearing formula display device which characterized in that includes:
the instruction receiving module is used for receiving a display control instruction;
the content display module is used for displaying target content based on the display control instruction; the target content comprises a trigger surface and a target trigger line to be displayed;
wherein the display control command is generated based on the positive direction determination device according to claim 11 or 12.
14. A computer-readable storage medium, characterized in that it stores a program or instructions for causing a computer to perform the steps of the method according to any one of claims 4-9 or to perform the steps of the method according to claim 10.
15. An electronic device, comprising: a processor and a memory;
the processor is adapted to perform the steps of the method of any of claims 4-9 or to perform the steps of the method of claim 10 by calling a program or instructions stored in the memory.
CN202210664816.9A 2022-06-13 2022-06-13 Display system, determination method, display device, medium, and apparatus Pending CN115437590A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210664816.9A CN115437590A (en) 2022-06-13 2022-06-13 Display system, determination method, display device, medium, and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210664816.9A CN115437590A (en) 2022-06-13 2022-06-13 Display system, determination method, display device, medium, and apparatus

Publications (1)

Publication Number Publication Date
CN115437590A true CN115437590A (en) 2022-12-06

Family

ID=84240973

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210664816.9A Pending CN115437590A (en) 2022-06-13 2022-06-13 Display system, determination method, display device, medium, and apparatus

Country Status (1)

Country Link
CN (1) CN115437590A (en)

Similar Documents

Publication Publication Date Title
CN100363880C (en) Operation input device and method of operation input
IL290065B2 (en) System and method for promoting connectivity between a mobile communication device and a vehicle touch screen
WO2015102069A1 (en) Operating device
US9649938B2 (en) Method for synchronizing display devices in a motor vehicle
US20200201515A1 (en) Method and electronic device for controlling augmented reality device
CN109213363B (en) System and method for predicting pointer touch position or determining pointing in 3D space
US20180241970A1 (en) Driving assistance method and driving assistance device and program using same
JP2007141177A (en) Operation input device
WO2018061603A1 (en) Gestural manipulation system, gestural manipulation method, and program
US20190156118A1 (en) Information processing apparatus, control method, and program
CN115437590A (en) Display system, determination method, display device, medium, and apparatus
US20210174084A1 (en) Method for human-machine interaction and apparatus for the same
CN114013431B (en) Automatic parking control method and system based on user intention
CN115617232A (en) Remote screen control method, vehicle and computer readable storage medium
US10963065B2 (en) Action processing apparatus
JP5933468B2 (en) Information display control device, information display device, and information display control method
CN115437408A (en) Controller, method, apparatus, system, medium, and device of display device
WO2022003511A1 (en) Systems and methods for dynamic shape sketching
CN115437589A (en) Controller, method, apparatus, system, medium, and device of display device
JP7117454B2 (en) Support method and support system
JP7108329B1 (en) Information processing method, information processing system, program
US12014010B2 (en) Information processing device and information processing method based on input operation of user
CN110949271B (en) Operation processing device
JP5889230B2 (en) Information display control device, information display device, and information display control method
CN115437591A (en) Display method, control method, device, system, medium, and apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination