CN217693554U

CN217693554U - Media playing system of head-mounted display equipment, vehicle-mounted media playing system and vehicle

Info

Publication number: CN217693554U
Application number: CN202221025374.5U
Authority: CN
Inventors: 尼蒙
Original assignee: Shining Reality Wuxi Technology Co Ltd
Current assignee: Shining Reality Wuxi Technology Co Ltd
Priority date: 2022-04-29
Filing date: 2022-04-29
Publication date: 2022-10-28
Anticipated expiration: 2032-04-29

Abstract

The present disclosure provides a system for media playing, a vehicle-mounted media playing system and a vehicle. In a specific implementation scheme, the system for media playing comprises: the media data processing device comprises a data input first interface and at least one data output first interface, wherein the data input first interface is used for receiving externally input media data, and the at least one data output first interface is used for outputting the media data processed by the media data processing device; and the head-mounted display equipment comprises a data input second interface which is in communication connection with the data output first interface and is used for receiving the processed media data, and the head-mounted display equipment is used for playing according to the processed media data.

Description

Media playing system of head-mounted display equipment, vehicle-mounted media playing system and vehicle

Technical Field

The present disclosure relates to the field of media playing technologies for head-mounted display devices, and in particular, to a media playing system for a head-mounted display device, a vehicle-mounted media playing system for a head-mounted display device, and a vehicle.

Background

With the development of socioeconomic and technical developments, the use of head-mounted display devices has become widespread. However, in the related art, there is no scheme for combining a head-mounted display device with a vehicle-mounted medium.

SUMMERY OF THE UTILITY MODEL

The embodiment of the disclosure provides a vehicle-mounted media playing system for head-mounted display equipment, a vehicle-mounted media playing system for head-mounted display equipment and a vehicle, which can enrich product market, fill up technical blank in related fields, and simultaneously improve the use experience of a user on the head-mounted display equipment based on scenes.

In one aspect of the disclosure, a media playing system for a head-mounted display device is provided, which includes a media data processing apparatus and at least one head-mounted display device. The media data processing device comprises a data input first interface and at least one data output first interface, wherein the data input first interface is used for receiving externally input media data, and the at least one data output first interface is used for outputting the media data processed by the media data processing device; the at least one head-mounted display device comprises a data input second interface which is in communication connection with the data output first interface and used for receiving the processed media data, and the head-mounted display device is used for playing according to the processed media data.

In another aspect of the present disclosure, an in-vehicle media playing system for a head-mounted display device is provided, including: the system comprises a vehicle machine, a media data processing device and at least one head-mounted display device. The vehicle machine comprises at least one third data output interface and at least one first audio data output interface; the media data processing device comprises a data input first interface and at least one data output first interface, wherein the data input first interface is in communication connection with the data output third interface and is used for receiving media data sent by the vehicle machine, and the at least one data output first interface is used for outputting the media data processed by the media data processing device; the at least one head-mounted display device comprises a data input second interface which is in communication connection with the data output first interface and used for receiving the processed media data, and the head-mounted display device is used for playing according to the processed media data.

In yet another aspect of the disclosure, a vehicle is provided that includes an in-vehicle media playback system for a head-mounted display device as described in the disclosure.

The technical solution of the present disclosure is further described in detail by the accompanying drawings and examples.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description, serve to explain the principles of the disclosure.

The present disclosure may be more clearly understood from the following detailed description, taken with reference to the accompanying drawings, in which:

FIG. 1 is a schematic structural diagram of one embodiment of a media playback system for a head mounted display device according to the present disclosure;

FIG. 2 is a schematic block diagram of a first embodiment of the media data processing apparatus of FIG. 1;

fig. 3 is a schematic configuration diagram of a second embodiment of the media data processing device of fig. 1;

fig. 4 is a schematic configuration diagram of a third embodiment of the media data processing device of fig. 1;

FIG. 5 is a schematic structural diagram of another embodiment of the media playing system for the head-mounted display device according to the present disclosure;

FIG. 6 is a schematic structural diagram of one embodiment of an in-vehicle media playing system for a head-mounted display device according to the present disclosure;

FIG. 7 is a schematic block diagram of a first embodiment of the media data processing apparatus of FIG. 6;

FIG. 8 is a schematic diagram of a second embodiment of the media data processing apparatus of FIG. 6;

FIG. 9 is a schematic structural diagram of a third embodiment of the media data processing apparatus shown in FIG. 6;

FIG. 10 is a schematic structural diagram of an embodiment of an in-vehicle assembly connection of the media data processing device according to the present disclosure;

fig. 11 is a schematic structural diagram of another embodiment of the media data processing device of the present disclosure connected to an in-vehicle assembly;

FIG. 12 is a schematic structural diagram of another embodiment of the in-vehicle media playing system for the head-mounted display device according to the disclosure;

fig. 13 is a schematic diagram illustrating a hierarchical division of the car machine and the converter according to a protocol layer of data transmission according to the present disclosure;

fig. 14 is a schematic diagram of hierarchical division of the car machine and the converter according to the driving flow hierarchy of the running program according to the present disclosure.

Reference numerals:

1. a media data processing device; 10. a data input first interface; 11. a data output first interface; 12. a data output second interface; 13. a data input third interface; 110. a hub; 120. a converter;

2. a head mounted display device; 21. a data input second interface;

3. a vehicle machine; 31. a third interface for data output; 32. an audio data output first interface; 33. a control instruction input interface;

4. sounding; 41. audio data is input into the first interface;

5. a controller; 51. a control signal input terminal; 52. and a control signal output terminal.

Detailed Description

Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, the numerical expressions, and numerical values set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.

It will be understood by those within the art that the terms "first", "second", etc. in the embodiments of the present disclosure are used only for distinguishing between different steps, devices or modules, etc., and do not denote any particular technical meaning or necessary logical order therebetween.

It is also understood that in embodiments of the present disclosure, "a plurality" may refer to two or more and "at least one" may refer to one, two or more.

It is also to be understood that any reference to any component, data, or structure in the embodiments of the disclosure, may be generally understood as one or more, unless explicitly defined otherwise or stated otherwise.

In addition, the term "and/or" in the present disclosure is only one kind of association relationship describing the association object, and indicates that three relationships may exist, for example, a and/or B, may indicate: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" in the present disclosure generally indicates that the former and latter associated objects are in an "or" relationship.

It should also be understood that the description of the various embodiments of the present disclosure emphasizes the differences between the various embodiments, and the same or similar parts may be referred to each other, so that the descriptions thereof are omitted for brevity.

Meanwhile, it should be understood that the sizes of the respective portions shown in the drawings are not drawn in an actual proportional relationship for the convenience of description.

The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the disclosure, its application, or uses.

Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.

It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.

Exemplary System

In one aspect of the present disclosure, a media playback system for a head-mounted display device is provided.

Fig. 1 is a schematic structural diagram of an embodiment of a media playing system for a head-mounted display device according to the present disclosure. As shown in fig. 1, the media playing system includes a media data processing apparatus 1 and at least one head-mounted display device 2.

In this embodiment the media data processing device 1 comprises a data input first interface 10 and at least one data output first interface 11. Wherein, the data input first interface 10 is used for receiving the media data input from outside, and at least one data output first interface 11 is used for outputting the media data processed by the media data processing device 1; the at least one head-mounted display device 2 comprises a second data input interface 21, the second data input interface 21 is in communication connection with the first data output interface 11 and is used for receiving the processed media data, and the head-mounted display device 2 is used for playing according to the processed media data.

It should be noted that the media data may be streaming media data downloaded from a network, or may also be video data and/or audio data stored locally.

In addition, the number of the head-mounted display devices 2 in the system is not particularly limited, and can be adjusted according to the requirement, for example, the number of users who use the head-mounted display devices 2 at the same time.

The processing manner of the media data by the media data processing apparatus 1 may include, but is not limited to, decoding, rendering, and streaming, so as to assist the head mounted display device 2 in playing, which will be described in detail below.

Based on the media playing system in the embodiment of fig. 1, the media data processing device 1 and the head-mounted display device 2 are in communication connection, a system architecture for combined application of the head-mounted display device and the media data processing device is built, the technical blank in the related field can be filled, and the product market can be enriched.

On the basis of the embodiment of fig. 1, the media data processing device in the present disclosure may include various embodiments.

In one possible embodiment of the disclosure:

the media data processing device may comprise a hub and at least one converter. The number of the converters is not limited in the present disclosure, and may be determined according to the number of the head-mounted display devices.

In an alternative example, referring to fig. 2, the media data processing device 1 may comprise one hub 110 and at least one converter 120. Wherein, a hub 110 comprises a data input interface and at least one data output second interface 12, wherein, the data input interface of the hub is used as the data input first interface 10; the hub 110 is configured to split the received media data, and each split media data path has no difference from the one before splitting. The converter 120 includes a data input third interface 13 and at least one data output interface, where the data output interface of the at least one converter is used as the data output first interface 11, the data input third interface 13 is in communication connection with the corresponding data output second interface 12, and is used to receive the media data, and the converter 120 is used to process the media data to obtain the processed media data.

As described above, it is understood that when the number of the converters (Adapter) is at least one, the HUB (HUB) may form a one-to-many connection relationship with at least one converter, so that the HUB may shunt the media data to at least one converter, thereby providing the media data processing apparatus with the capability of simultaneously providing data for at least one head-mounted display device.

Also, the converter may process (e.g., decode and render) the received media data; thereby providing a supplemental computational power to the head mounted display device.

Based on the example of fig. 2, the connection between the hub 110 and the at least one switch 120 can be set in a variety of available ways.

For example, in one mode, the hub 110 and the converter 120 may be packaged separately, and the data input third interface 12 and the data output second interface 12 are connected through an external data line to realize a split connection configuration between the hub 110 and the converter 120. It can be understood that the hub and the converter are arranged in a split connection manner based on independent packaging, so that on one hand, the assembly of a modular system based on requirements can be conveniently realized; on the other hand, maintenance and replacement of a failed module can be facilitated.

In another way, the hub 110 and the converter 120 may be integrally packaged, and the data input third interface 13 and the data output second interface 12 are communicatively connected through an internal data line, so as to realize an integrated connection arrangement between the hub 110 and the converter 120. It can be understood that the hub and the converter are integrally connected and packaged in the media data processing device, so that the structure is more centralized and simpler, the connection structure of the whole media playing system is simplified, and the installation is convenient.

In another possible embodiment of the disclosure:

the media data processing device may comprise a converter.

In an alternative example, referring to fig. 3, the media data processing apparatus 1 may include a converter 120. One converter 120 may include a data input interface and at least one data output interface, where the data input interface of the converter is used as the data input first interface 10, the data output interface of the converter is used as the data output first interface 11, and the converter 120 is configured to process the media data to obtain the processed media data.

In an optional example, the converter 120 may be further configured to stream the received media data according to the number of the head-mounted display devices. When the number of the head-mounted display devices connected with the converter is one, the converter can skip the shunting operation and directly transmit the processed media data to the head-mounted display devices.

As described above, in this example, the converter 120 has both the capability of processing media data and the capability of splitting the media data according to the number of the head-mounted display devices, so that one converter can be used in combination with the head-mounted display devices to construct a media playing system, thereby improving the system integration and simplifying the system structure.

On the basis of the example of fig. 2 or fig. 3, as an alternative embodiment, the converter of the present disclosure may further include at least one switch, configured to control whether to skip processing of the media data shunted to the head-mounted display device correspondingly connected to the converter, according to the type of the head-mounted display device correspondingly connected to the converter.

In this embodiment, the converter may identify the manufacturer code and/or product code of the head-mounted display device after establishing communication with the corresponding connected head-mounted display device, thereby determining the type of the head-mounted display device. Wherein the head mounted display device may include, but is not limited to, AR glasses, VR glasses, MR glasses, XR glasses.

The manner of controlling, by the switch, "whether to skip processing of the media data distributed to the head-mounted display device correspondingly connected to the converter according to the type of the head-mounted display device correspondingly connected to the converter" may include: for example, in the case where the head-mounted display device is AR glasses, then the switch control "does not skip"; namely, the converter processes the media data distributed to the corresponding connected AR glasses; when the head-mounted display device is VR glasses, the switch is controlled to skip; that is, the converter does not process the media data distributed to the VR glasses connected correspondingly, but directly transmits the media data to the VR glasses. The processing manner of the media data may include, for example, decoding and rendering.

When the number of the head-mounted display devices connected with the converter is one, the converter can also skip shunt operation after the switch judges whether to skip processing the media data, and directly transmits the media data obtained after the switch judgment to the head-mounted display devices.

As described above, it can be understood that the converter can expand the types of available types of the head-mounted display devices connected downstream (for example, AR glasses and VR glasses can be used in a mixed manner and are connected to different branch lines of the converter) based on the control function of the switch, so as to increase the number of combined application schemes that can be supported by the media playing system, thereby improving the product competitiveness of the media playing system.

In yet another possible embodiment of the disclosure:

the media data processing device may comprise a hub.

In an alternative example, referring to fig. 4, the media data processing device 1 may comprise a hub 110. One hub 110 may include a data input interface and at least one data output interface, where the data input interface of the hub is used as a data input first interface 10, the data output interface of the hub is used as a data output first interface 11, and the hub 110 is configured to process the media data to obtain the processed media data; and the head-mounted display device 2 is further configured to process the processed media data and then play the processed media data.

As described above, the processing of the media data by the hub 110 may include, for example, splitting, and the number of splitting paths may be determined according to the number of connected head-mounted display devices 2.

In the example of fig. 4, the head-mounted display device 2 needs to have independent data processing capability so as to handle the media data streamed from the hub 110. Wherein the treatment may be, for example, decoding and rendering, etc.

It can be understood that the media data processing apparatus 1 illustrated in fig. 4 has a simple structure, and the head-mounted display device can be assembled with or disassembled from the media data processing apparatus 1 by plugging/unplugging an external data line, so as to facilitate system construction and later maintenance.

It should be noted that, regarding the hub mentioned in the two embodiments corresponding to fig. 2 and fig. 4, the disclosure does not make any particular limitation on the type thereof, for example, the type of the hub may include, but is not limited to, a passive type, an active type, and an intelligent type.

In the above embodiments, when the media data is video data, the applicable standards include, but are not limited to, HDMI standard and DP standard.

As an alternative embodiment of the present disclosure, referring to fig. 2, 3 and 4, at least one of the first data input interface 10, the second data input interface 21 and the first data output interface 11 may be a Type-C interface. Referring to fig. 2, in a case where the media data processing apparatus 1 includes the data output second interface 12 and the data input third interface 13, an interface Type of at least one of the data output second interface 12 and the data input third interface 13 may be a Type-C interface. The external data line used for communication connection between the interfaces can be a USB data line.

It can be understood that, the Type-C interface can carry a maximum data transmission speed of 10Gb/s, the USB3.1 data transmission specification maximum data transmission speed is 10Gb/s, and the USB3.0 data transmission specification maximum data transmission speed is 5Gb/s; therefore, based on the communication link of the Type-C interface and the USB data line, the time for transmitting the media data can be greatly shortened, the delay is reduced, and smooth use experience is created for a user using the head-mounted display device.

As an alternative embodiment, referring to fig. 2, 3 and 4, the media data processing device 1 may be powered through the data input first interface 10; the data output first interface 11 is also used for supplying power to the head-mounted display device 2 by being connected with the data input second interface 21. Referring to fig. 2, in case that the media data processing device 1 comprises a data output second interface 12 and a data input third interface 13: the data output second interface 12 is also used to supply power to the converter 120 by connecting to the data input third interface 13.

As the connection relation among the interfaces is directly utilized, the upstream equipment supplies power to the downstream equipment, and an external power supply is not needed, so that the system connection structure can be simplified, and the cost can be reduced.

Fig. 5 is a schematic structural diagram of another embodiment of the media playing system for a head-mounted display device according to the present disclosure. As shown in fig. 5, the media playing system further includes a car machine 3, a stereo 4 and a controller 5.

As an optional implementation manner, the car machine 3 may include at least one data output third interface 31, where the data output third interface 31 is communicatively connected to the data input first interface 10, and is configured to send the media data to the media data processing apparatus 1.

The car machine is a vehicle-mounted infotainment product installed in an automobile, and the car machine can functionally realize information communication between people and the automobile and between the automobile and the outside (automobile and automobile). Typically, the vehicle machine is mounted within a center console of the vehicle.

Based on the media playing system in the embodiment of fig. 5, the communication connection among the media data processing device 1, the head-mounted display device 2 and the vehicle 3 is realized, and a system architecture for the combined application of the head-mounted display device and the vehicle-mounted media based on the vehicle is built, so that the technical blank in the related field can be filled, and the product market can be enriched. In addition, based on the media playing system, the use experience of the head-mounted display device based on scenes (such as scenes needing to be taken by a bus, such as business trips and travels) can be provided for the user, and the user requirements are met.

As another alternative, the controller 5 may include a control signal input terminal 51 and a control signal output terminal 52, where the control signal input terminal 51 is configured to receive control information input by a user, and the control signal output terminal 52 is configured to send a control command formed by the controller 5 according to the control information to the vehicle 3.

It can be understood that the control information is input through the controller, so that a user can conveniently control the media played by the vehicle-mounted computer, and the user experience is improved. The controls may include, but are not limited to, for example, pause, play, fast forward play, fast reverse play, adjusting volume, adjusting resolution, adjusting playback magnification, and the like.

The communication mode between the controller and the vehicle machine can be a wired mode or a wireless mode. The wired mode may be, for example, connection through a data line; the wireless means may be, for example, bluetooth, infrared, wireless network communication (Wi-Fi), near Field Communication (NFC), etc.

As another optional implementation manner, the car machine 3 further includes at least one audio data output first interface 32, and then the at least one sound 4 may include an audio data input first interface 41, where the audio data input first interface 41 is in communication connection with the corresponding audio data output first interface 32, and is used to receive audio data sent by the car machine 3, where the sound 4 is used to play the audio data.

Application scenarios for this embodiment may include, but are not limited to: 1) The user only wants to play audio data of the car machine (the audio data can be music liked by the user for example); 2) The same media data is watched simultaneously to at least one user of wearing head-mounted display device to can isolate audio data, by the stereo set broadcast of vehicle (because the on-vehicle stereo set of vehicle has better stereo surround the effect), and wear display device broadcast video, thereby can promote user's use and experience.

Optionally, in the application scenario 2), the car machine 1 may separate audio data from the media data, decode the audio data, and send the decoded audio data to the car-mounted audio for playing; and the Type of the interface between the audio data input first interface 41 and the corresponding audio data output first interface 32 can also be Type-C.

In other application scenarios, the media data may include both audio data and video data, and then the audio and video data may be played by a downstream head-mounted display device.

As another optional implementation manner, the car machine and the converter are layered according to a protocol of data transmission, and sequentially include, from top to bottom, an application layer, a transport layer, a network layer, a data link layer, and a physical layer. Alternatively, the data transport protocol of the transport layer may be, for example, the TCP-IP protocol for signaling and the RTP protocol for video data.

As another optional implementation manner, the car machine and the converter are layered according to a driving flow of the running program, and sequentially include an APP layer, a Framework layer, a Native layer, an Init layer, and a Kernel layer from top to bottom.

The present disclosure may provide a system architecture for a head-mounted display device and a vehicle-based media combination application based on the solutions of the embodiments of fig. 1 to 5. Particularly, a one-to-many system connection structure between the media data processing device and the head-mounted display equipment can be realized; therefore, the method not only can fill up the technical blank in the related field, but also can enrich the product market.

In addition, based on the media playing system architecture, the use experience of the head-mounted display device based on scenes (such as business trips, travels and other scenes needing to be taken by a bus) can be provided for at least one user at the same time, and the actual requirements of the user are met.

In another aspect of the present disclosure, an in-vehicle media playing system for a head-mounted display device is also provided.

Fig. 6 is a schematic structural diagram of an embodiment of an in-vehicle media playing system for a head-mounted display device according to the present disclosure. As shown in fig. 6, the vehicle-mounted media playing system includes a media data processing apparatus 1, at least one head-mounted display device 2, and a vehicle 3.

The car machine 3 may include at least one data output third interface 31 and at least one audio data output first interface 32; the media data processing device 1 may include a first data input interface 10 and at least one first data output interface 11, where the first data input interface 10 is in communication connection with the third data output interface 31, and is configured to receive media data sent by the car machine 3, and the at least one first data output interface 11 is configured to output the media data processed by the media data processing device 1; at least one head-mounted display device 2, including a data input second interface 21, the data input second interface 21 is connected with the data output first interface 11 in communication, and is used for receiving the processed media data, and the head-mounted display device 2 is used for playing according to the processed media data.

It should be noted that, the number of the head-mounted display devices in the system is not particularly limited, and may be adjusted according to the needs, for example, according to the number of users.

The media data may be streaming media data downloaded from a network, or may also be video data and/or audio data stored locally.

The processing manner of the media data by the media data processing apparatus may include, but is not limited to, decoding, rendering, and streaming, so as to assist the head mounted display device to play, which will be described in detail below.

In addition, the car machine is a vehicle-mounted information entertainment product installed in a car, and the car machine can realize information communication between people and the car and between the car and the outside (car and car) in function. Typically, the vehicle machine is mounted within a center console of the vehicle.

The audio data output first interface 32 may support the following application scenarios: 1) The user only wants to play audio data of the car machine (the audio data can be music liked by the user, for example); 2) The same media data is watched simultaneously to at least one user of wearing head mounted display device to can isolate audio data, then can send the stereo broadcast of vehicle (because the on-vehicle stereo of vehicle has better stereo surround effect), and head mounted display device broadcast video, thereby can promote user's use and experience.

Based on the vehicle-mounted media playing system in the embodiment of fig. 6, the communication connection among the media data processing device 1, the at least one head-mounted display device 2 and the vehicle 3 is realized, and a system architecture for combined application of the head-mounted display device and the vehicle-mounted media is established, so that the technical blank in the related field can be filled, and the product market can be enriched.

In addition, based on the vehicle-mounted media playing system, the use experience of the head-mounted display device based on scenes (such as business trips, travels and the like needing to be taken by a vehicle) can be provided for the user, and the user requirements are met.

On the basis of the embodiment of fig. 6, the media data processing device in the present disclosure may include various embodiments.

In one possible embodiment of the disclosure:

In an alternative example, referring to fig. 7, the media data processing device 1 may include one hub 110 and at least one converter 120. The hub 110 includes a data input interface and at least one data output second interface 12, where the data input interface of the hub is used as the data input first interface 10, the hub 110 is used to split the received media data, and each split media data path has no difference from that before splitting. The converter 120 includes a data input third interface 13 and at least one data output interface, wherein the data output interface of the at least one converter is used as the data output first interface 11, the data input third interface 13 is in communication connection with the corresponding data output second interface 12, and is configured to receive the media data, and the converter 120 is configured to process the media data to obtain the processed media data.

Also, the converter may process (e.g., decode and render) the received media data; thereby providing a supplemental computational power to the head-mounted display device.

Based on the example of fig. 7, the connection between the one hub 110 and the at least one switch 120 may be provided in a variety of available ways.

For example, in one mode, the hub 110 and the switch 120 may be packaged separately, and the data input third interface 12 and the data output second interface 12 are connected by external data line communication, so as to implement a split connection configuration between the hub 110 and the switch 120. It can be understood that the hub and the converter are arranged in a split connection manner based on independent packaging, so that on one hand, the assembly of a modular system based on requirements can be conveniently realized; on the other hand, maintenance and replacement of a failed module can be facilitated.

In another way, the hub 110 and the converter 120 may be integrally packaged, and the data input third interface 13 and the data output second interface 12 are communicatively connected through an internal data line, so as to realize an integrated connection arrangement between the hub 110 and the converter 120. It can be understood that the hub and the converter are integrally connected and arranged, and are packaged in the media data processing device, so that the structure is more centralized and simpler, the connection structure of the whole media playing system is simplified, and the installation is convenient.

In another possible embodiment of the disclosure:

the media data processing device may comprise a converter.

In an alternative example, referring to fig. 8, the media data processing apparatus 1 may include a converter 120. A converter 120 may include a data input interface and at least one data output interface, where the data input interface of the converter is used as a data input first interface 10, the data output interface of the converter is used as a data output first interface 11, and the converter 120 is configured to process the media data to obtain the processed media data.

In this embodiment, the converter may identify the manufacturer code and/or the product code of the head-mounted display device after establishing communication with the corresponding connected head-mounted display device, so as to determine the type of the head-mounted display device. Wherein the head mounted display device may include, but is not limited to, AR glasses, VR glasses, MR glasses, XR glasses.

When the number of the head-mounted display equipment connected with the converter is one, the converter can skip the shunt operation after the switch judges whether to skip the processing of the media data, and directly transmits the media data obtained after the switch judgment to the head-mounted display equipment.

As described above, it can be understood that the converter can expand the types of available types of the head-mounted display devices connected downstream based on the control function of the switch (for example, AR glasses and VR glasses can be used in a mixed manner and are simultaneously connected to different branch lines of the converter), thereby increasing the number of combined application schemes that can be supported by the media playing system, and further improving the product competitiveness of the media playing system

In yet another possible embodiment of the disclosure:

the media data processing apparatus may comprise a hub.

In an alternative example, referring to fig. 9, the media data processing device 1 may comprise a hub 110. A hub 110 may include a data input interface and at least one data output interface, where the data input interface of the hub is used as a data input first interface 10, the data output interface of the hub is used as a data output first interface 11, and the hub 110 is configured to process the media data to obtain the processed media data; and the head-mounted display device 2 is further configured to process the processed media data and then play the processed media data.

As described above, the processing of the media data by the hub 110 may include, for example, splitting, and specifically, the number of splitting paths may be determined according to the number of connected head-mounted display devices 2.

In the example of fig. 9, the head-mounted display device 2 needs to have an independent data processing capability, so that the media data streamed from the hub 110 can be handled. Wherein the handling may be, for example, decoding and rendering the media data, etc.

It can be understood that the media data processing apparatus 1 illustrated in fig. 9 has a simple structure, and the head-mounted display device can be assembled with or disassembled from the media data processing apparatus 1 by plugging and unplugging the external data line, thereby facilitating system construction and post-maintenance.

It should be noted that, regarding the hub mentioned in the two embodiments corresponding to fig. 7 and fig. 9, the present disclosure does not make any particular limitation on the type thereof, for example, the type of the hub may include, but is not limited to, a passive type, an active type, and an intelligent type.

Based on the above-described embodiments of fig. 7 and 9, the media data processing apparatus may have various installation manners in the vehicle interior.

As a possible installation manner, referring to fig. 10, in case that the hub 110 and the converter 120 are separately provided, the hub 110 may be provided at an intermediate armrest of a front seat of the vehicle, and at least one converter 120 may be respectively provided at a seat belt root position of a front seat and a rear seat, and enable the data input third interface 13 to be communicatively connected with the corresponding data output second interface 12 through an external data line; alternatively, the hub 110 may be disposed at a middle armrest of a front seat of the vehicle, two switches 120 corresponding to the front seat may be connected to the hub 110 via an extension line, and then the switches 120 may be connected to the head-mounted display device via a transmission line associated with the head-mounted display device.

As an alternative example, the hub may be embedded inside the middle armrest of the front seat, and communicatively connected to the converter through an internal wiring.

As described above, it is understood that the installation of the hub 110 at the armrest between the front seat 1 and the seat 2 may facilitate the connection of the front and rear passengers with the respective switches 120; in addition, the converter 120 is respectively arranged at the root positions of the safety belts of the seat 1, the seat 2, the seat 3 and the seat 4, so that the occupied seat space can be saved, and meanwhile, the passenger can conveniently connect with the head-mounted display device.

As another possible installation manner, referring to fig. 11, corresponding to a scenario where the media data processing apparatus 1 includes a hub or a converter, the number of the first interfaces of data output of the media data processing apparatus 1 is at least one, and the media data processing apparatus 1 is disposed at the middle armrest of the front seat of the vehicle and enables at least one of the first interfaces of data output to be connected by the head mounted display device.

As an alternative example, the media data processing device 1 may be installed embedded at a middle armrest of a front seat of a vehicle and then expose at least one data output first interface.

As described above, since the media data processing apparatus 1 is disposed at the middle armrest of the front seat of the vehicle, it is possible to facilitate the front (seat 1, seat 2) and rear (seat 3, seat 4) passengers to connect the respective head mounted display devices 3, and it is also possible to save the occupied seat space.

Fig. 12 is a schematic structural diagram of another embodiment of the in-vehicle media playing system for the head-mounted display device according to the present disclosure. As shown in fig. 12, the in-vehicle media playing system further includes at least one audio 4 and a controller 5.

As an optional implementation manner, referring to fig. 12, the sound 4 may include an audio data input first interface 41, where the audio data input first interface 41 is in communication connection with a corresponding audio data output first interface 32, and is configured to receive audio data sent by the car machine, where the sound is configured to play the audio data.

The stereo can be the on-vehicle stereo of vehicle, has better stereo surround effect, consequently under the scene that supports audio data independent broadcast, the stereo can be based on the system cooperation head mounted display device and use, and head mounted display device plays video data this moment to improve user's seeing and hearing experience.

In the application scenario, the Type of the interface in the system can be Type-C (the highest Type can bear 10Gb/s data transmission speed), and based on the communication link of the Type-C interface and the USB data line, because the communication link has higher data transmission speed, the delay of the video data relative to the audio data can be greatly reduced or even eliminated, so that the user experience can be ensured.

As an optional implementation manner, referring to fig. 12, the car machine 1 further includes at least one control instruction input interface 33 for receiving a control instruction. The controller 5 may include a control signal input terminal 51 and a control signal output terminal 52, where the control signal input terminal 51 is configured to receive control information input by a user, and the control signal output terminal 52 is configured to send a control instruction formed by the controller 5 according to the control information to the car machine 3.

Wherein, the controller 5 may comprise at least one of a mobile phone, a remote controller and a voice assistant. The present disclosure does not limit the type of the remote controller, for example, the remote controller may be a smart band, a smart ring, or a handle.

It can be understood that the driver can perform touch control through the App at the mobile phone end based on the matching relationship established in advance between the personal mobile phone of the driver and the vehicle 3 to input control information; or the driver and the passenger can input control information to the vehicle-mounted voice assistant in a voice input mode; still alternatively, both the driver and the passenger may input control information based on keys of a remote controller.

The media played by the vehicle machine can be conveniently controlled by a user through inputting the control information through the controller, and the user experience is improved. The controls may include, but are not limited to, for example, pause, play, fast forward play, fast reverse play, adjusting volume, adjusting resolution, adjusting playback magnification, and the like.

Referring to fig. 7, 8 and 9, as an alternative embodiment of the present disclosure, at least one of the first data input interface 10, the second data input interface 21 and the first data output interface 11 has a Type-C interface. Referring to fig. 7, in a case where the media data processing apparatus 1 includes the data output second interface 12 and the data input third interface 13, the interface Type of at least one of the data output second interface 12 and the data input third interface 13 is a Type-C interface. And the external data line used for communication connection between the interfaces is a USB data line.

It can be understood that the highest Type-C interface can bear 10Gb/s data transmission speed, the maximum data transmission speed of the USB3.1 data transmission specification is 10Gb/s, and the maximum data transmission speed of the USB3.0 data transmission specification is 5Gb/s; therefore, based on the communication link of the Type-C interface and the USB data line, the time for transmitting the media data can be greatly shortened, the delay is reduced, and smooth use experience is created for a user using the head-mounted display device.

As an alternative embodiment of the present disclosure, referring to fig. 7, 8 and 9, the media data processing device 1 may be connected to the data input first interface 10 through the data output third interface 31 and powered; the data output first interface 11 is also used for supplying power to the head-mounted display device 2 by being connected with the data input second interface 21. Referring to fig. 7, in case that the media data processing device 1 comprises a data output second interface 12 and a data input third interface 13: the data output second interface 12 is also used to supply power to the converter 120 by connecting to the data input third interface 13.

As another optional implementation manner, the car machine and the converter are layered according to a driving flow of the running program, and sequentially include, from top to bottom, an APP layer, a Framework layer, a Native layer, an Init layer, and a Kernel layer.

The present disclosure may provide a system architecture for a combined application of a head-mounted display device and an in-vehicle media based on the solutions of the embodiments of fig. 6 to 12. Particularly, a one-to-many system connection structure between the media data processing device and the head-mounted display equipment can be realized; therefore, the method not only can fill up the technical blank in the related field, but also can enrich the product market.

In yet another aspect of the present disclosure, a vehicle is also provided.

As an embodiment of the present disclosure, a vehicle is provided, wherein the vehicle includes the in-vehicle media playing system of the present disclosure.

It can be understood that, when a vehicle carries the vehicle-mounted media playing system disclosed by the disclosure, a system architecture of combined application of a head-mounted display device and vehicle-mounted media can be provided. Particularly, a one-to-many system connection structure between the media data processing device and the head-mounted display equipment can be realized; therefore, the technical blank in the related field can be filled, and the product market can be enriched.

In addition, the present disclosure does not particularly limit the type of the vehicle. For example, the vehicle may be an unmanned vehicle provided with a vehicle machine, a manned vehicle, a new energy vehicle, or a conventional energy (fossil energy) vehicle.

Referring to fig. 13, the car machine and the converter are layered according to a data transmission protocol, and sequentially include, from top to bottom, an application layer, a transmission layer, a network layer, a data link layer, and a physical layer.

As an optional implementation manner, the process of transmitting the media data in the system is briefly described by taking the case that the media data is transmitted from the car machine to the converter.

Referring to fig. 7 and 13, the car machine serves as a sending end of the media data, and the converter serves as a receiving end of the media data; the hub between the two is responsible for expanding the data from one path to multiple paths, so that the hub does not perform other processing on the data from the protocol perspective.

A vehicle end:

step 1, preprocessing the media data to obtain binary media data, and then transmitting a data packet A comprising the binary media data to a next layer through an application layer (such as RTP (real-time transport protocol));

step 2, adding the length (length) and the sequence number (seq) of a data packet 'UDP + A' or 'TCP + A' based on a transmission layer (for example, UDP (user datagram protocol) or TCP (transmission control protocol)), and transmitting the added data packet 'UDP + A' or 'TCP + A' to the next layer;

step 3, adding the length (length), the source address (IP) and the destination address (IP) of the data packet 'IP + UDP + A' or 'IP + TCP + A' based on the network layer (for example, IP (Internet protocol)) and transmitting the added data packet 'IP + UDP + A' or 'IP + TCP + A' to the next layer;

step 4, based on the length (length) of the data packet 'USB + IP + UDP + A' or 'USB + IP + TCP + A' and the packet format of the data packet added to the data link layer (such as USB (universal serial bus)), the added data packet 'USB + IP + UDP + A' is transmitted to the next layer;

and 5, sending the data packet 'USB + IP + UDP + A' or 'USB + IP + TCP + A' to a converter end by a physical layer (for example, a USB data line can be Hardware).

The converter end:

and the data packet is completely symmetrical to the vehicle end, and the data packet can be reversely decoded layer by layer, which is not described herein.

It should be noted that, the protocol stack needs to be established layer by layer when the system is powered on, and after the whole data path is established, the application layer can start to transmit data. When the device in the system is powered off and has no battery, the protocol stack on the device is released, and the device needs to be rebuilt after being powered on again.

From the perspective of programs, taking an android program as an example, referring to fig. 14, the car machine and the converter are layered according to a driving flow of an operating program, and sequentially include an APP layer, a Framework layer, a Native layer, an Init layer, and a Kernel layer from top to bottom.

As an alternative embodiment, the Kernel layer is based on Linux and implemented by C language; the Kernel layer includes a driver layer and a file system. For example, in response to the converter being powered up via the USB data lines (physical lines), the driver layer inside the Kernel layer, and the file system, can start running accordingly.

According to the partition standard of the android program, all the android layers from the Init layer to the Framework layer belong to the android layer. The Init process is a process No. 0 of an android layer, the kernel process starts the Init process, and the process is needed for interaction with a file system. The Native layer and the Framework layer run some built-in APPs and other services (services), such as page unlocking, notification bar pull-down, wi-Fi, bluetooth, address book and the like. The Init layer and the Native layer are both realized by C + + language, and the Framework layer is realized by Java language.

The foregoing describes the general principles of the present disclosure in conjunction with specific embodiments, however, it is noted that the advantages, effects, etc. mentioned in the present disclosure are merely examples and are not limiting, and they should not be considered essential to the various embodiments of the present disclosure. Furthermore, the foregoing disclosure of specific details is for the purpose of illustration and description and is not intended to be limiting, since the disclosure will be described in detail with reference to specific details.

In the present specification, the embodiments are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same or similar parts in the embodiments are referred to each other. For the system embodiment, since it basically corresponds to the method embodiment, the description is relatively simple, and reference may be made to the partial description of the method embodiment for relevant points.

The block diagrams of devices, apparatuses, systems referred to in this disclosure are only given as illustrative examples and are not intended to require or imply that the connections, arrangements, configurations, etc. must be made in the manner shown in the block diagrams. These devices, apparatuses, devices, systems may be connected, arranged, configured in any manner, as will be appreciated by those skilled in the art. Words such as "including," "comprising," "having," and the like are open-ended words that mean "including, but not limited to," and are used interchangeably therewith. The words "or" and "as used herein mean, and are used interchangeably with, the word" and/or, "unless the context clearly dictates otherwise. The word "such as" is used herein to mean, and is used interchangeably with, the phrase "such as but not limited to".

The methods and apparatus of the present disclosure may be implemented in a number of ways. For example, the methods and apparatus of the present disclosure may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above-described order for the steps of the method is for illustration only, and the steps of the method of the present disclosure are not limited to the order specifically described above unless specifically stated otherwise. Further, in some embodiments, the present disclosure may also be embodied as programs recorded in a recording medium, the programs including machine-readable instructions for implementing the methods according to the present disclosure. Thus, the present disclosure also covers a recording medium storing a program for executing the method according to the present disclosure.

It is also noted that in the apparatus, devices, and methods of the present disclosure, various components or steps may be broken down and/or re-combined. These decompositions and/or recombinations are to be considered equivalents of the present disclosure.

The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the disclosure. Thus, the present disclosure is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

The foregoing description has been presented for purposes of illustration and description. Furthermore, the description is not intended to limit embodiments of the disclosure to the form disclosed herein. While a number of example aspects and embodiments have been discussed above, those of skill in the art will recognize certain variations, modifications, alterations, additions and sub-combinations thereof.

Claims

1. A media playback system for a head mounted display device, comprising:

media data processing device comprising a data input first interface and at least one data output first interface,

the data input first interface is used for receiving media data input by the vehicle machine, and the at least one data output first interface is used for outputting the media data processed by the media data processing device;

and the head-mounted display equipment comprises a data input second interface which is in communication connection with the data output first interface and is used for receiving the processed media data, and the head-mounted display equipment is used for playing according to the processed media data.

2. The system of claim 1, wherein the media data processing device comprises:

a hub comprising a data input interface and at least one data output second interface, wherein the data input interface of the hub is used as the data input first interface; the concentrator is used for distributing the received media data;

at least one converter comprising a third interface for data input and at least one interface for data output,

wherein the data output interface of the at least one converter is used as the first data output interface,

the data input third interface is in communication connection with the corresponding data output second interface and is used for receiving the media data,

the converter is used for processing the media data to obtain the processed media data.

3. The system of claim 1, wherein the media data processing device comprises:

a converter comprising a data input interface and at least one data output interface, wherein the data input interface of the converter is used as the data input first interface, the data output interface of the converter is used as the data output first interface,

4. The system of claim 3, wherein the converter is further configured to stream the received media data according to a number of the head mounted display devices.

5. The system of claim 2, 3 or 4, wherein the converter comprises:

and the at least one switch is used for controlling whether to skip processing of the media data distributed to the head-mounted display equipment correspondingly connected according to the type of the head-mounted display equipment correspondingly connected with the converter.

6. The system of claim 1, wherein the media data processing device comprises:

a hub comprising a data input interface and at least one data output interface, wherein the data input interface of the hub is used as the data input first interface, the data output interface of the hub is used as the data output first interface,

the hub is used for processing the media data to obtain the processed media data;

and the head-mounted display equipment is also used for processing the processed media data and then playing the processed media data.

7. The system of claim 2, wherein,

the media data processing device is powered on through the data input first interface;

the data output first interface is also used for supplying power to the head-mounted display equipment through being connected with the data input second interface;

and the data output second interface is also used for supplying power to the converter by being connected with the data input third interface.

8. The system of any one of claims 2, 3, 4 and 7, wherein the system further comprises:

the vehicle machine comprises at least one data output third interface, wherein the data output third interface is in communication connection with the data input first interface and is used for sending the media data to the media data processing device.

9. The system of claim 8, wherein the system further comprises:

the controller comprises a control signal input end and a control signal output end, wherein the control signal input end is used for receiving control information input by a user, and the control signal output end is used for sending a control command formed by the controller according to the control information to the vehicle machine.

10. The system of claim 8, wherein the car machine further comprises at least one audio data output first interface, the system further comprising:

at least one sound device, which comprises an audio data input first interface, the audio data input first interface is in communication connection with the corresponding audio data output first interface and is used for receiving the audio data sent by the vehicle machine,

wherein the sound is used for playing the audio data.

11. The system of claim 8, wherein the car machine and the converter are layered according to a data transmission protocol, and comprise an application layer, a transport layer, a network layer, a data link layer, and a physical layer from top to bottom.

12. The system of claim 8, wherein the car machine and the converter are layered according to a driving flow of the running program, and sequentially comprise an APP layer, a Framework layer, a Native layer, an Init layer and a Kernel layer from top to bottom.

13. An in-vehicle media playback system for a head-mounted display device, comprising:

the car machine comprises at least one data output third interface and at least one audio data output first interface;

the media data processing device comprises a data input first interface and at least one data output first interface, wherein the data input first interface is in communication connection with the data output third interface and is used for receiving media data sent by the vehicle machine, and the at least one data output first interface is used for outputting the media data processed by the media data processing device;

14. The system of claim 13, wherein the media data processing device comprises:

15. The system of claim 13, wherein the media data processing device comprises:

a converter including a data input interface and at least one data output interface, wherein the data input interface of the converter is used as the first data input interface, the data output interface of the converter is used as the first data output interface,

16. The system of claim 15, wherein the converter is further configured to stream the received media data according to the number of head mounted display devices.

17. The system of claim 14, 15 or 16, wherein the converter comprises:

18. The system of claim 13, wherein the media data processing device comprises:

19. The system of claim 13, wherein the system further comprises:

at least one speaker including a first interface for inputting audio data,

the audio data input first interface is in communication connection with the corresponding audio data output first interface and is used for receiving the audio data sent by the vehicle-mounted computer,

wherein the sound is used for playing the audio data.

20. The system of claim 13, wherein the vehicle machine further comprises at least one control command input interface for receiving control commands, the system further comprising:

a controller including a control signal input terminal and a control signal output terminal,

the control signal input end is used for receiving control information input by a user, and the control signal output end is in communication connection with the control instruction input interface and used for sending a control instruction formed by the controller according to the control information input by the user to the vehicle-mounted computer.

21. The system of claim 14, wherein,

the media data processing device is connected with the data input first interface through the data output third interface and is powered on;

22. The system according to any one of claims 14, 15 and 16, wherein the car machine and the converter are layered according to a protocol of data transmission, and are an application layer, a transport layer, a network layer, a data link layer and a physical layer from top to bottom.

23. The system according to any one of claims 14, 15, 16 and 18, wherein the car machine and the converter are layered according to a driving flow of the running program, and sequentially comprise an APP layer, a Framework layer, a Native layer, an Init layer and a Kernel layer from top to bottom.

24. A vehicle, wherein the vehicle comprises a system according to any one of claims 13-23.