CN111866411A - Content display device, method, apparatus, and computer-readable storage medium - Google Patents

Content display device, method, apparatus, and computer-readable storage medium Download PDF

Info

Publication number
CN111866411A
CN111866411A CN201910362300.7A CN201910362300A CN111866411A CN 111866411 A CN111866411 A CN 111866411A CN 201910362300 A CN201910362300 A CN 201910362300A CN 111866411 A CN111866411 A CN 111866411A
Authority
CN
China
Prior art keywords
display device
content display
content
visible light
pattern
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910362300.7A
Other languages
Chinese (zh)
Other versions
CN111866411B (en
Inventor
王楠
刘冰洋
李笑昕
沈蕾
虞险云
于丹丹
李德忠
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nokia Shanghai Bell Co Ltd
Nokia Oyj
Original Assignee
Nokia Shanghai Bell Co Ltd
Nokia Networks Oy
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Shanghai Bell Co Ltd, Nokia Networks Oy filed Critical Nokia Shanghai Bell Co Ltd
Priority to CN201910362300.7A priority Critical patent/CN111866411B/en
Publication of CN111866411A publication Critical patent/CN111866411A/en
Application granted granted Critical
Publication of CN111866411B publication Critical patent/CN111866411B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/268—Signal distribution or switching
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B10/00—Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
    • H04B10/11—Arrangements specific to free-space transmission, i.e. transmission through air or vacuum
    • H04B10/114—Indoor or close-range type systems
    • H04B10/116—Visible light communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/22—Adaptations for optical transmission
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3102—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM] using two-dimensional electronic spatial light modulators
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179—Video signal processing therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Optical Communication System (AREA)

Abstract

Embodiments of the present disclosure relate to a content display apparatus, method, apparatus, and computer-readable storage medium. The content display device described herein includes: a deformation in a housing of the content display device, the deformation adapted to reflect the combined visible light and to cause a change in a pattern characteristic of the combined visible light for positioning the content display device; and a Visible Light Communication (VLC) receiver disposed at a position in the housing corresponding to the deformation, and configured to convert the light signal emitted in the form of combined visible light into content corresponding to the position of the content display device. The method combines the visible light communication technology with the structured light positioning technology, reduces the number of required wireless routers, provides higher data rate, and simultaneously ensures data security.

Description

Content display device, method, apparatus, and computer-readable storage medium
Technical Field
Embodiments of the present disclosure relate generally to the field of communications technology, and more particularly, to a device, method, apparatus, and computer-readable storage medium for content display.
Background
As user demands for video experiences continue to increase, simulation techniques such as interactive Virtual Reality (VR)/Augmented Reality (AR) techniques that provide ultra-high definition image quality and enable participants to interact with the created virtual environment, even being fully immersed therein, have emerged. Such interactive technology has a perception function, and can capture the reaction and behavior of the participant and then generate image content adapted to the reaction and behavior of the participant through computer processing.
Wireless Local Area Networks (WLANs) that conform to the 802.11 family of standards are the most common technology for providing effective bandwidth to VR-enabled wireless devices. Currently, to meet the demand of multiple users to watch VR images or experience VR games simultaneously, the wireless network coverage can be expanded and the available network bandwidth can be increased by increasing the number of wireless routers (e.g., Wi-Fi APs). However, interference between Wi-Fi APs may occur, degrading the user experience.
Disclosure of Invention
In general, example embodiments of the present disclosure propose content display devices, methods, apparatuses, and computer-readable storage media.
In a first aspect, a content display device is provided. The content display apparatus includes: a deformation in a housing of the content display device, the deformation adapted to reflect the combined visible light and to cause a change in a pattern characteristic of the combined visible light for positioning the content display device; and a Visible Light Communication (VLC) receiver disposed at a position in the housing corresponding to the deformation, and configured to convert the light signal emitted in the form of combined visible light into content corresponding to the position of the content display device.
In a second aspect, an integrated communication device is provided. The integrated communication device includes a Visible Light Communication (VLC) transmitter and a combined light projector. The VLC transmitter is configured to: modulating the content data signal into an optical signal; and emitting the optical signal in the form of visible light. The combined light projector is configured to: combining the visible light with the pattern features to obtain combined visible light; and projecting the combined visible light.
In a third aspect, a media server is provided. The media server includes at least one processor and at least one memory including computer program code. The at least one memory and the computer program code are configured to, with the at least one processor, cause the media server to: a first communication address for downlink data transmission and a second communication address different from the first communication address for uplink data transmission are set for the content display apparatus according to the first aspect.
In a fourth aspect, a content display system is provided. The content display system includes: a content display device according to the first aspect, an integrated communication device according to the second aspect, and a media server according to the third aspect.
In a fifth aspect, a method for displaying content is provided. The method comprises the following steps: receiving, from the integrated communication device, an optical signal emitted in the form of combined visible light, the optical signal being transmitted based on positional information of the content display device, the positional information of the content display device being determined using deformation of a housing located at the content display device; and converting the light signal into content corresponding to a location of the content display device.
In a sixth aspect, a method for communication is provided. The method comprises the following steps: modulating the content data signal into an optical signal; emitting the optical signal in the form of visible light; combining the visible light with the pattern features to obtain combined visible light; and projecting the combined visible light.
In a seventh aspect, a method for communication is provided. The method comprises the following steps: a first communication address for downlink data transmission and a second communication address different from the first communication address for uplink data transmission are set for the content display apparatus according to the first aspect.
In an eighth aspect, an apparatus for displaying content is provided. The device includes: means for receiving from the integrated communication device an optical signal emitted in a combined visible form, the optical signal being transmitted based on location information of the content display device, the location information of the content display device being determined using a deformation of a housing located at the content display device; and means for converting the light signal into content corresponding to a location of the content display device.
In a ninth aspect, an apparatus for communication is provided. The device includes: means for modulating the content data signal into an optical signal; means for transmitting an optical signal in the form of visible light; means for combining visible light with the pattern features to obtain combined visible light; and means for projecting the combined visible light.
In a tenth aspect, an apparatus for communication is provided. The device includes: means for setting a first communication address for downlink data transmission and a second communication address different from the first communication address for uplink data transmission for the content display apparatus according to the first aspect.
In an eleventh aspect, a computer-readable storage medium is provided, having a computer program stored thereon. The computer program comprises instructions which, when executed by a processor on the device, cause the device to perform the method according to the fifth aspect.
In a twelfth aspect, example embodiments of the present disclosure provide a computer-readable storage medium having a computer program stored thereon. The computer program comprises instructions which, when executed by a processor on the device, cause the device to perform the method according to the sixth aspect.
In a thirteenth aspect, example embodiments of the present disclosure provide a computer-readable storage medium having a computer program stored thereon. The computer program comprises instructions which, when executed by a processor on the device, cause the device to perform the method according to the seventh aspect.
It should be understood that the statements herein reciting aspects are not intended to limit the critical or essential features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.
Drawings
The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. In the drawings, like or similar reference characters designate like or similar elements, and wherein:
fig. 1 illustrates an example communication system in which embodiments of the present disclosure may be implemented;
FIG. 2 shows a schematic diagram of the structured light localization principle;
FIG. 3 shows a flow diagram of an interaction process according to an example embodiment of the present disclosure;
FIG. 4A shows a schematic diagram of a content display device according to an example embodiment of the present disclosure;
fig. 4B illustrates a block diagram of a Visible Light Communication (VLC) receiver according to an example embodiment of the present disclosure;
FIG. 5 shows a flow diagram of a method for implementation at a content display device, according to an example embodiment of the present disclosure;
fig. 6A shows a block diagram of an integrated communication device according to an example embodiment of the present disclosure;
fig. 6B illustrates a block diagram of a Visible Light Communication (VLC) transmitter, in accordance with an example embodiment of the present disclosure;
fig. 7 shows a flow diagram of a method for implementation at an integrated communication device according to an example embodiment of the present disclosure;
FIG. 8 shows a block diagram of a media server according to an example embodiment of the present disclosure;
fig. 9 shows a flow diagram of a method for implementation at a media server according to an example embodiment of the present disclosure;
FIG. 10 illustrates a block diagram of a device suitable for implementing example embodiments of the present disclosure.
Detailed Description
Some example embodiments will be described below with reference to the accompanying drawings. While example embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.
The term "Visible Light (VLC) communication" as used herein refers to a wireless communication method of directly transmitting an optical signal in the air using light in the visible light band as an information carrier. The visible light communication technology can achieve data rates of 1Gbps to 3.4 Gbps. Fluorescent lamps, incandescent lamps, fluorescent lamps, Light Emitting Diodes (LEDs), etc. may be used as the light source of visible light. For convenience of discussion, example embodiments of the present disclosure are described with an LED as an example of a light source of visible light.
The term "combined visible light" as used herein refers to visible light having structural or pattern features and modulated thereon and carrying a digital signal. The structural or pattern features may include stripe patterns, spot patterns, circle patterns, grid patterns, and any suitable combination thereof, as may be desired. By projecting the combined visible light to a device supporting the VLC technology, it is possible to simultaneously realize the functions of measuring the position information of the device and transmitting data to the device.
The term "content display device" as used herein refers to a device for displaying imagery with wireless communication capabilities and may be a multimedia player, a tablet, a smart phone, a wearable device, or the like. For ease of discussion, example embodiments of the present disclosure are described with a Virtual Reality (VR)/Augmented Reality (AR) kiosk as an example of a content display device.
The term "Ultra High Definition (UHD)" as used herein refers to ultra high definition, with resolution up to the 4K and above standard. For example, 4K is a 3840 by 2160 pixel resolution standard, and 8K is a 7680 by 4320 pixel resolution standard. The term "High Definition (HD)" refers to full high definition above 720P, with resolution reaching the standard of 1280 × 720 pixels above. The term "Standard Definition (SD)" refers to standard definition, which can reach the resolution standard of 720 × 480 pixels or more.
The term "circuitry" as used herein refers to one or more of the following:
(a) hardware-only circuit implementations (such as implementations in only analog and/or digital circuitry); and
(b) a combination of hardware circuitry and software, such as (if applicable): (i) a combination of analog and/or digital hardware circuitry and software/firmware, and (ii) any portion of a hardware processor and software (including a digital signal processor, software, and memory that work together to cause an apparatus, such as an OLT or other computing device, to perform various functions); and
(c) a hardware circuit and/or processor, such as a microprocessor or a portion of a microprocessor, that requires software (e.g., firmware) for operation, but may lack software when software is not required for operation.
The definition of circuit applies to all usage scenarios of this term in this application, including any claims. As another example, the term "circuitry" as used herein also covers an implementation of merely a hardware circuit or processor (or multiple processors), or a portion of a hardware circuit or processor, or software or firmware accompanying it. For example, the term "circuitry" would also cover a baseband integrated circuit or processor integrated circuit or a similar integrated circuit in an OLT or other computing device, as applicable to the particular claim element.
The terms "include" and variations thereof as used herein are inclusive and open-ended, i.e., "including but not limited to. The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment". Relevant definitions for other terms will be given in the following description.
Currently, with the popularity of VR/AR technology, more and more UHD VR/AR applications, such as interactive VR/AR video or gaming applications, are popular with a wide range of users. As previously mentioned, when conducting a VR/AR experience, the VR/AR system needs to capture the participant's reactions and behaviors to translate into the necessary interactive inputs. For example, the user's position in the virtual environment may be located by tracking the user's head movements through a head mounted VR kiosk used by the user. This requires the head-mounted VR/AR kiosk to provide high precision tracking and positioning functions. In order not to restrict the movement of the user, the head-worn VR/AR all-in-one machine generally employs wireless communication technology. Meanwhile, in order not to reduce the user experience, the head-mounted VR/AR all-in-one machine should have the smallest volume and light weight. However, in a conventional VR/AR kiosk, the functions for tracking and locating and the functions for wireless communication are provided by two separate systems, respectively. This is clearly disadvantageous to the weight, volume and cost of the VR/AR combination.
On the other hand, to support UHD 360 degree panoramic technologies, such as VR/AR video applications, sufficient WLAN coverage and to meet bandwidth requirements far above the SD standard are required. However, the data rates provided by the commonly employed 802.11 family of standards are not sufficient to support simultaneous UHD VR/AR experiences for many users. By way of example, 802.11ay is the highest data rate wireless standard of the current 802.11 family of standards. According to the standard established by IEEE, 802.11ay can achieve a single-stream transmission rate of 44 Gbps and a four-stream concurrent transmission rate of 176 Gbps, wherein 44 Gbps is used for a downlink and 132 Gbps is used for an uplink. Assuming that in an indoor environment capable of providing VR/AR video or gaming experiences, such as a theater, a gaming bar, a gaming cabin, a cabin of an airplane or cruise ship, etc., a downlink data rate required by a single user is 2Gbps, one 802.11ay AP can only support approximately 22 users for simultaneous experiences.
As previously mentioned, one solution is to extend the coverage of the WLAN and provide adequate data rates by deploying wireless routers at high density, such as Wi-Fi APs. However, this solution faces at least the following problems: 1) the wireless routers interfere with each other, so that the effective transmission rate is reduced; 2) it is very difficult to allocate radio spectrum resources for wireless routers deployed at high density; 3) wireless routers can cause interference to other radio communication systems deployed within the same scenario; and 4) data transmitted via Wi-Fi is easily intercepted over the air, so that data security is not guaranteed.
The inventor realizes that visible light communication has the advantages of high transmission rate, strong data security, no electromagnetic interference, no need of spectrum authentication and the like, and if the Visible Light Communication (VLC) technology can be complemented with radio communication technologies such as Wi-Fi, LTE, 5G and the like, the problems can be well solved.
To this end, example embodiments of the present disclosure propose an interactive communication mechanism that combines VLC technology with structured light technology. The mechanism modulates media data into an optical signal transmitted with visible light as a carrier and combines the visible light with pattern features for positioning, thereby forming a combined visible light. As such, when the combined visible light is projected to a content display device (e.g., a head-mounted VR device, VR kiosk), the content display device may receive streaming media data via a downlink using, for example, a VLC enabled receiver. Meanwhile, since a part of the combined visible light is reflected by the content display device, so that the pattern characteristics of the part of the combined visible light are changed, the position information of the content display device can be determined based on the degree of the change.
In other words, the communication mechanism according to the exemplary embodiment of the present disclosure achieves the functions of positioning and data transmission by means of combining visible light at the same time, which will greatly alleviate the problem of insufficient effective bandwidth, reduce the number of required wireless routers, and provide a high-precision positioning function. Such interactive communication mechanisms make it possible for more users to simultaneously engage in a VR/AR video or gaming experience within the same space.
In particular, such a communication mechanism can be well integrated with an indoor environment with limited electromagnetic wave transmission and many obstacles, and is more energy-saving and economical in practice because visible light sources (e.g., LEDs, incandescent lamps, fluorescent lamps, etc.) are widely present therein.
Furthermore, the communication mechanism according to the example embodiments of the present disclosure is more secure and reliable than a communication mechanism that relies entirely on WLAN.
Fig. 1 illustrates an example communication system in which embodiments of the present disclosure may be implemented. As shown in fig. 1, the communication system 100 includes a content display device 110, an integrated communication device 120, a media server 130, a wireless router 140, and a route switching device 150.
The content display device 110 may wirelessly communicate with the media server 130 via the wireless router 140 and the route switching device 150, e.g., to send uplink data to the media server 130 or to receive downlink data from the media server 130. The content display device 110 and the integrated communication device 120 communicate wirelessly using VLC technology, for example, the content display device 110 may receive downlink data from visible light projected by the integrated communication device 120. Details will be discussed later with respect to the content display device 110.
The integrated communication device 120 communicates with the media server 130 via a broadband local area network (e.g., via gigabit ethernet) or any suitable network, wired or wirelessly. In some example embodiments, the integrated communication device 120 may be configured to request the content data signal from the media server 130. Details will be discussed later with respect to the integrated communication device 120.
In the communication system shown in fig. 1, the media server 130 may act as a data source providing a content data signal to the integrated communication device 120 to cause the integrated communication device 120 to transmit the content data signal to the content display device 110. In other example embodiments, the media server 130 may retrieve content data from a remote node such as an application server, a portal server, a content server, or a cloud server (not shown) via the internet and provide it to the integrated communication device 120. In such embodiments, the content server may store all content data and act as a data source, and the portal server and application server may be configured to support VR/AR applications installed on the content display device 110 and provide an Electronic Program Guide (EPG) system to provide indexing and navigation of various services to the content display device 110. As will be discussed in detail later with respect to the media server 130.
The wireless router 140 is connected to the media server via a route switching device 150 and is configured to provide wireless network coverage to the indoor environment in which the user is located. Wireless router 140 may be a network device conforming to the 802.11 family of standards or implemented by any suitable device, such as a Wi-Fi AP, although the scope of the disclosure is not limited in this respect.
Routing switch device 150 may be any suitable network device capable of implementing network interconnections, and the scope of the present disclosure is not limited in this respect.
In particular, in an example embodiment, the communication system 100 may be a Content Delivery Network (CDN) architecture based communication system. At this point, the media server 130 may act as a CDN edge delivery server or edge node, while the remote nodes may act as central content servers.
It should also be understood that communication system 100 is described for exemplary purposes only and does not imply any limitation as to the scope of the present disclosure. For example, example embodiments of the present disclosure may also be applied to systems other than the communication system 100. The number of elements or entities shown is merely an example and not a limitation. Moreover, the elements or entities may communicate using any communication technique currently known and developed in the future. By way of example, in a scene such as a VR/AR theater, a gaming bar, or a passenger cabin of an airplane or cruise ship that supports a VR/AR display system, there may be many users that are simultaneously engaged in a VR/AR experience. At this time, the communication system 100 may include more than one content display device 110 and more than one integrated communication device 120, and a single integrated communication device 120 may correspond to one or more content display devices 110.
Example embodiments of the present disclosure track the motion of the content display device 110 by means of structured light-based measurement techniques, using the principle that pattern features of structured light change when encountering obstacles or persons, thereby enabling high-precision positioning of the user. Fig. 2 illustrates the structured light localization principle. As shown in fig. 2, when the structured light having a stripe pattern projected from the projector 210 encounters the convex structure 220, its pattern characteristics are changed such as distorted or deformed. The camera 230 can capture the reflected structured light with the changed pattern feature, and then calculate the position of the protruding structure 220 according to the change degree of the pattern feature. Many algorithms are known in computing location information and are not described in detail herein.
Fig. 3 shows a flowchart of an example interaction process, according to an example embodiment of the present disclosure. For discussion purposes, the example interaction process 300 will be described with reference to FIG. 1. The process 300 may involve the content display device 110, the integrated communication device 120, and the media server 130 as shown in fig. 1. It should be appreciated that although process 900 is described with respect to communication system 100 of fig. 1, the process illustrated in fig. 3 is equally applicable to other communication scenarios.
In process 300, media server 130 sets (305) a first communication address for downlink data transmissions and a second communication address for uplink transmissions for content display device 110. Depending on the wireless communication technology used, the communication address may comprise an IP address or any other type of wireless communication address, such as an address of a device according to the bluetooth protocol, an address of a device according to the ZigBee protocol, etc.
According to example embodiments of the present disclosure, the content display device 110 may be implemented by any suitable device that supports image/video playback, VR/AR display systems, including but not limited to multimedia players, smart phones, laptops, tablets, wearable devices (e.g., head-mounted VR devices, VR/AR kiosks, etc.), and the like.
The media server 130 may employ any suitable protocol or mechanism to set and manage communication addresses for the content display device 110, such as a dynamic IP address mechanism and/or a static IP address machine based on Netconf network configuration protocol. According to an example embodiment of the present disclosure, the first communication address set by the media server 130 is different from the second communication address, and the two communication addresses respectively correspond to two wireless communication mechanisms supported by the content display device 110, which will be discussed in detail later.
The media server 130 sets (310) a first communication address for the integrated communication device 120.
Optionally, the content display device 110 may send 315 a content data signal request to the media server 130, for example, via the wireless router 140, with the set second communication address. The content data signal request may include a configuration and settings of the content display device 110, such as a first communication address and a second communication address. In such an embodiment, the media server then transmits at least the first communication address in the configuration of the content display device 110 to the corresponding integrated communication device 120. Optionally, the content display device 110 may also receive data from the media server 130, for example, via the wireless router 140, using the set second communication address.
The media server 130 transmits (320) the content data signal to the integrated communication device 120. The content data signal may include, but is not limited to, multimedia files, VR/AR video streams, and the like. In an example embodiment, the media server 130 may transmit the content data signal in response to the content data signal request, or may transmit directly.
The integrated communication device 120 modulates (325) the content data signal into an optical signal, emits (330) the optical signal in the form of visible light, combines the visible light with the pattern feature, and acquires (335) the combined visible light. The pattern features combined with the visible light may include at least one of a stripe pattern, a speckle pattern, a circle pattern, and a grid pattern.
In an example embodiment, the integrated communication device 120 is a network device that supports visible light communication technology. Furthermore, the integrated communication device 120 may also serve as a lighting device in the indoor environment covered by the communication system 100. By way of example, the integrated communication device 120 may be installed within a venue that provides a VR/AR video or gaming experience in which one or more users are viewing VR/AR content using the content display device 110.
The integrated communication device 120 then projects (340) the combined visible light. In an example embodiment, the housing of the content display device 110 has a deformation adapted to receive and reflect light rays (e.g., combined light). Since the combined light has a pattern feature, the pattern feature may change when the combined light is projected onto the content display device. As described above, the principle that pattern features of structured light change when encountering an obstacle or a person can be used to track the motion of the user or a particular part of the user's body (e.g., the head). In this way, the deformation of the housing of the content display device may act as an identification block to locate the head movement of the user.
The integrated communication device 120 receives 345 the combined visible light reflected by the content display device 110. As described above, the pattern features of the combined visible light have changed, and based on the change in the pattern features, the integrated communication device 120 determines (350) location information of the content display device 110.
In some example embodiments, the position of the content display device 110 may be defined by multiple degrees of freedom (nDoF). For example, nDoF may include three degrees of freedom (3DoF) and six degrees of freedom (6 DoF). When the content display apparatus is positioned using the 3DoF, the motion or movement of the user can be reflected in three degrees of freedom, up and down, left and right, front and back, and the like. The 6DoF is based on the 3DoF and additionally considers three degrees of freedom of pitch, yaw and roll. Thus, when the content display device is positioned using 6DoF, the motion or movement of the user can be reflected in the above six degrees of freedom.
In some example embodiments, the integrated communication device 120 may also determine the speed of movement of the content display device 110 based on, for example, changes in pattern features over a period of time.
The content display device 110 may convert (355) the light signal emitted in the form of combined visible light into content for display. As an example, the content may be video or video content.
The integrated communication device 120 then requests (360) a content data signal corresponding to the location information from the media server 130.
As an example, where the content display device 110 is a head mounted VR device, the location information of the content display device 110 corresponds to head movement of the user, which may indicate the user's current field of view. When the location of the user who is conducting the VR/AR experience changes, the screen presented to the user should also change accordingly with its location, and thus content appropriate to the user's current field of view needs to be requested from the media server 130.
In response to the request from the integrated communication device 120, the media server 130 provides (365) a content data signal corresponding to the location to the integrated communication device 120.
Similar to the steps in 325-335, the integrated communication device 120 modulates (370) the received content data signal into an optical signal, emits (375) the optical signal in the form of visible light, and combines (380) the visible light with the pattern features to obtain (380) a combined visible light.
In turn, the integrated communication device 120 projects (385) combined visible light to the content display device 110, the light signal emitted in the form of the combined visible light including a content data signal corresponding to the location of the content display device 110.
The content display device 110 converts (390) the light signal emitted in the form of combined visible light into content corresponding to the location of the content display device 110. In an example embodiment, the content display device 110 performs downlink transmission, i.e., receives the optical signal, using the first communication address. After receiving the optical signal, the content display device 110 may convert the optical signal into an electrical signal and demodulate the electrical signal to obtain a content data signal corresponding to the location. The content display device 110 may then display content associated with the content data signal.
Although the various steps in the above-described interaction process 300 are described in a particular order, this order is for illustrative purposes only and is not limiting. Unless explicitly noted, it should not be understood that such interaction processes are required to be completed in the particular order shown or in sequential order. In some cases, multitasking or parallel processing may be beneficial. Additionally, the interaction process 300 may also include additional operations not shown and/or may omit one or more of the operations shown. By way of example, operations 330 and 335, operation 350 and operation 355 may be performed synchronously, and so on, for example.
Fig. 4A shows a schematic diagram of a content display device according to an example embodiment of the present disclosure. The content display device may be implemented as the content display device 110 shown in fig. 1.
As shown in fig. 4A, the housing of the content display device 110 has a deformation adapted to receive and reflect visible light. The content display device 110 includes a Visible Light Communication (VLC) receiver 412, the VLC receiver 412 being arranged at a position corresponding to the deformation of the housing. In some example embodiments, the VLC receiver 412 may be mounted or mounted on a housing of the content display device 110 to provide the housing with a deformation. As an example, the VLC receiver 412 may be directly mounted on the housing surface of the content display device 110, or a certain area may be hollowed out from the housing surface of the content display device 110, and the VLC receiver 412 may be embedded in the area. Although in fig. 4A, the VLC receiver 412 is shown as being located in a raised structure on the housing of the content display device 410, the VLC receiver 412 may have other topographical structures suitable for reflecting light, such as recessed structures. Alternatively, in the case where the VLC receiver 412 is mounted on the housing of the content display device 110 in the same continuous plane, the presence of the VLC receiver 412 may still cause the pattern characteristics of the reflected visible light to change due to the difference in the material of the VLC receiver 412 and the material of the surface of the housing. As described above, the deformation of the housing may serve as an identification block for locating the head movement of the user, and therefore, as long as the deformation is adapted to reflect visible light and cause a change in the pattern characteristics of the visible light.
In an example embodiment, the content display device 110 may also include a wireless signal transmitter such that the content display device 110 may communicate using other wireless communication technologies such as LTE, LTE-A, 5G, Wi-Fi, Bluetooth, ZigBee, and so on. In some example embodiments, the wireless signal transmitter may communicate with the media server 130 via the wireless router 140 and the route switching device 150. In some example embodiments, the wireless signal transmitter may be replaced with a wireless signal transceiver that functions as both uplink/downlink bi-directional transmission, as the present disclosure is not limited in this respect.
It should be understood that the content display device 110 also includes other components necessary for content display, including but not limited to a core processing unit, a display terminal, drive components, input/output components, touch sensors, data transmission interfaces, power supplies, and the like. For ease of discussion and for simplicity, these components are not shown in the drawings, but it is not intended that embodiments of the disclosure not be equipped with these components, and the scope of the disclosure is not limited in this respect. It should be understood that the routing switch device 150 includes, but is not limited to, a gateway, a router, a switch, etc. having a routing switch function.
Fig. 4B shows a block diagram of a VLC receiver according to an example embodiment of the present disclosure. The VLC receiver may be implemented by the VLC receiver 412 shown in fig. 4A. As shown in fig. 4B, the VLC receiver 412 includes a photodiode 414, an amplifying and filtering module 416, an analog-to-digital (AD) converter 418, a signal processing module 420, and a modulation module 422. It should be appreciated that VLC receiver 412 is merely an example, and that VLC receiver may also include additional components or modules not shown, as the scope of the present disclosure is not limited in this respect.
Fig. 5 shows a flow diagram of a method 500 for implementation at a content display device, according to an example embodiment of the present disclosure. For ease of discussion, the method 500 will be described below in connection with fig. 4A and 4B from the perspective of the content display device 110.
As shown in fig. 5, at block 510, the VLC receiver 412 of the content display device 110 receives the light signal emitted in the form of combined visible light from the integrated communication device 120.
At block 520, the VLC receiver 412 converts the light signal into content corresponding to the location of the content display device 110. According to embodiments of the present disclosure, an optical signal emitted in the form of combined visible light is used to carry content data.
In some example embodiments, one example implementation of the step at block 520 may include: the light signal corresponding to the location of the content display device is received by the VLC receiver 412. The optical signal is converted into an electrical signal by the photodiode 414. The electrical signal is processed by the AD converter 418, the signal processing module 420 and the demodulation module 422, and then the content data signal is acquired. The display device 110 then displays content associated with the content data signal, such as VR/AR video content that is appropriate for the user's current field of view.
In some example embodiments, the content display device 110 further comprises a wireless signal transmitter. The wireless signal transmitter may utilize any suitable wireless communication technology and standard, whether currently known or developed in the future, such as LTE, LTE-a, 5G, Wi-Fi, bluetooth, ZigBee, long range communication (LoRa), and the like. The scope of the present disclosure is not limited in this respect.
Also, in an example embodiment, the VLC receiver 412 of the content display device 110 may be configured to perform downlink data transmissions, such as receiving light signals transmitted in a combined light form, for example, using a first communication address, and the wireless signal transmitter may perform uplink data transmissions, such as sending a registration request, a service request, a content data signal request, etc., to a server using a second communication address different from the first communication address.
The content display device according to the exemplary embodiment of the present disclosure has a deformation adapted to reflect the combined visible light, in particular, by arranging the VLC receiver at a position corresponding to the deformation, so that the functions of positioning and downlink data transmission can be simultaneously realized by processing the combined visible light. Such a content display device has a lower weight, a smaller volume, and a lower cost than a conventional device that employs two independent systems to provide a positioning function and a wireless communication function, respectively.
Furthermore, the content display device according to the example embodiment of the present disclosure may implement interactive communication through a flexible bidirectional high-speed communication mechanism. Because the uplink/downlink data transmission respectively utilizes different wireless communication technologies, the downlink data transmission requiring high data rate is configured to utilize VLC technology, and the uplink data transmission requiring low data rate and bandwidth is configured to utilize other wireless communication technologies, which not only can help to reduce delay, enable image contents such as VR/AR videos and the like to be smoothly displayed, realize real-time interaction with VR/AR video applications, but also can effectively reduce the number of wireless routers required by VR/AR experience places, thereby obviously improving the experience of users when watching VR/AR videos.
Fig. 6A shows a schematic diagram of an integrated communication device according to an example embodiment of the present disclosure. The integrated communication device may be implemented by the integrated communication device 120 as shown in fig. 1. As shown in fig. 6A, the integrated communication device 120 includes a VLC emitter 612 and a combined light projector 614. In an example embodiment, the integrated communication device 120 may also include at least one camera 616.
The at least one camera 616 may be a specially designed infrared camera or any suitable camera. In an example embodiment, the at least one camera may be arranged independently of the integrated communication device 120. In particular, a two-camera arrangement may also be employed, where permitted.
According to an example embodiment of the present disclosure, the integrated communication device 120 may be an optical-to-electrical communication device that supports optical-to-electrical conversion. It should be understood that the integrated communication device 120 may also include other physical or virtual elements or components, such as digital-to-analog converters, and the number of elements or entities shown is merely an example. For ease of discussion, an integrated communication device including a camera is described below as an example. It should be noted, however, that all of the features described are equally applicable to embodiments in which the camera is self-contained.
Fig. 6B shows a schematic diagram of a VLC transmitter according to an example embodiment of the present disclosure. The VLC transmitter may be implemented by the VLC transmitter 612 shown in fig. 6A. As shown in fig. 6B, the VLC transmitter 612 includes a modulation module 622, a signal processing module 624, a digital-to-analog (DA) converter 626, an amplification and biasing module 628, and a Light Emitting Diode (LED) 630. It should be understood that the VLC transmitter 612 illustrated in fig. 6B is merely an example, and that the VLC transmitter may further include additional components or modules not shown, such as a structured light imaging component, etc., and the scope of the present disclosure is not limited in this respect.
Fig. 7 shows a flowchart of a method 700 for implementation at an integrated communication device according to an example embodiment of the present disclosure. For ease of discussion, the method 700 will be described below in conjunction with fig. 6A and 6B from the perspective of the integrated communication device 120.
At block 710, the VLC transmitter 612 modulates the content data signal into a light signal. For example, according to an example embodiment of the present disclosure, a content data signal obtained from a source of the content data signal, e.g., the media server 130, may be modulated by the modulation module 622 of the VLC transmitter 612 and processed via the signal processing module 624, the DA converter 626, and the amplification and bias module 628 to obtain an optical signal.
At block 720, the VLC transmitter 612 transmits the light signal in the form of visible light. For example, according to an example embodiment of the present disclosure, the LED 630 may be used as a light source of visible light. It should be understood that other light sources may be used to emit light signals, such as incandescent lights, fluorescent lights, and the like. Also, the number of light sources is merely an example, and the scope of the present disclosure is not limited in this respect.
At block 730, the combined light projector 614 combines the visible light with the pattern features to obtain combined visible light. Only in respect of the combination of visible light and pattern features, the known structured light principle is applied, and the specific way of achieving the combination will not be described herein.
At block 740, the combined light projector 614 projects combined visible light. As an example, the range of projecting the combined visible light may be limited to a certain spatial range, such as a place where the user is conducting a VR/AR experience.
In some embodiments, at least one camera 616 may receive the combined visible light reflected by the content display device (e.g., deformation of a housing of the content display device) and determine location information of the content display device based on a change in a pattern characteristic of the reflected combined visible light.
In some embodiments, at least one camera 616 may compare the change in the pattern feature to a reference pattern feature and, based on the comparison, determine location information for the content display device. In the context of the present disclosure, a reference pattern feature may be an original, undistorted, or unaltered pattern feature. In addition, as described above, many algorithms are known in calculating location information and therefore are not described in detail herein. Additionally or alternatively, in example embodiments, a dual camera arrangement may be employed, which would provide greater positioning accuracy and reliability.
Additionally or alternatively, in situations where the magnitude of the user action is large, a wide range and low precision positioning may be performed first by the at least one camera 616 to determine the range of motion of the user. Further, a smaller and more accurate positioning is performed within the determined range of motion by the method 700 as shown in fig. 7. In this way, the integrated communication device 120 may implement a wide-range, high-precision multi-level positioning function.
In some example embodiments, the integrated communication device 120 may also request a content data signal corresponding to the location information of the content display device 110 from the media server 130 according to the determined location information.
Additionally or alternatively, the integrated communication device 120 may also determine a speed of motion of the content display device based on a change in a pattern characteristic of the combined visible light reflected over a period of time.
Additionally or alternatively, the integrated communication device 120 may also decide whether to request a content data signal corresponding to the location information from the media server 130 depending on whether the location information of the content display device 110 has changed. In such embodiments, at least one camera 616 detects changes in the location information of content display device 110. If the location information of the content display device 110 changes, meaning that the user's field of view changes, a corresponding content data signal is requested from the media server 130 to be appropriate for the current field of view. Conversely, if the location information has not changed, meaning that the user's field of view has not changed, then no request need be sent.
The integrated communication device and the communication mechanism adopted by the integrated communication device according to the embodiments of the present disclosure can not only track or locate all persons or objects within a spatial range, but also transmit an optical signal to a content display device as a receiving party by forming and projecting combined visible light. Thus, it is possible to benefit from both the high data rate of VLC technology and the high accuracy positioning of structured light technology.
Fig. 8 shows a schematic diagram of a media server according to an example embodiment of the present disclosure. The media server may be implemented as the media server 130 shown in fig. 1.
In the context of the present disclosure, a media server may be implemented with any suitable machine and may be equipped with sufficient resources. For example, as shown in fig. 8, the media server 130 may include at least one processor 812 and at least one memory 814. For example, the memory 814 may be implemented as a Redundant Array of Independent Disks (RAID) for storing frequently used content data. The media server 130 may communicate with the integrated communication device 120 in the communication system via a local area network (e.g., gigabit ethernet). Further, the media server 130 communicates with the wireless router 140 in the communication system via the route switching device 150. In an example embodiment, the media server 130 may also communicate with a remote node, such as an application server, portal server, content server, or cloud server, via the internet. The scope of the present disclosure is not limited in this respect.
Fig. 9 shows a flow diagram of a method 900 for implementation at a media server, according to an example embodiment of the present disclosure. For ease of discussion, 900 will be described below in connection with fig. 8 from the perspective of the media server 130. It should be understood that method 900 may also include additional acts not shown, and the scope of the present disclosure is not limited in this respect.
At block 910, the media server 130 sets a first communication address for downlink data transmission and a second communication address different from the first communication address for uplink data transmission for the content display device 110. Depending on the wireless communication technology used by the content display device 110, the communication address may comprise an IP address or any other type of wireless communication address, such as a device address associated with bluetooth, a device address associated with ZigBee, etc.
In some embodiments, the VLC receiver 412 of the content display device 110 receives light signals transmitted in the form of visible light from, for example, the integrated communication device 120 via a first communication address, while the wireless signal transmitter of the content display device 110 performs uplink data transmissions via a second communication address, such as sending a registration request, a service request, signaling for interaction, a data signal request, etc., to the media server 130.
In some additional example embodiments, the method 900 may also inform the integrated communication device 120 and the media server 130 about the configuration (e.g., the first communication address) of the content display device 110 so that the integrated communication device 120 and the media server 130 may communicate with the content display device 110 using the first communication address.
In the example of fig. 9, at block 920, the media server 130 may send the first communication address to the integrated communication device 120.
Optionally, at block 930, the media server 130 receives a request from the integrated communication device 120 for a content data signal corresponding to the location information of the content display device 110.
Optionally, at block 940, in response to the request from the integrated communication device 120, the media server 130 provides the content data signal to the integrated communication device 120 to cause the integrated communication device 120 to transmit the content data signal to the first communication address.
In some embodiments, the request for the content data signal corresponding to the location information of the content display device includes the location information of the content display device 110. The media server 130 retrieves the corresponding content data signal based on the location information.
In some embodiments, the memory 814 of the media server 130 may store certain multimedia files, such as VR/AR video streams, movies, and the like. When the memory 814 stores content data requested by the integrated communication device 120, the media server 130 may retrieve the content data corresponding to the location information locally and provide it to the integrated communication device 120. Alternatively, when the memory 814 does not store the requested content data, the media server 130 may request retrieval of the content data corresponding to the location information from a remote node in the internet in response to a request from the integrated communication device 120. The remote node may be a remote server or a cloud server, such as a portal server, an application server, a content server, etc., although the scope of the disclosure is not limited in this respect.
It should be understood that method 900 may also include additional acts not shown, and the scope of the present disclosure is not limited in this respect.
A media server according to an example embodiment of the present disclosure may set different communication addresses for different wireless communication technologies. By setting the first communication address for the VLC technology and the second communication address for the other wireless communication technology, the up/down link data transmission can be realized with different wireless communication technologies. In this way, not only can the problems of insufficient network bandwidth, low data rate and the like be solved, but also a flexible and high-speed interactive communication mechanism can be realized.
Fig. 10 illustrates a block diagram of a device 1000 suitable for implementing example embodiments of the present disclosure. The device 1000 may be implemented at or part of the content display device 110, the integrated communication device 120, the media server 130 shown in fig. 1.
As shown in fig. 10, the device 1000 includes one or more processors 1010, one or more memories 1020 coupled to the processors 1010, a communication module 1040 coupled to the processors 1010, and a communication interface (not shown) coupled to the communication module 1040. The memory 1020 stores at least a program 1030.
The communication module 1040 is used for bidirectional communication. The communication module 1040 has at least one antenna for facilitating communication. The communication interface may represent any interface necessary for communication.
The processor 1010 may be of any suitable type suitable to the local technical environment, and may include one or more of the following: general purpose computers, special purpose computers, microprocessors, digital signal controllers (DSPs), and processors based on a multi-core processor architecture. Device 1000 may include multiple processors, such as application specific integrated circuit chips that are subordinate in time to a clock that synchronizes the host processor.
The memory 1020 may include one or more non-volatile memories and one or more volatile memories. Examples of non-volatile memory include, but are not limited to, Read Only Memory (ROM)1024, Electrically Programmable Read Only Memory (EPROM), flash memory, a hard disk, a Compact Disk (CD), a Digital Video Disk (DVD), and other magnetic and/or optical storage devices. Examples of volatile memory include, but are not limited to, Random Access Memory (RAM)1022 and other volatile memory that is not to be maintained during power down.
Computer programs 1030 include computer-executable instructions that are executed by the associated processor 1010. The program 1040 may be stored in the ROM 1024. Processor 1010 may perform any suitable actions and processes by loading programs 1030 into RAM 1022.
Example embodiments of the present disclosure may be implemented by way of program 1030 such that device 1000 may perform any of the processes discussed herein with reference to fig. 1-9. Example embodiments of the present disclosure may also be implemented by hardware or a combination of software and hardware.
In some embodiments, the program 1030 may be tangibly embodied in a computer-readable medium, which may be included in the device 1000 (such as the memory 1020) or other storage device accessible by the device 1000. Device 1000 can load program 1030 from the computer-readable medium into RAM 1022 for execution. The computer readable medium may include any type of tangible, non-volatile memory, such as a ROM, EPROM, flash memory, hard disk, CD, DVD, or the like.
In general, the various example embodiments of this disclosure may be implemented in hardware or special purpose circuits, software, logic or any combination thereof. Certain aspects may be implemented in hardware, while other aspects may be implemented in firmware or software which may be executed by a controller, microprocessor or other computing device. While aspects of the embodiments of the present disclosure are illustrated or described as block diagrams, flow charts, or using some other pictorial representation, it is well understood that the blocks, apparatus, systems, techniques or methods described herein may be implemented in, as non-limiting examples, hardware, software, firmware, special purpose circuits or logic, general purpose hardware or controller or other computing devices, or some combination thereof.
The present disclosure also provides at least one computer program product tangibly stored on a non-transitory computer-readable storage medium. The computer program product comprises computer executable instructions, such as those included in program modules, executed in a device on a target real or virtual processor to implement the method as described above with reference to fig. 1-9. Generally, program modules include routines, programs, libraries, objects, classes, components, data structures, etc. that perform particular tasks or implement particular abstract data types. In various example embodiments, the functionality of the program modules may be combined or divided among the program modules described. Machine-executable instructions for program modules may be executed within local or distributed devices. In a distributed facility, program modules may be located in both local and remote memory storage media.
Computer program code for implementing the methods of the present disclosure may be written in one or more programming languages. These computer program codes may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the computer or other programmable data processing apparatus, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be performed. The program code may execute entirely on the computer, partly on the computer, as a stand-alone software package, partly on the computer and partly on a remote computer or entirely on the remote computer or server.
In the context of the present disclosure, computer program code or related data may be carried by any suitable carrier to enable a device, apparatus or processor to perform various processes and operations described above. Examples of a carrier include a signal, computer readable medium, and the like.
Examples of signals may include electrical, optical, radio, acoustic, or other forms of propagated signals, such as carrier waves, infrared signals, and the like.
The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination thereof. More detailed examples of a computer-readable storage medium include an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.
Additionally, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In some cases, multitasking or parallel processing may be beneficial. Likewise, while the above discussion contains certain specific implementation details, this should not be construed as limiting the scope of any invention or claims, but rather as describing particular embodiments that may be directed to particular inventions. Certain features that are described in this specification in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
Various example embodiments of the technology have been described. Alternatively or additionally to the above, the following examples are described. Features described in any of the examples below may be used with any of the other examples described herein.
Example 1. a content display device, comprising: a deformation in a housing of the content display device adapted to reflect combined visible light and to change a pattern feature of the combined visible light for positioning the content display device; and a Visible Light Communication (VLC) receiver disposed in a position in the housing corresponding to the deformation, and configured to: converting the light signal emitted in the form of the combined visible light into content corresponding to the location of the content display device.
Example 2. the device of example 1, wherein to convert the light signal emitted in the combined visible light form into content corresponding to the location of the content display device comprises to: receiving the light signal corresponding to a location of the content display device; converting the optical signal into an electrical signal; demodulating the electrical signal to obtain a content data signal; and displaying the content associated with the content data signal.
Example 3. the device of example 1, wherein the deformation includes at least one of a convex structure and a concave structure formed on a surface of the housing of the content display device.
Example 4. the apparatus of example 1, wherein the pattern feature comprises at least one of a stripe pattern, a blob pattern, a circle pattern, and a grid pattern.
The device of example 5. according to example 1, wherein the VLC receiver is configured to perform downlink data transmission using the first communication address, and wherein the content display device further comprises: a wireless signal transmitter configured to perform uplink data transmission using a second communication address different from the first communication address.
Example 6. an integrated communication device, comprising: a Visible Light Communication (VLC) transmitter configured to: modulating the content data signal into an optical signal; and emitting the optical signal in the form of visible light; a combined light projector configured to: combining the visible light with pattern features to obtain combined visible light; and projecting the combined visible light.
Example 7. the apparatus of example 6, further comprising: at least one camera configured to: receiving the combined visible light reflected by a content display device; and determining location information of the content display device based on a change in a pattern feature of the reflected combined visible light.
The device of example 8, wherein the VLC transmitter is further configured to: acquiring a content data signal corresponding to the determined location information from a media server.
Example 9. the device of example 7, wherein determining the location information of the content display device comprises: comparing the change in the pattern feature to a reference pattern feature; and calculating the position information of the content display device in a plurality of degrees of freedom based on a result of the comparison.
Example 10 the device of example 6, wherein the VLC emitter comprises a Light Emitting Diode (LED) as a light source for the visible light.
Example 11. the apparatus of example 6, wherein the pattern feature comprises at least one of a stripe pattern, a blob pattern, a circle pattern, and a grid pattern.
Example 12. a media server, comprising: at least one processor; and at least one memory including computer program code; the at least one memory and the computer program code configured to, with the at least one processor, cause the media server to: setting a first communication address for downlink data transmission and a second communication address different from the first communication address for uplink data transmission for the content display apparatus according to example 5.
The media server of example 12, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the media server to: sending the first communication address to the integrated communication device of examples 6-11; and in response to a request from the integrated communication device for a content data signal corresponding to the location information of the content display device, providing the content data signal to the integrated communication device to cause the integrated communication device to transmit the content data signal to the first communication address.
Example 14. a content display system, comprising: the content display device of any of examples 1-5, the integrated communication device of any of examples 6-11, and the media server of any of examples 12-13.
Example 15 a method for displaying content, comprising: receiving, from an integrated communication device, an optical signal emitted in a combined visible light form, the optical signal transmitted based on position information of the content display device, the position information of the content display device determined using deformation of a housing located at the content display device; and converting the light signal into content corresponding to a location of the content display device.
Example 16. the method of example 15, wherein converting the light signal into content corresponding to the location of the content display device comprises: converting the optical signal into an electrical signal; demodulating the electrical signal to obtain a content data signal; and displaying the content associated with the content data signal.
Example 17. the method of example 15, wherein the deformation includes at least one of a raised structure and a recessed structure formed on a surface of the housing of the content display device.
Example 18. the method of example 15, wherein the pattern feature comprises at least one of a stripe pattern, a blob pattern, a circle pattern, and a grid pattern.
Example 19. the method of example 15, further comprising: performing downlink data transmission using the first communication address; and performing uplink data transmission using a second communication address different from the first communication address.
Example 20 a method for communication, comprising: modulating the content data signal into an optical signal; emitting the optical signal in the form of visible light; combining the visible light with pattern features to obtain combined visible light; and projecting the combined visible light.
Example 21. the method of example 20, further comprising: receiving the combined visible light reflected by a content display device; and determining location information of the content display device based on a change in a pattern feature of the reflected combined visible light.
Example 22. the method of example 20, further comprising: acquiring a content data signal corresponding to the determined location information from a media server.
Example 23. the method of example 20, wherein determining the location information of the content display device comprises: comparing the change in the pattern feature to a reference pattern feature; and calculating the position information of the content display device in a plurality of degrees of freedom based on a result of the comparison.
Example 24. the method of example 20, wherein the pattern feature comprises at least one of a stripe pattern, a blob pattern, a circle pattern, and a grid pattern.
Example 25 a method for communication, comprising: setting a first communication address for downlink data transmission and a second communication address different from the first communication address for uplink data transmission for the content display apparatus according to example 5.
Example 26. the method of example 25, comprising: sending the first communication address to the integrated communication device of examples 6-11; and in response to a request from the integrated communication device for a content data signal corresponding to the location information of the content display device, providing the content data signal to the integrated communication device to cause the integrated communication device to transmit the content data signal to the first communication address.
Example 27. an apparatus for displaying content, comprising: means for receiving from an integrated communication device an optical signal emitted in a combined visible form, the optical signal transmitted based on location information of the content display device, the location information of the content display device determined with a deformation of a housing located at the content display device; and means for converting the light signal into content corresponding to a location of the content display device.
Example 28 the apparatus of example 27, wherein the means for converting comprises: means for converting the optical signal into an electrical signal; means for demodulating the electrical signal to obtain a content data signal; and means for displaying the content associated with the content data signal.
Example 29 the apparatus of example 27, wherein the deformation includes at least one of a raised structure and a recessed structure formed on a surface of the housing of the content display device.
Example 30. the apparatus of example 27, wherein the pattern feature comprises at least one of a stripe pattern, a blob pattern, a circle pattern, and a grid pattern.
Example 31. the apparatus of example 27, further comprising: means for performing downlink data transmission using the first communication address; and means for performing an uplink data transmission using a second communication address different from the first communication address.
An apparatus for communication, comprising: means for modulating the content data signal into an optical signal; means for emitting the optical signal in the form of visible light; means for combining the visible light with pattern features to obtain combined visible light; and means for projecting the combined visible light.
Example 33. the apparatus of example 32, further comprising: means for receiving the combined visible light reflected by the content display device; and means for determining positional information of the content display device based on a change in a pattern characteristic of the reflected combined visible light.
Example 34. the apparatus of example 32, further comprising: means for obtaining a content data signal corresponding to the determined location information from a media server.
Example 35 the apparatus of example 32, wherein the means for determining comprises: means for comparing the change in the pattern feature to a reference pattern feature; and means for calculating the positional information of the content display device in a plurality of degrees of freedom based on a result of the comparison.
Example 36. the apparatus of example 32, wherein the pattern feature comprises at least one of a stripe pattern, a blob pattern, a circle pattern, and a grid pattern.
Example 37. an apparatus for communication, comprising: means for setting a first communication address for downlink data transmission and a second communication address different from the first communication address for uplink data transmission for the content display apparatus according to example 5.
Example 38. the apparatus of example 37, further comprising: means for sending the first communication address to the integrated communication device according to examples 6-11; and means for: in response to a request from the integrated communication device for a content data signal corresponding to the location information of the content display device, providing the content data signal to the integrated communication device to cause the integrated communication device to transmit the content data signal to the first communication address.
Example 39 a computer-readable storage medium having stored thereon a computer program comprising instructions that, when executed by a processor on a device, cause the device to perform the method of any of examples 15-19.
Example 40 a computer-readable storage medium having stored thereon a computer program comprising instructions that, when executed by a processor on a device, cause the device to perform the method of any of examples 20-24.
Example 41 a computer-readable storage medium having stored thereon a computer program comprising instructions that, when executed by a processor on a device, cause the device to perform the method of any of examples 25-26.

Claims (32)

1. A content display device, comprising:
a deformation in a housing of the content display device adapted to reflect combined visible light and to change a pattern feature of the combined visible light for positioning the content display device; and
a Visible Light Communication (VLC) receiver disposed in the housing at a position corresponding to the deformation and configured to:
Converting the light signal emitted in the form of the combined visible light into content corresponding to the location of the content display device.
2. The device of claim 1, wherein converting the light signal emitted in the combined visible light form to content corresponding to the location of the content display device comprises:
receiving the light signal corresponding to a location of the content display device;
converting the optical signal into an electrical signal;
demodulating the electrical signal to obtain a content data signal; and
displaying the content associated with the content data signal.
3. The device of claim 1, wherein the deformation comprises at least one of a raised structure and a recessed structure formed on a surface of the housing of the content display device.
4. The apparatus of claim 1, wherein the pattern features comprise at least one of a stripe pattern, a blob pattern, a circle pattern, and a grid pattern.
5. The device of claim 1, wherein the VLC receiver is configured to perform downlink data transmissions using a first communication address, and wherein the content display device further comprises:
a wireless signal transmitter configured to perform uplink data transmission using a second communication address different from the first communication address.
6. An integrated communication device, comprising:
a Visible Light Communication (VLC) transmitter configured to:
modulating the content data signal into an optical signal; and
emitting the optical signal in the form of visible light;
a combined light projector configured to:
combining the visible light with pattern features to obtain combined visible light; and
projecting the combined visible light.
7. The apparatus of claim 6, further comprising:
at least one camera configured to:
receiving the combined visible light reflected by a content display device; and
determining location information of the content display device based on a change in a pattern feature of the reflected combined visible light.
8. The device of claim 7, wherein the VLC transmitter is further configured to:
acquiring a content data signal corresponding to the determined location information from a media server.
9. The device of claim 7, wherein determining location information of the content display device comprises:
comparing the change in the pattern feature to a reference pattern feature; and
based on a result of the comparison, the positional information of the content display device in a plurality of degrees of freedom is calculated.
10. The apparatus of claim 6, wherein the VLC transmitter comprises a Light Emitting Diode (LED) as a light source of the visible light.
11. The apparatus of claim 6, wherein the pattern features comprise at least one of a stripe pattern, a blob pattern, a circle pattern, and a grid pattern.
12. A media server, comprising:
at least one processor; and
at least one memory including computer program code;
the at least one memory and the computer program code configured to, with the at least one processor, cause the media server to:
setting a first communication address for downlink data transmission and a second communication address different from the first communication address for uplink data transmission for the content display apparatus according to claim 5.
13. The media server of claim 12, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the media server to:
sending the first communication address to the integrated communication device of claims 6-11; and
In response to a request from the integrated communication device for a content data signal corresponding to the location information of the content display device, providing the content data signal to the integrated communication device to cause the integrated communication device to transmit the content data signal to the first communication address.
14. A content display system, comprising: the content display device according to any one of claims 1-5, the integrated communication device according to any one of claims 6-11, and the media server according to any one of claims 12-13.
15. A method for displaying content, comprising:
receiving, from an integrated communication device, an optical signal emitted in a combined visible light form, the optical signal transmitted based on position information of the content display device, the position information of the content display device determined using deformation of a housing located at the content display device; and
converting the light signal into content corresponding to a location of the content display device.
16. The method of claim 15, wherein converting the light signal into content corresponding to a location of the content display device comprises:
Converting the optical signal into an electrical signal;
demodulating the electrical signal to obtain a content data signal; and
displaying the content associated with the content data signal.
17. The method of claim 15, wherein the deformation comprises at least one of a raised structure and a recessed structure formed on a surface of the housing of the content display device.
18. The method of claim 15, the pattern features comprising at least one of a stripe pattern, a blob pattern, a circle pattern, and a grid pattern.
19. The method of claim 15, further comprising:
performing downlink data transmission using the first communication address; and
performing uplink data transmission using a second communication address different from the first communication address.
20. A method for communication, comprising:
modulating the content data signal into an optical signal;
emitting the optical signal in the form of visible light;
combining the visible light with pattern features to obtain combined visible light; and
projecting the combined visible light.
21. The method of claim 20, further comprising:
receiving the combined visible light reflected by a content display device; and
Determining location information of the content display device based on a change in a pattern feature of the reflected combined visible light.
22. The method of claim 20, further comprising:
acquiring a content data signal corresponding to the determined location information from a media server.
23. The method of claim 20, wherein determining location information of the content display device comprises:
comparing the change in the pattern feature to a reference pattern feature; and
based on a result of the comparison, the positional information of the content display device in a plurality of degrees of freedom is calculated.
24. The method of claim 20, the pattern features comprising at least one of a stripe pattern, a blob pattern, a circle pattern, and a grid pattern.
25. A method for communication, comprising:
for the content display device according to claim 5, setting a first communication address for downlink data transmission, and setting a second communication address different from the first communication address for uplink data transmission.
26. The method of claim 25, further comprising:
sending the first communication address to the integrated communication device of claims 6-11; and
In response to a request from the integrated communication device for a content data signal corresponding to the location information of the content display device, providing the content signal to the integrated communication device to cause the integrated communication device to transmit the content data signal to the first communication address.
27. An apparatus for displaying content, comprising:
means for receiving from an integrated communication device an optical signal emitted in a combined visible form, the optical signal transmitted based on location information of the content display device, the location information of the content display device determined with a deformation of a housing located at the content display device; and
means for converting the light signal into content corresponding to a location of the content display device.
28. An apparatus for communication, comprising:
means for modulating the content data signal into an optical signal;
means for emitting the optical signal in the form of visible light;
means for combining the visible light with pattern features to obtain combined visible light; and
means for projecting the combined visible light.
29. An apparatus for communication, comprising:
Means for setting a first communication address for downlink data transmission and a second communication address different from the first communication address for uplink data transmission for the content display device according to claim 5.
30. A computer-readable storage medium having stored thereon a computer program comprising instructions which, when executed by a processor on a device, cause the device to perform the method of any one of claims 15-19.
31. A computer-readable storage medium having stored thereon a computer program comprising instructions which, when executed by a processor on a device, cause the device to perform the method of any one of claims 20-24.
32. A computer-readable storage medium having stored thereon a computer program comprising instructions which, when executed by a processor on a device, cause the device to perform the method of any one of claims 25-26.
CN201910362300.7A 2019-04-30 2019-04-30 Content display apparatus, method, device, and computer-readable storage medium Active CN111866411B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910362300.7A CN111866411B (en) 2019-04-30 2019-04-30 Content display apparatus, method, device, and computer-readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910362300.7A CN111866411B (en) 2019-04-30 2019-04-30 Content display apparatus, method, device, and computer-readable storage medium

Publications (2)

Publication Number Publication Date
CN111866411A true CN111866411A (en) 2020-10-30
CN111866411B CN111866411B (en) 2023-06-23

Family

ID=72965736

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910362300.7A Active CN111866411B (en) 2019-04-30 2019-04-30 Content display apparatus, method, device, and computer-readable storage medium

Country Status (1)

Country Link
CN (1) CN111866411B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009008932A (en) * 2007-06-28 2009-01-15 Dainippon Printing Co Ltd Image projection system
CN102868448A (en) * 2012-08-24 2013-01-09 中兴通讯股份有限公司 Visible light communication data transmission method and device, and visible light communication data receiving method and device
US20140153923A1 (en) * 2012-12-01 2014-06-05 Qualcomm Incorporated Methods and apparatus for communications using visible light communications signaling in combination with wireless radio signaling
CN104363382A (en) * 2014-04-24 2015-02-18 北京国承万通信息科技有限公司 Method and device for transmitting/acquiring information by visible light
CN104769861A (en) * 2012-11-07 2015-07-08 高通股份有限公司 Methods and apparatus for communicating information using visible light signals and/or radio signals
US20150373503A1 (en) * 2014-06-20 2015-12-24 Qualcomm Incorporated Method and apparatus for positioning system enhancement with visible light communication
CN207117844U (en) * 2016-11-02 2018-03-16 大辅科技（北京）有限公司 More VR/AR equipment collaborations systems

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009008932A (en) * 2007-06-28 2009-01-15 Dainippon Printing Co Ltd Image projection system
CN102868448A (en) * 2012-08-24 2013-01-09 中兴通讯股份有限公司 Visible light communication data transmission method and device, and visible light communication data receiving method and device
CN104769861A (en) * 2012-11-07 2015-07-08 高通股份有限公司 Methods and apparatus for communicating information using visible light signals and/or radio signals
US20140153923A1 (en) * 2012-12-01 2014-06-05 Qualcomm Incorporated Methods and apparatus for communications using visible light communications signaling in combination with wireless radio signaling
CN104823391A (en) * 2012-12-01 2015-08-05 高通股份有限公司 Methods and apparatus for communications using visible light communications signaling in combination with wireless radio signaling
CN104363382A (en) * 2014-04-24 2015-02-18 北京国承万通信息科技有限公司 Method and device for transmitting/acquiring information by visible light
US20150373503A1 (en) * 2014-06-20 2015-12-24 Qualcomm Incorporated Method and apparatus for positioning system enhancement with visible light communication
CN207117844U (en) * 2016-11-02 2018-03-16 大辅科技（北京）有限公司 More VR/AR equipment collaborations systems

Also Published As

Publication number Publication date
CN111866411B (en) 2023-06-23

Similar Documents

Publication Publication Date Title
Saha et al. Survey on optical camera communications: challenges and opportunities
US10521668B2 (en) Display method and display apparatus
US9621266B2 (en) Techniques for raster line alignment in light-based communication
US10218440B2 (en) Method for visible light communication using display colors and pattern types of display
US10983344B2 (en) System for optical wireless communication to extended reality immersion device
US11789150B2 (en) Localization apparatus and method
JP7395354B2 (en) Receiving method and receiving device
US11695477B2 (en) Spatial optical wireless communication system
JP7082994B2 (en) Communication systems, display control devices, communication terminals and programs that enable large-capacity supplemental downlink using optical communication.
Khan et al. Visible light communication for next generation untethered virtual reality systems
US20230297312A1 (en) Interactive projection input and output device
Chakareski et al. Toward Enabling Next-Generation Societal Virtual Reality Applications for Virtual Human Teleportation: A novel future system concept and computation-communication-signal representation trade-offs
CN111866411B (en) Content display apparatus, method, device, and computer-readable storage medium
US10616547B1 (en) Multi-vantage point light-field picture element display
EP3416305B1 (en) Communication system
CN114339174A (en) Projection equipment and control method thereof
KR20180065757A (en) RECEPTION DEVICE FOR PROVIDING Li-FI/OCC combined VISIBLE LIGHT COMMUNICATION AND METHOD FOR THERE OF
CN112153442A (en) Playing method, device, terminal, television equipment, storage medium and electronic equipment
CN112152713B (en) Display method, display device, terminal, display device, storage medium and electronic device
KR20180046388A (en) Pointing method and apparatus using optical camera communication
Shatz et al. Demonstration of augmented-reality optical narrowcasting
CN118018107A (en) Communication method, device, system and storage medium
Ashok Design, modeling, and analysis of visual mimo communication
KR20170044942A (en) Method and apparatus for transmitting and receiving information by electronic device
CN112152717A (en) Information pushing method and device, terminal, information pushing equipment and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant