WO2018223618A1 - 一种显示数据的处理方法和设备 - Google Patents

一种显示数据的处理方法和设备 Download PDF

Info

Publication number
WO2018223618A1
WO2018223618A1 PCT/CN2017/111590 CN2017111590W WO2018223618A1 WO 2018223618 A1 WO2018223618 A1 WO 2018223618A1 CN 2017111590 W CN2017111590 W CN 2017111590W WO 2018223618 A1 WO2018223618 A1 WO 2018223618A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
data
transmission
transmission data
resolution
Prior art date
Application number
PCT/CN2017/111590
Other languages
English (en)
French (fr)
Inventor
戴天荣
朱育革
赵大川
陈翔
Original Assignee
歌尔股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 歌尔股份有限公司 filed Critical 歌尔股份有限公司
Priority to US15/761,174 priority Critical patent/US10620903B2/en
Publication of WO2018223618A1 publication Critical patent/WO2018223618A1/zh
Priority to US16/731,462 priority patent/US11106422B2/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/131—Protocols for games, networked simulations or virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/08—Bandwidth reduction
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2310/00—Command of the display device
    • G09G2310/02—Addressing, scanning or driving the display screen or processing steps related thereto
    • G09G2310/0232—Special driving of display border areas
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0686—Adjustment of display parameters with two or more screen areas displaying information with different brightness or colours
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
    • G09G2340/0435—Change or adaptation of the frame rate of the video stream
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2350/00—Solving problems of bandwidth in display systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays

Definitions

  • the present invention relates to the field of data transmission technologies, and in particular, to a method and a device for processing display data.
  • VR Virtual Reality
  • a host and a display usually includes a host and a display, and the host and display of the VR are usually connected by wire or wirelessly.
  • FOV Field of View
  • a display having a large angle of view has a large delay when the host transmits large amounts of data such as image data and video data.
  • a display screen with a single-eye 1K (resolution 1200*1080) with a refresh rate of 90 Hz is used as an example.
  • image data such large image data transmission needs to occupy a large bandwidth, when the wireless transmission mode between the host and the display of the VR needs to compress and decompress the data, which will cause the delay to be too large, and Latency is a key factor affecting the VR experience.
  • the present invention provides a method and apparatus for processing display data to solve the problem of large delays in data transmission between a host and a display of a VR.
  • the present invention provides a method for processing display data, which is applied to a host of a virtual reality device, and the method includes:
  • each frame display data to be transmitted is divided into first display data corresponding to the central area and second display data corresponding to the edge area;
  • the first transmission data and the second transmission data are transmitted to the head mounted display.
  • the present invention also provides a method for processing display data, which is applied to a head mounted display of a virtual reality device, the method comprising:
  • the first transmission data and the second transmission data are displayed data for each frame according to the central area.
  • the obtained first display data and the second display data are obtained by processing the first display data and the second display data by the first transmission factor and the second transmission factor, wherein the central region And the edge region is obtained by dividing the display area of the head mounted display according to the angle of view of the head mounted display;
  • the present invention provides a virtual reality device including a host and a head mounted display.
  • the host divides the display area of the head mounted display according to the angle of view of the head mounted display, and divides the display area into a central area and an edge area; according to the range of the central area and the edge area, the to-be-transmitted
  • Each frame display data segmentation process is a first display data corresponding to the central area and second display data corresponding to the edge area; processing the first display according to a preset first transmission factor and a second transmission factor respectively Data and the second display data, the first transmission data and the second transmission data are obtained, the second transmission data occupying a bandwidth smaller than the first transmission data; and the first transmission data and the second transmission Data is sent to the head mounted display;
  • An advantageous effect of the embodiment of the present invention is that the host of the virtual reality device divides the display area of the head mounted display according to the angle of view, and divides the display area into a central area corresponding to the user's attention and the user does not pay much attention to it.
  • the edge area respectively performs different processing on the display data corresponding to the central area and the edge area, so that the display data corresponding to the edge area occupies less bandwidth than the display data corresponding to the central area during data transmission, thereby reducing the occupation of the data transmission process.
  • the total bandwidth so that the host does not need to compress the transmitted data to transmit the data.
  • the head-mounted display does not need to decompress the transmitted data, thereby reducing the delay of the data display and improving the user experience.
  • FIG. 1 is a flowchart of a method for processing display data applied to a transmitting end of a host according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of a field of view of a head mounted display according to an embodiment of the present invention
  • FIG. 3 is a flowchart of a method for processing display data applied to a head mounted display according to an embodiment of the present invention
  • FIG. 4 is a structural block diagram of a device for processing display data applied to a transmitting end of a host according to an embodiment of the present invention
  • FIG. 5 is a structural block diagram of a processing apparatus for displaying data of a head mounted display according to an embodiment of the present invention.
  • the view edge portion of the head-mounted display having a large angle of view generally only provides the immersion feeling in the user's VR environment, and the user does not pay attention to the display details of the view field edge region without special squinting, and the display refresh of the area A reduction in the rate or display resolution does not cause dizziness or other discomfort to the user.
  • the invention is based on the above situation, and the host of the virtual reality device divides the display area of the head-mounted display according to the angle of view to ensure that the central focus area normally observed by the user transmits data according to the original display refresh rate or the original display resolution. At the same time, the display refresh rate or display resolution of the non-key area is reduced, thereby reducing the transmission bandwidth occupation, and there is no need to compress and decompress the transmission data, thereby significantly reducing the delay.
  • FIG. 1 is a flowchart of a method for processing display data applied to a transmitting end of a host according to an embodiment of the present invention.
  • the processing method is applied to a host of a virtual reality device, and the method in this embodiment is particularly applicable to a head mounted display through a wireless connection.
  • the host that performs the data transfer.
  • the method of the embodiment of the present invention includes:
  • the embodiment can display the display area according to the angle of view of the head mounted display.
  • the domain is divided, and the divided central area is a key area that the user can observe, and the divided edge area is a non-key area that the user does not pay much attention to.
  • the focus area of the head-mounted display generally corresponds to the field of view FOV ⁇ 90° display area
  • the present embodiment preferably corresponds to a display area where the head-mounted display has an angle of view of less than 90°.
  • the horizontal field of view is usually expressed as ⁇ AOB in FIG. 2, and vertical field angle ⁇ BOC.
  • ⁇ AOB horizontal field of view
  • ⁇ BOC vertical field angle
  • An area surrounded by a horizontal angle of view and a vertical field of view is set as a center area, and other areas of the display area are set as edge areas.
  • the central area and the edge may be divided according to a horizontal field of view angle of less than 90° and a vertical field of view angle of less than 80 degrees. region.
  • FIG. 2 is only a central region exemplarily shown as a rectangle.
  • the present embodiment does not limit the shape and proportion of the central region and the edge region.
  • the central region of the embodiment corresponds to a key region of interest to the user, and the edge region Corresponds to non-key areas that users don't care much about.
  • This embodiment does not limit the segmentation processing method for displaying data in each frame.
  • the segmentation algorithm of the image data may be segmented in the prior art, such as a segmentation algorithm based on region segmentation.
  • the first display data and the second display data are respectively processed according to the preset first transmission factor and the second transmission factor, to obtain first transmission data and second transmission data, where the bandwidth occupied by the second transmission data is smaller than the first transmission. data.
  • the transmission factors (ie, the first transmission factor and the second transmission factor) of this embodiment are processing elements that affect the bandwidth occupied by the data transmission, such as display resolution, display refresh rate, and the like.
  • the host of the embodiment can transmit the transmission data to the head-mounted display through a wired transmission channel, such as a wired transmission channel such as HDMI, Display Port, USB Type-C, etc.; the host can also pass the wireless transmission channel, for example, a band of 60 GHz millimeter wave
  • a wired transmission channel such as HDMI, Display Port, USB Type-C, etc.
  • the host can also pass the wireless transmission channel, for example, a band of 60 GHz millimeter wave
  • the transmitted data is sent wirelessly to the head mounted display.
  • the host of the virtual reality device divides the display area of the head mounted display according to the angle of view of the head mounted display, and divides the display area into a central area corresponding to the user's attention and an edge area that the user does not pay much attention to.
  • the display data corresponding to the central area and the edge area are processed differently, so that the display data corresponding to the edge area occupies less bandwidth than the display data corresponding to the central area during data transmission, thereby reducing the total occupied by the data transmission process.
  • the bandwidth enables the host to transmit the transmitted data to the head-mounted display without compressing the transmitted data.
  • the head-mounted display does not need to decompress the transmitted data, thereby reducing the delay of the data display and improving the user experience.
  • the display data is processed by any of the following three approaches.
  • Manner 1 The first transmission factor is the first display resolution, and the second transmission factor is the second display resolution.
  • the first display resolution can be maintained as the original display resolution of each frame of display data, and the second display resolution is smaller than the original display resolution. That is, the first display resolution of the first display data corresponding to the central area is the original display resolution, and the second display resolution of the second display data corresponding to the edge area is reduced with respect to the original display resolution.
  • the first transmission factor is a first display refresh rate
  • the second transmission factor is a second display refresh rate
  • the display refresh rate of the first display data corresponding to the central area is set to a first display refresh rate
  • the display refresh rate of the second display data corresponding to the edge area is set to a second display refresh rate
  • the first display refresh rate may be maintained as the original display refresh rate of each frame of display data to be transmitted, and the first display refresh rate is an integer multiple of the second display refresh rate. That is, the first display resolution of the first display data corresponding to the central area is the original display resolution, and the second display resolution of the second display data corresponding to the edge area is reduced relative to the original display resolution, for example, the display corresponding to the central area.
  • the display data corresponding to the edge region is updated by only one frame of data.
  • the first transmission factor is a first display resolution and a first display refresh rate
  • the second transmission factor is a second display resolution and a second display refresh rate
  • the display resolution and the display refresh rate of the first display data corresponding to the central region are respectively set as the first display resolution and the second display refresh rate, and the display resolution and the display refresh rate of the second display data corresponding to the edge region are respectively set to The second display resolution and the second display refresh rate obtain the first transmission data and the second transmission data.
  • the first display resolution of the first display data corresponding to the central area may be maintained as the original display resolution, and the second display resolution of the second display data corresponding to the edge area may be reduced relative to the original display resolution;
  • the first display resolution of the first display data corresponding to the area is the original display resolution, and the second display resolution of the second display data corresponding to the edge area is reduced relative to the original display resolution, for example, the display data corresponding to the central area is updated three.
  • the display data corresponding to the edge area is updated by only one frame of data.
  • FIG. 3 is a flowchart of a method for processing display data applied to a head mounted display according to an embodiment of the present disclosure.
  • the method is applied to a head mounted display of a virtual reality device, and the method of the embodiment is particularly applicable to a method of wirelessly connecting with A head-mounted display for data transmission by a host of a virtual reality device.
  • the method in this embodiment includes:
  • S310 Receive first transmission data and second transmission data sent by the host, where bandwidth occupied by the second transmission data Less than the first transmission data.
  • the first transmission data and the second transmission data in the embodiment are the first display data and the second display data obtained by dividing the display data of each frame according to the range of the central area and the edge area, and then the first transmission factor and the first transmission factor.
  • the second transmission factor is obtained by processing the first display data and the second display data, wherein the central area and the edge area are obtained by dividing the display area of the head mounted display according to the angle of view of the head mounted display.
  • the first display data and the second transmission data are received by the head-mounted display of the embodiment, and the first transmission data and the second transmission data are processed by the host into the display data of each frame to be transmitted by using the method shown in FIG. 1 . See the above description, and will not be described here.
  • the head mounted display needs to perform image reconstruction on the first transmission data and the second transmission data after receiving the first transmission data and the second transmission data to perform image processing. display.
  • the head-mounted display of the embodiment performs image reconstruction on the first transmission data and the second transmission data sent from the host. For the case of reducing the display refresh rate, if the second transmission data corresponding to the edge region is received, the display screen is directly sent to the display screen. Displaying, if the second transmission data corresponding to the received edge region is empty, that is, the second transmission data is not received, multiplexing the second transmission data corresponding to the edge region of the previous frame, and simultaneously performing boundary image data on the two regions The splicing process is performed, and the splicing process is sent to the display screen for display; for the case of reducing the display resolution, the original resolution image reconstruction is performed by interpolation or the like, and the display data can be output and displayed after reconstruction, without decompression. Processing, etc., can reduce the delay of data display and improve the user experience.
  • image reconstruction is performed on the received first transmission data and second transmission data by the following method:
  • Determining whether the data content of the second transmission data is empty If the data content of the second transmission data is empty, multiplexing the image data of the edge region corresponding to the previous frame display image, and the image data of the edge region and the first transmission data The corresponding image data is spliced, for example, the image of the boundary image data of the two regions is spliced by low-pass filtering to obtain a display image corresponding to the frame display data.
  • the second transmission data is subjected to image processing for the first display resolution by using the difference processing, and the second transmission data and the image after the image reconstruction are performed.
  • a transmission data is synthesized into a frame display image for display output;
  • the first transmission data and the second transmission data are combined into one frame display image for display output.
  • the present invention also provides an embodiment of a processing apparatus.
  • FIG. 4 is a structural block diagram of a processing device for displaying display data applied to a transmitting end of a host according to an embodiment of the present invention.
  • the processing device is applied to a host of a virtual reality device, and is particularly suitable for a host that performs data transmission with a head mounted display through a wireless connection. .
  • the apparatus of this embodiment includes an area dividing unit 41, a data dividing unit 42, a data processing unit 43, and a transmitting unit 44.
  • the area dividing unit 41 is configured to divide the display area of the head mounted display according to the angle of view of the head mounted display, and divide the display area into a central area and an edge area;
  • the data dividing unit 42 is configured to divide, according to the range of the central area and the edge area, each frame of display data to be transmitted into first display data corresponding to the central area and second display data corresponding to the edge area. ;
  • the data processing unit 43 is configured to separately process the first display data and the second display data according to the preset first transmission factor and the second transmission factor, to obtain the first transmission data and the second transmission data, and the bandwidth occupied by the second transmission data Less than the first transmission data;
  • the sending unit 44 is configured to send the first transmission data and the second transmission data to the head mounted display by wireless transmission.
  • the host of the virtual reality device divides the display area of the head mounted display according to the angle of view, and divides the display area into a center area corresponding to the user's attention and an edge area that the user does not pay much attention to, respectively, the center area and
  • the display data corresponding to the edge area is processed differently, so that the display data corresponding to the edge area consumes less bandwidth than the display data corresponding to the central area during data transmission, thereby reducing the total bandwidth occupied by the data transmission process, so that the host does not need to
  • the transmission data is compressed to transmit the transmission data to the head-mounted display, and the head-mounted display does not need to decompress the transmission data, thereby reducing the delay of the data display and improving the user experience.
  • the transmission factor (ie, the first transmission factor and the second transmission factor) of this embodiment is a band that affects data transmission.
  • Wide processing elements such as display resolution, display refresh rate, and more.
  • the data processing unit 43 is specifically configured to set the first display resolution and the second display resolution according to the bandwidth of the data transmission channel.
  • the second display resolution is smaller than the first display resolution; the display resolution of the first display data corresponding to the central region is set to be the first display resolution, and the display resolution of the second display data corresponding to the edge region is set to the second display Resolution, the first transmission data and the second transmission data are obtained.
  • the data processing unit 43 is specifically configured to set the first display refresh rate and the second display refresh rate according to the bandwidth of the data transmission channel.
  • the second display refresh rate is smaller than the first display refresh rate; the display refresh rate of the first display data corresponding to the central region is set to a first display refresh rate, and the display refresh rate of the second display data corresponding to the edge region is set to a second display
  • the refresh rate obtains the first transmission data and the second transmission data.
  • the data processing unit 43 is specifically configured to use the bandwidth according to the data transmission channel. Setting a first display resolution, a first display refresh rate, a second display resolution, and a second display refresh rate, the second display resolution is less than the first display resolution, and the second display refresh rate is less than the first display refresh rate;
  • the display resolution and the display refresh rate of the first display data corresponding to the central area are respectively the first display resolution and the second display refresh rate, and the display resolution and the display refresh rate of the second display data corresponding to the edge area are respectively set to be
  • the second display resolution and the second display refresh rate obtain the first transmission data and the second transmission data.
  • FIG. 5 is a structural block diagram of a processing device for displaying data of a head mounted display according to an embodiment of the present invention.
  • the processing device is applied to a head mounted display of a virtual reality device, and is particularly suitable for data transmission with a host through a wireless connection.
  • Head-mounted display is particularly suitable for data transmission with a host through a wireless connection.
  • the apparatus of this embodiment includes a receiving unit 51, an image reconstruction unit 52, and a display unit 53.
  • the receiving unit 51 is configured to receive first transmission data and second transmission data that are sent by the host, where the bandwidth occupied by the second transmission data is smaller than the first transmission data;
  • the first transmission data and the second transmission data received by the receiving unit 51 in this embodiment are the first display data and the second display data obtained after the frame data is divided and processed according to the range of the central area and the edge area, and then the first display data and the second display data are obtained.
  • a transmission factor and a second transmission factor are obtained after processing the first display data and the second display data, wherein the central area and the edge area are displays of the head mounted display according to an angle of view of the head mounted display Regional proceeding Obtained after division.
  • the image reconstruction unit 52 is configured to perform image reconstruction on the received first transmission data and the second transmission data to obtain a display image corresponding to the frame display data.
  • the display unit 53 is configured to display and output the display image.
  • the head-mounted display of the embodiment performs image reconstruction on the first transmission data and the second transmission data sent from the host. For the case of reducing the display refresh rate, if the second transmission data corresponding to the edge region is received, the display screen is directly sent to the display screen. Displaying, if the second transmission data corresponding to the received edge region is empty, that is, the second transmission data is not received, multiplexing the second transmission data corresponding to the edge region of the previous frame, and simultaneously performing boundary image data on the two regions The splicing process is performed, and the splicing process is sent to the display screen for display; for the case of reducing the display resolution, the original resolution image reconstruction is performed by interpolation or the like, and the display data can be output and displayed after reconstruction, without decompression. Processing, etc., can reduce the delay of data display and improve the user experience.
  • the processing apparatus in FIG. 5 further includes a determining unit, configured to determine whether the data content of the second transmission data is empty, and determine the second when determining that the data content of the second transmission data is not empty. Whether the display resolution of the transmitted data is smaller than the display resolution of the first transmitted data;
  • the image reconstruction unit 52 is specifically configured to: when the determining unit determines that the data content of the second transmission data is empty, multiplex the image data of the edge region corresponding to the previous frame display image, and image data of the edge region and the first The image data corresponding to the transmission data is spliced to obtain a display image corresponding to the frame display data; and when the determining unit determines that the display resolution of the second transmission data is smaller than the display resolution of the first transmission data, the second transmission data is used as a difference
  • the value processing performs image reconstruction of the first display resolution, and combines the second transmission data and the first transmission data after the image reconstruction into one frame display image and sends the image to the display unit 53 for display output; the second transmission data is determined by the determining unit.
  • the display resolution is equal to the display resolution of the first transmission data
  • the first transmission data and the second transmission data are combined into one frame display image and sent to the display unit 53 for display output.
  • the present invention also provides a virtual reality device, including a host and a head mounted display.
  • the host divides the display area of the head-mounted display according to the angle of view of the head-mounted display, and divides the display area into a central area and an edge area; according to the range of the central area and the edge area, the display data of each frame to be transmitted is divided into Corresponding to the first display data of the central area and the second display data of the corresponding edge area; processing the first display data and the second display data according to the preset first transmission factor and the second transmission factor, respectively, to obtain the first Transmitting data and second transmission data, wherein the second transmission data occupies less bandwidth than the first transmission data; and transmits the first transmission data and the second transmission data to the head mounted display.
  • the head-mounted display receives the first transmission data and the second transmission data sent by the host, performs image reconstruction on the received first transmission data and the second transmission data, obtains a display image corresponding to the frame display data, and displays the display image
  • the host processes the first display data and the second display data according to the preset first transmission factor and the second transmission factor, respectively, to obtain the first transmission data and the second transmission data, including:
  • the host sets a first display resolution and a second display resolution according to a bandwidth of the data transmission channel, where the second display resolution is smaller than the first display resolution; and the first transmission factor is preset to the first display resolution, and the first The second transmission factor is preset to the second display resolution, and the display resolution of the first display data corresponding to the central region is set to the first display resolution, and the display resolution of the second display data corresponding to the edge region is set to be the first The display resolution is two, and the first transmission data and the second transmission data are obtained.
  • the host processes the first display data and the second display data according to the preset first transmission factor and the second transmission factor, respectively, to obtain the first transmission data and the second transmission data, including:
  • the host sets a first display refresh rate and a second display refresh rate according to a bandwidth of the data transmission channel, where the second display refresh rate is smaller than the first display refresh rate; and the first transmission factor is preset to the first display refresh rate, and the first The second transmission factor is preset to the second display refresh rate; the display refresh rate of the first display data corresponding to the central region is set to the first display refresh rate, and the display refresh rate of the second display data corresponding to the edge region is set. Second, the refresh rate is displayed, and the first transmission data and the second transmission data are obtained.
  • the host processes the first display data and the second display data according to the preset first transmission factor and the second transmission factor, respectively, to obtain the first transmission data and the second transmission data, including:
  • the host sets a first display resolution, a first display refresh rate, a second display resolution, and a second display refresh rate according to a bandwidth of the data transmission channel, where the second display resolution is smaller than the first display resolution, and the second display refresh rate is Is less than the first display refresh rate; preset the first transmission factor to the first display resolution and the first display refresh rate, and preset the second transmission factor to the second display resolution and the second display refresh rate Setting a display resolution and a display refresh rate of the first display data corresponding to the central area as the first display resolution and the second display refresh rate, respectively, setting a display resolution and a display refresh of the second display data corresponding to the edge area
  • the rate is the second display resolution and the second display refresh rate, respectively, and the first transmission data and the second transmission data are obtained.
  • the host draws the display area of the head mounted display according to the field of view of the head mounted display Divide the display area into a central area and an edge area, including:
  • the host acquires a horizontal field of view and a vertical field of view for dividing the display area, and sets an area surrounded by a horizontal field of view and a vertical field of view as a center area, and other areas of the display area are set as edge areas.
  • the head mounted display performs image reconstruction on the received first transmission data and the second transmission data, including:
  • the head mounted display determines whether the data content of the second transmission data is empty. If the data content of the second transmission data is empty, multiplexing the image data of the edge region corresponding to the previous frame display image, and the image data of the edge region and the The image data corresponding to the transmission data is spliced to obtain a display image corresponding to the frame display data;
  • the data content of the second transmission data is not empty, determining whether the display resolution of the second transmission data is smaller than the display resolution of the first transmission data, if the display resolution of the second transmission data is smaller than the display resolution of the first transmission data Rate, using the difference processing on the second transmission data to perform image reconstruction of the first display resolution, and synthesizing the second transmission data and the first transmission data after the image reconstruction into one frame display image for display output; if the second transmission The display resolution of the data is equal to the display resolution of the first transmission data, and the first transmission data and the second transmission data are combined into one frame display image for display output.

Abstract

本发明公开了一种显示数据的处理方法和一种虚拟现实设备。处理方法包括：主机根据头戴显示器的视场角将显示区域划分成中心区域和边缘区域；将每帧显示数据分割处理为对应中心区域的第一显示数据和对应边缘区域的第二显示数据；根据第一、第二传输因子分别对第一、第二显示数据处理得到第一、第二传输数据并发送给头戴显示器；头戴显示器对接收到的第一、第二传输数据进行图像重建，得到该帧显示数据对应的显示图像并进行显示输出。虚拟现实设备包括上述的主机和头戴显示器。本发明能够降低传输带宽占用，不需要对传输数据压缩和解压缩，显著地减少时延。

Description

一种显示数据的处理方法和设备 技术领域
本发明涉及数据传输技术领域，特别涉及一种显示数据的处理方法和设备。
背景技术
虚拟现实设备(Virtual Reality，VR)通常包括主机和显示器，VR的主机与显示器之间通常采用有线或无线的方式连接。随着物质生活水平的提高，人们越来越追求大显示屏大视场角的视觉体验。市场上VR的显示器通常具有较大的视场角(Field of View，FOV)，例如视场角能够达到120°、150°。但是，具有较大视场角的显示器在主机传送图像数据、视频数据等大数据量时，会有较大的时延。
以显示刷新率为90Hz的单眼1K(分辨率为1200*1080)的显示屏幕为例，1个像素点用24bit表示，则需要传送1200*1080*2(双眼)*90*24＝5.6G bit/s的图像数据，如此大的图像数据传输需要占用较大的带宽，当VR的主机与显示器之间采用无线传输方式时则需要对数据进行压缩和解压缩，这将导致时延过大，而时延则是影响VR体验的关键因素。
发明内容
基于本发明的一个目的，本发明提供了一种显示数据的处理方法和设备，以解决VR的主机与显示器之间进行数据传输时存在较大时延的问题。
为达到上述目的，本发明的技术方案是这样实现的：
一方面，本发明提供了一种显示数据的处理方法，应用于虚拟现实设备的主机，该方法包括：
根据虚拟现实设备的头戴显示器的视场角对头戴显示器的显示区域进行划分，将显示区域划分成中心区域和边缘区域；
根据中心区域和边缘区域的范围，将待传输的每帧显示数据分割处理为对应中心区域的第一显示数据和对应边缘区域的第二显示数据；
根据预设的第一传输因子和第二传输因子分别处理第一显示数据和第二显示数据， 得到第一传输数据和第二传输数据，该第二传输数据占用的带宽小于第一传输数据；
将第一传输数据和第二传输数据发送给头戴显示器。
另一方面，本发明还提供了一种显示数据的处理方法，应用于虚拟现实设备的头戴显示器，该方法包括：
接收虚拟现实设备的主机发送的第一传输数据和第二传输数据，该第二传输数据占用的带宽小于第一传输数据；该第一传输数据和第二传输数据为每帧显示数据根据中心区域和边缘区域的范围分割处理后，得到的第一显示数据和第二显示数据，再由第一传输因子和第二传输因子处理第一显示数据和第二显示数据后所得到，其中，中心区域和边缘区域为根据头戴显示器的视场角对头戴显示器的显示区域进行划分后得到；
对接收到的第一传输数据和第二传输数据进行图像重建，得到该帧显示数据对应的显示图像；
对显示图像进行显示输出。
再一方面，本发明提供了一种虚拟现实设备，包括主机和头戴显示器，
所述主机根据所述头戴显示器的视场角对所述头戴显示器的显示区域进行划分，将显示区域划分成中心区域和边缘区域；根据所述中心区域和边缘区域的范围，将待传输的每帧显示数据分割处理为对应所述中心区域的第一显示数据和对应所述边缘区域的第二显示数据；根据预设的第一传输因子和第二传输因子分别处理所述第一显示数据和所述第二显示数据，得到第一传输数据和第二传输数据，所述第二传输数据占用的带宽小于所述第一传输数据；将所述第一传输数据和所述第二传输数据发送给所述头戴显示器；
所述头戴显示器接收所述主机发送的所述第一传输数据和所述第二传输数据，对接收到的所述第一传输数据和所述第二传输数据进行图像重建，得到该帧显示数据对应的显示图像，对所述显示图像进行显示输出。
本发明实施例的有益效果是：本发明在虚拟现实设备的主机，根据视场角对头戴显示器的显示区域进行划分，将显示区域划分成对应于用户关注的中心区域和用户不太关注的边缘区域，分别对中心区域和边缘区域对应的显示数据进行不同的处理，使边缘区域对应的显示数据在进行数据传输时占用带宽小于中心区域对应的显示数据，进而减少数据传输过程中所占用的总带宽，使主机不需要对传输数据进行压缩即可将传输数据发 送给头戴显示器，头戴显示器亦不需要对传输数据进行解压缩，进而减少了数据显示的时延，提高了用户体验。
附图说明
图1为本发明实施例提供的应用于主机发送端的显示数据的处理方法流程图；
图2为本发明实施例提供的头戴显示器视场角示意图；
图3为本发明实施例提供的应用于头戴显示器的显示数据的处理方法流程图；
图4为本发明实施例提供的应用于主机发送端的显示数据的处理装置结构框图；
图5为本发明实施例提供的应用于头戴显示器的显示数据的处理装置结构框图。
具体实施方式
为使本发明的目的、技术方案和优点更加清楚，下面将结合附图对本发明实施方式作进一步地详细描述。
具有大视场角的头戴显示器的视野边缘部分通常仅提供用户VR环境下的沉浸感，用户在没有特别斜视的情况下，对该视野边缘区域的显示细节并不关注，该区域的显示刷新率或显示分辨率的降低并不会引发用户眩晕或其他不适。
本发明基于上述情况，在虚拟现实设备的主机，根据视场角对头戴显示器的显示区域进行划分，保证用户正常观察到的中心重点区域按原显示刷新率或原显示分辨率进行数据传输，同时降低非重点区域的显示刷新率或显示分辨率，进而降低传输带宽占用，不需要对传输数据压缩和解压缩，显著地减少时延。
图1为本发明实施例提供的应用于主机发送端的显示数据的处理方法流程图，该处理方法应用于虚拟现实设备的主机，本实施例的方法尤其适用于通过无线连接的方式与头戴显示器进行数据传输的主机。
如图1所示，本发明实施例的方法包括：
S110，根据头戴显示器的视场角对头戴显示器的显示区域进行划分，将显示区域划分成中心区域和边缘区域。
由于大视场角的头戴显示器的视野边缘部分仅用于提供用户VR环境下的沉浸感，用户对该视野边缘区域的显示细节并不关注，且该区域的显示刷新率或显示分辨率的降低并不会引发用户眩晕或其他不适，因此本实施例可根据头戴显示器的视场角对显示区 域进行划分，划分后的中心区域为用户可观察到的重点区域，划分后的边缘区域为用户不太关注的非重点区域。由于头戴显示器的重点区域通常对应于视场角FOV<90°显示区域，因此本实施例优选地中心区域对应为头戴显示器视场角小于90°的显示区域。
如图2所示，对于头戴显示器的视场角而言，通常使用水平视场角如图2中的∠AOB，垂直视场角∠BOC来表示。此时，可以根据下述方法划分中心区域和边缘区域：
获取用于划分显示区域的水平视场角和垂直视场角；
将水平视场角和垂直视场角围成的区域设置为中心区域，该显示区域的其他区域设置为边缘区域。
示例性地，在使用水平视场角和垂直视场角表示本实施例头戴显示器的视场角时，可以按照水平视场角小于90°，垂直视场角小于80°划分中心区域和边缘区域。
需要说明的是，图2只是示例性示出为长方形的中心区域，本实施例并不限定中心区域和边缘区域的形状和比例，本实施例的中心区域对应于用户关注的重点区域，边缘区域对应于用户不太关注的非重点区域。
S120，根据中心区域和边缘区域的范围，将待传输的每帧显示数据分割处理为对应中心区域的第一显示数据和对应边缘区域的第二显示数据。
本实施例不限定对每帧显示数据的分割处理方法，可以采用现有技术中对图像数据的分割算法进行分割处理，如基于区域分割的分割算法。
S130，根据预设的第一传输因子和第二传输因子分别处理第一显示数据和第二显示数据，得到第一传输数据和第二传输数据，该第二传输数据占用的带宽小于第一传输数据。
其中，本实施例的传输因子(即第一传输因子和第二传输因子)为影响数据传输所占用带宽的处理元素，如显示分辨率、显示刷新率等。
S140，将第一传输数据和第二传输数据发送给头戴显示器。
本实施例的主机可通过有线传输通道，如HDMI，Display Port，USB Type-C等有线传输通道将传输数据发送给头戴显示器；主机也可以通过无线传输通道，如以60GHz毫米波的波段将传输数据无线发送给头戴显示器。
本实施例在虚拟现实设备的主机，根据头戴显示器的视场角对头戴显示器的显示区域进行划分，将显示区域划分成对应于用户关注的中心区域和用户不太关注的边缘区 域，分别对中心区域和边缘区域对应的显示数据进行不同的处理，使边缘区域对应的显示数据在进行数据传输时占用带宽小于中心区域对应的显示数据，进而减少数据传输过程中所占用的总带宽，使主机不需要对传输数据进行压缩即可将传输数据发送给头戴显示器，头戴显示器亦不需要对传输数据进行解压缩，进而减少了数据显示的时延，提高了用户体验。
在本实施例的一些实现方案中，通过下述三种方式中的任一种对显示数据进行处理。
方式一：第一传输因子为第一显示分辨率，第二传输因子为第二显示分辨率。
则根据预设的第一传输因子和第二传输因子分别处理第一显示数据和第二显示数据，得到第一传输数据和第二传输数据，具体为：
根据数据传输通道的带宽设置第一显示分辨率和第二显示分辨率，使第二显示分辨率小于第一显示分辨率；
将第一传输因子预设为第一显示分辨率，将第二传输因子预设为第二显示分辨率；
设置中心区域对应的第一显示数据的显示分辨率为第一显示分辨率，设置边缘区域对应的第二显示数据的显示分辨率为第二显示分辨率，得到第一传输数据和第二传输数据。
实际应用中，可使第一显示分辨率保持为每帧显示数据的原显示分辨率，第二显示分辨率小于原显示分辨率。即维持中心区域对应的第一显示数据的第一显示分辨率为原显示分辨率，相对于原显示分辨率降低边缘区域对应的第二显示数据的第二显示分辨率。
方式二：第一传输因子为第一显示刷新率，第二传输因子为第二显示刷新率。
则根据预设的第一传输因子和第二传输因子分别处理第一显示数据和第二显示数据，得到第一传输数据和第二传输数据，具体为：
根据数据传输通道的带宽设置第一显示刷新率和第二显示刷新率，使第二显示刷新率小于第一显示刷新率；
将第一传输因子预设为第一显示刷新率，将第二传输因子预设为第二显示刷新率；
设置中心区域对应的第一显示数据的显示刷新率为第一显示刷新率，设置边缘区域对应的第二显示数据的显示刷新率为第二显示刷新率，得到第一传输数据和第二传输数 据。
实际应用中，可使第一显示刷新率保持为待传输的每帧显示数据的原显示刷新率，第一显示刷新率为第二显示刷新率的整数倍。即维持中心区域对应的第一显示数据的第一显示分辨率为原显示分辨率，相对原显示分辨率降低边缘区域对应的第二显示数据的第二显示分辨率，例如使中心区域对应的显示数据更新三帧数据时，边缘区域对应的显示数据仅更新一帧数据。
方式三：第一传输因子为第一显示分辨率和第一显示刷新率，第二传输因子为第二显示分辨率和第二显示刷新率。
则根据预设的第一传输因子和第二传输因子分别处理第一显示数据和第二显示数据，得到第一传输数据和第二传输数据，具体为：
根据数据传输通道的带宽设置第一显示分辨率、第一显示刷新率、第二显示分辨率和第二显示刷新率，使第二显示分辨率小于第一显示分辨率，第二显示刷新率小于第一显示刷新率；
将第一传输因子预设为第一显示分辨率和第一显示刷新率，将第二传输因子预设为第二显示分辨率和第二显示刷新率；
设置中心区域对应的第一显示数据的显示分辨率和显示刷新率分别为第一显示分辨率和第二显示刷新率，设置边缘区域对应的第二显示数据的显示分辨率和显示刷新率分别为第二显示分辨率和第二显示刷新率，得到第一传输数据和第二传输数据。
实际应用中，可维持中心区域对应的第一显示数据的第一显示分辨率为原显示分辨率，相对于原显示分辨率降低边缘区域对应的第二显示数据的第二显示分辨率；维持中心区域对应的第一显示数据的第一显示分辨率为原显示分辨率，相对原显示分辨率降低边缘区域对应的第二显示数据的第二显示分辨率，例如使中心区域对应的显示数据更新三帧数据时，边缘区域对应的显示数据仅更新一帧数据。
图3为本发明实施例提供的应用于头戴显示器的显示数据的处理方法流程图，该处理方法应用于虚拟现实设备的头戴显示器，本实施例的方法尤其适用于通过无线连接的方式与虚拟现实设备的主机进行数据传输的头戴显示器。如图3所示，本实施例的方法包括：
S310，接收主机发送的第一传输数据和第二传输数据，该第二传输数据占用的带宽 小于第一传输数据。
本实施例中的第一传输数据和第二传输数据为每帧显示数据根据中心区域和边缘区域的范围分割处理后，得到的第一显示数据和第二显示数据，再由第一传输因子和第二传输因子处理第一显示数据和第二显示数据后所得到，其中，中心区域和边缘区域为根据头戴显示器的视场角对头戴显示器的显示区域进行划分后得到。
即本实施例头戴显示器接收到第一传输数据和第二传输数据为主机采用图1所示的方法将待传输的每帧显示数据处理成的第一传输数据和第二传输数据，处理过程见上述描述，在此不再赘述。
S320，对接收到的第一传输数据和第二传输数据进行图像重建，得到该帧显示数据对应的显示图像。
S330，对显示图像进行显示输出。
由于主机对待传输的每帧显示数据进行了分割处理，因此头戴显示器在接收到第一传输数据和第二传输数据后，需要对第一传输数据和第二传输数据进行图像重建，以进行图像显示。
本实施例的头戴显示器对来自主机发送的第一传输数据和第二传输数据进行图像重建，对于降低显示刷新率的情况，若接收到边缘区域对应的第二传输数据则直接送显示屏幕进行显示，若接收到的边缘区域对应的第二传输数据为空，即未接收到第二传输数据，则复用上一帧边缘区域对应的第二传输数据，同时对两个区域的边界图像数据进行拼接处理，拼接处理后发送至显示屏幕进行显示；对于降低显示分辨率的情况，则通过插值等方式进行原分辨率图像重建，重建后即可对显示数据进行输出显示，不需要进行解压缩等处理，因此可以减少数据显示的时延，提高了用户体验。
示例性地，通过下述方法对接收到的第一传输数据和第二传输数据进行图像重建：
判断第二传输数据的数据内容是否为空，若第二传输数据的数据内容为空，则复用上一帧显示图像对应的边缘区域的图像数据，将边缘区域的图像数据和第一传输数据对应的图像数据进行拼接处理，如通过低通滤波的方式对两个区域的边界图像数据进行图像拼接，得到该帧显示数据对应的显示图像。
若第二传输数据的数据内容不为空，则判断第二传输数据的显示分辨率是否小于第一传输数据的显示分辨率，
若第二传输数据的显示分辨率小于第一传输数据的显示分辨率，对第二传输数据采用差值处理进行第一显示分辨率的图像重建，并将图像重建后的第二传输数据和第一传输数据合成为一帧显示图像进行显示输出；
若第二传输数据的显示分辨率等于第一传输数据的显示分辨率，将第一传输数据和第二传输数据合成为一帧显示图像进行显示输出。
与前述处理方法实施例相对应的，本发明还提供了一种处理装置实施例。
图4为本发明实施例提供的应用于主机发送端的显示数据的处理装置结构框图，该处理装置应用于虚拟现实设备的主机，尤其适用于通过无线连接的方式与头戴显示器进行数据传输的主机。
如图4所示，本实施例的装置包括：区域划分单元41、数据分割单元42、数据处理单元43和发送单元44。
区域划分单元41，用于根据头戴显示器的视场角对头戴显示器的显示区域进行划分，将显示区域划分成中心区域和边缘区域；
数据分割单元42，用于根据所述中心区域和边缘区域的范围，将待传输的每帧显示数据分割处理为对应所述中心区域的第一显示数据和对应所述边缘区域的第二显示数据；
数据处理单元43，用于根据预设的第一传输因子和第二传输因子分别处理第一显示数据和第二显示数据，得到第一传输数据和第二传输数据，第二传输数据占用的带宽小于第一传输数据；
发送单元44，用于将第一传输数据和第二传输数据通过无线传输方式发送给所述头戴显示器。
本实施例在虚拟现实设备的主机，根据视场角对头戴显示器的显示区域进行划分，将显示区域划分成对应于用户关注的中心区域和用户不太关注的边缘区域，分别对中心区域和边缘区域对应的显示数据进行不同的处理，使边缘区域对应的显示数据在进行数据传输时占用带宽小于中心区域对应的显示数据，进而减少数据传输过程中所占用的总带宽，使主机不需要对传输数据进行压缩即可将传输数据发送给头戴显示器，头戴显示器亦不需要对传输数据进行解压缩，进而减少了数据显示的时延，提高了用户体验。
本实施例的传输因子(即第一传输因子和第二传输因子)为影响数据传输所占用带 宽的处理元素，如显示分辨率、显示刷新率等。
当第一传输因子为第一显示分辨率，第二传输因子为第二显示分辨率时，数据处理单元43，具体用于根据数据传输通道的带宽设置第一显示分辨率和第二显示分辨率，第二显示分辨率小于第一显示分辨率；设置中心区域对应的第一显示数据的显示分辨率为第一显示分辨率，设置边缘区域对应的第二显示数据的显示分辨率为第二显示分辨率，得到第一传输数据和第二传输数据。
当第一传输因子为第一显示刷新率，第二传输因子为第二显示刷新率时，数据处理单元43，具体用于根据数据传输通道的带宽设置第一显示刷新率和第二显示刷新率，第二显示刷新率小于第一显示刷新率；设置中心区域对应的第一显示数据的显示刷新率为第一显示刷新率，设置边缘区域对应的第二显示数据的显示刷新率为第二显示刷新率，得到第一传输数据和第二传输数据。
当第一传输因子为第一显示分辨率和第一显示刷新率，第二传输因子为第二显示分辨率和第二显示刷新率时，数据处理单元43，具体用于根据数据传输通道的带宽设置第一显示分辨率、第一显示刷新率、第二显示分辨率和第二显示刷新率，第二显示分辨率小于第一显示分辨率，第二显示刷新率小于第一显示刷新率；设置中心区域对应的第一显示数据的显示分辨率和显示刷新率分别为第一显示分辨率和第二显示刷新率，设置边缘区域对应的第二显示数据的显示分辨率和显示刷新率分别为第二显示分辨率和第二显示刷新率，得到第一传输数据和第二传输数据。
图5为本发明实施例提供的应用于头戴显示器的显示数据的处理装置结构框图，该处理装置应用于虚拟现实设备的头戴显示器，尤其适用于通过无线连接的方式与主机进行数据传输的头戴显示器。
如图5所示，本实施例的装置包括：接收单元51、图像重建单元52和显示单元53。
接收单元51，用于接收主机发送的第一传输数据和第二传输数据，其中第二传输数据占用的带宽小于第一传输数据；
本实施例接收单元51接收到的第一传输数据和第二传输数据为每帧显示数据根据中心区域和边缘区域的范围分割处理后，得到的第一显示数据和第二显示数据，再由第一传输因子和第二传输因子处理第一显示数据和第二显示数据后所得到，其中，所述中心区域和边缘区域为根据所述头戴显示器的视场角对所述头戴显示器的显示区域进行 划分后得到。
图像重建单元52，用于对接收到的第一传输数据和第二传输数据进行图像重建，得到该帧显示数据对应的显示图像。
显示单元53，用于对显示图像进行显示输出。
本实施例的头戴显示器对来自主机发送的第一传输数据和第二传输数据进行图像重建，对于降低显示刷新率的情况，若接收到边缘区域对应的第二传输数据则直接送显示屏幕进行显示，若接收到的边缘区域对应的第二传输数据为空，即未接收到第二传输数据，则复用上一帧边缘区域对应的第二传输数据，同时对两个区域的边界图像数据进行拼接处理，拼接处理后发送至显示屏幕进行显示；对于降低显示分辨率的情况，则通过插值等方式进行原分辨率图像重建，重建后即可对显示数据进行输出显示，不需要进行解压缩等处理，因此可以减少数据显示的时延，提高了用户体验。
示例性地，图5中的处理装置还包括判断单元，该判断单元用于判断第二传输数据的数据内容是否为空，以及在判断第二传输数据的数据内容不为空时，判断第二传输数据的显示分辨率是否小于第一传输数据的显示分辨率；
此时，图像重建单元52，具体用于在判断单元判断第二传输数据的数据内容为空时，复用上一帧显示图像对应的边缘区域的图像数据，将边缘区域的图像数据和第一传输数据对应的图像数据进行拼接处理，得到该帧显示数据对应的显示图像；在判断单元判断第二传输数据的显示分辨率小于第一传输数据的显示分辨率时，对第二传输数据采用差值处理进行第一显示分辨率的图像重建，并将图像重建后的第二传输数据和第一传输数据合成为一帧显示图像发送给显示单元53进行显示输出；在判断单元判断第二传输数据的显示分辨率等于第一传输数据的显示分辨率时，将第一传输数据和第二传输数据合成为一帧显示图像发送给显示单元53进行显示输出。
本发明装置实施例的各单元的具体工作方式可以参见本发明的方法实施例。
与前述处理方法实施例相对应的，本发明还提供了一种虚拟现实设备，包括主机和头戴显示器。主机根据头戴显示器的视场角对头戴显示器的显示区域进行划分，将显示区域划分成中心区域和边缘区域；根据中心区域和边缘区域的范围，将待传输的每帧显示数据分割处理为对应中心区域的第一显示数据和对应边缘区域的第二显示数据；根据预设的第一传输因子和第二传输因子分别处理第一显示数据和第二显示数据，得到第一 传输数据和第二传输数据，其中第二传输数据占用的带宽小于所述第一传输数据；将第一传输数据和第二传输数据发送给头戴显示器。头戴显示器接收主机发送的第一传输数据和第二传输数据，对接收到的第一传输数据和第二传输数据进行图像重建，得到该帧显示数据对应的显示图像，对该显示图像进行显示输出。
在一些实施例中，主机根据预设的第一传输因子和第二传输因子分别处理所述第一显示数据和所述第二显示数据，得到第一传输数据和第二传输数据，包括：
主机根据数据传输通道的带宽设置第一显示分辨率和第二显示分辨率，其中第二显示分辨率小于第一显示分辨率；将第一传输因子预设为该第一显示分辨率，将第二传输因子预设为该第二显示分辨率，设置中心区域对应的第一显示数据的显示分辨率为该第一显示分辨率，设置边缘区域对应的第二显示数据的显示分辨率为该第二显示分辨率，得到第一传输数据和第二传输数据。
在一些实施例中，主机根据预设的第一传输因子和第二传输因子分别处理第一显示数据和第二显示数据，得到第一传输数据和第二传输数据，包括：
主机根据数据传输通道的带宽设置第一显示刷新率和第二显示刷新率，其中第二显示刷新率小于第一显示刷新率；将第一传输因子预设为该第一显示刷新率，将第二传输因子预设为该第二显示刷新率；设置中心区域对应的第一显示数据的显示刷新率为该第一显示刷新率，设置边缘区域对应的第二显示数据的显示刷新率为该第二显示刷新率，得到第一传输数据和第二传输数据。
在一些实施例中，主机根据预设的第一传输因子和第二传输因子分别处理第一显示数据和第二显示数据，得到第一传输数据和第二传输数据，包括：
主机根据数据传输通道的带宽设置第一显示分辨率、第一显示刷新率、第二显示分辨率和第二显示刷新率，其中第二显示分辨率小于第一显示分辨率，第二显示刷新率小于第一显示刷新率；将第一传输因子预设为该第一显示分辨率和该第一显示刷新率，将第二传输因子预设为该第二显示分辨率和该第二显示刷新率；设置中心区域对应的第一显示数据的显示分辨率和显示刷新率分别为该第一显示分辨率和该第二显示刷新率，设置边缘区域对应的第二显示数据的显示分辨率和显示刷新率分别为该第二显示分辨率和该第二显示刷新率，得到第一传输数据和第二传输数据。
在一些实施例中，主机根据头戴显示器的视场角对头戴显示器的显示区域进行划 分，将显示区域划分成中心区域和边缘区域，包括：
主机获取用于划分所述显示区域的水平视场角和垂直视场角，将水平视场角和垂直视场角围成的区域设置为中心区域，显示区域的其他区域设置为边缘区域。
在一些实施例中，头戴显示器对接收到的第一传输数据和第二传输数据进行图像重建，包括：
头戴显示器判断第二传输数据的数据内容是否为空，若第二传输数据的数据内容为空，则复用上一帧显示图像对应的边缘区域的图像数据，将边缘区域的图像数据和第一传输数据对应的图像数据进行拼接处理，得到该帧显示数据对应的显示图像；
若第二传输数据的数据内容不为空，则判断第二传输数据的显示分辨率是否小于第一传输数据的显示分辨率，若第二传输数据的显示分辨率小于第一传输数据的显示分辨率，对第二传输数据采用差值处理进行第一显示分辨率的图像重建，并将图像重建后的第二传输数据和第一传输数据合成为一帧显示图像进行显示输出；若第二传输数据的显示分辨率等于第一传输数据的显示分辨率，将第一传输数据和第二传输数据合成为一帧显示图像进行显示输出。
以上所述，仅为本发明的具体实施方式，在本发明的上述教导下，本领域技术人员可以在上述实施例的基础上进行其他的改进或变形。本领域技术人员应该明白，上述的具体描述只是更好的解释本发明的目的，本发明的保护范围应以权利要求的保护范围为准。

Claims (15)

  1. 一种显示数据的处理方法，应用于虚拟现实设备的主机，所述方法包括：
    根据虚拟现实设备的头戴显示器的视场角对所述头戴显示器的显示区域进行划分，将显示区域划分成中心区域和边缘区域；
    根据所述中心区域和边缘区域的范围，将待传输的每帧显示数据分割处理为对应所述中心区域的第一显示数据和对应所述边缘区域的第二显示数据；
    根据预设的第一传输因子和第二传输因子分别处理所述第一显示数据和所述第二显示数据，得到第一传输数据和第二传输数据，所述第二传输数据占用的带宽小于所述第一传输数据；
    将所述第一传输数据和所述第二传输数据发送给所述头戴显示器。
  2. 根据权利要求1所述的处理方法，其中，所述根据预设的第一传输因子和第二传输因子分别处理所述第一显示数据和所述第二显示数据，得到第一传输数据和第二传输数据，包括：
    根据数据传输通道的带宽设置第一显示分辨率和第二显示分辨率，所述第二显示分辨率小于所述第一显示分辨率；
    将第一传输因子预设为所述第一显示分辨率，将第二传输因子预设为所述第二显示分辨率；
    设置中心区域对应的第一显示数据的显示分辨率为所述第一显示分辨率，设置边缘区域对应的第二显示数据的显示分辨率为所述第二显示分辨率，得到第一传输数据和第二传输数据。
  3. 根据权利要求1所述的处理方法，其中，所述根据预设的第一传输因子和第二传输因子分别处理所述第一显示数据和所述第二显示数据，得到第一传输数据和第二传输数据，包括：
    根据数据传输通道的带宽设置第一显示刷新率和第二显示刷新率，所述第二显示刷新率小于所述第一显示刷新率；
    将第一传输因子预设为所述第一显示刷新率，将第二传输因子预设为所述第二显示刷新率；
    设置中心区域对应的第一显示数据的显示刷新率为所述第一显示刷新率，设 置边缘区域对应的第二显示数据的显示刷新率为所述第二显示刷新率，得到第一传输数据和第二传输数据。
  4. 根据权利要求1所述的处理方法，其中，所述根据预设的第一传输因子和第二传输因子分别处理所述第一显示数据和所述第二显示数据，得到第一传输数据和第二传输数据，包括：
    根据数据传输通道的带宽设置第一显示分辨率、第一显示刷新率、第二显示分辨率和第二显示刷新率，所述第二显示分辨率小于所述第一显示分辨率，所述第二显示刷新率小于所述第一显示刷新率；
    将第一传输因子预设为所述第一显示分辨率和所述第一显示刷新率，将第二传输因子预设为所述第二显示分辨率和所述第二显示刷新率；
    设置中心区域对应的第一显示数据的显示分辨率和显示刷新率分别为所述第一显示分辨率和所述第二显示刷新率，设置边缘区域对应的第二显示数据的显示分辨率和显示刷新率分别为所述第二显示分辨率和所述第二显示刷新率，得到第一传输数据和第二传输数据。
  5. 根据权利要求2所述的处理方法，其中，所述第一显示分辨率保持为每帧显示数据的原显示分辨率，所述第二显示分辨率小于所述原显示分辨率。
  6. 根据权利要求3所述的处理方法，其中，所述第一显示刷新率保持为所述待传输的每帧显示数据的原显示刷新率；所述第一显示刷新率为所述第二显示刷新率的整数倍。
  7. 根据权利要求1所述的处理方法，其中，根据所述头戴显示器的视场角对所述头戴显示器的显示区域进行划分，将显示区域划分成中心区域和边缘区域，包括：
    获取用于划分所述显示区域的水平视场角和垂直视场角；
    将所述水平视场角和所述垂直视场角围成的区域设置为中心区域，所述显示区域的其他区域设置为边缘区域。
  8. 一种显示数据的处理方法，应用于虚拟现实设备的头戴显示器，所述方法包括：
    接收虚拟现实设备的主机发送的第一传输数据和第二传输数据，所述第二传 输数据占用的带宽小于所述第一传输数据，所述第一传输数据和第二传输数据为每帧显示数据根据中心区域和边缘区域的范围分割处理后，得到的第一显示数据和第二显示数据，再由第一传输因子和第二传输因子处理第一显示数据和第二显示数据后所得到，其中，所述中心区域和边缘区域为根据所述头戴显示器的视场角对所述头戴显示器的显示区域进行划分后得到；
    对接收到的所述第一传输数据和第二传输数据进行图像重建，得到该帧显示数据对应的显示图像；
    对所述显示图像进行显示输出。
  9. 根据权利要求8所述的处理方法，其中，对接收到的所述第一传输数据和第二传输数据进行图像重建，包括：
    判断所述第二传输数据的数据内容是否为空，若所述第二传输数据的数据内容为空，则复用上一帧显示图像对应的边缘区域的图像数据，将所述边缘区域的图像数据和所述第一传输数据对应的图像数据进行拼接处理，得到该帧显示数据对应的显示图像；
    若所述第二传输数据的数据内容不为空，则判断所述第二传输数据的显示分辨率是否小于所述第一传输数据的显示分辨率，
    若所述第二传输数据的显示分辨率小于所述第一传输数据的显示分辨率，对所述第二传输数据采用差值处理进行第一显示分辨率的图像重建，并将图像重建后的第二传输数据和所述第一传输数据合成为一帧显示图像进行显示输出；
    若所述第二传输数据的显示分辨率等于所述第一传输数据的显示分辨率，将所述第一传输数据和所述第二传输数据合成为一帧显示图像进行显示输出。
  10. 一种虚拟现实设备，包括主机和头戴显示器，
    所述主机，根据所述头戴显示器的视场角对所述头戴显示器的显示区域进行划分，将显示区域划分成中心区域和边缘区域；根据所述中心区域和边缘区域的范围，将待传输的每帧显示数据分割处理为对应所述中心区域的第一显示数据和对应所述边缘区域的第二显示数据；根据预设的第一传输因子和第二传输因子分别处理所述第一显示数据和所述第二显示数据，得到第一传输数据和第二传输数据，所述第二传输数据占用的带宽小于所述第一传输数据；将所述第一传输数据 和所述第二传输数据发送给所述头戴显示器；
    所述头戴显示器，接收所述主机发送的所述第一传输数据和所述第二传输数据，对接收到的所述第一传输数据和所述第二传输数据进行图像重建，得到该帧显示数据对应的显示图像，对所述显示图像进行显示输出。
  11. 根据权利要求10所述的虚拟现实设备，其中，所述主机根据预设的第一传输因子和第二传输因子分别处理所述第一显示数据和所述第二显示数据，得到第一传输数据和第二传输数据，包括：
    所述主机根据数据传输通道的带宽设置第一显示分辨率和第二显示分辨率，所述第二显示分辨率小于所述第一显示分辨率；将第一传输因子预设为所述第一显示分辨率，将第二传输因子预设为所述第二显示分辨率，设置中心区域对应的第一显示数据的显示分辨率为所述第一显示分辨率，设置边缘区域对应的第二显示数据的显示分辨率为所述第二显示分辨率，得到第一传输数据和第二传输数据。
  12. 根据权利要求10所述的虚拟现实设备，其中，所述主机根据预设的第一传输因子和第二传输因子分别处理所述第一显示数据和所述第二显示数据，得到第一传输数据和第二传输数据，包括：
    所述主机根据数据传输通道的带宽设置第一显示刷新率和第二显示刷新率，所述第二显示刷新率小于所述第一显示刷新率；将第一传输因子预设为所述第一显示刷新率，将第二传输因子预设为所述第二显示刷新率；设置中心区域对应的第一显示数据的显示刷新率为所述第一显示刷新率，设置边缘区域对应的第二显示数据的显示刷新率为所述第二显示刷新率，得到第一传输数据和第二传输数据。
  13. 根据权利要求10所述的虚拟现实设备，其中，所述主机根据预设的第一传输因子和第二传输因子分别处理所述第一显示数据和所述第二显示数据，得到第一传输数据和第二传输数据，包括：
    所述主机根据数据传输通道的带宽设置第一显示分辨率、第一显示刷新率、第二显示分辨率和第二显示刷新率，所述第二显示分辨率小于所述第一显示分辨率，所述第二显示刷新率小于所述第一显示刷新率；将第一传输因子预设为所述 第一显示分辨率和所述第一显示刷新率，将第二传输因子预设为所述第二显示分辨率和所述第二显示刷新率；设置中心区域对应的第一显示数据的显示分辨率和显示刷新率分别为所述第一显示分辨率和所述第二显示刷新率，设置边缘区域对应的第二显示数据的显示分辨率和显示刷新率分别为所述第二显示分辨率和所述第二显示刷新率，得到第一传输数据和第二传输数据。
  14. 根据权利要求10所述的虚拟现实设备，其中，所述主机根据所述头戴显示器的视场角对所述头戴显示器的显示区域进行划分，将显示区域划分成中心区域和边缘区域，包括：
    所述主机获取用于划分所述显示区域的水平视场角和垂直视场角，将所述水平视场角和所述垂直视场角围成的区域设置为中心区域，所述显示区域的其他区域设置为边缘区域。
  15. 根据权利要求10所述的虚拟现实设备，其中，所述头戴显示器对接收到的所述第一传输数据和第二传输数据进行图像重建，包括：
    所述头戴显示器判断所述第二传输数据的数据内容是否为空，若所述第二传输数据的数据内容为空，则复用上一帧显示图像对应的边缘区域的图像数据，将所述边缘区域的图像数据和所述第一传输数据对应的图像数据进行拼接处理，得到该帧显示数据对应的显示图像；
    若所述第二传输数据的数据内容不为空，则判断所述第二传输数据的显示分辨率是否小于所述第一传输数据的显示分辨率，若所述第二传输数据的显示分辨率小于所述第一传输数据的显示分辨率，对所述第二传输数据采用差值处理进行第一显示分辨率的图像重建，并将图像重建后的第二传输数据和所述第一传输数据合成为一帧显示图像进行显示输出；若所述第二传输数据的显示分辨率等于所述第一传输数据的显示分辨率，将所述第一传输数据和所述第二传输数据合成为一帧显示图像进行显示输出。
PCT/CN2017/111590 2017-06-09 2017-11-17 一种显示数据的处理方法和设备 WO2018223618A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US15/761,174 US10620903B2 (en) 2017-06-09 2017-11-17 Method and device for processing display data
US16/731,462 US11106422B2 (en) 2017-06-09 2019-12-31 Method for processing display data

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710433460.7 2017-06-09
CN201710433460.7A CN107333119A (zh) 2017-06-09 2017-06-09 一种显示数据的处理方法和设备

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US15/761,174 A-371-Of-International US10620903B2 (en) 2017-06-09 2017-11-17 Method and device for processing display data
US16/731,462 Continuation US11106422B2 (en) 2017-06-09 2019-12-31 Method for processing display data

Publications (1)

Publication Number Publication Date
WO2018223618A1 true WO2018223618A1 (zh) 2018-12-13

Family

ID=60194731

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/111590 WO2018223618A1 (zh) 2017-06-09 2017-11-17 一种显示数据的处理方法和设备

Country Status (3)

Country Link
US (2) US10620903B2 (zh)
CN (1) CN107333119A (zh)
WO (1) WO2018223618A1 (zh)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108665805B (zh) 2017-04-01 2020-09-25 北京京东方显示技术有限公司 显示面板、显示装置和虚拟现实设备
CN107239144B (zh) 2017-06-09 2020-02-07 歌尔股份有限公司 一种设备的输入方法和装置
CN107333119A (zh) 2017-06-09 2017-11-07 歌尔股份有限公司 一种显示数据的处理方法和设备
TWI678107B (zh) 2018-05-16 2019-11-21 香港商京鷹科技股份有限公司 影像傳輸方法及其系統與影像傳送端裝置
CN109637406A (zh) 2019-01-04 2019-04-16 京东方科技集团股份有限公司 一种显示装置的显示方法、显示装置以及可读存储介质
CN109714583B (zh) * 2019-01-22 2022-07-19 京东方科技集团股份有限公司 增强现实的显示方法及增强现实的显示系统
CN111479162B (zh) * 2020-04-07 2022-05-13 成都酷狗创业孵化器管理有限公司 直播数据传输方法、装置以及计算机可读存储介质
CN112214193B (zh) * 2020-06-24 2021-08-03 深圳一点通显示有限公司 多通道数据优化下的边缘显示系统与方法
CN112468820B (zh) * 2020-11-26 2023-08-15 京东方科技集团股份有限公司 图像显示方法及图像显示系统
CN113066431B (zh) * 2021-03-09 2022-03-18 昀光微电子（上海）有限公司 一种数据传输设备、方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103930817A (zh) * 2011-06-20 2014-07-16 谷歌公司 用于数据的自适应传送的系统和方法
CN105340279A (zh) * 2012-12-27 2016-02-17 微软技术许可有限责任公司 用于近眼显示器的显示更新时间缩减
CN106210692A (zh) * 2016-06-30 2016-12-07 深圳市虚拟现实科技有限公司 基于瞳孔检测的远程全景图像实时传输和显示方法
CN106464854A (zh) * 2014-02-26 2017-02-22 索尼电脑娱乐欧洲有限公司 图像编码和显示
WO2017035053A1 (en) * 2015-08-24 2017-03-02 Finisar Corporation Image projection system
CN107333119A (zh) * 2017-06-09 2017-11-07 歌尔股份有限公司 一种显示数据的处理方法和设备

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4409897B2 (ja) * 2003-09-19 2010-02-03 株式会社リコー 画像処理装置、画像処理方法、プログラム及び情報記録媒体
US8405770B2 (en) * 2009-03-12 2013-03-26 Intellectual Ventures Fund 83 Llc Display of video with motion
US8493390B2 (en) 2010-12-08 2013-07-23 Sony Computer Entertainment America, Inc. Adaptive displays using gaze tracking
US8235529B1 (en) 2011-11-30 2012-08-07 Google Inc. Unlocking a screen using eye tracking information
CN102611801A (zh) 2012-03-30 2012-07-25 深圳市金立通信设备有限公司 一种基于眼球运动轨迹控制手机交互的系统和方法
US9030482B2 (en) 2012-11-09 2015-05-12 Intel Corporation Hybrid display frame buffer for display subsystem
CN103902029B (zh) 2012-12-26 2018-03-27 腾讯数码（天津）有限公司 一种移动终端及其解锁方法
KR20150032019A (ko) 2013-09-17 2015-03-25 한국전자통신연구원 시선 추적 기반의 사용자 인터페이스 방법 및 그 장치
US9977495B2 (en) * 2014-09-19 2018-05-22 Utherverse Digital Inc. Immersive displays
CN104699249B (zh) 2015-03-27 2018-04-27 联想(北京)有限公司 一种信息处理方法及电子设备
KR102313485B1 (ko) * 2015-04-22 2021-10-15 삼성전자주식회사 가상현실 스트리밍 서비스를 위한 영상 데이터를 송수신하는 방법 및 장치
CN105139792B (zh) * 2015-08-18 2018-04-20 京东方科技集团股份有限公司 显示方法和显示装置
CN106686295A (zh) 2015-11-11 2017-05-17 中兴通讯股份有限公司 一种控制摄像设备的方法和装置
CN105827866A (zh) * 2016-05-18 2016-08-03 努比亚技术有限公司 一种移动终端及控制方法
CN105979224A (zh) * 2016-06-23 2016-09-28 青岛歌尔声学科技有限公司 一种头戴显示器、视频输出设备和视频处理方法、系统
WO2018035166A1 (en) * 2016-08-16 2018-02-22 Apple Inc. Electronic device with display
CN106412563A (zh) * 2016-09-30 2017-02-15 珠海市魅族科技有限公司 一种图像显示方法以及装置
US20180095531A1 (en) * 2016-10-05 2018-04-05 Lenovo Enterprise Solutions (Singapore) Pte. Ltd. Non-uniform image resolution responsive to a central focus area of a user
US20180137602A1 (en) * 2016-11-14 2018-05-17 Google Inc. Low resolution rgb rendering for efficient transmission
US10424097B2 (en) * 2017-04-01 2019-09-24 Intel Corporation Predictive viewport renderer and foveated color compressor
CN107239144B (zh) 2017-06-09 2020-02-07 歌尔股份有限公司 一种设备的输入方法和装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103930817A (zh) * 2011-06-20 2014-07-16 谷歌公司 用于数据的自适应传送的系统和方法
CN105340279A (zh) * 2012-12-27 2016-02-17 微软技术许可有限责任公司 用于近眼显示器的显示更新时间缩减
CN106464854A (zh) * 2014-02-26 2017-02-22 索尼电脑娱乐欧洲有限公司 图像编码和显示
WO2017035053A1 (en) * 2015-08-24 2017-03-02 Finisar Corporation Image projection system
CN106210692A (zh) * 2016-06-30 2016-12-07 深圳市虚拟现实科技有限公司 基于瞳孔检测的远程全景图像实时传输和显示方法
CN107333119A (zh) * 2017-06-09 2017-11-07 歌尔股份有限公司 一种显示数据的处理方法和设备

Also Published As

Publication number Publication date
US20190235817A1 (en) 2019-08-01
US10620903B2 (en) 2020-04-14
CN107333119A (zh) 2017-11-07
US20200133607A1 (en) 2020-04-30
US11106422B2 (en) 2021-08-31

Similar Documents

Publication Publication Date Title
WO2018223618A1 (zh) 一种显示数据的处理方法和设备
US10582198B2 (en) Method and an apparatus and a computer program product for video encoding and decoding
US8911291B2 (en) Display system and display method for video wall
CN112204993B (zh) 使用重叠的被分区的分段的自适应全景视频流式传输
WO2017219652A1 (zh) 一种头戴显示器、视频输出设备和视频处理方法、系统
US10511803B2 (en) Video signal transmission method and device
US11138460B2 (en) Image processing method and apparatus
KR19990085858A (ko) 다지점 영상회의 시스템 및 그에 따른 구현방법
US20120127261A1 (en) Teleconferencing device and image display processing method
CA2823559A1 (en) Method and apparatus for mcu to optimize configuration of multiple pictures
WO2019013848A1 (en) FOVÉAL COMPRESSION OF DISPLAY FLOW
US20130100247A1 (en) Image data transmission apparatus, control method for image data transmission apparatus, image data transmission method, and image data reception apparatus
TWI610553B (zh) 影像資料傳送裝置
WO2020261617A1 (ja) 画像処理システム、画像処理用集積回路、および画像処理方法
JP2012124899A (ja) デジタルビデオ送信装置及び方法、デジタルビデオ受信装置及び方法、デジタルビデオ送受信システム
US20110157302A1 (en) Three-dimensional video display system with multi-stream sending/receiving operation
JP5265468B2 (ja) 映像受信装置及び表示装置
JP2020115299A (ja) 仮想空間情報処理装置、方法、プログラム
US20230142944A1 (en) Image data transfer apparatus, image display system, and image transfer method
CN110740286A (zh) 一种视频会议控制方法、多点控制单元及视频会议终端
JP2013046319A (ja) 画像処理装置及び、画像処理方法
CN108243293B (zh) 一种基于虚拟现实设备的图像显示方法及系统
WO2021193362A1 (ja) 画像処理装置および画像処理方法
EP4362454A1 (en) Downscale and upscale method and device using artificial intelligence (ai) during video conference
JPH08294102A (ja) 動画像通信会議システム及びその通信方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17912377

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17912377

Country of ref document: EP

Kind code of ref document: A1