WO2018000610A1 - 一种基于图像类型判断的自动播放方法和电子设备 - Google Patents

一种基于图像类型判断的自动播放方法和电子设备 Download PDF

Info

Publication number
WO2018000610A1
WO2018000610A1 PCT/CN2016/099951 CN2016099951W WO2018000610A1 WO 2018000610 A1 WO2018000610 A1 WO 2018000610A1 CN 2016099951 W CN2016099951 W CN 2016099951W WO 2018000610 A1 WO2018000610 A1 WO 2018000610A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
determining
image frame
parallax
image type
Prior art date
Application number
PCT/CN2016/099951
Other languages
English (en)
French (fr)
Inventor
周正
乔伟
Original Assignee
乐视控股（北京）有限公司
乐视致新电子科技（天津）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 乐视控股（北京）有限公司, 乐视致新电子科技（天津）有限公司 filed Critical 乐视控股（北京）有限公司
Publication of WO2018000610A1 publication Critical patent/WO2018000610A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details

Definitions

  • the embodiments of the present invention relate to the field of virtual reality (English: virtual reality, abbreviated as VR), and particularly to an automatic playing method and an electronic device based on image type judgment.
  • virtual reality English: virtual reality, abbreviated as VR
  • VR virtual reality
  • VR technology is a collection of simulation technology and computer graphics human-machine interface technology, multimedia technology, sensing technology, network technology and other technologies. It is a challenging cross-cutting discipline and research field.
  • VR mainly includes simulation environment, perception, natural skills and sensing equipment.
  • the simulation environment is a computer-generated, real-time, dynamic, three-dimensional, realistic image.
  • Perception means that the ideal VR should have the perception of all people, such as the visual perception generated by computer graphics technology.
  • Natural skills refer to the rotation of the person's head, eyes, gestures, or other human behaviors.
  • the computer processes the data that is appropriate to the actions of the participants, responds to the user's input in real time, and feeds back to the user's facial features.
  • the sensing device refers to a gyroscope, an accelerator, and the like.
  • the VR helmet is a kind of helmet display that closes the user's vision and hearing to the outside world and guides the user to create a feeling in the virtual environment.
  • the helmet-type display is the earliest VR display. Its display principle is to use the left and right eye screens to display the images of the left and right eyes respectively. The human eye obtains the information with parallax and produces a stereoscopic effect in the mind.
  • the helmet display has the characteristics of small size and strong sealing.
  • Existing VR systems cannot provide image type detection and cannot accurately determine playback the way.
  • the user can view 2d, 3d or panoramic images or videos through the VR system.
  • Different image types need to provide different playback modes, and the existing VR system cannot provide image type detection, and cannot quickly and accurately determine the playback mode. Affect the user experience.
  • the technical problem to be solved by the embodiments of the present invention is how to provide an automatic playing method based on image type judgment and an electronic device capable of automatically determining an image type to automatically select a corresponding playing manner.
  • an embodiment of the present invention provides, in a first aspect, an automatic playback method based on image type determination, comprising: receiving an image and intercepting an image frame; determining an image type according to the image frame; automatically according to the image type Select the corresponding playback method.
  • determining an image type according to the image frame includes: determining whether a disparity exists between a left half portion and a symmetric right half portion of the image frame; and determining the image when there is disparity For 3d images.
  • determining the image type according to the image frame includes: determining whether there is a disparity between the upper half of the image frame and the lower half of the symmetry; and determining the image when there is disparity For 3d images.
  • determining an image type according to the image frame includes: acquiring a pixel point of a left edge column of the image frame and a pixel point of a right edge column; if located at a corresponding position in the two columns The absolute value of the difference in pixel values of the pixel points is lower than a preset threshold, and the image is determined as a panoramic image.
  • determining the image type according to the image frame includes: when the determination result of the image type is not belonging to the 3d image nor belonging to the panoramic image, determining the image as a 2d image.
  • an embodiment of the present invention provides, in a second aspect, an automatic playback device based on image type determination, including: an intercepting module, configured to receive an image and capture an image. a frame; a determining module, configured to determine an image type according to the image frame; and a playing module, configured to automatically select a corresponding playing mode according to the image type.
  • the determining module is configured to determine whether there is a disparity between the left half of the image frame and the symmetric right half, and determine the image as a 3d image when there is disparity .
  • the determining module is configured to determine whether there is a disparity between the upper half of the image frame and the lower half of the symmetry; and determine the image as a 3d image when there is disparity .
  • the determining module is configured to acquire pixel points of a left edge column and a right edge column of the image frame; if the pixel is located at a corresponding position in the two columns The absolute value of the difference in pixel values is lower than a preset threshold, and the image is determined as a panoramic image.
  • the determining module is configured to determine the image as a 2d image when the determination result of the image type is not belonging to the 3d image or the panoramic image.
  • an embodiment of the present invention provides, in a third aspect, an electronic device, including: at least one processor; and a memory communicably coupled to the at least one processor; wherein the memory is stored An instruction executed by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to: receive an image and intercept an image frame; determine an image type based on the image frame; The image type automatically selects the corresponding playback mode.
  • an embodiment of the present invention provides, in a fourth aspect, a non-transitory computer readable storage medium, where the non-transitory computer readable storage medium stores computer executable instructions, and the computer executable instructions Receiving an image and intercepting an image frame; determining an image type according to the image frame; and automatically selecting a corresponding playback mode according to the image type.
  • Computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions that, when executed by a computer, cause the computer to perform each of the above The method described in the aspects.
  • an automatic playback method and an electronic device based on image type determination can automatically detect an image type after receiving an image, and select a corresponding playback mode to play according to the image type, thereby being fast and accurate.
  • the playback mode of the image is determined to be played, thereby improving the efficiency of playing the image.
  • an automatic playback method and an electronic device based on image type determination can convert a 3d image into a 2d image for playback without having a 3d playback mode.
  • FIG. 1 is a flowchart of an automatic play method based on image type determination according to an embodiment of the present invention
  • Figure 2a shows a schematic diagram of a left and right symmetrical 3d image
  • Figure 2b shows a schematic diagram of a vertically symmetrical 3d image
  • FIG. 3 is a schematic structural diagram of an automatic playback apparatus based on image type determination according to an embodiment of the present invention
  • FIG. 4 is a schematic structural diagram of an automatic playback apparatus based on image type determination according to another embodiment of the present invention.
  • FIG. 5 shows an automatic broadcast based on image type judgment according to still another embodiment of the present invention. Schematic diagram of the structure of the discharge device.
  • FIG. 1 is a flowchart of an automatic play method based on image type determination according to an embodiment of the present invention.
  • the method is performed by an electronic device, and the electronic device may be a server or a terminal. As shown in Figure 1, the method includes steps S1-S3.
  • Step S1 Receive image information and intercept the image frame.
  • N N > 1 image frames are intercepted.
  • Step S2 Determine an image type according to the image frame.
  • FIG. 2a shows a schematic diagram of a left-right symmetric 3d image, as shown in FIG. 2a, in which A represents a left-eye image and B represents a right-eye image, and determining the image type according to the image frame may include: determining a left half of the image frame and Whether there is a parallax between the right half of the symmetry, and the image is judged as a 3d image when there is parallax.
  • the method of judging whether or not there is parallax may be any scheme for judging parallax in the prior art.
  • FIG. 2b shows a schematic diagram of a vertically symmetrical 3d image, as shown in FIG. 2b, in which A can represent a left eye image, B can represent a right eye image, and determining the image type according to the image frame can include: determining an upper image frame. Whether there is a parallax between the half portion and the symmetrical lower half portion, and the image is judged as a 3d image when there is parallax.
  • determining the image type according to the image frame may include: determining whether the image is a panoramic image according to pixel information of an edge column of the image frame.
  • the method may include: acquiring a pixel of a column on the left edge of the image frame, and a pixel of the column with the rightmost edge, if the pixel values of the corresponding pixels in the two columns are the same, or the absolute value of the difference between the pixel values is lower than the pre-predetermined value
  • Setting a threshold the preset threshold may be very small, and the absolute value of the difference between the pixel values is lower than the threshold, indicating that the difference between the pixel values is almost the same, then the left and right sides of the image frame may be spliced to each other, and the image is judged For panoramic images.
  • the image is determined as a 2d image.
  • the method for determining whether there is disparity may be any scheme for determining the disparity in the prior art, when the left half of the image frame and the symmetric When there is no parallax between the right half, it is judged whether there is parallax between the upper half of the image frame and the lower half of the symmetry, and there is no parallax between the upper half of the image frame and the lower half of the symmetry. When it is judged that the image does not belong to the 3d image.
  • determining, according to the pixel information of the edge column of the image frame, whether the image is a panoramic image including acquiring a pixel of a column on the left edge of the image frame, and a pixel of the column with the rightmost edge, when located at a corresponding position in the two columns
  • the image is judged as a 2d image.
  • Step S3 automatically selecting a corresponding play mode according to the image type.
  • the 2d playback mode is automatically selected.
  • the 3d playback mode is automatically selected, and when the image is determined to be a panoramic image, the automatic selection is performed. Select the panorama playback mode.
  • the embodiment of the present invention may further include the step of converting the image type, for example, when the existing player does not have a certain playing mode (such as 3d or panoramic playing mode), the image type may be used. Convert to 2d image and play in 2d mode. For example, you can play only one of its left eye view or right eye view.
  • a certain playing mode such as 3d or panoramic playing mode
  • the image type can be automatically detected after receiving the image, and the corresponding playing mode is selected according to the image type for playing, and if the 3d playing mode is not available, the 3d image can be converted into a 2d image for playing. .
  • FIG. 3 is a schematic structural diagram of an automatic playback apparatus based on image type determination according to an embodiment of the present invention.
  • the apparatus 1 includes an interception module 11, a determination module 12, and a playback module 13.
  • the intercepting module 11 is configured to receive an image and intercept the image frame.
  • the determining module 12 is configured to determine an image type according to the image frame.
  • the playing module 13 is configured to automatically select a corresponding playing mode according to the image type.
  • the determining module 12 is configured to determine whether there is a disparity between the left half of the image frame and the symmetric right half, and determine the image as a 3d image when there is disparity .
  • the determining module 12 is configured to determine whether there is a disparity between the upper half of the image frame and the lower half of the symmetry, and determine the image as a 3d image when there is disparity .
  • the determining module 12 is configured to acquire a pixel point of a left edge column of the image frame and a pixel point of a right edge column, if the pixel is located at a corresponding position in the two columns
  • the absolute value of the difference in pixel values is lower than a preset threshold, and the image is determined as a panoramic image.
  • the determining module 12 is configured to use the image class When the result of the type determination is not a 3d image nor a panoramic image, the image is determined to be a 2d image.
  • the image type can be automatically detected after receiving the image, and the corresponding playing mode is selected according to the image type for playing, and if the 3d playing mode is not available, the 3d image can be converted into a 2d image for playing. .
  • FIG. 4 is a schematic structural diagram of an automatic playback apparatus based on image type determination according to another embodiment of the present invention.
  • the embodiment of the present invention may further include a conversion module 14 for converting an image type, for example, when an existing player does not When a playback mode (such as 3d or panorama playback mode) is available, the image type can be converted to a 2d image and played in 2d mode. For example, you can play only one of its left eye view or right eye view.
  • a playback mode such as 3d or panorama playback mode
  • the embodiment of the present invention provides a non-transitory computer storage medium, where the computer storage medium stores computer executable instructions, and the computer executable instructions can execute the playing method in any of the foregoing method embodiments.
  • FIG. 5 is a block diagram showing the structure of an automatic playback apparatus based on image type determination according to another embodiment of the present invention.
  • the automatic playback device 1100 based on the image type determination may be a host server having a computing capability, a personal computer PC, or a portable computer or terminal that can be carried.
  • the specific embodiments of the present invention do not limit the specific implementation of the computing node.
  • the electronic device 1100 includes a processor 1110, a communication interface 1120, a memory array 1130, and a bus 1140.
  • the processor 1110, the communication interface 1120, and the memory 1130 complete communication with each other through the bus 1140.
  • the communication interface 1120 is configured to communicate with a network element, where the network element includes, for example, a virtual machine management center, shared storage, and the like.
  • the processor 1110 is configured to execute a program.
  • the processor 1110 may be a central processing unit CPU, or an Application Specific Integrated Circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present invention.
  • ASIC Application Specific Integrated Circuit
  • the memory 1130 is used to store files.
  • the memory 1130 may include a high speed RAM memory and may also include a non-volatile memory such as at least one disk memory.
  • Memory 1130 can also be a memory array.
  • the memory 1130 may also be partitioned, and the blocks may be combined into a virtual volume according to certain rules.
  • the above program may be program code including computer operating instructions.
  • the program is specifically configured to: receive an image and intercept an image frame; determine an image type according to the image frame; and automatically select a corresponding playback mode according to the image type.
  • determining an image type according to the image frame includes: determining whether a disparity exists between a left half portion and a symmetric right half portion of the image frame; and determining the image when there is disparity For 3d images.
  • determining the image type according to the image frame includes: determining whether there is a disparity between the upper half of the image frame and the lower half of the symmetry; and determining the image when there is disparity For 3d images.
  • determining an image type according to the image frame includes: acquiring a pixel point of a left edge column of the image frame and a pixel point of a right edge column; if located at a corresponding position in the two columns The absolute value of the difference in pixel values of the pixel points is lower than a preset threshold, and the image is determined as a panoramic image.
  • determining the image type according to the image frame includes: when the determination result of the image type is not belonging to the 3d image nor belonging to the panoramic image, determining the image as a 2d image.
  • the above product can perform the method provided by the embodiment of the present invention, and has the implementation method Functional modules and benefits. For technical details that are not described in detail in this embodiment, reference may be made to the method provided by the embodiments of the present invention.
  • the electronic device of the embodiment of the invention exists in various forms, including but not limited to:
  • Mobile communication devices These devices are characterized by mobile communication functions and are mainly aimed at providing voice and data communication.
  • Such terminals include: smart phones (such as iPhone), multimedia phones, functional phones, and low-end phones.
  • Ultra-mobile PC devices These devices belong to the category of personal computers, have computing and processing functions, and generally have mobile Internet access.
  • Such terminals include: PDAs, MIDs, and UMPC devices, such as the iPad.
  • Portable entertainment devices These devices can display and play multimedia content. Such devices include: audio, video players (such as iPod), handheld game consoles, e-books, and smart toys and portable car navigation devices.
  • the server A device that provides computing services.
  • the server consists of a processor, hard disk, memory, system bus, etc.
  • the server is similar to a general-purpose computer architecture, but because of the need to provide highly reliable services, processing power, stability, and reliability. Security, scalability, manageability and other aspects are high.
  • the device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located A place, or it can be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • a readable storage medium such as a ROM/RAM, a magnetic disk, an optical disk, etc.
  • a computer device which may be a personal computer, server, or electronic device, etc.
  • the automatic playing method and the electronic device based on the image type determination provided by the embodiment of the present invention, by receiving an image and intercepting an image frame, determining an image type according to the image frame, automatically selecting a corresponding playing mode according to the image type, thereby being capable of Quickly and accurately determine the playback mode of the image for playback, thereby improving the efficiency of playing the image.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Processing Or Creating Images (AREA)

Abstract

本发明实施例涉及一种基于图像类型判断的自动播放方法和电子设备，包括：接收图像并截取图像帧，根据所述图像帧判断图像类型，根据所述图像类型自动选择对应的播放方式。根据本发明实施例提供一种基于图像类型判断的自动播放方法和电子设备，可以快速准确的确定图像的播放方式并进行播放，由此提高播放图像的效率。

Description

一种基于图像类型判断的自动播放方法和电子设备
交叉引用
本申请要求在2016年6月30日提交中国专利局、申请号为201610509952.5、发明名称为“一种基于图像类型判断的自动播放方法和装置”的中国专利申请的优先权，该申请的全部内容通过引用结合在本申请中。
技术领域
本发明实施例涉及虚拟现实(英文：virtual reality，缩写：VR)技术领域，尤其涉及一种基于图像类型判断的自动播放方法和电子设备。
背景技术
VR技术是仿真技术与计算机图形学人机接口技术、多媒体技术、传感技术、网络技术等多种技术的集合，是一门富有挑战性的交叉技术前沿学科和研究领域。VR主要包括模拟环境、感知、自然技能和传感设备等方面。模拟环境是由计算机生成的、实时动态的三维立体逼真图像。感知是指理想的VR应该具有一切人所具有的感知，例如计算机图形技术所生成的视觉感知等。自然技能是指人的头部转动，眼睛、手势、或其他人体行为动作，由计算机来处理与参与者的动作相适应的数据，并对用户的输入作出实时响应，并分别反馈到用户的五官。传感设备是指陀螺仪、加速器等。
VR头盔是一种利用头盔显示器将用户对外界的视觉、听觉封闭，引导用户产生一种身在虚拟环境中的感觉。头盔式显示器是最早的VR显示器，其显示原理是利用左右眼屏幕分别显示左右眼的图像，人眼获取这种具有视差的信息后在脑海中产生立体感。头盔显示器作为VR显示设备，具有小巧和封闭性强的特点。用户使用VR头盔时，首先，需要将智能终端放入VR头盔，构成VR系统，使用户进行虚拟现实体验。
现有VR系统无法提供图像类型的检测，不能准确地确定播放 方式。在使用中，用户可以通过VR系统观看2d、3d或全景图像或视频，不同的图像类型需要提供不同的播放方式，而现有VR系统无法提供图像类型的检测，不能快速准确的确定播放方式，影响用户感受。
发明内容
有鉴于此，本发明实施例要解决的技术问题是，如何提供一种基于图像类型判断的自动播放方法和电子设备能够自动判断图像类型以自动选择相应的播放方式。
为解决以上技术问题，本发明实施例在第一方面提供一种基于图像类型判断的自动播放方法，包括：接收图像并截取图像帧；根据所述图像帧判断图像类型；根据所述图像类型自动选择对应的播放方式。
在一种可能的实现方式中，根据所述图像帧判断图像类型包括：判断所述图像帧中左半部分和对称的右半部分之间是否存在视差；并且当存在视差时将所述图像判断为3d图像。
在一种可能的实现方式中，根据所述图像帧判断图像类型包括：判断所述图像帧中上半部分和对称的下半部分之间是否存在视差；并且当存在视差时将所述图像判断为3d图像。
在一种可能的实现方式中，根据所述图像帧判断图像类型包括：获取所述图像帧左侧边缘列的像素点与右侧边缘列的像素点；若位于所述两列中对应位置的像素点的像素值之差的绝对值低于预设阈值，则将所述图像判断为全景图像。
在一种可能的实现方式中，根据所述图像帧判断图像类型包括：当所述图像类型的判断结果为不属于3d图像也不属于全景图像时，将所述图像判断为2d图像。
为解决以上技术问题，本发明实施例在第二方面提供一种基于图像类型判断的自动播放装置，包括：截取模块，用于接收图像并截取图像 帧；判断模块，用于根据所述图像帧判断图像类型；播放模块，用于根据所述图像类型自动选择对应的播放方式。
在一种可能的实现方式中，所述判断模块，用于判断所述图像帧中左半部分和对称的右半部分之间是否存在视差；并且当存在视差时将所述图像判断为3d图像。
在一种可能的实现方式中，所述判断模块，用于判断所述图像帧中上半部分和对称的下半部分之间是否存在视差；并且当存在视差时将所述图像判断为3d图像。
在一种可能的实现方式中，所述判断模块，用于获取所述图像帧左侧边缘列的像素点与右侧边缘列的像素点；若位于所述两列中对应位置的像素点的像素值之差的绝对值低于预设阈值，则将所述图像判断为全景图像。
在一种可能的实现方式中，所述判断模块，用于当所述图像类型的判断结果为不属于3d图像也不属于全景图像时，将所述图像判断为2d图像。
为解决以上技术问题，本发明实施例在第三方面提供一种电子设备，包括：至少一个处理器；以及，与所述至少一个处理器通信连接的存储器；其中，所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行，以使所述至少一个处理器能够：接收图像并截取图像帧；根据所述图像帧判断图像类型；根据所述图像类型自动选择对应的播放方式。
为解决以上技术问题，本发明实施例在第四方面提供一种非暂态计算机可读存储介质，所述非暂态计算机可读存储介质存储有计算机可执行指令，所述计算机可执行指令用于：接收图像并截取图像帧；根据所述图像帧判断图像类型；根据所述图像类型自动选择对应的播放方式。
为解决以上技术问题，本发明实施例在第五方面提供一种计算 机程序产品，所述计算机程序产品包括存储在非暂态计算机可读存储介质上的计算机程序，所述计算机程序包括程序指令，当所述程序指令被计算机执行时，使所述计算机执行以上各个方面所述的方法。
根据本发明实施例提供的一种基于图像类型判断的自动播放方法和电子设备，可以在接收到图像后自动检测图像类型，并根据图像类型选择对应的播放方式进行播放，由此能够快速准确的确定图像的播放方式进行播放，由此提高播放图像的效率。
根据本发明实施例提供的一种基于图像类型判断的自动播放方法和电子设备，可以在不具备3d播放模式的情况下，将3d图像转换为2d图像进行播放。
根据下面参考附图对示例性实施例的详细说明，本发明实施例的其它特征及方面将变得清楚。
附图说明
一个或多个实施例通过与之对应的附图中的图片进行示例性说明，这些示例性说明并不构成对实施例的限定，附图中具有相同参考数字标号的元件表示为类似的元件，除非有特别申明，附图中的图不构成比例限制。
图1示出本发明实施例提供的基于图像类型判断的自动播放方法的流程图；
图2a示出左右对称的3d图像的示意图；
图2b示出上下对称的3d图像的示意图；
图3示出本发明实施例提供的基于图像类型判断的自动播放装置的结构示意图；
图4示出本发明另一实施例提供的基于图像类型判断的自动播放装置的结构示意图；
图5示出本发明再一实施例提供的基于图像类型判断的自动播 放装置的结构示意图。
具体实施方式
以下结合附图对本发明的优选实施例进行说明，应当理解，此处所描述的优选实施例仅用于说明和解释本发明，并不用于限定本发明。
以下将参考附图详细说明本发明的各种示例性实施例、特征和方面。附图中相同的附图标记表示功能相同或相似的元件。尽管在附图中示出了实施例的各种方面，但是除非特别指出，不必按比例绘制附图。
在这里专用的词“示例性”意为“用作例子、实施例或说明性”。这里作为“示例性”所说明的任何实施例不必解释为优于或好于其它实施例。
另外，为了更好的说明本发明实施例，在下文的具体实施方式中给出了众多的具体细节。本领域技术人员应当理解，没有某些具体细节，本发明同样可以实施。在一些实例中，对于本领域技术人员熟知的方法、手段、元件未作详细描述，以便于凸显本发明的主旨。
实施例1
图1示出本发明实施例提供的基于图像类型判断的自动播放方法的流程图，该方法由电子设备执行，电子设备可以为服务器或终端。如图1所示，该方法包括步骤S1-S3。
步骤S1、接收图像信息并截取图像帧。
例如，接收图像信息后，截取例如N(N＞1)个图像帧。
步骤S2、根据图像帧判断图像类型。
图2a示出左右对称的3d图像的示意图，如图2a所示，图中A表示左眼图像，B表示右眼图像，根据该图像帧判断图像类型可以包括：判断图像帧中左半部分和对称的右半部分之间是否存在视差，当存在视差时将该图像判断为3d图像。判断是否存在视差的方法可以为现有技术中任何判断视差的方案。
图2b示出上下对称的3d图像的示意图，如图2b所示，图中A可以表示左眼图像，B可以表示右眼图像，根据该图像帧判断图像类型可以包括：判断图像帧中的上半部分和对称的下半部分之间是否存在视差，当存在视差时将该图像判断为3d图像。
进一步地，根据该图像帧判断图像类型可以包括：根据图像帧边缘列的像素信息，判断该图像是否为全景图像。
具体可以包括获取图像帧左侧边缘一列的像素点，与最右侧边缘一列的像素点，若位于该两列中对应位置的像素点像素值相同，或者像素值之差的绝对值低于预设阈值，该预设阈值可以非常小，像素值之差的绝对值低于该阈值说明像素值之差几乎相同，那么说明该图像帧的左侧与右侧可以互相拼接，则将该图像判断为全景图像。
并且，当图像不属于3d图像也不属于全景图像时，将该图像判断为2d图像。
具体地，判断图像帧中左半部分和对称的右半部分之间是否存在视差，判断是否存在视差的方法可以为现有技术中任何判断视差的方案，当图像帧中左半部分和对称的右半部分之间不存在视差时，判断图像帧中的上半部分和对称的下半部分之间是否存在视差，并且当图像帧中的上半部分和对称的下半部分之间不存在视差时，判断图像不属于3d图像。
进一步，根据图像帧边缘列的像素信息，判断该图像是否为全景图像，包括获取图像帧左侧边缘一列的像素点，与最右侧边缘一列的像素点，当位于该两列中对应位置的像素点像素值不相同，或者像素值之差的绝对值高于预设阈值时，判断图像不属于全景图像。此时，将图像判断为2d图像。
步骤S3、根据图像类型，自动选择对应的播放方式。
包括当判断图像为2d图像时，自动选择2d播放模式，当判断图像为3d图像时，自动选择3d播放模式，判断图像为全景图像时，自动选 择全景播放模式。
在一种可能的实现方式中，本发明实施例还可以包括对图像类型进行转换的步骤，例如当现有播放器不具备某播放方式(如3d或全景播放方式)时，可以将该图像类型转换为2d图像，并用2d模式进行播放。例如可以只播放其左眼视图或右眼视图之中的一个视图。
根据本发明实施例，可以在接收到图像后自动检测图像类型，并根据图像类型选择对应的播放方式进行播放，并且在不具备3d播放模式的情况下，可以将3d图像转换为2d图像进行播放。
实施例2
图3示出本发明实施例提供的基于图像类型判断的自动播放装置的结构示意图，如图3所示，该装置1包括：截取模块11、判断模块12和播放模块13。
截取模块11，用于接收图像并截取图像帧。
判断模块12，用于根据所述图像帧判断图像类型。
播放模块13，用于根据所述图像类型自动选择对应的播放方式。
在一种可能的实现方式中，所述判断模块12用于判断所述图像帧中左半部分和对称的右半部分之间是否存在视差，并且当存在视差时将所述图像判断为3d图像。
在一种可能的实现方式中，所述判断模块12用于判断所述图像帧中上半部分和对称的下半部分之间是否存在视差，并且当存在视差时将所述图像判断为3d图像。
在一种可能的实现方式中，所述判断模块12用于获取所述图像帧左侧边缘列的像素点与右侧边缘列的像素点，若位于所述两列中对应位置的像素点的像素值之差的绝对值低于预设阈值，则将所述图像判断为全景图像。
在一种可能的实现方式中，所述判断模块12用于当所述图像类 型的判断结果为不属于3d图像也不属于全景图像时，将所述图像判断为2d图像。
根据本发明实施例，可以在接收到图像后自动检测图像类型，并根据图像类型选择对应的播放方式进行播放，并且在不具备3d播放模式的情况下，可以将3d图像转换为2d图像进行播放。
图4示出本发明另一实施例提供的基于图像类型判断的自动播放装置的结构示意图，本发明实施例还可以包括转换模块14，用于对图像类型进行转换，例如当现有播放器不具备某播放方式(如3d或全景播放方式)时，可以将该图像类型转换为2d图像，并用2d模式进行播放。例如可以只播放其左眼视图或右眼视图之中的一个视图。
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描述的装置的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
实施例3
本发明实施例提供了一种非暂态计算机存储介质，所述计算机存储介质存储有计算机可执行指令，该计算机可执行指令可执行上述任意方法实施例中的播放方法。
实施例4
图5示出了本发明的另一个实施例的一种基于图像类型判断的自动播放装置的结构框图。所述基于图像类型判断的自动播放装置1100可以是具备计算能力的主机服务器、个人计算机PC、或者可携带的便携式计算机或终端等。本发明具体实施例并不对计算节点的具体实现做限定。
该电子设备1100包括处理器(processor)1110、通信接口(Communications Interface)1120、存储器(memory array)1130和总线1140。其中，处理器1110、通信接口1120、以及存储器1130通过总线1140完成相互间的通信。
通信接口1120用于与网元通信，其中网元包括例如虚拟机管理中心、共享存储等。
处理器1110用于执行程序。处理器1110可能是一个中央处理器CPU，或者是专用集成电路ASIC(Application Specific Integrated Circuit)，或者是被配置成实施本发明实施例的一个或多个集成电路。
存储器1130用于存放文件。存储器1130可能包含高速RAM存储器，也可能还包括非易失性存储器(non-volatile memory)，例如至少一个磁盘存储器。存储器1130也可以是存储器阵列。存储器1130还可能被分块，并且所述块可按一定的规则组合成虚拟卷。
在一种可能的实施方式中，上述程序可为包括计算机操作指令的程序代码。该程序具体可用于执行：接收图像并截取图像帧；根据所述图像帧判断图像类型；根据所述图像类型自动选择对应的播放方式。
在一种可能的实现方式中，根据所述图像帧判断图像类型包括：判断所述图像帧中左半部分和对称的右半部分之间是否存在视差；并且当存在视差时将所述图像判断为3d图像。
在一种可能的实现方式中，根据所述图像帧判断图像类型包括：判断所述图像帧中上半部分和对称的下半部分之间是否存在视差；并且当存在视差时将所述图像判断为3d图像。
在一种可能的实现方式中，根据所述图像帧判断图像类型包括：获取所述图像帧左侧边缘列的像素点与右侧边缘列的像素点；若位于所述两列中对应位置的像素点的像素值之差的绝对值低于预设阈值，则将所述图像判断为全景图像。
在一种可能的实现方式中，根据所述图像帧判断图像类型包括：当所述图像类型的判断结果为不属于3d图像也不属于全景图像时，将所述图像判断为2d图像。
上述产品可执行本发明实施例所提供的方法，具备执行方法相 应的功能模块和有益效果。未在本实施例中详尽描述的技术细节，可参见本发明实施例所提供的方法。
本发明实施例的电子设备以多种形式存在，包括但不限于：
移动通信设备：这类设备的特点是具备移动通信功能，并且以提供话音、数据通信为主要目标。这类终端包括：智能手机(例如iPhone)、多媒体手机、功能性手机，以及低端手机等。
超移动个人计算机设备：这类设备属于个人计算机的范畴，有计算和处理功能，一般也具备移动上网特性。这类终端包括：PDA、MID和UMPC设备等，例如iPad。
便携式娱乐设备：这类设备可以显示和播放多媒体内容。该类设备包括：音频、视频播放器(例如iPod)，掌上游戏机，电子书，以及智能玩具和便携式车载导航设备。
服务器：提供计算服务的设备，服务器的构成包括处理器、硬盘、内存、系统总线等，服务器和通用的计算机架构类似，但是由于需要提供高可靠的服务，因此在处理能力、稳定性、可靠性、安全性、可扩展性、可管理性等方面要求较高。
其他具有数据交互功能的电子装置。
以上所描述的装置实施例仅仅是示意性的，其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到各实施方式可借助软件加通用硬件平台的方式来实现，当然也可以通过硬件。基于这样的理解，上述技术方案本质上或者说对相关技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品可以存储在计算机 可读存储介质中，如ROM/RAM、磁碟、光盘等，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者电子设备等)执行各个实施例或者实施例的某些部分所述的方法。
最后应说明的是：以上实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。
工业实用性
本发明实施例提供的基于图像类型判断的自动播放方法和电子设备，通过接收图像并截取图像帧，根据所述图像帧判断图像类型，根据所述图像类型自动选择对应的播放方式，由此能够快速准确的确定图像的播放方式进行播放，由此提高播放图像的效率。

Claims (21)

  1. 一种基于图像类型判断的自动播放方法，由电子设备执行，所述方法包括：
    接收图像并截取图像帧；
    根据所述图像帧判断图像类型；
    根据所述图像类型自动选择对应的播放方式。
  2. 根据权利要求1所述的自动播放方法，其特征在于，根据所述图像帧判断图像类型包括：
    判断所述图像帧中左半部分和对称的右半部分之间是否存在视差；并且
    当存在视差时将所述图像判断为3d图像。
  3. 根据权利要求1或2所述的自动播放方法，其特征在于，根据所述图像帧判断图像类型包括：
    判断所述图像帧中上半部分和对称的下半部分之间是否存在视差；并且
    当存在视差时将所述图像判断为3d图像。
  4. 根据权利要求1-3中任一项所述的自动播放方法，其特征在于，根据所述图像帧判断图像类型包括：
    获取所述图像帧左侧边缘列的像素点与右侧边缘列的像素点；
    若位于所述两列中对应位置的像素点的像素值之差的绝对值低于预设阈值，则将所述图像判断为全景图像。
  5. 根据权利要求4所述的自动播放方法，其特征在于，根据所述图像帧判断图像类型包括：
    当所述图像类型的判断结果为不属于3d图像也不属于全景图像时，将所述图像判断为2d图像。
  6. 一种基于图像类型判断的自动播放装置，其特征在于，包括：
    截取模块，用于接收图像并截取图像帧；
    判断模块，用于根据所述图像帧判断图像类型；
    播放模块，用于根据所述图像类型自动选择对应的播放方式。
  7. 根据权利要求6所述的自动播放装置，其特征在于，所述判断模块，用于判断所述图像帧中左半部分和对称的右半部分之间是否存在视差；并且
    当存在视差时将所述图像判断为3d图像。
  8. 根据权利要求6或7所述的自动播放装置，其特征在于，所述判断模块，用于判断所述图像帧中上半部分和对称的下半部分之间是否存在视差；并且当存在视差时将所述图像判断为3d图像。
  9. 根据权利要求6-8中任一项所述的自动播放装置，其特征在于，所述判断模块，用于获取所述图像帧左侧边缘列的像素点与右侧边缘列的像素点；若位于所述两列中对应位置的像素点的像素值之差的绝对值低于预设阈值，则将所述图像判断为全景图像。
  10. 根据权利要求9所述的自动播放装置，其特征在于，所述判断模块，用于当所述图像类型的判断结果为不属于3d图像也不属于全景图像时，将所述图像判断为2d图像。
  11. 一种电子设备，包括：
    至少一个处理器；以及，
    与所述至少一个处理器通信连接的存储器；其中，
    所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所 述至少一个处理器执行，以使所述至少一个处理器能够：
    接收图像并截取图像帧；
    根据所述图像帧判断图像类型；
    根据所述图像类型自动选择对应的播放方式。
  12. 根据权利要求11所述的电子设备，其特征在于，根据所述图像帧判断图像类型包括：
    判断所述图像帧中左半部分和对称的右半部分之间是否存在视差；并且
    当存在视差时将所述图像判断为3d图像。
  13. 根据权利要求11或12所述的电子设备，其特征在于，根据所述图像帧判断图像类型包括：
    判断所述图像帧中上半部分和对称的下半部分之间是否存在视差；并且
    当存在视差时将所述图像判断为3d图像。
  14. 根据权利要求11-13中任一项所述的电子设备，其特征在于，根据所述图像帧判断图像类型包括：
    获取所述图像帧左侧边缘列的像素点与右侧边缘列的像素点；
    若位于所述两列中对应位置的像素点的像素值之差的绝对值低于预设阈值，则将所述图像判断为全景图像。
  15. 根据权利要求14所述的电子设备，其特征在于，根据所述图像帧判断图像类型包括：
    当所述图像类型的判断结果为不属于3d图像也不属于全景图像时，将所述图像判断为2d图像。
  16. 一种非暂态计算机可读存储介质，其特征在于，所述非暂态计算机可 读存储介质存储有计算机可执行指令，所述计算机可执行指令用于：
    接收图像并截取图像帧；
    根据所述图像帧判断图像类型；
    根据所述图像类型自动选择对应的播放方式。
  17. 根据权利要求16所述的非暂态计算机可读存储介质，其特征在于，根据所述图像帧判断图像类型包括：
    判断所述图像帧中左半部分和对称的右半部分之间是否存在视差；并且
    当存在视差时将所述图像判断为3d图像。
  18. 根据权利要求16或17所述的非暂态计算机可读存储介质，其特征在于，根据所述图像帧判断图像类型包括：
    判断所述图像帧中上半部分和对称的下半部分之间是否存在视差；并且
    当存在视差时将所述图像判断为3d图像。
  19. 根据权利要求16-18中任一项所述的非暂态计算机可读存储介质，其特征在于，根据所述图像帧判断图像类型包括：
    获取所述图像帧左侧边缘列的像素点与右侧边缘列的像素点；
    若位于所述两列中对应位置的像素点的像素值之差的绝对值低于预设阈值，则将所述图像判断为全景图像。
  20. 根据权利要求19所述的非暂态计算机可读存储介质，其特征在于，根据所述图像帧判断图像类型包括：
    当所述图像类型的判断结果为不属于3d图像也不属于全景图像时，将所述图像判断为2d图像。
  21. 一种计算机程序产品，所述计算机程序产品包括存储在非暂态计算 机可读存储介质上的计算机程序，所述计算机程序包括程序指令，当所述程序指令被计算机执行时，使所述计算机执行权利要求1-5任一项所述的方法。
PCT/CN2016/099951 2016-06-30 2016-09-23 一种基于图像类型判断的自动播放方法和电子设备 WO2018000610A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610509952.5A CN106101698A (zh) 2016-06-30 2016-06-30 一种基于图像类型判断的自动播放方法和装置
CN201610509952.5 2016-06-30

Publications (1)

Publication Number Publication Date
WO2018000610A1 true WO2018000610A1 (zh) 2018-01-04

Family

ID=57212169

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/099951 WO2018000610A1 (zh) 2016-06-30 2016-09-23 一种基于图像类型判断的自动播放方法和电子设备

Country Status (2)

Country Link
CN (1) CN106101698A (zh)
WO (1) WO2018000610A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106897041A (zh) * 2017-02-22 2017-06-27 重庆卓美华视光电有限公司 互动教学方法、装置及系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101010960A (zh) * 2004-08-13 2007-08-01 庆熙大学校产学协力团 针对全景图像进行运动估计和补偿的方法和设备
US20100007716A1 (en) * 2008-07-09 2010-01-14 Lg Display Co., Ltd. Stereoscopic 3d display device
CN102970555A (zh) * 2012-11-30 2013-03-13 深圳Tcl新技术有限公司 调整3d视频播放模式的方法和装置
CN104683787A (zh) * 2015-03-12 2015-06-03 青岛歌尔声学科技有限公司 识别视频类型的方法、装置和显示设备及其投影视频方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101010960A (zh) * 2004-08-13 2007-08-01 庆熙大学校产学协力团 针对全景图像进行运动估计和补偿的方法和设备
US20100007716A1 (en) * 2008-07-09 2010-01-14 Lg Display Co., Ltd. Stereoscopic 3d display device
CN102970555A (zh) * 2012-11-30 2013-03-13 深圳Tcl新技术有限公司 调整3d视频播放模式的方法和装置
CN104683787A (zh) * 2015-03-12 2015-06-03 青岛歌尔声学科技有限公司 识别视频类型的方法、装置和显示设备及其投影视频方法

Also Published As

Publication number Publication date
CN106101698A (zh) 2016-11-09

Similar Documents

Publication Publication Date Title
WO2020207191A1 (zh) 虚拟物体被遮挡的区域确定方法、装置及终端设备
US10003769B2 (en) Video telephony system, image display apparatus, driving method of image display apparatus, method for generating realistic image, and non-transitory computer readable recording medium
WO2018000609A1 (zh) 一种虚拟现实系统中分享3d影像的方法和电子设备
WO2017193576A1 (zh) 一种视频分辨率的适应方法、装置及虚拟现实终端
US20150356770A1 (en) Street view map display method and system
WO2018000619A1 (zh) 一种数据展示方法、装置、电子设备与虚拟现实设备
WO2017092332A1 (zh) 一种渲染图像的处理方法及装置
WO2017177622A1 (zh) 一种全景视频的播放方法、装置和电子设备
US20170186243A1 (en) Video Image Processing Method and Electronic Device Based on the Virtual Reality
CN112543343B (zh) 基于连麦直播的直播画面处理方法、装置及电子设备
US20130027389A1 (en) Making a two-dimensional image into three dimensions
KR102030322B1 (ko) 비디오 프레임의 다수의 부분들에 대한 지문들을 생성함으로써 입체 비디오들을 검출하기 위한 방법들, 시스템들, 및 매체들
CN108833877B (zh) 图像处理方法及装置、计算机装置及可读存储介质
WO2018000608A1 (zh) 一种虚拟现实系统中分享全景影像的方法和电子设备
WO2017092432A1 (zh) 一种虚拟现实交互方法、装置和系统
WO2023169283A1 (zh) 双目立体全景图像的生成方法、装置、设备、存储介质和产品
WO2018000620A1 (zh) 一种数据展示方法及装置、虚拟现实设备与播放控制器
WO2018000606A1 (zh) 一种虚拟现实交互界面的切换方法和电子设备
CN106412718A (zh) 一种字幕在3d空间中的渲染方法及其装置
CN109816791B (zh) 用于生成信息的方法和装置
WO2018000610A1 (zh) 一种基于图像类型判断的自动播放方法和电子设备
US20170169572A1 (en) Method and electronic device for panoramic video-based region identification
TWI790560B (zh) 並排影像偵測方法與使用該方法的電子裝置
US20170188052A1 (en) Video format discriminating method and system
KR20200137839A (ko) Vr 학습 영상 제공 방법 및 장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16907006

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16907006

Country of ref document: EP

Kind code of ref document: A1