CN106961622B - Display processing method and device - Google Patents

Display processing method and device Download PDF

Info

Publication number
CN106961622B
CN106961622B CN201710200445.8A CN201710200445A CN106961622B CN 106961622 B CN106961622 B CN 106961622B CN 201710200445 A CN201710200445 A CN 201710200445A CN 106961622 B CN106961622 B CN 106961622B
Authority
CN
China
Prior art keywords
image stream
image
stream
sub
unit data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710200445.8A
Other languages
Chinese (zh)
Other versions
CN106961622A (en
Inventor
雷小刚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lenovo Beijing Ltd
Original Assignee
Lenovo Beijing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lenovo Beijing Ltd filed Critical Lenovo Beijing Ltd
Priority to CN201710200445.8A priority Critical patent/CN106961622B/en
Publication of CN106961622A publication Critical patent/CN106961622A/en
Application granted granted Critical
Publication of CN106961622B publication Critical patent/CN106961622B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/426Internal components of the client ; Characteristics thereof
    • H04N21/42607Internal components of the client ; Characteristics thereof for processing the incoming bitstream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally

Abstract

The invention discloses a display processing method and a display processing device, wherein the method comprises the following steps: obtaining a first image stream, the first image stream corresponding to a first field of view; obtaining a second image stream, wherein the second image stream at least corresponds to a visual field outside the first visual field, and the data quantity of unit data in the second image stream is smaller than that of the unit data in the first image stream; displaying the first image stream. The user can watch the corresponding site image (such as real-time image) larger than the visual field through the terminal and other electronic equipment at one observation point in the displayed image, the definition of the image is ensured in the watching process, and the user experience is good.

Description

Display processing method and device
Technical Field
The present invention relates to the field of image processing, and in particular, to a display processing method and apparatus.
Background
Various forms of display processing may be performed on the acquired images for different purposes of use, especially, the application and display processing of the panoramic image can conveniently serve the user, the panoramic image can watch the corresponding real-time image (live broadcast image) in a certain visual field range at the observation point, the panoramic image has higher definition under the normal condition, but also requires higher definition of the image when viewing the corresponding live image at the viewpoint in other fields of view (e.g. rotated by a certain angle), however, if the image file satisfying these requirements is large, processing a large file with high definition requires high hardware configuration, and further, in specific use, users often cannot watch the whole panoramic image at the same time, but watch the panoramic image step by step with different view angles, so that huge waste of hardware and network bandwidth is caused.
Disclosure of Invention
The embodiment of the invention aims to provide a display processing method and device. The method meets the requirement that a user can see the images with high definition when watching the images such as panoramic images and the like, and simultaneously reduces the configuration requirement on corresponding hardware.
In order to solve the technical problem, the embodiment of the invention adopts the following technical scheme: a display processing method, comprising:
obtaining a first image stream, the first image stream corresponding to a first field of view;
obtaining a second image stream, wherein the second image stream at least corresponds to a visual field outside the first visual field, and the data quantity of unit data in the second image stream is smaller than that of the unit data in the first image stream;
displaying the first image stream.
Preferably, the method further comprises:
obtaining a horizon adjustment parameter, the horizon adjustment parameter being a parameter indicative of an adjustment from a first horizon to a second horizon;
determining a third image stream corresponding to the second view according to the adjustment parameter and at least a second image stream;
displaying the third image stream corresponding to the second field of view.
Preferably, the method further comprises:
obtaining a fourth image stream corresponding to the third image stream, wherein the unit data amount of the third image stream is smaller than that of the fourth image stream, the unit data amount of the third image stream is equal to that of the second image stream, and the unit data amount of the fourth image stream is equal to that of the first image stream;
displaying the fourth image stream corresponding to the second field of view.
Preferably, the field of view corresponding to the second image stream comprises the first field of view, or the field of view corresponding to the second image stream is adjacent to the first field of view;
or
The field of view corresponding to the second image stream and the first field of view constitute a full field of view, or the field of view corresponding to the second image stream is a full field of view, or the field of view corresponding to the second image stream and the first field of view constitute a field of view that is less than a full field of view.
Preferably, determining a third image stream corresponding to the second field of view at least from the second image stream in dependence on the adjustment parameter comprises: if the second field of view comprises a partial region of the first field of view,
reducing the unit data amount of a first image stream corresponding to a partial area of the first visual field to obtain a first sub-image stream corresponding to the partial area; obtaining a second sub-image stream of a region within the second field of view other than the partial region from the second image stream; generating the third image stream from the first sub-image stream and the second sub-image stream;
or
Obtaining a first sub-image stream corresponding to the partial region from the first image stream, and obtaining a second sub-image stream of a region other than the partial region in the second view from the second image stream; generating the third image stream according to the first sub-image stream and the second sub-image stream, wherein the data amount of unit data of the first sub-image stream is larger than the data amount of unit data of the second sub-image stream.
Preferably, determining a third image stream corresponding to the second field of view at least from the second image stream in dependence on the adjustment parameter comprises:
and if the second visual field does not comprise a partial region of the first visual field, obtaining the third image stream corresponding to the second visual field from the second image stream.
An embodiment of the present invention further provides a display processing apparatus, including:
communication means for obtaining a first image stream corresponding to a first field of view and a second image stream corresponding to at least a field of view outside the first field of view, the data amount of unit data in the second image stream being smaller than the data amount of unit data in the first image stream;
display means for displaying the first image stream.
Preferably, the apparatus further comprises:
acquisition means for obtaining a field of view adjustment parameter, the field of view adjustment parameter being a parameter indicative of an adjustment from a first field of view to a second field of view;
processing means for determining a third image stream corresponding to the second field of view at least from a second image stream in dependence on the adjustment parameter;
wherein the display device is capable of displaying the third image stream corresponding to the second field of view.
Preferably, the communication device is capable of obtaining a fourth image stream corresponding to the third image stream, wherein the unit data amount of the third image stream is smaller than the unit data amount of the fourth image stream, the unit data amount of the third image stream is equal to the unit data amount of the second image stream, and the unit data amount of the fourth image stream is equal to the unit data amount of the first image stream;
the display device is capable of displaying the fourth image stream corresponding to the second field of view.
Preferably, the processing device is capable of determining, at least from the second image stream, a third image stream corresponding to the second field of view according to the adjustment parameter, and performing: if the second field of view comprises a partial region of the first field of view,
reducing the unit data amount of a first image stream corresponding to a partial area of the first visual field to obtain a first sub-image stream corresponding to the partial area; obtaining a second sub-image stream of a region within the second field of view other than the partial region from the second image stream; generating the third image stream from the first sub-image stream and the second sub-image stream;
or
A first sub-image stream corresponding to the partial region can be obtained from the first image stream, and a second sub-image stream of a region other than the partial region in the second field of view can be obtained from the second image stream; generating the third image stream according to the first sub-image stream and the second sub-image stream, wherein the data amount of unit data of the first sub-image stream is larger than the data amount of unit data of the second sub-image stream.
The embodiment of the invention has the beneficial effects that: the user can watch the corresponding site image (such as real-time image) larger than the visual field through the terminal and other electronic equipment at one observation point in the displayed image, the definition of the image is ensured in the watching process, and the user experience is good.
Drawings
FIG. 1 is a flow chart of a display processing method according to an embodiment of the present invention;
FIG. 2 is a flow chart of a display processing method for displaying a third image stream according to an embodiment of the present invention;
FIG. 3 is a block diagram of a connection structure of a display processing apparatus according to an embodiment of the present invention;
FIG. 4 is a first illustration of a relationship between a first field of view and a second field of view in accordance with an embodiment of the present invention;
FIG. 5 is a second illustration of the relationship of the first field of view and the second field of view in accordance with an embodiment of the present invention;
FIG. 6 is a third illustration of the relationship of the first field of view and the second field of view in accordance with an embodiment of the present invention;
FIG. 7 is a fourth illustration of the relationship of the first field of view and the second field of view in accordance with an embodiment of the present invention;
fig. 8 is a fifth schematic diagram of the relationship between the first field of view and the second field of view according to the embodiment of the invention.
Description of the reference numerals
1-display processing device 2-communication device 3-display device
4-acquisition device 5-processing device 6-server
7-first field of view 8-second field of view 9-viewpoint
Detailed Description
Various aspects and features of the present invention are described herein with reference to the drawings.
It will be understood that various modifications may be made to the embodiments disclosed herein. Accordingly, the foregoing description should not be construed as limiting, but merely as exemplifications of embodiments. Other modifications will occur to those skilled in the art which are within the scope and spirit of the invention.
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and, together with a general description of the invention given above, and the detailed description of the embodiments given below, serve to explain the principles of the invention.
These and other characteristics of the invention will become apparent from the following description of a preferred form of embodiment, given as a non-limiting example, with reference to the accompanying drawings.
It should also be understood that, although the invention has been described with reference to some specific examples, a person of skill in the art shall certainly be able to achieve many other equivalent forms of the invention, having the characteristics as set forth in the claims and hence all coming within the field of protection defined thereby.
The above and other aspects, features and advantages of the present invention will become more apparent in view of the following detailed description when taken in conjunction with the accompanying drawings.
Specific embodiments of the present invention are described hereinafter with reference to the accompanying drawings; however, it is to be understood that the disclosed embodiments are merely exemplary of the invention, which can be embodied in various forms. Well-known and/or repeated functions and constructions are not described in detail to avoid obscuring the invention in unnecessary or unnecessary detail. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a basis for the claims and as a representative basis for teaching one skilled in the art to variously employ the present invention in virtually any appropriately detailed structure.
The specification may use the phrases "in one embodiment," "in another embodiment," "in yet another embodiment," or "in other embodiments," which may each refer to one or more of the same or different embodiments in accordance with the invention.
A display processing method according to an embodiment of the present invention can be applied to a process of processing a panoramic image, and fig. 1 is a flowchart of the display processing method, where the display processing method includes:
a first image stream is obtained, the first image stream corresponding to a first field of view 7 (e.g., available from a server 6). In one embodiment, the electronic device such as the terminal can display an image corresponding to a first image stream in a first view 7, and the image is a high-definition image, the first image stream may be formed by splicing images captured by a plurality of views through an image capturing device (e.g., a camera), and the electronic device such as the terminal may obtain the first image stream in a wired or wireless manner, so that a user can clearly view an image corresponding to the first image stream in the first view 7 by using the electronic device such as the terminal;
a second image stream is obtained, the second image stream corresponding to at least the fields of view outside the first field of view 7, the data amount of the unit data in the second image stream being smaller than the data amount of the unit data in the first image stream. Specifically, the images corresponding to the second image stream correspond to at least images displayed from a field of view other than the first field of view 7, and the images corresponding to the second image stream can be displayed in a field of view other than the first field of view 7. In one embodiment, the second image stream does not correspond to the first field of view 7; in another embodiment, the second image stream corresponds to a portion of the first field of view 7 and a portion of the field of view outside the first field of view 7; in a further embodiment the second image stream corresponds to the entire first field of view 7 and a part of the field of view outside the first field of view 7. The image corresponding to the second image stream is an image with lower definition than the image corresponding to the first image stream, that is, the data amount of unit data in the second image stream is smaller than that of unit data in the first image stream. In one embodiment, the electronic device such as the terminal may obtain the second image stream from the server 6, and the server 6 may process the first image stream to generate the second image stream and transmit the second image stream to the electronic device such as the terminal, for example, the server 6 may perform a resolution reduction or data compression process on the image corresponding to the first image stream to generate the second image stream, so that the electronic device such as the terminal obtains the second image stream; in another embodiment, the electronic device such as the terminal may obtain the second image stream from the server 6, and the server 6 may directly obtain the low-resolution easily-called image data when the image is actually captured, and form the second image stream;
the first image stream is displayed, for example, an image corresponding to the first image stream may be displayed in the first view 7 by an electronic device such as a terminal, the electronic device such as the terminal may convert from the first view 7 to another view (for example, a user may convert the display of the electronic device such as the terminal from the first view 7 to the second view 8 as needed), the data amount of the unit data of the first image stream is displayed in the first view 7 (for example, higher than that of the second image stream), the corresponding image quality is good for the user to experience, but if the display is converted to another view such as the second view 8, the corresponding hardware can be enabled to quickly transmit or process another image stream (for example, the second image stream) with a lower data total amount, for example, if the user needs to convert from the first view 7 to the second view 8, the server 6 can quickly process, and the terminal device and the network device and the like can also quickly respond. Further, when the panoramic image is displayed from the first view 7 to another view, since the unit data amounts of the first image stream and the second image stream are different, an image displayed during the view conversion (for example, an image seen by a user) is an image with a high unit data amount, and an image not displayed (for example, an image not seen by the user) is an image with a low unit data amount, so that the processing of a hardware device is facilitated, and thus, the normal use of the user can be ensured, and the configuration requirement for the corresponding hardware device can be reduced (the low-configuration hardware device can also meet the requirement that the user normally views a high-definition image).
As shown in fig. 2, the display processing method further includes: obtaining a field-of-view adjustment parameter, which is a parameter indicating adjustment from the first field of view 7 to the second field of view 8, for example, the field-of-view adjustment parameter may include data such as coordinates, position, rotation direction, rotation angle, or rotation time when adjusting from the first field of view 7 to the second field of view 8, and an electronic device such as a terminal may accurately switch from the first field of view 7 to the second field of view 8 through the data;
a third image stream corresponding to the second field of view 8 is determined at least in dependence on the second image stream in dependence on the adjustment parameter. With reference to fig. 4 and 5, it is determined that there are many cases where the image displayed by the electronic device such as the terminal is rotated by a viewing point 9, but the rotation angle is small, the image included in the second field of view 8 includes a part of the image in the first field of view 7, or the rotation angle is large, the image included in the second field of view 8 does not include the image in the first field of view 7, and the unit data amount of the third image stream may be equal to the unit data amount of the second image stream, i.e. the resolution of the image corresponding to the third image stream is low, and is easy to be processed by the hardware device, but when determining the third image stream corresponding to the second field of view 8, at least the second image stream is needed, for example, the third image stream may be obtained partially from the second image stream and partially from the first image stream;
a third image stream corresponding to the second field of view 8 is displayed. In an embodiment, the image corresponding to the third image stream is displayed as an image with a lower resolution, and at this time, if the second view 8 is switched to display the image with the higher resolution immediately, the requirement on hardware configuration is extremely high and a large amount of system resources are consumed, while the image corresponding to the third image stream has a lower resolution and a small whole file amount, and can be very easily called by the hardware with the lower configuration, and for a user, the image corresponding to the view can be immediately seen in one view when the panoramic image is viewed by using the hardware with the lower configuration, even if the resolution of the image is lower, the image is in line with the use mind of the user, and even the requirement of part of the user for viewing the image is met.
In one embodiment, the display processing method needs to obtain a fourth image stream corresponding to the third image stream, and display the fourth image stream corresponding to the second field of view 8, wherein the unit data amount of the third image stream is smaller than the unit data amount of the fourth image stream, the unit data amount of the third image stream is equal to the unit data amount of the second image stream, and the unit data amount of the fourth image stream is equal to the unit data amount of the first image stream. Specifically, the fourth image stream and the first image stream both correspond to images with high resolution, and the image quality of the images corresponding to the fourth image stream may be equal to that of the images corresponding to the first image stream, so that the first image stream can be directly and quickly converted into the fourth image stream; the third image stream and the second image stream both correspond to images with low resolution, and the image quality of the images corresponding to the third image stream can be equal to that of the images corresponding to the second image stream, so that the second image stream can be directly and quickly converted into the third image stream, the third image stream can be quickly obtained, and the fourth image stream can be further obtained. When the electronic device such as the terminal displays an image, the electronic device such as the terminal displays an image with a low resolution corresponding to the third image stream and displays an image with a high resolution corresponding to the fourth image stream, so that the user can finally see the image with a high resolution in the second view 8 by using low-configuration hardware.
In another embodiment, the display processing method needs to obtain a fourth image stream corresponding to the third image stream, and display the fourth image stream corresponding to the second field of view 8, wherein the unit data amount of the third image stream is smaller than the unit data amount of the fourth image stream. In this way, it is ensured that the image corresponding to the third image stream has a lower resolution than the image corresponding to the fourth image stream, and is easily called by hardware, and finally, the image having a higher resolution corresponding to the fourth image stream can be displayed in the second field of view 8.
The first field of view 7 is described below with reference to fig. 5 to 8, and the field of view corresponding to the second image stream includes the first field of view 7, or the field of view corresponding to the second image stream is adjacent to the first field of view 7. For example, the first view 7 is 60 degrees ahead, when the electronic device such as the terminal enlarges the view range to the left or the right with an observation point 9 in the image, for example, the enlarged view is 120 degrees ahead, and simultaneously obtains the second image stream (the unit data amount of the second image stream is low, so that the processing amount corresponding to the server is small, the transmission amount of the network transmission device is small, and the response time of the electronic device such as the terminal is short), the view corresponding to the second image stream includes the first view 7, that is, the view of the front 120 degrees includes the first view 7 of the front 60 degrees, or when the image displayed by the electronic device such as the terminal rotates to the left or the right with a certain angle with an observation point 9, the new view obtained after the rotation is not in the first view 7 but adjacent to the first view, that the view corresponding to the second image stream is adjacent to the first view 7, for example, the first view 7 is 60 degrees right ahead, and a view obtained when an image displayed by the electronic device such as the terminal is rotated 60 degrees to the left by a viewpoint 9 is adjacent to the first view 7; alternatively, the first and second electrodes may be,
the field of view corresponding to the second image stream and the first field of view 7 form a full field of view (as shown in fig. 7), or the field of view corresponding to the second image stream is a full field of view, or the field of view corresponding to the second image stream and the first field of view 7 form a field of view smaller than the full field of view, so that the image stream corresponding to the formed field of view or the full field of view at least includes the corresponding second image stream, which will make the corresponding processing amount of the server smaller, the transmission amount of the network transmission equipment smaller, and the response time of the electronic equipment such as the terminal shorter. For example, the first field of view 7 is 60 degrees directly in front, the field of view corresponding to the second image stream is a field of view excluding 60 degrees directly in front of the second image stream in 360 degrees, or the field of view corresponding to the second image stream is a full field of view of 360 degrees, or the first field of view 7 is 60 degrees directly in front, and the field of view corresponding to the second image stream is 120 degrees, and the field of view formed by the field of view corresponding to the second image stream and the first field of view 7 at this time is smaller than the full field of view of 360 degrees.
Determining a third image stream corresponding to the second field of view 8 based on the adjustment parameter and at least the second image stream comprises: if the second field of view 8 comprises a partial area of the first field of view 7, as shown in fig. 4, the image displayed by the electronic device, e.g. the terminal, is rotated by a small angle to the left or to the right at a viewpoint 9, forming the second field of view 8, the second field of view 8 comprising a partial area of the first field of view 7,
reducing the unit data amount of the first image stream corresponding to the partial region of the first view 7 (for example, the first view 7 is 60 degrees at the front, and the partial region is 20 degrees at the left, so that the unit data amount of the first image stream at the left 20 degrees can be reduced), and obtaining a first sub-image stream corresponding to the partial region; obtaining a second sub-image stream of a region within the second field of view 8, excluding the partial region, from the second image stream; a third image stream is generated from the first sub-image stream and the second sub-image stream. In one embodiment, the image quality of the image corresponding to the partial area of the first view 7 is reduced, so as to obtain a first sub-image stream corresponding to the partial area, the unit data amount of the first sub-image stream is lower than the unit data amount of the first image stream, preferably equal to the unit data amount of the second image stream, the unit data amount of the obtained second sub-image stream is equal to the unit data amount of the second image stream, the unit data amounts of the first sub-image stream and the second sub-image stream are the same (the image resolutions corresponding to the two image streams are the same), and a third image stream is generated according to the first sub-image stream and the second sub-image stream; or
Obtaining a first sub-image stream of a corresponding partial area from the first image stream, and obtaining a second sub-image stream of an area except the partial area in the second visual field 8 from the second image stream; and generating a third image stream according to the first sub-image stream and the second sub-image stream, wherein the data amount of the unit data of the first sub-image stream is larger than that of the second sub-image stream. In the step, the resolution of the image corresponding to the first sub-image stream is not reduced firstly, but the resolution of the image corresponding to the first sub-image stream is maintained firstly, and finally the first sub-image stream and the second sub-image stream are processed uniformly to generate a third image stream.
In an embodiment of the invention, determining the third image stream corresponding to the second field of view 8 at least from the second image stream in dependence on the adjustment parameter comprises: if the second field of view 8 does not comprise a partial region of the first field of view 7, as shown in fig. 5 to 7, a third image stream corresponding to the second field of view 8 is obtained from the second image stream. For example, the first field of view 7 is 60 degrees directly in front, the second field of view 8 is 60 degrees laterally in back, that is, the electronic device such as the terminal turns by a large angle with respect to the observation point 9 in the image, and obtains a third image stream corresponding to the second field of view 8 from a second image stream (having a small unit data amount) having the same unit data amount as that of the second image stream.
A display processing apparatus 1 according to an embodiment of the present invention can be applied to a process of processing a panoramic image, and fig. 3 is a block diagram of a connection structure of the display processing apparatus (which may be connected to a server), and includes a communication apparatus 2 and a display apparatus 3:
the communication device 2 is configured to obtain a first image stream corresponding to a first field of view 7 and a second image stream (which may be obtained, for example, from the server 6) corresponding to at least a field of view outside the first field of view 7, the data amount of the unit data in the second image stream being smaller than the data amount of the unit data in the first image stream; the display means 3 are for displaying the first image stream. In one embodiment, the display device 3 can display a video corresponding to a first image stream in a first view 7, and the video is a high-definition image, the first image stream may be formed by splicing images captured by a plurality of views through an image capturing device (e.g., a camera), and the communication device 2 of the electronic device such as a terminal may obtain the first image stream from the server 6 or other devices through a wired or wireless manner, so that a user can clearly view an image corresponding to the first image stream in the first view 7 through the display device 3 of the electronic device such as the terminal.
The images corresponding to the second image stream correspond to at least images displayed from a field of view other than the first field of view 7, and the images corresponding to the second image stream can be displayed in a field of view other than the first field of view 7. In one embodiment, the second image stream does not correspond to the first field of view 7; in another embodiment, the second image stream corresponds to a portion of the first field of view 7 and a portion of the field of view outside the first field of view 7; in a further embodiment the second image stream corresponds to the entire first field of view 7 and a part of the field of view outside the first field of view 7. The image corresponding to the second image stream is an image with lower definition than the image corresponding to the first image stream, that is, the data amount of unit data in the second image stream is smaller than that of unit data in the first image stream. In one embodiment, the communication apparatus 2 may obtain the second image stream from the server 6, and the server 6 may process the first image stream to generate the second image stream and transmit the second image stream to the communication apparatus 2, for example, the image corresponding to the first image stream may be subjected to a resolution reduction or data compression process to generate the second image stream, so that the electronic device such as the terminal obtains the second image stream; in another embodiment, the communication device 2 may obtain a second image stream from the server 6, and the server 6 may directly obtain low resolution, easily recalled image data at the time the image was actually captured, and form the second image stream;
for the display device 3 to display the first image stream, for example, the display device 3 of the electronic equipment such as the terminal can display the image corresponding to the first image stream in the first view 7, the display device 3 can be converted from the first view 7 to another view (for example, the user can convert the display of the display device 3 from the first view 7 to the second view 8 as required), the data amount of the unit data of the first image stream is displayed in the first view 7 (for example, higher than that of the second image stream), the corresponding image quality is good for the user experience, but if the image quality is changed to another view such as the second view 8, it enables the corresponding hardware to quickly transmit or process other image streams (such as the second image stream) with a low amount of data, for example, if the user needs to switch from the first view 7 to the second view 8, the server 6 can process quickly, and the terminal device and the network device can respond quickly. Further, when the panoramic image is displayed from the first view 7 displayed on the display device 3 to the other view, since the data amounts of the unit data of the first image stream and the second image stream are different, the image displayed on the display device 3 (for example, the image viewed by the user) is an image with a high data amount of the unit data when the view is switched, and the image not displayed on the display device 3 (for example, the image not viewed by the user) is an image with a low data amount of the unit data, so that the processing of the hardware device is facilitated, and thus the normal use of the user can be ensured, and the configuration requirement for the corresponding hardware device can be reduced (the hardware device with low configuration can also meet the requirement that the user normally views the image with high definition).
With continued reference to fig. 3, the display processing device 1 further comprises acquisition means 4 and processing means 5: the acquisition device 4 is configured to obtain a field-of-view adjustment parameter, where the field-of-view adjustment parameter is a parameter indicating an adjustment from the first field of view 7 to the second field of view 8, and for example, the field-of-view adjustment parameter may include data such as coordinates, a position, a rotation direction, a rotation angle, or a rotation time when the adjustment is performed from the first field of view 7 to the second field of view 8, and the acquisition device 4 of an electronic device such as a terminal may accurately switch from the first field of view 7 to the second field of view 8 through the parameters;
the processing means 5 are configured to determine, according to the adjustment parameter, a third image stream corresponding to the second field of view 8, at least according to the second image stream; the processing device 5 determines that the second field of view 8 may be in various situations, and with reference to fig. 4 and 5, an image displayed by an electronic device such as a terminal is rotated by a viewpoint 9, but the rotation angle is small, the image included in the second field of view 8 includes a part of the image in the first field of view 7, or the rotation angle is large, the image included in the second field of view 8 does not include the image in the first field of view 7, and the unit data amount of the third image stream may be equal to the unit data amount of the second image stream, i.e. the resolution of the image corresponding to the third image stream is low, and is easy to be processed by a hardware device, but when determining the third image stream corresponding to the second field of view 8, at least the second image stream is needed, for example, the third image stream may be obtained partially from the first image stream according to the second image stream;
the display means 3 are able to display said third image stream corresponding to the second field of view 8. In an embodiment, the image corresponding to the third image stream is displayed as an image with a lower resolution, and at this time, if the second view 8 is switched to display the image with the higher resolution immediately, the requirement on hardware configuration is extremely high and a large amount of system resources are consumed, while the image corresponding to the third image stream has a lower resolution and a small whole file amount, and can be very easily called by the hardware with the lower configuration, and for a user, the image corresponding to the view can be immediately seen in one view when the panoramic image is viewed by using the hardware with the lower configuration, even if the resolution of the image is lower, the image is in line with the use mind of the user, and even the requirement of part of the user for viewing the image is met.
In one embodiment, the communication device 2 is capable of obtaining a fourth image stream corresponding to the third image stream and displaying the fourth image stream corresponding to the second field of view 8, wherein the unit data size of the third image stream is less than the unit data size of the fourth image stream, the unit data size of the third image stream is equal to the unit data size of the second image stream, and the unit data size of the fourth image stream is equal to the unit data size of the first image stream. Specifically, the fourth image stream and the first image stream both correspond to images with high resolution, and the image quality of the images corresponding to the fourth image stream may be equal to that of the images corresponding to the first image stream, so that the first image stream can be directly and quickly converted into the fourth image stream; the third image stream and the second image stream both correspond to images with low resolution, and the image quality of the image corresponding to the third image stream may be equal to the image quality of the image corresponding to the second image stream, so that the second image stream may be directly and quickly converted into the third image stream, so that the communication device 2 may quickly obtain the third image stream, and further obtain the fourth image stream. When the display device 3 can display the fourth image stream corresponding to the second field of view 8, the image with low resolution corresponding to the third image stream is displayed, and the image with high resolution corresponding to the fourth image stream is displayed, so that the user can finally see the image with high resolution in the second field of view 8 by using low-configuration hardware.
In another embodiment, the communication device 2 is capable of obtaining a fourth image stream corresponding to the third image stream and displaying the fourth image stream corresponding to the second field of view 8, wherein the unit data amount of the third image stream is smaller than the unit data amount of the fourth image stream. In this way, it is ensured that the image corresponding to the third image stream has a lower resolution than the image corresponding to the fourth image stream, and is easily called by hardware, and finally, the image having a higher resolution corresponding to the fourth image stream can be displayed in the second field of view 8.
The processing means 5 are able to determine, according to the adjustment parameters, a third image stream corresponding to the second field of view 8, based on at least the second image stream, and to perform: as shown in fig. 4, if the second field of view 8 includes a partial region of the first field of view 7, the image displayed on the display device 3 of the electronic apparatus, such as a terminal, is rotated by a small angle to the left or right at a viewpoint 9 to form the second field of view 8, the second field of view 8 includes a partial region of the first field of view 7,
reducing the unit data amount of the first image stream corresponding to the partial region of the first view 7 (for example, the first view 7 is 60 degrees at the front, and the partial region is 20 degrees at the left, so that the unit data amount of the first image stream at the left 20 degrees can be reduced), and obtaining a first sub-image stream corresponding to the partial region; obtaining a second sub-image stream of a region within the second field of view 8, excluding the partial region, from the second image stream; a third image stream is generated from the first sub-image stream and the second sub-image stream. In one embodiment, the image quality of the image corresponding to the partial area of the first view 7 is reduced, so as to obtain a first sub-image stream corresponding to the partial area, the unit data amount of the first sub-image stream is lower than the unit data amount of the first image stream, preferably equal to the unit data amount of the second image stream, the unit data amount of the obtained second sub-image stream is equal to the unit data amount of the second image stream, the unit data amounts of the first sub-image stream and the second sub-image stream are the same (the image resolutions corresponding to the two image streams are the same), and a third image stream is generated according to the first sub-image stream and the second sub-image stream; or
The processing means 5 are able to derive from the first image stream a first sub-image stream corresponding to a partial region and from the second image stream a second sub-image stream of a region within the second field of view 8 other than the partial region; and generating a third image stream according to the first sub-image stream and the second sub-image stream, wherein the data amount of the unit data of the first sub-image stream is larger than that of the second sub-image stream. In the process, the resolution of the image corresponding to the first sub-image stream is not reduced firstly, but the resolution of the image corresponding to the first sub-image stream is maintained firstly, and finally, the processing device 5 uniformly processes the first sub-image stream and the second sub-image stream to generate a third image stream.
Furthermore, the processing means 5 are able to determine, depending on the adjustment parameter, at least on the second image stream, a third image stream corresponding to the second field of view 8 performing: if the second field of view 8 does not comprise a partial region of the first field of view 7, a third image stream corresponding to the second field of view 8 is obtained from the second image stream.
The above embodiments are only exemplary embodiments of the present invention, and are not intended to limit the present invention, and the scope of the present invention is defined by the claims. Various modifications and equivalents may be made by those skilled in the art within the spirit and scope of the present invention, and such modifications and equivalents should also be considered as falling within the scope of the present invention.

Claims (6)

1. A display processing method, comprising:
obtaining a first image stream, the first image stream corresponding to a first field of view;
obtaining a second image stream, wherein the second image stream at least corresponds to a visual field outside the first visual field, and the data quantity of unit data in the second image stream is smaller than that of the unit data in the first image stream;
displaying the first image stream; wherein the content of the first and second substances,
the method further comprises the following steps: obtaining a field of view adjustment parameter, the field of view adjustment parameter being a parameter indicative of an adjustment from a first field of view to a second field of view; determining a third image stream corresponding to the second view according to the adjustment parameter and at least a second image stream; displaying the third image stream corresponding to the second field of view; wherein the content of the first and second substances,
obtaining a fourth image stream corresponding to the third image stream, wherein the unit data amount of the third image stream is smaller than that of the fourth image stream, the unit data amount of the third image stream is equal to that of the second image stream, and the unit data amount of the fourth image stream is equal to that of the first image stream; displaying the fourth image stream corresponding to the second field of view.
2. The method of claim 1, wherein the field of view corresponding to the second image stream comprises the first field of view or is adjacent to the first field of view;
or
The field of view corresponding to the second image stream and the first field of view constitute a full field of view, or the field of view corresponding to the second image stream is a full field of view, or the field of view corresponding to the second image stream and the first field of view constitute a field of view that is less than a full field of view.
3. The method of claim 1, wherein determining a third image stream corresponding to the second field of view based on at least a second image stream based on the adjustment parameter comprises: if the second field of view comprises a partial region of the first field of view,
reducing the unit data amount of a first image stream corresponding to a partial area of the first visual field to obtain a first sub-image stream corresponding to the partial area; obtaining a second sub-image stream of a region within the second field of view other than the partial region from the second image stream; generating the third image stream from the first sub-image stream and the second sub-image stream;
or
Obtaining a first sub-image stream corresponding to the partial region from the first image stream, and obtaining a second sub-image stream of a region other than the partial region in the second view from the second image stream; generating the third image stream according to the first sub-image stream and the second sub-image stream, wherein the data amount of unit data of the first sub-image stream is larger than the data amount of unit data of the second sub-image stream.
4. The method of claim 1, wherein determining a third image stream corresponding to the second field of view based on at least a second image stream based on the adjustment parameter comprises:
and if the second visual field does not comprise a partial region of the first visual field, obtaining the third image stream corresponding to the second visual field from the second image stream.
5. A display processing apparatus comprising:
communication means for obtaining a first image stream corresponding to a first field of view and a second image stream corresponding to at least a field of view outside the first field of view, the data amount of unit data in the second image stream being smaller than the data amount of unit data in the first image stream;
display means for displaying the first image stream; wherein the content of the first and second substances,
the device further comprises:
acquisition means for obtaining a field of view adjustment parameter, the field of view adjustment parameter being a parameter indicative of an adjustment from a first field of view to a second field of view;
processing means for determining a third image stream corresponding to the second field of view at least from a second image stream in dependence on the adjustment parameter;
wherein the display device is capable of displaying the third image stream corresponding to the second field of view; wherein the content of the first and second substances,
the communication device can obtain a fourth image stream corresponding to the third image stream, wherein the unit data volume of the third image stream is smaller than that of the fourth image stream, the unit data volume of the third image stream is equal to that of the second image stream, and the unit data volume of the fourth image stream is equal to that of the first image stream; the display device is capable of displaying the fourth image stream corresponding to the second field of view.
6. The apparatus of claim 5, wherein,
the processing device can determine a third image stream corresponding to the second visual field according to the adjusting parameter and at least according to the second image stream to execute: if the second field of view comprises a partial region of the first field of view,
reducing the unit data amount of a first image stream corresponding to a partial area of the first visual field to obtain a first sub-image stream corresponding to the partial area; obtaining a second sub-image stream of a region within the second field of view other than the partial region from the second image stream; generating the third image stream from the first sub-image stream and the second sub-image stream;
or
A first sub-image stream corresponding to the partial region can be obtained from the first image stream, and a second sub-image stream of a region other than the partial region in the second field of view can be obtained from the second image stream; generating the third image stream according to the first sub-image stream and the second sub-image stream, wherein the data amount of unit data of the first sub-image stream is larger than the data amount of unit data of the second sub-image stream.
CN201710200445.8A 2017-03-30 2017-03-30 Display processing method and device Active CN106961622B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710200445.8A CN106961622B (en) 2017-03-30 2017-03-30 Display processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710200445.8A CN106961622B (en) 2017-03-30 2017-03-30 Display processing method and device

Publications (2)

Publication Number Publication Date
CN106961622A CN106961622A (en) 2017-07-18
CN106961622B true CN106961622B (en) 2020-09-25

Family

ID=59471064

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710200445.8A Active CN106961622B (en) 2017-03-30 2017-03-30 Display processing method and device

Country Status (1)

Country Link
CN (1) CN106961622B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104182999A (en) * 2013-05-21 2014-12-03 百度在线网络技术(北京)有限公司 Panoramic animation jumping method and system
US9007432B2 (en) * 2010-12-16 2015-04-14 The Massachusetts Institute Of Technology Imaging systems and methods for immersive surveillance
CN105022818A (en) * 2015-07-08 2015-11-04 纪兴瑞 Tile map storing and loading method
CN105677275A (en) * 2015-12-31 2016-06-15 北京小鸟看看科技有限公司 Interface layout method and wraparound interface system
CN106453913A (en) * 2016-10-31 2017-02-22 北京疯景科技有限公司 Method and apparatus for previewing panoramic contents
US9588215B1 (en) * 2012-02-14 2017-03-07 C360 Technologies, Inc. Object tracking and data aggregation in panoramic video
CN106537894A (en) * 2014-07-14 2017-03-22 索尼互动娱乐股份有限公司 System and method for use in playing back panorama video content

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8953079B2 (en) * 2012-12-31 2015-02-10 Texas Instruments Incorporated System and method for generating 360 degree video recording using MVC
CN106060513B (en) * 2016-06-29 2017-11-21 深圳市优象计算技术有限公司 A kind of code stream caching method for cylinder three-dimensional panoramic video netcast
CN106210692A (en) * 2016-06-30 2016-12-07 深圳市虚拟现实科技有限公司 Long-range panoramic picture real-time Transmission based on pupil detection and display packing
CN106101847A (en) * 2016-07-12 2016-11-09 三星电子(中国)研发中心 The method and system of panoramic video alternating transmission
CN106254940B (en) * 2016-09-23 2019-11-01 北京疯景科技有限公司 Play the method and device of panorama content
CN106454321A (en) * 2016-10-26 2017-02-22 深圳市道通智能航空技术有限公司 Panoramic video processing method, device and system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9007432B2 (en) * 2010-12-16 2015-04-14 The Massachusetts Institute Of Technology Imaging systems and methods for immersive surveillance
US9588215B1 (en) * 2012-02-14 2017-03-07 C360 Technologies, Inc. Object tracking and data aggregation in panoramic video
CN104182999A (en) * 2013-05-21 2014-12-03 百度在线网络技术(北京)有限公司 Panoramic animation jumping method and system
CN106537894A (en) * 2014-07-14 2017-03-22 索尼互动娱乐股份有限公司 System and method for use in playing back panorama video content
CN105022818A (en) * 2015-07-08 2015-11-04 纪兴瑞 Tile map storing and loading method
CN105677275A (en) * 2015-12-31 2016-06-15 北京小鸟看看科技有限公司 Interface layout method and wraparound interface system
CN106453913A (en) * 2016-10-31 2017-02-22 北京疯景科技有限公司 Method and apparatus for previewing panoramic contents

Also Published As

Publication number Publication date
CN106961622A (en) 2017-07-18

Similar Documents

Publication Publication Date Title
WO2016065913A1 (en) Video image processing method, device and system
AU2012269508B2 (en) Method and device for MCU multi-picture optimized configuration
EP3065049A2 (en) Interactive video display method, device, and system
JP2013197838A (en) Remote conference system and remote conference terminal
CN105407280B (en) Panoramic image synthesis method and system
US20150304360A1 (en) Videoconferencing Information Presentation Method, Apparatus, and System
CN104980697A (en) Video transmission method for web camera
CN106375682B (en) Image processing method and device, movable equipment, unmanned aerial vehicle remote controller and system
WO2009138015A1 (en) Image displaying method and its device
CN106412617B (en) Remote debugging control method and device
JP2010113618A (en) Image distribution device and method, and program
CN103747210A (en) Method and device for data processing of video monitoring system
CN103873939A (en) Video processing method and electronic equipment
CN108449545B (en) Monitoring system and application method thereof
US20180338093A1 (en) Eye-tracking-based image transmission method, device and system
CN106604118B (en) Playing device and method
WO2019157803A1 (en) Transmission control method
WO2014030405A1 (en) Display device, display method, television receiver, and display control device
CN106961622B (en) Display processing method and device
CN106792084B (en) Television signal display parameter adjusting method and device and television signal display method
CN104811802A (en) Image playing method and apparatus
US9699402B2 (en) Method and apparatus for transmitting video signal
CN203225845U (en) Digital high-definition video-wall
CN111083368A (en) Simulation physics cloud platform panoramic video display system based on high in clouds
CN107454326B (en) Method for panoramic shooting by using fisheye lens, camera and panoramic shooting system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant