CN114518860A - Method and device for creating panoramic picture based on large screen, intelligent terminal and medium - Google Patents
Method and device for creating panoramic picture based on large screen, intelligent terminal and medium Download PDFInfo
- Publication number
- CN114518860A CN114518860A CN202011291487.5A CN202011291487A CN114518860A CN 114518860 A CN114518860 A CN 114518860A CN 202011291487 A CN202011291487 A CN 202011291487A CN 114518860 A CN114518860 A CN 114518860A
- Authority
- CN
- China
- Prior art keywords
- resolution
- picture
- large screen
- screen
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/10—Geometric effects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/62—Semi-transparency
Abstract
The application discloses a method, a device, an intelligent terminal and a medium for creating a panoramic picture based on a large screen, wherein the method comprises the following steps: acquiring the picture resolution of a target picture and the screen resolution of a large screen; calculating a resolution difference value between the image resolution and the screen resolution, and adjusting the target image according to the resolution difference value to obtain a large screen image matched with the screen resolution; creating a floating window layer arranged on a large screen image, and configuring and filling a translation expansion area and a feeling direct-view area on the floating window layer through a preset algorithm; respectively setting layer transparencies of the floating window layers corresponding to the translation expansion area and the interested direct-view area; and synthesizing the floating window image layers with different image layer transparencies with the large screen to obtain the panoramic image of the target picture. The method aims to enable the intelligent large screen to provide a 360-degree panoramic image and improve visual perception of a user through different layer transparencies of the floating window layer, a translation expansion area algorithm, a feeling direct-view algorithm and a seamless superposition technology.
Description
Technical Field
The application relates to the technical field of intelligent large screens, in particular to a method and device for creating panoramic pictures based on a large screen, an intelligent terminal and a medium.
Background
The new image technology represented by the VR technology brings unprecedented visual experience to users. The intelligent large screen is used as a display center of the household intelligent equipment, and how to meet the increasingly improved requirements of users on display effect becomes a problem to be solved urgently. An intelligent large screen under the traditional condition often does not have the function of creating a 360-degree panoramic picture, a 360-degree panoramic picture cannot be generated by combining a VR (virtual reality) technology, and the 360-degree panoramic picture is also called a three-dimensional panoramic picture and a panoramic annular view. The 360-degree panoramic technology is a three-dimensional virtual display technology which is completed by performing multi-angle all-around shooting on an existing scene by using a digital camera, then performing later-stage stitching by using a computer and loading a playing program.
Accordingly, there is a need for improvements and developments in the art.
Disclosure of Invention
Therefore, it is necessary to provide a method, an apparatus, an intelligent terminal and a medium for creating a panoramic picture based on a large screen to combine the large screen with a VR technology to display a 360 ° panoramic picture for a user, aiming at the technical problem that the existing large intelligent screen cannot provide a 360 ° panoramic picture.
In order to achieve the purpose, the following technical scheme is adopted in the application:
in a first aspect, a method for creating a panoramic picture based on a large screen includes:
acquiring the picture resolution of a target picture and the screen resolution of a large screen;
calculating a resolution difference value between the image resolution and the screen resolution, and adjusting the target image according to the resolution difference value to obtain a large screen image matched with the screen resolution;
creating a floating window layer arranged on a large screen image, and configuring and filling a translation expansion area and a feeling direct-view area corresponding to the category to which the screen resolution belongs on the floating window layer through a preset algorithm; the translation expansion area is used for converting the target picture into a large screen picture through translation operation and expansion operation; the visual sensing area is used for converting the large screen image into a panoramic image through parallax;
respectively setting layer transparencies of the suspended window layers corresponding to the translation expansion area and the perceived direct-view area;
and synthesizing the floating window image layers with different image layer transparencies with the large screen to obtain the panoramic image of the target picture.
In a second aspect, the present application provides an apparatus for creating a panoramic picture based on a large screen, including:
the acquisition module is used for acquiring the picture resolution of the target picture and the screen resolution of the large screen;
the resolution adjusting module is used for calculating a resolution difference value between the picture resolution and the screen resolution, and adjusting the target picture according to the resolution difference value to obtain a large screen image matched with the screen resolution;
the translation expansion area module is used for creating a suspension window layer arranged on the large screen image, configuring and filling translation expansion areas corresponding to the categories of screen resolutions on the suspension window layer through a preset algorithm, and setting the layer transparency of the suspension window layer corresponding to the translation expansion areas; the translation expansion area is used for converting the target picture into a large screen picture through translation operation and expansion operation;
the system comprises a translation expansion area module, a sense direct-view module and a floating window image layer display module, wherein the sense direct-view module is used for configuring and filling a sense direct-view area according to a translation expansion area module through a sense direct-view algorithm and setting the image layer transparency of a floating window image layer corresponding to the sense direct-view area; the visual perception area is used for converting a large screen image into a panoramic image through parallax;
and the panoramic synthesis module is used for synthesizing the suspended window image layers with different image layer transparencies with the large screen to obtain a panoramic image of the target picture.
In a third aspect, the present application further provides an intelligent terminal, where the intelligent terminal includes a large-screen display screen, a memory, a processor, and a program stored in the memory and capable of running on the processor and creating a panoramic picture based on the large screen, and the processor implements the steps of the method for creating a panoramic picture based on the large screen when executing the program for creating a panoramic picture based on the large screen.
In a fourth aspect, the present application further provides a computer storage medium having a computer program stored thereon, where the computer program, when executed by a processor, implements the steps in the method for creating a panoramic picture based on a large screen.
Has the advantages that:
compared with the prior art, the application provides a method, a device, an intelligent terminal and a medium for creating a panoramic picture based on a large screen, aiming at generating a large screen picture (namely a planar panoramic picture) matched with the screen resolution by using a resolution difference value for a target picture, and converting the large screen picture into a three-dimensional panoramic picture by using different layer transparencies of a floating window layer, a translation expansion area algorithm, a sense direct vision algorithm and a seamless superposition technology, so that the intelligent large screen is combined with a VR (virtual reality) technology, the intelligent large screen can also provide a 360-degree panoramic picture, the visual perception of a user is improved, the popularization is expanded, and the user is facilitated.
Drawings
Fig. 1 is a flowchart of a method for creating a panoramic picture based on a large screen according to the present application;
fig. 2 is a block diagram illustrating a structure of an apparatus for creating a panoramic picture based on a large screen according to the present application;
fig. 3 is a block diagram of a structure of an intelligent terminal provided in the present application.
Detailed Description
The application provides a method, a device, an intelligent terminal and a medium for creating a panoramic picture based on a large screen, and in order to make the purpose, technical scheme and effect of the application clearer and clearer, the application is further described in detail below by referring to the attached drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combinations of one or more of the associated listed items.
It will be understood by those within the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
The technical solution of the present application is described below with reference to the accompanying drawings and specific embodiments, as follows:
referring to fig. 1, fig. 1 is a flowchart illustrating a method for creating a panoramic picture based on a large screen. It should be noted that the method for creating a panoramic picture based on a large screen according to the embodiment of the present invention is not limited to the steps and the sequence in the flowchart shown in fig. 1, and the steps in the flowchart may be added, removed, or changed in sequence according to different requirements. As shown in fig. 1, the method for creating a panoramic picture based on a large screen includes:
s10, the system acquires the picture resolution of the target picture and the screen resolution of the large screen.
Specifically, the target picture refers to an object that needs and becomes a panorama. In this embodiment, the target picture is a standard definition picture, that is, the picture resolution of the target picture is a standard definition resolution, which is usually 480p (720 × 480 pixel resolution, etc.) or 576p, and the standard definition resolution is expressed by a degree sd (standard definition).
It should be noted that 480 in 480p refers to vertical resolution, and there are 480 horizontal scan lines in the vertical direction.
The target picture may originate from a network or from a photograph. Therefore, in order to improve the quality of the synthesized panorama, a preprocessing operation may be performed on the target picture. The preprocessing operation refers to processing rules set according to user requirements, such as performing brightness enhancement processing on the target picture, or performing cropping processing on the target picture. The processing rule is not limited, and can be freely set according to different scenes.
By large screen is meant a display screen having a screen diagonal dimension greater than 40 feet. For example: large screen in direct view color TV or back projection TV. Therefore, the screen resolution of the large screen may be high definition resolution hd (high definition), 720p (1280 × 720 pixel resolution); may be full High definition resolution fhd, 1080p (1080 × 720 pixel resolution); may be ultra High definition resolution uhd (ultra High definition), 4k (4096 × 2160 pixel resolution); it may also be full Ultra High definition resolution, fuhd (full Ultra High definition), 8k (7680 × 4320 pixel resolution, 16: 9).
Specifically, the system acquiring the picture resolution of the target picture and the screen resolution of the large screen specifically includes:
s11, when a command that the intelligent terminal sends the target picture is monitored, the system receives the target picture and obtains the picture resolution of the target picture; the picture resolution is expressed as the horizontal pixel number and the vertical pixel number of the target picture;
s12, the system acquires the screen resolution of the large screen; the screen resolution is expressed as horizontal pixel count by vertical pixel count of the large screen.
In this embodiment, if the screen resolution of the large screen is 1080p (1920 × 1080), 1920 is the number of horizontal pixels, 1080 is the number of vertical pixels, and the picture resolution of the target picture is 720 × 640, where 720 is the number of horizontal pixels and 640 is the number of vertical pixels.
And S20, the system calculates the difference between the image resolution and the screen resolution, and adjusts the target image according to the difference to obtain a large screen image matched with the screen resolution.
Specifically, since the picture resolution and the screen resolution each include the number of horizontal pixels and the vertical pixel value, the resolution difference values of the calculated picture resolution and the screen resolution are expressed as a resolution difference value of the number of horizontal pixels in the calculated picture resolution and the number of horizontal pixels in the screen resolution and a resolution difference value of the number of vertical pixels in the picture resolution and the number of vertical pixels in the screen resolution. In this embodiment, the resolution ratio is adjusted by calculating the resolution difference between the number of horizontal pixels in the picture resolution and the number of horizontal pixels in the screen resolution.
Further, the number of horizontal pixels in the picture resolution is differentiated from the number of horizontal pixels in the screen resolution to obtain a horizontal resolution difference value. Since the screen resolution is greater than or equal to the picture resolution, the absolute value of the horizontal resolution difference is acquired.
And if the absolute value of the horizontal resolution difference is equal to 0, taking the target picture as a large screen picture matched with the screen resolution. That is, the picture resolution of the target picture is the same as the screen resolution of the large screen, and therefore, the padding operation for the target picture is not required.
And if the absolute value of the horizontal resolution difference is not equal to 0, taking the absolute value of the horizontal resolution difference as the number of pixels to be filled in the horizontal direction of the target picture.
For example:
the target picture Pic _ X (X1) is 640// horizontal direction 640 horizontal pixels;
large screen _ XDisplay (x1) ═ 1080// large screen physical display resolution;
the horizontal resolution difference Dis _ ChaRu (X1) ═ large screen _ XDisplay (X1) — Pic _ X (X1) | 1080 ═ 640 ═ 440, 440 is the horizontal resolution difference, and 440 is taken as the number of pixels to be filled in the horizontal direction of the target picture.
In the filling process, the color to be filled needs to be determined in advance, and after the color pixel value of the color to be filled is obtained, the target picture is filled by using the color pixel value, so that the picture resolution of the large-screen picture obtained after the target picture is filled is the same as and matched with the screen resolution of the large screen.
Specifically, the process of determining the color to be filled and acquiring the color pixel value corresponding to the color to be filled by the system is as follows:
s211, acquiring color pixel values of all filling colors on the target picture and the number of pixels corresponding to all the filling colors; the color pixel value of each filling color comprises an R value, a G value and a B value;
s212, respectively calculating the average values of the R value, the G value and the B value according to the first color pixel value of each filling color and the number of pixels corresponding to each filling color to obtain an R average value, a G average value and a B average value;
and S213, determining colors corresponding to the R mean value, the G mean value and the B mean value, wherein the colors are colors to be filled, and color pixel values of the colors to be filled are the R mean value, the G mean value and the B mean value.
It can be understood that the color pixel values of the filling colors on the target picture all include RGB values, so that the color with the most color in red, green and blue on the target picture is selected by mean pixel screening, and the color is taken as the color to be filled, and the color pixel value is the RGB mean value.
For example:
ave _ pixebgb (r1, g1, b1) { "0", "128", "255" }// average is the blue-filled pixel.
And after the color to be filled is determined, filling the target picture, stopping filling until the filling number reaches the number of pixels to be filled, such as 440, and acquiring a large screen picture corresponding to the filling stop. Thus, the picture resolution of the large screen image obtained after filling is the same as the screen resolution.
S30, the system creates a floating window layer arranged on the large screen image, and a translation expansion area and a feeling direct-view area corresponding to the category to which the screen resolution belongs are configured and filled on the floating window layer through a preset algorithm; the translation expansion area is used for converting the target picture into a large screen picture through translation operation and expansion operation; the perceived direct-view area is used for converting the large screen image into a panoramic image through parallax.
And S40, the system respectively sets layer transparencies of the floating window layers corresponding to the translation expansion area and the perceived direct-view area.
In the present embodiment, the screen resolutions are classified into two categories, high definition resolution and ultra high definition resolution. Therefore, for the two categories, a corresponding translation expansion area and a perceived direct-view area are created respectively. The translation expansion area can be regarded as projecting the target picture to a large screen for seamless connection. The perceived direct-view area can be regarded as the parallax formed after the projection of the target picture.
If the category to which the screen resolution belongs is high-definition resolution, a floating window layer arranged on a large screen image is created, and a translation expansion area and a feeling direct-view area corresponding to the category to which the screen resolution belongs are configured and filled on the floating window layer through a preset algorithm, wherein the method comprises the following steps:
s311, creating a floating window layer according to the screen resolution so that the size of the floating window layer is matched with that of a large screen;
s312, placing the floating window layer at the upper end of the large screen image;
s313, configuring a first translation expansion area on the floating window layer according to the target picture through a preset translation expansion area algorithm;
s314, cutting out a first horizontal pixel of a first horizontal proportion (such as 3/4) on the target picture from the horizontal direction;
s315, filling the first horizontal pixel to the first translation expansion area;
s316, adding a preset Yixing direct-view algorithm after the first translation expansion area is filled, so as to obtain a first Yixing direct-view area; wherein the first translation expansion area comprises a first perceived direct-view area;
s317, intercepting a first vertical pixel with a first vertical proportion (such as 1/2) in the vertical direction in the target picture;
s318, fill the first vertical pixel into the first perceived direct-view region.
The system respectively sets the layer transparency of the suspended window layer corresponding to the translation expansion area and the sensible direct-view area to comprise:
s411, configuring the layer transparency of the floating window layer corresponding to the first sensible direct-view area to be fully transparent;
and S412, configuring the layer transparency of the floating window layer corresponding to the first sensible direct-view area to be fully transparent.
Specifically, as shown in table 1 below, if the screen resolution is 1080p, and the picture resolution of the target picture is 720 × 640, a first horizontal ratio, for example, 3/4 is selected to cut out pixels in the horizontal direction of the target picture, 3 × 720/4 is 540, at this time, 540 pixels on each horizontal line are cut out, the length of the cut out pixels on each horizontal line is obtained to configure a first translation expansion area FOV resolution, specifically, the length of the first translation expansion area is 540. And intercepting 540 pixels on each horizontal line on the target image through a translation expansion algorithm to fill a first translation expansion area, and configuring the layer transparency from left to right of the floating window layer corresponding to the first translation expansion area to be semitransparent, namely 50%.
It should be noted that the first perceived direct-view area is configured according to the first translation expansion area of the floating window layer. Therefore, after the first translation expansion area is filled and configured, a Xinxing direct-view algorithm is added to the final first translation expansion area from left to right to obtain a first Xinxing direct-view area. And selecting a first vertical ratio, for example 1/2, to intercept pixels in the vertical direction of the target picture, where 1 × 640/2 is 320, and at this time, capturing 320 pixels on each vertical line on the target picture to fill the pixels in the first perceived direct-view region ROI resolution, and setting the layer transparency of the suspended window layer corresponding to the first perceived direct-view region to be fully transparent, that is, 100%.
If the category to which the screen resolution belongs is the ultra-high definition resolution, creating a suspended window layer arranged on the large screen image, and configuring and filling a translation expansion area and a funny direct-view area corresponding to the category to which the screen resolution belongs on the suspended window layer through a preset algorithm, wherein the method comprises the following steps:
s321, creating a floating window layer according to the screen resolution so that the size of the floating window layer is matched with that of a large screen;
s322, placing the floating window layer at the upper end of the large screen image;
s323, calculating a high-definition picture corresponding to the high-definition resolution of the target picture; the picture resolution of the high-definition picture is greater than the picture resolution of the target picture;
s324, configuring a second translation expansion area on the floating window image layer according to the high-definition picture through a preset translation expansion area algorithm;
s325, intercepting a second horizontal pixel with a second horizontal proportion on the high-definition picture from the horizontal direction;
s326, filling the second horizontal pixels into the second translation expansion area;
s327, adding a preset Yixing direct-view algorithm after the second translation expansion area is filled, and obtaining a second Yixing direct-view area; wherein the second translation expansion area comprises a second perceived direct-view area;
s328, intercepting a second vertical pixel of a second vertical proportion in the vertical direction in the high-definition picture;
s329, fill the second vertical pixel into the second perceived direct-view region.
The layer transparency of the suspended window layer corresponding to the translation expansion area and the feeling direct-view area is set respectively and comprises the following steps:
s421, configuring the layer transparency of the suspended window layer corresponding to the second translation expansion area to be semitransparent;
and S422, configuring the layer transparency of the suspended window layer corresponding to the second perceptual direct-view area to be fully transparent.
Specifically, as shown in table 1 below, if the screen resolution is 3840p, the picture resolution of the target picture is, for example, 720 × 640, and the target picture needs to be converted into a high definition picture, and the high definition picture needs to be converted into an ultra high definition picture, that is, a large screen picture. Specifically, a high-definition picture corresponding to the high-definition resolution of the target picture is calculated; the picture resolution of the high-definition picture is greater than the picture resolution of the target picture. That is, the high definition picture may be the medium-large screen picture (a) described above.
And selecting a second horizontal ratio, for example 4/3, to intercept pixels in the horizontal direction of the high definition picture, where 4 × 1080/3 is 1440, at this time, 1440 pixels on each horizontal line are intercepted, and the length of the pixels intercepted on each horizontal line is obtained to configure a second translation expansion area FOV resolution, specifically, the length of the second translation expansion area is 1440. 1440 pixels on each horizontal line on the high-definition image are intercepted through a translation expansion algorithm to fill a second translation expansion area, and the transparency of the floating window image layer corresponding to the second translation expansion area from left to right is configured to be semitransparent, namely 50%.
The second perceived direct-view region is arranged according to the second translation expansion region of the floating window layer. Therefore, after the second translation expansion area is filled and configured, a sensory direct-view algorithm is added to the final second translation expansion area from left to right to obtain a second sensory direct-view area. And selecting a second vertical ratio such as 3/4 to intercept pixels in the vertical direction of the high-definition picture, wherein 3 x 720/4 is 540, at this time, 540 pixels on each vertical line on the screenshot high-definition picture are filled into a second interested direct-view region ROI resolution, and the layer transparency of the suspended window layer corresponding to the second interested direct-view region is set to be full transparency, namely 100%.
TABLE 1
And S50, synthesizing the floating window image layers with different image layer transparencies with a large screen by the system to obtain a panoramic image of the target picture.
Specifically, for different screen resolutions in steps S30 and S40, panoramic images of different resolutions of the target picture are obtained by synthesizing the floating window image layer with different image layer transparencies with the large screen. The method comprises the following specific steps: the category of the screen resolution is high-definition resolution, and floating window image layers with different image layer transparencies are synthesized with a large screen by utilizing a seamless superposition technology to obtain a high-definition panoramic image of a target picture; and the category of the screen resolution is ultrahigh-definition resolution, and the suspended window image layers with different image layer transparencies are synthesized with the large screen by utilizing a seamless superposition technology to obtain the ultrahigh-definition panoramic image of the target picture.
Therefore, based on the steps S10-S50, the application generates a large screen image (i.e., a planar panorama) matched with the screen resolution from the target image by using the resolution difference, and then converts the large screen image into a three-dimensional panorama by using different layer transparencies of the floating window layer, a translation expansion area algorithm, a feeling direct-view algorithm and a seamless superposition technology, so that the intelligent large screen is combined with the VR technology, the intelligent large screen can provide a 360-degree panorama, the visual perception of a user is improved, the popularization is expanded, and the user is facilitated.
Based on the method for creating the panoramic picture based on the large screen, the application also provides a device for creating the panoramic picture based on the large screen. Referring to fig. 2, fig. 2 illustrates a schematic structural diagram of an apparatus for creating a panoramic picture based on a large screen in the present application. The apparatus may include an acquisition module 100, a resolution adjustment module 200, a translation expansion area module 300, a perceived direct view module 400, and a panorama synthesis module 500, with fig. 2 showing only some of the components of the apparatus, but it is understood that not all of the shown components are required and that more or fewer components may be implemented instead. The device can be any networking equipment such as a mobile phone, an ipad and a desktop computer.
An obtaining module 100, configured to obtain a picture resolution of a target picture and a screen resolution of a large screen;
the resolution adjusting module 200 is configured to calculate a resolution difference between a picture resolution and a screen resolution, and adjust the target picture according to the resolution difference to obtain a large screen image matched with the screen resolution;
the translation expansion area module 300 is configured to create a floating window layer on a large screen image, configure and fill a translation expansion area corresponding to a category to which a screen resolution belongs on the floating window layer through a preset algorithm, and set layer transparency of the floating window layer corresponding to the translation expansion area and a perceived direct-view area; the translation expansion area is used for converting the target picture into a large screen picture through translation operation and expansion operation;
the developing direct-view module 400 is configured to configure and fill a developing direct-view area according to the translation expansion area module through a developing direct-view algorithm, and set layer transparency of a floating window layer corresponding to the developing direct-view area; the visual perception area is used for converting a large screen image into a panoramic image through parallax;
the panorama synthesis module 500 is configured to synthesize the floating window image layers with different image layer transparencies with the large screen to obtain a panorama of the target picture, specifically, as described above in the method for creating the panorama based on the large screen.
The application also provides an intelligent terminal, as shown in fig. 3, the intelligent terminal 1 may be any network-enabled device such as a mobile phone, an ipad, a desktop computer, and the like. While the intelligent terminal 1 comprises a processor 20 and a memory 22 connected to the processor 20, fig. 3 shows only some of the components of the intelligent terminal 1, it being understood that not all of the shown components are required and that more or fewer components may be implemented instead.
The storage 22 may be an internal storage unit of the intelligent terminal 1 in some embodiments, for example, a memory of the intelligent terminal 1. The memory 22 may also be an external storage device of the intelligent terminal 1 in other embodiments, such as a plug-in usb disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like provided on the intelligent terminal 1. Further, the memory 22 may also include both an internal storage unit and an external storage device of the smart terminal 1. The memory 22 is used for storing application software installed in the intelligent terminal 1 and various data, such as a display program code of a web page. The memory 22 may also be used to temporarily store data that has been output or is to be output. In one embodiment, the memory 22 stores a display program of a web page, and the display program of the web page can be executed by the processor 20 to perform the following steps:
the acquisition module is used for acquiring the picture resolution of the target picture and the screen resolution of the large screen;
the resolution adjusting module is used for calculating a resolution difference value between the picture resolution and the screen resolution, and adjusting the target picture according to the resolution difference value to obtain a large screen image matched with the screen resolution;
the translation expansion area module is used for creating a suspended window layer arranged on the large screen image, configuring and filling translation expansion areas corresponding to the categories to which the screen resolutions belong on the suspended window layer through a preset algorithm, and setting layer transparencies of the suspended window layer corresponding to the translation expansion areas and the perceived direct-view areas; the translation expansion area is used for converting the target picture into a large screen picture through translation operation and expansion operation;
the system comprises a translation expansion area module, a sense direct-view module and a floating window image layer display module, wherein the sense direct-view module is used for configuring and filling a sense direct-view area according to a translation expansion area module through a sense direct-view algorithm and setting the image layer transparency of a floating window image layer corresponding to the sense direct-view area; the visual perception area is used for converting a large screen image into a panoramic image through parallax;
and the panoramic synthesis module is used for synthesizing the floating window image layers with different image layer transparencies with the large screen to obtain a panoramic image of the target picture, and the method is particularly used.
The present application further provides a computer-readable storage medium, on which a computer program is stored, and when being executed by the processor 20, the computer program implements the steps in the method for creating a panoramic picture based on a large screen, specifically the method as described above.
Of course, it can be understood by those skilled in the art that all or part of the processes in the methods of the embodiments described above can be implemented by instructing relevant hardware (such as a processor, a controller, etc.) by a computer program, and the program can be stored in a computer-readable storage medium, and when executed, the program can include the processes of the embodiments of the methods described above. The storage medium may be a memory, a magnetic disk, an optical disk, etc.
It should be understood that the application is not limited to the above examples, and that modifications or changes may be made by those skilled in the art based on the above description, and all such modifications and changes are intended to fall within the scope of the appended claims.
Claims (12)
1. A method for creating a panoramic picture based on a large screen is characterized by comprising the following steps:
acquiring the picture resolution of a target picture and the screen resolution of a large screen;
calculating a resolution difference value between the image resolution and the screen resolution, and adjusting the target image according to the resolution difference value to obtain a large screen image matched with the screen resolution;
creating a floating window layer arranged on the large screen image, and configuring and filling a translation expansion area and a feeling direct-view area corresponding to the category to which the screen resolution belongs on the floating window layer through a preset algorithm; the translation expansion area is used for converting the target picture into the large screen picture through translation operation and expansion operation; the vision sensing area is used for converting the large screen image into a panoramic image through parallax;
respectively setting layer transparencies of the suspended window layers corresponding to the translation expansion area and the perceived direct-view area;
and synthesizing the floating window image layers with different image layer transparencies with the large screen to obtain a panoramic image of the target picture.
2. The method of claim 1, wherein the obtaining the picture resolution of the target picture and the screen resolution of the large screen comprises:
when a command that an intelligent terminal sends a target picture is monitored, receiving the target picture and obtaining the picture resolution of the target picture; the picture resolution is expressed as the number of horizontal pixels by the number of vertical pixels of the target picture;
acquiring the screen resolution of the large screen; the screen resolution is expressed as the number of horizontal pixels by the number of vertical pixels of the large screen.
3. The method according to claim 2, wherein the calculating a resolution difference between the picture resolution and the screen resolution, and adjusting the target picture according to the resolution difference to obtain a large screen image matching the screen resolution comprises:
the horizontal pixel number in the picture resolution is differed with the horizontal pixel number in the screen resolution to obtain a horizontal resolution difference value;
if the absolute value of the horizontal resolution difference is equal to 0, taking the target picture as a large screen picture matched with the screen resolution;
if the absolute value of the horizontal resolution difference is not equal to 0, taking the absolute value of the horizontal resolution difference as the number of pixels to be filled in the horizontal direction of the target picture; determining a color to be filled, and acquiring a color pixel value corresponding to the color to be filled; and filling the target picture through the color pixel values to obtain a large screen picture matched with the screen resolution.
4. The method according to claim 3, wherein the determining a color to be filled and obtaining a color pixel value corresponding to the color to be filled comprises:
acquiring color pixel values of all filling colors on the target picture and the number of pixels corresponding to all the filling colors; the color pixel value of each filling color comprises an R value, a G value and a B value;
respectively calculating the average values of the R value, the G value and the B value according to the first color pixel value of each filling color and the number of pixels corresponding to each filling color to obtain an R average value, a G average value and a B average value;
and determining colors corresponding to the R mean value, the G mean value and the B mean value, wherein the colors are colors to be filled, and color pixel values of the colors to be filled are the R mean value, the G mean value and the B mean value.
5. The method according to any one of claims 1 to 4, wherein if the category to which the screen resolution belongs is high definition resolution, the creating a floating window layer disposed on the large screen image, and configuring and filling a translation expansion area and a perceived direct-view area corresponding to the category to which the screen resolution belongs on the floating window layer by a preset algorithm includes:
creating a floating window layer according to the screen resolution, so that the size of the floating window layer is matched with the large screen;
placing the floating window map layer at the upper end of the large screen map;
configuring a first translation expansion area on the floating window layer according to the target picture through a preset translation expansion area algorithm;
intercepting a first horizontal pixel of a first horizontal proportion on the target picture from the horizontal direction;
filling the first horizontal pixel to the first translation expansion region;
adding a preset feeling direct-view algorithm after the first translation expansion area is filled, and obtaining a first feeling direct-view area; wherein the first translation expansion area comprises a first perceived direct-view area;
intercepting a first vertical pixel of a first vertical proportion in the vertical direction in the target picture;
filling the first vertical pixel into the first region of perceived direct view.
6. The method according to claim 5, wherein the setting of layer transparencies of the floating window layer corresponding to the translation expansion area and the perceived direct-view area respectively comprises:
configuring the layer transparency of the suspended window layer corresponding to the first translation expansion area to be semitransparent;
and configuring the layer transparency of the suspended window layer corresponding to the first direct-view sensing area to be fully transparent.
7. The method according to any one of claims 1 to 4, wherein if the category to which the screen resolution belongs is ultra high definition resolution, the creating a floating window layer disposed on the large screen image, and configuring and filling a translation expansion area and a perceived direct-view area corresponding to the category to which the screen resolution belongs on the floating window layer by a preset algorithm includes:
creating a floating window layer according to the screen resolution, so that the size of the floating window layer is matched with the large screen;
placing the floating window layer at the upper end of the large screen image;
calculating a high-definition picture corresponding to the high-definition resolution of the target picture; the picture resolution of the high-definition picture is greater than the picture resolution of the target picture;
configuring a second translation expansion area on the floating window layer according to the high-definition picture through a preset translation expansion area algorithm;
intercepting second horizontal pixels of a second horizontal proportion on the high-definition picture from the horizontal direction;
filling the second horizontal pixels to the second translation expansion region;
after the second translation expansion area is filled, adding a preset Yixing direct-view algorithm to obtain a second Yixing direct-view area; wherein the second translation expansion zone comprises the second perceived direct view zone;
intercepting a second vertical pixel of a second vertical proportion in the vertical direction in the high-definition picture;
filling the second vertical pixel into the second region of perceived sight.
8. The method according to claim 7, wherein the setting of layer transparencies of the floating window layer corresponding to the translation expansion area and the direct-view area respectively comprises:
configuring the layer transparency of the suspended window layer corresponding to the second translation expansion area to be semitransparent;
and configuring the layer transparency of the suspended window layer corresponding to the second direct-view sensing area to be fully transparent.
9. The method according to claim 6 or 8, wherein the synthesizing the floating window image layers with different image layer transparencies with the large screen to obtain the panorama of the target picture comprises:
and synthesizing the floating window image layers with different image layer transparencies with the large screen by utilizing a seamless superposition technology to obtain a panoramic image of the target picture.
10. An apparatus for creating a panoramic picture based on a large screen, comprising:
the acquisition module is used for acquiring the picture resolution of the target picture and the screen resolution of the large screen;
the resolution adjusting module is used for calculating a resolution difference value between the picture resolution and the screen resolution, and adjusting the target picture according to the resolution difference value to obtain a large screen image matched with the screen resolution;
the translation expansion area module is used for creating a suspended window layer arranged on the large screen image, configuring and filling a translation expansion area corresponding to the category to which the screen resolution belongs on the suspended window layer through a preset algorithm, and setting the layer transparency of the suspended window layer corresponding to the translation expansion area; the translation expansion area is used for converting the target picture into the large screen picture through translation operation and expansion operation;
the system comprises a translation expansion area module, a sense direct-view module and a floating window layer transparency setting module, wherein the translation expansion area module is used for configuring and filling a sense direct-view area through a sense direct-view algorithm according to the translation expansion area module, and setting the layer transparency of the floating window layer corresponding to the sense direct-view area; wherein the perceived direct-view area is used for converting the large screen image into a panoramic image through parallax;
and the panoramic synthesis module is used for synthesizing the floating window image layers with different image layer transparencies with the large screen to obtain a panoramic image of the target picture.
11. An intelligent terminal, comprising a large-screen display screen, a memory, a processor and a program stored in the memory and executable on the processor for creating a panoramic picture based on a large screen, wherein the processor implements the steps of the method for creating a panoramic picture based on a large screen according to any one of claims 1 to 9 when executing the program for creating a panoramic picture based on a large screen.
12. A computer-readable storage medium, having a computer program stored thereon, which, when being executed by a processor, implements the steps of the method for creating a panoramic picture based on a large screen of any one of claims 1 to 9.
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011291487.5A CN114518860B (en) | 2020-11-18 | 2020-11-18 | Method and device for creating panoramic picture based on large screen, intelligent terminal and medium |
| GB2308579.8A GB2616188A (en) | 2020-11-18 | 2021-11-01 | Method and apparatus for creating panoramic picture on basis of large screen, and intelligent terminal and medium |
| PCT/CN2021/127958 WO2022105584A1 (en) | 2020-11-18 | 2021-11-01 | Method and apparatus for creating panoramic picture on basis of large screen, and intelligent terminal and medium |
| JP2023530651A JP2023550764A (en) | 2020-11-18 | 2021-11-01 | Methods, devices, smart terminals and media for creating panoramic images based on large displays |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011291487.5A CN114518860B (en) | 2020-11-18 | 2020-11-18 | Method and device for creating panoramic picture based on large screen, intelligent terminal and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114518860A true CN114518860A (en) | 2022-05-20 |
| CN114518860B CN114518860B (en) | 2023-08-01 |
Family
ID=81594727
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011291487.5A Active CN114518860B (en) | 2020-11-18 | 2020-11-18 | Method and device for creating panoramic picture based on large screen, intelligent terminal and medium |
Country Status (4)
| Country | Link |
|---|---|
| JP (1) | JP2023550764A (en) |
| CN (1) | CN114518860B (en) |
| GB (1) | GB2616188A (en) |
| WO (1) | WO2022105584A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114995701A (en) * | 2022-07-19 | 2022-09-02 | 荣耀终端有限公司 | Suspension window control method and related device |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004334843A (en) * | 2003-04-15 | 2004-11-25 | Seiko Epson Corp | Method of composting image from two or more images |
| KR100790890B1 (en) * | 2006-09-27 | 2008-01-02 | 삼성전자주식회사 | Apparatus and method for generating panorama image |
| US20080074506A1 (en) * | 2006-09-21 | 2008-03-27 | Samsung Electronics Co., Ltd | Apparatus and method for photographing panoramic image |
| CN104181884A (en) * | 2014-08-11 | 2014-12-03 | 厦门立林科技有限公司 | Device and method for controlling intelligent home based on panoramic view |
| CN105516311A (en) * | 2015-12-09 | 2016-04-20 | 中国农业银行股份有限公司 | Electronic map panorama acquisition method and system |
| CN106462944A (en) * | 2016-05-30 | 2017-02-22 | 香港应用科技研究院有限公司 | Mapping multiple high-resolution images onto a low-resolution 360-degree image to produce a high-resolution panorama without ghosting |
| CN108307219A (en) * | 2017-11-07 | 2018-07-20 | 深圳市佳创视讯技术股份有限公司 | A kind of high definition television panoramic video intelligence methods of exhibiting |
| CN110377257A (en) * | 2019-07-17 | 2019-10-25 | Oppo广东移动通信有限公司 | Layer composition, device, electronic equipment and storage medium |
| US20200057595A1 (en) * | 2018-08-15 | 2020-02-20 | Boe Technology Group Co., Ltd. | Splicing screen, display method thereof and display control apparatus |
-
2020
- 2020-11-18 CN CN202011291487.5A patent/CN114518860B/en active Active
-
2021
- 2021-11-01 WO PCT/CN2021/127958 patent/WO2022105584A1/en active Application Filing
- 2021-11-01 GB GB2308579.8A patent/GB2616188A/en active Pending
- 2021-11-01 JP JP2023530651A patent/JP2023550764A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004334843A (en) * | 2003-04-15 | 2004-11-25 | Seiko Epson Corp | Method of composting image from two or more images |
| US20080074506A1 (en) * | 2006-09-21 | 2008-03-27 | Samsung Electronics Co., Ltd | Apparatus and method for photographing panoramic image |
| KR100790890B1 (en) * | 2006-09-27 | 2008-01-02 | 삼성전자주식회사 | Apparatus and method for generating panorama image |
| CN104181884A (en) * | 2014-08-11 | 2014-12-03 | 厦门立林科技有限公司 | Device and method for controlling intelligent home based on panoramic view |
| CN105516311A (en) * | 2015-12-09 | 2016-04-20 | 中国农业银行股份有限公司 | Electronic map panorama acquisition method and system |
| CN106462944A (en) * | 2016-05-30 | 2017-02-22 | 香港应用科技研究院有限公司 | Mapping multiple high-resolution images onto a low-resolution 360-degree image to produce a high-resolution panorama without ghosting |
| CN108307219A (en) * | 2017-11-07 | 2018-07-20 | 深圳市佳创视讯技术股份有限公司 | A kind of high definition television panoramic video intelligence methods of exhibiting |
| US20200057595A1 (en) * | 2018-08-15 | 2020-02-20 | Boe Technology Group Co., Ltd. | Splicing screen, display method thereof and display control apparatus |
| CN110377257A (en) * | 2019-07-17 | 2019-10-25 | Oppo广东移动通信有限公司 | Layer composition, device, electronic equipment and storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114995701A (en) * | 2022-07-19 | 2022-09-02 | 荣耀终端有限公司 | Suspension window control method and related device |
| CN114995701B (en) * | 2022-07-19 | 2024-04-02 | 荣耀终端有限公司 | Suspended window control method and related device |
Also Published As
| Publication number | Publication date |
|---|---|
| GB2616188A (en) | 2023-08-30 |
| CN114518860B (en) | 2023-08-01 |
| GB202308579D0 (en) | 2023-07-26 |
| JP2023550764A (en) | 2023-12-05 |
| WO2022105584A1 (en) | 2022-05-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113382168B (en) | Apparatus and method for storing overlapping regions of imaging data to produce an optimized stitched image | |
| US9811946B1 (en) | High resolution (HR) panorama generation without ghosting artifacts using multiple HR images mapped to a low resolution 360-degree image | |
| US9619861B2 (en) | Apparatus and method for improving quality of enlarged image | |
| JP6561216B2 (en) | Generating intermediate views using optical flow | |
| US9591237B2 (en) | Automated generation of panning shots | |
| KR20170017700A (en) | Electronic Apparatus generating 360 Degrees 3D Stereoscopic Panorama Images and Method thereof | |
| US20080253685A1 (en) | Image and video stitching and viewing method and system | |
| JP2009124685A (en) | Method and system for combining videos for display in real-time | |
| CN103973963B (en) | Image acquisition device and image processing method thereof | |
| US11589026B2 (en) | Method for generating and displaying panorama images based on rendering engine and a display apparatus | |
| JPH1127703A (en) | Display device and its control method | |
| KR20150108774A (en) | Method for processing a video sequence, corresponding device, computer program and non-transitory computer-readable medium | |
| CN108665415B (en) | Image quality improving method and device based on deep learning | |
| US20190266802A1 (en) | Display of Visual Data with a Virtual Reality Headset | |
| WO2019050038A1 (en) | Image generation method and image generation device | |
| CN114630053B (en) | HDR image display method and display device | |
| US20230033267A1 (en) | Method, apparatus and system for video processing | |
| CN107409239A (en) | Image transfer method, graphic transmission equipment and image delivering system based on eye tracks | |
| CN111866523A (en) | Panoramic video synthesis method and device, electronic equipment and computer storage medium | |
| CN114518860B (en) | Method and device for creating panoramic picture based on large screen, intelligent terminal and medium | |
| CN112770095A (en) | Panoramic projection method and device and electronic equipment | |
| CN101917639A (en) | Method and system for generating stereo images | |
| CN113542463B (en) | Video shooting device and method based on folding screen, storage medium and mobile terminal | |
| CN112866507B (en) | Intelligent panoramic video synthesis method and system, electronic device and medium | |
| JP5645448B2 (en) | Image processing apparatus, image processing method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |