CN112837421A - Method and device for previewing program played on display screen - Google Patents
Method and device for previewing program played on display screen Download PDFInfo
- Publication number
- CN112837421A CN112837421A CN201911160537.3A CN201911160537A CN112837421A CN 112837421 A CN112837421 A CN 112837421A CN 201911160537 A CN201911160537 A CN 201911160537A CN 112837421 A CN112837421 A CN 112837421A
- Authority
- CN
- China
- Prior art keywords
- image
- display screen
- real scene
- program
- virtual program
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 33
- 230000004044 response Effects 0.000 claims abstract description 21
- 239000003550 marker Substances 0.000 claims description 13
- 238000009877 rendering Methods 0.000 claims description 9
- 230000000694 effects Effects 0.000 abstract description 11
- 230000015654 memory Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 5
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Abstract
The embodiment of the invention discloses a method and a device for previewing a program played on a display screen. The method for example comprises: acquiring a real scene image obtained by shooting; identifying the content of the real scene image; in response to the fact that the real scene image contains the target display screen, acquiring current position information and pose information of the portable electronic terminal, and acquiring an area where the target display screen is located in the real scene image; acquiring a virtual program image; and adjusting the posture of the virtual program image based on the current position information and the pose information to obtain an adjusted virtual program image, and overlaying the adjusted virtual program image into the area where the target display screen is located in the real scene image to obtain a target image fusing the real scene image and the adjusted virtual program image for the user to watch on the portable electronic terminal. The embodiment of the invention enables a user to intuitively preview the program playing effect of the target display screen.
Description
Technical Field
The invention relates to the technical field of display, in particular to a display screen playing program previewing method and a display screen playing program previewing device.
Background
In the field of display screens, users often need to build display screens with different design styles according to application scenes of the display screens, such as LED display screens, however, how the display effect of the finally built display screen and how the user can know the display effect and the experience of watching the display screen from various angles only after the display screen finishes displaying, and the user cannot predict the effect of playing programs on the display screen.
Disclosure of Invention
Therefore, to overcome the defects and shortcomings in the prior art, embodiments of the present invention provide a method and a device for previewing a program played on a display screen, so that a user can intuitively preview the program playing effect of a target display screen.
On one hand, a method for previewing a program played on a display screen according to an embodiment of the present invention is applied to a portable electronic terminal, and includes: acquiring a real scene image obtained by shooting; performing content identification on the real scene image; in response to the fact that the real scene image contains the target display screen, acquiring current position information and pose information of the portable electronic terminal, and acquiring an area where the target display screen is located in the real scene image; acquiring a virtual program image; and adjusting the posture of the virtual program image based on the current position information and the pose information to obtain an adjusted virtual program image, and overlaying the adjusted virtual program image into the area of the target display screen in the real scene image to obtain a target image fusing the real scene image and the adjusted virtual program image for the user to watch.
In the above scheme, a real scene image including a target display screen and a virtual program image obtained by shooting are obtained by a display screen playing program previewing method, then the posture of the virtual program image is adjusted based on the obtained current position information and the obtained pose information to obtain an adjusted virtual program image, and the adjusted virtual program image is superimposed in the area where the target display screen is located in the real scene image, so as to obtain a target image fusing the real scene image and the adjusted virtual program image for a user to watch, and thus, the user can visually check the display effect of the virtual program image on the target display screen by watching the target image.
In an embodiment of the present invention, the target display screen has a mark pattern displayed thereon, and the acquiring the virtual program image includes: and responding to the mark pattern in the area where the target display screen is located in the real scene image, and acquiring the virtual program image corresponding to the mark pattern from a server connected with the portable electronic terminal through a network according to the mark pattern.
In an embodiment of the present invention, the method for previewing a program on a display screen further includes: determining the ambient light brightness of the target display screen based on the real scene image before the virtual program image is obtained; and rendering the virtual program image according to the brightness of the environment light to obtain the rendered virtual program image before the posture of the virtual program image is adjusted based on the current position information and the posture information to obtain the adjusted virtual program image.
In an embodiment of the present invention, no marker pattern is displayed on the target display screen, and the acquiring the virtual program image includes: prompting a user to set a playing program in response to not recognizing the mark pattern in the area where the target display screen is located in the real scene image; acquiring the playing program and sending the playing program to a server connected with the portable electronic terminal through a network so that the server generates the virtual program image according to the playing program; receiving the virtual program image from the server. Here, in the case that no mark pattern is displayed on the target display screen, in response to that the mark pattern in the area where the target display screen is located in the real scene image is not identified, the display screen preview method of the embodiment obtains the broadcast program by prompting the user to set the broadcast program, and sends the obtained broadcast program to the server, so that the server generates a virtual program image according to the broadcast program, and finally obtains the virtual program image from the server.
In an embodiment of the present invention, the method for previewing a program on a display screen further includes: determining the ambient light brightness of the target display screen based on the real scene image before the virtual program image is acquired; wherein the acquiring of the virtual program image includes: prompting a user to set a playing program in response to not recognizing the mark pattern in the area where the target display screen is located in the real scene image; acquiring the playing program, and sending the playing program and the ambient light brightness to a server connected with the portable electronic terminal through a network, so that the server generates the rendered virtual program image according to the playing program and the ambient light brightness; receiving the virtual program image from the server.
On the other hand, an embodiment of the present invention provides a display screen program preview device, which is applied to a portable electronic terminal, and includes: the first image acquisition module is used for acquiring a real scene image obtained by shooting; the content identification module is used for carrying out content identification on the real scene image; the information and area acquisition module is used for responding to the fact that the real scene image contains the target display screen, acquiring the current position information and the pose information of the portable electronic terminal and acquiring the area of the target display screen in the real scene image; the second image acquisition module is used for acquiring a virtual program image; and the target image display module is used for adjusting the posture of the virtual program image based on the current position information and the pose information to obtain an adjusted virtual program image, and superposing the adjusted virtual program image to the area of the target display screen in the real scene image to obtain a target image fusing the real scene image and the adjusted virtual program image for a user to watch.
In the above scheme, the real scene image including the target display screen and the virtual program image obtained by shooting are obtained through the display screen playing program previewing device, then the posture of the virtual program image is adjusted based on the obtained current position information and the obtained pose information to obtain the adjusted virtual program image, and the adjusted virtual program image is superposed in the area where the target display screen is located in the real scene image, so that the target image fusing the real scene image and the adjusted virtual program image is obtained for the user to watch, and therefore the user can visually check the display effect of the virtual program image on the target display screen by watching the target image.
In an embodiment of the present invention, the second image obtaining module is specifically configured to: and in response to identifying the marker pattern in the area of the target display screen in the real scene image, acquiring the virtual program image corresponding to the marker pattern from a server connected to the portable electronic terminal through a network according to the marker pattern.
In an embodiment of the present invention, the apparatus for previewing programs on a display screen further includes: the environment brightness obtaining module is used for determining the environment brightness of the target display screen based on the real scene image; and the virtual program image rendering module is used for rendering the virtual program image according to the ambient light brightness to obtain the rendered virtual program image.
In an embodiment of the present invention, the second image obtaining module is specifically configured to: prompting a user to set a playing program in response to not recognizing the mark pattern in the area where the target display screen is located in the real scene image; acquiring the playing program and sending the playing program to a server connected to the portable electronic terminal through a network, so that the server generates the virtual program image according to the playing program; receiving the virtual program image from the server.
In an embodiment of the present invention, the apparatus for previewing programs on a display screen further includes: the environment brightness obtaining module is used for determining the environment brightness of the target display screen based on the real scene image; the second image acquisition module is specifically configured to: prompting a user to set a playing program in response to not recognizing the mark pattern in the area where the target display screen is located in the real scene image; acquiring the playing program, and sending the playing program and the ambient light brightness to a server connected with the portable electronic terminal through a network, so that the server generates the rendered virtual program image according to the playing program and the ambient light brightness; receiving the virtual program image from the server.
One or more of the above technical solutions may have the following advantages or beneficial effects: the method and the device for previewing the program played by the display screen acquire a real scene image including a target display screen and acquire a virtual program image, then adjust the posture of the virtual program image based on the acquired current position information and the posture information to acquire an adjusted virtual program image, and overlay the adjusted virtual program image into the area where the target display screen is located in the real scene image to acquire a target image fusing the real scene image and the adjusted virtual program image for a user to watch on the portable electronic terminal, for example, so that the user can visually check the display effect of the virtual program image on the target display screen by watching the target image.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a flowchart illustrating a method for previewing a program played on a display screen according to a first embodiment of the present invention.
Fig. 2 is a flowchart illustrating another method for previewing a program displayed on a display screen according to a first embodiment of the present invention.
Fig. 3 is a schematic system structure diagram of a method for previewing a program on a display screen according to a first embodiment of the present invention.
Fig. 4 is a schematic block diagram of an apparatus for previewing a program displayed on a display screen according to a second embodiment of the present invention.
Fig. 5 is a schematic block diagram of another apparatus for previewing programs on a display screen according to a second embodiment of the present invention.
Fig. 6 is a schematic structural diagram of a system for previewing programs displayed on a display screen according to a third embodiment of the present invention.
Fig. 7 is a schematic structural diagram of a computer-readable storage medium according to a fourth embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
[ first embodiment ] A method for manufacturing a semiconductor device
Referring to fig. 1, it is a flowchart illustrating a method for previewing a program on a display screen according to a first embodiment of the present invention. Specifically, the method for previewing the program played by the display screen provided by the embodiment of the invention is applied to a portable electronic terminal such as a mobile phone, a notebook computer, a tablet computer and the like.
The method for previewing the program played by the display screen can comprise the following steps:
step S102, acquiring a real scene image obtained by shooting;
step S104, identifying the content of the real scene image;
step S106, in response to the fact that the real scene image contains the target display screen, acquiring current position information and pose information of the portable electronic terminal, and acquiring an area where the target display screen is located in the real scene image;
step S108, acquiring a virtual program image;
step S110, adjusting the posture of the virtual program image based on the current position information and the pose information to obtain an adjusted virtual program image, and overlaying the adjusted virtual program image to the area of the target display screen in the real scene image to obtain a target image fusing the real scene image and the adjusted virtual program image for the user to watch.
In order to facilitate understanding of the present embodiment, a method for previewing a program on a display screen in the present embodiment is described in detail below with reference to fig. 2 and 3.
Fig. 3 shows a system 200 for displaying a program preview on a display screen according to an embodiment of the present invention, which includes a target display screen 202, a portable electronic terminal 204, and a server 206. Wherein the portable electronic terminal 204 is connected to the server 206 via a network, such as a wired network or a wireless network. The target display 202 may be, for example, an LED display, and the portable electronic terminal 204 may be, for example, a cell phone.
The method for previewing the program played by the display screen according to the embodiment of the present invention is executed by, for example, AR (Augmented Reality) program preview software on the portable electronic terminal 204.
Specifically, the portable electronic terminal 204 first obtains a captured real scene image, where the obtained captured real scene image may be obtained by a camera of the portable electronic terminal 204, or may be obtained by another image capturing device connected to the portable electronic terminal 204, and is not limited in this respect.
Then, the portable electronic terminal 204 performs content recognition on the real scene image. When recognizing that the real scene image contains the target display screen 202, the portable electronic terminal 204 acquires current position information and pose information of the portable electronic terminal 204 and acquires an area where the target display screen 202 is located in the real scene image. The current position information and the pose information may be acquired, for example, by a positioning module, such as a GPS module, and an attitude sensor, such as a gyroscope and/or an acceleration sensor, of the portable electronic terminal 204, which is not particularly limited herein.
Then, the portable electronic terminal 204 identifies whether a marker pattern located in the area where the target display screen 202 is located exists in the real scene image. Under the condition that the mark pattern in the area where the target display screen 202 is located in the real scene image is identified, the portable electronic terminal 204 acquires the virtual program image corresponding to the mark pattern from a server 206 end connected to the portable electronic terminal 204 through a network according to the mark pattern. The marker pattern may, for example, be a marker pattern displayed on the target display screen 202, which may, for example, be preset. Here, the mark pattern and the obtained virtual program image have a certain mapping relationship, and different mark patterns can trigger obtaining of different virtual program images.
Or, in the case that the portable electronic terminal 204 does not recognize the mark pattern in the area where the target display screen 202 is located in the real scene image, the portable electronic terminal 204 prompts the user to set the playing program. Then, in response to the user setting the broadcast program, for example, through a touch screen of the portable electronic terminal 204, the portable electronic terminal 204 acquires the broadcast program and sends the broadcast program to a server 206 connected to the portable electronic terminal 204 through a network, so that the server 206 generates the virtual program image according to the broadcast program and sends the virtual program image to the portable electronic terminal 204; the portable electronic terminal 204 then receives the virtual program image from the server 206. It should be noted that, in the above solution, the virtual program image is obtained from the server 206, in other embodiments, the virtual program image may also be obtained locally from the portable electronic terminal, and the embodiment of the present invention is not specifically limited herein.
Finally, the portable electronic terminal 204 adjusts the posture of the virtual program image based on the current position information and the pose information to obtain an adjusted virtual program image, and superimposes the adjusted virtual program image onto the area of the real scene image where the target display screen 202 is located, so as to obtain a target image fusing the real scene image and the adjusted virtual program image for the user to watch. Here, the user may view the target image through the portable electronic terminal 204, and may also view the target image through a display device or a projection device connected to the portable electronic terminal 204, which is not specifically limited herein.
In this way, the user can view the effect of displaying the virtual program image in the region where the target display screen 202 is located through the portable electronic terminal 204, and the program playing effect of previewing the target display screen 202 is achieved. It should be noted that the adjusting of the posture of the virtual program image may be, for example, adjusting the size and angle of the virtual program image, so that the adjusted virtual program image obtained when the portable electronic terminal 204 moves relative to the target display screen 202 can ensure spatial consistency.
Further, in order to make the virtual program image displayed on the target display screen 202 more realistic, as shown in step S107 in fig. 2, the portable electronic terminal 204 may determine the ambient light level of the target display screen 202 based on the real scene image before acquiring the virtual program image. Next, the portable electronic terminal 204 performs acquisition and fusion of the virtual program image based on whether the mark pattern in the area where the target display screen 202 is located in the real scene image is identified, and the specific process is described in detail below.
Under the condition that the portable electronic terminal 204 identifies the mark pattern in the area where the target display screen 202 is located in the real scene image, the portable electronic terminal 204 acquires the virtual program image corresponding to the mark pattern from a server 206 connected with the portable electronic terminal 204 through a network according to the mark pattern. Then, as shown in step S109 of fig. 2, the portable electronic terminal 204 renders the virtual program image obtained in step S107 according to the ambient light brightness to obtain the rendered virtual program image, and the following steps are already described in detail above and are not described again here.
In the case that the portable electronic terminal 204 does not recognize the mark pattern in the area where the target display screen 202 is located in the real scene image, the portable electronic terminal prompts the user to set a broadcast program. Then, in response to the user setting the broadcast program, for example, through a touch screen of the portable electronic terminal 204, the portable electronic terminal 204 acquires the broadcast program and sends the broadcast program and the ambient light brightness to the server 206 connected to the portable electronic terminal 204 through the network, so that the server 206 generates a rendered virtual program image according to the broadcast program and the ambient light brightness, so that the portable electronic terminal 204 executes the step S110. It should be noted that, in the present embodiment, rendering of the virtual program image is performed by the server 206; in other embodiments, it may also be that the server 206 acquires a virtual program image based on the broadcast program acquired from the portable electronic terminal 204, transmits the virtual program image to the portable electronic terminal 204, and then the portable electronic terminal 204 renders the virtual program image according to the ambient light brightness and the acquired virtual program image to obtain the rendered virtual program image.
In summary, in the foregoing embodiment of the present invention, a real scene image including a target display screen and a virtual program image obtained by shooting are obtained by a display screen program playing preview method, then the posture of the virtual program image is adjusted based on the obtained current position information and the obtained pose information to obtain an adjusted virtual program image, and the adjusted virtual program image is superimposed on the area where the target display screen is located in the real scene image, so as to obtain a target image fusing the real scene image and the adjusted virtual program image for a user to view on, for example, a portable electronic terminal.
[ second embodiment ]
Referring to fig. 4, a second embodiment of the present invention provides a display screen preview device 300 for playing programs. The display screen program preview device 300 is applied to, for example, a portable electronic terminal, and includes: a first image acquisition module 302, a content recognition module 304, an information and region acquisition module 306, a second image acquisition module 308, and a target image display module 310.
Specifically, the first image obtaining module 302 is configured to obtain a captured real scene image; the content identification module 304 is configured to perform content identification on the real scene image; the information and area acquisition module 306 is configured to, in response to recognizing that the real scene image includes a target display screen, acquire current position information and pose information of the portable electronic terminal, and acquire an area in the real scene image where the target display screen is located; the second image obtaining module 308 is configured to obtain a virtual program image; and the target image display module 310 adjusts the posture of the virtual program image based on the current position information and the pose information to obtain an adjusted virtual program image, and superimposes the adjusted virtual program image onto the area of the target display screen in the real scene image, so as to obtain a target image fusing the real scene image and the adjusted virtual program image for the user to watch.
In a specific embodiment, the second image obtaining module 308 is specifically configured to, in response to identifying a marker pattern in the real scene image in the area where the target display screen is located, obtain, according to the marker pattern, the virtual program image corresponding to the marker pattern from a server connected to the portable electronic terminal through a network.
In one embodiment, as shown in fig. 5, the display screen preview device 300 may further include an ambient light level obtaining module 307 and a virtual program image rendering module 309. Specifically, the ambient light brightness obtaining module 307 is configured to determine the ambient light brightness of the target display screen based on the real scene image. The virtual program image rendering module 309 is configured to render the virtual program image according to the ambient light brightness to obtain the rendered virtual program image.
In a specific embodiment, the second image obtaining module 308 may be specifically configured to: prompting a user to set a playing program in response to not recognizing the mark pattern in the area where the target display screen is located in the real scene image; acquiring the playing program and sending the playing program to a server connected to the portable electronic terminal through a network, so that the server generates the virtual program image according to the playing program; receiving the virtual program image from the server.
In a specific embodiment, the apparatus 300 for previewing programs on a display screen may further include an ambient light brightness obtaining module 307, configured to determine an ambient light brightness of the target display screen based on the real scene image; the second image acquisition module is specifically configured to: prompting a user to set a playing program in response to not recognizing the mark pattern in the area where the target display screen is located in the real scene image; acquiring the playing program, and sending the playing program and the ambient light brightness to a server connected with the portable electronic terminal through a network, so that the server generates the rendered virtual program image according to the playing program and the ambient light brightness; receiving the virtual program image from the server.
For specific working processes and technical effects among the modules in the device 300 for previewing programs on a display screen in this embodiment, reference is made to the description of the related steps in the foregoing first embodiment, and details are not repeated here.
[ third embodiment ]
As shown in fig. 6, a third embodiment of the present invention provides a display screen program preview system 400. The display screen plays program preview 400 including memory 410 and processor 430 coupled to memory 410. The memory 410 may be, for example, a non-volatile memory, on which the computer program 411 is stored. The processor 430 executes the computer program 411 to execute the method for previewing programs on the display screen according to the first embodiment.
[ fourth example ] A
As shown in fig. 7, a fourth embodiment of the invention provides a computer-readable storage medium 500 storing computer-executable instructions 510. The computer-executable instructions 510 are for performing a display screen program preview method as described in the foregoing first embodiment. The computer-readable storage medium 500 is, for example, a non-volatile memory, such as including: magnetic media (e.g., hard disks, floppy disks, and magnetic tape), optical media (e.g., CDROM disks and DVDs), magneto-optical media (e.g., optical disks), and hardware devices specially constructed for storing and executing computer-executable instructions (e.g., Read Only Memories (ROMs), Random Access Memories (RAMs), flash memories, etc.). The computer-readable storage medium 500 may execute the computer-executable instructions 510 by one or more processors or processing devices.
In addition, it should be understood that the foregoing embodiments are merely exemplary illustrations of the present invention, and the technical solutions of the embodiments can be arbitrarily combined and collocated without conflict between technical features and structural contradictions, which do not violate the purpose of the present invention.
In the embodiments provided in the present invention, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, a division of a unit is merely a division of one logic function, and an actual implementation may have another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may also be distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, each functional unit/module in the embodiments of the present invention may be integrated into one processing unit/module, or each unit/module may exist alone physically, or two or more units/modules may be integrated into one unit/module. The integrated units/modules may be implemented in the form of hardware, or may be implemented in the form of hardware plus software functional units/modules.
The integrated units/modules, which are implemented in the form of software functional units/modules, may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium and includes several instructions for causing one or more processors of a computer device (which may be a personal computer, a server, or a network device) to execute some steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A preview method of a program played on a display screen is applied to a portable electronic terminal and comprises the following steps:
acquiring a real scene image obtained by shooting;
performing content identification on the real scene image;
in response to the fact that the real scene image contains the target display screen, acquiring current position information and pose information of the portable electronic terminal, and acquiring an area where the target display screen is located in the real scene image;
acquiring a virtual program image;
and adjusting the posture of the virtual program image based on the current position information and the pose information to obtain an adjusted virtual program image, and overlaying the adjusted virtual program image into the area of the target display screen in the real scene image to obtain a target image fusing the real scene image and the adjusted virtual program image for the user to watch.
2. The method for previewing a program on a display screen according to claim 1, wherein a mark pattern is displayed on said target display screen; the acquiring of the virtual program image includes:
and responding to the mark pattern in the area where the target display screen is located in the real scene image, and acquiring the virtual program image corresponding to the mark pattern from a server connected with the portable electronic terminal through a network according to the mark pattern.
3. The method for previewing programs on a display screen according to claim 2, further comprising:
determining the ambient light brightness of the target display screen based on the real scene image before the virtual program image is acquired;
and rendering the virtual program image according to the brightness of the environment light to obtain the rendered virtual program image before the posture of the virtual program image is adjusted based on the current position information and the posture information to obtain the adjusted virtual program image.
4. The method for previewing a program on a display screen according to claim 1, wherein no mark pattern is displayed on said target display screen, and said obtaining a virtual program image comprises:
prompting a user to set a playing program in response to not recognizing the mark pattern in the area where the target display screen is located in the real scene image;
acquiring the playing program and sending the playing program to a server connected with the portable electronic terminal through a network so that the server generates the virtual program image according to the playing program;
receiving the virtual program image from the server.
5. The method for previewing programs on a display screen according to claim 4, further comprising: determining the ambient light brightness of the target display screen based on the real scene image before the virtual program image is acquired;
wherein the acquiring of the virtual program image includes:
prompting a user to set a playing program in response to not recognizing the mark pattern in the area where the target display screen is located in the real scene image;
acquiring the playing program, and sending the playing program and the ambient light brightness to a server connected with the portable electronic terminal through a network, so that the server generates the rendered virtual program image according to the playing program and the ambient light brightness;
receiving the virtual program image from the server.
6. A display screen program previewing device is applied to a portable electronic terminal and comprises the following components:
the first image acquisition module is used for acquiring a real scene image obtained by shooting;
the content identification module is used for carrying out content identification on the real scene image;
the information and area acquisition module is used for responding to the fact that the real scene image contains the target display screen, acquiring the current position information and the pose information of the portable electronic terminal and acquiring the area of the target display screen in the real scene image;
the second image acquisition module is used for acquiring a virtual program image;
and the target image display module is used for adjusting the posture of the virtual program image based on the current position information and the pose information to obtain an adjusted virtual program image, and superposing the adjusted virtual program image to the area of the target display screen in the real scene image to obtain a target image fusing the real scene image and the adjusted virtual program image for a user to watch.
7. The device for previewing programs played by a display screen according to claim 6, wherein the second image obtaining module is specifically configured to:
and in response to identifying the marker pattern in the area of the target display screen in the real scene image, acquiring the virtual program image corresponding to the marker pattern from a server connected to the portable electronic terminal through a network according to the marker pattern.
8. The apparatus for previewing programs on a display screen according to claim 7, further comprising:
the environment brightness obtaining module is used for determining the environment brightness of the target display screen based on the real scene image;
and the virtual program image rendering module is used for rendering the virtual program image according to the ambient light brightness to obtain the rendered virtual program image.
9. The device for previewing programs played by a display screen according to claim 6, wherein the second image obtaining module is specifically configured to:
prompting a user to set a playing program in response to not recognizing the mark pattern in the area where the target display screen is located in the real scene image;
acquiring the playing program and sending the playing program to a server connected to the portable electronic terminal through a network, so that the server generates the virtual program image according to the playing program;
receiving the virtual program image from the server.
10. The apparatus for previewing programs on a display screen according to claim 9, further comprising: the environment brightness obtaining module is used for determining the environment brightness of the target display screen based on the real scene image;
the second image acquisition module is specifically configured to:
prompting a user to set a playing program in response to not recognizing the mark pattern in the area where the target display screen is located in the real scene image;
acquiring the playing program, and sending the playing program and the ambient light brightness to a server connected with the portable electronic terminal through a network, so that the server generates the rendered virtual program image according to the playing program and the ambient light brightness;
receiving the virtual program image from the server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911160537.3A CN112837421B (en) | 2019-11-23 | Method and device for previewing play program of display screen |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911160537.3A CN112837421B (en) | 2019-11-23 | Method and device for previewing play program of display screen |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112837421A true CN112837421A (en) | 2021-05-25 |
| CN112837421B CN112837421B (en) | 2024-05-10 |
Family
ID=
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170316607A1 (en) * | 2016-04-28 | 2017-11-02 | Verizon Patent And Licensing Inc. | Methods and Systems for Minimizing Pixel Data Transmission in a Network-Based Virtual Reality Media Delivery Configuration |
| CN108520552A (en) * | 2018-03-26 | 2018-09-11 | 广东欧珀移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170316607A1 (en) * | 2016-04-28 | 2017-11-02 | Verizon Patent And Licensing Inc. | Methods and Systems for Minimizing Pixel Data Transmission in a Network-Based Virtual Reality Media Delivery Configuration |
| CN108520552A (en) * | 2018-03-26 | 2018-09-11 | 广东欧珀移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
Non-Patent Citations (1)
| Title |
|---|
| 王钊: "电视节目制作中的虚拟演播室技术", 内江师范学院学报, no. 04 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9728011B2 (en) | System and method for implementing augmented reality via three-dimensional painting | |
| CN110716646A (en) | Augmented reality data presentation method, device, equipment and storage medium | |
| CN107911621B (en) | Panoramic image shooting method, terminal equipment and storage medium | |
| US9392248B2 (en) | Dynamic POV composite 3D video system | |
| CN107993292B (en) | Augmented reality scene restoration method and device and computer readable storage medium | |
| US11880999B2 (en) | Personalized scene image processing method, apparatus and storage medium | |
| CN111937046A (en) | Mixed reality system, program, method, and portable terminal device | |
| JP7441926B2 (en) | Computer program that performs video coding | |
| CN110873963A (en) | Content display method and device, terminal equipment and content display system | |
| CN111311756A (en) | Augmented reality AR display method and related device | |
| CN110875944B (en) | Communication connection method, device, terminal equipment and wireless communication system | |
| CN109788359B (en) | Video data processing method and related device | |
| CN108961424B (en) | Virtual information processing method, device and storage medium | |
| CN110737326A (en) | Virtual object display method and device, terminal equipment and storage medium | |
| CN111899349B (en) | Model presentation method and device, electronic equipment and computer storage medium | |
| CN110618751B (en) | Virtual object display method and device, terminal equipment and storage medium | |
| KR102176805B1 (en) | System and method for providing virtual reality contents indicated view direction | |
| CN111833456A (en) | Image processing method, device, equipment and computer readable storage medium | |
| CN112837421A (en) | Method and device for previewing program played on display screen | |
| EP4290462A1 (en) | Three-dimensional imaging method, apparatus, and device, and storage medium | |
| CN112837421B (en) | Method and device for previewing play program of display screen | |
| CN114143588B (en) | Playing control method and electronic equipment | |
| CN110662113B (en) | Video playing method and device and computer readable storage medium | |
| US20240087157A1 (en) | Image processing method, recording medium, image processing apparatus, and image processing system | |
| CN118055201A (en) | Method and equipment for displaying special effect picture |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |