CN112312178B - Multimedia image processing system of multimedia exhibition room - Google Patents
Multimedia image processing system of multimedia exhibition room Download PDFInfo
- Publication number
- CN112312178B CN112312178B CN202010747118.6A CN202010747118A CN112312178B CN 112312178 B CN112312178 B CN 112312178B CN 202010747118 A CN202010747118 A CN 202010747118A CN 112312178 B CN112312178 B CN 112312178B
- Authority
- CN
- China
- Prior art keywords
- image data
- real object
- multimedia
- exhibition stand
- background image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
- H04N21/41415—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance involving a public display, viewable by several users in a public space outside their home, e.g. movie theatre, information kiosk
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/40—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
Abstract
The invention provides a multimedia image processing system of a multimedia exhibition hall, which relates to the field of multimedia image processing, and comprises a camera for acquiring image data of a real object exhibition stand; the multimedia computer is in communication connection with the camera and is used for receiving the image data of the real object exhibition stand and selecting background image data through background image model matching; and the multimedia processor is in communication connection with the multimedia computer and is used for receiving the real object exhibition stand image data and the background image data and fusing the image data of the real object exhibition stand image data and the background image data. According to the invention, the background image matched with the real object exhibition stand can be intelligently selected through the multimedia computer, so that the problem of inconsistent fusion of the background image and the real object exhibition stand object is avoided; and the multimedia processor performs image fusion after performing brightness comprehensive adjustment on the real object exhibition stand image data and the background image data, thereby reducing the problem of image fusion distortion.
Description
Technical Field
The present invention relates to the field of multimedia image processing, and more particularly, to a multimedia image processing system for a multimedia exhibition hall.
Background
The multimedia exhibition hall is the main direction of exhibition development of museums, science and technology museums, theme venues and the like. Not only the application of various leading-edge display technologies but also the technical means and equipment used, historical culture contents to be displayed and the overall exhibition form environment are considered and harmonious for the whole exhibition hall design. The combined application of media such as videos, audios, animations, pictures, characters and the like is needed, the background meaning contained in the exhibition object is deeply mined, the dynamic exhibition form which is difficult to achieve by common exhibition means, namely longitudinal deep dissection and transverse correlation expansion is realized, the coordination of vision, hearing and other senses and behaviors of audiences is promoted, and a brand-new visiting experience is created.
Then, when the existing multimedia video processing system fuses the exhibition display object and the background image, the problems of incoordination between the background image and the exhibition display object and distortion of image fusion exist.
Disclosure of Invention
In view of the above-mentioned shortcomings of the prior art, the present invention aims to provide a multimedia image processing system for a multimedia exhibition hall, which can intelligently select a background image matched with a real object exhibition stand through a multimedia computer, so that the problem of inconsistent fusion between the background image and the real object exhibition stand is avoided; and the multimedia processor performs image fusion after performing brightness comprehensive adjustment on the real object exhibition stand image data and the background image data, thereby reducing the problem of image fusion distortion.
The invention provides a multimedia image processing system of a multimedia exhibition hall, which comprises a camera for acquiring image data of a real object exhibition hall; the multimedia computer is in communication connection with the camera and is used for receiving the image data of the real object exhibition stand and selecting background image data through background image model matching; the multimedia processor is in communication connection with the multimedia computer and is used for receiving the real object exhibition stand image data and the background image data and fusing the real object exhibition stand image data and the background image data; and the display screen is in communication connection with the multimedia processor and is used for receiving and displaying the fused image data.
In an embodiment of the present invention, before performing background image data matching selection, the background image model needs to be trained, and a specific process is as follows:
(1.1) inputting the characteristic data of the pre-configured training set into a convolution layer of a neural network model for linear transformation;
(1.2) carrying out nonlinear transformation on the feature data after each convolution processing by using a RELU activation function of a neural network model;
(1.3) downsampling the characteristic data after each nonlinear change by using a Max Pooling layer of a neural network model;
and (1.4) outputting matched feature data by using a full connection layer of the neural network model to obtain a background image model.
In an embodiment of the present invention, the feature data of the training set includes shape, color, brightness, historical background description of the real object exhibition booth image data, and background images corresponding to the real object exhibition booth image data one to one.
In an embodiment of the present invention, the multimedia processor performs image data fusion on the real object exhibition booth image data and the background image data, and the specific process is as follows:
(2.1) receiving real-time real object exhibition stand image data and background image data, wherein the received real object exhibition stand image data and the received background image data respectively comprise a plurality of frames, and each frame comprises a plurality of pixels;
(2.2) converting the coding format of each pixel of the real object exhibition stand image data and the background image data into a color space format with a brightness component;
(2.2) counting the brightness grading conditions of all pixels in a plurality of continuous frames to generate a brightness grading statistical chart;
and (2.3) comprehensively adjusting the brightness according to the brightness grading statistical chart, and fusing image data of the real object display stand image data and background image data after the comprehensive adjustment of the brightness.
In an embodiment of the present invention, the system further includes a modulator and a demodulator, the modulator and the machine being electrically connected to the multimedia processor, respectively; and the modulator and the demodulator are used for respectively modulating and demodulating the real object exhibition stand image data received by the multimedia computer.
As described above, the multimedia image processing system of the multimedia exhibition hall of the present invention has the following advantages: according to the invention, the background image matched with the real object exhibition stand can be intelligently selected through the multimedia computer, so that the problem of inconsistent fusion of the background image and the real object exhibition stand object is avoided; and the multimedia processor performs image fusion after performing brightness comprehensive adjustment on the real object exhibition stand image data and the background image data, thereby reducing the problem of image fusion distortion.
Drawings
Fig. 1 is a block diagram of a multimedia image processing system according to an embodiment of the present invention.
Fig. 2 is a block diagram of a multimedia image processing system with a modulator and a demodulator according to an embodiment of the present invention.
Fig. 3 is a schematic diagram illustrating background image model training disclosed in the embodiment of the present invention.
Fig. 4 is a flowchart illustrating the operation of the multimedia image processing system according to the embodiment of the present invention.
Fig. 5 is a flowchart illustrating background image model training disclosed in the embodiment of the present invention.
FIG. 6 is a flow chart illustrating the operation of the multimedia processor disclosed in the embodiment of the present invention.
Detailed Description
The embodiments of the present invention are described below with reference to specific embodiments, and other advantages and effects of the present invention will be easily understood by those skilled in the art from the disclosure of the present specification. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.
It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention, and the components related to the present invention are only shown in the drawings rather than drawn according to the number, shape and size of the components in actual implementation, and the type, quantity and proportion of the components in actual implementation may be changed freely, and the layout of the components may be more complicated.
Referring to fig. 1, the present invention provides a multimedia image processing system for a multimedia exhibition hall, which includes a camera for collecting image data of a real object exhibition hall; the multimedia computer is in communication connection with the camera and is used for receiving the image data of the real object exhibition stand and selecting background image data through background image model matching; the multimedia processor is in communication connection with the multimedia computer and is used for receiving the real object exhibition stand image data and the background image data and fusing the real object exhibition stand image data and the background image data; the display screen is in communication connection with the multimedia processor and used for receiving and displaying the fused image data; referring to fig. 2, the system further includes a modulator and a demodulator, the modulator and the machine being electrically connected to the multimedia processor, respectively; and the modulator and the demodulator are used for respectively carrying out modulation processing and demodulation processing on the real object exhibition stand image data received by the multimedia computer.
Referring to fig. 3, before performing background image data matching selection, the background image model needs to be trained, and the specific process is as follows, referring to fig. 4:
(1.1) inputting the characteristic data of the pre-configured training set into a convolution layer of a neural network model for linear transformation;
(1.2) carrying out nonlinear transformation on the feature data after each convolution processing by using a RELU activation function of a neural network model;
(1.3) using a Max Pooling layer of a neural network model to carry out down-sampling on the feature data after each nonlinear change;
and (1.4) outputting matched feature data by using a full connection layer of the neural network model to obtain a background image model.
Specifically, the feature data of the training set includes shape, color, brightness, historical background description of the real object exhibition stand image data, and background images corresponding to the real object exhibition stand image data one to one.
Referring to fig. 5, the camera acquires the real-time image data of the real object exhibition stand, and sends the real object exhibition stand image data to the multimedia computer through the communication network, the modulator and the demodulator perform preliminary modulation and demodulation processing on the real object exhibition stand image data, and then the background image model trained in advance in the multimedia computer identifies the real object exhibition stand image data, and matches and selects the image background which is most harmonious with the colors of the style, the size, the color and the like of the real object exhibition stand; and the real object exhibition stand image data and the background data are sent to a multimedia processor through a communication network, the multimedia processor performs brightness comprehensive adjustment on the real object exhibition stand image data and the background data and then performs image fusion, and the image fusion data are transmitted to a display screen for displaying.
Referring to fig. 6, the multimedia processor performs image data fusion on the real object exhibition booth image data and the background image data, and the specific process is as follows:
(2.1) real-time receiving real object display table image data and background image data, wherein the received real object display table image data and the background image data respectively comprise a plurality of frames, and each frame comprises a plurality of pixels;
(2.2) converting the coding format of each pixel of the real object exhibition stand image data and the background image data into a color space format with a brightness component;
(2.2) counting the brightness grading conditions of all pixels in a plurality of continuous frames to generate a brightness grading statistical chart;
and (2.3) comprehensively adjusting the brightness according to the brightness grading statistical chart, and fusing image data of the real object exhibition stand image data and the background image data after the comprehensive adjustment of the brightness.
In conclusion, the background image matched with the real object exhibition stand can be intelligently selected through the multimedia computer, so that the problem that the background image and the real object exhibition stand are incompatible in object fusion is avoided; and the multimedia processor performs image fusion after performing brightness comprehensive adjustment on the real object exhibition stand image data and the background image data, thereby reducing the problem of image fusion distortion. Therefore, the invention effectively overcomes various defects in the prior art and has high industrial utilization value.
The foregoing embodiments are merely illustrative of the principles and utilities of the present invention and are not intended to limit the invention. Those skilled in the art can modify or change the above-described embodiments without departing from the spirit and scope of the present invention. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present invention.
Claims (5)
1. A multimedia image processing system of a multimedia exhibition room is characterized in that: the system comprises a camera for acquiring image data of a real object exhibition stand; the multimedia computer is in communication connection with the camera and is used for receiving the image data of the real object exhibition stand and selecting background image data matched with the display content on the real object exhibition stand through background image model matching; the multimedia processor is in communication connection with the multimedia computer and is used for receiving the real object exhibition stand image data and the background image data and fusing the real object exhibition stand image data and the background image data; and the display screen is in communication connection with the multimedia processor and is used for receiving and displaying the fused image data.
2. The system of claim 1, wherein the background image model requires model training before performing background image data matching selection, and the specific process is as follows:
(1.1) inputting the characteristic data of the pre-configured training set into a convolution layer of a neural network model for linear transformation;
(1.2) carrying out nonlinear transformation on the feature data after each convolution processing by using a RELU activation function of a neural network model;
(1.3) downsampling the characteristic data after each nonlinear change by using a Max Pooling layer of a neural network model;
and (1.4) outputting matched feature data by using a full connection layer of the neural network model to obtain a background image model.
3. The system of claim 2, wherein the system comprises: the feature data of the training set comprises the shape, the color, the brightness, the historical background description of the real object exhibition stand image data and background images which are in one-to-one correspondence with the real object exhibition stand image data.
4. The system of claim 1, wherein the multimedia processor performs image data fusion on the real object exhibition booth image data and the background image data by the following specific steps:
(2.1) receiving real-time real object exhibition stand image data and background image data, wherein the received real object exhibition stand image data and the received background image data respectively comprise a plurality of frames, and each frame comprises a plurality of pixels;
(2.2) converting the coding format of each pixel of the real object exhibition stand image data and the background image data into a color space format with a brightness component;
(2.3) counting the brightness grading conditions of all pixels in a plurality of continuous frames to generate a brightness grading statistical chart;
and (2.4) comprehensively adjusting the brightness according to the brightness grading statistical chart, and fusing image data of the real object exhibition stand image data and the background image data after the comprehensive adjustment of the brightness.
5. The system of claim 1, wherein the system comprises: the system also comprises a modulator and a demodulator, wherein the modulator and the demodulator are respectively electrically connected with the multimedia processor; and the modulator and the demodulator are used for respectively carrying out modulation processing and demodulation processing on the real object exhibition stand image data received by the multimedia computer.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010747118.6A CN112312178B (en) | 2020-07-29 | 2020-07-29 | Multimedia image processing system of multimedia exhibition room |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010747118.6A CN112312178B (en) | 2020-07-29 | 2020-07-29 | Multimedia image processing system of multimedia exhibition room |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112312178A CN112312178A (en) | 2021-02-02 |
| CN112312178B true CN112312178B (en) | 2022-08-30 |
Family
ID=74483336
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010747118.6A Active CN112312178B (en) | 2020-07-29 | 2020-07-29 | Multimedia image processing system of multimedia exhibition room |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112312178B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113269293B (en) * | 2021-05-21 | 2022-02-18 | 深圳市方圆展示制品有限公司 | Commodity display cabinet capable of on-line and off-line experience |
| CN117785995A (en) * | 2024-02-28 | 2024-03-29 | 江西方兴科技股份有限公司 | Data display method and system based on Internet of things screen |
Family Cites Families (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011210139A (en) * | 2010-03-30 | 2011-10-20 | Sony Corp | Image processing apparatus and method, and program |
| CN102999264A (en) * | 2012-11-09 | 2013-03-27 | Tcl通力电子（惠州）有限公司 | Method and device for automatically setting desktop background, and electronic equipment |
| CN103631069B (en) * | 2013-12-09 | 2016-06-22 | 牛强 | Multifunctional digital studio system |
| CN105303217B (en) * | 2015-10-13 | 2018-12-18 | 北京工业大学 | A kind of efficient implicit 2 D code system |
| CN105869198A (en) * | 2015-12-14 | 2016-08-17 | 乐视移动智能信息技术（北京）有限公司 | Multimedia photograph generating method, apparatus and device, and mobile phone |
| CN106019798A (en) * | 2016-07-12 | 2016-10-12 | 广州凡拓数字创意科技股份有限公司 | Holographic phantom imaging device |
| CN106686300A (en) * | 2016-11-30 | 2017-05-17 | 努比亚技术有限公司 | Picture shooting method and device |
| CN106409157B (en) * | 2016-12-12 | 2018-12-11 | 北京沃富瑞德文化传播有限公司 | A kind of magic display system can be used for magic show |
| WO2019047985A1 (en) * | 2017-09-11 | 2019-03-14 | Oppo广东移动通信有限公司 | Image processing method and device, electronic device, and computer-readable storage medium |
| CN107633228A (en) * | 2017-09-20 | 2018-01-26 | 北京奇虎科技有限公司 | Video data handling procedure and device, computing device |
| CN107743254A (en) * | 2017-10-25 | 2018-02-27 | 成都金麒麟云信息科技有限公司 | The multimedia image processing system of multi-media sharing hall |
| CN107957782A (en) * | 2017-12-18 | 2018-04-24 | 广东互动电子网络媒体有限公司 | A kind of museum's Interactive Experience system |
| CN110248207B (en) * | 2018-03-08 | 2021-03-16 | 株式会社理光 | Image reality display server, image reality display method, recording medium and image reality display system |
| CN110807126B (en) * | 2018-08-01 | 2023-05-26 | 腾讯科技（深圳）有限公司 | Method, device, storage medium and equipment for converting article into video |
| CN209846685U (en) * | 2019-04-08 | 2019-12-27 | 四川迪森沃克建筑装饰工程有限公司 | Exhibition stand for cultural exhibition |
| CN110334612A (en) * | 2019-06-19 | 2019-10-15 | 上海交通大学 | Electric inspection process image object detection method with self-learning capability |
| CN110941733B (en) * | 2019-10-15 | 2020-11-03 | 中国人民解放军海军大连舰艇学院 | Integrated interface information multiple fusion display method |
| CN110807107A (en) * | 2019-10-28 | 2020-02-18 | 广州奇川展览有限公司 | Exhibition hall theme one-key switching method and device |
-
2020
- 2020-07-29 CN CN202010747118.6A patent/CN112312178B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN112312178A (en) | 2021-02-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112312178B (en) | Multimedia image processing system of multimedia exhibition room | |
| US11450044B2 (en) | Creating and displaying multi-layered augemented reality | |
| CN103024266B (en) | Shooting optimization method, system and the device of mobile terminal | |
| US20080168512A1 (en) | System and Method to Implement Interactive Video Streaming | |
| JP2019067078A (en) | Image processing method and image processing program | |
| CN107465939B (en) | Method and device for processing video image data stream | |
| US11538136B2 (en) | System and method to process images of a video stream | |
| US20220312056A1 (en) | Rendering a modeled scene | |
| CN101179669A (en) | Session television terminal subtitling generating and stacking method | |
| WO2023193521A1 (en) | Video inpainting method, related apparatus, device and storage medium | |
| CN114240749A (en) | Image processing method, image processing device, computer equipment and storage medium | |
| CN105183269A (en) | Method for automatically identifying screen where cursor is located | |
| CN109194942B (en) | Naked eye 3D video playing method, terminal and server | |
| CN106878760B (en) | Draw and parse the method and device of present | |
| EP2765502A1 (en) | Method of providing a digitally represented visual instruction from a specialist to a user in need of said visual instruction, and a system therefore | |
| CN107580228B (en) | Monitoring video processing method, device and equipment | |
| CN106658107A (en) | Multi-path multi-mode image display method | |
| CN105808184A (en) | Method and device for displaying Android 2D (Two-dimensional) application image, and headset equipment | |
| CN114245027B (en) | Video data hybrid processing method, system, electronic equipment and storage medium | |
| CN110661880A (en) | Remote assistance method, system and storage medium | |
| CN114782250A (en) | Video image processing method and device, electronic equipment and storage medium | |
| CN115205752A (en) | Liquid crystal splicing LCD method and system based on intelligent display | |
| CN114723600A (en) | Method, device, equipment, storage medium and program product for generating cosmetic special effect | |
| CN112651801A (en) | Method and device for displaying house source information | |
| CN105278901A (en) | Remote management method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Room 801, No.26, Lane 168, Daduhe Road, Putuo District, Shanghai 200062 Applicant after: Shanghai hexu Culture & Tourism Group Co.,Ltd. Address before: 200433 room 3331, building 15, 36 Guohe Road, Yangpu District, Shanghai Applicant before: Shanghai genial Exhibition Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |