CN111866409A - Image selection processing apparatus and image selection processing system - Google Patents
Image selection processing apparatus and image selection processing system Download PDFInfo
- Publication number
- CN111866409A CN111866409A CN202010653110.3A CN202010653110A CN111866409A CN 111866409 A CN111866409 A CN 111866409A CN 202010653110 A CN202010653110 A CN 202010653110A CN 111866409 A CN111866409 A CN 111866409A
- Authority
- CN
- China
- Prior art keywords
- image
- module
- image selection
- images
- selection processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000004927 fusion Effects 0.000 claims description 54
- 230000005540 biological transmission Effects 0.000 claims description 15
- 238000007499 fusion processing Methods 0.000 claims description 9
- 238000004891 communication Methods 0.000 claims description 8
- 238000000605 extraction Methods 0.000 claims description 6
- 238000000034 method Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 230000000694 effects Effects 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 230000006835 compression Effects 0.000 description 5
- 238000007906 compression Methods 0.000 description 5
- 238000006243 chemical reaction Methods 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000001151 other effect Effects 0.000 description 1
- 238000005096 rolling process Methods 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000002087 whitening effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2624—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of whole input images, e.g. splitscreen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The application discloses an image selection processing apparatus and an image selection processing system. Wherein the image selection processing apparatus includes: the image selection processor is configured to acquire images transmitted through a plurality of channels, and the first USB interface is connected with the image selection processor and is configured to transmit the images transmitted by the image selection processor to an external terminal device, wherein the image selection processor comprises: an image selection module configured to select an image of at least one channel from images of a plurality of channels; and the image output module is configured to send the image of the at least one channel selected by the image selection module to the first USB interface.
Description
Technical Field
The present application relates to the field of image processing technologies, and in particular, to an image selection processing device and an image selection processing system.
Background
In the field of multi-station live broadcasting, in order to collect field pictures or capture wonderful and vivid pictures in all directions, not only multiple cameras are required to participate, but also a professional broadcasting guide station is required to switch the multi-station pictures, so that the cost is high and the delay is large. In addition, in order to present pictures with different angles or more hierarchical senses to a live broadcast user, the fusion of the pictures needs to be performed through a professional broadcasting guide station, but the fusion mode is easily influenced by the function of the broadcasting guide station, and the effects of multi-picture screen splicing, multi-picture-in-picture and the like are difficult to achieve.
Disclosure of Invention
The utility model provides an image selection processing equipment and image selection processing system to solve at least part or all that exist among the prior art not only need many cameras to participate in the live mode of the current many machine positions, still need professional direction broadcast platform to carry out the switching and/or the integration of many machine positions picture, with high costs, delay greatly and easily receive the influence of direction broadcast platform function, hardly accomplish the technical problem of effects such as many pictures piecing together the screen, many pictures picture-in-picture.
According to an aspect of an embodiment of the present disclosure, there is provided an image selection processing apparatus including: the image selection processor is configured to acquire images transmitted through a plurality of channels, and the first USB interface is connected with the image selection processor and is configured to transmit the images transmitted by the image selection processor to an external terminal device, wherein the image selection processor comprises: an image selection module configured to select an image of at least one channel from images of a plurality of channels; and the image output module is configured to send the image of the at least one channel selected by the image selection module to the first USB interface.
According to another aspect of an embodiment of the present disclosure, there is provided an image selection processing system including: the image selection processing device is connected with the plurality of image acquisition devices and the terminal device, and is configured to acquire images acquired by the plurality of image acquisition devices transmitted through a plurality of channels, select an image of at least one channel from the images of the plurality of channels, and send the image of the selected at least one channel to the terminal device.
In the embodiment of the invention, a chip-level framework can be designed in the image selection processor, so that the selection and switching of multi-channel images are realized, a professional broadcasting station is not needed, the cost is low, and the time delay is low. The image selection processor of a single chip is used for finishing the image processing of a plurality of image acquisition devices, thereby greatly reducing the cost. Moreover, by the image fusion module, the effects of image fusion (picture-in-picture, multi-picture screen splicing) and the like can be completed in the chip, a professional broadcasting station is not needed for fusing multi-position pictures, the software expansibility is good, and upgrading and iteration are facilitated. And the technical problems that in the existing multi-camera live broadcasting mode in the prior art, not only multiple cameras are needed to participate, but also a professional broadcasting guide station is needed to switch and/or fuse multi-camera pictures, the cost is high, the delay is large, the influence of the broadcasting guide station function is easy to cause, and the effects of multi-picture screen splicing, multi-picture-in-picture and the like are difficult to achieve are solved.
The above and other objects, advantages and features of the present application will become more apparent to those skilled in the art from the following detailed description of specific embodiments thereof, taken in conjunction with the accompanying drawings.
Drawings
Some specific embodiments of the present application will be described in detail hereinafter by way of illustration and not limitation with reference to the accompanying drawings. The same reference numbers in the drawings identify the same or similar elements or components. Those skilled in the art will appreciate that the drawings are not necessarily drawn to scale. In the drawings:
FIG. 1 is a schematic diagram of an image selection processing system according to an embodiment of the present disclosure;
FIG. 2 is a schematic diagram of an image fusion process performed by an image fusion module according to an embodiment of the disclosure;
FIG. 3 is yet another schematic diagram of an image fusion process performed by an image fusion module according to an embodiment of the present disclosure;
FIG. 4 is a schematic diagram of yet another configuration of an image selection processing system according to an embodiment of the present disclosure;
FIG. 5 is an interface schematic of an application according to an embodiment of the present disclosure;
FIG. 6 is a schematic diagram of yet another configuration of an image selection processing system according to an embodiment of the present disclosure; and
Fig. 7 is a schematic diagram of another structure of an image selection processing system according to an embodiment of the present disclosure.
Detailed Description
It should be noted that, in the present disclosure, the embodiments and features of the embodiments may be combined with each other without conflict. The present disclosure will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
In order to make the technical solutions of the present disclosure better understood by those skilled in the art, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only some embodiments of the present disclosure, not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments disclosed herein without making any creative effort, shall fall within the protection scope of the present disclosure.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the terms so used are interchangeable under appropriate circumstances for describing the embodiments of the disclosure herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
It is noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments according to the present application. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, and it should be understood that when the terms "comprises" and/or "comprising" are used in this specification, they specify the presence of stated features, steps, operations, devices, components, and/or combinations thereof, unless the context clearly indicates otherwise.
Examples
Fig. 1 is a schematic diagram of an image selection processing system 10 according to embodiment 1 of the present application. Referring to fig. 1, a first aspect of embodiment 1 of the present application provides an image selection processing apparatus 200, including an image selection processor 220 and a first USB interface 250 connected to the image selection processor 220, wherein the image selection processor 220 is configured to acquire images transmitted via a plurality of channels, and the first USB interface 250 is configured to transmit the images transmitted by the image selection processor 220 to an external terminal apparatus 300, and the image selection processor 220 includes: an image selection module 222 configured to select an image of at least one channel from the images of the plurality of channels; and an image output module 224 configured to transmit the image of the at least one channel selected by the image selection module 222 to the first USB interface 250.
As described in the background art, in the field of multi-station live broadcasting, in order to capture a live picture or capture a highlight and a vivid picture in all directions, not only multiple cameras are required to participate, but also a professional director is required to switch the multi-station pictures, which is high in cost and delay.
Specifically, with respect to the above-mentioned problem, referring to fig. 1, the image selection processing apparatus 200 provided in the first aspect of the present embodiment includes an image selection processor 220 and a first USB interface 250 connected to the image selection processor 220. Also, the image selection processor 220 acquires images transmitted via a plurality of channels. The image can be acquired by a plurality of image acquisition devices 100a to 100n, the image acquisition devices 100a to 100n are all connected with the image selection processor 220 through serial ports, and compared with a traditional camera which needs a processor arranged inside, the image acquisition devices 100a to 100n are small in size and flexible in placement position. Further, the image processing of the plurality of image capturing apparatuses 100a to 100N is completed by the image selection processor 220, and the overall cost is lower than that of N single cameras.
Further, the image selection processor 220 includes an image selection module 222 and an image output module 224. Wherein the image selection module 222 selects an image of at least one channel from the images of the plurality of channels. Therefore, the image selection module 222 can flexibly switch images without a professional broadcasting station, the cost is low, and the image selection and switching are completed in the image selection processor 220, so that the time delay is low. Finally, the image selection module 222 transmits the image of the selected at least one channel to the first USB interface 250, and the first USB interface 250 transmits the image of the selected at least one channel to the external terminal device 300. The terminal device 300 is, for example, a computer, which runs with a live client, and the first USB interface 250 is used to connect with an external terminal device 300, so that the terminal device does not need to be driven, the interface is widely used, and the seamless connection of the live client is completed. In addition, the first USB interface 250 may be a USB3.0 interface, the transmission speed of the USB3.0 interface is 5Gbps, multiple pictures can be output in a non-compression manner, the delay is lower, the picture quality is better, the expandability is good, and upgrading are facilitated.
Therefore, a chip-level architecture can be designed in the image selection processor 220, selection and switching of multi-channel images are realized, a professional broadcasting station is not needed, the cost is low, and the time delay is low. Moreover, the image selection processor 220 of a single chip is used for completing the image processing of the plurality of image acquisition devices 100a to 100n, thereby greatly reducing the cost. And the technical problems that in the existing multi-camera live broadcasting mode in the prior art, not only a plurality of cameras are needed to participate, but also a professional director is needed to switch multi-camera pictures, so that the cost is high and the delay is large are solved.
Optionally, the image selection processor 220 further includes an image fusion module 223 connected to the image selection module 222 and the image output module 224, where the image fusion module 223 is configured to perform fusion processing on the images of at least one channel, and transmit the fused images to the image output module 224.
Specifically, referring to fig. 1, the image selection processor 220 further includes an image fusion module 223 connected to the image selection module 222 and the image output module 224. The image fusion module 223 is configured to perform fusion processing on the images of at least one channel. For example, the image fusion module 223 may perform multi-screen or picture-in-picture fusion on the images of the multiple channels. Referring to fig. 2, the input image of the image fusion module 223 has 4 channels of images, and outputs a multi-screen-spliced image, that is, the 4 channels of images are displayed in a four-screen-spliced manner. Similarly, the image input to the image fusion module 223 may also be an image of 6 channels, and after performing multi-screen splicing, the image of the 6 channels is displayed in a six-screen-splicing manner. In addition, referring to fig. 3, the input image of the image fusion module 223 has 2 channels of images, and then performs picture-in-picture fusion on the 2 channels of images, and then outputs one picture-in-picture image. It should be noted that, in the present embodiment, the number of the plurality of channels may be 4 or 6, which is only shown by way of example, and the number of the plurality of channels is not particularly limited. In addition, the image fusion module 223 can also perform some common video image processing, such as character matting and the like.
Therefore, by the mode, the image fusion module 223 can complete the effects of image fusion (picture-in-picture fusion, multi-picture screen splicing) and the like in a chip, a professional broadcasting station is not needed for fusing multi-position pictures, the software expansibility is good, and upgrading and iteration are facilitated. And the technical problems that in the existing multi-machine-position live broadcasting mode in the prior art, a professional broadcasting guide station is needed to perform multi-machine-position picture fusion, the function of the broadcasting guide station is easily influenced, and the effects of multi-picture screen splicing, multi-picture-in-picture and the like are difficult to achieve are solved.
Optionally, the image selection processor 220 further comprises an image processing module 221 connected to the image selection module 222, the image processing module 221 being configured to process the acquired images transmitted via the plurality of channels.
Specifically, referring to fig. 1, the image selection processor 220 further includes an image processing module 221 connected to an image selection module 222. The image processing module 221 receives the images transmitted by the channels and pre-processes the images. For example, images transmitted via the respective channels are captured by a plurality of image capturing apparatuses 100a to 100n, which include a corresponding plurality of sensors 110a to 110n in the plurality of image capturing apparatuses 100a to 100 n. At this time, the image processing module 221(ISPImageSignalProcessor) needs to convert the signals received by the plurality of sensors 110a to 110n into image signals. Similarly, the image processing module 221 may perform a plurality of image enhancement processes such as resolution adjustment, image enhancement, filtering, skin beautifying, and whitening on the images transmitted by the plurality of channels. In addition, the image processing module 221 has an output corresponding to the number of channels, and sends the preprocessed image to the image selection module 222 via the corresponding output.
Optionally, as shown in fig. 1, the image selection processing apparatus 200 further includes a main control module 226, which is connected to the image processing module 221, the image selection module 222, the image fusion module 223, and the image output module 224, where the main control module 226 is configured to coordinate the image processing module 221, the image selection module 222, the image fusion module 223, and the image output module 224 to perform corresponding processing operations according to operation instructions related to images transmitted by multiple channels. In this way, the main control module 226 can coordinate different functional modules in the image selection processing device 200 according to the received operation instruction, thereby greatly improving the work efficiency of completing image processing, selection, switching and fusion in the chip.
Alternatively, as shown with reference to fig. 1, the image selection processing apparatus 200 further includes a memory 260 connected to the image selection processor 220, and the image selection processor 220 further includes a memory control module 225 connected to the image processing module 221, the image selection module 222, the image fusion module 223, the image output module 224, and the memory 260.
In a preferred embodiment, after the image processing module 221 receives the images transmitted by the channels, the received images transmitted by the channels may be transmitted to the memory control module 225, and the images may be stored in the memory 260 through the memory control module 225. After the image processing module 221 preprocesses the images of the respective channels, the preprocessed images of the plurality of channels may be transmitted to the memory control module 225, and the processed images may be stored in the memory 260 by the memory control module 225. Therefore, by storing the images transmitted by the channels and the processed images of the channels in the memory 260, the subsequent modules (e.g., the image selection module 222, the image fusion module 223, and the image output module 224) can dynamically acquire the images from the memory 260 according to the requirements.
In another preferred embodiment, the image selection module 222 reads the pre-processed images of the plurality of channels from the memory 260 through the memory control module 225, and selects an image of at least one channel from the read pre-processed images of the plurality of channels. Enabling the image selection module 222 to dynamically select images from the memory 260 as desired.
In another preferred embodiment, the image fusion module 223 reads the image of at least one channel from the memory 260 through the memory control module 225, performs fusion processing on the read image of at least one channel, and stores the fused image to the memory 260 through the memory control module 225. So that the image fusion module 223 can dynamically read the image of at least one channel from the memory 260 according to the requirement. Referring to fig. 2 and 3, the memory 260 stores or caches images of 6 channels, and the image fusion module 223 may dynamically acquire an image of at least one channel (for example, an image of 4 channels or an image of 2 channels) from the images of the 6 channels according to a requirement. Further, after the image fusion module 223 performs fusion processing on the read image, the image after fusion processing is stored in the memory 260 through the memory control module 225, so that the image output module 224 can dynamically acquire the image to be output from the memory 260 according to the requirement.
In another preferred embodiment, the image output module 224 reads the fusion-processed image from the memory 260 through the memory control module 225.
Optionally, the image selection processing device 200 further comprises an image display interface 230 connected to the image selection processor 220, the image display interface 230 being configured to transmit the image transmitted by the image selection processor 220 to an external image display device.
Specifically, as shown in fig. 1, the image display interface 230 may be an HDMI interface or/DP interface, and may be widely used without driving, and may transmit the image transmitted by the image selection processor 220 (e.g., the image of the at least one channel selected by the image selection module 222 or the fused image output by the image fusion module 223) to an external image display device. The external image display device is an HDMI interface device, such as a television, a display, and the like, and meets the real-time browsing requirement of the live client. In addition, the transmission speed of the HDMI is 5Gbps +, the fused image can be output in a non-compression mode, the time delay is lower, and the image quality is better.
Optionally, a network interface 240 connected to the image selection processor 220 is further included, and the network interface 240 is configured to receive operation instructions related to the images of the plurality of channels from the terminal device 300 and send the operation instructions to the image selection processor 220.
Specifically, referring to fig. 1, a user may send an operation instruction related to images of a plurality of channels to the network interface 240 through the terminal device 300, and the operation instruction is sent to the image selection processor 220 by the network interface 240. The operation instruction related to the images of the multiple channels is, for example, a channel selection instruction or an image fusion instruction. For example, in a case that the operation instruction related to the images of the multiple channels is a channel selection instruction, the image selection processor 220 selects, through the image selection module 222, an image of a corresponding channel from the channels corresponding to the output ends of the image processing module 221 according to the channel selection instruction received by the network interface 240, and masks the unselected channel (i.e., the output end corresponding to the channel no longer outputs the image). Specifically, the image selection module 222 dynamically selects an image from the memory 260 according to the channel selection instruction. The network interface 240 is, for example, a LAN/WiFi/3G/4G interface.
Optionally, the image selection processing device 200 further includes a network receiving module 227 and a text parsing module 228, where the network receiving module 227 is connected to the text parsing module 228, and configured to send, according to a word extraction request received from the terminal device 300, text information and text attribute information corresponding to the word extraction request to the text parsing module 228; and the text parsing module 228 is connected to the image fusion module 223, and configured to parse the text information and the text attribute information received from the network receiving module 227, and send the parsed text information and text attribute information to the image fusion module 223.
Referring to fig. 1, the image selection processing apparatus 200 further includes a network receiving module 227 and a text parsing module 228, wherein the network receiving module 227 is connected with the text parsing module 228. Specifically, the user may edit a word on the terminal device 300 according to the requirement, and then send a word request to the text parsing module 228 through the terminal device 300. The word extraction request comprises text information and text attribute information, the text information is text information of a word to be extracted by a user, and the text attribute information is information such as word extraction rolling speed, the position of a word extractor in a screen and the like. The text parsing module 228 sends the corresponding text information and text attribute information to the text parsing module 228 according to the received prompt request. The text analysis module 228 analyzes the received text information and text attribute information, and sends the analyzed text information and text attribute information to the image fusion module 223. The image fusion module 223 can output the fused image and text content according to the parsed text information and text attribute information. By the mode, the words are conveniently prompted to the anchor, labor is saved, and the anchor is enabled to be 'as usual in the propaganda department' by a word-prompting carousel method.
Optionally, the image selection processing device 200 further includes a remote controller receiving interface 270, and the image selection processor 220 further includes a quick binding module 229, where the quick binding module 229 is configured to generate a plurality of pieces of image scene information corresponding to a plurality of operation instructions related to images of a plurality of channels received from the terminal device 300, and bind the plurality of pieces of image scene information with a plurality of keys on the external remote controller 400 one by one; the remote controller receiving interface 270 is configured to receive trigger information that a user triggers a specific key from the remote controller 400, send the trigger information to the image selection processor 220, determine, by the image selection processor 220, target image scene information bound to the specific key according to the trigger information, and transmit the target image scene information to the terminal device 300 through the first USB interface 250.
Referring to fig. 6, the image selection processing apparatus 200 further includes a remote controller reception interface 270, and the image selection processor 220 further includes a shortcut binding module 229. Specifically, the user may perform image selection definition (e.g., single screen, multi-screen fusion, etc.) or function definition (e.g., background change, background music change, etc.) on the terminal device 300 according to the requirement. At this time, a plurality of operation instructions related to the images of the plurality of channels of the terminal device 300 are transmitted to the shortcut binding module 229. The plurality of operation instructions are, for example, the image selection instruction and/or the function instruction. The fast binding module 229 generates a plurality of corresponding image scene information according to the received plurality of operation instructions. One image scene information includes, for example, pip + specified background + specified music, and the other image scene information includes, for example, multi-picture + specified background + specified music, which is not specifically limited herein. Also, the image selection processing apparatus 200 is communicatively connected to the external remote controller 400, and the shortcut binding module 229 binds the plurality of pieces of image scene information to the plurality of keys on the external remote controller 400 one by one.
Further, when the user needs to switch the image scene quickly, the user may trigger a specific key (for example, key a) on the remote controller 400, at this time, the remote controller 400 sends trigger information of the user triggering the key a to the remote controller receiving interface 270, and the remote controller receiving interface 270 sends the trigger information to the image selection processor 220, so that the image selection processor 220 can determine target image scene information according to the trigger information and transmit the target image scene information to the terminal device 300 through the first USB interface 250. Therefore, through binding of the terminal equipment, a user (such as an anchor) can enter various specified image scenes by using a key shortcut, namely the user can select different image scenes by triggering different keys without carrying out complex operation on the terminal equipment, so that the labor is saved, the live broadcast effect is improved, and the purpose of quickly switching the image scenes is also realized.
Optionally, the image selection processing device 200 further includes a plurality of HDMI interfaces 280a, a. -, 280n and a plurality of second USB interfaces 290a, a. -, 290n, where the plurality of HDMI interfaces 280a, a. -, 280n are configured to receive HDMI signals acquired by the plurality of image acquisition devices 100a, a. -, 100n employing HDMI interfaces, and transmit the HDMI signals to the image selection module 221; and the second USB interfaces 290a, a. -, 290n are configured to receive USB signals acquired by the image acquisition devices 100a, a. -, 100n using the USB interfaces, and transmit the USB signals to the image selection module 221.
Referring to fig. 7, the image selection processing apparatus 200 further includes a plurality of HDMI interfaces 280a,. and 280n and a plurality of second USB interfaces 290a,. and 290 n. Specifically, the plurality of image capturing devices 100a, # and 100n using the HDMI interface may transmit the captured HDMI signal to the plurality of HDMI interfaces 280a, # and 280n, which are transmitted to the image selection module 221 by the plurality of HDMI interfaces 280a, # and 280 n. Furthermore, the plurality of image capturing devices 100a, # and 100n using USB interfaces may transmit the captured USB signals to the plurality of second USB interfaces 290a, # and 290n, which are transmitted to the image selection module 221 by the plurality of second USB interfaces 290a, # and 290 n. Among them, the plurality of image pickup apparatuses 100a, ·, 100n employing the HDMI interface are, for example, a plurality of HDMI cameras, and the plurality of image pickup apparatuses 100a, ·, 100n employing the USB interface are, for example, a plurality of USB cameras.
Further, the image processing module 221 includes an HDMIRx protocol conversion module and a USBRx protocol conversion module. Wherein the HDMIRx protocol conversion module is configured to convert HDMI signals received from the plurality of HDMI interfaces 280a,.. and 280n into image signals (RGB/YUV). The USBRx protocol conversion module is configured to convert USB signals received from the plurality of second USB interfaces 290 a. Further, the image processing module 221 can also decompress an image compression stream (H264/MJPEG or the like) supported by the USB camera into an image signal (RGB/YUV) for the USB camera input. Thus, in this way, a multi-channel fused image selection processing apparatus 200 is provided, and the following advantageous effects can be achieved: 1) the output of the notebook is perfectly combined with the acquisition of the USB camera conveniently, and the fusion of PPT and character acquisition in N notebooks is completed; 2) the USB camera and the HDMI camera are conveniently fused perfectly; 3) a USB output interface (corresponding to the first USB interface 250) is adopted externally, which is equivalent to a USB camera, and terminal software is convenient to dock; 4) the output is output by adopting an HDMI/DP interface (corresponding to the image display interface 230) so as to facilitate real-time viewing.
A second aspect of embodiment 1 of the present application provides an image selection processing system 10, including: the image selection processing device 200 comprises a plurality of image acquisition devices 100a, 100n and a terminal device 300, wherein the image selection processing device 200 is connected with the plurality of image acquisition devices 100a, 100n and the terminal device 300, and is configured to acquire images acquired by the plurality of image acquisition devices 100a, 100n transmitted through a plurality of channels, select an image of at least one channel from the images of the plurality of channels, and transmit the image of the selected at least one channel to the terminal device 300.
Referring to fig. 1, an image selection processing system 10 includes: a plurality of image capturing devices 100a, 100n for capturing images, the image selection processing device 200 according to the first aspect of the present embodiment, and the terminal device 300. Specifically, the plurality of image capturing apparatuses 100a to 100n capture images and transmit the captured images to the image selection processing apparatus 200 through a plurality of channels. The image selection processing device 200 acquires images acquired by the plurality of image acquisition devices 100a,.. or 100n transmitted via the plurality of channels, then selects an image of at least one channel from the images of the plurality of channels, and finally transmits the image of the selected at least one channel to the terminal device 300. Therefore, the selection and switching of the multi-channel images can be realized in the image selection processing equipment 200, a professional broadcasting station is not needed, the cost is low, and the time delay is low. Moreover, the image processing of the plurality of image capturing apparatuses 100a to 100n is completed using one image selection processing apparatus 200, which greatly reduces the cost. And the technical problems that in the existing multi-camera live broadcasting mode in the prior art, not only a plurality of cameras are needed to participate, but also a professional director is needed to switch multi-camera pictures, so that the cost is high and the delay is large are solved.
Optionally, the plurality of image capturing devices 100a, # 1., 100n include a plurality of sensors 110a, # 110., 110n for capturing signals and a plurality of serializers 120a, # 110., 120n corresponding to the plurality of sensors 110a, # 110n, wherein the plurality of serializers 120a, # 120n are configured to convert signals captured by the plurality of sensors 110a, # 110, 110n into serial signals and transmit the serial signals over a serial transmission cable, and the image selection processing device 200 further includes a plurality of deserializers 210a, # 210n corresponding to the plurality of serializers 120a, # 120n, wherein the plurality of deserializers 210a, # 210n are configured to receive serial signals transmitted by the plurality of serializers 120a, # 120n over the serial transmission cable, deserializing the serial signals, and transmits the deserialized signal to the image selection processor 220.
Specifically, referring to fig. 1, the plurality of image capturing devices 100a, ·, 100n include a plurality of sensors 110a, ·, 110n for capturing signals, so that the captured information is more comprehensive. Also, the plurality of image capturing apparatuses 100a, # and 100n further include a plurality of serializers 120a, # and 120n corresponding to the plurality of sensors 110a, # and 110n, and the signals captured by the respective sensors are converted into serial signals by the plurality of serializers 120a, # and 120n, and the serial signals are transmitted through a serial transmission cable. Meanwhile, the image selection processing device 200 further includes a plurality of deserializers 210a, ·, 210n corresponding to the plurality of serializers 120a, ·, 120n, deserializes the serial signals transmitted by the serial transmission cable through the plurality of deserializers 210a, ·, 210n, and transmits the deserialized signals to the image selection processor 220, so that the plurality of image acquisition devices 100a,. and.100 n can transmit the acquired image signals to the image selection processor 220 at long distances. Thus, in the case where a plurality of image capturing devices include a plurality of sensors and multiplex signal transmission is required, it can be realized that each sensor can transmit a signal to the image selection processor 220 over a long distance.
Optionally, the terminal device 300 includes an application 310 and a USB input interface 320 connected to the application 310, wherein the USB input interface 320 is connected to the first USB interface 250 of the image selection processing device 200, and is configured to receive the image transmission of the at least one channel selected by the image selection module 222 from the first USB interface 250, and transmit the image transmission of the selected at least one channel to the application 310; and application 310 is configured to display images transmitted by USB input interface 320.
Specifically, referring to fig. 4, the terminal device 300 is provided with an application 310, and the application 310 acquires an image transmitted by the image selection processing device 200 from the USB input interface 320 and displays the image transmitted by the USB input interface 320. Fig. 5 is a schematic diagram of an interface of an application 310 displayed by the terminal device 300, and referring to fig. 5, a channel display column is arranged on the right side of the interface, and 6 channel windows (channel 1 to channel 6) are arranged in the channel selection column and are used for displaying video images of the 6 channels. In addition, a video channel selection control (marked with numbers "1" to "6") is provided at the lower end of the main screen, so that a channel image displayed on the main screen can be selected from video images of 6 channels.
In addition, the following functions are also provided in the interface:
1) local video: the system is used for loading the local video on the main screen;
2) courseware: the courseware display device is used for displaying courseware on the main screen;
3) setting a picture: the screen modes for selecting the home screen include, for example: a single landscape (a channel image of one channel is displayed in a single landscape manner); picture-in-picture (images showing a plurality of videos in the form of picture-in-picture); two horizontal screens (channel images of two channels are displayed in a horizontal display mode); a four-split screen (channel images of 4 channels are displayed in a four-split screen manner); a six-pass screen (channel images of 6 channels are displayed in a six-pass screen manner).
Optionally, the terminal device 300 further includes a communication module 330 connected to the application 310, where the application 310 is configured to generate a corresponding operation instruction according to an operation input by a user and related to the images of the plurality of channels, and send the operation instruction to the communication module 330; and the communication module 330 is configured to receive an operation instruction from the application 310 and transmit the operation instruction to the network interface 240 of the image selection processing apparatus 200.
Specifically, referring to fig. 4, the terminal device 300 further includes a communication module 330 connected to the application 310. When the user needs to dynamically select and display an image of a designated channel from images of a plurality of channels as needed or to perform image fusion and then display the selected image, an operation related to the images of the plurality of channels is input to the application 310. The application 310 generates a corresponding operation instruction (for example, a channel selection instruction or an image fusion instruction) according to an operation input by the user and related to the images of the plurality of channels, and sends the operation instruction to the image selection processing apparatus 200 through the communication module 330, that is, sends the operation instruction to the network interface 240 of the image selection processing apparatus 200, so that the image selection processing apparatus 200 performs channel selection or image fusion according to the operation instruction.
Therefore, by the technical scheme, a chip-level framework can be designed in the image selection processor 220, the processing, switching and fusion of multi-channel images are realized, and the following beneficial effects are realized:
1) each image acquisition device 100 a-100N is connected with the image selection processing device 200 through a serial port, the camera is small in size and flexible in placement position, the multi-camera processing is completed by using the single-chip image selection processor 220, and the overall cost is lower than that of N single cameras.
2) The image switching is completed in the image selection processor 220, a professional broadcasting station is not needed, and the cost is low.
3) The image selection module 222 completes image selection, switching and low delay in the chip.
4) Through the image fusion module 223, image fusion (picture-in-picture, multi-picture and other effects) is completed in the chip, and the output is performed by adopting a USB interface, so that the driving is not required, the interface application is wide, N pictures can be output to the USB interface in various modes of image fusion, and the seamless connection of the live broadcast client is completed by butting to external terminal equipment 300, such as a host computer and the like. In addition, the USB3.0 interface can be used for outputting, the transmission speed of the USB3.0 interface is 5Gbps, multiple pictures can be output in a non-compression mode, the time delay is lower, the image quality is better, the expansibility is good, and upgrading and iteration are facilitated.
5) The HDMI interface is adopted for output, driving is not needed, the interface is widely applied, N pictures can be output to HDMI interface equipment, a television, a display and the like in various modes of image fusion, and the real-time browsing requirement of a live client is met. In addition, the transmission speed of the HDMI is 5Gbps +, multiple pictures can be output in a non-compression mode, delay is lower, and image quality is better.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
The relative arrangement of the components and steps, the numerical expressions, and numerical values set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise. Meanwhile, it should be understood that the sizes of the respective portions shown in the drawings are not drawn in an actual proportional relationship for the convenience of description. Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate. In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values. It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.
Spatially relative terms, such as "above … …," "above … …," "above … …," "above," and the like, may be used herein for ease of description to describe one device or feature's spatial relationship to another device or feature as illustrated in the figures. It will be understood that the spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. For example, if a device in the figures is turned over, devices described as "above" or "on" other devices or configurations would then be oriented "below" or "under" the other devices or configurations. Thus, the exemplary term "above … …" can include both an orientation of "above … …" and "below … …". (the device may also be oriented 90 degrees or at other orientations in different ways), and the spatially relative descriptors used herein interpreted accordingly.
In the description of the present disclosure, it is to be understood that the orientation or positional relationship indicated by the directional terms such as "front, rear, upper, lower, left, right", "lateral, vertical, horizontal" and "top, bottom", etc., are generally based on the orientation or positional relationship shown in the drawings, and are presented only for the convenience of describing and simplifying the disclosure, and in the absence of a contrary indication, these directional terms are not intended to indicate and imply that the device or element being referred to must have a particular orientation or be constructed and operated in a particular orientation, and therefore, should not be taken as limiting the scope of the disclosure; the terms "inner and outer" refer to the inner and outer relative to the profile of the respective component itself.
The above description is only for the preferred embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present application should be covered within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (18)
1. An image selection processing apparatus (200), characterized by comprising: an image selection processor (220) and a first USB interface (250) connected with the image selection processor (220), wherein the image selection processor (220) is configured to acquire images transmitted through a plurality of channels, the first USB interface (250) is configured to transmit the images transmitted by the image selection processor (220) to an external terminal device (300), and the image selection processor (220) comprises:
an image selection module (222) configured to select an image of at least one channel from the images of the plurality of channels; and
an image output module (224) configured to send an image of the at least one channel selected by the image selection module (222) to the first USB interface (250).
2. The image selection processing device (200) according to claim 1, wherein the image selection processor (220) further comprises an image fusion module (223) connected to the image selection module (222) and the image output module (224), the image fusion module (223) being configured to perform a fusion process on the images of the at least one channel and transmit the fused images to the image output module (224).
3. The image selection processing device (200) according to claim 2, wherein the image selection processor (220) further comprises an image processing module (221) connected to the image selection module (222), the image processing module (221) being configured for processing the acquired images transmitted via a plurality of channels.
4. The image selection processing device (200) according to claim 3, wherein the image selection processing device (200) further comprises a main control module (226) connected to the image processing module (221), the image selection module (222), the image fusion module (223), and the image output module (224), wherein the main control module (226) is configured to coordinate the image processing module (221), the image selection module (222), the image fusion module (223), and the image output module (224) to perform corresponding processing operations according to operation instructions related to the images transmitted by the plurality of channels.
5. The image selection processing apparatus (200) of claim 3, wherein the image selection processing apparatus (200) further comprises a memory (260) connected to the image selection processor (220), and wherein
The image selection processor (220) further comprises a memory control module (225) connected to the image processing module (221), the image selection module (222), the image fusion module (223), the image output module (224) and the memory (260).
6. The image selection processing apparatus (200) of claim 5, wherein the image processing module (221) stores the processed images of the plurality of channels to the memory (260) through the memory control module (225).
7. The image selection processing apparatus (200) according to claim 6, wherein the image selection module (222) reads the processed images of the plurality of channels from the memory (260) through the memory control module (225), and selects an image of at least one channel from the read processed images of the plurality of channels.
8. The image selection processing apparatus (200) according to claim 7, wherein the image fusion module (223) reads the image of at least one channel from the memory (260) through the memory control module (225), performs fusion processing on the read image of at least one channel, and stores the fused image to the memory (260) through the memory control module (225).
9. The image selection processing apparatus (200) according to claim 8, wherein the image output module (224) reads the fusion-processed image from the memory (260) through the memory control module (225).
10. The image selection processing device (200) according to claim 1, further comprising an image display interface (230) connected to the image selection processor (220), the image display interface (230) being configured to transmit the image transmitted by the image selection processor (220) to an external image display device.
11. The image selection processing device (200) according to claim 1, further comprising a network interface (240) connected to the image selection processor (220), the network interface (240) being configured to receive operation instructions related to the images of the plurality of channels from the terminal device (300) and to send the operation instructions to the image selection processor (220).
12. The image selection processing device (200) of claim 4, further comprising a network receiving module (227) and a text parsing module (228), wherein
The network receiving module (227) is connected with the text parsing module (228) and is configured to send text information and text attribute information corresponding to a word extraction request to the text parsing module (228) according to the word extraction request received from the terminal device (300); and
The text analysis module (228) is connected to the image fusion module (223), and is configured to analyze the text information and the text attribute information received from the network receiving module (227), and send the analyzed text information and the analyzed text attribute information to the image fusion module (223).
13. The image selection processing apparatus (200) of claim 4, wherein the image selection processing apparatus (200) further comprises a remote control reception interface (270) and the image selection processor (220) further comprises a shortcut binding module (229), wherein
The quick binding module (229) is configured to generate a plurality of pieces of corresponding image scene information according to a plurality of operation instructions related to the images of the plurality of channels received from the terminal device (300), and bind the plurality of pieces of image scene information with a plurality of keys on an external remote controller (400) one by one;
the remote controller receiving interface (270) is configured to receive trigger information of a user triggering a specified key from the remote controller (400), send the trigger information to the image selection processor (220), determine target image scene information bound with the specified key according to the trigger information through the image selection processor (220), and transmit the target image scene information to the terminal device (300) through the first USB interface (250).
14. The image selection processing device (200) according to claim 3, further comprising a plurality of HDMI interfaces (280a,.., 280n) and a plurality of second USB interfaces (290a,.., 290n), wherein
The plurality of HDMI interfaces (280a, 280 a. -, 280n) are configured to receive HDMI signals acquired by a plurality of image acquisition devices (100a, 100 a. -, 100n) employing HDMI interfaces, send the HDMI signals to the image processing module (221); and
the plurality of second USB interfaces (290a, a. -, 290n) are configured to receive USB signals acquired by a plurality of image acquisition devices (100a, a. -, 100n) employing USB interfaces, and to transmit the USB signals to the image processing module (221).
15. An image selection processing system (10), comprising: a plurality of image acquisition devices (100a, 100n) for acquiring images, an image selection processing device (200) according to any one of claims 1 to 10, and a terminal device (300), wherein
The image selection processing device (200) is connected with the plurality of image acquisition devices (100a,..., 100n) and the terminal device (300), and is configured to acquire images acquired by the plurality of image acquisition devices (100a,.., 100n) transmitted via a plurality of channels, select an image of at least one channel from the images of the plurality of channels, and transmit the image of the selected at least one channel to the terminal device (300).
16. The image selection processing system (10) according to claim 15, wherein the plurality of image acquisition devices (100a,..., 100n) include a plurality of sensors (110a,..., 110n) for acquiring signals and a plurality of serializers (120a,.., 120n) corresponding to the plurality of sensors (110a,.., 110n), wherein the plurality of serializers (120a,.., 120n) are configured to convert signals acquired by the plurality of sensors (110a,.., 110n) into serial signals and transmit the serial signals over a serial transmission cable, and wherein the plurality of serializers (120a,.., 120n) are configured to convert signals acquired by the plurality of sensors (110a,.., 110n) into serial signals and transmit the serial signals over a serial transmission cable, and wherein
The image selection processing device (200) further comprises a plurality of deserializers (210a,.., 210n) corresponding to the plurality of serializers (120a,.., 120n), wherein the plurality of deserializers (210a,.., 210n) are configured to receive serial signals transmitted by the plurality of serializers (120a,.., 120n) through a serial transmission cable, deserialize the serial signals, and transmit the deserialized signals to the image selection processor (220).
17. Image selection processing system (10) according to claim 16, characterized in that the terminal device (300) comprises a USB input interface (320) for an application (310) and for connecting with the application (310), wherein
The USB input interface (320) is connected with the first USB interface (250) of the image selection processing device (200), and is configured to receive the image transmission of at least one channel selected by the image selection module (222) from the first USB interface (250) and transmit the image transmission of the selected at least one channel to the application program (310); and
the application (310) is configured to display images transmitted by the USB input interface (320).
18. The image selection processing system (10) of claim 17, wherein the terminal device (300) further comprises a communication module (330) connected to the application (310), wherein
The application program (310) is configured to generate corresponding operation instructions according to the operation input by the user and related to the images of the plurality of channels, and send the operation instructions to the communication module (330); and
the communication module (330) is configured to receive the operation instruction from the application (310) and transmit the operation instruction to a network interface (240) of the image selection processing apparatus (200).
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2020105762261 | 2020-06-22 | ||
| CN202010576226 | 2020-06-22 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111866409A true CN111866409A (en) | 2020-10-30 |
Family
ID=73153263
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010653110.3A Pending CN111866409A (en) | 2020-06-22 | 2020-07-08 | Image selection processing apparatus and image selection processing system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111866409A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105208355A (en) * | 2015-10-21 | 2015-12-30 | 合肥华凌股份有限公司 | Refrigerator data acquisition method and system as well as refrigerator |
| CN105828201A (en) * | 2016-04-22 | 2016-08-03 | 北京小米移动软件有限公司 | Video processing method and device |
| CN108462839A (en) * | 2018-03-23 | 2018-08-28 | 中国人民解放军92941部队 | Instructor in broadcasting's control system and method |
| CN208094678U (en) * | 2018-05-03 | 2018-11-13 | 合肥芯福传感器技术有限公司 | A kind of polymorphic formula video camera |
| CN109246402A (en) * | 2018-08-20 | 2019-01-18 | 张越同 | A kind of multiple terminals input drawing optical projection system |
| CN209767716U (en) * | 2019-06-13 | 2019-12-10 | 北京都是科技有限公司 | Image acquisition system |
| CN110720206A (en) * | 2018-08-23 | 2020-01-21 | 深圳市大疆创新科技有限公司 | Data acquisition system, transmission conversion circuit and mobile platform |
| CN210274328U (en) * | 2019-08-30 | 2020-04-07 | 北京都是科技有限公司 | 3D image acquisition system, depth camera and image processing equipment |
| CN110996168A (en) * | 2019-10-21 | 2020-04-10 | 深圳银澎云计算有限公司 | Video terminal equipment and image synthesis method |
-
2020
- 2020-07-08 CN CN202010653110.3A patent/CN111866409A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105208355A (en) * | 2015-10-21 | 2015-12-30 | 合肥华凌股份有限公司 | Refrigerator data acquisition method and system as well as refrigerator |
| CN105828201A (en) * | 2016-04-22 | 2016-08-03 | 北京小米移动软件有限公司 | Video processing method and device |
| CN108462839A (en) * | 2018-03-23 | 2018-08-28 | 中国人民解放军92941部队 | Instructor in broadcasting's control system and method |
| CN208094678U (en) * | 2018-05-03 | 2018-11-13 | 合肥芯福传感器技术有限公司 | A kind of polymorphic formula video camera |
| CN109246402A (en) * | 2018-08-20 | 2019-01-18 | 张越同 | A kind of multiple terminals input drawing optical projection system |
| CN110720206A (en) * | 2018-08-23 | 2020-01-21 | 深圳市大疆创新科技有限公司 | Data acquisition system, transmission conversion circuit and mobile platform |
| CN209767716U (en) * | 2019-06-13 | 2019-12-10 | 北京都是科技有限公司 | Image acquisition system |
| CN210274328U (en) * | 2019-08-30 | 2020-04-07 | 北京都是科技有限公司 | 3D image acquisition system, depth camera and image processing equipment |
| CN110996168A (en) * | 2019-10-21 | 2020-04-10 | 深圳银澎云计算有限公司 | Video terminal equipment and image synthesis method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6493008B1 (en) | Multi-screen display system and method | |
| JP3490472B2 (en) | Architecture for transferring pixel streams | |
| KR20120051208A (en) | Method for gesture recognition using an object in multimedia device device and thereof | |
| CN108243318B (en) | Method and device for realizing live broadcast of multiple image acquisition devices through single interface | |
| CN205693774U (en) | Video guide's equipment | |
| CN106598213A (en) | Virtual reality device, and control method and system thereof | |
| CN106954088B (en) | Touch control method and touch control all-in-one machine | |
| EP4050889A1 (en) | Conference device with multi-videostream capability | |
| JPH11205711A (en) | Information display device | |
| CN106412617B (en) | Remote debugging control method and device | |
| CN108093211B (en) | Video preview method, device, server and computer readable storage medium | |
| JPH09233384A (en) | Image input device and image transmitter using it | |
| CN202218353U (en) | System capable of detecting and visually displaying port states of IPTV terminal | |
| JP5094583B2 (en) | Imaging apparatus, data communication system, and data communication method | |
| CN113452932A (en) | Display device and display method | |
| CN111866409A (en) | Image selection processing apparatus and image selection processing system | |
| CN215453147U (en) | Live broadcast equipment and live broadcast system | |
| KR101600865B1 (en) | Multi-channel hd/uhd image data routing switch system for being used in a studio and the method thereof | |
| CN102377957A (en) | Television capable of displaying multiple pictures | |
| CN105163055A (en) | Dynamic recording device, playback device, dynamic recording method and playback method | |
| CN113407289A (en) | Wallpaper switching method, wallpaper generation method, device and storage medium | |
| CN114339071A (en) | Image processing circuit, image processing method and electronic device | |
| US20070169160A1 (en) | Image display device and reservation recording method thereof | |
| JPH10304327A (en) | Data broadcast receiver and television receiver | |
| JP2000013713A (en) | Video signal processor and television receiver using the processor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201030 |