US20210176444A1 - Video conference panoramic image spreading method - Google Patents
Video conference panoramic image spreading method Download PDFInfo
- Publication number
- US20210176444A1 US20210176444A1 US16/782,236 US202016782236A US2021176444A1 US 20210176444 A1 US20210176444 A1 US 20210176444A1 US 202016782236 A US202016782236 A US 202016782236A US 2021176444 A1 US2021176444 A1 US 2021176444A1
- Authority
- US
- United States
- Prior art keywords
- panoramic
- image
- video conference
- dividing point
- picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/26—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
- G06V10/267—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion by performing operations on regions, e.g. growing, shrinking or watersheds
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
- H04N7/144—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display camera and display on the same optical axis, e.g. optically multiplexing the camera and display for eye to eye contact
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/157—Conference systems defining a virtual conference space and using avatars or agents
Definitions
- the present invention relates to a video conference panoramic image spreading method, and more particularly to a method that achieves avoiding, adjusting, stitching and spreading with dividing points acquired with bodily human features recognition as basis for two-dimensional panoramic picture spreading.
- a panoramic camera is widely used in indoor 360-degree conference panoramic photography and recording events.
- a panoramic camera having a fisheye lens assembly having multiple lenses may be used to acquire 360-degree panoramic conference pictures or images.
- the fisheye lens used in the conventional the panoramic camera may lead to image distortion of figures and inapplicability for human face recognition, and it often needs to carry out distortion correction, cutting and intercepting, and stitching to provide a two-dimensional panoramic picture.
- image distortion may not occur by using a regular panoramic camera lens that does not involve a fisheye lens, it is still necessary to carry out cutting, intercepting, and stitching of images in order to form a two-dimensional panoramic picture.
- the 360-degree panoramic conference pictures or images acquired with panoramic cameras having fisheye lens or having no fisheye lens both suffer the problem that a human face of a photographed subject is cut and divided during operations of cutting and intercepting and this eventually leads to a two-dimensional panoramic picture that is formed through stitching involving the human face of the photographed subject being split and arranged at two opposite sides. This is a challenge that must be overcome for spreading of a video conference panoramic image acquired with a panoramic camera.
- FIGS. 1 and 2 photographing made with a typical known fisheye lens based panoramic camera and cutting and stitching of a 360-degree panoramic conference picture or image are illustrated, in which to avoid intercepting, a reference object B is set up at a selected angular position of a conference table A, such as a 90-degree position (namely the 12-o'clock direction), so that a panoramic camera C set on the conference table A is provided with a reference point for cutting and stitching of a 360-degree panoramic conference picture or image.
- a reference object B is set up at a selected angular position of a conference table A, such as a 90-degree position (namely the 12-o'clock direction), so that a panoramic camera C set on the conference table A is provided with a reference point for cutting and stitching of a 360-degree panoramic conference picture or image.
- seats for the photographed subjects D 1 , D 2 , D 3 , D 4 must be particularly arranged in order to avoid a coverage arrangement in front of the reference object B, so that a user, when attempting to select and determine a starting point for cutting the 360-degree panoramic conference picture or image cut the starting point, may use the reference object B as the starting point for cutting of the 360-degree panoramic conference picture or image.
- Taiwan Patent No. 1549070 discloses a mobile device and a control method thereof, of which a purpose is using human face recognition applied to a panoramic image intercepted with a camera lens (an image acquisition unit 110 ) to control operations of a mobile device to enter sleeping and deactivating a screen or activating a screen.
- Taiwan Patent No. 1549070 discloses a mobile device and a control method thereof, of which a purpose is using human face recognition applied to a panoramic image intercepted with a camera lens (an image acquisition unit 110 ) to control operations of a mobile device to enter sleeping and deactivating a screen or activating a screen.
- Taiwan Patent No. 1549070 discloses a mobile device and a control method thereof, of which a purpose is using human face recognition applied to a panoramic image intercepted with a camera lens (an image acquisition unit 110 ) to control operations of a mobile device to enter sleeping and deactivating a screen or activating a screen.
- no solution was proposed for overcoming the issue of cutting and splitting
- Taiwan Patent No. 1633499 discloses a method for displaying a panoramic image and an electronic device thereof, in which displaying is made for illustrating human faces through human face recognition executed in a mobile phone and then through an operation of displaying of a specific one of the human faces, a response is made in a panoramic image displayed on an upper side.
- This is generally used for panoramic photography with a mobile phone and is not applicable to a general indoor video conference system.
- a panoramic image displayed with a viewer of the mobile phone is a continuous photographed image and is not a spread two-dimensional panoramic picture formed by processing a panoramic image or picture through intercepting and stitching as described above.
- the primary objective of the present invention is to provide a video conference panoramic image spreading method, which eliminates the problems and drawbacks of panoramic cameras discussed above or disclosed in the prior art patent documents that when they are used in applications of 360-degree indoor conference panoramic photography and recording in an operation of a two-dimensional panoramic picture through cutting, stitching and spreading of a 360-degree panoramic conference picture or image captured with the panoramic camera, the human faces or the human bodies of the photographed subjects who participate a conference may be cut and split and eventually a two-dimensional panoramic picture, which is formed through stitching, a human face or a human body of the photographed subjects may be split and arranged at two opposite sides.
- the present invention provides a video conference panoramic image spreading method, which comprises the following steps:
- Step (b) performing bodily human features recognition, in which conferee photographed subjects contained in the at least one primitive video conference panoramic picture or image that is photographed and captured and thus acquired by the panoramic camera in Step (a) is individually subjected to bodily human features recognition;
- Step (c) searching out a dividing point for two-dimensional picture spreading and defining the dividing point as a starting point for the two-dimensional panoramic image spreading, in which searching is performed in the primitive video conference panoramic picture or image in which the conferee photographed subjects have been subjected to bodily human features recognition in Step (b) to find a dividing point that does not lead to cutting or dividing of bodily human features of the conferee photographed subjects, and the dividing point is taken as the starting point for spreading a two-dimensional panoramic image;
- Step (d) intercepting desired image regions according to the dividing point, in which cutting and intercepting regions of the primitive video conference panoramic picture or image are performed according to the dividing point found in Step (c), wherein cutting and intercepting are carried out primarily based on a region of each of the conferee photographed subjects in the primitive video conference panoramic picture or image in order to acquire at least one quasi-panoramic image;
- Step (e) carrying out combining and stitching on the quasi-panoramic image by using the starting point for two-dimensional panoramic image spreading, in which the quasi-panoramic image intercepted in Step (d) is subjected to combining and stitching according to the starting point for two-dimensional panoramic image spreading, which is the dividing point of Step (c);
- Step (f) forming a two-dimensional panoramic picture, in which the quasi-panoramic image that has been subjected to combining and stitching in Step (e) forms a spread two-dimensional panoramic picture.
- the panoramic camera of Step (a) comprises a panoramic camera having a fisheye lens.
- the panoramic camera of Step (a) comprises a panoramic camera having multiple lenses.
- bodily human features recognition of Step (b) is applied as features recognition for at least one or a combination of at least two of human face, facial features, upper body contour, and dynamic face image of the conferee photographed subjects.
- an operation of searching out the dividing point for two-dimensional picture spreading and defining the dividing point as the starting point of the panoramic image carried out in Step (c) further comprises:
- Step (c1) randomly selecting a test dividing point, in which a test dividing point is randomly picked in the primitive video conference panoramic picture or image of which the conferee photographed subjects contained therein have been individually subjected to the bodily human features recognition in Step (b);
- Step (c2) identifying if the test dividing point cuts and divides bodily human features and carrying out Step (c21), if positive, and carrying out Step (c22), if negative, in which determination is made on whether bodily human features of any one of the conferee photographed subjects of Step (c1) is cut and divided by the test dividing point picked in Step (c1);
- Step (c21) moving the test dividing point, in which the test dividing point of Step (c1) is moved in a clockwise direction or a counterclockwise direction and repeating Step (c2);
- Step (c22) setting the test dividing point as the dividing point for two-dimensional picture spreading, in which a test dividing point that does not cut and divide, in Step (c2), the bodily human features of any one of the conferee photographed subjects of Step (c) is taken as the dividing point for spreading of the two-dimensional picture;
- Step (a)-Step (f) are provided as image processing software pre-loaded in the panoramic camera of Step (a).
- the panoramic camera of Step (a) is connected to at least one image processor, and Step (a)-Step (f) are provided as image processing software pre-loaded in the image processor.
- the panoramic camera of Step (a) is connected to at least one smart communication device, and Step (a)-Step (f) are provided as image processing software pre-loaded in the smart communication device.
- the smart communication device to which the panoramic camera of Step (a) is connected comprises a smart mobile phone.
- the smart communication device to which the panoramic camera of Step (a) is connected comprises a tablet computer.
- the panoramic camera of Step (a) is connected to at least one desk-top computer, and Step (a)-Step (f) are provided as image processing software pre-loaded in the desk-top computer.
- the panoramic camera of Step (a) is connected to at least one notebook computer, and Step (a)-Step (f) are provided as image processing software pre-loaded in the notebook computer.
- the efficacy of the video conference panoramic image spreading method is that through each step of the above-discussed Step (a)-(f), conferee photographed subjects contained in at least one primitive video conference panoramic picture or image that is photographed, captured, and thus acquired by a panoramic camera are subjected to bodily human features recognition in respect of human face, facial features, upper body contour, or dynamic face image and a processing result of bodily human features recognition is taken as a basis for selecting a dividing point and a starting point for carrying out cutting and spreading of the primitive video conference panoramic picture or image to form a two-dimensional panoramic picture and further, the dividing point is randomly movable, so that there is no need to set up a reference object as required by the prior art, and during the course of cutting, selection can be made based on the result of bodily human features recognition applied to each individual conferee photographed subject of the primitive video conference panoramic picture or image to achieve avoiding to thereby completely overcome the drawback or problem of the prior art that a human face or a human body of the conferee photographed
- the result of bodily human features recognition for each conferee photographed subject contained in the primitive video conference panoramic picture or image as proposed in the present invention may be later used in applications for instantaneous change, magnifying, locking, and tracking of image for at least one selected conferee photographed subject in the spread two-dimensional panoramic picture so as to further improve the industrial value and economic advantage of the present invention.
- FIG. 1 is a schematic view illustrating operation of a prior art video conference panoramic image spreading method
- FIG. 2 is a schematic view showing a prior art way of spreading a two-dimensional panoramic image for FIG. 1 ;
- FIG. 3 is a flowchart of a video conference panoramic image spreading method according to the present invention.
- FIG. 4 is a schematic view illustrating operation of cutting and intercepting of the video conference panoramic image spreading method according to a first embodiment of the present invention
- FIG. 5 is a schematic view showing spreading of a two-dimensional panoramic picture of the video conference panoramic image spreading method according to the first embodiment of the present invention
- FIG. 6 is a schematic view showing an operation of FIG. 3 for searching for a dividing point for spreading of the two-dimensional picture and defining the dividing point as a starting point for the panoramic image;
- FIG. 7 is a schematic view showing an operation of selecting the dividing point and cutting and intercepting in the video conference panoramic image spreading method according to the first embodiment of the present invention.
- FIG. 8 is an other schematic view showing the operation of selecting the dividing point and cutting and intercepting in the video conference panoramic image spreading method according to the first embodiment of the present invention.
- FIG. 9 is a schematic view showing a video conference panoramic image spreading method according to a second embodiment of the present invention.
- FIG. 10 is a schematic view showing a video conference panoramic image spreading method according to a third embodiment of the present invention.
- FIG. 11 is a schematic view showing a video conference panoramic image spreading method according to a fourth embodiment of the present invention.
- FIG. 12 is a schematic view showing a video conference panoramic image spreading method according to a fifth embodiment of the present invention.
- FIG. 13 is a schematic view showing a preferred way of application for the video conference panoramic image spreading method according to the present invention.
- FIG. 14 is a schematic view showing a spread two-dimensional panoramic picture in the application of FIG. 13 ;
- FIG. 15 is a schematic view showing another example of the spread two-dimensional panoramic picture of FIG. 14 .
- FIG. 3 is a flow chart of a video conference panoramic image spreading method according to the present invention, of which steps include Step 10 - 60 , wherein:
- FIG. 4 a primitive panoramic picture or image
- the panoramic camera 60 A being not limited to any specific type, a panoramic camera having fisheye lens being taken as an example of the present invention, a panoramic camera having multiple lenses being also considered falling in the scope of the present invention
- Step 10 performing bodily human features recognition, in which conferee photographed subjects 70 , 71 , 72 , 73 contained in the at least one primitive video conference panoramic picture or image that is photographed and captured and thus acquired by the panoramic camera 60 A in Step 10 is individually subjected to performance of bodily human features recognition, the bodily human features recognition being not limited any specific item, features recognition for at least one or a combination of at least two of human face, facial features, upper body contour, and dynamic face image of the conferee photographed subjects 70 , 71 , 72 , 73 being taken as an example of the present invention;
- Step 30 searching out a dividing point for two-dimensional picture spreading and defining the dividing point found as a starting point for the two-dimensional panoramic image spreading, in which searching is performed in the primitive video conference panoramic picture or image in which the conferee photographed subjects 70 , 71 , 72 , 73 have been subjected to bodily human features recognition in Step 20 to find a dividing point X (as shown in FIGS. 4 and 5 ) that does not lead to cutting or dividing of bodily human features of the conferee photographed subjects 70 , 71 , 72 , 73 and the dividing point X is taken as the starting point for spreading a two-dimensional panoramic image 100 (as shown in FIG. 5 );
- Step 50 forming a two-dimensional panoramic picture, in which the quasi-panoramic image P that has been subjected to combining and stitching in Step 50 forms a spread two-dimensional panoramic picture 100 .
- Step 10 - 60 of the flowchart of the video conference panoramic image spreading method according to the present invention is described by taking an example in which a single dividing point X is used as a starting point for a spread two-dimensional panoramic picture 100 corresponding to the at least one primitive video conference panoramic picture or image.
- the number and position selection of the dividing point X and combination operations for adhering and stitching are not limited thereto, and alternatively, multiple dividing points X at different positions may be selected as starting points for combining and stitching of the two-dimensional panoramic picture 100 , and steps of such a process may carried out according to Step 10 - 60 described above to similarly acquire a spread two-dimensional panoramic picture 100 according thereto.
- FIG. 6 is a flowchart illustrating an embodiment of an operation of Step ( 30 ) shown in FIG. 3 for searching out a dividing point for two-dimensional picture spreading and defining the dividing point as a starting point of a panoramic image, comprising Step 31 - 35 , wherein:
- test dividing point T (as shown in FIG. 7 ) randomly selecting a test dividing point, in which a test dividing point T (as shown in FIG. 7 ) is randomly picked in the primitive video conference panoramic picture or image of which the conferee photographed subjects 70 , 71 , 72 , 73 contained therein have been individually subjected to bodily human features recognition in Step 20 of FIG. 3 ;
- Step 32 identifying if the test dividing point cuts and divides bodily human features and carrying out Step 33 , if positive, and carrying out Step 34 , if negative, in which determination is made on whether bodily human features of any one of the conferee photographed subjects 70 , 71 , 72 , 73 of Step 31 is cut and divided by the test dividing point T picked in Step 31 ;
- Step 33 moving the test dividing point, in which the test dividing point T of Step 31 is moved in a clockwise direction or a counterclockwise direction, wherein the test dividing point T that is originally located at a 0-degree position being moved counterclockwise to a 45-degree position (as shown in FIGS. 7 and 8 ) is taken as an example for illustration of the present invention, and then repeating Step 32 ;
- Step ( 34 ) setting the test dividing point as the dividing point for two-dimensional picture spreading, in which a test dividing point T (as shown in FIG. 8 ) that does not cut and divide, in Step ( 32 ), the bodily human features of any one of the conferee photographed subjects of Step ( 31 ) is taken as the dividing point X for spreading of the two-dimensional picture, namely the dividing point X shown in FIG. 4 ; and
- Step ( 31 )-( 35 ) of the flowchart of the above-described embodiment for searching the dividing point for spreading the two-dimensional picture and defining the dividing point as the starting point of the panoramic image and the schematic views illustrating the operations of cutting corresponding thereto that are explained with reference to FIGS. 6-8 are provide as an example for easily expounding the technical contents and the features of the present invention, and are not intended to unduly constrain the scope of the present invention. It is appreciated that those operations and techniques that are equivalent to what described above are all considered falling in the scope of the present invention.
- Step 10 - 60 of the flowchart of the video conference panoramic image spreading method shown in FIG. 3 can be executed in any suitable measures and means, of which an example includes image processing software pre-loaded in the panoramic camera 60 A mentioned in Step 10 .
- FIG. 9 a second embodiment of the video conference panoramic image spreading method according to the present invention is shown, in which the panoramic camera 60 A of Step 10 is shown connected to at least one image processor 61 , and the software that executes Step 10 - 60 of FIG. 3 may be pre-loaded or stored in advance in the image processor 61 .
- a third embodiment of the video conference panoramic image spreading method according to the present invention is shown, in which the panoramic camera 60 A of Step 10 is shown connected to at least one smart communication device 62 , and the software that executes Step 10 - 60 of FIG. 3 may be pre-loaded or stored in advance in the smart communication device 62 .
- the smart communication device 62 is not limited to any specific type, and a smart mobile phone and a tablet computer are provided as examples in the present invention.
- FIG. 11 a fourth embodiment of the video conference panoramic image spreading method according to the present invention is shown, in which the panoramic camera 60 A of Step 10 is shown connected to at least one desk-top computer 63 , and the software that executes Step 10 - 60 of FIG. 3 may be pre-loaded or stored in advance in the desk-top computer 63 .
- FIG. 12 a fifth embodiment of the video conference panoramic image spreading method according to the present invention is shown, in which the panoramic camera 60 A of Step 10 is shown connected to at least one notebook computer 64 , and the software that executes Step 10 - 60 of FIG. 3 may be pre-loaded or stored in advance in the notebook computer 64 .
- FIGS. 13 and 14 an example of a preferred application of the video conference panoramic image spreading method is shown, in which the spread two-dimensional panoramic picture 100 with the four conferee photographed subjects 70 , 71 , 72 , 73 originally shown in FIGS. 4 and 5 is shown and, during the video conference, an additional, new conferee photographed subject 74 instantaneously joints the conference and intervenes between the conferee photographed subjects 71 and 72 .
- the video conference panoramic image spreading method described as Step 10 - 60 may be similarly applied to subject the conferee photographed subjects 70 , 71 , 74 , 72 , 73 to bodily human features recognition and the same process of for re-selection of a new dividing point X′ (as shown in FIG. 13 ) and re-combination through adhering and stitching is carried out to provide a refreshed, updated result of a spread two-dimensional panoramic picture 100 ′ (as shown in FIG. 14 ) in which the conferee photographed subjects 70 , 71 , 74 , 72 , 73 are included.
- FIG. 15 which provides an example of application of the video conference panoramic image spreading method for displaying the spread two-dimensional panoramic picture 100 ′ in an alternative way
- at least one of the conferee photographed subjects 70 , 71 , 74 , 72 , or 73 may be selected for instantaneously magnifying, locking, and tracking for image displaying.
- the conferee photographed subjects 71 , 72 , 73 are selected as target subjects for instantaneously magnifying, locking, and tracking and three magnified, locked, and tracked images 711 , 721 , and 731 of the target subjects are displayed on a lower side of the two-dimensional panoramic picture 100 ′ to provide an instantaneous effect of magnifying, locking, and tracking to a video conference monitoring unit or a conference speech recording unit.
- FIGS. 3-15 provide a video conference panoramic image spreading method according to the present invention, and the description and drawings related thereto as disclosed herein are provided for the purposes of being an example for easy explanation of the technical contents and features of the present invention and are not intended to unduly constrain the scope of the present invention. Further, any equivalent substitute and modification of the steps and the operations performed in the present invention as described herein are considered belonging to the spirit and scope of the present invention, which will be solely defined with the appended claims.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Studio Devices (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
Description
- The present invention relates to a video conference panoramic image spreading method, and more particularly to a method that achieves avoiding, adjusting, stitching and spreading with dividing points acquired with bodily human features recognition as basis for two-dimensional panoramic picture spreading.
- Heretofore, a panoramic camera is widely used in indoor 360-degree conference panoramic photography and recording events. For example, a panoramic camera having a fisheye lens assembly having multiple lenses may be used to acquire 360-degree panoramic conference pictures or images. However, the fisheye lens used in the conventional the panoramic camera may lead to image distortion of figures and inapplicability for human face recognition, and it often needs to carry out distortion correction, cutting and intercepting, and stitching to provide a two-dimensional panoramic picture. Although image distortion may not occur by using a regular panoramic camera lens that does not involve a fisheye lens, it is still necessary to carry out cutting, intercepting, and stitching of images in order to form a two-dimensional panoramic picture. The 360-degree panoramic conference pictures or images acquired with panoramic cameras having fisheye lens or having no fisheye lens both suffer the problem that a human face of a photographed subject is cut and divided during operations of cutting and intercepting and this eventually leads to a two-dimensional panoramic picture that is formed through stitching involving the human face of the photographed subject being split and arranged at two opposite sides. This is a challenge that must be overcome for spreading of a video conference panoramic image acquired with a panoramic camera.
- As shown in
FIGS. 1 and 2 , photographing made with a typical known fisheye lens based panoramic camera and cutting and stitching of a 360-degree panoramic conference picture or image are illustrated, in which to avoid intercepting, a reference object B is set up at a selected angular position of a conference table A, such as a 90-degree position (namely the 12-o'clock direction), so that a panoramic camera C set on the conference table A is provided with a reference point for cutting and stitching of a 360-degree panoramic conference picture or image. In order for photographed subjects D1, D2, D3, D4 that participate a video conference to avoid a human face of any one of the photographed subjects D1, D2, D3, D4 being cut and split during cutting and stitching of the 360-degree panoramic conference picture or image, seats for the photographed subjects D1, D2, D3, D4 must be particularly arranged in order to avoid a coverage arrangement in front of the reference object B, so that a user, when attempting to select and determine a starting point for cutting the 360-degree panoramic conference picture or image cut the starting point, may use the reference object B as the starting point for cutting of the 360-degree panoramic conference picture or image. This, however, requires at least one lens or one side of the panoramic camera C in alignment with the reference object B, and this imposes significant limitation to the installation and range of application of the panoramic camera C. However, locations and quantity of the seats for the photographed subjects D1, D2, D3, D4 are also subjected to unnecessary constraints, making it no industrial value and economic advantages. - Further, prior art patent documents are known, such as Taiwan Patent No. 1549070, which discloses a mobile device and a control method thereof, of which a purpose is using human face recognition applied to a panoramic image intercepted with a camera lens (an image acquisition unit 110) to control operations of a mobile device to enter sleeping and deactivating a screen or activating a screen. Similar to what described above, no solution was proposed for overcoming the issue of cutting and splitting a human face or a human body of a photographed subject during the operations of cutting of a 360-degree panoramic conference picture or image and thus, a final two-dimensional panoramic picture that is formed through stitching may suffer the undesired situation that the human face of one photographed subject is split and arranged at two opposite sides.
- Further, Taiwan Patent No. 1633499 discloses a method for displaying a panoramic image and an electronic device thereof, in which displaying is made for illustrating human faces through human face recognition executed in a mobile phone and then through an operation of displaying of a specific one of the human faces, a response is made in a panoramic image displayed on an upper side. This is generally used for panoramic photography with a mobile phone and is not applicable to a general indoor video conference system. Further, a panoramic image displayed with a viewer of the mobile phone is a continuous photographed image and is not a spread two-dimensional panoramic picture formed by processing a panoramic image or picture through intercepting and stitching as described above. In other words, such a known technique is not applicable to processing of cutting and stitching a panoramic image of an indoor conference and there is also no solution to handle the above-discussed problem that a human face or a human body of a photographed subject is cut and split during the operations of cutting and stitching of a panoramic image, and would thus be no industrial value and economic advantage.
- The primary objective of the present invention is to provide a video conference panoramic image spreading method, which eliminates the problems and drawbacks of panoramic cameras discussed above or disclosed in the prior art patent documents that when they are used in applications of 360-degree indoor conference panoramic photography and recording in an operation of a two-dimensional panoramic picture through cutting, stitching and spreading of a 360-degree panoramic conference picture or image captured with the panoramic camera, the human faces or the human bodies of the photographed subjects who participate a conference may be cut and split and eventually a two-dimensional panoramic picture, which is formed through stitching, a human face or a human body of the photographed subjects may be split and arranged at two opposite sides.
- Thus, the present invention provides a video conference panoramic image spreading method, which comprises the following steps:
- (a) acquiring a primitive panoramic picture or image, in which at least one panoramic camera is used to photograph and capture and thus acquire at least one primitive video conference panoramic picture or image;
- (b) performing bodily human features recognition, in which conferee photographed subjects contained in the at least one primitive video conference panoramic picture or image that is photographed and captured and thus acquired by the panoramic camera in Step (a) is individually subjected to bodily human features recognition;
- (c) searching out a dividing point for two-dimensional picture spreading and defining the dividing point as a starting point for the two-dimensional panoramic image spreading, in which searching is performed in the primitive video conference panoramic picture or image in which the conferee photographed subjects have been subjected to bodily human features recognition in Step (b) to find a dividing point that does not lead to cutting or dividing of bodily human features of the conferee photographed subjects, and the dividing point is taken as the starting point for spreading a two-dimensional panoramic image;
- (d) intercepting desired image regions according to the dividing point, in which cutting and intercepting regions of the primitive video conference panoramic picture or image are performed according to the dividing point found in Step (c), wherein cutting and intercepting are carried out primarily based on a region of each of the conferee photographed subjects in the primitive video conference panoramic picture or image in order to acquire at least one quasi-panoramic image;
- (e) carrying out combining and stitching on the quasi-panoramic image by using the starting point for two-dimensional panoramic image spreading, in which the quasi-panoramic image intercepted in Step (d) is subjected to combining and stitching according to the starting point for two-dimensional panoramic image spreading, which is the dividing point of Step (c); and
- (f) forming a two-dimensional panoramic picture, in which the quasi-panoramic image that has been subjected to combining and stitching in Step (e) forms a spread two-dimensional panoramic picture.
- Further, in the video conference panoramic image spreading method according to the present invention, the panoramic camera of Step (a) comprises a panoramic camera having a fisheye lens.
- In the above-described video conference panoramic image spreading method according to the present invention, the panoramic camera of Step (a) comprises a panoramic camera having multiple lenses.
- In the above-described video conference panoramic image spreading method according to the present invention, bodily human features recognition of Step (b) is applied as features recognition for at least one or a combination of at least two of human face, facial features, upper body contour, and dynamic face image of the conferee photographed subjects.
- In the above-described video conference panoramic image spreading method according to the present invention, an operation of searching out the dividing point for two-dimensional picture spreading and defining the dividing point as the starting point of the panoramic image carried out in Step (c) further comprises:
- (c1) randomly selecting a test dividing point, in which a test dividing point is randomly picked in the primitive video conference panoramic picture or image of which the conferee photographed subjects contained therein have been individually subjected to the bodily human features recognition in Step (b);
- (c2) identifying if the test dividing point cuts and divides bodily human features and carrying out Step (c21), if positive, and carrying out Step (c22), if negative, in which determination is made on whether bodily human features of any one of the conferee photographed subjects of Step (c1) is cut and divided by the test dividing point picked in Step (c1);
- (c21) moving the test dividing point, in which the test dividing point of Step (c1) is moved in a clockwise direction or a counterclockwise direction and repeating Step (c2);
- (c22) setting the test dividing point as the dividing point for two-dimensional picture spreading, in which a test dividing point that does not cut and divide, in Step (c2), the bodily human features of any one of the conferee photographed subjects of Step (c) is taken as the dividing point for spreading of the two-dimensional picture; and
- (c3) ending.
- In the above-described video conference panoramic image spreading method according to the present invention, Step (a)-Step (f) are provided as image processing software pre-loaded in the panoramic camera of Step (a).
- In the above-described video conference panoramic image spreading method according to the present invention, the panoramic camera of Step (a) is connected to at least one image processor, and Step (a)-Step (f) are provided as image processing software pre-loaded in the image processor.
- In the above-described video conference panoramic image spreading method according to the present invention, the panoramic camera of Step (a) is connected to at least one smart communication device, and Step (a)-Step (f) are provided as image processing software pre-loaded in the smart communication device.
- In the above-described video conference panoramic image spreading method according to the present invention, the smart communication device to which the panoramic camera of Step (a) is connected comprises a smart mobile phone.
- In the above-described video conference panoramic image spreading method according to the present invention, the smart communication device to which the panoramic camera of Step (a) is connected comprises a tablet computer.
- In the above-described video conference panoramic image spreading method according to the present invention, the panoramic camera of Step (a) is connected to at least one desk-top computer, and Step (a)-Step (f) are provided as image processing software pre-loaded in the desk-top computer.
- In the above-described video conference panoramic image spreading method according to the present invention, the panoramic camera of Step (a) is connected to at least one notebook computer, and Step (a)-Step (f) are provided as image processing software pre-loaded in the notebook computer.
- The efficacy of the video conference panoramic image spreading method according to the present invention is that through each step of the above-discussed Step (a)-(f), conferee photographed subjects contained in at least one primitive video conference panoramic picture or image that is photographed, captured, and thus acquired by a panoramic camera are subjected to bodily human features recognition in respect of human face, facial features, upper body contour, or dynamic face image and a processing result of bodily human features recognition is taken as a basis for selecting a dividing point and a starting point for carrying out cutting and spreading of the primitive video conference panoramic picture or image to form a two-dimensional panoramic picture and further, the dividing point is randomly movable, so that there is no need to set up a reference object as required by the prior art, and during the course of cutting, selection can be made based on the result of bodily human features recognition applied to each individual conferee photographed subject of the primitive video conference panoramic picture or image to achieve avoiding to thereby completely overcome the drawback or problem of the prior art that a human face or a human body of the conferee photographed subjects contained in a 360-degree panoramic conference picture or image is cut and split during an operation of cutting and eventually leading to the human face or the human body of the conferee photographed subjects that has been cut is split and arranged at two opposite sides of a two-dimensional panoramic picture that is formed through stitching, without adding any instrument and cost. Further, the result of bodily human features recognition for each conferee photographed subject contained in the primitive video conference panoramic picture or image as proposed in the present invention may be later used in applications for instantaneous change, magnifying, locking, and tracking of image for at least one selected conferee photographed subject in the spread two-dimensional panoramic picture so as to further improve the industrial value and economic advantage of the present invention.
-
FIG. 1 is a schematic view illustrating operation of a prior art video conference panoramic image spreading method; -
FIG. 2 is a schematic view showing a prior art way of spreading a two-dimensional panoramic image forFIG. 1 ; -
FIG. 3 is a flowchart of a video conference panoramic image spreading method according to the present invention; -
FIG. 4 is a schematic view illustrating operation of cutting and intercepting of the video conference panoramic image spreading method according to a first embodiment of the present invention; -
FIG. 5 is a schematic view showing spreading of a two-dimensional panoramic picture of the video conference panoramic image spreading method according to the first embodiment of the present invention; -
FIG. 6 is a schematic view showing an operation ofFIG. 3 for searching for a dividing point for spreading of the two-dimensional picture and defining the dividing point as a starting point for the panoramic image; -
FIG. 7 is a schematic view showing an operation of selecting the dividing point and cutting and intercepting in the video conference panoramic image spreading method according to the first embodiment of the present invention; -
FIG. 8 is an other schematic view showing the operation of selecting the dividing point and cutting and intercepting in the video conference panoramic image spreading method according to the first embodiment of the present invention; -
FIG. 9 is a schematic view showing a video conference panoramic image spreading method according to a second embodiment of the present invention; -
FIG. 10 is a schematic view showing a video conference panoramic image spreading method according to a third embodiment of the present invention; -
FIG. 11 is a schematic view showing a video conference panoramic image spreading method according to a fourth embodiment of the present invention; -
FIG. 12 is a schematic view showing a video conference panoramic image spreading method according to a fifth embodiment of the present invention; -
FIG. 13 is a schematic view showing a preferred way of application for the video conference panoramic image spreading method according to the present invention; -
FIG. 14 is a schematic view showing a spread two-dimensional panoramic picture in the application ofFIG. 13 ; and -
FIG. 15 is a schematic view showing another example of the spread two-dimensional panoramic picture ofFIG. 14 . - Referring to illustrations of
FIGS. 3, 4, and 5 ,FIG. 3 is a flow chart of a video conference panoramic image spreading method according to the present invention, of which steps include Step 10-60, wherein: - (10) acquiring a primitive panoramic picture or image, in which at least one
panoramic camera 60A (as shown inFIG. 4 ) is used to photograph and capture, and thus acquire at least one primitive video conference panoramic picture or image, thepanoramic camera 60A being not limited to any specific type, a panoramic camera having fisheye lens being taken as an example of the present invention, a panoramic camera having multiple lenses being also considered falling in the scope of the present invention; - (20) performing bodily human features recognition, in which conferee photographed
subjects panoramic camera 60A inStep 10 is individually subjected to performance of bodily human features recognition, the bodily human features recognition being not limited any specific item, features recognition for at least one or a combination of at least two of human face, facial features, upper body contour, and dynamic face image of the conferee photographedsubjects - (30) searching out a dividing point for two-dimensional picture spreading and defining the dividing point found as a starting point for the two-dimensional panoramic image spreading, in which searching is performed in the primitive video conference panoramic picture or image in which the conferee photographed
subjects Step 20 to find a dividing point X (as shown inFIGS. 4 and 5 ) that does not lead to cutting or dividing of bodily human features of the conferee photographedsubjects FIG. 5 ); - (40) intercepting desired image regions according to the dividing point, in which cutting and intercepting regions of the primitive video conference panoramic picture or image are performed according to the dividing point X found in
Step 30, wherein cutting and intercepting are carried out primarily based on a region of each of the conferee photographed subjects in the primitive video conference panoramic picture or image in order to acquire at least one quasi-panoramic image P (as shown in the lower part ofFIG. 4 ), wherein the quasi-panoramic image P is not a picture that will be finally displayed and is a virtual picture; and - (50) carrying out combining and stitching on the quasi-panoramic image by using the starting point for two-dimensional panoramic image spreading, in which the quasi-panoramic image P intercepted in
Step 40 is subjected to combining and stitching according to the starting point for two-dimensional panoramic image spreading, which is the dividing point X ofStep 30, namely cutting is made at a location between the conferee photographedsubjects subjects - (60) forming a two-dimensional panoramic picture, in which the quasi-panoramic image P that has been subjected to combining and stitching in
Step 50 forms a spread two-dimensionalpanoramic picture 100. - The above-described Step 10-60 of the flowchart of the video conference panoramic image spreading method according to the present invention is described by taking an example in which a single dividing point X is used as a starting point for a spread two-dimensional
panoramic picture 100 corresponding to the at least one primitive video conference panoramic picture or image. The number and position selection of the dividing point X and combination operations for adhering and stitching are not limited thereto, and alternatively, multiple dividing points X at different positions may be selected as starting points for combining and stitching of the two-dimensionalpanoramic picture 100, and steps of such a process may carried out according to Step 10-60 described above to similarly acquire a spread two-dimensionalpanoramic picture 100 according thereto. - Further referring to illustrations of
FIGS. 6 and 7 ,FIG. 6 is a flowchart illustrating an embodiment of an operation of Step (30) shown inFIG. 3 for searching out a dividing point for two-dimensional picture spreading and defining the dividing point as a starting point of a panoramic image, comprising Step 31-35, wherein: - (31) randomly selecting a test dividing point, in which a test dividing point T (as shown in
FIG. 7 ) is randomly picked in the primitive video conference panoramic picture or image of which the conferee photographedsubjects Step 20 ofFIG. 3 ; - (32) identifying if the test dividing point cuts and divides bodily human features and carrying out
Step 33, if positive, and carrying outStep 34, if negative, in which determination is made on whether bodily human features of any one of the conferee photographedsubjects Step 31 is cut and divided by the test dividing point T picked inStep 31; - (33) moving the test dividing point, in which the test dividing point T of
Step 31 is moved in a clockwise direction or a counterclockwise direction, wherein the test dividing point T that is originally located at a 0-degree position being moved counterclockwise to a 45-degree position (as shown inFIGS. 7 and 8 ) is taken as an example for illustration of the present invention, and then repeatingStep 32; - (34) setting the test dividing point as the dividing point for two-dimensional picture spreading, in which a test dividing point T (as shown in
FIG. 8 ) that does not cut and divide, in Step (32), the bodily human features of any one of the conferee photographed subjects of Step (31) is taken as the dividing point X for spreading of the two-dimensional picture, namely the dividing point X shown inFIG. 4 ; and - (35) ending.
- Step (31)-(35) of the flowchart of the above-described embodiment for searching the dividing point for spreading the two-dimensional picture and defining the dividing point as the starting point of the panoramic image and the schematic views illustrating the operations of cutting corresponding thereto that are explained with reference to
FIGS. 6-8 are provide as an example for easily expounding the technical contents and the features of the present invention, and are not intended to unduly constrain the scope of the present invention. It is appreciated that those operations and techniques that are equivalent to what described above are all considered falling in the scope of the present invention. - Step 10-60 of the flowchart of the video conference panoramic image spreading method shown in
FIG. 3 can be executed in any suitable measures and means, of which an example includes image processing software pre-loaded in thepanoramic camera 60A mentioned inStep 10. - Further referring to
FIG. 9 , a second embodiment of the video conference panoramic image spreading method according to the present invention is shown, in which thepanoramic camera 60A ofStep 10 is shown connected to at least oneimage processor 61, and the software that executes Step 10-60 ofFIG. 3 may be pre-loaded or stored in advance in theimage processor 61. - Referring further to
FIG. 10 , a third embodiment of the video conference panoramic image spreading method according to the present invention is shown, in which thepanoramic camera 60A ofStep 10 is shown connected to at least onesmart communication device 62, and the software that executes Step 10-60 ofFIG. 3 may be pre-loaded or stored in advance in thesmart communication device 62. Thesmart communication device 62 is not limited to any specific type, and a smart mobile phone and a tablet computer are provided as examples in the present invention. - Referring further to
FIG. 11 , a fourth embodiment of the video conference panoramic image spreading method according to the present invention is shown, in which thepanoramic camera 60A ofStep 10 is shown connected to at least one desk-top computer 63, and the software that executes Step 10-60 ofFIG. 3 may be pre-loaded or stored in advance in the desk-top computer 63. - Referring further to
FIG. 12 , a fifth embodiment of the video conference panoramic image spreading method according to the present invention is shown, in which thepanoramic camera 60A ofStep 10 is shown connected to at least onenotebook computer 64, and the software that executes Step 10-60 ofFIG. 3 may be pre-loaded or stored in advance in thenotebook computer 64. - Further referring to
FIGS. 13 and 14 , an example of a preferred application of the video conference panoramic image spreading method is shown, in which the spread two-dimensionalpanoramic picture 100 with the four conferee photographedsubjects FIGS. 4 and 5 is shown and, during the video conference, an additional, new conferee photographed subject 74 instantaneously joints the conference and intervenes between the conferee photographedsubjects subjects FIG. 13 ) and re-combination through adhering and stitching is carried out to provide a refreshed, updated result of a spread two-dimensionalpanoramic picture 100′ (as shown inFIG. 14 ) in which the conferee photographedsubjects - Further referring to
FIG. 15 , which provides an example of application of the video conference panoramic image spreading method for displaying the spread two-dimensionalpanoramic picture 100′ in an alternative way, during displaying of the refreshed and updated spread two-dimensionalpanoramic picture 100′ that includes the four conferee photographedsubjects subjects FIG. 15 , the conferee photographedsubjects images panoramic picture 100′ to provide an instantaneous effect of magnifying, locking, and tracking to a video conference monitoring unit or a conference speech recording unit. - In the above,
FIGS. 3-15 provide a video conference panoramic image spreading method according to the present invention, and the description and drawings related thereto as disclosed herein are provided for the purposes of being an example for easy explanation of the technical contents and features of the present invention and are not intended to unduly constrain the scope of the present invention. Further, any equivalent substitute and modification of the steps and the operations performed in the present invention as described herein are considered belonging to the spirit and scope of the present invention, which will be solely defined with the appended claims.
Claims (12)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW108144979A TWI742481B (en) | 2019-12-09 | 2019-12-09 | Video conference panoramic image expansion method |
TW108144979 | 2019-12-09 |
Publications (2)
Publication Number | Publication Date |
---|---|
US20210176444A1 true US20210176444A1 (en) | 2021-06-10 |
US11375169B2 US11375169B2 (en) | 2022-06-28 |
Family
ID=76209940
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/782,236 Active 2040-12-30 US11375169B2 (en) | 2019-12-09 | 2020-02-05 | Video conference panoramic image spreading method |
Country Status (3)
Country | Link |
---|---|
US (1) | US11375169B2 (en) |
CN (1) | CN113037994A (en) |
TW (1) | TWI742481B (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2023239467A1 (en) * | 2022-06-08 | 2023-12-14 | Microsoft Technology Licensing, Llc | Customization of a user interface displaying a rendering of multiple participants of a hybrid communication session |
CN117422617A (en) * | 2023-10-12 | 2024-01-19 | 华能澜沧江水电股份有限公司 | Method and system for realizing image stitching of video conference system |
WO2024091335A1 (en) * | 2022-10-25 | 2024-05-02 | Zoom Video Communications, Inc. | Unified video stream in video conferencing |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI824321B (en) * | 2021-07-02 | 2023-12-01 | 創惟科技股份有限公司 | Image controller, image processing system and image modifying method |
CN113784189B (en) * | 2021-08-31 | 2023-08-01 | Oook(北京)教育科技有限责任公司 | Round table video conference generation method and device, medium and electronic equipment |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4439763B2 (en) * | 2001-07-04 | 2010-03-24 | 株式会社リコー | Image recording / reproducing system and image recording / reproducing method |
US7782357B2 (en) * | 2002-06-21 | 2010-08-24 | Microsoft Corporation | Minimizing dead zones in panoramic images |
US7428000B2 (en) * | 2003-06-26 | 2008-09-23 | Microsoft Corp. | System and method for distributed meetings |
JP5569329B2 (en) * | 2010-10-15 | 2014-08-13 | 大日本印刷株式会社 | Conference system, monitoring system, image processing apparatus, image processing method, image processing program, etc. |
TWI549070B (en) | 2015-08-18 | 2016-09-11 | 宏碁股份有限公司 | Mobile apparatus and control method thereof |
US9842624B2 (en) * | 2015-11-12 | 2017-12-12 | Intel Corporation | Multiple camera video image stitching by placing seams for scene objects |
CN108076304A (en) * | 2016-11-15 | 2018-05-25 | 深圳三微思博科技有限公司 | A kind of built-in projection and the method for processing video frequency and conference system of camera array |
TW201901527A (en) * | 2017-05-26 | 2019-01-01 | 和碩聯合科技股份有限公司 | Video conference and video conference management method |
TWI633499B (en) | 2017-06-22 | 2018-08-21 | 宏碁股份有限公司 | Method and electronic device for displaying panoramic image |
CN108257086B (en) * | 2017-12-22 | 2021-04-13 | 微幻科技(北京)有限公司 | Panoramic photo processing method and device |
CN109035138B (en) * | 2018-08-17 | 2023-06-09 | 深圳如布科技有限公司 | Conference recording method, device, equipment and storage medium |
US20210127059A1 (en) * | 2019-10-29 | 2021-04-29 | Microsoft Technology Licensing, Llc | Camera having vertically biased field of view |
-
2019
- 2019-12-09 TW TW108144979A patent/TWI742481B/en active
-
2020
- 2020-01-22 CN CN202010073379.4A patent/CN113037994A/en active Pending
- 2020-02-05 US US16/782,236 patent/US11375169B2/en active Active
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2023239467A1 (en) * | 2022-06-08 | 2023-12-14 | Microsoft Technology Licensing, Llc | Customization of a user interface displaying a rendering of multiple participants of a hybrid communication session |
WO2024091335A1 (en) * | 2022-10-25 | 2024-05-02 | Zoom Video Communications, Inc. | Unified video stream in video conferencing |
CN117422617A (en) * | 2023-10-12 | 2024-01-19 | 华能澜沧江水电股份有限公司 | Method and system for realizing image stitching of video conference system |
Also Published As
Publication number | Publication date |
---|---|
TWI742481B (en) | 2021-10-11 |
US11375169B2 (en) | 2022-06-28 |
TW202123081A (en) | 2021-06-16 |
CN113037994A (en) | 2021-06-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11375169B2 (en) | Video conference panoramic image spreading method | |
USRE45785E1 (en) | Virtual reality camera | |
US8698916B2 (en) | Red-eye filter method and apparatus | |
US8345961B2 (en) | Image stitching method and apparatus | |
US20200154053A1 (en) | Camera area locking | |
WO2016131217A1 (en) | Image correction method and device | |
JP6942940B2 (en) | Image processing equipment, image processing methods and programs | |
JP2017505004A (en) | Image generation method and dual lens apparatus | |
JPWO2008012905A1 (en) | Authentication apparatus and authentication image display method | |
CN110278366B (en) | Panoramic image blurring method, terminal and computer readable storage medium | |
US10212341B2 (en) | Mobile electronic device with multiple cameras | |
CN111918127B (en) | Video clipping method and device, computer readable storage medium and camera | |
US10970901B2 (en) | Single-photo generating device and method and non-volatile computer-readable media thereof | |
CN113824871A (en) | Method and device for processing superposed photographing of front camera and rear camera of mobile terminal and mobile terminal | |
CN112261281A (en) | Visual field adjusting method, electronic equipment and storage device | |
JP2007257331A (en) | Video synthesizing device | |
WO2019113869A1 (en) | Camera array-based panoramic optical field acquisition device, processing method and computing equipment | |
JP2019121991A (en) | Moving image manual preparing system | |
US20230116612A1 (en) | Image processing apparatus, method for controlling the same, and non-transitory computer-readable storage medium | |
CN114745498B (en) | Method and system for capturing subregions and notifying whether altered by camera movement | |
JP6833772B2 (en) | Image processing equipment, imaging equipment, image processing methods and programs | |
CN110730297A (en) | Photo data processing method, system, device and storage medium | |
CN111314680A (en) | Method and device for realizing projection picture superposition and projection system | |
CN111385472A (en) | Image processing method and image acquisition device | |
CN110710202A (en) | Image processing method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
AS | Assignment |
Owner name: MAGIC CONTROL TECHNOLOGY CORP., TAIWAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LIU, PEI-CHUNG;REEL/FRAME:051735/0028 Effective date: 20200204 |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO SMALL (ORIGINAL EVENT CODE: SMAL); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: APPLICATION DISPATCHED FROM PREEXAM, NOT YET DOCKETED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT RECEIVED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |