TWI776191B - Scriptable automatic video recording system - Google Patents

Abstract

The present invention discloses a scriptable automatic video recording system, comprising a camera device that consists of a primary image capturing module, at least one auxiliary image capturing module and an image processing module. In the present invention, the image processing module is configured to decide a photography region and/or an image displaying region. Moreover, based on a photography script that is selected, the image processing module utilizes an object tracking unit to track at least one object that is showed in the image displaying region, and then adaptively modulates an angle of view and an angle of coverage of the primary image capturing module, thereby making the tracked object be kept to show in the image displaying region.

Description

Programmable automatic camera system

The present invention relates to the technical field of photographing devices, and more particularly, to a programmable automatic photographing system.

At present, professional photographing devices all have a Selfie function for users to take self-portraits or take pictures. When a user wants to take a selfie, he usually holds the photographing device with one hand and presses the photographing key or the photographing key with his thumb to take a selfie. Further, the industry has developed selfie sticks and tripods for users to place their photographing devices on the selfie sticks or tripods; in this way, users can use the selfie sticks or tripods to fix the photographic devices The user falls within the photographing range of the photographing device together with the surrounding scenery and/or objects. It is known that all photographing devices for self-portrait are equipped with a remote control, allowing the user to control the photographing device to start photographing work by operating the remote control after determining the scene and/or the scene to be shot with.

KOL is the abbreviation of Key Opinion Leader in English, and it is translated as opinion leader in Chinese. KOLs usually have their own areas of expertise, and then provide content related to their areas of expertise through blogs, communities, or audio-visual platforms. The well-known Youtuber belongs to the KOL, and is also known as the Internet celebrity. It should be known that an internet celebrity can be a person, a group of people, a virtual character, or an animal. In order to gain a high click rate and increase the number of subscriptions, Internet celebrities will come up with various shooting themes. Common shooting themes include: food, tourist attractions, life situations, etc. Therefore, for individual Internet celebrities, they must plan the placement of the tripod in advance before each photo shoot to determine the viewing angle and range of photography.

It is worth noting that after completing the settings of the tripod position, the camera angle and the shooting range, the Internet celebrity can only move within the shooting range. Once the range of activities exceeds the shooting range, the phenomenon of appearing on the camera will occur, affecting the entire section. The smooth shooting of the content. On the other hand, when shooting, although the subject (ie, the Internet celebrity) can use the remote control to adjust the depth/shallowness of the depth of field of the photographic device to determine the clarity/blur of the background image; You can adjust the angle of view of the photographing device by yourself, and determine the far/near sense of the subject in the photographic picture. It is a pity that for the person being photographed (that is, the Internet celebrity), it is actually difficult to perfectly control the depth/shallowness of the depth of field and the large/small angle of view so that the photographic picture perfectly presents the shooting subject. The main reason is that the person being photographed It is impossible to see the real content of the photographic picture.

As can be seen from the above description, the conventional photographing device with a Selfie function still has room for further improvement. In view of this, the inventor of this case has made great efforts to research and invent, and finally developed and completed a choreographed photography system of the present invention.

The main purpose of the present invention is to provide a programmable automatic photographing system, which includes an electronic support device and a photographing device. Wherein, the photographing device has a main image capture module, at least one auxiliary image capture module and an image processing module, and the photographic resolution of the main image capture module is greater than or equal to the auxiliary image capture module Set of photographic resolutions. According to the design of the present invention, the image processing module is used for determining a photographing area and/or a display area according to the image captured by the photographing device. Further, based on the selected at least one choreographed photography script, the image processing module uses an object tracking unit to track at least one object from the display area, and then controls the electronic support device to adjust a horizontal rotation of the photography device angle and/or a vertical rotation angle and/or adjusting the photographic viewing angle and photographing range of the main image capture module, so that at least one object to be tracked will always appear in the display area.

The programmable automatic photography system of the present invention is very suitable for Internet celebrities to use. For individual Internet celebrities, they only need to select the corresponding choreographed photography script according to different shooting themes before each photography work, and the photography device will automatically track the subject objects during the photography work. , thereby keeping the subject object in the display at all times (ie, out of sight).

In order to achieve the above object, the present invention proposes an embodiment of the programmable automatic photography system, which includes: A photographing device, comprising: a main image capture module with a first photographic resolution, a first photographic angle of view and a first photographic range, and at least one auxiliary image capture module with a second photographic resolution , and an image processing module coupled to the main image capture module and the at least one auxiliary image capture module; wherein the second video resolution is smaller than the first video resolution, and the image processing module include: A control unit, coupled to the main image capture module and the at least one auxiliary image capture module, has a display area determination function for determining a display screen according to the first photographing angle of view and the first photographing range A display area is determined, and a non-display area determination function is also provided for determining at least two non-display areas on the display screen according to the display area, the second shooting angle of view and the second shooting range, so that the at least two non-display areas are determined. The non-display area is adjacent to the display area; a script database, coupled to the control unit, and storing a plurality of choreographed photography scripts; and an object tracking unit, coupled to the control unit; Wherein, the control unit controls the object tracking unit to track at least one object from the display area based on the selected at least one of the choreographed photography scripts; Wherein, according to the selected at least one of the choreographed photography scripts, the control unit adaptively adjusts the first photography angle of view and the first photography range according to an object tracking information transmitted by the object tracking unit, so that the At least one of the objects being tracked is always present in the display area.

In one embodiment, the aforementioned choreographed photography system of the present invention further includes an electronic supporting device, wherein the photographing device is connected to the electronic supporting device, and the control unit is based on the selected at least one choreographed photography script and An object tracking information sent by the object tracking unit controls the electronic support device to adjust a horizontal rotation angle and/or a vertical rotation angle of the camera device and/or adjust the first camera angle and the first camera range, Therefore, at least one of the objects being tracked will always appear in the display area.

In one embodiment, the photographing device further includes a communication module coupled to the image processing module, so as to enable the photographing device to perform wired or wireless communication with an external electronic device for displaying through a display of the electronic device the display screen.

In possible embodiments, the electronic device is any of the following: a remote control with a display screen, a smart TV, a smart phone, a tablet, a notebook, an all-in-one computer, or a desktop computer.

In one embodiment, the image processing module further includes: a script selection unit for presenting a script selection interface on the display screen of the display, enabling a user to select at least one of the directed photography scripts by clicking on the script selection interface; and an object selection unit for presenting a tracking object selection interface on the display screen of the display, so that the user selects at least one of the tracking objects by clicking on the tracking object selection interface.

In one embodiment, the primary image capturing module generates a primary image frame, and each of the auxiliary image capturing modules generates an auxiliary image frame. And, at least two of the auxiliary image frames are spliced into a total auxiliary image frame, and the total auxiliary image frame includes a first image content and a second image content, and the first image content includes all the image content of the main image frame.

In one embodiment, the control unit adjusts the depth/shallowness of a first depth of field of one of the main image capturing modules to adjust a background image of the display screen to be clear/blurred.

In another embodiment, the control unit adjusts the large/small of the first camera angle of view of the main image capturing module to determine the distance/closeness of at least one of the objects in the display screen.

In another embodiment, the control unit adjusts the horizontal rotation angle and/or the vertical rotation angle so that the display area moves with the object in the display screen.

In a feasible embodiment, the plurality of choreographed photography scripts respectively correspond to a plurality of photography themes, and the plurality of photography themes include: food theme, car theme, motorcycle theme, bicycle theme, game theme, character theme, animal theme , Plant theme, Building theme, Landscape theme, Scenic theme theme, Landmark theme, Indoor activity theme, Outdoor activity theme, Designated director shooting style, Designated film shooting style.

In a feasible embodiment, the first photographic resolution can be any one of the following but not limited to: 8K, 4K, 2K, 1080P, or 720P.

In one embodiment, the size of the display area is equal to or smaller than the size of the display screen.

In order to more clearly describe the directed photography system proposed by the present invention, the preferred embodiments of the present invention will be described in detail below with reference to the drawings.

FIG. 1 shows a perspective view of a choreographed photography system of the present invention, FIG. 2 shows a block diagram of the choreographed photography system of the present invention, and FIG. 3 shows an application diagram of the choreographed photography system of the present invention. As shown in FIG. 1 , FIG. 2 , and FIG. 3 , the choreographed photography system 1 of the present invention includes: an electronic supporting device 10 and a photographing device 11 connected to the electronic supporting device 10 . In particular, the photographing device 11 includes: a main image capturing module 111 , at least two auxiliary image capturing modules 112 , an image processing module 113 , and a communication module 114 .

More specifically, the image processing module 113 has a control unit 1130 , a script database 1131 , an object tracking unit 1132 , a script selection unit 1133 , and an object selection unit 1134 . Please also refer to FIG. 4 , which shows a schematic diagram of a display screen. As shown in FIG. 4 , according to the design of the present invention, the control unit 1130 is coupled to the main image capture module 111 and the at least two auxiliary image capture modules 112 , and has a display area determination function for determining the display area according to the first image capture module 112 . A photographing angle of view and the first photographing range determine a display area D1 on a display screen D. Moreover, as shown in FIG. 4 , the control unit 1130 also has a non-display area determination function for determining at least two images on the display screen D according to the display area D1 , the second shooting angle of view and the second shooting range For the non-display area D2, the at least two non-display areas D2 are adjacent to the display area D1. It should be added that the communication module 114 of the photographing device 11 wirelessly communicates with an external electronic device 2 to display the display screen D through a display of the electronic device 2 . Furthermore, it can be seen from FIG. 4 that the size of the display area D1 is smaller than or equal to the size of the display screen D. As shown in FIG.

It should be understood that the present invention does not limit the electronic device 2 to be a smart phone, it can also be a remote controller with a display screen, a smart TV, a tablet computer, a notebook computer, an all-in-one computer, or a desktop computer.

In particular, the present invention includes the script database 1131, the script selection unit 1133, the object tracking unit 1132, and the object selection unit 1134 in the image processing module 113, all of which are coupled to The control unit 1130 and the script database 1131 store a plurality of directed photography scripts. In more detail, the plurality of choreographed photography scripts respectively correspond to a plurality of photography themes, and the plurality of photography themes include: food theme, car theme, motorcycle theme, bicycle theme, game theme, character theme, animal theme, plants Theme, Landscape Theme, Scenic Theme Theme, Landmark Theme, Indoor Event Theme, and Outdoor Event Theme, Designated Director Shooting Style, Designated Movie Shooting Style.

When using the choreographed photography system 1 of the present invention, it is only necessary to select the corresponding choreographed photography script and the subject object to be tracked according to different shooting themes before each photographing work, and the photographing device 11 is shooting. During the work, the subject object is automatically tracked, so as to keep the subject object in the display screen D under any circumstances (ie, out of the picture). In more detail, the control unit 1130 controls the object tracking unit 1132 to track at least one object from the display area D1 based on the selected at least one of the choreographed photography scripts and the at least one object selected for tracking. At the same time, according to the selected at least one of the choreographed photography scripts, the control unit 1130 controls the electronic support device 10 to adjust a horizontal rotation angle of the photography device 11 according to an object tracking information sent by the object tracking unit 1132 and/or a vertical rotation angle and/or adjusting the first photographing angle of view and the first photographing range, so that at least one of the objects being tracked will always appear in the display area D1.

More specifically, the script selection unit 1133 is used to present a script selection interface on the display screen of the display, so that a user can select at least one of the directed photography scripts by clicking on the script selection interface. On the other hand, the object selection unit 1134 is used for presenting a tracking object selection interface on the display screen of the display, so that the user can select at least one of the tracking objects by clicking on the tracking object selection interface. As shown in FIG. 2 and FIG. 4 , the user operates the electronic device 2 to select at least one of the choreographed photography scripts by clicking on a script selection interface. At the same time, the user operates the electronic device 2 to select at least one of the tracking objects by clicking on the tracking object selection interface. In this way, the photographic subject corresponding to the directed photographic script is a building subject, and the tracked object is a wooden house. After starting the photographing work, the image processing module 113 of the photographing device 11 automatically divides a display area D1 and two non-display areas D2 adjacent to the display area D1 on a display screen D, and makes the wooden The house (ie, the tracked object) always appears in the display area D1.

Please continue to refer to FIG. 5 , which is a schematic diagram of a display screen. As shown in FIG. 2 and FIG. 5 , the user operates the electronic device 2 to select at least one of the choreographed photography scripts by clicking on a script selection interface. At the same time, the user operates the electronic device 2 to select at least one of the tracking objects by clicking on the tracking object selection interface. In this way, the photographic subject corresponding to the choreographed photographic script is the subject of building a character, and the object to be tracked is a child playing football. After the photographing work is started, the image processing module 113 of the photographing device 11 automatically divides a display area D1 and two non-display areas D2 adjacent to the display area D1 on a display screen D, and enables the player to play football. The child (ie, the tracked object) always appears in the display area D1.

It is worth noting that, in order to improve the processing speed of the object recognition and tracking of the object tracking unit 1132 of the image processing module 113, the present invention specially makes the photographing device 11 have a main image capturing module 111 and at least two auxiliary the image capturing module 112 , and the first camera resolution of the main image capturing module 111 is greater than or equal to the second camera resolution of the auxiliary image capturing module 112 . For example, the first photographic resolution is 8K, 4K, 2K, 1080P, or 720P. In this way, when performing the photographing work, the main image capturing module 111 will generate a main image frame, and each of the auxiliary image capturing modules 112 will generate an auxiliary image frame. According to the present invention, the at least two auxiliary image frames are spliced into a total auxiliary image frame, and the total auxiliary image frame includes a first image content and a second image content, and the first image content includes all of the main image frame. video content. In this case, the object tracking unit 1132 may use the total auxiliary image frame spliced by at least two of the auxiliary image frames to perform object recognition and tracking. It should be understood that since the auxiliary image frame is a low-resolution image frame, the computing processing time of the object recognition and tracking of the object tracking unit 1132 can be greatly reduced, and at the same time, it will not occupy too much computing resources, so as to achieve improved performance. The calculation processing speed of the object recognition and tracking of the image processing module 113 .

As can be seen from the above description, the main image frame generated by the main image capturing module 111 will be displayed in the display area D1 with high-definition quality. On the other hand, at least two of the auxiliary image frames generated by the auxiliary image capturing module 112 are spliced into a total auxiliary image frame, and the total auxiliary image frame does not include part of the image content of the main image frame (also That is, the second image content) is displayed in the non-displayed area D2, and the user cannot see the image content of this part on the display screen of the display.

After completing the object identification and tracking, the control unit 1130 can adjust a background image of the display screen D to be clear by adjusting the depth of field of the main image capture module 111, so that the tracked object can be reduced by a small amount. The more surrounding scenery and/or objects are reflected in the mirror (ie, appear in the display area D1 of the display screen D). On the contrary, the control unit 1130 can adjust a background image of the display frame D to be blurred by reducing the depth of field of the main image capturing module 111 to highlight (enlarge) the tracked object.

After completing the object identification and tracking, the control unit 1130 can further adjust the large/small shooting angle of the main image capturing module 111 to determine the distance/nearness of at least one of the objects in the display screen. On the other hand, the control unit 1130 can also adjust the horizontal rotation angle and/or the vertical rotation angle of the photographing device 11 by controlling the electronic support device 10 , so that the display area D1 is in the display screen D Follow the movement of the tracked object to ensure that the tracked object always appears in the display area D1.

FIG. 6 shows a perspective view of a director type camera system of the present invention. Comparing FIG. 6 with FIG. 1 , it can be found that the camera device 11 of the directed camera system 1 of the present invention shown in FIG. Above, below, left, and right. On the other hand, FIG. 7 shows a perspective view of a directed camera system according to the present invention. Comparing FIG. 7 with FIG. 1 , it can be found that the camera device 11 of the directed camera system 1 of the present invention shown in FIG. 7 only has one auxiliary image capturing module 112 . To put it simply, in a feasible embodiment, the number of auxiliary image capturing modules 112 of the photographing device 11 is not limited to two or four.

Thus, the above-mentioned system has completely and clearly described a directed photography system disclosed in the present invention. And, through the above, we can know that the present invention has the following advantages:

(1) The main purpose of the present invention is to provide a directed photography system 1 including a photography device 11 . Wherein, the photographing device 11 has a main image capturing module 111, at least one auxiliary image capturing module 112 and an image processing module 113, and the photographic resolution of the main image capturing module 111 is greater than that of the auxiliary image Capture the photographic resolution of the module 112 . According to the design of the present invention, the image processing module 113 determines a display area D1 on a display screen D according to the parameters of the main image capture module 111 and the auxiliary image capture module 112 such as the shooting angle and the shooting range. and at least two non-display areas D2. Further, based on the selected at least one choreographed photography script, the image processing module 113 uses an object tracking unit 1132 to track at least one object from the display area D1, and then adaptively adjusts the main image capture module 111, so that at least one object to be tracked will always appear in the display area D1.

(2) The choreographed photography system 1 of the present invention is very suitable for Internet celebrities to use. For individual Internet celebrities, they only need to select the corresponding choreographed photography script according to different shooting themes before each photography work, and the photography device will automatically track the subject objects during the photography work. , thereby keeping the subject object in the display at all times (ie, out of sight).

It must be emphasized that the above-mentioned detailed descriptions are for specific descriptions of feasible embodiments of the present invention, but the embodiments are not intended to limit the patent scope of the present invention. All should be included in the scope of the patent in this case.

<The present invention> 1: Choreographer photography system 10: Electronic support device 11: Photographic installation 111: Main image capture module 112: Auxiliary image capture module 113: Image processing module 1130: Control Unit 1131: Script Repository 1132: Object Tracking Unit 1133: Script selection unit 1134: Object selection unit 114: Communication module D: display screen D1: Display area D2: Non-display area 2: Electronic device

FIG. 1 shows a perspective view of a choreographed photography system of the present invention; FIG. 2 shows a block diagram of the choreographed photography system of the present invention; FIG. 3 shows an application diagram of the choreographed photography system of the present invention; 4 shows a schematic diagram of a display screen; 5 shows a schematic diagram of a display screen; FIG. 6 shows a perspective view of a choreographed camera system of the present invention; and FIG. 7 shows a perspective view of a director type camera system of the present invention.

1: Choreographer photography system

10: Electronic support device

11: Photographic installation

111: Main image capture module

112: Auxiliary image capture module

113: Image processing module

2: Electronic device

Claims (9)

A director-type photography system, comprising: a photography device, comprising: a main image capture module with a first photography resolution, a first photography angle of view and a first photography range, a camera with a second photography resolution at least one auxiliary image capture module, and an image processing module coupled to the main image capture module and the at least two auxiliary image capture modules; wherein the main image capture module and the at least two auxiliary image capture modules The image capture module is located on the same horizontal plane and the same vertical plane, and the second photographic resolution is less than or equal to the first photographic resolution, and the image processing module includes: a control unit, coupled to the main image capture The capture module and the at least one auxiliary image capture module are used to determine a photographing area and/or a display area according to the image captured by the photographing device; a script database is coupled to the control unit and stores There are a plurality of choreographed photography scripts; and an object tracking unit coupled to the control unit; wherein the control unit controls the object tracking unit to capture images from the photographing device based on the selected at least one choreographed photography script At least one object is tracked in the image, so that the tracked object remains in the photographing area and/or the display area; wherein, the main image capturing module and the main image capturing module located on the same horizontal plane and the same vertical plane At least two auxiliary image capture modules have the same focal length, so that the main image capture module generates a main image frame, the at least two auxiliary image capture modules generate at least two auxiliary image frames, and the at least two auxiliary image frames Spliced into a substantial package A total auxiliary image frame including a first image content and a second image content, and the first image content is all the image content of the main image frame; wherein, the photographing device further comprises a camera coupled to the image processing module A communication module is used for wired or wireless communication between the photographing device and an external electronic device, so as to display a display screen through a display of the electronic device, and the display screen includes all the image contents of the main image frame. The choreographed photography system of claim 1, further comprising an electronic support device, wherein the photography device is connected to the electronic support device, and the control unit is based on the selected at least one choreographed photography script and the An object tracking information sent by the object tracking unit controls the electronic support device to adjust a horizontal rotation angle and/or a vertical rotation angle of the camera device and/or adjust the first camera angle and the first camera range, thereby So that at least one of the objects being tracked will always appear in the photographing area and/or the display area. The director photography system of claim 1, wherein the electronic device is any one of the following: a remote control with a display screen, a smart TV, a smart phone, a tablet computer, a notebook computer, an all-in-one computer, or desktop computer. The director photography system according to claim 1, wherein the image processing module further comprises: a script selection unit for presenting a script selection interface on the display screen of the display, allowing a user to click selecting at least one of the choreographed photography scripts by means of the script selection interface; and An object selection unit for presenting a tracking object selection interface on the display screen of the display, so that the user selects at least one of the tracking objects by clicking on the tracking object selection interface. The director photography system of claim 1, wherein the control unit adjusts the depth/shallowness of a first depth of field of one of the main image capturing modules to adjust a background image of the display screen to be clear/blurred. The choreographed photography system of claim 1, wherein the control unit adjusts the large/small of the first camera angle of view of the main image capture module to determine the distance of at least one of the objects in the display screen /close. The director photography system according to claim 1, wherein the control unit adjusts the horizontal rotation angle and/or the vertical rotation angle so that the display area moves with the object in the display screen. The choreographed photography system according to claim 1, wherein the plurality of choreographed photography scripts respectively correspond to a plurality of photography themes, and the plurality of photography themes include: a food theme, a car theme, a motorcycle theme, a bicycle theme, a game Theme, Character Theme, Animal Theme, Plant Theme, Building Theme, Landscape Theme, Scenic Theme Theme, Landmark Theme, Indoor Event Theme, and Outdoor Event Theme, Designated Director Shooting Style, Designated Movie Shooting Style. The director photography system according to claim 1, wherein the size of the display area is equal to or smaller than the size of the display screen.

Images