WO2022007893A1 - 一种拍照方法及电子设备 - Google Patents
一种拍照方法及电子设备 Download PDFInfo
- Publication number
- WO2022007893A1 WO2022007893A1 PCT/CN2021/105232 CN2021105232W WO2022007893A1 WO 2022007893 A1 WO2022007893 A1 WO 2022007893A1 CN 2021105232 W CN2021105232 W CN 2021105232W WO 2022007893 A1 WO2022007893 A1 WO 2022007893A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- camera
- resolution
- stream
- video
- photographing
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 97
- 230000005540 biological transmission Effects 0.000 claims abstract description 113
- 238000012545 processing Methods 0.000 claims description 98
- 230000004044 response Effects 0.000 claims description 29
- 230000008569 process Effects 0.000 claims description 17
- 238000004590 computer program Methods 0.000 claims description 10
- 238000013473 artificial intelligence Methods 0.000 claims description 9
- 238000013461 design Methods 0.000 description 34
- 238000004891 communication Methods 0.000 description 19
- 230000006870 function Effects 0.000 description 17
- 238000004422 calculation algorithm Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 238000004364 calculation method Methods 0.000 description 7
- 230000000694 effects Effects 0.000 description 6
- 230000008878 coupling Effects 0.000 description 4
- 238000010168 coupling process Methods 0.000 description 4
- 238000005859 coupling reaction Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 229920001621 AMOLED Polymers 0.000 description 3
- 238000012790 confirmation Methods 0.000 description 3
- 238000001914 filtration Methods 0.000 description 3
- 238000003709 image segmentation Methods 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 239000002096 quantum dot Substances 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 230000003796 beauty Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000003707 image sharpening Methods 0.000 description 1
- 238000003706 image smoothing Methods 0.000 description 1
- 238000010348 incorporation Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
- H04N7/0122—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal the input and the output signals having different aspect ratios
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/4223—Cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/617—Upgrading or updating of programs or applications for camera control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
- H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
- H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Definitions
- the present application relates to the field of terminal technologies, and in particular, to a photographing method and an electronic device.
- a smart screen includes a device body with a screen and a camera. During the process of taking pictures, video recordings or video calls, the camera captures the images and transmits them to the main body of the device, and presents them to the user through the screen. Since the single-chip solution adopted by the mobile phone cannot meet the needs of high-definition decoding and high-quality image processing of the smart screen, the smart screen adopts a dual-chip architecture. In addition to the main chip, a separate video processing chip for image processing is also set. Usually, the main chip is installed in the main body of the device, and the video processing chip is installed in the camera. Data interaction is completed between the video processing chip and the main chip through a universal serial bus (USB) channel.
- USB universal serial bus
- USB video class USB video class, UVC
- the video processing chip obtains the images collected by the camera sensor to form a video stream, and transmits the video stream to the main chip through the UVC channel.
- the main chip renders the video stream, it can be A photo preview interface is displayed on the display screen; when taking a photo, a frame of image is directly captured from the video stream and saved as a photo; the resolution of the video stream is the same as that of the photo.
- the resolution of the video stream is generally 1920x1080, and the maximum resolution of the saved photos is 1920x1080 (2 million pixels), which cannot meet the needs of users for ultra-clear photos.
- the resolution of the video stream transmitted by the UVC channel needs to be at least 5632x4224, which will increase system memory, power consumption, delay, etc., thereby increasing hardware costs or reducing user experience.
- the embodiments of the present application provide a photographing method and an electronic device.
- the video stream and the photographing stream are transmitted separately in different USB channels, which can fully ensure the real-time and fluency of the video stream when obtaining ultra-clear resolution photos.
- an embodiment of the present application provides a photographing method, which is applied to an electronic device.
- the electronic device includes a device body and a camera connected to the device body, and the device body includes a display screen; the method includes: the camera collects video images, and according to the video The image acquires a video stream with a first resolution; the camera transmits the video stream to the device main body through the first transmission channel; the device main body displays the video stream through the display screen; in response to the device main body receiving the photographing instruction, the camera acquires the first video stream according to the collected video image.
- Two-resolution photo stream the camera transmits the photo stream to the device body through the second transmission channel; the device body obtains the photo according to the photo stream; wherein, the second resolution is greater than the first resolution; the second transmission channel is different from the first transmission channel .
- the device body may include a main processor and a display screen; the camera may include a sensor and a video processor.
- the method may include: a sensor collects a video image, and transmits the video image to a video processor; the video processor acquires a video stream with a first resolution according to the video image; and transmits the video through the first transmission channel stream to the main processor; the main processor displays the video stream through the display screen; in response to the main processor receiving the photographing instruction, the video processor obtains the photographing stream with the second resolution according to the video image collected by the camera sensor;
- the transmission channel transmits the photo stream to the main processor; the main processor obtains the photo according to the photo stream.
- the video stream and the photo stream are transmitted through different transmission channels, and the resolution of the photo is not limited by the resolution of the preview video.
- the resolution of the photo is not limited by the resolution of the preview video.
- the camera captures a video image, and acquires a video stream with a first resolution according to the video image, including: the camera captures the first video image at a second resolution; The image is processed to obtain a video stream with a first resolution; the camera obtaining a photographing stream with a second resolution according to the collected video image includes: the camera obtaining a photographing stream with the second resolution according to the first video image.
- the method may include: a camera sensor captures a first video image at a second resolution and transmits it to a video processor; the video processor processes the first video image to obtain a video stream with the first resolution ; The video processor also acquires a camera stream with a second resolution according to the first video image.
- a camera captures video images with high resolution, and obtains a low-resolution video stream and a high-resolution camera stream according to the high-resolution video images.
- the camera capturing a video image, and acquiring a video stream with a first resolution according to the video image includes: capturing a second video image at the first resolution by the camera, and according to the second video image
- the video image acquires a video stream with the first resolution
- the camera acquiring the photographing stream with the second resolution according to the collected video image includes: in response to the device body receiving the photographing instruction, the camera uses the first
- a first video image is collected at a second resolution
- a camera stream with a second resolution is obtained according to the first video image.
- the method may include: a camera sensor captures a second video image at a first resolution, and transmits the second video image to a video processor; the video processor acquires a video image with the first resolution according to the second video image video stream; in response to the main processor receiving the photographing instruction, the camera sensor captures the first video image at the second resolution, and transmits the first video image to the video processor; the video processor acquires a second video image according to the first video image Resolution of the camera stream.
- the camera when taking pictures and previewing, the camera collects video images at low resolution, and obtains a low-resolution video stream according to the video images; when taking pictures, the camera collects video images at high resolution, and obtains high-resolution images according to the video images. photo stream.
- acquiring the camera stream with the second resolution according to the first video image includes: the camera intercepts one or more frames of the first video image to form the camera stream. In a specific implementation, this step may be completed by the video processor of the camera.
- the camera transmits the video stream to the device body at the first transmission rate through the first transmission channel; the camera transmits the photo stream to the device body at the second transmission rate through the second transmission channel; Wherein, the second transmission rate is smaller than the first transmission rate.
- this step may be completed by the video processor of the camera.
- the method further includes: the camera acquires an artificial intelligence AI stream with a third resolution according to the collected video images; wherein the third resolution is smaller than the first resolution; the camera Perform image enhancement processing on the captured video images according to the AI stream.
- a video image can be collected by a camera sensor; the video processor obtains an AI stream of a third resolution according to the video image collected by the camera sensor, and performs image enhancement processing on the video image collected by the camera sensor according to the AI stream.
- AI streams can be transmitted at a higher transmission rate, quickly perform AI calculations, perform image enhancement processing on video images, and improve the photo preview interface and the image effect of photos.
- the camera and the device body are connected through a universal serial bus (USB).
- USB universal serial bus
- the video processor of the camera and the main processor of the device body are connected through a universal serial bus (USB).
- an embodiment of the present application provides a photographing method, which is applied to an electronic device, where the electronic device includes a display screen, a camera sensor, a video processor, and a main processor; the method includes: the camera sensor collects video images, and transmits the video images.
- the video processor obtains a video stream with a first resolution according to the video image, and transmits the video stream to the main processor through the first transmission channel; the main processor displays the video stream through the display screen; in response to the main processor After receiving the photographing instruction, the video processor obtains a photographing stream with a second resolution according to the video image collected by the camera sensor; and transmits the photographing stream to the main processor through the second transmission channel; the main processor obtains the photograph according to the photographing stream.
- the second resolution is greater than the first resolution.
- the video stream and the photo stream are transmitted through different transmission channels, and the resolution of the photo is not limited by the resolution of the preview video.
- the resolution of the photo is not limited by the resolution of the preview video.
- the camera sensor captures the first video image at the second resolution and transmits it to the video processor; the video processor processes the first video image to obtain a first video image with the first resolution. and the video processor also obtains a camera stream with a second resolution according to the first video image.
- the camera sensor captures video images at high resolution.
- the video processor obtains a low-resolution video stream and a high-resolution camera stream according to the high-resolution video image.
- the camera sensor captures the second video image at the first resolution; the video processor obtains the video stream with the first resolution according to the second video image; in response to the main processor After receiving the photographing instruction, the camera sensor collects the first video image at the second resolution, and transmits the first video image to the video processor; the video processor obtains the photographing stream with the second resolution according to the first video image.
- the camera sensor when taking pictures and previewing, collects video images with low resolution, and the video processor obtains low-resolution video streams according to the video images; when taking pictures, the camera sensor collects video images with high resolution, and the video processor Video images are captured in high-resolution camera streams.
- the video processor intercepts one or more frames of the first video image to form a photographing stream.
- the video processor transmits the video stream to the main processor at the first transmission rate through the first transmission channel; the video processor transmits the photograph at the second transmission rate through the second transmission channel to the host processor; wherein the second transfer rate is less than the first transfer rate. In this way, the smoothness of the preview interface can be guaranteed.
- the video processor obtains an AI stream of a third resolution according to the video image collected by the camera sensor; wherein the third resolution is smaller than the first resolution; the video processor obtains an AI stream according to the AI The stream performs image enhancement processing on the captured video images.
- AI streams can be transmitted at a higher transmission rate, quickly perform AI calculations, perform image enhancement processing on video images, and improve the photo preview interface and the image effect of photos.
- an embodiment of the present application provides a photographing method, the method may include: the electronic device displays a photographing preview interface of a first resolution; in response to receiving a photographing instruction from a user, the electronic device obtains a photograph of the second resolution; Wherein, the second resolution is greater than the first resolution.
- the resolution of the photo obtained by the electronic device is greater than the resolution of the preview video, and the low resolution of the preview video can be maintained while obtaining the high-definition photo, which can ensure the smoothness of the preview video.
- the electronic device captures the first video image at the second resolution; compresses the first video image to the first resolution to obtain a video stream; the electronic device displays on the camera preview interface video stream.
- the electronic device acquires a photo stream according to the first video image; the electronic device acquires a photo according to the photo stream. In this way, the video stream having the first resolution and the photographing stream having the second resolution are obtained.
- the electronic device captures the second video image at the first resolution; the electronic device acquires the video stream according to the second video image; the electronic device displays the video stream on the camera preview interface.
- the electronic device acquires the first video image at the second resolution; the electronic device acquires the photographing stream according to the first video image; and the electronic device acquires the photograph according to the photographing stream.
- the video stream having the first resolution and the photographing stream having the second resolution are obtained.
- the electronic device captures one or more frames of the first video image to form a photographing stream.
- the video stream and the photographing stream are transmitted through different transmission channels.
- the video stream and the photo stream can be transmitted with different resolutions and different transmission rates.
- the transmission rate of the video stream is greater than the transmission rate of the photographing stream. This ensures the smoothness of the video stream.
- the method further includes: the electronic device obtains an artificial intelligence AI stream of a third resolution according to the collected video image; wherein the third resolution is smaller than the first resolution; the electronic device The device performs image enhancement processing on the captured video images according to the AI stream.
- AI streams can be transmitted at a higher transmission rate, quickly perform AI calculations, perform image enhancement processing on video images, and improve the photo preview interface and the image effect of photos.
- an embodiment of the present application provides an electronic device, the electronic device includes: a device body and a camera connected to the device body, and the device body includes a display screen.
- the camera is used to collect video images and obtain a video stream with a first resolution according to the video images; it is also used to transmit the video stream to the main body of the device through the first transmission channel; the main body of the device is used to display the video stream through the display screen is also used to receive a photographing instruction; a camera is also used to obtain a photographing stream with a second resolution according to the video image collected by the camera in response to the device main body receiving the photographing instruction; wherein the second resolution is greater than the first resolution;
- the camera is also used to transmit the photo stream to the device body through the second transmission channel; wherein, the second transmission channel is different from the first transmission channel; the device body is also used to obtain photos according to the photo stream.
- the camera is specifically used to collect the first video image with the second resolution; specifically, it is also used to process the first video image to obtain a video with the first resolution stream; specifically, it is further used to obtain a photographing stream with a second resolution according to the first video image.
- the camera is specifically used to collect the second video image at the first resolution, and obtain a video stream with the first resolution according to the second video image;
- a first video image is collected at a second resolution, and a photographing stream with a second resolution is obtained according to the first video image.
- acquiring the camera stream with the second resolution according to the first video image specifically includes: the camera intercepts one or more frames of the first video image to form the camera stream.
- the camera is specifically used to transmit the video stream to the device body at the first transmission rate through the first transmission channel; the camera is also specifically used to transmit the video stream at the second transmission rate through the second transmission channel
- the photographing stream is transmitted to the main body of the device; wherein, the second transmission rate is smaller than the first transmission rate.
- the camera is also used to obtain an artificial intelligence AI stream with a third resolution according to the collected video image; it is also used to perform image enhancement on the collected video image according to the AI stream processing; wherein the third resolution is smaller than the first resolution.
- the camera and the device body are connected through a universal serial bus (USB).
- USB universal serial bus
- an embodiment of the present application provides an electronic device, where the electronic device includes: a display screen, a camera sensor, a video processor, and a main processor.
- the camera sensor is used to collect video images; the camera sensor is also used to transmit the video images to a video processor; the video processor is used to obtain a video stream with a first resolution according to the video images;
- a transmission channel transmits the video stream to the main processor; the display screen is used to display the video stream; the main processor is also used to receive the photographing instruction; the video processor is used to respond to the main processor receiving the photographing instruction, according to the camera sensor
- the captured video image acquires a camera stream with a second resolution; wherein the second resolution is greater than the first resolution; the video processor is further configured to transmit the camera stream to the main processor through the second transmission channel; the main processor, Also used to get photos based on the camera stream.
- the second transmission channel is different from the first transmission channel.
- the camera sensor is specifically used to collect the first video image at the second resolution;
- the video processor is specifically used to process the first video image, A video stream with a resolution;
- the video processor is further configured to acquire a camera stream with a second resolution according to the first video image.
- the camera sensor is specifically used to collect the second video image with the first resolution
- the video processor is specifically used to acquire the video image with the first resolution according to the second video image.
- the video processor acquiring the camera stream with the second resolution according to the first video image specifically includes: the video processor intercepts one or more frames of the first video image to form images photo stream.
- the video processor is specifically used to transmit the video stream to the main processor at the first transmission rate through the first transmission channel; the video processor is also specifically used to transmit the video stream through the second transmission channel
- the camera stream is transmitted to the main processor at a second transmission rate; wherein the second transmission rate is smaller than the first transmission rate.
- the video processor is further configured to obtain an artificial intelligence AI stream of a third resolution according to the video image collected by the camera sensor; wherein the third resolution is smaller than the first resolution
- the video processor is also used to perform image enhancement processing on the video images collected by the camera sensor according to the AI stream.
- the video processor and the main processor are connected through a universal serial bus (USB).
- USB universal serial bus
- an embodiment of the present application provides an electronic device, which can implement the photographing method described in the first aspect, the second aspect, or the third aspect and the possible design methods thereof.
- the above method can be implemented by executing corresponding software through hardware.
- the electronic device may include a processor and memory.
- the processor is configured to support the electronic device to perform the corresponding function in the method of the first aspect, the second aspect or the third aspect.
- the memory is for coupling with the processor, which holds the necessary program instructions and data for the electronic device.
- an embodiment of the present application provides a computer-readable storage medium, where the computer-readable storage medium includes computer instructions, and when the computer instructions are executed on an electronic device, the electronic device is made to perform the above-mentioned first aspect, the first The photographing method described in the second aspect or the third aspect and its possible design methods.
- an embodiment of the present application provides a computer program product, which, when the computer program product runs on a computer, enables the computer to execute the first aspect, the second aspect, or the third aspect and possible designs thereof method of taking pictures.
- the electronic device of the fourth aspect, the electronic device of the fifth aspect, the electronic device of the sixth aspect, the computer-readable storage medium of the seventh aspect, and the computer program product of the eighth aspect please refer to the technical effect brought by the above-mentioned corresponding method, which will not be repeated here.
- Fig. 1 is a kind of schematic diagram of photographing method in the prior art
- FIG. 2 is a schematic composition diagram of a hardware structure of an electronic device provided by an embodiment of the present application.
- FIG. 3 is a schematic diagram 1 of a photographing method provided by an embodiment of the present application.
- FIG. 4 is a schematic diagram 2 of a photographing method provided by an embodiment of the present application.
- 5A is a flowchart 1 of a photographing method provided by an embodiment of the present application.
- 5B is a second flowchart of a photographing method provided by an embodiment of the present application.
- FIG. 6 is a schematic diagram 1 of an example of a display interface of an electronic device provided by an embodiment of the present application.
- FIG. 7 is a second schematic diagram of an example of a display interface of an electronic device provided by an embodiment of the present application.
- FIG. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
- the photographing method provided by the embodiment of the present application can be applied to any electronic device that is transmitted between any camera and the device body based on the USB dual-stack architecture.
- the electronic device may be a smart screen (also referred to as a large screen or a smart TV), a personal computer (person computer, PC), a notebook computer, a smart home device, etc.
- a smart screen also referred to as a large screen or a smart TV
- a personal computer person computer, PC
- a notebook computer a smart home device, etc.
- the specific form of the electronic device 100 in the embodiments of the present application No special restrictions are made.
- the electronic device 100 may include a device body 110 and a camera 120 .
- the device body 110 includes a main processor 111, a video processor 122, a memory 112, an audio module 113, a speaker 113A, a display screen 114, a wireless communication module 115, an interface module 116, a power module 117, a camera 120, and the like;
- the camera 120 includes a sensor 121 and video processor 122.
- the camera 120 is liftable.
- the camera 120 may be raised to be separated from the device body 110 ; or the camera 120 may be lowered back into the device body 110 .
- the video processor 122 may be located in the camera 120 and separated from the device body 110 as the camera 120 is raised.
- the video processor 122 may also be located in the main body 110 of the device, and does not rise and fall with the rise and fall of the camera 120 , that is, the rise and fall of the camera 120 is equivalent to the rise and fall of the sensor 121 .
- the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device 100 .
- the electronic device 100 may include more or less components than shown, or combine some components, or separate some components, or arrange different components.
- the illustrated components may be implemented in hardware, software or a combination of software and hardware.
- the main processor 111 may include one or more processors, for example, the main processor 111 may include an application processor, a graphics processing unit (GPU), a controller, a video codec, and/or a digital signal processing DSP (digital signal processor, DSP), etc. Wherein, different processors may be independent devices, or may be integrated in one or more processors. For example, the functions of the main processor 111 may be implemented by an integrated main chip.
- the main processor 111 may include an application processor, a graphics processing unit (GPU), a controller, a video codec, and/or a digital signal processing DSP (digital signal processor, DSP), etc.
- DSP digital signal processor
- the controller may be the nerve center and command center of the electronic device 100 .
- the controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.
- An operating system of the electronic device 100 may be installed on the application processor for managing hardware and software resources of the electronic device 100 . For example, managing and configuring memory, prioritizing the supply and demand of system resources, managing file systems, managing drivers, etc.
- the operating system can also be used to provide an operating interface for the user to interact with the system.
- various types of software can be installed in the operating system, for example, a driver program, an application program (application, App), and the like.
- apps such as "camera”, “clock”, “fitness”, and "video” may be installed in the operating system.
- a digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals.
- Video codecs are used to compress or decompress digital video.
- the electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play videos in various encoding formats.
- Graphics processors are used to perform image and graphics related operations.
- Memory 112 for storing instructions and data.
- memory 112 is a cache memory.
- the memory may hold instructions or data used or recycled by the main processor 111 . If the main processor 111 needs to use the instruction or data again, it can be called directly from the memory 112 . Repeated access is avoided, and the waiting time of the main processor 111 is reduced, thereby improving the efficiency of the system.
- the memory 112 may also be provided in the main processor 111 , that is, the main processor 111 includes the memory 112 . This embodiment of the present application does not limit this.
- the audio module 113 is used for converting digital audio information into analog audio signal output, and also for converting analog audio input into digital audio signal.
- the audio module 113 may also be used to encode and decode audio signals.
- the audio module 113 may be provided in the main processor 111 , or some functional modules of the audio module 113 may be provided in the main processor 111 .
- Speaker 113A also referred to as “speaker” is used to convert audio electrical signals into sound signals.
- the electronic device 100 may implement audio functions through the audio module 113, the speaker 113A, and the application processor. For example sound playback etc.
- the electronic device 100 implements a display function through a GPU, a display screen 114, an application processor, and the like.
- the GPU is a microprocessor for image processing, and is connected to the display screen 114 and the application processor.
- the GPU is used to perform mathematical and geometric calculations for graphics rendering.
- Main processor 111 may include one or more GPUs that execute program instructions to generate or change display information.
- the display screen 114 is used to display images, videos, and the like.
- Display screen 114 includes a display panel.
- the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light).
- LED liquid crystal display
- AMOLED organic light-emitting diode
- FLED flexible light-emitting diode
- Miniled MicroLed, Micro-oLed, quantum dot light-emitting diode (quantum dot light emitting diodes, QLED) and so on.
- the display screen 114 may be used to display an App interface, a photo preview interface, a photo, and the like.
- the electronic device 100 may implement a shooting function through a video processor 122, a camera 120, a video codec, a GPU, a display screen 114, an application processor, and the like.
- the wireless communication module 115 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (WiFi) networks), bluetooth (BT), frequency modulation (frequency modulation, FM), infrared technology (infrared, IR) and other wireless communication solutions.
- WLAN wireless local area networks
- BT wireless fidelity
- FM frequency modulation
- IR infrared technology
- the wireless communication module 115 may be one or more devices integrating at least one communication processing module.
- the wireless communication module 115 receives electromagnetic waves via the antenna, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the main processor 111 .
- the interface module 116 may include a network cable interface, a USB interface, an audio output interface, a high definition multimedia interface (HDMI), a memory card interface, and the like.
- the network cable interface can be inserted into the network cable. One end of the network cable is inserted into the network cable interface of the electronic device 100, and the other end is inserted into the wired network interface, and the electronic device 100 is connected to the wired network.
- the USB interface is an interface that conforms to the USB standard specification, which can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc.
- the USB interface can be used to transmit data between the electronic device 100 and peripheral devices; for example, the electronic device 100 can be connected to an external storage device, an external camera, a gamepad, etc. through the USB interface.
- the device audio output interface is used to connect external audio equipment, for example, it can be used to connect speakers.
- HDMI is a fully digital video and sound transmission interface, which can transmit uncompressed audio and video signals at the same time; for example, the electronic device 100 can be connected to devices such as cable set-top boxes, network set-top boxes, and speakers through the HDMI interface.
- the memory card interface is used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100 .
- the power module 117 can be used to supply power to various components included in the electronic device 100 .
- Camera 120 is used to capture still images or video.
- the object is projected onto the sensor 121 through the lens-generated optical image.
- the sensor 121 may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
- CMOS complementary metal-oxide-semiconductor
- the sensor 121 converts the optical signal into an electrical signal, and then passes the electrical signal to the video processor 122 for conversion into a digital image signal.
- the video processor 122 outputs the digital image signal to DSP processing.
- DSP converts digital image signals into standard RGB, YUV and other formats of image signals.
- the video processor 122 is used for processing the data fed back by the sensor 121 .
- the shutter when taking a picture, the shutter is opened, the light is transmitted to the sensor 121 through the lens, the optical signal is converted into an electrical signal, and the sensor 121 transmits the electrical signal to the video processor 122 for processing and converted into an image visible to the naked eye.
- the video processor 122 can also perform algorithm optimization on the noise, brightness, and skin tone of the image.
- the video processor 122 can also optimize parameters such as exposure and color temperature of the shooting scene.
- the electronic device 100 will be equipped with a remote control.
- the remote controller is used to control the electronic device 100 .
- the remote control 200 may include multiple keys, such as an up key 201 , a down key 202 , a left key 203 , a right key 204 , an OK key 205 , a menu key 206 , a power key 207 and the like.
- the keys on the remote control 200 may be mechanical keys or touch keys.
- the remote controller 200 can receive key inputs, generate key signal inputs related to user settings and function control of the electronic device 100 , and send corresponding signals to the electronic device 100 to control the electronic device 100 .
- the key when the user presses the up key 201, the down key 202, the left key 203, the right key 204, the OK key 205, the menu key 206 or the power key 207, the key can send out a corresponding signal; way to send a signal to the electronic device 100 .
- the electronic device 100 receives the signal corresponding to the key through the wireless communication module 115 (eg, Bluetooth, IR), the corresponding operation can be performed according to the signal.
- the electronic device 100 receives a signal corresponding to the up key 201, it can trigger the focus of the display interface of the electronic device 100 to move up; the electronic device 100 receives a signal corresponding to the down key 202, which can trigger the focus of the display interface of the electronic device 100 to move up.
- the electronic device 100 receives the signal corresponding to the left key 203, which can trigger the focus of the display interface of the electronic device 100 to move to the left; the electronic device 100 receives the signal corresponding to the right key 204, and can trigger the electronic device 100 to display the interface focus right
- the electronic device 100 receives the signal corresponding to the confirm key 205, it can trigger the focus of the selected display interface of the electronic device 100; the electronic device 100 receives the signal corresponding to the menu key 206, and can trigger the electronic device 100 to display the menu page (such as displaying a home camera setting interface); the electronic device 100 receives a signal corresponding to the power key 207, which can trigger the electronic device 100 to turn on or off.
- the remote control 200 may also include other keys and components, such as a home key, a volume key, a back key, a Bluetooth interface, an infrared interface, a battery storage cavity (for installing batteries and powering the remote control) and the like. This embodiment of the present application will not be repeated here.
- the camera 120 is connected to the device body 110 through a USB interface.
- the video processor 122 of the camera 120 and the main processor 111 of the device body 110 are connected through a USB interface.
- the USB transmission channel between the video processor 122 and the main processor 111 adopts a dual-stack architecture.
- two transmission channels are included between the video processor 122 and the main processor 111; one transmission channel is based on the UVC protocol, and the other transmission channel is based on the remote network driver interface specification (RNDIS).
- RNDIS remote network driver interface specification
- the camera 120 transmits the preview video stream to the main processor 111 for rendering through a first transmission channel (such as a UVC channel).
- the photo stream is transmitted to the main processor 111 through the second transmission channel (eg, the RNDIS channel) for saving.
- the UVC channel transmits a lower-resolution video stream, which can reduce the delay and obtain a better real-time experience;
- the RNDIS channel transmits a higher-resolution photo stream, and can obtain photos with higher pixels.
- different transmission channels are used to transmit the video stream and the photographing stream on the USB interface, so that the video stream can be transmitted by using a low resolution and a high transmission rate, and the photographing stream can be transmitted by using a high resolution and a low transmission rate;
- the acquisition of ultra-clear photos can be completed with lower memory and power consumption, and the frame rate and real-time performance of video streaming will not be affected.
- the video processor 122 includes a video input (video input, VI) processing unit 401, a video processing subsystem (video process subsystem, VPSS) 402, an enhancement algorithm unit 403 and artificial intelligence ( artificial intelligence, AI) processing unit 404.
- a video input video input, VI
- a video processing subsystem video process subsystem, VPSS
- an enhancement algorithm unit 403
- artificial intelligence artificial intelligence, AI
- the camera sensor 121 collects video images to form preview image data.
- the VI processing unit 401 preprocesses the preview image data to obtain a preview video stream.
- the preprocessing may include filtering and noise reduction, object enhancement, image segmentation and other processing.
- the VPSS402 obtains the video stream and the photographing stream according to the preview video stream.
- an AI stream and the like may also be obtained according to the preview video stream.
- the video stream is used for photo preview;
- the photo stream is used to obtain photos;
- the AI stream is used for artificial intelligence operations, such as face recognition.
- the electronic device can perform face recognition based on the AI stream, and then perform skin beautification, beauty or other image processing on the face in the video stream based on the result of the face recognition.
- VPSS402 configures the resolution and transmission rate of video stream, camera stream and AI stream respectively.
- the video stream adopts a first resolution and a first transmission rate
- the photographing stream adopts a second resolution and a second transmission rate
- the AI stream adopts a third resolution and a third transmission rate.
- the first resolution is smaller than the second resolution and larger than the third resolution
- the first transmission rate is equal to the third transmission rate and larger than the second transmission rate.
- the first resolution is 2560x1920
- the first transmission rate is 30fps (frames per second)
- the second resolution is 5632x4224
- the second transmission rate is 2fps
- the third resolution is 1920x1080
- the third The transfer rate is 30fps.
- the camera sensor collects video images at a second resolution to obtain a preview video stream;
- VPSS402 compresses the resolution of the preview video stream to a first resolution to form a video stream; adopts a video encoding method encoding the video stream; and using the first transmission rate to send the video stream to the main processor through the first transmission channel (such as a UVC channel); the main processor renders the decoded video stream and completes the photo preview.
- the video encoding method may include H265, H264, and the like. In this way, the video stream is transmitted with a lower resolution and a high transmission rate, which can ensure the clarity and smoothness of the video stream.
- the VPSS402 intercepts one or more frames of images of the preview video stream to form a photo stream; the enhancement algorithm unit 403 uses an image enhancement algorithm to perform image enhancement processing on the photo stream; uses an image encoding method to enhance the image
- the processed photo stream is encoded; and sent to the main processor through a second transmission channel (such as an RNDIS channel) at a second transmission rate; the main processor saves the decoded photo stream and completes the photo.
- the image enhancement algorithm may include a histogram equalization algorithm, a grayscale transformation algorithm, an image smoothing algorithm, an image sharpening algorithm, and the like.
- Image coding methods may include MJPEG (motion joint photographic experts group), JPEG (joint photographic experts group), and the like.
- MJPEG motion joint photographic experts group
- JPEG joint photographic experts group
- the high-resolution photo stream can be used to obtain ultra-clear photos; and the photo stream can be obtained only when a photo is taken, which can save memory and reduce power consumption.
- the VPSS 402 intercepts one or more frames of the preview video stream, and compresses the image resolution to a third resolution to form an AI stream; the AI processing unit 404 performs AI processing (such as face recognition) according to the AI stream. ).
- the VI processing unit 401 preprocesses the preview image data according to the calculation result of the AI processing unit 404 . For example, the VI processing unit 401 adjusts the overall exposure of the image according to the face data calculated by the AI processing unit 404, and improves the brightness of the face.
- the preview image data is preprocessed according to the calculation result of the AI processing unit 404, which improves the look and feel of the preview video and photos, and improves the user experience; the AI stream adopts a lower resolution and a higher transmission rate, which can improve the AI calculation speed and improve the user experience. real-time.
- An embodiment of the present application provides a photographing method, as shown in FIG. 5A , the method may include:
- the electronic device receives an operation of the user to open the camera App.
- the user opens the "Home Camera” app of the smart screen.
- the smart screen displays an “all applications” interface 601, and the “all applications” interface 601 includes a “home camera” icon 602.
- the user can select the “home camera” icon 602 to open the “home camera” App.
- the smart screen may receive the user's selection operation on the “home camera” icon 602 .
- the smart screen receives the user's selection operation on the "home camera” icon 602, that is, receives the user's operation of opening the camera App.
- the smart screen displays an "all applications" interface 601, focusing on the first icon "AI fitness".
- the user can move the focus to the right by pressing the right key (such as the right key 204 shown in FIG. 2 ) of the remote control (such as the remote control 200 shown in FIG. 2 ); when the focus falls on the “home camera” icon 602 , the user presses Press the confirmation key (such as the confirmation key 205 shown in FIG. 2 ) of the remote control (such as the remote control 200 shown in FIG. 2 ).
- the smart screen receives the signal corresponding to the confirmation key 205 through the wireless communication module 115 (such as Bluetooth), that is, receives the user's selection operation on the “home camera” icon 602 .
- the wireless communication module 115 such as Bluetooth
- the smart screen In response to receiving the user's selection operation on the “home camera” icon 602 , the smart screen displays a “photograph preview” interface 603 .
- the "Photo Preview” interface 603 may include, but is not limited to, the "Photo” option 604, the “Video” option 605, the “Photo Frame” option 606, etc.;
- the "frame” option 606 is used to switch photo frames.
- the "all applications" interface 601 further includes a "family album” icon 607, and the user can select the "family album” icon 607 to open the family album and view photos that have been saved to the smart screen.
- the user selects the "photograph” option 604 to start taking a photo, and the smart screen takes a photo and saves the photo. Users can open the family album to view the photos they have taken.
- the embodiments of the present application take the remote controller controlling the smart screen as an example for illustrative description. It can be understood that the electronic device in this embodiment of the present application may be controlled in other manners. For example, the camera app of the electronic device can be opened through the mobile app to start taking pictures, and the focus on the display screen can be moved, etc.; or the camera app of the electronic device can be opened through voice control to start taking pictures, etc.
- the embodiments of the present application do not limit the specific manner of controlling the electronic device (for example, opening the camera App and starting to take pictures).
- the camera App In response to receiving the user's instruction to open the camera App, the camera App sends the first preview instruction to the UVC channel, and sends the second preview instruction to the RNDIS channel.
- the camera App in response to receiving the user's operation of opening the camera App, sends a first preview instruction to the UVC channel, where the first preview instruction is used to instruct to start a photo preview.
- the first preview instruction includes a first resolution.
- the camera App sends a second preview command to the RNDIS channel, where the second preview command is used to instruct to start a photo preview.
- the second preview instruction includes a second resolution. Understandably, the camera App is installed in the operating system of the main processor.
- the camera App sends the first preview command to the UVC channel, that is, the main processor sends the first preview command to the UVC channel; the camera App sends the second preview command to the RNDIS channel, that is, the main processor sends the second preview command to the RNDIS channel.
- the first resolution and the second resolution are default values; for example, the first resolution is a first default value (eg, 2560 ⁇ 1440), and the second resolution is a second default value (eg, 5632 ⁇ 3168).
- the values of the first resolution and the second resolution may be modified according to the user's selection.
- the smart screen displays a “photograph preview” interface 603 .
- a signal corresponding to a user pressing a menu key eg, menu key 206 shown in FIG. 2
- a remote controller eg, remote controller 200 shown in FIG. 2
- the smart screen displays a "home camera setting” interface 701 .
- the "Home Camera Settings” interface 701 may include a "Photo Resolution” option 702 for setting the resolution at which the camera captures photos.
- the smart screen may receive the user's selection operation on the "photo resolution” option 702, and in response to the user's selection operation on the "photo resolution” option 702, display the "photo resolution” interface 703.
- the "Photo Resolution” interface 703 may include multiple resolution options.
- the "Photo Resolution” interface 703 may include an "18MP” option 704, a "4MP” option 705, a "24MP” option 706 and a "6MP” option 707; corresponding to 18MP, 4MP, 24MP, and 6MP, respectively CMOS.
- the default option of the smart screen is the "18MP" option 704, which means that the photo is taken with 18 million pixels in a 16:9 aspect ratio; the corresponding second resolution is 5632x3168, and the corresponding first resolution can be 2560x1440.
- the smart screen receives a user's selection operation on the "24MP" option 706, and the "24MP" option indicates that a photo is taken with 24 million pixels in a 4:3 aspect ratio, and the corresponding second resolution is 5632x4224.
- the smart screen determines that the second resolution is 5632x4224.
- the smart screen determines the value of the first resolution, and the first resolution is smaller than the second resolution.
- the first resolution may be 2560 ⁇ 1980.
- the UVC channel sends the first preview command to the VI processing unit, and the RNDIS channel sends the second preview command to the VI processing unit.
- the VI processing unit sends a third preview instruction to the camera sensor.
- the VI processing unit receives the first preview command, and obtains the first resolution according to the first preview command; the VI processing unit receives the second preview command, and obtains the second resolution according to the second preview command.
- the VI processing unit sends a third preview instruction to the camera sensor, where the third preview instruction is used to instruct to start a photo preview.
- the third preview instruction includes the second resolution.
- the camera sensor starts a photo preview, and collects video images.
- the camera sensor receives the third preview instruction and starts the photo preview.
- the camera sensor captures video images at the second resolution to form preview image data.
- the camera sensor sends preview image data to the VI processing unit.
- the VI processing unit acquires a preview video stream according to the preview image data.
- the VI processing unit receives the preview image data, and preprocesses the preview image data to obtain a preview video stream.
- the VI processing unit can perform filtering and noise reduction, target enhancement, and image segmentation on the preview image data.
- the VI processing unit adjusts the overall exposure of the preview image data according to the face data calculated by the AI processing unit, so as to improve the brightness of the face in the image.
- the VI processing unit sends a fourth preview instruction to the VPSS.
- the fourth preview instruction is used to instruct to start the photo preview.
- the fourth preview instruction includes the first resolution and the second resolution.
- the VI processing unit sends the preview video stream to the VPSS.
- the VPSS acquires the video stream according to the preview video stream, and sends the video stream to the UVC channel.
- the VPSS receives a preview video stream, and the resolution of the preview video stream is the second resolution.
- the VPSS compresses the resolution of the preview video stream to the first resolution to form a video stream; and sends the video stream to the UVC channel.
- the video stream is sent to the camera App through the UVC channel.
- the resolution of the video stream is the first resolution.
- the video stream is sent to the camera App at the first transmission rate through the UVC channel.
- the camera App renders and plays the video stream.
- the camera App receives the video stream, and the main processor renders the video stream.
- the main processor plays the rendered video stream through the display screen, that is, displays the photographing preview interface; the resolution of the photographing preview interface is the first resolution.
- the smart screen receives a user's photographing operation.
- the smart screen displays the "photograph preview" interface 603 shown in FIG. 6 .
- the "Take Photo Preview” interface 603 includes a "Take Photo” option 604, and the user can select the "Take Photo” option 604 to initiate taking a photo.
- the smart screen can receive the user's selection operation on the "photograph” option 604 .
- the smart screen receives the user's selection operation on the "photograph” option 604, that is, receives the user's photographing operation.
- the user may also send a photographing instruction through a mobile phone App, voice, etc., which is not limited in the embodiment of the present application.
- the camera App In response to receiving the user's photographing instruction, the camera App sends the photographing instruction to the RNDIS channel.
- the camera App in response to receiving the user's photographing operation, the camera App (main processor) sends a photographing instruction to the RNDIS channel.
- the photographing instruction includes a second resolution.
- the RNDIS channel sends a photographing instruction to the VPSS.
- the S50g and VPSS obtain the photo stream according to the preview video stream.
- the VPSS After receiving the photographing instruction, the VPSS intercepts one or more frames of the preview video stream to form a photographing stream.
- the resolution of the preview video stream and the photographing stream is the second resolution. It is understandable that during the preview process, the camera sensor continuously collects images and forms a preview video stream.
- the VPSS intercepts one or more frames of the current preview video stream to form a photographing stream.
- the VPSS sends the photo stream to the RNDIS channel.
- the camera stream obtained by the VPSS is sent to the RNDIS channel after image enhancement processing.
- the photo stream is sent to the camera app through the RNDIS channel.
- the photo stream is sent to the camera app at the second transmission rate through the RNDIS channel.
- the camera app receives the photo stream and saves it as a photo; the resolution of the photo is the second resolution.
- a user may open a family album to view saved photos.
- the VI processing unit may first execute S504, send the third instruction to the camera sensor, and then execute S508, and send the fourth instruction to the VPSS; or may first execute S508, and send the fourth instruction to the VPSS, and then execute S504, and send the fourth instruction to the camera.
- the sensor sends a third instruction; the sequence of the above steps does not affect the effect of the embodiment of the present application.
- the embodiment of the present application provides a photographing method. After a camera collects an image according to the high resolution of the photograph, a video stream is transmitted to a main processor at a lower resolution and a higher transmission rate through a first transmission channel; The transmission channel transmits the photo stream to the main processor at a higher resolution and a lower transmission rate, and the resolution of the photo is not limited by the resolution of the preview video. In this way, you can not only obtain ultra-clear photos, but also ensure that the preview video is clear and smooth.
- the embodiment of the present application also provides a photographing method, as shown in FIG. 5B , the method may include:
- the camera App In response to receiving the user's instruction to open the camera App, the camera App sends a first preview instruction to the UVC channel.
- the camera App in response to receiving the user's operation of opening the camera App, the camera App sends a first preview instruction to the UVC channel, where the first preview instruction is used to instruct to start a photo preview. Understandably, the camera App is installed in the operating system of the main processor. The camera App sends the first preview command to the UVC channel, that is, the main processor sends the first preview command to the UVC channel.
- the first preview instruction includes a first resolution.
- the first resolution is a default value; for example, the first resolution is a first default value (eg, 2560 ⁇ 1440).
- the value of the first resolution is determined according to a user's selection. Illustratively, referring to FIG.
- the "Photo Resolution” interface 703 includes a plurality of resolution options. The user can select an option for the photo resolution.
- the "Photo Resolution” interface 703 may include an "18MP” option 704, a "4MP” option 705, a "24MP” option 706 and a “6MP” option 707; corresponding to 18MP, 4MP, 24MP, and 6MP, respectively CMOS.
- the "18MP" option 704 indicates that a photo is taken with 18 megapixels in a 16:9 aspect ratio; the corresponding photo resolution is 5632x3168, and the corresponding first resolution is 2560x1440.
- the UVC channel sends a first preview instruction to the VI processing unit.
- the VI processing unit sends a first preview instruction to the camera sensor.
- the camera sensor starts a photo preview, and captures a video image at a first resolution.
- the camera sensor receives the first preview instruction, acquires the first resolution according to the first preview instruction, and collects video images at the first resolution to form preview image data.
- the camera sensor sends preview image data to the VI processing unit.
- the VI processing unit acquires a preview video stream according to the preview image data.
- the VI processing unit sends a preview video stream to the VPSS.
- the VPSS sends the preview video stream to the UVC channel.
- the preview video stream is sent to the camera App through the UVC channel.
- the resolution of the video stream is the first resolution.
- the video stream is sent to the camera app at a first transmission rate (eg, 30fps) through the UVC channel.
- the camera App renders and plays the video stream.
- the camera App in response to receiving the user's photographing instruction, the camera App sends the photographing instruction to the RNDIS channel.
- the camera App in response to receiving the user's photographing instruction, sends the photographing instruction to the RNDIS channel.
- the photographing instruction includes a second resolution; wherein the second resolution is greater than the first resolution.
- the second resolution is 5632 ⁇ 3168.
- the camera App is installed in the operating system of the main processor. The camera App sends a photographing command to the RNDIS channel, that is, the main processor sends a photographing command to the RNDIS channel.
- the RNDIS channel sends a photographing instruction to the VI processing unit.
- the photographing instruction includes the second resolution.
- the VI processing unit sends a photographing instruction to the camera sensor.
- the camera sensor collects video images at the second resolution.
- the camera sensor receives the photographing instruction, obtains the second resolution according to the photographing instruction, and collects video images at the second resolution to form second preview image data.
- the camera sensor sends the second preview image data to the VI processing unit.
- the VI processing unit acquires the second preview video stream according to the second preview image data.
- the VI processing unit receives the second preview image data, and preprocesses the second preview image data to obtain a second preview video stream.
- the VI processing unit may perform filtering and noise reduction, target enhancement, image segmentation and other processing on the second preview image data.
- the VI processing unit sends a photographing instruction to the VPSS.
- the VI processing unit sends the second preview video stream to the VPSS.
- the VPSS acquires the photographing stream according to the second preview video stream.
- the VPSS After receiving the photographing instruction, the VPSS intercepts one or more frames of images of the second preview video stream to form a photographing stream.
- the resolutions of the second preview video stream and the photographing stream are the second resolution.
- the VPSS compresses the resolution of the second preview video stream to the first resolution to form the second video stream; and sends the second video stream to the UVC channel.
- the second video stream is sent to the camera app through the UVC channel.
- the camera App receives the second video stream and renders the second video stream.
- the display screen of the smart screen plays the rendered second video stream, that is, a photo preview interface is displayed; the resolution of the photo preview interface is the first resolution.
- VPSS sends the photo stream to the RNDIS channel.
- the camera stream obtained by the VPSS is sent to the RNDIS channel after image enhancement processing.
- the photo stream is sent to the camera app through the RNDIS channel.
- the photo stream is sent to the camera App at the second transmission rate through the RNDIS channel.
- the second transmission rate is smaller than the first transmission rate, for example, the second transmission rate is 2fps.
- the photo stream is sent through the RNDIS channel with a higher resolution and a lower transmission rate, so that high-definition photos can be obtained.
- the camera app receives the photo stream and saves it as a photo; the resolution of the photo is the second resolution.
- a user may open a family album to view saved photos.
- the embodiment of the present application provides a photographing method.
- a camera captures an image at a low resolution, and transmits a video stream to a main processor at a lower resolution and a higher transmission rate through a first transmission channel; Video smoothness.
- the camera captures images with high resolution, and transmits the camera stream to the main processor at a higher resolution and a lower transmission rate through the second transmission channel, so as to obtain high-definition photos. In this way, you can not only obtain ultra-clear photos, but also ensure that the preview video is clear and smooth.
- the above-mentioned electronic device includes corresponding hardware structures and/or software modules for executing each function.
- the embodiments of the present application can be implemented in hardware or a combination of hardware and computer software. Whether a function is performed by hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Experts may use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of the embodiments of the present application.
- the electronic device may be divided into functional modules according to the foregoing method examples.
- each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module.
- the above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules. It should be noted that, the division of modules in the embodiments of the present application is schematic, and is only a logical function division, and there may be other division manners in actual implementation.
- FIG. 8 shows a possible schematic structural diagram of the electronic device involved in the above embodiment.
- the electronic device 800 includes: a camera 810 and a device body 820 ; wherein, the camera 810 includes a sensor 811 and a first processing unit 812 ; the device body 820 includes a second processing unit 821 and a display unit 822 .
- Data can be exchanged between the camera 810 and the device body 820 through the first channel 831 or the second channel 832; specifically, the first processing unit 812 and the second processing unit 821 can exchange data through the first channel 831 or the second channel 832 .
- the senor 811 is used for collecting images.
- it may be used to perform the processing steps of S505 and S506 in Figure 5A; or the processing steps of S515, S516, S51g and S51h in Figure 5B; and/or other processes for the techniques described herein.
- the first processing unit 812 is used for image processing. For example, it can be used to perform the processing steps of S504, S507-S50a, 50g and S50h in FIG. 5A; or the processing steps of S514, S517-S519, S51f and S51i-S51n in FIG. 5B; and/or for the processing steps described herein. Other procedures of the described techniques.
- the first channel 831 is used for transmitting video stream and video stream related commands. For example, it may be used to perform the process steps of S503 and S115b in FIG. 5A; or the process steps of S513 and S51a in FIG. 5B; and/or other processes for the techniques described herein.
- the second channel 832 is used to transmit the photographing stream and the instructions related to the photographing stream. For example, it may be used to perform the processing steps of S503, S50f and S50i in FIG. 5A; or the processing steps of S51e and S51p in FIG. 5B; and/or other processes for the techniques described herein.
- the second processing unit 821 is configured to control and manage the actions of the electronic device 800 and interact with the user (for example, receiving user instructions, etc.). For example, it can be used to perform the processing steps of S501, S502, S50c-S50e and S50j in FIG. 5A; or the processing steps of S511, S512, S51b-S51d and S51q in FIG. 5B; and/or for the processing steps described herein other processes of technology.
- the display unit 822 is used to display a display interface of the electronic device 800, for example, it can be used to display a photo preview interface, a setting interface, a photo, and the like.
- the unit modules in the above electronic device 800 include but are not limited to the above sensor 811 , the first processing unit 812 , the first channel 831 , the second channel 832 , the second processing unit 821 and the display unit 822 .
- the electronic device 800 may further include a storage unit, a communication unit, an audio unit, and the like.
- the storage unit is used to store program codes and data of the electronic device 800 .
- the communication unit is used to support communication between the electronic device 800 and other devices. For example, it can be used to receive control signals from a remote control. Audio units are used to play sounds etc.
- the sensor 811 may be a sensor of a camera.
- the first processing unit 812 may be a video processor or other programmable logic device, transistor logic device, hardware component, or any combination thereof, which may implement or execute various exemplary logic blocks described in connection with the present disclosure, modules and circuits.
- the first channel 831 and the second channel 832 may be USB channels.
- the second processing unit 821 may be a processor or a controller, for example, a central processing unit (CPU), a digital signal processor (DSP), an application-specific integrated circuit (ASIC) ), field programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof.
- the storage unit may be a memory.
- the communication unit may be a transceiver, a transceiver circuit, a communication interface, or the like.
- the display unit 822 may be a display screen.
- the audio unit may include speakers, receivers, and the like.
- the sensor 811 is an image acquisition sensor (such as the sensor 121 shown in FIG. 2 )
- the first processing unit 812 is a processor (such as the video processor 122 shown in FIG. 2 )
- the second processing unit 821 is a processor (such as The main processor 111 shown in FIG. 2 )
- the storage unit may be a memory (the memory 112 shown in FIG. 2 )
- the communication unit may be a wireless communication module (the wireless communication module 115 shown in FIG. 2 )
- the display unit 822 It may be a display screen (display screen 114 shown in FIG. 2 )
- the audio unit may include a speaker (speaker 113A shown in FIG. 2 ) and the like.
- the electronic device 800 provided in this embodiment of the present application may be the electronic device 100 shown in FIG. 2 .
- the above-mentioned processor, memory, communication module, etc. can be coupled together, for example, connected through a bus.
- Embodiments of the present application further provide a computer-readable storage medium, where computer program codes are stored in the computer-readable storage medium.
- the electronic device executes the related method in FIG. 5A or FIG. 5B The steps implement the methods in the above embodiments.
- Embodiments of the present application also provide a computer program product, which, when the computer program product runs on a computer, causes the computer to execute the relevant method steps in FIG. 5A or FIG. 5B to implement the method in the above embodiment.
- the electronic device 800, the computer-readable storage medium, or the computer program product provided by the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, for the beneficial effects that can be achieved, reference may be made to the provided above. The beneficial effects in the corresponding method will not be repeated here.
- the disclosed apparatus and method may be implemented in other manners.
- the device embodiments described above are only illustrative.
- the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods.
- multiple units or components may be Incorporation may either be integrated into another device, or some features may be omitted, or not implemented.
- the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.
- the units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place, or may be distributed to multiple different places . Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
- each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.
- the above-mentioned integrated units can be implemented in the form of hardware, and can also be implemented in the form of software functional units.
- the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a readable storage medium.
- the technical solutions of the embodiments of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, which are stored in a storage medium , including several instructions to make a device (may be a single chip microcomputer, a chip, etc.) or a processor (processor) to execute all or part of the steps of the methods described in the various embodiments of the present application.
- the aforementioned storage medium includes: a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk and other mediums that can store program codes.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Graphics (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Studio Devices (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本申请实施例公开了一种拍照方法及电子设备,涉及终端技术领域。电子设备包括设备主体和与设备主体连接的摄像头,设备主体包括显示屏;摄像头采集视频图像,并根据视频图像获取具有第一分辨率的视频流;还根据视频图像获取具有第二分辨率的拍照流;视频流和拍照流采用不同的传输通道传输至设备主体。这样,可以以较低的分辨率和较高的传输速率传输视频流,以较高的分辨率和较低的传输速率传输拍照流;既可以获取超清照片,还可以保证预览视频的清晰和流畅。
Description
本申请要求于2020年07月10日提交国家知识产权局、申请号为202010664485.X、申请名称为“一种拍照方法及电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
本申请涉及终端技术领域,尤其涉及一种拍照方法及电子设备。
随着科技进步,智慧屏逐渐走入了人们的生活。智慧屏也可以称为智能电视。用户除了使用智慧屏观看各种电视节目、视频以外,还可以使用智慧屏进行拍照,摄像,视频通话等。一般来说,智慧屏包括具有屏幕的设备主体以及摄像头。拍照,摄像或视频通话等过程中,摄像头采集图像后传输至设备主体,通过屏幕呈现给用户。由于手机采用的单芯片方案无法满足智慧屏高清解码和高质量图像处理的需求,智慧屏采用了双芯片架构,除主芯片外,还设置了单独用于图像处理的视频处理芯片。通常,主芯片安装在设备主体,视频处理芯片安装在摄像头。视频处理芯片和主芯片间通过通用串行总线(universal serial bus,USB)通道完成数据交互。
现有技术中,视频处理芯片和主芯片间通过USB视频类(USB video class,UVC)通道交互数据。示例性的,请参考图1,在拍照预览过程中,视频处理芯片获取摄像头传感器采集的图像形成视频流,将视频流经UVC通道传输至主芯片,主芯片对视频流进行渲染后,可以在显示屏上呈现拍照预览界面;拍照时,直接从视频流中截取一帧图像保存为照片;视频流分辨率和照片分辨率是一样的。目前视频流分辨率一般为1920x1080,保存的照片最大分辨率为1920x1080(200万像素),无法满足用户对超清照片的需求。如果为了获取2400万像素超清照片,则UVC通道所传输的视频流分辨率至少需要达到5632x4224,而这会增加系统内存、功耗、时延等,进而增加硬件成本或者降低用户体验。
发明内容
本申请实施例提供一种拍照方法及电子设备,视频流和拍照流在不同的USB通道分开传输,可以在获取超清分辨率照片时充分保证视频流的实时性及流畅性。
第一方面,本申请实施例提供一种拍照方法,应用于电子设备,电子设备包括设备主体和与设备主体连接的摄像头,设备主体包括显示屏;该方法包括:摄像头采集视频图像,并根据视频图像获取具有第一分辨率的视频流;摄像头通过第一传输通道传输视频流至设备主体;设备主体通过显示屏显示视频流;响应于设备主体接收到拍照指令,摄像头根据采集的视频图像获取第二分辨率的拍照流;摄像头通过第二传输通道传输拍照流至设备主体;设备主体根据拍照流获取照片;其中,第二分辨率大于第一分辨率;第二传输通道与第一传输通道不同。
在具体实现中,设备主体可以包括主处理器和显示屏;摄像头可以包括传感器和 视频处理器。具体到上述各单元,该方法可以包括:传感器采集视频图像,并将视频图像传输至视频处理器;视频处理器根据视频图像获取具有第一分辨率的视频流;并通过第一传输通道传输视频流至主处理器;主处理器通过显示屏显示视频流;响应于主处理器接收到拍照指令,视频处理器根据摄像头传感器采集的视频图像获取具有第二分辨率的拍照流;并通过第二传输通道传输拍照流至主处理器;主处理器根据拍照流获取照片。
在该方法中,视频流和拍照流通过不同的传输通道进行传输,照片的分辨率不受预览视频分辨率的限制。这样就可以获取高分辨率的超清照片,同时保持低分辨率的预览视频,以保证预览视频的流畅性。
结合第一方面,在一种可能的设计方式中,摄像头采集视频图像,并根据视频图像获取具有第一分辨率的视频流包括:摄像头以第二分辨率采集第一视频图像;对第一视频图像进行处理,获取具有第一分辨率的视频流;摄像头根据采集的视频图像获取具有第二分辨率的拍照流包括:摄像头根据第一视频图像获取具有第二分辨率的拍照流。
在具体实现中,该方法可以包括:摄像头传感器以第二分辨率采集第一视频图像,并传输至视频处理器;视频处理器对第一视频图像进行处理,获取具有第一分辨率的视频流;视频处理器还根据第一视频图像获取具有第二分辨率的拍照流。
在该方法中,摄像头以高分辨率采集视频图像,并根据高分辨率的视频图像获取低分辨率的视频流和高分辨率的拍照流。
结合第一方面,在一种可能的设计方式中,摄像头采集视频图像,并根据视频图像获取具有第一分辨率的视频流包括:摄像头以第一分辨率采集第二视频图像,并根据第二视频图像获取具有第一分辨率的视频流;响应于设备主体接收到拍照指令,摄像头根据采集的视频图像获取具有第二分辨率的拍照流包括:响应于设备主体接收到拍照指令,摄像头以第二分辨率采集第一视频图像,并根据第一视频图像获取具有第二分辨率的拍照流。
在具体实现中,该方法可以包括:摄像头传感器以第一分辨率采集第二视频图像,并将第二视频图像传输给视频处理器;视频处理器根据第二视频图像获取具有第一分辨率的视频流;响应于主处理器接收到拍照指令,摄像头传感器以第二分辨率采集第一视频图像,并将第一视频图像传输至视频处理器;视频处理器根据第一视频图像获取具有第二分辨率的拍照流。
在该方法中,拍照预览时,摄像头以低分辨率采集视频图像,并根据视频图像获取低分辨率的视频流;拍照时,摄像头以高分辨率采集视频图像,并根据视频图像获取高分辨率的拍照流。
结合第一方面,在一种可能的设计方式中,摄像头根据第一视频图像获取具有第二分辨率的拍照流包括:摄像头截取第一视频图像的一帧或多帧图像形成拍照流。在具体实现中,可以由摄像头的视频处理器完成该步骤。
结合第一方面,在一种可能的设计方式中,摄像头通过第一传输通道以第一传输速率传输视频流至设备主体;摄像头通过第二传输通道以第二传输速率传输拍照流至设备主体;其中,第二传输速率小于第一传输速率。这样,可以保证预览界面的流畅 性。在具体实现中,可以由摄像头的视频处理器完成该步骤。
结合第一方面,在一种可能的设计方式中,该方法还包括:摄像头根据采集的视频图像获取具有第三分辨率的人工智能AI流;其中,第三分辨率小于第一分辨率;摄像头根据AI流对采集的视频图像进行图像增强处理。在具体实现中,可以由摄像头传感器采集视频图像;视频处理器根据摄像头传感器采集的视频图像获取第三分辨率的AI流,并根据AI流对摄像头传感器采集的视频图像进行图像增强处理。
AI流采用较小的分辨率,就可以以较高的传输速率进行传输,快速的进行AI计算,对视频图像进行图像增强处理,提升拍照预览界面和照片的图像效果。
结合第一方面,在一种可能的设计方式中,摄像头与设备主体之间通过通用串行总线USB连接。具体的,摄像头的视频处理器与设备主体的主处理器之间通过通用串行总线USB连接。
第二方面,本申请实施例提供一种拍照方法,应用于电子设备,电子设备包括显示屏,摄像头传感器,视频处理器和主处理器;该方法包括:摄像头传感器采集视频图像,将视频图像传输至视频处理器;视频处理器根据视频图像获取具有第一分辨率的视频流,并通过第一传输通道传输视频流至主处理器;主处理器通过显示屏显示视频流;响应于主处理器接收到拍照指令,视频处理器根据摄像头传感器采集的视频图像获取具有第二分辨率的拍照流;并通过第二传输通道传输拍照流至主处理器;主处理器根据拍照流获取照片。其中,第二分辨率大于第一分辨率。
在该方法中,视频流和拍照流通过不同的传输通道进行传输,照片的分辨率不受预览视频分辨率的限制。这样就可以获取高分辨率的超清照片,同时保持低分辨率的预览视频,以保证预览视频的流畅性。
结合第二方面,在一种可能的设计方式中,摄像头传感器以第二分辨率采集第一视频图像,并传输至视频处理器;视频处理器对第一视频图像进行处理,获取具有第一分辨率的视频流;视频处理器还根据第一视频图像获取具有第二分辨率的拍照流。在该方法中,摄像头传感器以高分辨率采集视频图像。视频处理器根据高分辨率的视频图像获取低分辨率的视频流和高分辨率的拍照流。
结合第二方面,在一种可能的设计方式中,摄像头传感器以第一分辨率采集第二视频图像;视频处理器根据第二视频图像获取具有第一分辨率的视频流;响应于主处理器接收到拍照指令,摄像头传感器以第二分辨率采集第一视频图像,并将第一视频图像传输至视频处理器;视频处理器根据第一视频图像获取具有第二分辨率的拍照流。在该方法中,拍照预览时,摄像头传感器以低分辨率采集视频图像,视频处理器根据视频图像获取低分辨率的视频流;拍照时,摄像头传感器以高分辨率采集视频图像,视频处理器根据视频图像获取高分辨率的拍照流。
结合第二方面,在一种可能的设计方式中,视频处理器截取第一视频图像的一帧或多帧图像形成拍照流。
结合第二方面,在一种可能的设计方式中,视频处理器通过第一传输通道以第一传输速率传输视频流至主处理器;视频处理器通过第二传输通道以第二传输速率传输拍照流至主处理器;其中,第二传输速率小于第一传输速率。这样,可以保证预览界面的流畅性。
结合第二方面,在一种可能的设计方式中,视频处理器根据摄像头传感器采集的视频图像获取第三分辨率的AI流;其中,第三分辨率小于第一分辨率;视频处理器根据AI流对采集的视频图像进行图像增强处理。AI流采用较小的分辨率,就可以以较高的传输速率进行传输,快速的进行AI计算,对视频图像进行图像增强处理,提升拍照预览界面和照片的图像效果。
第三方面,本申请实施例提供一种拍照方法,该方法可以包括:电子设备显示第一分辨率的拍照预览界面;响应于接收到用户的拍照指令,电子设备获取第二分辨率的照片;其中,第二分辨率大于第一分辨率。在该方法中,电子设备获取的照片的分辨率大于预览视频的分辨率,可以在获取高清照片的同时,保持预览视频的低分辨率,这样可以保证预览视频的流畅性。
结合第三方面,在一种可能的设计方式中,电子设备以第二分辨率采集第一视频图像;将第一视频图像压缩至第一分辨率,获取视频流;电子设备在拍照预览界面显示视频流。电子设备根据第一视频图像获取拍照流;电子设备根据拍照流获取照片。这样就实现了获取具有第一分辨率的视频流和具有第二分辨率的拍照流。
结合第三方面,在一种可能的设计方式中,电子设备以第一分辨率采集第二视频图像;电子设备根据第二视频图像获取视频流;电子设备在拍照预览界面显示视频流。响应于接收到用户的拍照指令,电子设备以第二分辨率采集第一视频图像;电子设备根据第一视频图像获取拍照流;电子设备根据拍照流获取照片。这样就实现了获取具有第一分辨率的视频流和具有第二分辨率的拍照流。
结合第三方面,在一种可能的设计方式中,电子设备截取第一视频图像的一帧或多帧图像形成拍照流。
结合第三方面,在一种可能的设计方式中,视频流和拍照流通过不同的传输通道进行传输。这样就可以实现视频流和拍照流采用不同的分辨率以及不同的传输速率进行传输。
结合第三方面,在一种可能的设计方式中,视频流的传输速率大于拍照流的传输速率。这样可以保证视频流的流畅性。
结合第三方面,在一种可能的设计方式中,该方法还包括:电子设备根据采集的视频图像获取第三分辨率的人工智能AI流;其中,第三分辨率小于第一分辨率;电子设备根据AI流对采集的视频图像进行图像增强处理。AI流采用较小的分辨率,就可以以较高的传输速率进行传输,快速的进行AI计算,对视频图像进行图像增强处理,提升拍照预览界面和照片的图像效果。
第四方面,本申请实施例提供一种电子设备,该电子设备包括:设备主体和与设备主体连接的摄像头,设备主体包括显示屏。其中,摄像头,用于采集视频图像,并根据视频图像获取具有第一分辨率的视频流;还用于通过第一传输通道传输视频流至设备主体;设备主体,用于通过显示屏显示视频流;还用于接收拍照指令;摄像头,还用于响应于设备主体接收到拍照指令,根据摄像头采集的视频图像获取具有第二分辨率的拍照流;其中,第二分辨率大于第一分辨率;摄像头,还用于通过第二传输通道传输拍照流至设备主体;其中,第二传输通道与第一传输通道不同;设备主体,还用于根据拍照流获取照片。
结合第四方面,在一种可能的设计方式中,摄像头,具体用于以第二分辨率采集第一视频图像;具体还用于对第一视频图像进行处理,获取具有第一分辨率的视频流;具体还用于根据第一视频图像获取具有第二分辨率的拍照流。
结合第四方面,在一种可能的设计方式中,摄像头,具体用于以第一分辨率采集第二视频图像,并根据第二视频图像获取具有第一分辨率的视频流;具体还用于响应于设备主体接收到拍照指令,以第二分辨率采集第一视频图像,并根据第一视频图像获取具有第二分辨率的拍照流。
结合第四方面,在一种可能的设计方式中,摄像头根据第一视频图像获取具有第二分辨率的拍照流具体包括:摄像头截取第一视频图像的一帧或多帧图像形成拍照流。
结合第四方面,在一种可能的设计方式中,摄像头具体用于通过第一传输通道以第一传输速率传输视频流至设备主体;摄像头具体还用于通过第二传输通道以第二传输速率传输拍照流至设备主体;其中,第二传输速率小于第一传输速率。
结合第四方面,在一种可能的设计方式中,摄像头,还用于根据采集的视频图像获取具有第三分辨率的人工智能AI流;还用于根据AI流对采集的视频图像进行图像增强处理;其中,第三分辨率小于第一分辨率。
结合第四方面,在一种可能的设计方式中,摄像头与设备主体之间通过通用串行总线USB连接。
第五方面,本申请实施例提供一种电子设备,该电子设备包括:显示屏,摄像头传感器,视频处理器和主处理器。其中,摄像头传感器,用于采集视频图像;摄像头传感器,还用于将视频图像传输至视频处理器;视频处理器,用于根据视频图像获取具有第一分辨率的视频流;还用于通过第一传输通道传输视频流至主处理器;显示屏,用于显示视频流;主处理器,还用于接收拍照指令;视频处理器,用于响应于主处理器接收到拍照指令,根据摄像头传感器采集的视频图像获取具有第二分辨率的拍照流;其中,第二分辨率大于第一分辨率;视频处理器,还用于通过第二传输通道传输拍照流至主处理器;主处理器,还用于根据拍照流获取照片。其中,第二传输通道与第一传输通道不同。
结合第五方面,在一种可能的设计方式中,摄像头传感器,具体用于以第二分辨率采集第一视频图像;视频处理器,具体用于对第一视频图像进行处理,获取具有第一分辨率的视频流;视频处理器,具体还用于根据第一视频图像获取具有第二分辨率的拍照流。
结合第五方面,在一种可能的设计方式中,摄像头传感器,具体用于以第一分辨率采集第二视频图像;视频处理器,具体用于根据第二视频图像获取具有第一分辨率的视频流;摄像头传感器,具体还用于响应于主处理器接收到拍照指令,以第二分辨率采集第一视频图像,并将第一视频图像传输至视频处理器;视频处理器,具体用于根据第一视频图像获取具有第二分辨率的拍照流。
结合第五方面,在一种可能的设计方式中,视频处理器根据第一视频图像获取具有第二分辨率的拍照流具体包括:视频处理器截取第一视频图像的一帧或多帧图像形成拍照流。
结合第五方面,在一种可能的设计方式中,视频处理器具体用于通过第一传输通 道以第一传输速率传输视频流至主处理器;视频处理器具体还用于通过第二传输通道以第二传输速率传输拍照流至主处理器;其中,第二传输速率小于第一传输速率。
结合第五方面,在一种可能的设计方式中,视频处理器,还用于根据摄像头传感器采集的视频图像获取第三分辨率的人工智能AI流;其中,第三分辨率小于第一分辨率;视频处理器,还用于根据AI流对摄像头传感器采集的视频图像进行图像增强处理。
结合第五方面,在一种可能的设计方式中,视频处理器与主处理器之间通过通用串行总线USB连接。
第六方面,本申请实施例提供一种电子设备,该电子设备可以实现上述第一方面、第二方面或第三方面及其可能的设计方式所述的拍照方法,其可以通过软件、硬件、或者通过硬件执行相应的软件实现上述方法。在一种可能的设计中,该电子设备可以包括处理器和存储器。该处理器被配置为支持该电子设备执行上述第一方面、第二方面或第三方面方法中相应的功能。存储器用于与处理器耦合,其保存该电子设备必要的程序指令和数据。
第七方面,本申请实施例提供一种计算机可读存储介质,该计算机可读存储介质包括计算机指令,当所述计算机指令在电子设备上运行时,使得电子设备执行如上述第一方面、第二方面或第三方面及其可能的设计方式所述的拍照方法。
第八方面,本申请实施例提供一种计算机程序产品,当所述计算机程序产品在计算机上运行时,使得所述计算机执行如上述第一方面、第二方面或第三方面及其可能的设计方式所述的拍照方法。
第四方面所述的电子设备,第五方面所述的电子设备,第六方面所述的电子设备,第七方面所述的计算机可读存储介质,第八方面所述的计算机程序产品所带来的技术效果可参见上述对应的方法所带来的技术效果,此处不再赘述。
图1为现有技术中一种拍照方法示意图;
图2为本申请实施例提供的一种电子设备的硬件结构的组成示意图;
图3为本申请实施例提供的拍照方法示意图一;
图4为本申请实施例提供的拍照方法示意图二;
图5A为本申请实施例提供的拍照方法流程图一;
图5B为本申请实施例提供的拍照方法流程图二;
图6为本申请实施例提供的一种电子设备的显示界面实例示意图一;
图7为本申请实施例提供的一种电子设备的显示界面实例示意图二;
图8为本申请实施例提供的一种电子设备的结构组成示意图。
本申请实施例提供的拍照方法,可以应用于任意摄像头和设备主体间基于USB双栈架构传输的电子设备。比如,该电子设备可以为智慧屏(也可以称为大屏或智能电视)、个人计算机(person computer,PC)、笔记本电脑、智能家居设备等,本申请实施例对该电子设备100的具体形式不做特殊限制。
请参考图2,其示出了本申请实施例提供的一种电子设备100的结构示意图。其中,电子设备100可以包括设备主体110和摄像头120。其中,设备主体110包括主处理器111, 视频处理器122存储器112,音频模块113,扬声器113A,显示屏114,无线通信模块115,接口模块116,电源模块117摄像头120等;摄像头120包括传感器121和视频处理器122。
在一些实施例中,摄像头120是可升降的。摄像头120可以升起,从而与设备主体110分离;或者摄像头120也可以降落回设备主体110内。可选的,视频处理器122可以位于摄像头120内,随着摄像头120升起,与设备主体110分离。可选的,视频处理器122也可以位于设备主体110内,不随着摄像头120的升降而升降,即升降摄像头120相当于升降传感器121。
可以理解的是,本发明实施例示意的结构并不构成对电子设备100的具体限定。在本申请另一些实施例中,电子设备100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以是硬件,软件或软件和硬件的组合实现。
主处理器111可以包括一个或多个处理器,例如:主处理器111可以包括应用处理器,图形处理器(graphics processing unit,GPU),控制器,视频编解码器,和/或数字信号处理器(digital signal processor,DSP)等。其中,不同的处理器可以是独立的器件,也可以集成在一个或多个处理器中。比如,该主处理器111的功能可以由一个集成的主芯片实现。
其中,控制器可以是电子设备100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
应用处理器上可以安装有电子设备100的操作系统,用于管理电子设备100的硬件与软件资源。比如,管理与配置内存、决定系统资源供需的优先次序、管理文件系统、管理驱动程序等。操作系统也可以用于提供一个让用户与系统交互的操作界面。其中,操作系统内可以安装各类软件,比如,驱动程序,应用程序(application,App)等。示例性的,操作系统内可以安装“相机”、“时钟”、“健身”、“视频”等App。
数字信号处理器用于处理数字信号,除了可以处理数字图像信号,还可以处理其他数字信号。
视频编解码器用于对数字视频压缩或解压缩。电子设备100可以支持一种或多种视频编解码器。这样,电子设备100可以播放多种编码格式的视频。
图形处理器用于进行图像和图形相关运算工作。
存储器112,用于存储指令和数据。在一些实施例中,存储器112为高速缓冲存储器。该存储器可以保存主处理器111使用过或循环使用的指令或数据。如果主处理器111需要再次使用该指令或数据,可从存储器112中直接调用。避免了重复存取,减少了主处理器111的等待时间,因而提高了系统的效率。
在一些实施例中,存储器112也可以设置于主处理器111中,即主处理器111包括存储器112。本申请实施例对此不进行限定。
音频模块113用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块113还可以用于对音频信号编码和解码。在一些实施例中,音频模块113可以设置于主处理器111中,或将音频模块113的部分功能模块设置于主处理器111中。
扬声器113A,也称“喇叭”,用于将音频电信号转换为声音信号。
电子设备100可以通过音频模块113,扬声器113A,以及应用处理器等实现音频功能。 例如声音播放等。
电子设备100通过GPU,显示屏114,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏114和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。主处理器111可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏114用于显示图像,视频等。显示屏114包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot light emitting diodes,QLED)等。本申请实施例中,显示屏114可以用于显示App界面、拍照预览界面、照片等。
电子设备100可以通过视频处理器122,摄像头120,视频编解码器,GPU,显示屏114以及应用处理器等实现拍摄功能。
无线通信模块115可以提供应用在电子设备100上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,WiFi)网络),蓝牙(bluetooth,BT),调频(frequency modulation,FM),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块115可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块115经由天线接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到主处理器111。
接口模块116可以包括网线接口、USB接口、音频输出接口、高清多媒体接口(high definition multimedia interface,HDMI)、存储卡接口等。网线接口可以插入网线。网线的一端插入电子设备100的网线接口,另一端插入有线网络接口,电子设备100即接入了有线网络。USB接口是符合USB标准规范的接口,具体可以是Mini USB接口,Micro USB接口,USB Type C接口等。USB接口可以用于电子设备100与外围设备之间传输数据;比如,电子设备100可以通过USB接口连接外部存储设备,外接摄像头,游戏手柄等。设备音频输出接口用于连接外部音频设备,比如,可以用于连接音箱。HDMI是一种全数字化视频和声音发送接口,可以同时发送未压缩的音频及视频信号;比如,电子设备100可以通过HDMI接口连接有线机顶盒、网络机顶盒、音箱等设备。存储卡接口用于连接外部存储卡,例如Micro SD卡,实现扩展电子设备100的存储能力。
电源模块117,可以用于向电子设备100包含的各个部件供电。
摄像头120用于捕获静态图像或视频。物体通过镜头生成光学图像投射到传感器121。传感器121可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。传感器121把光信号转换成电信号,之后将电信号传递给视频处理器122转换成数字图像信号。视频处理器122将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。视频处理器122用于处理传感器121反馈的数据。例如,拍照时,打开快门,光线通过镜头被传递到传感器121上,光信号转换为电信号,传感器121将所述电信号传递给视频处理器122处理,转化为肉眼可见的图像。视频处理器122还可以对图像的噪点,亮度,肤色进行算法优化。视频处理器122还可以对拍摄场景的曝光,色温等参数优化。
通常,电子设备100会配有一遥控器。该遥控器用于控制电子设备100。示例性的, 如图2,遥控器200可以包括多个按键,比如,向上键201,向下键202,向左键203,向右键204,确定键205,菜单键206,电源键207等。遥控器200上的按键可以是机械按键,也可以是触摸式按键。遥控器200可以接收按键输入,产生与电子设备100的用户设置以及功能控制有关的键信号输入,并向电子设备100发送相应的信号,以控制电子设备100。比如,当用户按压向上键201,向下键202,向左键203,向右键204,确定键205,菜单键206或电源键207时,该按键可以发出对应的信号;并通过蓝牙、红外等方式向电子设备100发送信号。电子设备100通过无线通信模块115(比如,蓝牙、IR)接收到按键对应的信号,则可以根据该信号执行相应的操作。示例性的,电子设备100接收到向上键201对应的信号,可以触发电子设备100显示界面的焦点上移;电子设备100接收到向下键202对应的信号,可以触发电子设备100显示界面的焦点下移;电子设备100接收到向左键203对应的信号,可以触发电子设备100显示界面的焦点左移;电子设备100接收到向右键204对应的信号,可以触发电子设备100显示界面的焦点右移;电子设备100接收到确定键205对应的信号,可以触发选中电子设备100显示界面的焦点;电子设备100接收到菜单键206对应的信号,可以触发电子设备100显示菜单页面(比如显示家庭相机设置界面);电子设备100接收到电源键207对应的信号,可以触发电子设备100开机或关机。
可以理解的,遥控器200还可以包括其他按键和部件,比如主页键、音量键、返回键、蓝牙接口、红外接口、电池收纳腔(用于安装电池,为遥控器供电)等。本申请实施例不再赘述。
在一些实施例中,摄像头120通过USB接口与设备主体110连接。在一种示例中,摄像头120的视频处理器122和设备主体110的主处理器111间通过USB接口连接。在一些实施例中,请参考图3,视频处理器122和主处理器111间的USB传输通道采用双栈架构。示例性的,视频处理器122和主处理器111间包括两个传输通道;一个传输通道基于UVC协议,另一传输通道基于远程网络驱动程序接口规范(remote network driver interface specification,RNDIS)。在一种实现方式中,在拍照预览过程中,摄像头120将预览视频流通过第一传输通道(比如UVC通道)传输至主处理器111进行渲染。拍照时,拍照流通过第二传输通道(比如RNDIS通道)传输至主处理器111进行保存。示例性的,UVC通道传输较低分辨率的视频流,可以降低时延,获得更好的实时性体验;RNDIS通道传输较高分辨率的拍照流,可以获得像素较高的照片。
本申请实施例提供的拍照方法,在USB接口采用不同的传输通道传输视频流和拍照流,这样可以采用低分辨率高传输速率传输视频流,采用高分辨率低传输速率传输拍照流;在不增加硬件成本的条件下,以较低的内存和功耗完成超清照片的获取,并且不影响视频流帧率和实时性。
在一些实施例中,请参考图4,视频处理器122包括视频输入(video input,VI)处理单元401,视频处理子系统(video process sub system,VPSS)402,增强算法单元403和人工智能(artificial intelligence,AI)处理单元404。
摄像头传感器121采集视频图像,形成预览图像数据。VI处理单元401对该预览图像数据进行预处理获得预览视频流。比如,所述预处理可以包括滤波降噪、目标增强、图像分割等处理。
VPSS402根据该预览视频流获取视频流和拍照流。可选的,还可以根据该预览视频流 获取AI流等。其中,视频流用于拍照预览;拍照流用于获取照片;AI流用于人工智能运算,比如人脸识别。例如电子设备可以基于AI流进行人脸识别,然后基于人脸识别的结果对视频流中的人脸进行美肤、美颜或其它图像处理。VPSS402分别配置视频流、拍照流以及AI流的分辨率和传输速率。在一种示例中,视频流采用第一分辨率和第一传输速率,拍照流采用第二分辨率和第二传输速率,AI流采用第三分辨率和第三传输速率。在一种实现方式中,第一分辨率小于第二分辨率且大于第三分辨率,第一传输速率等于第三传输速率且大于第二传输速率。比如,第一分辨率为2560x1920,第一传输速率为30fps(每秒传输帧数,frames per second);第二分辨率为5632x4224,第二传输速率为2fps;第三分辨率为1920x1080,第三传输速率为30fps。
在一种实现方式中,拍照预览过程中,摄像头传感器以第二分辨率采集视频图像,获得预览视频流;VPSS402将预览视频流的分辨率压缩至第一分辨率形成视频流;采用视频编码方法对该视频流编码;并采用第一传输速率通过第一传输通道(比如UVC通道)将视频流发送至主处理器;主处理器对解码后的视频流进行渲染,完成拍照预览。示例性的,视频编码方法可以包括H265、H264等。这样,视频流采用较低分辨率和高传输速率进行传输,可以保证视频流清晰度及流畅性。
在一种实现方式中,拍照时,VPSS402截取预览视频流的一帧或多帧图像形成拍照流;增强算法单元403采用图像增强算法对该拍照流进行图像增强处理;采用图像编码方法对图像增强处理后的拍照流进行编码;并采用第二传输速率通过第二传输通道(比如RNDIS通道)发送至主处理器;主处理器保存解码后的拍照流,完成拍照。示例性的,图像增强算法可以包括直方图均衡算法、灰度变换算法、图像平滑算法、图像锐化算法等。图像编码方法可以包括MJPEG(motion joint photographic experts group)、JPEG(joint photographic experts group)等。这样,拍照流采用高分辨率,可以实现获取超清照片;并且,仅在拍照时使能获取拍照流,可以节省内存并降低功耗。
在一种实现方式中,VPSS402截取预览视频流的一帧或多帧图像,并将图像分辨率压缩至第三分辨率形成AI流;AI处理单元404根据AI流进行AI处理(比如人脸识别)。在一种实现方式中,VI处理单元401根据AI处理单元404的计算结果对预览图像数据进行预处理。比如,VI处理单元401根据AI处理单元404计算出的人脸数据,对图像整体曝光进行调整,提高人脸亮度等。根据AI处理单元404的计算结果对预览图像数据进行预处理,提高了预览视频和照片的观感,提升用户体验;AI流采用较低分辨率和较高传输速率,可以提升AI计算速度,提高了实时性。
下面结合附图详细介绍本申请实施例提供的一种拍照方法及电子设备。
本申请实施例提供一种拍照方法,如图5A所示,该方法可以包括:
S501、接收用户打开相机App的指令。
在一种实现方式中,电子设备(例如智慧屏)接收用户打开相机App的操作。示例性的,用户打开智慧屏的“家庭相机”App。如图6所示,智慧屏显示“全部应用”界面601,“全部应用”界面601包括“家庭相机”图标602,用户可以选中“家庭相机”图标602来打开“家庭相机”App。智慧屏可以接收用户对“家庭相机”图标602的选中操作。智慧屏接收到用户对“家庭相机”图标602的选中操作,即接收到用户打开相机App的操作。
在一种示例中,智慧屏显示“全部应用”界面601,落焦于第1个图标“AI健身”。 用户可以通过按下遥控器(比如图2所示遥控器200)的向右键(比如图2所示向右键204)使焦点右移;当焦点落焦于“家庭相机”图标602时,用户按下遥控器(比如图2所示遥控器200)的确定键(比如图2所示确定键205)。智慧屏通过无线通信模块115(比如蓝牙)接收到确定键205对应的信号,即接收到用户对“家庭相机”图标602的选中操作。
响应于接收到用户对“家庭相机”图标602的选中操作,智慧屏显示“拍照预览”界面603。“拍照预览”界面603可以包括但不限于“拍照”选项604,“录像”选项605,“相框”选项606等;“拍照”选项604用于启动拍照,“录像”选项605用于启动录像,“相框”选项606用于切换照片相框。
在一种示例中,“全部应用”界面601还包括“家庭相册”图标607,用户可以选中“家庭相册”图标607打开家庭相册,查看已保存至智慧屏的照片。比如,用户选中“拍照”选项604启动拍照,智慧屏进行拍照,并保存照片。用户可以打开家庭相册查看拍摄的照片。
需要说明的是,本申请实施例以遥控器控制智慧屏为例进行示例性说明。可以理解的,本申请实施例中电子设备可以通过其他方式进行控制。比如,可以通过手机App打开电子设备的相机App,启动拍照,移动显示屏上的焦点等;或者可以通过语音控制打开电子设备的相机App,启动拍照等。本申请实施例对于控制电子设备(比如打开相机App,启动拍照)的具体方式并不进行限定。
S502、响应于接收到用户打开相机App的指令,相机App向UVC通道发送第一预览指令,向RNDIS通道发送第二预览指令。
在一种实现方式中,响应于接收到用户打开相机App的操作,相机App向UVC通道发送第一预览指令,第一预览指令用于指示启动拍照预览。在一种实现方式中,第一预览指令包括第一分辨率。相机App向RNDIS通道发送第二预览指令,第二预览指令用于指示启动拍照预览。在一种实现方式中,第二预览指令包括第二分辨率。可以理解的,相机App安装在主处理器的操作系统内。相机App向UVC通道发送第一预览指令,即主处理器向UVC通道发送第一预览指令;相机App向RNDIS通道发送第二预览指令,即主处理器向RNDIS通道发送第二预览指令。
在一种实现方式中,第一分辨率和第二分辨率为默认值;比如第一分辨率为第一默认值(比如2560x1440),第二分辨率为第二默认值(比如5632x3168)。
在一种实现方式中,可以根据用户的选择,修改第一分辨率和第二分辨率的值。在一种示例中,如图7所示,智慧屏显示“拍照预览”界面603。在该界面,接收用户按下遥控器(比如图2所示遥控器200)的菜单键(比如图2所示菜单键206)对应的信号。响应于接收到菜单键对应信号,智慧屏显示“家庭相机设置”界面701。“家庭相机设置”界面701可以包括“照片分辨率”选项702,“照片分辨率”选项702用于设置相机拍摄照片的分辨率。智慧屏可以接收用户对“照片分辨率”选项702的选中操作,响应于用户对“照片分辨率”选项702的选中操作,显示“照片分辨率”界面703。“照片分辨率”界面703可以包括多个分辨率选项。比如,“照片分辨率”界面703可以包括“18MP”选项704,“4MP”选项705,“24MP”选项706和“6MP”选项707;分别对应1800万像素,400万像素,2400万像素,600万像素。在一种示例中,智慧屏默认选项为“18MP”选项704,表示用1800万像素按16:9宽高比拍摄照片;其对应的第二分辨率为5632x3168,对应的第一分辨 率可以为2560x1440。示例性的,智慧屏接收到用户对“24MP”选项706的选中操作,“24MP”选项表示用2400万像素按4:3宽高比拍摄照片,对应的第二分辨率为5632x4224。响应于接收到用户对“24MP”选项706的选中操作,智慧屏确定第二分辨率为5632x4224。智慧屏确定第一分辨率的值,第一分辨率小于第二分辨率,比如,第一分辨率可以为2560x1980。
S503、UVC通道向VI处理单元发送第一预览指令,RNDIS通道向VI处理单元发送第二预览指令。
S504、VI处理单元向摄像头传感器发送第三预览指令。
VI处理单元接收第一预览指令,根据第一预览指令获取第一分辨率;VI处理单元接收第二预览指令,根据第二预览指令获取第二分辨率。
VI处理单元向摄像头传感器发送第三预览指令,第三预览指令用于指示启动拍照预览。在一种实现方式中,第三预览指令包括第二分辨率。
S505、摄像头传感器启动拍照预览,采集视频图像。
摄像头传感器接收第三预览指令,启动拍照预览。在一种实现方式中,摄像头传感器以第二分辨率采集视频图像,形成预览图像数据。
S506、摄像头传感器向VI处理单元发送预览图像数据。
S507、VI处理单元根据预览图像数据获取预览视频流。
VI处理单元接收预览图像数据,对该预览图像数据进行预处理获得预览视频流。比如,VI处理单元可以对预览图像数据进行滤波降噪、目标增强、图像分割等处理。示例性的,VI处理单元根据AI处理单元计算出的人脸数据,对预览图像数据整体曝光进行调整,提高图像中的人脸亮度。
S508、VI处理单元向VPSS发送第四预览指令。
第四预览指令用于指示启动拍照预览。在一种实现方式中,第四预览指令包括第一分辨率和第二分辨率。
S509、VI处理单元向VPSS发送预览视频流。
S50a、VPSS根据预览视频流获取视频流,发送该视频流至UVC通道。
在一种实现方式中,VPSS接收到预览视频流,该预览视频流的分辨率为第二分辨率。VPSS将预览视频流的分辨率压缩至第一分辨率,形成视频流;并发送该视频流至UVC通道。
S50b、视频流通过UVC通道发送至相机App。
该视频流的分辨率为第一分辨率。在一种实现方式中,视频流通过UVC通道,以第一传输速率发送至相机App。
S50c、相机App对该视频流进行渲染播放。
相机App接收视频流,主处理器对该视频流进行渲染。主处理器通过显示屏播放该渲染的视频流,即显示拍照预览界面;拍照预览界面的分辨率为第一分辨率。
S50d、接收用户的拍照指令。
在一种实现方式中,智慧屏接收用户的拍照操作。示例性的,智慧屏显示图6所示“拍照预览”界面603。“拍照预览”界面603包括“拍照”选项604,用户可以选中“拍照”选项604来启动拍照。智慧屏可以接收用户对“拍照”选项604的选中操作。智慧屏接收到用户对“拍照”选项604的选中操作,即接收到用户的拍照操作。
可以理解的,用户还可以通过手机App、语音等方式发送拍照指令,本申请实施例对此并不进行限定。
S50e、响应于接收到用户的拍照指令,相机App向RNDIS通道发送拍照指令。
在一种实现方式中,响应于接收到用户的拍照操作,相机App(主处理器)向RNDIS通道发送拍照指令。在一种实现方式中,该拍照指令包括第二分辨率。
S50f、RNDIS通道向VPSS发送拍照指令。
S50g、VPSS根据预览视频流获取拍照流。
VPSS接收拍照指令后,截取预览视频流的一帧或多帧图像形成拍照流。该预览视频流和拍照流的分辨率为第二分辨率。可以理解的,在预览过程中,摄像头传感器持续采集图像,并形成预览视频流。VPSS接收拍照指令后,截取当前的预览视频流的一帧或多帧图像形成拍照流。
S50h、VPSS发送拍照流至RNDIS通道。
在一种实现方式中,VPSS获取的拍照流经过图像增强处理后发送至RNDIS通道。
S50i、拍照流通过RNDIS通道发送至相机App。
拍照流通过RNDIS通道,以第二传输速率发送至相机App。
S50j、相机App保存照片。
相机App接收拍照流,保存为照片;照片的分辨率为第二分辨率。示例性的,用户可以打开家庭相册,查看已保存的照片。
需要说明的是,本申请实施例并不限定上述各个步骤的先后顺序。示例性的,VI处理单元可以先执行S504,向摄像头传感器发送第三指令,再执行S508,向VPSS发送第四指令;也可以先执行S508,向VPSS发送第四指令,再执行S504,向摄像头传感器发送第三指令;上述步骤的先后顺序并不影响本申请实施例的效果。
本申请实施例提供了一种拍照方法,摄像头按照照片的高分辨率采集图像后,通过第一传输通道以较低的分辨率和较高的传输速率传输视频流至主处理器;通过第二传输通道以较高的分辨率和较低的传输速率传输拍照流至主处理器,照片的分辨率不受预览视频分辨率的限制。这样,既可以获取超清照片,还可以保证预览视频的清晰和流畅。
本申请实施例还提供一种拍照方法,如图5B所示,该方法可以包括:
S511、接收用户打开相机App的指令。
S511的具体步骤可以参考S501,此处不再赘述。
S512、响应于接收到用户打开相机App的指令,相机App向UVC通道发送第一预览指令。
在一种实现方式中,响应于接收到用户打开相机App的操作,相机App向UVC通道发送第一预览指令,第一预览指令用于指示启动拍照预览。可以理解的,相机App安装在主处理器的操作系统内。相机App向UVC通道发送第一预览指令,即主处理器向UVC通道发送第一预览指令。在一种实现方式中,第一预览指令包括第一分辨率。在一种实现方式中,第一分辨率为默认值;比如第一分辨率为第一默认值(比如2560x1440)。在另一种实现方式中,根据用户的选择确定第一分辨率的值。示例性的,请参考图7,“照片分辨率”界面703包括多个分辨率选项。用户可以选择一个选项作为照片分辨率。比如,“照片分辨率”界面703可以包括“18MP”选项704,“4MP”选项705,“24MP”选项706和 “6MP”选项707;分别对应1800万像素,400万像素,2400万像素,600万像素。在一种示例中,“18MP”选项704表示用1800万像素按16:9宽高比拍摄照片;其对应的照片分辨率为5632x3168,对应的第一分辨率为2560x1440。
S513、UVC通道向VI处理单元发送第一预览指令。
S514、VI处理单元向摄像头传感器发送第一预览指令。
S515、摄像头传感器启动拍照预览,以第一分辨率采集视频图像。
摄像头传感器接收到第一预览指令,根据第一预览指令获取第一分辨率,并以第一分辨率采集视频图像,形成预览图像数据。
S516、摄像头传感器向VI处理单元发送预览图像数据。
S517、VI处理单元根据预览图像数据获取预览视频流。
S517的具体步骤可以参考S507,此处不再赘述。
S518、VI处理单元向VPSS发送预览视频流。
S519、VPSS将预览视频流发送至UVC通道。
S51a、预览视频流通过UVC通道发送至相机App。
该视频流的分辨率为第一分辨率。在一种实现方式中,视频流通过UVC通道,以第一传输速率(比如30fps)发送至相机App。
S51b、相机App对该视频流进行渲染播放。
S51c、接收用户的拍照指令。
S51b-S51c的具体步骤可以参考S50c-S50d,此处不再赘述。
S51d、响应于接收到用户的拍照指令,相机App向RNDIS通道发送拍照指令。
在一种实现方式中,响应于接收到用户的拍照指令,相机App向RNDIS通道发送拍照指令。在一种实现方式中,该拍照指令包括第二分辨率;其中,第二分辨率大于第一分辨率。示例性的,第二分辨率为5632x3168。可以理解的,相机App安装在主处理器的操作系统内。相机App向RNDIS通道发送拍照指令,即主处理器向RNDIS通道发送拍照指令。
S51e、RNDIS通道向VI处理单元发送拍照指令。
在一种实现方式中,拍照指令包括第二分辨率。
S51f、VI处理单元向摄像头传感器发送拍照指令。
S51g、摄像头传感器以第二分辨率采集视频图像。
摄像头传感器接收拍照指令,根据拍照指令获取第二分辨率,并以第二分辨率采集视频图像形成第二预览图像数据。
S51h、摄像头传感器向VI处理单元发送第二预览图像数据。
S51i、VI处理单元根据第二预览图像数据获取第二预览视频流。
VI处理单元接收第二预览图像数据,对该第二预览图像数据进行预处理获得第二预览视频流。比如,VI处理单元可以对第二预览图像数据进行滤波降噪、目标增强、图像分割等处理。
S51j、VI处理单元向VPSS发送拍照指令。
S51k、VI处理单元向VPSS发送第二预览视频流。
S51m、VPSS根据第二预览视频流获取拍照流。
VPSS接收拍照指令后,截取第二预览视频流的一帧或多帧图像形成拍照流。该第二预览视频流和拍照流的分辨率为第二分辨率。
可选的,VPSS将第二预览视频流的分辨率压缩至第一分辨率,形成第二视频流;并发送该第二视频流至UVC通道。第二视频流通过UVC通道发送至相机App。相机App接收第二视频流,对第二视频流进行渲染。智慧屏的显示屏播放该渲染的第二视频流,即显示拍照预览界面;拍照预览界面的分辨率为第一分辨率。
S51n、VPSS发送拍照流至RNDIS通道。
在一种实现方式中,VPSS获取的拍照流经过图像增强处理后发送至RNDIS通道。
S51p、拍照流通过RNDIS通道发送至相机App。
在一种实现方式中,拍照流通过RNDIS通道,以第二传输速率发送至相机App。其中,第二传输速率小于第一传输速率,比如,第二传输速率为2fps。这样,拍照流通过RNDIS通道以较高的分辨率以及较低的传输速率发送,可以实现获取高清照片。
S51q、相机App保存照片。
相机App接收拍照流,保存为照片;照片的分辨率为第二分辨率。示例性的,用户可以打开家庭相册,查看已保存的照片。
本申请实施例提供了一种拍照方法,在拍照预览阶段,摄像头以低分辨率采集图像,通过第一传输通道以较低的分辨率和较高的传输速率传输视频流至主处理器;保证视频流畅性。在拍照时,摄像头以高分辨率采集图像,通过第二传输通道以较高的分辨率和较低的传输速率传输拍照流至主处理器,实现获取高清照片。这样,既可以获取超清照片,还可以保证预览视频的清晰和流畅。
可以理解的是,上述电子设备为了实现上述功能,其包含了执行各个功能相应的硬件结构和/或软件模块。可以理解的,结合本文中所公开的实施例描述的各示例的单元及算法步骤,本申请实施例能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请实施例的范围。
本申请实施例可以根据上述方法示例对上述电子设备进行功能模块的划分,例如,可以对应各个功能划分各个功能模块,也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。需要说明的是,本申请实施例中对模块的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。
在采用集成的单元的情况下,图8示出了上述实施例中所涉及的电子设备的一种可能的结构示意图。该电子设备800包括:摄像头810和设备主体820;其中,摄像头810包括传感器811和第一处理单元812;设备主体820包括第二处理单元821和显示单元822。摄像头810和设备主体820之间可以通过第一通道831或者第二通道832交互数据;具体的,第一处理单元812和第二处理单元821之间通过第一通道831或者第二通道832交互数据。
其中,传感器811用于采集图像。例如,可以用于执行图5A中,S505和S506的处理步骤;或者图5B中,S515、S516、S51g和S51h的处理步骤;和/或用于本文所描述的 技术的其它过程。
第一处理单元812,用于进行图像处理。例如,可以用于执行图5A中,S504、S507-S50a、50g和S50h的处理步骤;或者图5B中,S514、S517-S519、S51f和S51i-S51n的处理步骤;和/或用于本文所描述的技术的其它过程。
第一通道831,用于传输视频流和视频流相关指令。例如,可以用于执行图5A中,S503和S115b的处理步骤;或者图5B中,S513和S51a的处理步骤;和/或用于本文所描述的技术的其它过程。
第二通道832,用于传输拍照流和拍照流相关指令。例如,可以用于执行图5A中,S503、S50f和S50i的处理步骤;或者图5B中,S51e和S51p的处理步骤;和/或用于本文所描述的技术的其它过程。
第二处理单元821,用于对电子设备800的动作进行控制管理,以及与用户进行交互(比如接收用户指令等)。例如,可以用于执行图5A中,S501、S502、S50c-S50e和S50j的处理步骤;或者图5B中,S511、S512、S51b-S51d和S51q的处理步骤;和/或用于本文所描述的技术的其它过程。
显示单元822,用于显示电子设备800的显示界面,比如,可以用于显示拍照预览界面,设置界面,照片等。
当然,上述电子设备800中的单元模块包括但不限于上述传感器811、第一处理单元812、第一通道831、第二通道832、第二处理单元821和显示单元822。例如,电子设备800中还可以包括存储单元、通信单元、音频单元等。存储单元用于保存电子设备800的程序代码和数据。通信单元用于支持电子设备800与其他装置的通信。例如,可以用于接收遥控器的控制信号。音频单元用于播放声音等。
其中,传感器811可以是摄像头的传感器。第一处理单元812可以是视频处理器或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合,其可以实现或执行结合本申请公开内容所描述的各种示例性的逻辑方框,模块和电路。第一通道831和第二通道832可以是USB通道。第二处理单元821可以是处理器或控制器,例如可以是中央处理器(central processing unit,CPU),数字信号处理器(digital signal processor,DSP),专用集成电路(application-specific integrated circuit,ASIC),现场可编程门阵列(field programmable gate array,FPGA)或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。存储单元可以是存储器。通信单元可以是收发器、收发电路或通信接口等。显示单元822可以是显示屏。音频单元可以包括扬声器、受话器等。
例如,传感器811为图像采集传感器(如图2所示的传感器121),第一处理单元812为处理器(如图2所示的视频处理器122),第二处理单元821为处理器(如图2所示的主处理器111),存储单元可以为存储器(如图2所示的存储器112),通信单元可以为无线通信模块(如图2所示的无线通信模块115),显示单元822可以为显示屏(如图2所示的显示屏114),音频单元可以包括扬声器(如图2所示的扬声器113A)等。本申请实施例所提供的电子设备800可以为图2所示的电子设备100。其中,上述处理器、存储器和通信模块等可以耦合在一起,例如通过总线连接。
本申请实施例还提供一种计算机可读存储介质,该计算机可读存储介质中存储有计算机程序代码,当上述处理器执行该计算机程序代码时,电子设备执行图5A或图5B中的相 关方法步骤实现上述实施例中的方法。
本申请实施例还提供了一种计算机程序产品,当该计算机程序产品在计算机上运行时,使得计算机执行图5A或图5B中的相关方法步骤实现上述实施例中的方法。
其中,本申请实施例提供的电子设备800、计算机可读存储介质或者计算机程序产品均用于执行上文所提供的对应的方法,因此,其所能达到的有益效果可参考上文所提供的对应的方法中的有益效果,此处不再赘述。
通过以上的实施方式的描述,所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。
在本申请所提供的几个实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个装置,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是一个物理单元或多个物理单元,即可以位于一个地方,或者也可以分布到多个不同地方。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以使用硬件的形式实现,也可以使用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个可读取存储介质中。基于这样的理解,本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该软件产品存储在一个存储介质中,包括若干指令用以使得一个设备(可以是单片机,芯片等)或处理器(processor)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何在本申请揭露的技术范围内的变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。
Claims (16)
- 一种拍照方法,应用于电子设备,所述电子设备包括设备主体和与所述设备主体连接的摄像头,所述设备主体包括显示屏;其特征在于,所述方法包括:所述摄像头采集视频图像,并根据所述视频图像获取具有第一分辨率的视频流;所述摄像头通过第一传输通道传输所述视频流至所述设备主体;所述设备主体通过所述显示屏显示所述视频流;响应于所述设备主体接收到拍照指令,所述摄像头根据采集的视频图像获取具有第二分辨率的拍照流;其中,所述第二分辨率大于所述第一分辨率;所述摄像头通过第二传输通道传输所述拍照流至所述设备主体;所述第二传输通道与所述第一传输通道不同;所述设备主体根据所述拍照流获取照片。
- 根据权利要求1所述的方法,其特征在于,所述摄像头采集视频图像,并根据所述视频图像获取具有第一分辨率的视频流包括:所述摄像头以所述第二分辨率采集第一视频图像,对所述第一视频图像进行处理,获取具有所述第一分辨率的所述视频流;所述摄像头根据采集的视频图像获取具有第二分辨率的拍照流包括:所述摄像头根据所述第一视频图像获取具有所述第二分辨率的所述拍照流。
- 根据权利要求1所述的方法,其特征在于,所述摄像头采集视频图像,并根据所述视频图像获取具有第一分辨率的视频流包括:摄像头以所述第一分辨率采集第二视频图像,并根据所述第二视频图像获取具有所述第一分辨率的所述视频流;响应于所述设备主体接收到拍照指令,所述摄像头根据采集的视频图像获取具有第二分辨率的拍照流包括:响应于所述设备主体接收到所述拍照指令,所述摄像头以所述第二分辨率采集第一视频图像,并根据所述第一视频图像获取具有所述第二分辨率的所述拍照流。
- 根据权利要求2或3所述的方法,其特征在于,所述摄像头根据所述第一视频图像获取具有所述第二分辨率的所述拍照流包括:所述摄像头截取所述第一视频图像的一帧或多帧图像形成所述拍照流。
- 根据权利要求1-4任意一项所述的方法,其特征在于,所述摄像头通过第一传输通道传输所述视频流至所述设备主体包括:所述摄像头通过所述第一传输通道以第一传输速率传输所述视频流至所述设备主体;所述摄像头通过第二传输通道传输所述拍照流至所述设备主体包括:所述摄像头通过所述第二传输通道以第二传输速率传输所述拍照流至所述设备主体;其中,所述第二传输速率小于所述第一传输速率。
- 根据权利要求1-5任意一项所述的方法,其特征在于,所述方法还包括:所述摄像头根据采集的视频图像获取具有第三分辨率的人工智能AI流;其中,所述第三分辨率小于所述第一分辨率;所述摄像头根据所述AI流对所述采集的视频图像进行图像增强处理。
- 根据权利要求1-6任意一项所述的方法,其特征在于,所述摄像头与所述设备主体之间通过通用串行总线USB连接。
- 一种电子设备,其特征在于,包括:设备主体和与所述设备主体连接的摄像头,所述设备主体包括显示屏;所述摄像头,用于采集视频图像,并根据所述视频图像获取具有第一分辨率的视频流;所述摄像头,还用于通过第一传输通道传输所述视频流至所述设备主体;所述设备主体,用于通过所述显示屏显示所述视频流;所述设备主体,还用于接收拍照指令;所述摄像头,还用于响应于所述设备主体接收到所述拍照指令,根据所述摄像头采集的视频图像获取具有第二分辨率的拍照流;其中,所述第二分辨率大于所述第一分辨率;所述摄像头,还用于通过第二传输通道传输所述拍照流至所述设备主体;所述第二传输通道与所述第一传输通道不同;所述设备主体,还用于根据所述拍照流获取照片。
- 根据权利要求8所述的电子设备,其特征在于,所述摄像头,具体用于以所述第二分辨率采集第一视频图像;所述摄像头,具体还用于对所述第一视频图像进行处理,获取具有所述第一分辨率的所述视频流;所述摄像头,具体还用于根据所述第一视频图像获取具有所述第二分辨率的所述拍照流。
- 根据权利要求8所述的电子设备,其特征在于,所述摄像头,具体用于以所述第一分辨率采集第二视频图像,并根据所述第二视频图像获取具有所述第一分辨率的所述视频流;所述摄像头,具体还用于响应于所述设备主体接收到所述拍照指令,以所述第二分辨率采集第一视频图像,并根据所述第一视频图像获取具有所述第二分辨率的所述拍照流。
- 根据权利要求9或10所述的电子设备,其特征在于,所述摄像头根据所述第一视频图像获取具有所述第二分辨率的所述拍照流具体包括:所述摄像头截取所述第一视频图像的一帧或多帧图像形成所述拍照流。
- 根据权利要求8-11任意一项所述的电子设备,其特征在于,所述摄像头具体用于通过所述第一传输通道以第一传输速率传输所述视频流至所述设备主体;所述摄像头具体还用于通过所述第二传输通道以第二传输速率传输所述拍照流至所述设备主体;其中,所述第二传输速率小于所述第一传输速率。
- 根据权利要求8-12任意一项所述的电子设备,其特征在于,所述摄像头,还用于根据采集的视频图像获取具有第三分辨率的人工智能AI流;所述第三分辨率小于所述第一分辨率;所述摄像头,还用于根据所述AI流对所述采集的视频图像进行图像增强处理。
- 根据权利要求8-13任意一项所述的电子设备,其特征在于,所述摄像头与所述设备主体之间通过通用串行总线USB连接。
- 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质包括计算机指令,当所述计算机指令在电子设备上运行时,使得所述电子设备执行如权利要求1-7任意一项所述的方法。
- 一种计算机程序产品,其特征在于,当所述计算机程序产品在计算机上运行时,使得所述计算机执行如权利要求1-7任意一项所述的方法。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP21836976.7A EP4171010A4 (en) | 2020-07-10 | 2021-07-08 | PHOTOGRAPHY METHOD AND ELECTRONIC DEVICE |
JP2023501316A JP2023532815A (ja) | 2020-07-10 | 2021-07-08 | 写真撮影方法および電子デバイス |
US18/004,844 US20230262195A1 (en) | 2020-07-10 | 2021-07-08 | Photographing Method and Electronic Device |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010664485.X | 2020-07-10 | ||
CN202010664485.XA CN113923342A (zh) | 2020-07-10 | 2020-07-10 | 一种拍照方法及电子设备 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022007893A1 true WO2022007893A1 (zh) | 2022-01-13 |
Family
ID=79232248
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2021/105232 WO2022007893A1 (zh) | 2020-07-10 | 2021-07-08 | 一种拍照方法及电子设备 |
Country Status (5)
Country | Link |
---|---|
US (1) | US20230262195A1 (zh) |
EP (1) | EP4171010A4 (zh) |
JP (1) | JP2023532815A (zh) |
CN (1) | CN113923342A (zh) |
WO (1) | WO2022007893A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115065868A (zh) * | 2022-04-12 | 2022-09-16 | 北京字节跳动网络技术有限公司 | 图像处理方法、装置、设备、系统及介质 |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115525188A (zh) * | 2022-02-28 | 2022-12-27 | 荣耀终端有限公司 | 拍摄方法和电子设备 |
WO2024101747A1 (ko) * | 2022-11-07 | 2024-05-16 | 삼성전자 주식회사 | 카메라를 포함하는 웨어러블 전자 장치 및 이의 동작 방법 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103685943A (zh) * | 2013-11-22 | 2014-03-26 | 乐视致新电子科技(天津)有限公司 | 一种显示设备、图像采集控制装置以及方法 |
US20170142345A1 (en) * | 2008-02-28 | 2017-05-18 | Avigilon Analytics Corporation | Intelligent high resolution video system |
CN107241540A (zh) * | 2017-08-01 | 2017-10-10 | 哈尔滨市舍科技有限公司 | 一种双分辨率集成式全景摄像装置及方法 |
US20200221024A1 (en) * | 2019-01-07 | 2020-07-09 | Samsung Electronics Co., Ltd. | Image processors and image processing methods |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103402055A (zh) * | 2013-07-29 | 2013-11-20 | 广东欧珀移动通信有限公司 | 移动终端用摄像头芯片、带摄像功能的移动终端及其拍照方法和装置 |
US10078644B1 (en) * | 2016-01-19 | 2018-09-18 | Gopro, Inc. | Apparatus and methods for manipulating multicamera content using content proxy |
US11190724B2 (en) * | 2017-03-10 | 2021-11-30 | Raytheon Company | Adaptive bitrate streaming of UHD image data |
CN110401798B (zh) * | 2019-07-30 | 2021-03-09 | 晶晨半导体(深圳)有限公司 | 一种mipi摄像头输出分辨率的调节方法及装置 |
-
2020
- 2020-07-10 CN CN202010664485.XA patent/CN113923342A/zh active Pending
-
2021
- 2021-07-08 US US18/004,844 patent/US20230262195A1/en active Pending
- 2021-07-08 WO PCT/CN2021/105232 patent/WO2022007893A1/zh unknown
- 2021-07-08 EP EP21836976.7A patent/EP4171010A4/en active Pending
- 2021-07-08 JP JP2023501316A patent/JP2023532815A/ja active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170142345A1 (en) * | 2008-02-28 | 2017-05-18 | Avigilon Analytics Corporation | Intelligent high resolution video system |
CN103685943A (zh) * | 2013-11-22 | 2014-03-26 | 乐视致新电子科技(天津)有限公司 | 一种显示设备、图像采集控制装置以及方法 |
CN107241540A (zh) * | 2017-08-01 | 2017-10-10 | 哈尔滨市舍科技有限公司 | 一种双分辨率集成式全景摄像装置及方法 |
US20200221024A1 (en) * | 2019-01-07 | 2020-07-09 | Samsung Electronics Co., Ltd. | Image processors and image processing methods |
Non-Patent Citations (1)
Title |
---|
See also references of EP4171010A4 |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115065868A (zh) * | 2022-04-12 | 2022-09-16 | 北京字节跳动网络技术有限公司 | 图像处理方法、装置、设备、系统及介质 |
Also Published As
Publication number | Publication date |
---|---|
EP4171010A1 (en) | 2023-04-26 |
US20230262195A1 (en) | 2023-08-17 |
EP4171010A4 (en) | 2023-11-29 |
JP2023532815A (ja) | 2023-07-31 |
CN113923342A (zh) | 2022-01-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2022007893A1 (zh) | 一种拍照方法及电子设备 | |
WO2021004381A1 (zh) | 一种投屏显示方法及电子设备 | |
WO2020063505A1 (zh) | 图像处理方法、系统及计算机可读存储介质 | |
WO2020063507A1 (zh) | 图像处理方法、系统及计算机可读存储介质 | |
WO2020097888A1 (zh) | 视频处理方法、装置、电子设备及计算机可读存储介质 | |
WO2020063508A1 (zh) | 智能终端、图像处理方法及计算机可读存储介质 | |
CN102694980A (zh) | 移动终端、移动终端摄像头的远程控制系统及方法 | |
US20230162324A1 (en) | Projection data processing method and apparatus | |
US20090041363A1 (en) | Image Processing Apparatus For Reducing JPEG Image Capturing Time And JPEG Image Capturing Method Performed By Using Same | |
WO2020063506A1 (zh) | 智能终端、图像处理方法及计算机可读存储介质 | |
WO2021168649A1 (zh) | 多功能接收设备和会议系统 | |
JP2001238190A (ja) | 画像処理装置及びその制御処理方法 | |
WO2020006657A1 (zh) | 视频拍摄处理方法、设备以及视频拍摄处理系统 | |
JP6319491B2 (ja) | 撮像装置及び制御方法 | |
KR100685300B1 (ko) | 인코딩된 데이터 전달 방법 및 그 방법을 수행하는 촬상장치 | |
JP6583458B2 (ja) | 撮像装置及び制御方法 | |
US7805069B2 (en) | Imaging device, system and associated methods using multiple harmonized data streams | |
JP4746106B2 (ja) | イメージシグナルプロセッサ及び垂直同期信号の遅延出力方法 | |
US20200294211A1 (en) | Image display apparatus, image supply apparatus, and control method thereof | |
JP6583457B2 (ja) | 撮像装置及び制御方法 | |
JP6119447B2 (ja) | 撮像システム、及び制御方法 | |
TWI543598B (zh) | 電視系統 | |
US10708862B2 (en) | Control apparatus for controlling plural process executing apparatuses | |
CN116634204A (zh) | 一种数据传输方法及电子设备 | |
WO2024146349A1 (zh) | 一种图像处理方法及装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21836976 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2023501316 Country of ref document: JP Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2021836976 Country of ref document: EP Effective date: 20230119 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |