WO2020248640A1 - Dispositif d'affichage - Google Patents

Dispositif d'affichage Download PDF

Info

Publication number
WO2020248640A1
WO2020248640A1 PCT/CN2020/079701 CN2020079701W WO2020248640A1 WO 2020248640 A1 WO2020248640 A1 WO 2020248640A1 CN 2020079701 W CN2020079701 W CN 2020079701W WO 2020248640 A1 WO2020248640 A1 WO 2020248640A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
display
aspect ratio
camera
user interface
Prior art date
Application number
PCT/CN2020/079701
Other languages
English (en)
Chinese (zh)
Inventor
于文钦
杨鲁明
朱铄
Original Assignee
海信视像科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 海信视像科技股份有限公司 filed Critical 海信视像科技股份有限公司
Publication of WO2020248640A1 publication Critical patent/WO2020248640A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H04N21/4438—Window management, e.g. event handling following interaction with the user interface
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4781—Games
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters

Definitions

  • This application relates to the technical field of smart TVs, and in particular to a display device.
  • the display device can provide users with playback screens such as audio, video, and pictures, it has received widespread attention from users.
  • playback screens such as audio, video, and pictures
  • users' demand for the functions of display devices is increasing day by day.
  • Current display devices especially household devices, such as smart TVs.
  • the actual shooting area of the camera is not consistent with the display area of the smart TV.
  • the current technology cannot capture and display images on the TV according to the aspect ratio required by the user.
  • An exemplary embodiment of the present application provides a display device for capturing and displaying an image according to an aspect ratio set by a user on the TV side.
  • a display device including:
  • Camera used to collect image data with the first aspect ratio
  • a display configured to display an image screen and a user interface, and a selector used in the user interface to indicate that an item is selected in the user interface;
  • a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller compares the controller with the second aspect ratio. Intercepting an image with a first aspect ratio collected by a camera, and displaying it according to the second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio;
  • an exemplary embodiment of the present application provides an image capturing method, including:
  • a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller compares the controller with the second aspect ratio. Intercepting an image with a first aspect ratio collected by a camera, and displaying it according to the second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio;
  • an exemplary embodiment of the present application provides a display device, which is characterized in that it includes:
  • Camera used to collect image data with the first aspect ratio
  • a display configured to display an image screen and a user interface, and a selector used in the user interface to indicate that an item is selected in the user interface;
  • a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller compares the controller with the second aspect ratio. Intercepting an image with a first aspect ratio collected by a camera, and displaying it according to the second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio;
  • an exemplary embodiment of the present application provides a display device, which is characterized in that it includes:
  • Camera used to collect image data with the first aspect ratio
  • a display configured to display an image screen and a user interface, and a selector used in the user interface to indicate that an item is selected in the user interface;
  • a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller according to the second aspect ratio. Intercepting the first aspect ratio image collected by the camera, and displaying according to a second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio;
  • a preview image in a user interface is displayed statically, and the display displays a first image of the first aspect ratio.
  • an exemplary embodiment of the present application provides a display device, which is characterized in that it includes:
  • a display configured to display an image screen and a user interface, and a selector used in the user interface to indicate that an item is selected in the user interface;
  • a controller in communication with the display the controller is configured to: receive a control signal input from a user input interface instructing to start the camera on or off;
  • a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller collecting the camera from the camera.
  • the first resolution image is intercepted and displayed according to the second resolution and according to the first frame rate, where the second resolution is different from the first resolution;
  • an exemplary embodiment of the present application provides an image capturing method, which is characterized in that the method includes:
  • a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller compares the controller with the second aspect ratio. Intercepting an image with a first aspect ratio collected by a camera, and displaying it according to the second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio;
  • an exemplary embodiment of the present application provides an image capturing method, which is characterized in that the method includes:
  • a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller according to the second aspect ratio.
  • the camera captures the first aspect ratio image for interception, and displays it according to a second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio;
  • a preview image in a user interface is displayed statically, and the display displays a first image of the first aspect ratio.
  • FIG. 1 exemplarily shows a schematic diagram of an operation scene between the display device 200 and the control device according to the embodiment
  • FIG. 2 exemplarily shows a configuration block diagram of the software system in the display device 200 according to the embodiment
  • FIG. 3 exemplarily shows a schematic diagram of application programs included in the application layer of the display device according to the embodiment
  • FIG. 4 exemplarily shows a schematic diagram of a user interface in the display device 200 according to the embodiment
  • 5 to 7 exemplarily show schematic diagrams of interaction between the user interface and the user in the display device 200 according to an exemplary embodiment
  • FIG. 8 exemplarily shows a schematic diagram of an image shooting method according to an exemplary embodiment
  • FIG. 9 exemplarily shows a schematic diagram of a comparison of the display ratio of the camera shooting area and the TV display area according to an exemplary embodiment
  • FIG. 10 exemplarily shows a schematic diagram of a process of capturing an image of a television display area according to an exemplary embodiment
  • 11 to 13 exemplarily show schematic diagrams of interaction between a user interface and a user in the display device 200 according to another exemplary embodiment
  • FIG. 14 exemplarily shows a schematic diagram of another image shooting method according to an exemplary embodiment
  • FIG. 15 exemplarily shows a flowchart of capturing an image of a display area of a camera according to an exemplary embodiment
  • FIG. 16 exemplarily shows a schematic diagram of a display device of an image capturing device according to an exemplary embodiment
  • Fig. 17 exemplarily shows a schematic diagram of another image capturing device according to an exemplary embodiment.
  • FIG. 18 exemplarily shows a schematic diagram of another image capturing device according to an exemplary embodiment
  • Fig. 19 exemplarily shows a schematic diagram of another image capturing device according to an exemplary embodiment.
  • FIG. 20 exemplarily shows a schematic diagram of another image capturing apparatus according to an exemplary embodiment.
  • FIG. 21 exemplarily shows a schematic diagram of another image capturing apparatus according to an exemplary embodiment.
  • module used in the various embodiments of this application can refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or a combination of hardware or/and software code that can execute related to the component Function.
  • remote control used in the various embodiments of this application refers to a component of an electronic device (such as the display device disclosed in this application), which can generally control the electronic device wirelessly within a short distance.
  • This component can generally use infrared and/or radio frequency (RF) signals and/or Bluetooth to connect with electronic devices, and can also include functional modules such as wireless network WiFi, wireless USB, Bluetooth, and motion sensors.
  • RF radio frequency
  • a handheld touch remote control uses a user interface in a touch screen to replace most of the physical built-in hard keys in general remote control devices.
  • gesture used in the embodiments of the present application refers to a user's behavior through a change of hand shape or hand movement to express expected ideas, actions, goals, and/or results.
  • FIG. 1 exemplarily shows a schematic diagram of an operation scene between the display device 200 and the control device according to the embodiment. As shown in FIG. 1, the user can operate the display device 200 by controlling the device 100.
  • the control device 100 may be a remote controller 100A, which can communicate with the display device 200 through infrared protocol communication, Bluetooth protocol communication, ZigBee protocol communication or other short-distance communication methods for wireless or other communication
  • the display device 200 is controlled in a wired manner.
  • the user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, etc.
  • the user can control the display device 200 by inputting corresponding control commands through the volume plus and minus keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, and switch buttons on the remote control. Function.
  • the control device 100 can also be a smart device, such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, etc., which can be connected through a local area network (LAN, Wide Area Network), a wide area network (WAN, Wide Area Network), and a wireless local area network ((WLAN) , Wireless Local Area Network) or other networks communicate with the display device 200, and realize the control of the display device 200 through an application program corresponding to the display device 200.
  • LAN Local area network
  • WAN Wide Area Network
  • WLAN wireless local area network
  • the application can provide users with various controls through an intuitive user interface (UI, User Interface) on the screen associated with the smart device.
  • UI User Interface
  • both the mobile terminal 100B and the display device 200 can install software applications, so that the connection and communication between the two can be realized through a network communication protocol, and the purpose of one-to-one control operation and data communication can be realized.
  • the mobile terminal 100B can establish a control command protocol with the display device 200, synchronize the remote control keyboard to the mobile terminal 100B, and control the display device 200 by controlling the user interface of the mobile terminal 100B; or the mobile terminal 100B
  • the audio and video content displayed on the screen is transmitted to the display device 200 to realize the synchronous display function.
  • the display device 200 can also communicate with the server 300 through multiple communication methods.
  • the display device 200 may be allowed to communicate with the server 300 via a local area network, a wireless local area network, or other networks.
  • the server 300 may provide various contents and interactions to the display device 200.
  • the display device 200 transmits and receives information, interacts with an Electronic Program Guide (EPG, Electronic Program Guide), receives software program updates, or accesses a remotely stored digital media library.
  • EPG Electronic Program Guide
  • the server 300 may be a group or multiple groups, and may be one or more types of servers.
  • the server 300 provides other network service content such as video on demand and advertising services.
  • the display device 200 may be a liquid crystal display, an organic light emitting diode (Organic Light Emitting Diode, OLED) display, a projection display device, or a smart TV.
  • OLED Organic Light Emitting Diode
  • the specific display device type, size, aspect ratio, etc. are not limited, and those skilled in the art can understand that the display device 200 can make some changes in performance and configuration as required.
  • the display device 200 may additionally provide a smart network TV function that provides a computer support function. Examples include Internet TV, Smart TV, Internet Protocol TV (IPTV, Interactive Personality TV), etc.
  • a smart network TV function that provides a computer support function. Examples include Internet TV, Smart TV, Internet Protocol TV (IPTV, Interactive Personality TV), etc.
  • the display device may be connected or provided with a camera, which is used to present the picture captured by the camera on the display interface of the display device or other display devices to realize interactive chats between users.
  • the picture captured by the camera can be displayed on the display device in full screen, half screen, or in any optional area.
  • the camera is connected to the monitor rear shell through a connecting plate, and is fixedly installed on the upper middle of the monitor rear shell.
  • a connecting plate As an installable method, it can be fixedly installed at any position of the monitor rear shell to ensure its It is sufficient that the image capture area is not blocked by the rear shell, for example, the image capture area and the display device have the same orientation.
  • the camera can be connected to the display rear shell through a connecting plate or other conceivable connectors.
  • the connector is equipped with a lifting motor.
  • the user wants to use the camera or has an application to use the camera
  • it can be raised above the display.
  • the camera is not needed, it can be embedded behind the back shell to protect the camera from damage.
  • the camera used in this application may have 16 million pixels to achieve the purpose of ultra-high-definition display. In actual use, a camera with higher or lower than 16 million pixels can also be used.
  • the content displayed in different application scenarios of the display device can be merged in many different ways, so as to achieve functions that cannot be achieved by traditional display devices.
  • the user can video chat with at least one other user while watching a video program.
  • the presentation of the video program can be used as the background picture, and the video chat window is displayed on the background picture.
  • At least one video chat is performed across terminals.
  • the user can video chat with at least one other user while entering the education application for learning.
  • students can realize remote interaction with teachers while learning content in educational applications. Visually, you can call this function "learning and chatting”.
  • a video chat is conducted with players entering the game.
  • players entering the game.
  • a player enters a game application to participate in a game, it can realize remote interaction with other players. Visually, you can call this function "watch and play".
  • the game scene is integrated with the video picture, and the portrait in the video picture is cut out and displayed on the game picture to improve user experience.
  • somatosensory games such as ball games, boxing games, running games, dancing games, etc.
  • human body postures and movements are acquired through the camera, body detection and tracking, and the detection of human bone key points data, and then the game Animations are integrated to realize games such as sports and dance scenes.
  • the user can interact with at least one other user in video and voice in the K song application.
  • multiple users can jointly complete the recording of a song.
  • the user can turn on the camera locally to obtain pictures and videos, which is vivid, and this function can be called "look in the mirror".
  • the mirror application is a newly added application in the social TV project.
  • the application supports camera image preview, face recognition, adding beauty filters, taking pictures, photo sharing and other functions; the method of taking pictures mentioned in this embodiment is mirroring Realized in application.
  • FIG. 2 exemplarily shows a configuration block diagram of a software system in the display device 200 according to an exemplary embodiment.
  • the operating system 2911 includes operating software for processing various basic system services and performing hardware-related tasks, and serves as a medium for completing data processing between application programs and hardware components.
  • part of the operating system kernel may include a series of software to manage the hardware resources of the display device and provide services for other programs or software codes.
  • part of the operating system kernel may include one or more device drivers, and the device drivers may be a set of software codes in the operating system to help operate or control devices or hardware associated with the display device.
  • the drive may contain code to manipulate video, audio, and/or other multimedia components. Examples include displays, cameras, Flash, WiFi, and audio drivers.
  • the accessibility module 2911-1 is used to modify or access the application program, so as to realize the accessibility of the application program and the operability of its display content.
  • the communication module 2911-2 is used to connect to other peripherals via related communication interfaces and communication networks.
  • the user interface module 2911-3 is used to provide objects that display the user interface for access by various applications, and can realize user operability.
  • the control application 2911-4 is used to control process management, including runtime applications.
  • the event transmission system 2914 can be implemented in the operating system 2911 or in the application 2912. In some embodiments, it is implemented in the operating system 2911 on the one hand, and implemented in the application program 2912 at the same time, for monitoring various user input events, and responding to the recognition results of various events or sub-events according to various events. And implement one or more sets of pre-defined operation procedures.
  • the event monitoring module 2914-1 is used to monitor input events or sub-events of the user input interface.
  • the event recognition module 2914-1 is used to input the definitions of various events to various user input interfaces, recognize various events or sub-events, and transmit them to the processing to execute the corresponding one or more groups of processing programs .
  • the event or sub-event refers to the input detected by one or more sensors in the display device 200 and the input of an external control device (such as the control device 100).
  • an external control device such as the control device 100.
  • various sub-events of voice input, gesture input sub-events of gesture recognition, and sub-events of remote control button command input of control devices include multiple forms, including but not limited to one or a combination of pressing up/down/left/right/, confirming keys, and pressing keys.
  • non-physical buttons such as moving, pressing, and releasing.
  • the interface layout management module 2913 which directly or indirectly receives various user input events or sub-events monitored by the event transmission system 2914, is used to update the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the container
  • the size, position, level, etc. of the interface are related to various execution operations.
  • FIG. 3 exemplarily shows a schematic diagram of the application programs included in the application program layer of the display device according to the exemplary embodiment, and the application program layer of the display device includes various application programs that can be executed on the display device 200.
  • the application layer 2912 may include, but is not limited to, one or more applications, such as: video-on-demand application, application center, game application, etc., live TV application, media center application, etc.
  • applications such as: video-on-demand application, application center, game application, etc., live TV application, media center application, etc.
  • Live TV applications can provide live TV through different sources.
  • a live TV application may use input from cable TV, wireless broadcasting, satellite services, or other types of live TV services to provide TV signals.
  • the live TV application can display the video of the live TV signal on the display device 200.
  • Video-on-demand applications can provide videos from different storage sources. Unlike live TV applications, VOD provides video display from certain storage sources. For example, the video on demand can come from the server side of cloud storage, and from the local hard disk storage that contains the stored video programs.
  • Media center applications can provide various multimedia content playback applications.
  • the media center can provide services that are different from live TV or video on demand, and users can access various images or audio through the media center application.
  • Application center can provide storage of various applications.
  • the application program may be a game, an application program, or some other application program that is related to a computer system or other device but can be run on a display device.
  • the application center can obtain these applications from different sources, store them in the local storage, and then run on the display device 200.
  • FIG. 4 exemplarily shows a schematic diagram of a user interface in the display device 200 according to an exemplary embodiment.
  • the user interface includes a view display area 201.
  • the view display area 201 includes layout of one or more different items.
  • the user interface also includes a selector indicating that the item is selected, and the position of the selector can be moved through user input to change the selection of different items.
  • the view display area 201 is a zoomable view display.
  • Scalable can mean that the size or proportion of the view display area 201 on the screen is scalable, or that the size or proportion of the items in the view display 201 on the screen is scalable.
  • Items refer to visual objects displayed in the view display area of the user interface of the display device 200 to represent corresponding content such as icons, thumbnails, and video clips.
  • the item can represent the image content or video clip of a movie, TV series, audio content of music, application program, or other user access content history information.
  • the item may indicate an interface or a set display of interfaces through which the display device 200 is connected to an external device, or may indicate the name of an external device connected to the display device, or the like.
  • the view display area can present the content of the video chat project or the content of the application layer project (for example, web video, video on demand (VOD) display, application program screen, etc.).
  • the application layer project for example, web video, video on demand (VOD) display, application program screen, etc.
  • “Selector” is used to indicate that any item has been selected, such as cursor or focus object. Positioning the selection information input according to the icon or menu position touched by the user in the display 200 can enable the display device 200 to display the movement of the focus object to select the control item, and select or control one or more items.
  • the focus object refers to the object that moves between items based on user input. For example, draw a thick line on the edge of the item to realize or identify the position of the focus object.
  • the focus form is not limited to examples. It can be a tangible or intangible form that can be recognized by the user, such as a cursor, such as a 3D deformation of the item, and the border line and size of the text or image of the focused item can also be changed. , Color, transparency, outline, and/or font.
  • the event transmission system 2914 can monitor the user input of each predefined event or sub-event, and directly or indirectly provide the interface layout management module 2913 with the control of the recognized event or sub-event.
  • the interface layout management module 2913 is used to monitor the state of the user interface (including the position and/or size, change process, etc. of the view partition, item, focus or cursor object, etc.), and according to the event or sub-event, the view display area can be modified The size, location, level and other layout of the display area, and/or, adjust or modify the size or/and location, quantity, type, content and other layouts of various items in the view display area.
  • modifying and adjusting the layout includes displaying or not displaying each view partition or the content of items in the view partition on the screen.
  • the user input interface is used to send the user's input signal to the controller, or to transmit the signal output from the controller to the user.
  • the control device (such as a mobile terminal or a remote control) may send input signals input by the user, such as a power switch signal, a channel selection signal, and a volume adjustment signal, to the user input interface, and then the user input interface forwards the input signal to the controller;
  • the control device may receive output signals such as audio, video, or data output from the user input interface processed by the controller, and display the received output signal or output the received output signal as audio or vibration.
  • the user may input a user command on a graphical user interface (GUI) displayed on the display 200, and the user input interface receives the user input command through the graphical user interface (GUI).
  • GUI graphical user interface
  • the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.
  • FIGS. 5-7 exemplarily show schematic diagrams of interaction between the user interface and the user in the display device 200 according to an exemplary embodiment; for example, as shown in FIGS. 5-7, a plurality of different items are arranged in the view display area 201, such as A preview screen is displayed on the first user interface 201-1 of the view display area 201.
  • the preview screen is an image and video stream obtained from a camera that is intercepted according to the aspect ratio of the display.
  • Figure 5 shows one of the preview screens of the shooting scene.
  • the displayed preview screen has multiple frames, here is an example of a frame selected)
  • the image mode selected by the user is "storage ratio-full screen" (the pixel ratio of image width and height is 16 :9).
  • the user clicks "photograph” in response to the photographing instruction, the user interface changes as shown in FIG. 6.
  • the user can click on "beauty filter” to add or change special effects on the preview screen, where the selectable special effects include beauty, filters, Stickers, etc.; users can also click "view pictures” to enter the album center;
  • the first user interface 201-1 displays a frame in the image data stream obtained when the user sends the "photograph” instruction.
  • the user can scan the code to share the picture, or click "Save” or restart.
  • Shoot when the user clicks "save", in response to the "save” instruction, the user interface changes to as shown in FIG. 7, the second user interface 201-2 in the view display area 201 displays the picture just saved.
  • the user can obtain a picture with a 16:9 display ratio of the TV display area.
  • the preview image is formed by the controller capturing the image obtained by the camera according to the second aspect ratio, and then continuously displaying it on the first user interface according to the preset frame rate
  • the second aspect ratio is the display aspect ratio.
  • the display aspect ratio is 16:9.
  • the picture has a resolution, which determines the aspect ratio of the image.
  • the ratio of the number of horizontal pixels to the number of vertical pixels can be referred to as the pixel ratio, and can also be referred to as the aspect ratio of the image.
  • the first resolution is the resolution of the image acquired by the camera
  • the first aspect ratio is the aspect ratio of the image acquired by the camera
  • the first aspect ratio is associated with the first resolution
  • the second resolution is the resolution of the display preview image
  • the second aspect ratio is the aspect ratio of the display preview image
  • the second aspect ratio is associated with the second resolution
  • the preview screen has special effects, which can be implemented by using the acquired data stream or image through an interface that calls a special effect algorithm.
  • the image storage ratio is a full-screen mode (the aspect ratio of the image storage is 16:9).
  • Fig. 8 exemplarily shows an image shooting method according to an exemplary embodiment, including:
  • S102 Display a preview image of the shooting scene of the camera on the TV side on the first user interface.
  • the preview image is that the controller captures the first aspect ratio image collected by the camera according to the second aspect ratio, and according to the second aspect ratio and according to the preset frame The second aspect ratio is different from the first aspect ratio.
  • the preview image is that the controller captures the first resolution image collected by the camera at the second resolution, and displays the image at the second resolution and the preset frame rate.
  • the second resolution is different from the first resolution.
  • the first aspect ratio corresponding to the first resolution is 4:3; the aspect ratio corresponding to the second resolution is 16:9.
  • a frame of the second resolution image in the preview screen is acquired, and the second resolution image is displayed on the display at the second frame rate .
  • the first user interface is a preview interface
  • the second user interface is a photo display interface
  • the preview screen is a screen captured according to a preset ratio.
  • the preset ratio is that the pixel ratio of the image width and height is 16:9; after the preview interface of the mirror application is opened on the TV side according to the user instruction, the camera uses the image width and height pixel ratio of 4:3
  • the original image is captured in proportion (the camera captures a video stream, and the video stream is composed of multiple frames of image data).
  • the system hardware abstraction layer captures the camera
  • the original image is intercepted according to the pixel ratio of 16:9, and the intercepted image is compressed and encoded, and transmitted to the upper application (example, social TV mirror application), and the upper application parses the image to a certain degree
  • the frame rate (the value of the frame rate is not limited here) is continuously displayed on the preview interface to form a camera preview screen.
  • the mirror application is a newly added application in the social TV project.
  • the application supports camera screen preview, face recognition, adding special effects such as beauty filters, taking pictures, and photo sharing.
  • the preview screen has special effects.
  • special effects include beauty, filters, stickers, etc.
  • the preview screen can have special effects or no special effects; if you need to add special effects to the preview screen, the camera object is provided by the special effect algorithm; the method of adding special effects to the video screen specifically includes: output the video screen to the texture control ;
  • the special effect algorithm recognizes the face on the texture control TextureView, adds special effects such as filter stickers, superimposes the added special effects on the texture of the video picture without any special effects, and synthesizes the new texture;
  • the texture is output to the display control, and the user can see the video preview screen with special effects on the preview interface.
  • the mirror application does not process the integrated special effects algorithm, and directly creates a camera object to control and manage the camera.
  • the Camera object is used to control the camera switch, configure the camera parameters, manage the camera start/stop preview, take pictures, etc.
  • Camera has many interfaces to manage the camera, configure parameters, start/stop preview, etc.
  • the takePicture interface is used to start taking pictures.
  • special effects are not preset in the mirror application, and no post-processing is required on the images taken by the camera.
  • the user can select the image storage ratio to full-screen mode, and can also increase or change the special effects of the preview screen; when the user clicks "photograph", it will receive A frame of image is acquired when the user's photographing instruction is received, the user interface is switched from the preview interface to the photo display interface, and the image is displayed on the photo display interface.
  • the first aspect ratio is 4:3.
  • the second aspect ratio is an aspect ratio at 16:9.
  • the aspect ratio of image width and height is 16:9, for example, the resolution of the image displayed on the second user interface may be 1920*1080.
  • FIG. 9 exemplarily shows a comparison diagram of the display ratio between the camera shooting area and the TV display area according to an exemplary embodiment. It can be seen from the figure that the actual shooting area of the camera angle of view is larger than the TV preview screen display area.
  • Fig. 10 exemplarily shows a flow chart of capturing images of the TV display area according to an exemplary embodiment.
  • the TV terminal receives an instruction from the user to open the TV side mirror application, and after entering the preview interface, the special effect algorithm interface is called to initialize Display the required controls and turn on the camera in the special effect algorithm.
  • the camera collects the original image according to the ratio of width and height of pixels to 4:3.
  • the system's HAL compares the original The image is intercepted according to the pixel ratio of width and height of 16:9, and the intercepted image is compressed and encoded, and then uploaded to the upper application (example, mirror application), the upper application parses the image, (due to the camera capture).
  • the video stream is a video stream, and the video stream consists of multiple frames of images) and the parsed image is formed into a video screen without any special effects at a certain frame rate (the value of the frame rate is not limited here), and the video screen is output to On the texture control; for example, the special effect algorithm recognizes the face on the TextureView of the texture control, adds special effects such as filter stickers, superimposes the added special effects on the texture of the video screen without any special effects, and synthesizes a new texture; The synthesized texture is output to the display control, and the user can see the video preview screen with special effects on the preview interface.
  • the storage ratio selected by the user is full-screen mode (the image aspect ratio is 16:9), and the user "takes a picture" instruction is received, a frame of the current video preview screen is obtained through the special effect algorithm interface (this frame of image has special effects) Effect), and notify the preview screen, the user can see the Bitmap format image (or other format images) on the preview interface; when the user clicks on the "save” instruction, in response to the "save” instruction, the user interface The preview interface is switched to the photo display interface, and the photo is displayed on the photo display interface; at this time, the user obtains a 16:9 aspect ratio photo with special effects in the TV display area, for example, a resolution of 1920*1080).
  • the steps to capture the image of the TV display area include: on the TV side, receiving instructions from the user to enter the camera-related application (such as opening the mirror application), entering the preview interface, and obtaining the camera object (This object is used to control the camera switch, configure the camera parameters, manage the camera start/stop preview, take pictures, etc.); the camera collects the original image according to the ratio of width to height pixel ratio of 4:3, and the system's HAL treats the original image according to the width And the high pixel ratio is 16:9 to intercept, and the intercepted image is compressed and encoded, and then uploaded to the upper application (example, mirror application), the upper application parses the image, (because the camera captures video The video stream is composed of multiple frames of images) and the parsed image is continuously displayed on the preview interface at a certain frame rate (the value of the frame rate is not limited here) to form a video preview screen. At this time, the user will see the formed video preview screen on the preview interface.
  • the camera-related application such as opening the mirror application
  • the storage ratio selected by the user is full-screen mode (the image aspect ratio is 16:9), and the user "takes a picture" instruction is received, obtain a frame of the current video preview screen (this frame of image does not have special effects),
  • the user can see the Bitmap format image (or pictures in other formats) in the preview interface; when the user clicks the "save” instruction, the user interface switches from the preview interface to the photo display interface in response to the "save” instruction.
  • the photos are displayed on the photo display interface; at this time, the user obtains a 16:9 aspect ratio photo of the TV display area without special effects, for example, a resolution of 1920*1080.
  • a frame of image in the preview screen is acquired, the first user interface including the preview screen is exited, and the display displays the image with the second aspect ratio .
  • An exemplary embodiment of the present application provides another display device, including:
  • a display configured to display a user interface, wherein the user interface includes a view display area, wherein the view display area includes one or more different layout items, and the user interface further includes an instruction
  • the selector whose item is selected can move the position of the selector in the user interface through user input, so that a different item can be selected;
  • a controller in communication with the display, the controller configured to perform presentation of the user interface
  • the controller displays the first user interface of the view display area on the display according to the user's instruction for turning on the camera;
  • the controller receives an instruction for acquiring an image, it stops the preview screen, and at the same time calls the camera to acquire the image according to the first aspect ratio, and The second user interface in the view display area is displayed.
  • the method further includes:
  • the image aspect ratio selected by the user is the first aspect ratio
  • the preview screen will be stopped, and the camera will be called to acquire the image according to the first aspect ratio, and after adding special effects
  • the second user interface in the view display area is displayed.
  • FIGS. 11-13 exemplarily show a schematic diagram of interaction between the user interface and the user in the display device 200 according to another exemplary embodiment; for example, as shown in FIGS. 11-13, a plurality of different items are laid out in the view display area 201
  • the first user interface 201-3 of the view display area 201 displays the preview screen of the shooting scene of the camera on the TV side.
  • FIG. 11 shows one of the preview screens of the shooting scene (the preview screen displayed has multiple frames, here Select a frame of picture for illustration), and it can be seen from Figure 11 that the image mode selected by the user is "storage ratio-standard" (the pixel ratio of image width and height is 4:3), the user can click "beauty filter "Mirror", add or change special effects on the preview screen.
  • the selectable special effects include beauty, filters, stickers, etc.; the user can also click "view picture”; when the user clicks "take a picture", in response to the photo command,
  • the user interface changes as shown in Figure 12.
  • the first user interface 201-3 displays the last frame before the user sends out the "photograph” command.
  • the user can scan the QR code to share the picture, or click “Save” or retake the picture; when the user When "save” is clicked, in response to the "save” instruction, the user interface changes as shown in FIG. 13, and the second user interface 201-4 of the view display area 201 displays the picture just saved.
  • the image obtained by the user is a picture with a display ratio of 4:3 in the display area of the camera.
  • a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller according to the second aspect ratio. Intercepting the first aspect ratio image collected by the camera, and displaying according to a second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio;
  • a preview image in a user interface is displayed statically, and the display displays a first image of the first aspect ratio.
  • a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller according to the second aspect ratio.
  • the first aspect ratio image collected by the camera is intercepted, and displayed according to a second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio.
  • an image is acquired by a camera according to a first aspect ratio, and the image is formed into a preview screen in the first user interface according to the second aspect ratio, that is, according to the second aspect ratio. After comparing and capturing the image obtained by the camera, it is continuously displayed on the first user interface according to a preset frame rate to form a preview image.
  • the preset ratio is an aspect ratio of 16:9.
  • the preview screen has special effects.
  • the controller when the controller receives a photographing instruction, the data acquired by the camera is used as the current image and displayed on the second user interface.
  • the controller When the controller receives the user's camera instruction, it stops playing the preview screen, that is, it stops converting the aspect ratio of the camera shooting data. Call the camera directly to obtain the image data of the first aspect ratio, and display it on the second user interface after the photo is taken.
  • the image of the visible area of the camera is displayed on the second user interface 201-4 (photo display interface), and the pixel ratio of the width to the height of the image is 4:3.
  • the image resolution is, for example, 4656*3496 (it can also be set to other values).
  • the preset aspect ratio is a corresponding aspect ratio when the image storage ratio selected by the user is the standard mode.
  • the controller after the controller finishes taking a picture of the picture currently displayed on the first user interface, it adds special effects to the obtained image, and displays the image to which the special effects have been added on the second user interface.
  • the image after the photographing is completed is returned to the special effect algorithm to add the special effect effect, and the image with the special effect added is displayed on the second user interface 201-4.
  • Fig. 14 exemplarily shows another image capturing method according to an exemplary embodiment, including:
  • S202 Display a preview screen of the shooting scene of the TV camera on the first user interface
  • S203 When receiving a photographing instruction, convert the picture currently displayed on the first user interface into an image, and display it on the second user interface.
  • the first user interface is a preview interface
  • the second user interface is a photo display interface
  • the preview screen is a screen captured according to a preset ratio.
  • the preview screen has special effects.
  • special effects include beauty, filters, stickers, etc.
  • the preset aspect ratio is 4:3 ratio of pixel width and height (the specific image resolution aspect ratio is 4656*3496);
  • the image displayed on the second user interface is the image of the camera display area.
  • the image can be an image with or without special effects.
  • the preset aspect ratio is a corresponding aspect ratio when the image storage ratio selected by the user is the standard mode.
  • Figure 15 exemplarily shows a flow chart of capturing images of the display area of a camera according to an exemplary embodiment.
  • the user receives an instruction to open the mirror application on the TV side, starts the camera, initializes the controls required for display, and acquires the camera
  • the image data of is intercepted to fit the size displayed on the monitor, and enter the preview interface. If it is necessary to display a special effect screen, the intercepted data stream is called the special effect algorithm interface to present a preview screen with special effects.
  • the camera collects the original image according to the ratio of the width and height of the pixel to 4:3.
  • the HAL of the system is based on the original image according to the width and height of the pixel ratio of 16.
  • the texture control TextureView recognizes human faces, adds special effects such as filter stickers, superimposes the added special effects on the texture of the video screen without any special effects, and synthesizes a new texture; outputs the synthesized texture to the display control, The user can see the video preview screen with special effects on the preview interface.
  • Special effects processing, and return to the camera object (the camera is not in the preview algorithm application; call the camera's takePicture interface to take a picture, the preview picture will automatically stop, at this time the user sees one frame of the multi-frame picture when the camera command is executed ;
  • the camera object is used to control the camera switch, configure the camera parameters, manage the camera start/stop preview, take pictures, etc.); then call the takePicture interface, start taking pictures, generate the original photos obtained by the camera, and call the special effect algorithm to add special effects to the photo , Generate photos with special effects, and notify the preview interface, the user can see Bitmap format images (or pictures in other formats) on the preview interface; when the user clicks on the "save” instruction, in response to the "save
  • the steps to capture the image of the camera display area include: on the TV side, receiving the user's instruction to open the TV side mirror application, starting the camera, and initializing the display
  • the required controls are to intercept the image data obtained by the camera into a size suitable for the display of the monitor and enter the preview interface.
  • the camera object is obtained (the object 1 is used to control the camera switch, configure the camera parameters, manage the camera start/stop preview, take pictures, etc.).
  • the user selects the "storage ratio-standard” mode (the pixel ratio of image width and height is 4:3), and the preview image is still displayed at the preview resolution of 1920*1080; when the user clicks "photograph", in response to the "photograph” command, First stop the video preview screen, and return to the camera object (when the takePicture interface of the camera is called to take a picture, the preview screen will automatically stop, at this time the user sees a frame of the picture when taking pictures; among them, the camera object is used to control the camera switch, configuration Camera parameters, manage camera start/stop preview, take pictures, etc.); then call the takePicture interface to start taking pictures. After the picture is taken, the user can see the Bitmap format image (or pictures in other formats) on the preview interface.
  • the image is The screen of the actual visible area of the camera; when the user clicks the "save” instruction, the user interface switches from the preview interface to the photo display interface in response to the "save” instruction, and the photo is displayed on the photo display interface; at this time, the user gets the camera visible
  • An area photo with an aspect ratio of 4:3 without special effects can be, for example, a resolution of 4656*3496.
  • the TV-side camera displays the preview image with a resolution of 1920*1080.
  • the image with the corresponding aspect ratio is obtained according to the image storage ratio selected by the user (full screen or standard); specifically, when the user selects The image storage ratio is full-screen mode, and the ratio of pixel width to height of the TV display area is 16:9, and the resolution is for example 1920*1080 image.
  • the image storage ratio selected by the user is the standard mode, the visible area of the camera is obtained
  • the pixel width and height of is 4:3, and the resolution is, for example, an image of 4656*3496. In other words, users can simply switch to obtain photos with different aspect ratios and different shooting angles.
  • FIG. 16 exemplarily shows an image capturing device according to an exemplary embodiment, including:
  • the first unit 11 is configured to start the first user interface on the TV according to a user instruction
  • the second unit 12 is configured to display a preview image of the shooting scene of the TV camera on the first user interface
  • the third unit 13 is configured to convert the picture currently displayed on the first user interface into an image and display it on the second user interface when receiving a photographing instruction.
  • FIG. 17 exemplarily shows another image capturing device according to an exemplary embodiment, including:
  • the opening unit 21 is configured to open the first user interface on the TV according to a user instruction
  • the preview unit 22 is configured to display a preview picture of the shooting scene of the TV camera on the first user interface
  • the display unit 23 is configured to convert the picture currently displayed on the first user interface into an image when receiving a photographing instruction, and display it on the second user interface.
  • FIG. 18 exemplarily shows another display device according to an exemplary embodiment, including:
  • the fourth unit 31 collects surrounding environment data with the first aspect ratio
  • the fifth unit 32 is configured to open a first user interface on the TV side according to a user instruction, and display a preview picture of the shooting scene of the TV side camera on the first user interface, the preview picture being the controller according to the second width
  • the aspect ratio intercepts the first aspect ratio image collected by the camera, and displays it according to a second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio ratio;
  • the sixth unit 33 is configured to convert the picture of the second aspect ratio currently displayed on the preview picture into an image when receiving a photographing instruction, or obtain the picture of the first aspect ratio collected by the camera, and The second user interface is displayed.
  • FIG. 19 exemplarily shows another display device according to an exemplary embodiment, including:
  • the collecting unit 41 collects surrounding environment data with the first aspect ratio
  • the preview unit 42 is configured to open a first user interface on the TV side according to a user instruction, and display a preview screen of the shooting scene of the TV camera on the first user interface, the preview screen being the controller according to the second width and height
  • the first aspect ratio image collected by the camera is compared and intercepted, and displayed according to a second aspect ratio and according to a preset frame rate, where the second aspect ratio is different from the first aspect ratio ;
  • the display unit 43 is configured to convert the picture of the second aspect ratio currently displayed on the preview picture into an image when receiving a photographing instruction, or to obtain an image of the first aspect ratio collected by the camera, 2.
  • the user interface is displayed.
  • Fig. 20 also exemplarily shows an image capturing device according to an exemplary embodiment, including:
  • the processor 600 is configured to read a program in the memory 610 and execute the following process:
  • the picture currently displayed on the first user interface is converted into an image and displayed on the second user interface.
  • the first user interface is opened on the TV according to the user instruction; the preview screen of the shooting scene of the TV camera is displayed on the first user interface; when the camera instruction is received, the first user interface is currently displayed
  • the picture is converted into an image and displayed on the second user interface, so that the image is captured and displayed on the TV according to the aspect ratio set by the user.
  • the preview screen is a screen captured according to a preset ratio.
  • the preview screen has special effects.
  • converting the picture currently displayed on the first user interface into an image, and displaying it on the second user interface specifically includes:
  • the picture currently displayed on the first user interface is converted into an image and displayed on the second user interface.
  • the image storage ratio is a full-screen mode.
  • FIG. 21 also exemplarily shows another image capturing device according to an exemplary embodiment, including:
  • the processor 800 is configured to read a program in the memory 810 and execute the following process:
  • the picture currently displayed on the first user interface is converted into an image and displayed on the second user interface.
  • the first user interface is opened on the TV according to the user instruction; the preview screen of the shooting scene of the TV camera is displayed on the first user interface; when the camera instruction is received, the first user interface is currently displayed
  • the picture is converted into an image and displayed on the second user interface, so that the image is captured and displayed on the TV according to the aspect ratio set by the user.
  • the preview screen is a screen captured according to a preset ratio.
  • the preview screen has special effects.
  • converting the picture currently displayed on the first user interface into an image, and displaying it on the second user interface specifically includes:
  • the camera When receiving a user's photographing instruction, the camera is called, the camera is set according to the preset aspect ratio, and the picture currently displayed on the first user interface is photographed. After the photograph is completed, it is displayed on the second user interface.
  • the preset aspect ratio is a corresponding aspect ratio when the image storage ratio selected by the user is the standard mode.
  • a special effect is added to the obtained image, and the image to which the special effect has been added is displayed on the second user interface.
  • the bus architecture may include any number of interconnected buses and bridges, specifically one or more processors represented by the processors 600 and 800 and various circuit links between the memories represented by the memories 610 and 810 Together.
  • the bus architecture can also link various other circuits such as peripherals, voltage regulators, and power management circuits. These are all well-known in the art, and therefore, no further description will be given here.
  • the bus interface provides the interface.
  • An exemplary embodiment of the present application provides a display terminal, and the display terminal may specifically be a desktop computer, a portable computer, a smart phone, a tablet computer, a personal digital assistant (Personal Digital Assistant, PDA), etc.
  • the display terminal may include a central processing unit (CPU), a memory, an input/output device, etc.
  • the input device may include a keyboard, a mouse, a touch screen, etc.
  • an output device may include a display device, such as a liquid crystal display (Liquid Crystal Display, LCD), Cathode Ray Tube (CRT), etc.
  • the user interfaces 620 and 820 may be interfaces that can externally and internally connect the required equipment.
  • the connected equipment includes but not limited to a keypad, a display, a speaker, a microphone, a joystick, etc. .
  • the processor is responsible for managing the bus architecture and general processing, and the memory can store data used by the processor 600 when performing operations.
  • the processor may be a CPU (Central Embedded Device), ASIC (Application Specific Integrated Circuit, application-specific integrated circuit), FPGA (Field-Programmable Gate Array, field programmable gate array) or CPLD ( Complex Programmable Logic Device, complex programmable logic device).
  • CPU Central Embedded Device
  • ASIC Application Specific Integrated Circuit
  • FPGA Field-Programmable Gate Array, field programmable gate array
  • CPLD Complex Programmable Logic Device, complex programmable logic device
  • the memory may include read-only memory (ROM) and random access memory (RAM), and provides the processor with program instructions and data stored in the memory.
  • ROM read-only memory
  • RAM random access memory
  • the memory may be used to store the program of any of the methods provided in the exemplary implementation of the present application.
  • the processor calls the program instructions stored in the memory, and the processor is configured to execute any of the methods provided in the exemplary implementation manners of the present application according to the obtained program instructions.
  • the exemplary embodiment of the present application provides a computer storage medium for storing computer program instructions used by the device provided in the foregoing embodiment of the present application, which includes a computer program instruction for executing any method provided in the foregoing embodiment of the present application. program.
  • the computer storage medium may be any available medium or data storage device that can be accessed by the computer, including but not limited to magnetic storage (such as floppy disk, hard disk, magnetic tape, magneto-optical disk (MO), etc.), optical storage (such as CD, DVD, BD, HVD, etc.), and semiconductor memory (such as ROM, EPROM, EEPROM, non-volatile memory (NAND FLASH), solid state drive (SSD)), etc.
  • magnetic storage such as floppy disk, hard disk, magnetic tape, magneto-optical disk (MO), etc.
  • optical storage such as CD, DVD, BD, HVD, etc.
  • semiconductor memory such as ROM, EPROM, EEPROM, non-volatile memory (NAND FLASH), solid state drive (SSD)
  • the exemplary embodiments of the present application provide an image capturing method and device, and a display device, so that images are captured and displayed on the TV according to the aspect ratio set by the user.
  • the image mode selected by the user is the full-screen mode (16:9)
  • the image of the visible area of the TV is captured on the TV and displayed
  • the image mode selected by the user is the standard mode (4:3)
  • the terminal captures the image of the visible area of the camera and displays it; thus, the user can simply switch to obtain photos with different aspect ratios and different shooting angles.
  • the exemplary embodiments of this application may be provided as a method, a system, or a computer program product. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, this application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, optical storage, etc.) containing computer-usable program codes.
  • a computer-usable storage media including but not limited to disk storage, optical storage, etc.
  • These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device.
  • the device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
  • These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment.
  • the instructions provide steps for implementing functions specified in a flow or multiple flows in the flowchart and/or a block or multiple blocks in the block diagram.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention concerne un dispositif d'affichage (200) destiné à mettre en œuvre les étapes suivantes : ouvrir une première interface sur un téléviseur selon une instruction d'utilisateur (S101) ; afficher, sur la première interface, des représentations de prévisualisation d'une scène capturée par une caméra de télévision (S102) ; et, lors de la réception d'une instruction de photographie, convertir une représentation actuellement affichée sur la première interface en une image et afficher l'image sur une seconde interface (S103).
PCT/CN2020/079701 2019-06-10 2020-03-17 Dispositif d'affichage WO2020248640A1 (fr)

Applications Claiming Priority (8)

Application Number Priority Date Filing Date Title
CN201910497563 2019-06-10
CN201910497563.9 2019-06-10
CN201910877523.7 2019-09-17
CN201910878161.3A CN110636354A (zh) 2019-06-10 2019-09-17 一种显示设备
CN201910877523.7A CN112073765A (zh) 2019-06-10 2019-09-17 一种显示设备
CN201910877525.6A CN110636353B (zh) 2019-06-10 2019-09-17 一种显示设备
CN201910878161.3 2019-09-17
CN201910877525.6 2019-09-17

Publications (1)

Publication Number Publication Date
WO2020248640A1 true WO2020248640A1 (fr) 2020-12-17

Family

ID=68971130

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/079701 WO2020248640A1 (fr) 2019-06-10 2020-03-17 Dispositif d'affichage

Country Status (2)

Country Link
CN (3) CN112073765A (fr)
WO (1) WO2020248640A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112822556A (zh) * 2020-12-31 2021-05-18 上海米哈游天命科技有限公司 游戏画面的拍摄方法、装置、设备及存储介质
CN113938587A (zh) * 2021-09-14 2022-01-14 青岛海信移动通信技术股份有限公司 基于双摄像头的摄录方法及电子设备
CN113971048A (zh) * 2021-10-29 2022-01-25 Oppo广东移动通信有限公司 应用程序的启动方法及装置、存储介质及电子设备
CN114339358A (zh) * 2021-04-16 2022-04-12 海信视像科技股份有限公司 一种关机选择界面的动态处理方法及显示设备

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112073765A (zh) * 2019-06-10 2020-12-11 海信视像科技股份有限公司 一种显示设备
CN111314606B (zh) * 2020-02-21 2021-06-18 Oppo广东移动通信有限公司 拍照方法、装置、电子设备及存储介质
CN113497979A (zh) * 2020-03-20 2021-10-12 佛山市云米电器科技有限公司 界面模式显示方法、云服务器、电视机、系统和存储介质
CN111917998A (zh) * 2020-08-12 2020-11-10 惠州市康冠科技有限公司 基于GPUImgae的智能电视特效相机生成方法、装置及智能电视
CN112261289B (zh) * 2020-10-16 2022-08-26 海信视像科技股份有限公司 显示设备及ai算法结果获取方法
CN114513690B (zh) * 2020-10-27 2024-04-05 海信视像科技股份有限公司 显示设备及图像采集方法
CN114650363B (zh) * 2020-12-18 2023-07-21 华为技术有限公司 一种图像显示的方法及电子设备
CN113099308B (zh) * 2021-03-31 2023-10-27 聚好看科技股份有限公司 一种内容显示方法、显示设备及图像采集器
CN115474073B (zh) * 2021-06-11 2023-12-12 上海赛连信息科技有限公司 一种智能切换画面布局的方法和装置
CN113112407B (zh) * 2021-06-11 2021-09-03 上海英立视电子有限公司 基于电视的照镜视野生成方法、系统、设备及介质
CN115809957A (zh) * 2021-09-13 2023-03-17 北京字跳网络技术有限公司 图像处理方法及设备

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070139443A1 (en) * 2005-12-12 2007-06-21 Sonny Computer Entertainment Inc. Voice and video control of interactive electronically simulated environment
CN101510970A (zh) * 2009-03-27 2009-08-19 四川长虹电器股份有限公司 在16：9的电视上显示4：3图像的方法
CN103618933A (zh) * 2013-11-28 2014-03-05 青岛海信电器股份有限公司 一种自适应显示应用界面图像的方法及装置
US20160054890A1 (en) * 2014-03-12 2016-02-25 Samsung Electronics Co., Ltd. Electronic apparatus, image processing method, and computer-readable recording medium
CN105915872A (zh) * 2016-06-06 2016-08-31 苏州佳世达光电有限公司 图像的输出方法及投影装置
WO2017043331A1 (fr) * 2015-09-09 2017-03-16 ソニー株式会社 Dispositif et procédé de traitement d'images
CN106896999A (zh) * 2017-01-06 2017-06-27 广东小天才科技有限公司 一种移动终端的镜子模拟方法及装置
CN108737732A (zh) * 2018-06-04 2018-11-02 成都依能科技股份有限公司 一种在动态图像预览下定义静态高清图像拍摄区域的方法
CN109120997A (zh) * 2018-09-30 2019-01-01 北京微播视界科技有限公司 视频处理方法、装置、终端和介质
CN109302629A (zh) * 2018-08-27 2019-02-01 青岛海信电器股份有限公司 一种用于为图片切换画框的方法及显示终端
CN110636354A (zh) * 2019-06-10 2019-12-31 青岛海信电器股份有限公司 一种显示设备

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110126346A (ko) * 2010-05-17 2011-11-23 엘지전자 주식회사 해상도 선택 메뉴 제공 방법 및 방송 수신 장치
CN102681302A (zh) * 2011-03-17 2012-09-19 天津三星光电子有限公司 一种自选构图自拍的方法、装置及照相设备
JP5310837B2 (ja) * 2011-12-28 2013-10-09 カシオ計算機株式会社 画像生成装置、デジタルカメラ、方法、及びプログラム
KR101917650B1 (ko) * 2012-08-03 2019-01-29 삼성전자 주식회사 이미지 처리 방법 및 장치
CN102957901B (zh) * 2012-11-19 2016-05-18 天津三星电子有限公司 一种显示系统
US10168882B2 (en) * 2013-06-09 2019-01-01 Apple Inc. Device, method, and graphical user interface for switching between camera interfaces
CN103414945A (zh) * 2013-07-17 2013-11-27 深圳Tcl新技术有限公司 自动截取显示目标人像的方法和装置
CN104270579B (zh) * 2014-09-24 2018-06-05 青岛海信移动通信技术股份有限公司 一种终端应用界面像素调整方法及终端
CN104333701B (zh) * 2014-11-28 2017-04-26 广东欧珀移动通信有限公司 一种相机预览画面的显示方法、装置及终端
CN106506932A (zh) * 2015-09-08 2017-03-15 中兴通讯股份有限公司 图像的获取方法及装置
CN205378145U (zh) * 2016-02-04 2016-07-06 许阳振 电子镜
US20170302844A1 (en) * 2016-04-13 2017-10-19 Canon Kabushiki Kaisha Image capturing apparatus, control method therefor, and storage medium
CN106339705B (zh) * 2016-08-16 2019-07-02 北京小米移动软件有限公司 图片获取方法及装置
CN106331488A (zh) * 2016-08-25 2017-01-11 天脉聚源(北京)传媒科技有限公司 一种界面调整方法及装置
CN106293589B (zh) * 2016-08-31 2019-04-12 宇龙计算机通信科技(深圳)有限公司 一种设置预览分辨率的方法、装置及终端
CN106657761A (zh) * 2016-09-29 2017-05-10 乐视控股（北京）有限公司 一种智能终端的拍照方法和装置
KR20180051202A (ko) * 2016-11-08 2018-05-16 삼성전자주식회사 디스플레이장치 및 그 제어방법
CN106937043A (zh) * 2017-02-16 2017-07-07 奇酷互联网络科技（深圳）有限公司 移动终端及其图像处理的方法和装置
CN107155059A (zh) * 2017-04-11 2017-09-12 深圳市金立通信设备有限公司 一种图像预览方法及终端
KR102289716B1 (ko) * 2017-08-01 2021-08-17 삼성디스플레이 주식회사 표시 장치 및 이의 구동 방법
CN111213363A (zh) * 2017-10-13 2020-05-29 深圳传音通讯有限公司 终端拍照控制方法、移动终端及可读储存介质
CN108337442A (zh) * 2018-05-14 2018-07-27 Oppo广东移动通信有限公司 拍摄预览显示方法、装置、终端及存储介质
CN109460174A (zh) * 2018-11-09 2019-03-12 维沃移动通信有限公司 一种信息处理方法及终端设备
CN109547700A (zh) * 2018-12-27 2019-03-29 维沃移动通信有限公司 拍照方法及终端

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070139443A1 (en) * 2005-12-12 2007-06-21 Sonny Computer Entertainment Inc. Voice and video control of interactive electronically simulated environment
CN101510970A (zh) * 2009-03-27 2009-08-19 四川长虹电器股份有限公司 在16：9的电视上显示4：3图像的方法
CN103618933A (zh) * 2013-11-28 2014-03-05 青岛海信电器股份有限公司 一种自适应显示应用界面图像的方法及装置
US20160054890A1 (en) * 2014-03-12 2016-02-25 Samsung Electronics Co., Ltd. Electronic apparatus, image processing method, and computer-readable recording medium
WO2017043331A1 (fr) * 2015-09-09 2017-03-16 ソニー株式会社 Dispositif et procédé de traitement d'images
CN105915872A (zh) * 2016-06-06 2016-08-31 苏州佳世达光电有限公司 图像的输出方法及投影装置
CN106896999A (zh) * 2017-01-06 2017-06-27 广东小天才科技有限公司 一种移动终端的镜子模拟方法及装置
CN108737732A (zh) * 2018-06-04 2018-11-02 成都依能科技股份有限公司 一种在动态图像预览下定义静态高清图像拍摄区域的方法
CN109302629A (zh) * 2018-08-27 2019-02-01 青岛海信电器股份有限公司 一种用于为图片切换画框的方法及显示终端
CN109120997A (zh) * 2018-09-30 2019-01-01 北京微播视界科技有限公司 视频处理方法、装置、终端和介质
CN110636354A (zh) * 2019-06-10 2019-12-31 青岛海信电器股份有限公司 一种显示设备

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112822556A (zh) * 2020-12-31 2021-05-18 上海米哈游天命科技有限公司 游戏画面的拍摄方法、装置、设备及存储介质
CN114339358A (zh) * 2021-04-16 2022-04-12 海信视像科技股份有限公司 一种关机选择界面的动态处理方法及显示设备
CN113938587A (zh) * 2021-09-14 2022-01-14 青岛海信移动通信技术股份有限公司 基于双摄像头的摄录方法及电子设备
CN113938587B (zh) * 2021-09-14 2024-03-15 青岛海信移动通信技术有限公司 基于双摄像头的摄录方法及电子设备
CN113971048A (zh) * 2021-10-29 2022-01-25 Oppo广东移动通信有限公司 应用程序的启动方法及装置、存储介质及电子设备

Also Published As

Publication number Publication date
CN110636354A (zh) 2019-12-31
CN110636353A (zh) 2019-12-31
CN110636353B (zh) 2022-09-02
CN112073765A (zh) 2020-12-11

Similar Documents

Publication Publication Date Title
WO2020248640A1 (fr) Dispositif d'affichage
WO2020248668A1 (fr) Dispositif d'affichage et procédé de traitement d'image
WO2021088320A1 (fr) Dispositif d'affichage et procédé d'affichage de contenu
WO2017181599A1 (fr) Procédé et dispositif permettant d'afficher des vidéos
WO2021031623A1 (fr) Appareil d'affichage, procédé de partage de fichiers et serveur
CN112073798B (zh) 一种数据传输方法及设备
WO2021031629A1 (fr) Appareil d'affichage et procédé d'application d'un bouton multifonction pour dispositif de commande
WO2020248680A1 (fr) Procédé et appareil de traitement de données vidéo et dispositif d'affichage
US11917329B2 (en) Display device and video communication data processing method
US20220006972A1 (en) Method For Adjusting Position Of Video Chat Window And Display Device
CN112399263A (zh) 一种互动方法、显示设备及移动终端
CN112399264A (zh) 一种放映厅业务管理方法及应用
CN112783380A (zh) 显示设备和方法
CN112788423A (zh) 一种显示设备及菜单界面的显示方法
WO2020248681A1 (fr) Dispositif d'affichage et procédé d'affichage des états de commutation bluetooth
WO2021031608A1 (fr) Procédé et dispositif d'affichage de l'état de verrouillage d'un interrupteur physique d'appareil photo
CN112788378B (zh) 显示设备与内容显示方法
CN112463267B (zh) 在显示设备屏幕上呈现屏保信息的方法及显示设备
WO2020248829A1 (fr) Procédé de traitement d'audio et de vidéo et dispositif d'affichage
WO2020248682A1 (fr) Dispositif d'affichage et procédé de génération de scène virtuelle
CN112073777B (zh) 一种语音交互方法及显示设备
WO2020248699A1 (fr) Procédé de traitement du son et appareil d'affichage
WO2021088326A1 (fr) Dispositif d'affichage et procédé d'affichage d'appel entrant
CN114286077A (zh) 一种虚拟现实设备及vr场景图像显示方法
CN113938633A (zh) 一种视频通话处理方法及显示设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20823602

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20823602

Country of ref document: EP

Kind code of ref document: A1