CN110636353A - Display device - Google Patents

Display device Download PDF

Info

Publication number
CN110636353A
CN110636353A CN201910877525.6A CN201910877525A CN110636353A CN 110636353 A CN110636353 A CN 110636353A CN 201910877525 A CN201910877525 A CN 201910877525A CN 110636353 A CN110636353 A CN 110636353A
Authority
CN
China
Prior art keywords
image
resolution
user
camera
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910877525.6A
Other languages
Chinese (zh)
Other versions
CN110636353B (en
Inventor
于文钦
杨鲁明
朱铄
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Hisense Electronics Co Ltd
Original Assignee
Qingdao Hisense Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Hisense Electronics Co Ltd filed Critical Qingdao Hisense Electronics Co Ltd
Publication of CN110636353A publication Critical patent/CN110636353A/en
Priority to PCT/CN2020/079701 priority Critical patent/WO2020248640A1/en
Application granted granted Critical
Publication of CN110636353B publication Critical patent/CN110636353B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H04N21/4438—Window management, e.g. event handling following interaction with the user interface
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4781—Games
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application discloses a display device, which is used for shooting and displaying images according to the resolution set by a user. The image shooting method provided by the embodiment of the application comprises the following steps: starting a first user interface at the television according to a user instruction; displaying a preview picture of a shooting scene of a television camera on the first user interface; and when a photographing instruction is received, converting the current displayed picture of the first user interface into an image and displaying the image on a second user interface.

Description

Display device
Technical Field
The application relates to the technical field of intelligent televisions, in particular to a display device.
Background
Currently, since a display device can provide a user with a play picture such as audio, video, picture, and the like, it is receiving a wide attention of the user. With the development of big data and artificial intelligence, the functional requirements of users on display devices are increasing day by day. Current display devices, especially household devices, such as smart televisions; the actual shooting area of the camera is not consistent with the display area of the television, and the current technology cannot shoot and display images at the television according to the resolution required by a user.
Disclosure of Invention
The exemplary embodiments of the present application provide a display apparatus to capture and display an image according to a resolution set by a user.
According to an aspect of exemplary embodiments, there is provided a display apparatus including:
the camera is used for acquiring first-resolution acquired image data;
a display configured to display an image screen and a user interface, and a selector in the user interface to indicate that an item is selected in the user interface;
a controller in communication with the display, the controller configured to: receiving a control signal input from a user input interface and indicating to start the opening or closing of the camera;
presenting a first user interface in the display in response to a user input for starting the camera, wherein the first user interface comprises a preview picture, the preview picture is obtained by intercepting the first resolution image acquired by the camera by the controller and is displayed according to a second resolution and a first frame rate, and the second resolution is different from the first resolution;
receiving user input indicating that a picture is acquired by a user through selection of the selector in the first user interface, responding to the user input, acquiring an image with a first resolution acquired by the camera, keeping the preview picture still, and displaying the image with the first resolution by the display at a second frame rate.
An exemplary embodiment of the present application provides an image capturing method, including:
receiving a control signal input from a user input interface and indicating to start the opening or closing of the camera;
presenting a first user interface in the display in response to a user input for starting the camera, wherein the first user interface comprises a preview picture, the preview picture is obtained by intercepting the first resolution image acquired by the camera by the controller and is displayed according to a second resolution and a first frame rate, and the second resolution is different from the first resolution;
receiving user input indicating that a picture is acquired by a user through selection of the selector in the first user interface, responding to the user input, acquiring an image with a first resolution acquired by the camera, keeping the preview picture still, and displaying the image with the first resolution by the display at a second frame rate.
According to the method, a first user interface is started at a television end according to a user instruction; displaying a preview picture of a shooting scene of a television camera on the first user interface; and when a photographing instruction is received, acquiring an image with a first resolution acquired by the camera, keeping the preview picture still for display, and displaying the image with the first resolution by the display at a second frame rate. Therefore, in different scenes of the preview scene and the scene of taking a picture, the resolution and the frame rate can be converted according to the two scenes, and the picture is taken and displayed at the television according to the instruction of the user.
An embodiment of the present application further provides a computing device, including:
a memory for storing program instructions;
and the processor is used for calling the program instructions stored in the memory and executing any one of the methods provided by the embodiment of the application according to the obtained program.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic diagram illustrating an operation scenario between a display device 200 and a control apparatus according to an embodiment;
fig. 2 is a block diagram schematically illustrating a configuration of a software system in the display device 200 according to the embodiment;
fig. 3 is a schematic diagram illustrating an application included in an application layer of a display device according to an embodiment;
fig. 4 schematically illustrates a user interface in the display device 200 according to an embodiment;
FIG. 5 ~ 7 is a schematic diagram illustrating user interface interaction with a user in display device 200 according to an exemplary embodiment;
fig. 8 is a diagram schematically illustrating an image capturing method according to an exemplary embodiment;
fig. 9 is a schematic diagram illustrating a comparison of display scales of a camera shooting area and a television display area according to an exemplary embodiment;
FIG. 10 is a flow diagram illustrating capturing television display area images according to an exemplary embodiment;
FIG. 11 ~ 13 is a schematic diagram illustrating user interface interaction with a user in the display device 200 according to another exemplary embodiment;
fig. 14 is a schematic view schematically illustrating another image capturing method according to an exemplary embodiment;
fig. 15 is a flowchart illustrating capturing a camera display area image according to an exemplary embodiment;
FIG. 16 is a schematic diagram of a display device according to an exemplary embodiment;
FIG. 17 is a schematic diagram of another display device according to an exemplary embodiment;
a schematic diagram of a display device according to an exemplary embodiment is also illustrated in fig. 18.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Various embodiments of the present application will be described in detail below with reference to the accompanying drawings. It should be noted that the display sequence of the embodiment of the present application only represents the sequence of the embodiment, and does not represent the merits of the technical solutions provided by the embodiments.
The term "module," as used in various embodiments of the present application, may refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.
The term "remote control" as used in the embodiments of the present application refers to a component of an electronic device (such as the display device disclosed in the present application) that is capable of wirelessly controlling the electronic device, typically over a short distance. The component can be generally connected with an electronic device by using infrared and/or Radio Frequency (RF) signals and/or bluetooth, and can also comprise a wireless network WiFi, a wireless USB, bluetooth, a motion sensor and other functional modules. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.
The term "gesture" as used in the embodiments of the present application refers to a user behavior used to express an intended idea, action, purpose, or result through a change in hand shape or an action such as hand movement.
Fig. 1 is a schematic diagram illustrating an operation scenario between a display device 200 and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display apparatus 200 through the control device 100.
The control device 100 may be a remote controller 100A, which can communicate with the display device 200 through an infrared protocol communication, a bluetooth protocol communication, a ZigBee (ZigBee) protocol communication, or other short-range communication, and is used to control the display device 200 in a wireless or other wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.
The control apparatus 100 may also be a smart device, such as a mobile terminal 100B, a tablet computer, a notebook computer, etc., which may communicate with the display device 200 through a Local Area Network (LAN), a Wide Area Network (WAN), a Wireless Local Area Network (WLAN), or other networks, and implement control of the display device 200 through an application program corresponding to the display device 200.
For example, the mobile terminal 100B and the display device 200 may each have a software application installed thereon, so that connection communication between the two can be realized through a network communication protocol, and the purpose of one-to-one control operation and data communication can be further realized. Such as: a control instruction protocol can be established between the mobile terminal 100B and the display device 200, a remote control keyboard is synchronized to the mobile terminal 100B, and the function of controlling the display device 200 is realized by controlling a user interface on the mobile terminal 100B; the audio and video content displayed on the mobile terminal 100B may also be transmitted to the display device 200, so as to implement a synchronous display function.
As shown in fig. 1, the display apparatus 200 may also perform data communication with the server 300 through various communication means. In various embodiments of the present application, the display device 200 may be allowed to be communicatively coupled to the server 300 via a local area network, a wireless local area network, or other network. The server 300 may provide various contents and interactions to the display apparatus 200.
Illustratively, the display device 200 receives software Program updates, or accesses a remotely stored digital media library by sending and receiving information, and Electronic Program Guide (EPG) interactions. The servers 300 may be a group or groups, and may be one or more types of servers. Other web service contents such as a video on demand and an advertisement service are provided through the server 300.
The display device 200 may be a liquid crystal display, an Organic Light Emitting Diode (OLED) display, a projection display device, or an intelligent television. The specific display device type, size, resolution, etc. are not limiting, and those skilled in the art will appreciate that the display device 200 may be modified in performance and configuration as desired.
The display apparatus 200 may additionally provide an intelligent network tv function that provides a computer support function in addition to the broadcast receiving tv function. Examples include a network TV, a smart TV, an Internet Protocol TV (IPTV), and the like.
As shown in fig. 1, the display device may be connected or provided with a camera, and is configured to present a picture taken by the camera on a display interface of the display device or other display devices, so as to implement interactive chat between users. Specifically, the picture shot by the camera can be displayed on the display device in a full screen mode, a half screen mode or any optional area.
As an optional connection mode, the camera is connected with the display rear shell through the connecting plate, is fixedly installed in the middle of the upper side of the display rear shell, and can be fixedly installed at any position of the display rear shell as an installable mode, so that an image acquisition area is ensured not to be shielded by the rear shell, for example, the display orientation of the image acquisition area is the same as that of the display equipment.
As another alternative connection mode, the camera is connected to the display rear shell through a connection board or other conceivable connector, the camera is capable of lifting, the connector is provided with a lifting motor, when a user wants to use the camera or an application program wants to use the camera, the camera is lifted out of the display, and when the camera is not needed, the camera can be embedded in the rear shell to protect the camera from being damaged.
As an embodiment, the camera adopted in the present application may have 1600 ten thousand pixels, so as to achieve the purpose of ultra high definition display. In actual use, cameras higher or lower than 1600 ten thousand pixels may also be used.
After the camera is installed on the display device, the contents displayed by different application scenes of the display device can be fused in various different modes, so that the function which cannot be realized by the traditional display device is achieved.
Illustratively, a user may conduct a video chat with at least one other user while watching a video program. The presentation of the video program may be as a background frame over which a window for video chat is displayed. The function is called 'chat while watching'.
Optionally, in a scene of "chat while watching", at least one video chat is performed across terminals while watching a live video or a network video.
In another example, a user can conduct a video chat with at least one other user while entering the educational application for learning. For example, a student may interact remotely with a teacher while learning content in an educational application. Vividly, this function can be called "chatting while learning".
In another example, a user conducts a video chat with a player entering a card game while playing the game. For example, a player may enable remote interaction with other players when entering a gaming application to participate in a game. Figuratively, this function may be referred to as "watch while playing".
Optionally, the game scene is fused with the video picture, the portrait in the video picture is scratched and displayed in the game picture, and the user experience is improved.
Optionally, in the motion sensing game (such as ball hitting, boxing, running and dancing), the human posture and motion, limb detection and tracking and human skeleton key point data detection are obtained through the camera, and then the human posture and motion, the limb detection and tracking and the human skeleton key point data detection are fused with the animation in the game, so that the game of scenes such as sports and dancing is realized.
In another example, a user may interact with at least one other user in a karaoke application in video and voice. Vividly, this function can be called "sing while watching". Preferably, when at least one user enters the application in a chat scenario, a plurality of users can jointly complete recording of a song.
In another example, a user may turn on a camera locally to take pictures and videos, figurative, which may be referred to as "looking into the mirror". The mirror application is an application newly added in the social television project, and the application supports the functions of camera image preview, face recognition, addition of a beauty filter, photographing, picture sharing and the like; the method of capturing images mentioned in this embodiment is implemented in a mirror application.
In other examples, more or less functionality may be added. The function of the display device is not particularly limited in the present application.
Fig. 2 is a block diagram illustrating a configuration of a software system in the display device 200 according to an exemplary embodiment.
As shown in fig. 2, an operating system 2911, including executing operating software for handling various basic system services and for performing hardware related tasks, acts as an intermediary between application programs and hardware components for performing data processing.
In some embodiments, portions of the operating system kernel may contain a series of software to manage the display device hardware resources and provide services to other programs or software code.
In other embodiments, portions of the operating system kernel may include one or more device drivers, which may be a set of software code in the operating system that assists in operating or controlling the devices or hardware associated with the display device. The drivers may contain code that operates the video, audio, and/or other multimedia components. Examples include a display, a camera, Flash, WiFi, and audio drivers.
The accessibility module 2911-1 is configured to modify or access the application program to achieve accessibility and operability of the application program for displaying content.
A communication module 2911-2 for connection to other peripherals via associated communication interfaces and a communication network.
The user interface module 2911-3 is configured to provide an object for displaying a user interface, so that each application program can access the object, and user operability can be achieved.
Control applications 2911-4 for controlling process management, including runtime applications and the like.
The event transmission system 2914 may be implemented within the operating system 2911 or within the application 2912. In some embodiments, an aspect is implemented within the operating system 2911, while implemented in the application 2912, for listening for various user input events, and will implement one or more sets of predefined operations in response to various events referring to the recognition of various types of events or sub-events.
The event monitoring module 2914-1 is configured to monitor an event or a sub-event input by the user input interface.
The event identification module 2914-1 is configured to input definitions of various types of events for various user input interfaces, identify various events or sub-events, and transmit the same to a process for executing one or more corresponding sets of processes.
The event or sub-event refers to an input detected by one or more sensors in the display device 200 and an input of an external control device (e.g., the control apparatus 100). Such as: the method comprises the following steps of inputting various sub-events through voice, inputting a gesture sub-event through gesture recognition, inputting a remote control key command of a control device and the like. Illustratively, the one or more sub-events in the remote control include a variety of forms including, but not limited to, one or a combination of key presses up/down/left/right/, ok keys, key presses, and the like. And non-physical key operations such as move, hold, release, etc.
The interface layout management module 2913, directly or indirectly receiving the input events or sub-events from the event transmission system 2914, monitors the input events or sub-events, and updates the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the size, position, and level of the container, which are related to the layout of the interface.
Fig. 3 is a diagram illustrating an application included in an application layer of a display device including various applications executable in the display device 200 according to an exemplary embodiment.
The application layer 2912 may include, but is not limited to, one or more applications such as: video-on-demand applications, application centers, gaming applications, etc., live television applications, media center applications, etc.
The live television application program can provide live television through different signal sources. For example, a live television application may provide television signals using input from cable television, radio broadcasts, satellite services, or other types of live television services. And, the live television application may display video of the live television signal on the display device 200.
A video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. For example, the video on demand may come from a server side of the cloud storage, from a local hard disk storage containing stored video programs.
The media center application program can provide various applications for playing multimedia contents. For example, a media center, which may be other than live television or video on demand, may provide services that a user may access to various images or audio through a media center application.
The application program center can provide and store various application programs. The application may be a game, an application, or some other application associated with a computer system or other device that may be run on a display device. The application center may obtain these applications from different sources, store them in local storage, and then be operable on the display device 200.
A schematic diagram of a user interface in a display device 200 according to an exemplary embodiment is illustrated in fig. 4. As shown in fig. 4, the user interface includes a view display area 201, wherein, for example, the view display area 201 includes a layout of one or more different items. And a selector in the user interface indicating that the item is selected, the position of the selector being movable by user input to change the selection of a different item.
In some embodiments, the view display area 201 is a scalable view display. "scalable," may mean that the view display area 201 is scalable in size or proportion on the screen, or that the items in the view display 201 are scalable in size or proportion on the screen.
"item" refers to a visual object displayed in a view display area of a user interface in the display device 200 to represent corresponding content, such as icons, thumbnails, video clips, and the like. For example: the items may represent movies, image content or video clips of a television show, audio content of music, applications, or other user access content history information.
Further, the item may represent an interface or a collection of interfaces on which the display device 200 is connected to an external device, or may represent a name of an external device connected to the display device, or the like. Such as: a signal source input Interface set, or a High Definition Multimedia Interface (HDMI), a USB Interface, a PC terminal Interface, and the like.
It should be noted that: the view display area may present Video chat project content or application layer project content (e.g., web page Video, Video On Demand (VOD) presentations, application screens, etc.).
A "selector" is used to indicate where any item has been selected, such as a cursor or a focus object. Positioning the selection information input according to an icon or menu position touched by the user in the display 200 may cause movement of a focus object displayed in the display device 200 to select a control item, one or more of which may be selected or controlled.
The focus object refers to an object that moves between items according to user input. Illustratively, the focus object position is implemented or identified by drawing a thick line through the item edge. In other embodiments, the focus form is not limited to an example, and may be a form such as a cursor that is recognizable by the user, either tangible or intangible, such as in the form of a 3D deformation of the item, or may change the identification of the border lines, size, color, transparency, and outline and/or font of the text or image of the item in focus.
The event transmission system 2914, which may monitor user input for each predefined event or sub-event heard, provides control identifying the event or sub-event directly or indirectly to the interface layout management module 2913.
The interface layout management module 2913 is configured to monitor the state of the user interface (including the position and/or size of the view partition, the item, the focus or the cursor object, the change process, and the like), and according to the event or the sub-event, may perform a modification on the layout of the size and position, the hierarchy, and the like of the view display area, and/or adjust or modify the layout of the size or/and position, the number, the type, the content, and the like of the layout of various items in the view display area. In some embodiments, the layout is modified and adjusted, including displaying or not displaying the view sections or the content of the items in the view sections on the screen.
And a user input interface for transmitting an input signal of a user to the controller or transmitting a signal output from the controller to the user. For example, the control device (e.g., a mobile terminal or a remote controller) may send an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by a user to the user input interface, and then the input signal is forwarded to the controller by the user input interface; alternatively, the control device may receive an output signal such as audio, video, or data output from the user input interface via the controller, and display the received output signal or output the received output signal in audio or vibration form.
In some embodiments, a user may input a user command on a Graphical User Interface (GUI) displayed on the display 200, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.
FIG. 5 ~ 7 illustrates a user interface interacting with a user in the display device 200 according to an exemplary embodiment, for example, as shown in FIG. 5 ~ 7, an image screen and a user interface are presented on a display, wherein the first user interface 201-1 of the view display area 201 displays a preview screen, which is a video stream of an image captured from a camera captured according to a display resolution, one frame of the preview screen of a shooting scene is displayed in FIG. 5 (the displayed preview screen has multiple frames, one frame is taken as an example), and as can be seen from FIG. 5, the image mode selected by the user is "storage scale-full screen" (the ratio of pixels of the image width and height is 16: 9), the user can click on "beauty filter" to add or change special effect effects to the preview screen, the selectable effects include beauty, filter, special effect sticker, etc., the user can also click "view picture" into the center of an album, and when the user clicks on "take picture", the user interface changes to the state as shown in FIG. 6 in response to the shooting instruction.
As shown in fig. 6, a frame of picture in an image data stream acquired when a user sends a "take picture" instruction is displayed on the first user interface 201-1, and at this time, the user may scan a shared picture, or may click "save" or take a picture again; when the user clicks "save", in response to the "save" instruction, the user interface changes to display the picture just saved in the second user interface 201-2 of the view display area 201 as shown in fig. 7. At this time, the user obtains a display scale of the television display area of 16: 9 picture.
In some exemplary embodiments, the preview screen is formed by continuously displaying, by the controller, the first user interface at the first frame rate after the image acquired by the camera is captured at the second resolution, where the second resolution is a display resolution, and the second frame rate is a frame rate of the display. Illustratively, the preset ratio of the display resolution to width and height is 16: 9, respectively.
In some exemplary embodiments, the first resolution is a resolution at which the camera acquires an image.
In some exemplary embodiments, the preview screen has a special effect, and may be implemented by passing the acquired data stream or image through an interface that calls a special effect algorithm.
Illustratively, an image of the television display area is displayed in the second user interface 201-2 (photo presentation interface), the image having a pixel ratio of width to height of 16: 9.
in some exemplary embodiments, the image storage scale is full screen mode.
Fig. 8 illustrates an image capturing method according to an exemplary embodiment, including:
s101, starting a first user interface at a television end according to a user instruction;
s102, displaying a preview picture of a shooting scene of a camera at a television end on the first user interface, wherein the preview picture is obtained by intercepting an image of a first resolution ratio acquired by the camera according to a second resolution ratio and displaying the image according to the second resolution ratio and a preset frame rate by the controller, and the second resolution ratio is different from the first resolution ratio;
s103, when a photographing instruction is received, acquiring an image with a second resolution of one frame in the preview picture, and displaying the image with the second resolution on the display according to a second frame rate.
Illustratively, the first user interface is a preview interface and the second user interface is a photo presentation interface.
In some exemplary embodiments, the preview screen is a screen cut at a preset scale.
Illustratively, the preset ratio is a pixel ratio of 16: 9; after a preview interface of the mirror application is started at the television end according to the instruction of a user, the camera takes the pixel ratio of the width to the height of an image as 4: 3 (camera captures video stream, and video stream is composed of multiple frames of image data), in order to adapt the pixel ratio of the television width and height to 16: 9, the system Hardware Abstraction Layer (HAL) is used for processing an original image shot by a camera according to the pixel ratio of 16: and 9, intercepting the image, performing compression coding on the intercepted image, and transmitting the image to an upper application (for example, a social television mirror application), wherein the upper application analyzes the image, and continuously displays the image on a preview interface at a certain frame rate (the frame rate value is not limited herein), so as to form a camera preview picture.
The mirror application is an application newly added in the social television project, and the application supports the functions of camera image preview, face recognition, special effect effects of adding a beauty filter and the like, photographing, picture sharing and the like.
In some exemplary embodiments, the preview screen has a special effect.
Exemplary special effects include beauty, filters, stickers, and the like. The preview picture can have a special effect or not; if a special effect needs to be added to the preview picture, the camera object is provided by a special effect algorithm; the method for adding the special effect to the video picture specifically comprises the following steps: outputting the video picture to a texture control; illustratively, a special effect algorithm identifies a human face on the texture control TextureView, adds special effect effects such as filter stickers and the like, superimposes the added special effect on the video image texture without any special effect, and synthesizes a new texture; and outputting the synthesized texture to a display control, so that a user can see a video preview picture with special effects on a preview interface.
If no special effect needs to be added to the preview picture, the mirror application does not process the integrated special effect algorithm, and a Camera Camera object is directly created to control and manage the Camera. The Camera object is used for controlling a Camera switch, configuring Camera parameters, managing Camera start/stop preview, photographing and the like. Camera has many interfaces for managing cameras, configuring parameters, starting/stopping previews, etc. the takePicture interface is used to start the photograph.
For example, when a preview interface displays a preview screen of a shooting scene of a television camera, a user can select an image storage ratio to be in a full-screen mode, and can also increase or change a special effect of the preview screen; when a user clicks 'take a picture', a frame of image is acquired when a taking instruction of the user is received, the user interface is switched to a photo display interface from a preview interface, and the image is displayed on the photo display interface.
In some exemplary embodiments, the first resolution is associated with a resolution at which the camera acquires image data, and the second resolution is associated with a resolution at which a preview screen is displayed in the display.
In some exemplary embodiments, the first frame rate is associated with a frame rate at which the camera acquires image data, and the second frame rate is associated with a frame rate at which a preview screen is displayed in the display.
In some exemplary embodiments, the first resolution is a resolution at a pixel ratio of 4: 3 of image width and height.
In some exemplary embodiments, the second resolution is a resolution at a pixel ratio of 16: 9 of image width and height.
For example, when the image storage ratio is full-screen mode, the pixel ratio of the width and height of the image is 16: 9, the image resolution presented at the second user interface may be 1920 x 1080, for example.
Fig. 9 is a diagram illustrating a comparison of display scales of a camera shooting area and a television display area according to an exemplary embodiment, and it can be seen that an actual shooting area of a camera angle of view is larger than a television preview screen display area.
Fig. 10 is a flowchart illustrating a process of capturing an image of a display area of a tv in an exemplary embodiment, where, at a tv end, an instruction of a user to open a mirror application at the tv end is received, after entering a preview interface, a special effect algorithm interface is called, a control required for display is initialized, and a camera is started in a special effect algorithm, where the camera has a width-to-height pixel ratio of 4: 3, the original image is acquired in order to adapt to the width and height of the television to be 16: 9, HAL of the system to the original image in terms of width and height pixel ratio 16: intercepting in a ratio of 9, performing compression coding on the intercepted image, uploading the image to an upper layer application (for example, a mirror application), analyzing the image by the upper layer application, (as a camera acquires a video stream which consists of a plurality of frames of images), forming a video picture without any special effect by the analyzed image at a certain frame rate (the frame rate value is not limited herein), and outputting the video picture to a texture control; illustratively, a special effect algorithm identifies a human face on the texture control TextureView, adds special effect effects such as filter stickers and the like, superimposes the added special effect on the video image texture without any special effect, and synthesizes a new texture; and outputting the synthesized texture to a display control, so that a user can see a video preview picture with special effects on a preview interface. If the storage proportion selected by the user is in a full-screen mode (the image resolution is 16: 9) and a command of 'taking a picture' of the user is received, acquiring a frame of image of a current video preview picture through a special effect algorithm interface (the frame of image has a special effect), and informing the preview picture, wherein the user can see a Bitmap format image (or pictures in other formats) on the preview interface; when a command that a user clicks 'save' is received, responding to the 'save' command, switching the user interface from the preview interface to a photo display interface, and displaying a photo on the photo display interface; at this point, the user obtains a 16: 9 resolution photograph of the television display area with special effects, which may be 1920 x 1080, for example). If no special effect is added to the video preview picture, the step of shooting the image of the television display area specifically comprises the following steps: receiving an instruction of a user for entering a Camera related application (such as opening a mirror application) at a television end, and obtaining a Camera Camera object (the object is used for controlling a Camera switch, configuring Camera parameters, managing start/stop preview of a Camera, taking a picture and the like) after entering a preview interface; the camera is 4 according to the pixel ratio of width and height: 3, the HAL of the system to the original image is 16: and intercepting the image in a ratio of 9, performing compression coding on the intercepted image, and uploading the image to an upper layer application (for example, a mirror application), wherein the upper layer application analyzes the image, (as a video stream is acquired by a camera, the video stream consists of a plurality of frames of images) and continuously displays the analyzed image on a preview interface at a certain frame rate (the frame rate value is not limited herein), so as to form a video preview picture. At this time, the user sees the formed video preview screen on the preview interface.
If the storage ratio selected by the user is in a full-screen mode (the image resolution is 16: 9), and a command of 'taking a picture' of the user is received, a frame of image of a current video preview picture is obtained (the frame of image does not have a special effect), and the user can see a Bitmap format image (or pictures in other formats) on a preview interface; when a command that a user clicks 'save' is received, responding to the 'save' command, switching the user interface from the preview interface to a photo display interface, and displaying a photo on the photo display interface; at this point, the user obtains a 16: 9 resolution photograph of the television display area without special effects, which may be 1920 x 1080, for example.
In some embodiments, when the user clicks to take a picture, one frame of image in the preview screen is acquired, the first user interface including the preview screen is quitted from being displayed, and the display displays the image of the second resolution.
In some exemplary embodiments, a display apparatus includes: a display configured to display a user interface, wherein the user interface comprises a view display area, wherein the view display area comprises a layout of one or more different items, and a selector indicating that the item is selected, wherein the position of the selector in the user interface can be moved by user input to cause the different item to be selected;
in some exemplary embodiments, a display device further comprises a controller in communication with the display, the controller configured to perform presenting the user interface;
in some exemplary embodiments, the controller displays a first user interface of the view display area on the display according to an instruction for a user to turn on the camera; acquiring an image according to a first resolution through a camera, and forming a preview picture on the first user interface according to a second resolution by the image;
if the image resolution selected by the user is the first resolution, and when the controller receives an instruction for acquiring the image, stopping the preview picture, and calling the camera to acquire the image according to the first resolution and displaying the image on a second user interface of the view display area.
In some exemplary embodiments, a display device is further configured to perform:
displaying a first user interface of the view display area on a display according to an instruction of a user for opening a camera;
acquiring an image according to a first resolution by a camera in a special effect algorithm, adding a special effect to the image of the first resolution, and forming a preview picture on the first user interface according to a second resolution;
if the image resolution selected by the user is the first resolution, and when an instruction for acquiring the image is received, stopping the preview picture, simultaneously calling the camera to acquire the image according to the first resolution, and adding a special effect to display on a second user interface of the view display area.
FIG. 11 ~ 13 illustrates a user interface interacting with a user in the display device 200 according to another exemplary embodiment, for example, in FIG. 11 ~ 13, a plurality of different items are laid out in the view display area 201, for example, a preview image of a shooting scene of a television camera is displayed in the first user interface 201-3 of the view display area 201, a preview image of one frame of the shooting scene is displayed in FIG. 11 (the displayed preview image has a plurality of frames, one frame is taken here for example), and as can be seen from FIG. 11, the image mode selected by the user is "storage scale-standard" (the ratio of pixels of image width and height is 4: 3), the user can click on "beauty filter" to add or change special effects to the preview image, the selectable effects include beauty, filter, sticker, etc., the user can also click on "view picture of a picture", and when the user clicks on "photograph", the user interface changes to the special effects as shown in FIG. 12 in response to a photograph instruction.
As shown in fig. 12, a picture of the last frame before the user sends the "take picture" instruction is displayed on the first user interface 201-3, at this time, the user may scan the shared picture, or click "save" or take picture again; when the user clicks "save", in response to the "save" instruction, the user interface changes to display the picture just saved in the second user interface 201-4 of the view display area 201 as shown in fig. 13. At this time, the display scale of the image obtained by the user, which is the display area of the camera, is 4: 3.
In some exemplary embodiments, acquiring an image according to a first resolution by a camera, and forming a preview screen of the image on the first user interface according to a second resolution by the camera specifically includes:
and presenting a first user interface in the display in response to a user input for starting the camera, wherein the first user interface comprises a preview picture, the preview picture is obtained by intercepting the first resolution image acquired by the camera according to a second resolution by the controller, and is displayed according to the second resolution and a preset frame rate, and the second resolution is different from the first resolution.
Illustratively, the pixel ratio of the second resolution to width and height is 16: 9, respectively.
In some exemplary embodiments, the preview screen has a special effect.
In some exemplary embodiments, when the controller receives a photographing instruction, the data acquired by the camera is taken as a current image and displayed on the second user interface. Specifically, the method comprises the following steps:
when the controller receives a user photographing instruction, the playing of the preview picture is stopped, that is, the conversion of the resolution of the photographic shooting data is stopped. And directly calling the camera to acquire the image data with the first resolution, and displaying the image data on the second user interface after the photographing is finished.
For example, an image of the visible area of the camera is displayed on the second user interface 201-4 (photo presentation interface), and the pixel ratio of the width and height of the image is 4: 3. illustratively, the image resolution is, for example, 4656 x 3496 (which may be set to other values as well).
In some exemplary embodiments, the preset resolution is a resolution corresponding to the image storage ratio selected by the user as the standard mode.
In some exemplary embodiments, after the controller finishes photographing the currently displayed picture of the first user interface, the controller adds a special effect to the obtained image, and displays the image with the added special effect on the second user interface.
Illustratively, the photographed image is returned to the special effect algorithm to add the special effect, and the image with the special effect added is displayed on the second user interface 201-4.
Fig. 14 illustrates another image capturing method according to an exemplary embodiment, including:
s201, receiving a control signal which is input from a user input interface and indicates to start the opening or closing of a camera;
s202, responding to user input for starting the camera, and presenting a first user interface in the display, wherein the first user interface comprises a preview picture, the preview picture is obtained by intercepting the first resolution image collected by the camera by the controller and is displayed according to a second resolution and a first frame rate, and the second resolution is different from the first resolution;
s203, receiving user input of a user for selecting and indicating to acquire a picture in the first user interface through the selector, responding to the user input, acquiring an image with a first resolution acquired by the camera, keeping the preview picture still for display, and displaying the image with the first resolution by the display at a second frame rate.
According to the image shooting method, due to the limitation of bandwidth, in order to ensure the fluency of data flow, images with low resolution and high frame rate are adopted for transmission and display in a preview picture. And the high frame rate transmission is adopted, so that the phenomenon that the figure in the preview picture generates ghost shadow in the motion process is avoided.
According to the image shooting method, due to the limitation of bandwidth, in the process of obtaining the image, in order to guarantee the precision and the definition of the midpoint of the image, the images with high resolution and low frame rate are adopted for transmission and display.
In some exemplary embodiments, the first user interface is a preview interface and the second user interface is a photo presentation interface.
In some exemplary embodiments, the preview screen is a screen cut at a preset scale.
In some exemplary embodiments, the preview screen has a special effect.
Exemplary special effects include beauty, filters, stickers, and the like.
Illustratively, the preset resolution is 4 pixel width and height: 3-scale (image specific resolution is 4656 x 3496, for example); and displaying the image in the second user interface as a camera display area image. The image may be an image with or without a special effect.
In some exemplary embodiments, the preset resolution is a resolution corresponding to the image storage ratio selected by the user as the standard mode.
Fig. 15 is a flowchart illustrating a process of capturing an image of a display area of a camera according to an exemplary embodiment, where, at a television, an instruction of a user to open a mirror application at the television is received, the camera is started, a control required for display is initialized, image data acquired by the camera is cut into a size suitable for display on a display, and a preview interface is entered. If the special effect picture needs to be displayed, the intercepted data stream calls a special effect algorithm interface, and a preview picture with a special effect is presented.
Specifically, the camera is a camera with a width and height pixel ratio of 4: 3, the original image is acquired in order to adapt to the width and height of the television to be 16: 9, HAL of the system to the original image in terms of width and height pixel ratio 16: intercepting in a ratio of 9, performing compression coding on the intercepted image, uploading the image to an upper layer application (for example, a mirror application), analyzing the image by the upper layer application, (as a camera acquires a video stream which consists of a plurality of frames of images), forming a video picture without any special effect by the analyzed image at a certain frame rate (the frame rate value is not limited herein), and outputting the video picture to a texture control; illustratively, a special effect algorithm identifies a human face on the texture control TextureView, adds special effect effects such as filter stickers and the like, superimposes the added special effect on the video image texture without any special effect, and synthesizes a new texture; and outputting the synthesized texture to a display control, so that a user can see a video preview picture with special effects on a preview interface.
If the storage ratio selected by the user is the standard mode (the image resolution is 4: 3), displaying the preview image according to the 1920-1080 preview resolution; and receiving a 'photographing' instruction of a user, stopping the interception and special effect processing of the image data acquired by the camera, and returning to a camera object (the camera is not in the application of a preview algorithm; calling a takePicture interface of the camera to photograph, automatically stopping a preview picture, and at the moment, the user sees one frame of a multi-frame picture when the photographing instruction is executed, wherein the camera object is used for controlling a camera switch, configuring camera parameters, managing the start/stop of the camera for previewing, photographing and the like); then calling a takePicture interface, starting photographing, generating an original photo obtained by a camera, calling a special effect algorithm to add a special effect to the photo, generating a photo with a special effect, and informing a preview interface, so that a user can see a Bitmap format image (or pictures with other formats) on the preview interface; when a command that a user clicks 'save' is received, responding to the 'save' command, switching the user interface from the preview interface to a photo display interface, and displaying a photo on the photo display interface; at this time, the resolution of the user obtaining the visible area of the camera with special effect is 4: 3, may be 4656 x 3496, for example.
If no special effect is added to the video preview picture and the image finally obtained by the user does not have the special effect, the step of shooting the image in the display area of the camera specifically comprises the following steps: and at the television end, receiving an instruction of opening a mirror application at the television end by a user, starting a camera, initializing a control required for display, intercepting image data acquired by the camera into a size suitable for display of a display, and entering a preview interface. After entering a preview interface, a Camera object (the object 1 is used for controlling a Camera switch, configuring Camera parameters, managing Camera start/stop previewing, photographing and the like) is obtained.
The user selects the "store scale-standard" mode (4: 3 pixel ratio for image width and height), still displaying the preview image at 1920 x 1080 preview resolution; when a user clicks a 'photographing' instruction, firstly keeping a preview picture in static display and returning to a camera object (when a takePicture interface of the camera is called for photographing, the preview picture can be automatically kept in static, and at the moment, the user sees a frame of picture during photographing, wherein the camera object is used for controlling a camera switch, configuring camera parameters, managing the start/stop of the camera for previewing, photographing and the like); then calling a takePicture interface, starting to take a picture, and after the picture is taken, a user can see a Bitmap-format image (or pictures in other formats) on a preview interface, wherein the image is an actual visible area picture of the camera; when a command that a user clicks 'save' is received, responding to the 'save' command, switching the user interface from the preview interface to a photo display interface, and displaying a photo on the photo display interface; at this time, the user obtains a resolution without special effect of the visible area of the camera as 4: 3, may be 4656 x 3496, for example.
By the method, the television camera displays the preview picture at 1920-1080 resolution, and when a user takes a picture, an image with corresponding resolution is obtained according to the image storage ratio (full screen or standard) selected by the user; specifically, when the image storage ratio selected by the user is full-screen mode, the ratio of the pixel width and height of the television display area is obtained as 16: 9, obtaining an image with a resolution of 1920 × 1080, when the image storage ratio selected by the user is in the standard mode, the pixel width and height of the visible area of the camera are 4: 3, resolution is for example 4656 x 3496 images. That is, the user can obtain photographs of different resolutions and different shooting angles by simply switching.
Accordingly, on the device side, a display apparatus according to an exemplary embodiment is exemplarily shown in fig. 16, including:
a first unit 11 that acquires ambient environment data at a first resolution;
a second unit 12, responsive to a user input to activate the camera, for presenting a first user interface in a display, where the first user interface includes a preview screen, and the controller intercepts and displays the first resolution image captured by the camera at a second resolution, different from the first resolution, and according to a first frame rate;
a third unit 13, configured to receive a user input indicating that a picture is to be taken selected in the first user interface by the user through the selector, in response to the user input, capture an image of the first resolution acquired by the camera, keep the preview picture still, and display the image of the first resolution at the second frame rate.
Another display device according to an exemplary embodiment is exemplarily shown in fig. 17, including:
an acquisition unit 21 that acquires ambient environment data at a first resolution;
a preview unit 22, responsive to a user input for activating the camera, for presenting a first user interface in a display, where the first user interface includes a preview screen, and the controller intercepts and displays the image captured by the camera at a first resolution, the second resolution being different from the first resolution, and according to a first frame rate;
a display unit 23, configured to receive a user input indicating that a picture is to be taken selected in the first user interface by the user through the selector, in response to the user input, acquire the image of the first resolution acquired by the camera, keep the preview picture still, and display the image of the first resolution at the second frame rate.
Also exemplarily shown in fig. 18 is a display device according to an exemplary embodiment, including:
a processor 800 for reading the program in the memory 810 and executing the following processes:
starting a first user interface at a television according to a user instruction, displaying a preview picture of a shooting scene of a camera at the television at the first user interface, wherein the preview picture is obtained by intercepting a first resolution image acquired by the camera according to a second resolution by the controller, and displaying the first resolution image according to the second resolution and a preset frame rate, and the second resolution is different from the first resolution;
and receiving user input indicating that a picture is acquired by a user through the selector in the first user interface, responding to the user input, acquiring a first image of a first resolution ratio currently acquired by the camera, and keeping a preview picture in the first user interface to be still displayed, wherein the display displays the first image of the first resolution ratio.
In some exemplary embodiments, the preview screen is a screen cut at a preset scale.
In some exemplary embodiments, the preview screen has a special effect.
In some exemplary embodiments, after the picture currently displayed on the first user interface is photographed, a special effect is added to the obtained image, and the image with the added special effect is displayed on the second user interface.
In fig. 18, among other things, the bus architecture may include any number of interconnected buses and bridges with various circuits linking together, one or more processors represented by processor 800 and memory represented by memory 810. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. The bus interface provides an interface.
The exemplary embodiments of the present application provide a display terminal, which may be specifically a desktop computer, a portable computer, a smart phone, a tablet computer, a Personal Digital Assistant (PDA), and the like. The Display terminal may include a Central Processing Unit (CPU), a memory, an input/output device, etc., the input device may include a keyboard, a mouse, a touch screen, etc., and the output device may include a Display device, such as a Liquid Crystal Display (LCD), a Cathode Ray Tube (CRT), etc.
For different display terminals, in some exemplary embodiments, the user interfaces 620, 820 may be interfaces capable of interfacing externally to desired devices including, but not limited to, keypads, displays, speakers, microphones, joysticks, and the like.
The processor is responsible for managing the bus architecture and general processing, and the memory may store data used by the processor 600 in performing operations.
In some exemplary embodiments, the processor may be a CPU (central processing unit), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable gate array), or a CPLD (Complex Programmable Logic Device).
The memory may include Read Only Memory (ROM) and Random Access Memory (RAM), and provides the processor with program instructions and data stored in the memory. In the embodiments of the present application, the memory may be used to store a program of any of the methods provided in the exemplary embodiments of the present application.
The processor is configured to execute any of the methods provided in the exemplary embodiments of the present application in accordance with the obtained program instructions by calling the program instructions stored in the memory.
The present application provides, in an exemplary embodiment, a computer storage medium for storing computer program instructions for an apparatus provided in the above-mentioned embodiment of the present application, which includes a program for executing any one of the methods provided in the above-mentioned embodiment of the present application.
The computer storage media may be any available media or data storage device that can be accessed by a computer, including, but not limited to, magnetic memory (e.g., floppy disks, hard disks, magnetic tape, magneto-optical disks (MOs), etc.), optical memory (e.g., CDs, DVDs, BDs, HVDs, etc.), and semiconductor memory (e.g., ROMs, EPROMs, EEPROMs, non-volatile memory (NAND FLASH), Solid State Disks (SSDs)), etc.
In summary, the exemplary embodiments of the present application provide a display device, so that an image is captured and displayed according to a resolution set by a user at a television end. Specifically, when the image mode selected by the user is a full-screen mode (16: 9), shooting an image of a television visible area at the television end and displaying the image; when the image mode selected by the user is the standard mode (4: 3), shooting the image of the visible area of the camera at the television end and displaying the image; therefore, the user can obtain the photos with different resolutions and different shooting visual angles through simple switching.
As will be appreciated by one skilled in the art, the present application in exemplary embodiments may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments shown in the present application without inventive effort, shall fall within the scope of protection of the present application. Moreover, while the disclosure herein has been presented in terms of exemplary one or more examples, it is to be understood that each aspect of the disclosure can be utilized independently and separately from other aspects of the disclosure to provide a complete disclosure.
It should be understood that the terms "first," "second," "third," and the like in the description and in the claims of the present application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used are interchangeable under appropriate circumstances and can be implemented in sequences other than those illustrated or otherwise described herein with respect to the embodiments of the application, for example.
Furthermore, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims (10)

1. A display device, comprising:
the camera is used for acquiring first-resolution acquired image data;
a display configured to display an image screen and a user interface, and a selector in the user interface to indicate that an item is selected in the user interface;
a controller in communication with the display, the controller configured to: receiving a control signal input from a user input interface and indicating to start the opening or closing of the camera;
presenting a first user interface in the display in response to a user input for starting the camera, wherein the first user interface comprises a preview picture, the preview picture is obtained by intercepting the first resolution image acquired by the camera by the controller and is displayed according to a second resolution and a first frame rate, and the second resolution is different from the first resolution;
receiving user input indicating that a picture is acquired by a user through selection of the selector in the first user interface, responding to the user input, acquiring an image with a first resolution acquired by the camera, keeping the preview picture still, and displaying the image with the first resolution by the display at a second frame rate.
2. The display device according to claim 1, wherein the controller is further configured to perform:
and calling a special effect algorithm interface to carry out special effect processing on the preview picture.
3. The display device of claim 2, wherein the controller receives a user input indicating that a picture is to be taken by a user selecting in the first user interface via the selector, and in response to the user input, after the capturing of the first resolution image by the camera, is further configured to perform:
and performing special effect processing on the acquired image data with the first resolution, and presenting the image data on the display according to the second frame rate.
4. The display device according to claim 1, wherein receiving a user input for acquiring a first resolution image, stopping the formation of the preview screen, and acquiring one frame of the first resolution image data acquired by the camera, specifically comprises:
receiving user input of selecting an image storage ratio by a user, setting an image acquisition mode, acquiring a first resolution image acquired by a camera when receiving the user input for acquiring the first resolution image, keeping the preview picture in static display, and displaying the first resolution image at a second frame rate.
5. The display device according to claim 1, wherein the controller, after performing the receiving of the user input indicating that a picture is taken by selecting the user input in the first user interface through the selector, is further configured to perform:
and responding to the user input, acquiring a first image of a first resolution acquired currently by the camera, keeping a preview picture in the first user interface still for display, then quitting displaying the first user interface comprising the preview picture, and displaying the first image of the first resolution by a display.
6. An image capturing method, characterized by comprising:
receiving a control signal input from a user input interface and indicating to start the opening or closing of the camera;
presenting a first user interface in the display in response to a user input for starting the camera, wherein the first user interface comprises a preview picture, the preview picture is obtained by intercepting the first resolution image acquired by the camera by the controller and is displayed according to a second resolution and a first frame rate, and the second resolution is different from the first resolution;
receiving user input indicating that a picture is acquired by a user through selection of the selector in the first user interface, responding to the user input, acquiring an image with a first resolution acquired by the camera, keeping the preview picture still, and displaying the image with the first resolution by the display at a second frame rate.
7. The method of claim 6, further comprising, after said receiving user input indicating taking a picture selected in said first user interface by said selector:
and responding to the user input, acquiring a first image of a first resolution acquired currently by the camera, keeping a preview picture in the first user interface still for display, then quitting displaying the first user interface comprising the preview picture, and displaying the first image of the first resolution at a second frame rate by the display.
8. The method of claim 6, wherein a special effects algorithm interface is invoked to perform special effects processing on the preview screen.
9. The method of claim 6 ~ 8, wherein, after receiving user input from a user via the selector indicating that a picture is to be taken in the first user interface, and in response to the user input, capturing a first image of a first resolution currently captured by the camera and maintaining a still display of a preview screen in the first user interface, further comprising:
and carrying out special effect processing on the acquired first image, and displaying the first image subjected to the special effect processing by a display.
10. A computing device, comprising:
a memory for storing program instructions;
a processor for calling program instructions stored in said memory to execute the method of any of claims 6 ~ 9 in accordance with the obtained program.
CN201910877525.6A 2019-06-10 2019-09-17 Display device Active CN110636353B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/079701 WO2020248640A1 (en) 2019-06-10 2020-03-17 Display device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910497563 2019-06-10
CN2019104975639 2019-06-10

Publications (2)

Publication Number Publication Date
CN110636353A true CN110636353A (en) 2019-12-31
CN110636353B CN110636353B (en) 2022-09-02

Family

ID=68971130

Family Applications (3)

Application Number Title Priority Date Filing Date
CN201910878161.3A Pending CN110636354A (en) 2019-06-10 2019-09-17 Display device
CN201910877523.7A Pending CN112073765A (en) 2019-06-10 2019-09-17 Display device
CN201910877525.6A Active CN110636353B (en) 2019-06-10 2019-09-17 Display device

Family Applications Before (2)

Application Number Title Priority Date Filing Date
CN201910878161.3A Pending CN110636354A (en) 2019-06-10 2019-09-17 Display device
CN201910877523.7A Pending CN112073765A (en) 2019-06-10 2019-09-17 Display device

Country Status (2)

Country Link
CN (3) CN110636354A (en)
WO (1) WO2020248640A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111314606A (en) * 2020-02-21 2020-06-19 Oppo广东移动通信有限公司 Photographing method and device, electronic equipment and storage medium
CN113099308A (en) * 2021-03-31 2021-07-09 聚好看科技股份有限公司 Content display method, display equipment and image collector
CN114513690A (en) * 2020-10-27 2022-05-17 海信视像科技股份有限公司 Display device and image acquisition method
CN115474073A (en) * 2021-06-11 2022-12-13 上海赛连信息科技有限公司 Method and device for intelligently switching picture layout
WO2022257922A1 (en) * 2021-06-11 2022-12-15 上海英立视电子有限公司 Television-based mirror viewing field generation method, system, and device, and medium

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110636354A (en) * 2019-06-10 2019-12-31 青岛海信电器股份有限公司 Display device
CN113497979A (en) * 2020-03-20 2021-10-12 佛山市云米电器科技有限公司 Interface mode display method, cloud server, television, system and storage medium
CN111917998A (en) * 2020-08-12 2020-11-10 惠州市康冠科技有限公司 GPUImgae-based smart television special-effect camera generation method and device and smart television
CN112261289B (en) * 2020-10-16 2022-08-26 海信视像科技股份有限公司 Display device and AI algorithm result acquisition method
CN114650363B (en) * 2020-12-18 2023-07-21 华为技术有限公司 Image display method and electronic equipment
CN112822556B (en) * 2020-12-31 2022-11-15 上海米哈游天命科技有限公司 Game picture shooting method, device, equipment and storage medium
CN114339358A (en) * 2021-04-16 2022-04-12 海信视像科技股份有限公司 Dynamic processing method of shutdown selection interface and display device
CN115809957A (en) * 2021-09-13 2023-03-17 北京字跳网络技术有限公司 Image processing method and apparatus
CN113938587B (en) * 2021-09-14 2024-03-15 青岛海信移动通信技术有限公司 Double-camera-based shooting method and electronic equipment
CN113971048A (en) * 2021-10-29 2022-01-25 Oppo广东移动通信有限公司 Application program starting method and device, storage medium and electronic equipment

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102957901A (en) * 2012-11-19 2013-03-06 天津三星电子有限公司 Display system
CN103188443A (en) * 2011-12-28 2013-07-03 卡西欧计算机株式会社 Image generation device, digital camera and method thereof
US20140036108A1 (en) * 2012-08-03 2014-02-06 Samsung Electronics Co., Ltd. Image processing method and apparatus
CN104333701A (en) * 2014-11-28 2015-02-04 广东欧珀移动通信有限公司 Method and device for displaying camera preview pictures as well as terminal
CN105264480A (en) * 2013-06-09 2016-01-20 苹果公司 Device, method, and graphical user interface for switching between camera interfaces
CN205378145U (en) * 2016-02-04 2016-07-06 许阳振 Electronic mirror
CN106506932A (en) * 2015-09-08 2017-03-15 中兴通讯股份有限公司 The acquisition methods and device of image
CN107155059A (en) * 2017-04-11 2017-09-12 深圳市金立通信设备有限公司 A kind of image preview method and terminal
US20170302844A1 (en) * 2016-04-13 2017-10-19 Canon Kabushiki Kaisha Image capturing apparatus, control method therefor, and storage medium
CN108337442A (en) * 2018-05-14 2018-07-27 Oppo广东移动通信有限公司 Shooting preview display methods, device, terminal and storage medium
CN108737732A (en) * 2018-06-04 2018-11-02 成都依能科技股份有限公司 A method of give a definition static high-definition image shooting area in dynamic image preview
KR20190014302A (en) * 2017-08-01 2019-02-12 삼성디스플레이 주식회사 Display apparatus and method of driving the same
CN109460174A (en) * 2018-11-09 2019-03-12 维沃移动通信有限公司 A kind of information processing method and terminal device
CN109547700A (en) * 2018-12-27 2019-03-29 维沃移动通信有限公司 Photographic method and terminal

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8549442B2 (en) * 2005-12-12 2013-10-01 Sony Computer Entertainment Inc. Voice and video control of interactive electronically simulated environment
CN101510970A (en) * 2009-03-27 2009-08-19 四川长虹电器股份有限公司 Method for displaying 4:3 image on a 16:9 television
KR20110126346A (en) * 2010-05-17 2011-11-23 엘지전자 주식회사 Method of providing definition selection menu and broadcasting receiving apparatus
CN102681302A (en) * 2011-03-17 2012-09-19 天津三星光电子有限公司 Method and device for selecting image composition automatically and self-timing shoot and photographic device
CN103414945A (en) * 2013-07-17 2013-11-27 深圳Tcl新技术有限公司 Method and device for automatically clipping and displaying target image
CN103618933A (en) * 2013-11-28 2014-03-05 青岛海信电器股份有限公司 Method and device for displaying application interface images self-adaptively
KR102271853B1 (en) * 2014-03-21 2021-07-01 삼성전자주식회사 Electronic apparatus, image processing method, and computer-readable recording medium
CN104270579B (en) * 2014-09-24 2018-06-05 青岛海信移动通信技术股份有限公司 A kind of terminal applies interface pixel method of adjustment and terminal
US10748264B2 (en) * 2015-09-09 2020-08-18 Sony Corporation Image processing apparatus and image processing method
CN105915872B (en) * 2016-06-06 2017-12-29 苏州佳世达光电有限公司 The output intent and projection arrangement of image
CN106339705B (en) * 2016-08-16 2019-07-02 北京小米移动软件有限公司 Image acquisition method and device
CN106331488A (en) * 2016-08-25 2017-01-11 天脉聚源(北京)传媒科技有限公司 Interface adjusting method and device
CN106293589B (en) * 2016-08-31 2019-04-12 宇龙计算机通信科技(深圳)有限公司 A kind of method, apparatus and terminal that preview resolution is set
CN106657761A (en) * 2016-09-29 2017-05-10 乐视控股（北京）有限公司 Picture shooting method and device for intelligent terminal
KR20180051202A (en) * 2016-11-08 2018-05-16 삼성전자주식회사 Display apparatus and control method thereof
CN106896999A (en) * 2017-01-06 2017-06-27 广东小天才科技有限公司 The mirror analogy method and device of a kind of mobile terminal
CN106937043A (en) * 2017-02-16 2017-07-07 奇酷互联网络科技（深圳）有限公司 The method and apparatus of mobile terminal and its image procossing
CN111213363A (en) * 2017-10-13 2020-05-29 深圳传音通讯有限公司 Terminal photographing control method, mobile terminal and readable storage medium
CN109302629B (en) * 2018-08-27 2021-07-06 海信视像科技股份有限公司 Method for switching picture frames for pictures and display terminal
CN109120997A (en) * 2018-09-30 2019-01-01 北京微播视界科技有限公司 Method for processing video frequency, device, terminal and medium
CN110636354A (en) * 2019-06-10 2019-12-31 青岛海信电器股份有限公司 Display device

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103188443A (en) * 2011-12-28 2013-07-03 卡西欧计算机株式会社 Image generation device, digital camera and method thereof
US20140036108A1 (en) * 2012-08-03 2014-02-06 Samsung Electronics Co., Ltd. Image processing method and apparatus
CN102957901A (en) * 2012-11-19 2013-03-06 天津三星电子有限公司 Display system
CN105264480A (en) * 2013-06-09 2016-01-20 苹果公司 Device, method, and graphical user interface for switching between camera interfaces
CN104333701A (en) * 2014-11-28 2015-02-04 广东欧珀移动通信有限公司 Method and device for displaying camera preview pictures as well as terminal
CN106506932A (en) * 2015-09-08 2017-03-15 中兴通讯股份有限公司 The acquisition methods and device of image
CN205378145U (en) * 2016-02-04 2016-07-06 许阳振 Electronic mirror
US20170302844A1 (en) * 2016-04-13 2017-10-19 Canon Kabushiki Kaisha Image capturing apparatus, control method therefor, and storage medium
CN107155059A (en) * 2017-04-11 2017-09-12 深圳市金立通信设备有限公司 A kind of image preview method and terminal
KR20190014302A (en) * 2017-08-01 2019-02-12 삼성디스플레이 주식회사 Display apparatus and method of driving the same
CN108337442A (en) * 2018-05-14 2018-07-27 Oppo广东移动通信有限公司 Shooting preview display methods, device, terminal and storage medium
CN108737732A (en) * 2018-06-04 2018-11-02 成都依能科技股份有限公司 A method of give a definition static high-definition image shooting area in dynamic image preview
CN109460174A (en) * 2018-11-09 2019-03-12 维沃移动通信有限公司 A kind of information processing method and terminal device
CN109547700A (en) * 2018-12-27 2019-03-29 维沃移动通信有限公司 Photographic method and terminal

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111314606A (en) * 2020-02-21 2020-06-19 Oppo广东移动通信有限公司 Photographing method and device, electronic equipment and storage medium
CN114513690A (en) * 2020-10-27 2022-05-17 海信视像科技股份有限公司 Display device and image acquisition method
CN114513690B (en) * 2020-10-27 2024-04-05 海信视像科技股份有限公司 Display device and image acquisition method
CN113099308A (en) * 2021-03-31 2021-07-09 聚好看科技股份有限公司 Content display method, display equipment and image collector
CN113099308B (en) * 2021-03-31 2023-10-27 聚好看科技股份有限公司 Content display method, display equipment and image collector
CN115474073A (en) * 2021-06-11 2022-12-13 上海赛连信息科技有限公司 Method and device for intelligently switching picture layout
WO2022257922A1 (en) * 2021-06-11 2022-12-15 上海英立视电子有限公司 Television-based mirror viewing field generation method, system, and device, and medium
CN115474073B (en) * 2021-06-11 2023-12-12 上海赛连信息科技有限公司 Method and device for intelligently switching picture layout

Also Published As

Publication number Publication date
CN112073765A (en) 2020-12-11
CN110636353B (en) 2022-09-02
CN110636354A (en) 2019-12-31
WO2020248640A1 (en) 2020-12-17

Similar Documents

Publication Publication Date Title
CN110636353B (en) Display device
CN110611787B (en) Display and image processing method
CN112073798B (en) Data transmission method and equipment
CN112399212A (en) Display device, file sharing method and server
CN114296949A (en) Virtual reality equipment and high-definition screen capturing method
CN112073788A (en) Video data processing method and device and display equipment
CN112073770B (en) Display device and video communication data processing method
CN112399263A (en) Interaction method, display device and mobile terminal
CN112073778A (en) Display device and fault-tolerant method for key transmission
CN112399264B (en) Projection hall service management method and application
CN112073662A (en) Display device
CN112399233A (en) Display device and position self-adaptive adjusting method of video chat window
CN112068987A (en) Method and device for rapidly restoring factory settings
CN112463267B (en) Method for presenting screen saver information on display device screen and display device
CN112788378A (en) Display apparatus and content display method
CN112073663A (en) Audio gain adjusting method, video chatting method and display equipment
CN112073777B (en) Voice interaction method and display device
CN112073812B (en) Application management method on smart television and display device
WO2020248682A1 (en) Display device and virtual scene generation method
CN112399235A (en) Method for enhancing photographing effect of camera of smart television and display device
CN114286077A (en) Virtual reality equipment and VR scene image display method
CN112073773A (en) Screen interaction method and device and display equipment
CN112399223B (en) Method for improving moire fringe phenomenon and display device
CN112073779B (en) Display device and fault-tolerant method for key transmission
CN112995113B (en) Display device, port control method and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 266100 No. 151, Zhuzhou Road, Laoshan District, Shandong, Qingdao

Applicant after: Hisense Visual Technology Co., Ltd.

Address before: 266100 No. 151, Zhuzhou Road, Laoshan District, Shandong, Qingdao

Applicant before: QINGDAO HISENSE ELECTRONICS Co.,Ltd.

GR01 Patent grant
GR01 Patent grant