WO2023185809A1 - Procédé et appareil de génération de données vidéo, et dispositif électronique et support de stockage - Google Patents

Procédé et appareil de génération de données vidéo, et dispositif électronique et support de stockage Download PDF

Info

Publication number
WO2023185809A1
WO2023185809A1 PCT/CN2023/084310 CN2023084310W WO2023185809A1 WO 2023185809 A1 WO2023185809 A1 WO 2023185809A1 CN 2023084310 W CN2023084310 W CN 2023084310W WO 2023185809 A1 WO2023185809 A1 WO 2023185809A1
Authority
WO
WIPO (PCT)
Prior art keywords
client
data
video data
video
target
Prior art date
Application number
PCT/CN2023/084310
Other languages
English (en)
Chinese (zh)
Inventor
翟昊
朱启
刘家诚
Original Assignee
北京字跳网络技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京字跳网络技术有限公司 filed Critical 北京字跳网络技术有限公司
Publication of WO2023185809A1 publication Critical patent/WO2023185809A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4882—Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing

Definitions

  • the present disclosure relates to the field of computer technology, and specifically, to a video data generation method, a video data generation device, an electronic device, and a computer-readable storage medium.
  • the present disclosure provides at least a video data generation method, a video data generation device, an electronic device, and a computer-readable storage medium, which can enrich the display effect of the generated video data content, thereby improving the user's viewing experience.
  • the present disclosure provides a video data generation method, including:
  • the method upon receiving a fusion instruction for a plurality of first material clips sent by the first client, the method further includes:
  • rendering and generating second video data based on the real scene video and a plurality of first 3D data includes:
  • a plurality of target first material clips that are the same as the second number are determined from the plurality of first material clips.
  • the first video data is sent to the The second client is displayed.
  • a plurality of target first video data are respectively rendered and generated, and the plurality of target first video data are sent to the first client for display respectively.
  • prompt information is sent to the second client, where the prompt information is used to prompt the user of the second client whether to use the real scene video Fusion with the second material segment.
  • the present disclosure also provides an electronic device, including: a processor, a memory, and a bus.
  • the memory stores machine-readable instructions executable by the processor.
  • the connection between the processor and the memory is communicate through a bus, and when the machine-readable instructions are executed by the processor, the above video data generating method is performed.
  • Figure 2 is a flow chart of a video data generation method provided by an embodiment of the present disclosure
  • Figure 8 is a schematic diagram of an interface for displaying prompt information provided by an embodiment of the present disclosure.
  • Figure 9 is a schematic structural diagram of a video data generation device provided by an embodiment of the present disclosure.
  • embodiments of the present disclosure provide a video data generation method, which method includes: in response to a first trigger instruction for a first material clip sent by a first client, acquiring a real scene from the first client Video; based on the first trigger instruction, determine the first 3D data corresponding to the first material clip; based on the real scene video and the first 3D data, render and generate the first video data, and convert the The first video data is sent to the first client for display.
  • the first 3D data is stored on the server, and the above steps of generating video data are completed on the server, that is, there is no need to download the first 3D data corresponding to the first material clip to the client. Processing, in this way, can improve the response speed to user-triggered operations, thereby improving the user's interactive experience.
  • Figure 1 is a schematic diagram of the interaction between an execution subject of a video data generation method and a first client provided by an embodiment of the present disclosure.
  • the execution subject of the method is an electronic device, and the electronic device includes Server 10, where the server 10 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or it can provide cloud services, cloud databases, cloud computing, and cloud storage. , big data and artificial intelligence platforms and other basic cloud computing services.
  • the implementation process of the video data generation method in the embodiment of the present disclosure involves the communication process between the server and the first client.
  • the first client can also be called a terminal.
  • the terminal may be a smartphone 20, a desktop computer 30 or a notebook computer 40, etc. shown in FIG. 1, or a tablet computer, a smart speaker, a smart watch, etc. shown in FIG. 1, and is not limited thereto.
  • the first 3D data may also be 3D data that can be fused with real scene video to generate video data. That is to say, the corresponding relationship between the first 3D data and the first material clip is not limited to the above-mentioned relationship in which the first material clip can be obtained after rendering at least part of the first 3D data, and may also be Other corresponding relationships.
  • the first material clip is a video clip of a virtual object dancing
  • the first 3D data corresponding to the first material clip may be special effects data that can be applied to the video clip.
  • the first video of the real scene obtained from the first client and the first material clip are The fusion of 3D data makes the display effect of the content of the generated video data richer, that is, it can present the effect of combining virtual and real, which in turn helps to improve the user's viewing experience.
  • the determination may also be based on the correlation between the plurality of first material clips, for example, it may be automatically determined based on the contents of the plurality of first material clips. Specifically, the determination can be made based on the correlation between the virtual objects in the multiple material clips and the performance content of the virtual objects.
  • the target first material segment can be determined from the plurality of first material segments based on the performance content. A, B, C and D. In this way, the correlation and completeness between multiple target first material segments can be improved.
  • FIG. 6 is a flow chart of a method for sending first video data to a second client according to an embodiment of the present disclosure. As shown in Figure 6, it includes the following S601 ⁇ S604:
  • Figure 8 is a schematic diagram of an interface for displaying prompt information provided by an embodiment of the present disclosure.
  • a prompt pop-up window interface can be displayed on the display screen of the second client.
  • the pop-up window interface may include a window for displaying real-life scene videos and a window for prompt information "whether real-life scene videos need to be used", that is, to recommend and display adapted real-life scene videos to the user of the second client, and the user also You can make selections based on the option icons in the pop-up window, which will help improve the user experience of the second client.
  • rendering Based on the real scene video and a plurality of first 3D data, rendering generates second video data, and sends the second video data to the first client for display.
  • the determination module 1020 is also used to:
  • the rendering module 1030 is also used to:
  • prompt information is sent to the second client, where the prompt information is used to prompt the user of the second client whether to use the real scene video Fusion with the second material segment.
  • the memory 1102 can be, but is not limited to, random access memory (Random Access Memory, RAM), read-only memory (Read Only Memory, ROM), programmable read-only memory (Programmable Read-Only Memory, PROM), and can Erasable Programmable Read-Only Memory (EPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), etc.
  • RAM Random Access Memory
  • ROM read-only memory
  • PROM programmable read-only memory
  • EPROM Erasable Programmable Read-Only Memory
  • EEPROM Electrically Erasable Programmable Read-Only Memory
  • the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 800 .
  • the electronic device 1100 may include more or fewer components than shown in the figures, or some components may be combined, some components may be separated, or some components may be arranged differently.
  • the components illustrated may be implemented in hardware, software, or a combination of software and hardware.
  • the above-mentioned computer program product can be specifically implemented by hardware, software or a combination thereof.
  • the computer program product is embodied as a computer storage medium.
  • the computer program product is embodied as a software product, such as a Software Development Kit (SDK), etc. wait.
  • SDK Software Development Kit

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Graphics (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Processing Or Creating Images (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • User Interface Of Digital Computer (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

La présente divulgation concerne un procédé et un appareil de génération de données vidéo, ainsi qu'un dispositif électronique et un support de stockage. Le procédé comprend les étapes suivantes : en réponse à une première instruction de déclenchement envoyée par un premier client pour un premier clip matériel, acquérir une vidéo de scène réelle provenant du premier client ; sur la base de la première instruction de déclenchement, déterminer des premières données 3D correspondant au premier clip matériel ; et sur la base de la vidéo de scène réelle et des premières données 3D, effectuer un rendu pour générer des premières données vidéo, et envoyer les premières données vidéo au premier client à des fins d'affichage. Les modes de réalisation de la présente divulgation permettent de mettre en oeuvre le procédé de génération de données vidéo au niveau d'une extrémité de desserte, et d'améliorer ainsi la vitesse de réponse à une opération déclenchée par un utilisateur, ce qui améliore l'expérience d'interaction de l'utilisateur.
PCT/CN2023/084310 2022-04-01 2023-03-28 Procédé et appareil de génération de données vidéo, et dispositif électronique et support de stockage WO2023185809A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210339165.6 2022-04-01
CN202210339165.6A CN114697703B (zh) 2022-04-01 2022-04-01 视频数据生成方法、装置、电子设备及存储介质

Publications (1)

Publication Number Publication Date
WO2023185809A1 true WO2023185809A1 (fr) 2023-10-05

Family

ID=82141592

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/084310 WO2023185809A1 (fr) 2022-04-01 2023-03-28 Procédé et appareil de génération de données vidéo, et dispositif électronique et support de stockage

Country Status (2)

Country Link
CN (1) CN114697703B (fr)
WO (1) WO2023185809A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114697703B (zh) * 2022-04-01 2024-03-22 北京字跳网络技术有限公司 视频数据生成方法、装置、电子设备及存储介质
CN115174993B (zh) * 2022-08-09 2024-02-13 北京字跳网络技术有限公司 用于视频制作的方法、装置、设备和存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111862348A (zh) * 2020-07-30 2020-10-30 腾讯科技（深圳）有限公司 视频显示方法、视频生成方法、装置、设备及存储介质
CN112316424A (zh) * 2021-01-06 2021-02-05 腾讯科技（深圳）有限公司 一种游戏数据处理方法、装置及存储介质
WO2021202412A1 (fr) * 2020-03-31 2021-10-07 Home Box Office, Inc. Création d'expériences de réalité augmentée en transmission en continu, hébergées en nuage à faible latence perçue
CN113891140A (zh) * 2021-09-30 2022-01-04 北京市商汤科技开发有限公司 一种素材编辑方法、装置、设备及存储介质
CN114697703A (zh) * 2022-04-01 2022-07-01 北京字跳网络技术有限公司 视频数据生成方法、装置、电子设备及存储介质

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106331645B (zh) * 2016-09-08 2019-02-22 北京美吉克科技发展有限公司 利用虚拟镜头实现vr全景视频后期编辑的方法和系统
US10497180B1 (en) * 2018-07-03 2019-12-03 Ooo “Ai-Eksp” System and method for display of augmented reality
US11030814B1 (en) * 2019-01-15 2021-06-08 Facebook, Inc. Data sterilization for post-capture editing of artificial reality effects
CN111163323A (zh) * 2019-09-30 2020-05-15 广州市伟为科技有限公司 在线视频创作系统及方法
CN111510645B (zh) * 2020-04-27 2022-09-27 北京字节跳动网络技术有限公司 视频处理方法、装置、计算机可读介质和电子设备
CN111541914B (zh) * 2020-05-14 2021-10-15 腾讯科技（深圳）有限公司 一种视频处理方法及存储介质
CN111625100A (zh) * 2020-06-03 2020-09-04 浙江商汤科技开发有限公司 图画内容的呈现方法、装置、计算机设备及存储介质
CN112070906A (zh) * 2020-08-31 2020-12-11 北京市商汤科技开发有限公司 一种增强现实系统及增强现实数据的生成方法、装置
CN112422812B (zh) * 2020-09-01 2022-03-29 华为技术有限公司 图像处理方法、移动终端及存储介质
CN112291590A (zh) * 2020-10-30 2021-01-29 北京字节跳动网络技术有限公司 视频处理方法及设备
CN112569599B (zh) * 2020-12-24 2022-11-04 腾讯科技（深圳）有限公司 虚拟场景中虚拟对象的控制方法、装置及电子设备
CN113521758B (zh) * 2021-08-04 2023-10-24 北京字跳网络技术有限公司 信息交互方法及装置、电子设备、存储介质
CN113747199A (zh) * 2021-08-23 2021-12-03 北京达佳互联信息技术有限公司 视频编辑方法、装置、电子设备、存储介质及程序产品
CN113794846A (zh) * 2021-09-22 2021-12-14 苏州聚慧邦信息科技有限公司 一种视频云剪辑方法、装置及云剪辑服务器
CN113850746A (zh) * 2021-09-29 2021-12-28 北京字跳网络技术有限公司 图像处理方法、装置、电子设备及存储介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021202412A1 (fr) * 2020-03-31 2021-10-07 Home Box Office, Inc. Création d'expériences de réalité augmentée en transmission en continu, hébergées en nuage à faible latence perçue
CN111862348A (zh) * 2020-07-30 2020-10-30 腾讯科技（深圳）有限公司 视频显示方法、视频生成方法、装置、设备及存储介质
CN112316424A (zh) * 2021-01-06 2021-02-05 腾讯科技（深圳）有限公司 一种游戏数据处理方法、装置及存储介质
CN113891140A (zh) * 2021-09-30 2022-01-04 北京市商汤科技开发有限公司 一种素材编辑方法、装置、设备及存储介质
CN114697703A (zh) * 2022-04-01 2022-07-01 北京字跳网络技术有限公司 视频数据生成方法、装置、电子设备及存储介质

Also Published As

Publication number Publication date
CN114697703B (zh) 2024-03-22
CN114697703A (zh) 2022-07-01

Similar Documents

Publication Publication Date Title
WO2023185809A1 (fr) Procédé et appareil de génération de données vidéo, et dispositif électronique et support de stockage
WO2019128787A1 (fr) Procédé et appareil de diffusion en direct de vidéo en réseau et dispositif électronique
WO2022001593A1 (fr) Procédé et appareil de génération de vidéo, support de stockage et dispositif informatique
TWI752502B (zh) 一種分鏡效果的實現方法、電子設備及電腦可讀儲存介質
CN112637622A (zh) 一种直播演唱方法、装置、设备及介质
CN113766296B (zh) 直播画面的展示方法和装置
WO2021254502A1 (fr) Procédé et appareil d'affichage d'objet cible, et dispositif électronique
CN112199016B (zh) 图像处理方法、装置、电子设备及计算机可读存储介质
TW202304212A (zh) 直播方法、系統、電腦設備及電腦可讀儲存媒體
CN108846886B (zh) 一种ar表情的生成方法、客户端、终端和存储介质
JP2024519780A (ja) アプリケーションのページ表示方法、装置及び機器
WO2021139353A1 (fr) Procédé et appareil d'affichage d'élément, dispositif informatique et support de stockage
CN111615002B (zh) 视频后台播放控制方法、装置、系统及电子设备
CN109743584B (zh) 全景视频合成方法、服务器、终端设备及存储介质
WO2023169297A1 (fr) Procédé et appareil de génération d'effet spécial d'animation, dispositif et support
CN112291590A (zh) 视频处理方法及设备
CN114615513B (zh) 视频数据生成方法、装置、电子设备及存储介质
CN114245099B (zh) 视频生成方法、装置、电子设备以及存储介质
WO2023030550A1 (fr) Procédé de génération de données, procédé de traitement d'image, appareils, dispositif et support de stockage
CN112261433A (zh) 虚拟礼物的发送方法、显示方法、装置、终端及存储介质
US20230368461A1 (en) Method and apparatus for processing action of virtual object, and storage medium
WO2023035897A1 (fr) Procédé et appareil de génération de données vidéo, dispositif électronique et support de stockage lisible
WO2023226814A1 (fr) Procédé et appareil de traitement vidéo, dispositif électronique et support de stockage
WO2023045637A1 (fr) Procédé et appareil de génération de données vidéo, dispositif électronique et support de stockage lisible
CN104616342A (zh) 序列帧与全景的相互转换方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23778174

Country of ref document: EP

Kind code of ref document: A1