這裡將詳細地對示例性實施例進行說明，其示例表示在圖式中。下面的描述涉及圖式時，除非另有表示，不同圖式中的相同數字表示相同或相似的要素。以下示例性實施例中所描述的實施方式並不代表與本說明書一個或多個實施例相一致的所有實施方式。相反，它們僅是與如所附申請專利範圍中所詳述的、本說明書一個或多個實施例的一些方面相一致的裝置和方法的例子。
需要說明的是：在其他實施例中並不一定按照本說明書示出和描述的順序來執行相應方法的步驟。在一些其他實施例中，其方法所包括的步驟可以比本說明書所描述的更多或更少。此外，本說明書中所描述的單個步驟，在其他實施例中可能被分解為多個步驟進行描述；而本說明書中所描述的多個步驟，在其他實施例中也可能被合併為單個步驟進行描述。
圖1是一示例性實施例提供的一種多媒體協議的內容確認方法的流程圖。如圖1所示，該方法應用於區塊鏈節點，可以包括以下步驟：
步驟102，獲取協議參與方提供的視訊或音訊形式的第一多媒體資料，所述第一多媒體資料中包含用於表徵協議內容的第一資訊和用於表徵所述協議參與方認可所述協議內容的第二資訊。
在一實施例中，透過在電子設備上安裝、運行區塊鏈的客戶端，可以將該電子設備配置為區塊鏈網路中的區塊鏈節點，比如該電子設備可以包括伺服器、PC、平板電腦、手機等各種類型；換言之，區塊鏈節點可以承載於任意形式的電子設備上，本說明書並不對此進行限制。
在一實施例中，第一資訊的內容可以為協議參與方讀出協議內容的視訊片段或音訊片段；或者，第一資訊的內容可以為協議參與方手持印製有協議內容的文本或展示有協議內容的電子設備的視訊片段；或者，第一資訊可以透過其他方式表徵協議內容，本說明書並不對此進行限制。
在一實施例中，第二資訊的內容可以為協議參與方說出類似於“我同意”、“我確認”、“我認可”或類似的語句；或者，第二資訊的內容可以為協議參與方做出表徵“認可”的動作，比如點頭、伸出大拇指、微笑等；或者，第二資訊可以透過其他方式表徵“認可”的含義，本說明書並不對此進行限制。
在一實施例中，由於第一多媒體資料中透過第一資訊表徵了協議內容、透過第二資訊表徵了協議參與方對協議內容的認可態度，使得本說明書中的第一多媒體資料實際上已經實現了相關技術中的文本協議所需實現的功能，且協議參與方在本說明書的技術方案中無需具體形成文本內容，尤其是當涉及到多個協議參與方時，多個協議參與方不必須前往同一地點簽訂協議，從而在保證協議有效性的同時，極大地簡化了協議參與方的操作、提升了協議簽訂效率。
在一實施例中，如果存在多個協議參與方，可能存在多種情形：例如，多個協議參與方可以分別使用不同的電子設備，每一協議參與方可以分別透過自己使用的電子設備採集並上傳第一多媒體資料；再例如，多個協議參與方可以處於同一地點，這些協議參與方可以共用一台電子設備，比如輪流透過該電子設備採集並上傳第一多媒體資料，或者由電子設備同時對這些協議參與方進行第一多媒體資料的採集和上傳；當然，還可能存在其他情形，本說明書並不對此進行限制。
在一實施例中，區塊鏈節點可以調用智慧合約，所述智慧合約被用於驗證所述第一資訊所表徵的協議內容是否合法有效。例如，區塊鏈節點可以分析第一資訊所表徵的協議內容、將該協議內容提取為文本資訊，並將該文本資訊提供至智慧合約，使得智慧合約可以對第一資訊所表徵的協議內容進行分析，比如是否命中敏感詞、是否表達了非法語義等，本說明書並不對此進行限制。當協議內容被驗證為合法有效時，允許區塊鏈節點實施其他操作；當協議內容被驗證為非法或無效時，可以將上述的第一多媒體資料判定為無效協議，還可以對第一多媒體資料添加無效標記或阻止該第一多媒體資料生效。
步驟104，調用智慧合約，所述智慧合約被用於識別所述第一資訊表徵的協議內容中包含的特徵資訊，並向所述協議參與方輸出對所述特徵資訊的額外確認請求。
在一實施例中，所述特徵資訊可以包括：符合預定義的易口誤規則的資訊。比如某一詞匯存在發音相同或相近但表達的含義不同的情況時，可以判定為符合上述的易口誤規則；再比如對於一些關鍵的人名(如租房協議中的房東、租客)、地點名稱(如租房協議中的房間地址)、數字(如租金、日期)等，從而避免由於口音變化、聲調高低等方式造成誤解。
在一實施例中，可以預先定義符合上述易口誤規則的關鍵詞庫，並透過對第一資訊進行匹配識別，確定第一資訊中匹配的關鍵詞，以作為上述的特徵資訊。
在一實施例中，可以透過對第一資訊進行語義識別與分析，以確定出符合上述易口誤規則的資訊，比如上述的人名、地點名稱、數字等，以作為上述的特徵資訊。
步驟106，獲取所述協議參與方針對所述額外確認請求返回的視訊或音訊形式的第二多媒體資料，所述第二多媒體資料中包含對所述特徵資訊的額外確認資訊。
在一實施例中，當第二多媒體資料包含對特徵資訊的額外確認資訊時，相當於協議參與方對上述第一資訊中的特徵資訊予以再次確認，從而降低協議參與方由於口誤、口音、音調變化等原因而造成協議內容不清楚、不明確、存在漏洞等問題，以便於維護協議參與方的利益。
在一實施例中，所述第一多媒體資料與所述第二多媒體資料中可以分別採用不同語言對所述特徵資訊予以確認。例如，第一多媒體資訊中可以採用中文對包含特徵資訊在內的第一資訊進行表達，而第二多媒體資料中可以採用英文對特徵資訊進行確認。透過採用不同語音對相同的特徵資訊進行確認，可以降低協議參與方因口誤、口音、音調變化等原因而造成協議內容不清楚、不明確、存在漏洞等的概率，有助於維護協議參與方的利益。
在一實施例中，可以調用智慧合約，所述智慧合約被用於驗證所述第二資訊所表徵的所述協議參與方對所述協議內容的認可情況和/或所述額外確認資訊所表徵的所述協議參與方對所述特徵資訊的認可情況是否有效。例如，區塊鏈節點可以分析第二資訊和額外確認資訊所分別表徵的認可情況，並將該認可情況提供至智慧合約，使得智慧合約可以對第二資訊和額外確認所分別表徵的認可情況進行分析，比如是否含糊不清或存在歧義、是否存在脅迫狀況等，本說明書並不對此進行限制。當認可情況被驗證為有效時，允許區塊鏈節點實施其他操作；當認可情況被驗證為非法或無效時，可以將上述的第一多媒體資料、第二多媒體資料判定為無效協議，還可以對第一多媒體資料、第二多媒體資料添加無效標記或阻止該視訊資料生效。
在一實施例中，當存在多個協議參與方時，多個協議參與方可以對應於同一份第二多媒體資料，該第二多媒體資料包含的額外確認資訊用於表徵多個協議參與方對所述特徵資訊的認可情況。在另一實施例中，當存在多個協議參與方時，多個協議參與方分別對應於不同的第二多媒體資料，每一第二多媒體資料包含的額外確認資訊用於表徵相應的協議參與方對所述特徵資訊的認可情況。
步驟108，將所述第一多媒體資料和所述第二多媒體資料發佈至區塊鏈，以記錄為所述協議參與方簽訂的多媒體協議。
在一實施例中，透過將第一多媒體資料和第二多媒體資料發佈至區塊鏈中，可以確保該第一多媒體資料和第二多媒體資料無法被篡改或使得對第一多媒體資料和第二多媒體資料的篡改行為可檢驗，且可以透過查詢區塊鏈帳本而對該第一多媒體資料和第二多媒體資料進行追溯，具有極高的可靠性。
在一實施例中，可以分別產生第一多媒體資料和第二多媒體資料的數位摘要資訊，比如該數位摘要資訊可以為散列值。透過將第一多媒體資料和第二多媒體資料分別對應的數位摘要資訊發佈至區塊鏈中，或者進一步產生兩者的數位摘要資訊對應的數位摘要資訊並發佈至區塊鏈中，而將第一多媒體資料和第二多媒體資料儲存在本地而不上鏈，那麼基於第一多媒體資料、第二多媒體資料與數位摘要資訊之間的唯一匹配關係，可以確保第一多媒體資料和第二多媒體資料無法被篡改或使得對第一多媒體資料和第二多媒體資料的篡改行為可檢驗，同時可以避免對第一多媒體資料和第二多媒體資料的內容造成公開、有助於實現隱私保護。
在一實施例中，區塊鏈節點可以獲取第一多媒體資料和第二多媒體資料的簽訂屬性，比如該簽訂屬性可以包括以下至少之一：所述協議參與方的身分資訊、所述協議參與方的所處地點、協議簽訂時刻等，本說明書並不對此進行限制。然後，區塊鏈節點可以在將第一多媒體資料和第二多媒體資料發佈至區塊鏈時，還關聯發佈所述簽訂屬性，使得該第一多媒體資料和第二多媒體資料所表徵的協議事件具有更多維度的特徵資訊，有助於提升第一多媒體資料和第二多媒體資料的可信度。
在一實施例中，區塊鏈節點可以調用智慧合約，所述智慧合約被用於在多個協議參與方分別對應於不同的第一多媒體資料的情況下，驗證各個第一多媒體資料包含的第一資訊所表徵的協議內容是否一致。比如，區塊鏈節點可以分別提取各個第一多媒體資料中的第一資訊所表徵的協議內容，並傳遞至智慧合約中，以由智慧合約對各個第一多媒體資料分別對應的協議內容進行比較；如果協議內容均一致，允許區塊鏈節點實施其他操作，如果協議內容不完全一致，可以將本次產生的第一多媒體資料判定為無效協議，還可以對第一多媒體資料添加無效標記或阻止這些第一多媒體資料生效(避免基於這些第一多媒體資料形成多媒體協議)。
在一實施例中，區塊鏈節點可以調用智慧合約，所述智慧合約被用於根據所述視訊資料產生文字協議，並透過所述協議參與方的資料身分進行簽名；然後，在將所述第一多媒體資料和所述第二多媒體資料發佈至區塊鏈時，該區塊鏈節點還關聯發佈所述文字協議。
在一實施例中，本說明書中的協議可以包括單方協議，比如承諾書、遺囑、聲明等，本說明書並不對此進行限制。在一實施例中，本說明書中的協議可以包括多方協議或稱為合同，比如房屋租賃合同、商品買賣合同、勞動合同等，本說明書並不對此進行限制。
為了便於理解，下面以協議簽訂為例，對本說明書一個或多個實施例的技術方案進行說明。圖2是一示例性實施例提供的一種實施實人認證的示意圖。如圖2所示，假定用戶A使用手機21(或其他類型的電子設備，本說明書並不對此進行限制)，該手機21上可以透過運行某一應用程式X的APP客戶端或加載該應用程式X對應的網站，以向用戶A提供視訊協議的簽訂功能。在實施視訊協議的簽訂過程中，應用程式X可以對用戶A進行實人認證，以便於對用戶A的個人真實身分進行有效管理，並準確定義相關視訊協議的協議參與方(即用戶A)。
在一實施例中，手機21可以透過攝像頭模組對用戶A進行圖像採集，使得採集到的圖片或視訊中包含用戶A的人臉圖像、用戶A手持有效證件(如身分證)的圖像、用戶A按照指令執行相應動作的圖像等，以作為針對用戶A的身分資料，並由手機21將身分資料上傳至伺服器22，使得伺服器22可以基於人臉檢測、人臉識別、OCR證件識別、活體檢測等多種技術手段，對用戶A實施實人認證。
在實人認證完成後，用戶A可以基於已完成認證的身分資訊，簽訂相應的視訊協議。圖3是一示例性實施例提供的一種簽訂多媒體協議的示意圖。如圖3所示，手機21可以對用戶A進行多媒體資料採集，比如可以透過攝像頭進行視訊採集、透過麥克風進行音訊採集或者同時實施音視訊採集等，並確保採集得到的多媒體資料能夠至少表徵兩方面的內容：一方面，多媒體資料需要表徵所需簽訂的協議內容，另一方面，多媒體資料需要表徵用戶A認可該協議內容。
用戶A可以透過多種方式形成滿足上述要求的多媒體資料。例如，用戶A可以在面對手機21的鏡頭時，說出滿足上述要求的語音內容；再例如，用戶A可以在面對手機21的鏡頭時，還將印刷有滿足上述要求的內容的文本或顯示有滿足上述要求的內容的電子設備展示於鏡頭前；又例如，用戶A可以同時採用上述的多種形式。
比如，用戶A可以在面對手機21的鏡頭時，說出諸如“我承諾向XX組織捐贈100萬人民幣”的語音內容時，表徵的協議內容可以為“用戶A向XX組織捐贈100萬人民幣”，而“我承諾……”的句式表達了用戶A對上述協議內容的認可態度，因而可以認為滿足上述要求。再比如，用戶A可以在面對手機21的鏡頭時，可以將列印有“我承諾向XX組織捐贈100萬人民幣”的紙張呈現於鏡頭前，同樣滿足上述要求。又比如，用戶A可以在面對手機21的鏡頭時，可以將列印有“向XX組織捐贈100萬人民幣”的紙張呈現於鏡頭前，並說出諸如“我認可當前拍攝的協議內容”的語音內容，同樣滿足上述要求。
上述實施例涉及到用戶A簽訂單方的多媒體協議，即該多媒體協議的協議參與方僅包含用戶A，但該場景下並不意味著只有用戶A能夠出現在多媒體資料中。比如圖4所示，用戶A與用戶B均可以出現在手機21採集的多媒體資料中，並且伺服器22可以分別針對用戶A和用戶B進行實人認證；在實人認證通過後，用戶B可以協助用戶A完成多媒體採集，比如由用戶B口述協議內容，並由用戶A對用戶B口述的協議內容予以確認，譬如用戶B的口述內容可以為“由用戶A向XX組織捐贈100萬人民幣”，而用戶A可以透過諸如“我同意”等內容予以確認。
在一實施例中，伺服器22可以對手機21上傳的多媒體資料進行分析，以確定其包含的多媒體內容，比如上述的協議內容、用戶A對該協議內容的認可情況等。然後，伺服器22可以透過調用智慧合約，以基於該智慧合約中定義的檢驗規則對上述的多媒體內容進行檢驗；其中，檢驗規則可以包括以下至少之一：協議內容是否包含非法內容(比如可以匹配協議內容是否包含預設的敏感詞)、協議內容是否包含無效內容(比如透過語義分析協議內容是否清楚、準確)、協議參與方是否認可協議內容(比如協議參與方是否發出表達“認可”的語音或做出表達“認可”的動作等)、協議參與方表達“認可”的狀態是否正常(比如協議參與方的語調或表情是否正常、是否存在受人脅迫的情形等)等，本說明書並不對此進行限制。
圖5是一示例性實施例提供的一種防口誤處理的示意圖。如圖5所示，針對用戶A簽訂的單方多媒體協議，伺服器22在收到手機21上傳的多媒體資料後，可以提取該多媒體資料包含的協議內容；然後，伺服器22可以調用智慧合約，將提取的協議內容提供至該智慧合約，以由該智慧合約檢驗該協議內容中是否包含易口誤內容。
在一實施例中，智慧合約中預先定義有易口誤內容的識別邏輯，比如將協議內容與預定義的易口誤關鍵詞進行匹配，再比如將協議內容中識別出的人名、地址資訊、數字等特定類型的資訊作為易口誤內容，又比如將協議內容中由於協議參與方的口音、音調變化等而造成含義不清的內容作為易口誤內容等，本說明書並不對此進行限制。
針對識別出的易口誤內容，智慧合約可以指示伺服器22向手機21返回相應的易口誤內容確認提示。相應地，手機21可以引導用戶對易口誤內容進行重複確認，以採集到相應的多媒體確認資料。例如，假定協議內容為“我承諾從用戶A處租用XX小區2號樓302室，租金為每月3000元”、易口誤內容為中文表達的“3000元”(比如由口音、音調變化等，可能被誤解為“4000元”)，可以引導用戶A用諸如英文(或其他語言)表達為“Three thousand yuan”，從而透過兩種不同語言對租金數額進行確認，極大地降低了租金數額可能存在的爭議。
相應地，手機21可以將採集到的多媒體確認資料上傳至伺服器22，由伺服器22調用智慧合約對該多媒體確認資料所包含的資料內容進行檢驗。例如，智慧合約可以對多媒體確認資料包含的資料內容進行合法性檢測(比如是否包含敏感詞等)；再例如，智慧合約可以將多媒體確認資料包含的資料內容與上述多媒體資料包含的協議內容進行比較，以確定兩者是否一致。
在確認無誤後，伺服器22可以向區塊鏈中發佈相應的多媒體協議。例如，伺服器22可以向區塊鏈中發佈一筆交易，該交易中包含圖3-4中由手機21上傳的多媒體資料、圖6中由手機21上傳的多媒體確認資料，該多媒體資料和多媒體確認資料經由用於表徵用戶A的數位身分的密鑰進行簽名，以表明該多媒體資料和多媒體確認資料為用戶A參與的多媒體協議，而該交易的內容可以被記錄至區塊鏈帳本中，從而實現了對該多媒體協議的存證。當然，伺服器22可以僅在本地儲存上述的多媒體資料和多媒體確認資料，而向區塊鏈中發佈的交易中僅包含該多媒體資料和多媒體確認資料的散列值，一方面可以避免多媒體協議的內容被公開、有助於提升資料私密性，另一方面可以根據區塊鏈帳本中記錄的散列值對伺服器22在本地儲存的多媒體資料和多媒體確認資料進行驗證，以避免該多媒體資料和多媒體確認資料被篡改。
上述實施例中，多媒體協議僅存在單個協議參與方，即該多媒體協議為單方多媒體協議；而在其他實施例中，多媒體協議還可以為多方多媒體協議，即存在多個協議參與方，下面針對多方多媒體協議的場景進行描述。
假定用戶A與用戶B均為協議參與方，即由用戶A與用戶B共同參與簽訂一項多媒體協議。如圖4所示，用戶A與用戶B可以位於同一處，並共同使用手機21完成實人認證、多媒體資料的採集等操作。在實人認證過程中，手機21可以透過攝像頭模組同時採集到包含用戶A和用戶B的圖像，並據此針對用戶A和用戶B實施實人認證，其過程與圖2所示的實施例類似，此處不再贅述。或者，用戶A和用戶B可以對手機21進行分時複用，比如首先由用戶A使用手機21完成實人認證，然後換由用戶B使用手機21完成實人認證，對於每個用戶的實人認證過程分別與圖2所示的實施例類似，此處不再贅述。
然後，可以透過手機21對用戶A、用戶B進行多媒體採集，以獲得相應的多媒體資料。在一實施例中，手機21可以產生一份多媒體資料，該多媒體資料中包含：表徵所需簽訂的協議內容的多媒體內容、表徵用戶A和用戶B認可該協議內容的多媒體內容；比如，用戶A可以(面對手機21的鏡頭)說出“我承諾將XX小區2號樓302室出租給用戶B，租金為每月3000元”，而用戶B可以(面對手機21的鏡頭)說出“我承諾從用戶A處租用XX小區2號樓302室，租金為每月3000元”，那麼協議內容為“用戶A向用戶B出租XX小區2號樓302室，租金為每月3000元”，且用戶A、用戶B關於“我承諾……”的句式表達了對上述協議內容的認可態度；再比如，用戶A或用戶B可以將列印有“用戶A向用戶B出租XX小區2號樓302室，租金為每月3000元”的紙張呈現於鏡頭前，而用戶A、用戶B可以分別說出諸如“我認可當前拍攝的協議內容”的語音內容。當然，多媒體內容的表達形式並不受限，只要能夠表徵上述兩方面的含義即可。
需要指出的是：當手機21僅產生一份多媒體資料時，用戶A與用戶B可以同時完成多媒體資料的採集，也可以分別、依次完成採集，本說明書並不對此進行限制。
在另一實施例中，手機21可以針對用戶A和用戶B分別產生一份多媒體資料，對應於用戶A的多媒體資料中包含：表徵所需簽訂的協議內容的多媒體內容、表徵用戶A認可該協議內容的多媒體內容，對應於用戶B的多媒體資料中包含：表徵所需簽訂的協議內容的多媒體內容、表徵用戶B認可該協議內容的多媒體內容。對於每份多媒體資料，產生方式與圖3或圖4所示的實施例相類似，此處不再贅述。
當用戶A與用戶B參與的多方多媒體協議僅產生一份多媒體資料時，伺服器22可以透過類似於圖5所示的實施例，向手機21返回易口誤內容確認提示，使得手機21引導用戶A和用戶B對協議內容中的易口誤內容進行重複確認。然後，由伺服器22獲得手機21上傳的多媒體確認資料，並調用智慧合約對該多媒體確認資料中包含的資料內容進行檢驗，以及將手機21分別上傳的多媒體資料和多媒體確認資料發佈至區塊鏈、記錄為相應的多媒體協議。此處可以參考圖5所示的實施例，只是對易口誤內容的確認操作需要由用戶A和用戶B完成，此處不再贅述。
除了共用手機21之外，用戶A與用戶B還可以分別使用不同的電子設備，比如圖6所示，用戶A可以使用手機21、用戶B可以使用手機23，尤其是當用戶A與用戶B分別處於不同地理位置時，仍然可以遠程簽訂多媒體協議，而無需前往同一地點進行協議簽訂。
在一實施例中，可由任一協議參與方透過手機21向伺服器22請求多媒體協議的簽訂功能，比如該任一協議參與方為用戶A時，該用戶A可以指定用戶B為相關聯的協議參與方，使得用戶A使用的手機21(登錄有用戶A的帳號)與用戶B使用的手機23(登錄有用戶B的帳號)之間可以實現協同，從而共同參與到同一多媒體協議的簽訂過程中。
手機21可以針對用戶A實施實人認證，並採集用戶A相關的多媒體資料，這與圖3-4所示實施例的情況類似，此處不再贅述；手機23可以針對用戶B實施實人認證，並採集用戶B相關的多媒體資料，這與手機21的實施過程類似，此處不再贅述。
當手機21或手機23將多媒體資料上傳至伺服器22後，與圖3所示實施例相類似的，可由伺服器22對多媒體資料進行分析，然後透過調用智慧合約對分析結果進行檢驗，比如可以針對下述方面中至少之一進行檢驗：協議內容是否包含非法內容、協議內容是否包含無效內容、協議參與方是否認可協議內容、協議參與方表達“認可”的狀態是否正常等，此處不再贅述。
圖7是一示例性實施例提供的另一種防口誤處理的示意圖。如圖7所示，伺服器22可以透過調用智慧合約，以分別針對手機21上傳的多媒體資料1包含的協議內容、手機23上傳的多媒體資料2包含的協議內容進行檢測，確定協議內容中包含的易口誤內容，並分別向手機21、手機23發送易口誤內容確認提示1、易口誤內容確認提示2，使得手機21、手機23分別引導用戶A、用戶B對協議內容中的易口誤內容進行重複確認。然後，由伺服器22分別獲得手機21、手機23上傳的多媒體確認資料1、多媒體確認資料2，並調用智慧合約分別對該多媒體確認資料1、多媒體確認資料2中包含的資料內容進行檢驗。針對用戶A、用戶B實施的防口誤處理，均可以參考圖5所示的實施例，此處不再贅述。
在一實施例中，由於用戶A與用戶B有可能處於不同的地理位置處，使得兩者可能並不能夠直接獲知對方的多媒體採集情況，因而伺服器22在獲得一方的多媒體資料或多媒體確認資料後，可以將其傳遞至另一方進行查看。例如，每一協議參與方使用的電子設備上，可以展示出分別對應於各個協議參與方的視訊視窗，以分別用於展示各個協議參與方使用的電子設備拍攝的視訊畫面；譬如，手機21、手機23上可以分別展示出兩個視訊視窗，以分別展示手機21和手機23拍攝的視訊畫面，使得用戶A、用戶B既可以查看到自身的視訊拍攝情況，也可以查看到對方的視訊拍攝情況。尤其是，透過對多媒體資料和多媒體確認資料的相互傳遞，使得每一協議參與方可以獲知各個協議參與方的多媒體資料和多媒體確認資料，從而對多媒體資料所含的協議內容、多媒體確認資料所含的資料內容進行查看，便於發現伺服器22可能不易察覺的文字陷阱、歧義、口誤等情形；並且，每一協議參與方均可以具備終止簽訂的權限，使得任一協議參與方對其他協議參與方的多媒體資料或多媒體確認資料存在異議、且其他協議參與方拒絕修改時，均可以終止協議簽訂，以保障協議參與方的權益。
然後，伺服器22可以將手機21分別上傳的多媒體資料1和多媒體確認資料1、手機23分別上傳的多媒體資料2和多媒體確認資料2發佈至區塊鏈，從而記錄為用戶A與用戶B之間簽訂的多媒體協議。或者，可以將多媒體資料1、多媒體確認資料1、多媒體資料2和多媒體確認資料2分別對應的四個散列值(或者由四個散列值再次計算得到的一個散列值)發佈至區塊鏈，而將多媒體資料1、多媒體確認資料1、多媒體資料2和多媒體確認資料2儲存於伺服器22處並避免上鏈，有助於實現隱私保護。
需要指出的是：雖然在上述實施例中，涉及到多方協議時以用戶A與用戶B之間的協議簽訂場景進行舉例，但本說明書的技術方案同樣可以應用於更多數量的協議參與方之間，以實現三方或更多方的協議簽訂，本說明書並不對此進行限制。
圖8是一示例性實施例提供的一種設備的示意結構圖。請參考圖8，在硬體層面，該設備包括處理器802、內部匯流排804、網路介面806、內部記憶體808以及非易失性記憶體810，當然還可能包括其他業務所需要的硬體。處理器802從非易失性記憶體810中讀取對應的電腦程式到內部記憶體808中然後運行，在邏輯層面上形成多媒體協議的內容確認裝置。當然，除了軟體實現方式之外，本說明書一個或多個實施例並不排除其他實現方式，比如邏輯裝置抑或軟硬體結合的方式等等，也就是說以下處理流程的執行主體並不限定於各個邏輯單元，也可以是硬體或邏輯裝置。
請參考圖9，在軟體實施方式中，該多媒體協議的內容確認裝置應用於區塊鏈節點，可以包括：
第一獲取單元91，獲取協議參與方提供的視訊或音訊形式的第一多媒體資料，所述第一多媒體資料中包含用於表徵協議內容的第一資訊和用於表徵所述協議參與方認可所述協議內容的第二資訊；
第一調用單元92，調用智慧合約，所述智慧合約被用於識別所述第一資訊表徵的協議內容中包含的特徵資訊，並向所述協議參與方輸出對所述特徵資訊的額外確認請求；
第二獲取單元93，獲取所述協議參與方針對所述額外確認請求返回的視訊或音訊形式的第二多媒體資料，所述第二多媒體資料中包含對所述特徵資訊的額外確認資訊；
發佈單元94，將所述第一多媒體資料和所述第二多媒體資料發佈至區塊鏈，以記錄為所述協議參與方簽訂的多媒體協議。
可選的，所述特徵資訊包括：符合預定義的易口誤規則的資訊。
可選的，所述第一多媒體資料與所述第二多媒體資料中分別採用不同語言對所述特徵資訊予以確認。
可選的，還包括：
第二調用單元95，調用智慧合約，所述智慧合約被用於驗證所述第一資訊所表徵的協議內容是否合法有效。
可選的，還包括：
第三調用單元96，調用智慧合約，所述智慧合約被用於驗證所述第二資訊所表徵的所述協議參與方對所述協議內容的認可情況和/或所述額外確認資訊所表徵的所述協議參與方對所述特徵資訊的認可情況是否有效。
可選的，所述多媒體協議為單方協議，存在一個協議參與方；或者，所述多媒體協議為多方協議，存在多個協議參與方。
可選的，
當存在多個協議參與方時，多個協議參與方對應於相同的第一多媒體資料、第二多媒體資料，該第一多媒體資料包含的第二資訊用於表徵多個協議參與方對所述協議內容的認可情況，所述第二多媒體資料包含的額外確認資訊用於表徵多個協議參與方對所述特徵資訊的認可情況；
或者，當存在多個協議參與方時，多個協議參與方分別對應於不同的第一多媒體資料、第二多媒體資料，每個第一多媒體資料包含的第二資訊用於表徵相應的協議參與方對所述協議內容的認可情況，每個第二多媒體資料包含的額外確認資訊用於表徵相應的協議參與方對所述特徵資訊的認可情況。
可選的，還包括：
第四調用單元97，調用智慧合約，所述智慧合約被用於在多個協議參與方分別對應於不同的第一多媒體資料的情況下，驗證各個第一多媒體資料包含的第一資訊所表徵的協議內容是否一致。
可選的，還包括：
第五調用單元98，調用智慧合約，所述智慧合約被用於根據所述視訊資料產生文字協議，並透過所述協議參與方的資料身分進行簽名；
所述發佈單元94在將所述第一多媒體資料和所述第二多媒體資料發佈至區塊鏈時，還關聯發佈所述文字協議。
上述實施例闡明的系統、裝置、模組或單元，具體可以由電腦晶片或實體實現，或者由具有某種功能的產品來實現。一種典型的實現設備為電腦，電腦的具體形式可以是個人電腦、膝上型電腦、行動電話、相機電話、智慧電話、個人數位助理、媒體播放器、導航設備、電子郵件收發設備、遊戲控制台、平板電腦、可穿戴設備或者這些設備中的任意幾種設備的組合。
本說明書提出了一種電腦可讀媒體，其上儲存有電腦指令，該指令被處理器執行時實現本說明書的技術方案，比如上述任一實施例的多媒體協議的內容確認方法，此處不再一一贅述。
在一個典型的配置中，電腦包括一個或多個處理器(CPU)、輸入/輸出介面、網路介面和內部記憶體。
內部記憶體可能包括電腦可讀媒體中的非永久性記憶體，隨機存取記憶體(RAM)和/或非易失性內部記憶體等形式，如唯讀記憶體(ROM)或快閃記憶體(flash RAM)。內部記憶體是電腦可讀媒體的示例。
電腦可讀媒體包括永久性和非永久性、可移動和非可移動媒體可以由任何方法或技術來實現資訊儲存。資訊可以是電腦可讀指令、資料結構、程式的模組或其他資料。電腦的儲存媒體的例子包括，但不限於相變內部記憶體(PRAM)、靜態隨機存取記憶體(SRAM)、動態隨機存取記憶體(DRAM)、其他類型的隨機存取記憶體(RAM)、唯讀記憶體(ROM)、電可擦除可程式化唯讀記憶體(EEPROM)、快閃記憶體或其他內部記憶體技術、唯讀光碟唯讀記憶體(CD-ROM)、數位多功能光碟(DVD)或其他光學儲存、磁盒式磁帶、磁碟儲存、量子記憶體、基於石墨烯的儲存媒體或其他磁性儲存設備或任何其他非傳輸媒體，可用於儲存可以被計算設備訪問的資訊。按照本文中的界定，電腦可讀媒體不包括暫存電腦可讀媒體(transitory media)，如調變的資料信號和載波。
還需要說明的是，術語“包括”、“包含”或者其任何其他變體意在涵蓋非排他性的包含，從而使得包括一系列要素的過程、方法、商品或者設備不僅包括那些要素，而且還包括沒有明確列出的其他要素，或者是還包括為這種過程、方法、商品或者設備所固有的要素。在沒有更多限制的情況下，由語句“包括一個……”限定的要素，並不排除在包括所述要素的過程、方法、商品或者設備中還存在另外的相同要素。
上述對本說明書特定實施例進行了描述。其它實施例在申請專利範圍的範圍內。在一些情況下，在申請專利範圍中記載的動作或步驟可以按照不同於實施例中的順序來執行並且仍然可以實現期望的結果。另外，在圖式中描繪的過程不一定要求示出的特定順序或者連續順序才能實現期望的結果。在某些實施方式中，多任務處理和並行處理也是可以的或者可能是有利的。
在本說明書一個或多個實施例使用的術語是僅僅出於描述特定實施例的目的，而非旨在限制本說明書一個或多個實施例。在本說明書一個或多個實施例和申請專利範圍中所使用的單數形式的“一種”、“所述”和“該”也旨在包括多數形式，除非上下文清楚地表示其他含義。還應當理解，本文中使用的術語“和/或”是指並包含一個或多個相關聯的列出項目的任何或所有可能組合。
應當理解，儘管在本說明書一個或多個實施例可能採用術語第一、第二、第三等來描述各種資訊，但這些資訊不應限於這些術語。這些術語僅用來將同一類型的資訊彼此區分開。例如，在不脫離本說明書一個或多個實施例範圍的情況下，第一資訊也可以被稱為第二資訊，類似地，第二資訊也可以被稱為第一資訊。取決於語境，如在此所使用的詞語“如果”可以被解釋成為“在……時”或“當……時”或“回應於確定”。
以上所述僅為本說明書一個或多個實施例的較佳實施例而已，並不用以限制本說明書一個或多個實施例，凡在本說明書一個或多個實施例的精神和原則之內，所做的任何修改、等同替換、改進等，均應包含在本說明書一個或多個實施例保護的範圍之內。The exemplary embodiments will be described in detail here, and examples thereof are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with one or more embodiments of this specification. On the contrary, they are only examples of devices and methods consistent with some aspects of one or more embodiments of this specification as detailed in the scope of the appended application.
It should be noted that in other embodiments, the steps of the corresponding method are not necessarily executed in the order shown and described in this specification. In some other embodiments, the method may include more or fewer steps than described in this specification. In addition, a single step described in this specification may be decomposed into multiple steps for description in other embodiments; and multiple steps described in this specification may also be combined into a single step in other embodiments. description.
Fig. 1 is a flowchart of a method for confirming content of a multimedia protocol according to an exemplary embodiment. As shown in Figure 1, the method is applied to blockchain nodes and can include the following steps:
Step 102: Obtain first multimedia data in the form of video or audio provided by the protocol participants, the first multimedia data including first information used to characterize the content of the protocol and the endorsement of the protocol participants The second information of the content of the agreement.
In one embodiment, by installing and running a blockchain client on an electronic device, the electronic device can be configured as a blockchain node in the blockchain network. For example, the electronic device can include a server, a PC , Tablets, mobile phones and other types; in other words, blockchain nodes can be carried on any form of electronic equipment, and this manual does not limit this.
In one embodiment, the content of the first information may be a video clip or an audio clip in which the agreement participant reads the content of the agreement; or, the content of the first information may be a text printed with the agreement content held by the agreement participant or displayed Video clips of the electronic equipment of the agreement content; or, First Info can characterize the agreement content in other ways, and this manual does not limit this.
In one embodiment, the content of the second information can be a sentence similar to "I agree", "I confirm", "I agree" or similar for the parties to the agreement; or, the content of the second information can be the agreement participation The party makes actions that characterize "approval", such as nodding, sticking out thumbs, smiling, etc.; or, the second information may use other means to indicate the meaning of "approval", which is not limited in this manual.
In one embodiment, because the first multimedia data represents the content of the agreement through the first information and the second information represents the attitude of the agreement participants to the agreement content, the first multimedia data in this specification In fact, the functions required by the text protocol in the related technology have been implemented, and the protocol participants do not need to form specific text content in the technical solutions of this specification, especially when multiple protocol participants are involved, multiple protocol participants The parties do not have to go to the same place to sign the agreement, so that while ensuring the validity of the agreement, it greatly simplifies the operation of the parties to the agreement and improves the efficiency of signing the agreement.
In one embodiment, if there are multiple protocol participants, there may be multiple situations: for example, multiple protocol participants can use different electronic devices, and each protocol participant can use their own electronic devices to collect and upload data. The first multimedia data; for another example, multiple protocol participants can be in the same place, and these protocol participants can share an electronic device, such as taking turns to collect and upload the first multimedia data through the electronic device, or by electronic The device collects and uploads the first multimedia data to these protocol participants at the same time; of course, there may be other situations, which are not restricted in this manual.
In an embodiment, the blockchain node may call a smart contract, and the smart contract is used to verify whether the content of the agreement represented by the first information is legal and valid. For example, the blockchain node can analyze the agreement content represented by the first information, extract the agreement content as text information, and provide the text information to the smart contract, so that the smart contract can perform the agreement content represented by the first information Analysis, such as whether it hits a sensitive word, whether it expresses illegal semantics, etc. This manual does not limit this. When the protocol content is verified as legal and valid, the blockchain node is allowed to perform other operations; when the protocol content is verified as illegal or invalid, the above-mentioned first multimedia data can be determined as an invalid protocol, and the first multimedia data can be Add an invalid mark to the multimedia data or prevent the first multimedia data from taking effect.
Step 104: Invoking a smart contract, the smart contract being used to identify the feature information included in the agreement content represented by the first information, and output an additional confirmation request for the feature information to the protocol participant.
In an embodiment, the characteristic information may include: information that complies with a predefined slippage rule. For example, when a vocabulary has the same or similar pronunciation but different meanings, it can be judged to comply with the above-mentioned lip-synch rules; another example is for some key names (such as the landlord and tenant in the rental agreement) and place names ( Such as the room address in the rental agreement), numbers (such as rent, date), etc., so as to avoid misunderstandings caused by accent changes, pitch height, etc.
In one embodiment, it is possible to predefine a keyword library that meets the above-mentioned lip-synching rules, and by matching and recognizing the first information, the matching keywords in the first information are determined as the above-mentioned characteristic information.
In one embodiment, semantic recognition and analysis of the first information can be used to determine information that meets the aforementioned lip-synch rules, such as the aforementioned person's name, place name, number, etc., as the aforementioned characteristic information.
Step 106: Obtain second multimedia data in the form of video or audio returned by the protocol participant in response to the additional confirmation request, where the second multimedia data includes additional confirmation information for the feature information.
In one embodiment, when the second multimedia data contains additional confirmation information for the characteristic information, it is equivalent to the agreement participant re-confirming the characteristic information in the first information, thereby reducing the verbal errors and accents of the agreement participants. The content of the agreement is unclear, unclear, and there are loopholes due to reasons such as changes in pitch, so as to protect the interests of the parties to the agreement.
In one embodiment, the first multimedia data and the second multimedia data may be used in different languages to confirm the feature information. For example, Chinese can be used to express the first information including feature information in the first multimedia information, and English can be used to confirm the feature information in the second multimedia information. By using different voices to confirm the same feature information, it can reduce the probability that the protocol participants are unclear, unclear, and have loopholes due to verbal errors, accents, changes in pitch, etc., and help maintain the agreement participants’ interest.
In one embodiment, a smart contract can be invoked, and the smart contract is used to verify the agreement participants’ recognition of the agreement content represented by the second information and/or the additional confirmation information. Whether the agreement participants’ recognition of the feature information is valid. For example, the blockchain node can analyze the approval status represented by the second information and the additional confirmation information, and provide the approval status to the smart contract, so that the smart contract can perform the approval status represented by the second information and the additional confirmation information. Analysis, such as whether there is ambiguity or ambiguity, whether there is a coercion situation, etc., this manual does not limit this. When the recognition is verified as valid, the blockchain node is allowed to perform other operations; when the recognition is verified as illegal or invalid, the above-mentioned first multimedia data and second multimedia data can be judged as invalid protocols , You can also add invalid marks to the first multimedia data and the second multimedia data or prevent the video data from taking effect.
In one embodiment, when there are multiple protocol participants, the multiple protocol participants may correspond to the same second multimedia data, and the additional confirmation information contained in the second multimedia data is used to characterize the multiple protocols Participants' recognition of the feature information. In another embodiment, when there are multiple protocol participants, the multiple protocol participants respectively correspond to different second multimedia data, and the additional confirmation information contained in each second multimedia data is used to characterize the corresponding Of the agreement participants’ recognition of the feature information.
Step 108: Publish the first multimedia data and the second multimedia data to the blockchain to record the multimedia agreement signed by the agreement participants.
In one embodiment, by publishing the first multimedia data and the second multimedia data to the blockchain, it can be ensured that the first multimedia data and the second multimedia data cannot be tampered with or caused to The tampering behavior of the first multimedia data and the second multimedia data can be verified, and the first multimedia data and the second multimedia data can be traced by querying the blockchain ledger. The reliability.
In one embodiment, the digital summary information of the first multimedia data and the second multimedia data may be generated separately, for example, the digital summary information may be a hash value. By publishing the digital summary information corresponding to the first multimedia data and the second multimedia data to the blockchain, or further generating and publishing the digital summary information corresponding to the digital summary information of the two to the blockchain, And if the first multimedia data and the second multimedia data are stored locally and not on the chain, then based on the unique matching relationship between the first multimedia data, the second multimedia data and the digital summary information, Ensure that the first multimedia data and the second multimedia data cannot be tampered with or make the tampering behaviors on the first multimedia data and the second multimedia data verifiable, and at the same time avoid the first multimedia data and the second multimedia data. The content of the second multimedia material is made public and helps to realize privacy protection.
In an embodiment, the blockchain node can obtain the signing attributes of the first multimedia data and the second multimedia data. For example, the signing attributes can include at least one of the following: the identity information of the parties to the agreement, The location of the parties to the agreement, the time when the agreement is signed, etc., are not restricted by this manual. Then, when the blockchain node publishes the first multimedia data and the second multimedia data to the blockchain, it also publishes the signing attributes in association, so that the first multimedia data and the second multimedia data The protocol event represented by the body data has more dimensional characteristic information, which helps to improve the credibility of the first multimedia data and the second multimedia data.
In one embodiment, the blockchain node can call a smart contract, which is used to verify each first multimedia data when multiple protocol participants correspond to different first multimedia data. Whether the content of the agreement represented by the first information contained in the data is consistent. For example, the blockchain node can extract the protocol content represented by the first information in each first multimedia data, and transfer it to the smart contract, so that the smart contract can correspond to each first multimedia data. Compare the contents; if the contents of the agreement are the same, the blockchain node is allowed to perform other operations. If the contents of the agreement are not completely the same, the first multimedia data generated this time can be judged as an invalid agreement, and the first multimedia Add an invalid mark to the body data or prevent the first multimedia data from taking effect (avoid forming a multimedia protocol based on the first multimedia data).
In one embodiment, a blockchain node can call a smart contract, which is used to generate a text agreement based on the video data, and sign through the data identities of the parties to the agreement; When the first multimedia data and the second multimedia data are published to the blockchain, the blockchain node also publishes the text protocol in association.
In an embodiment, the agreement in this specification may include a unilateral agreement, such as a letter of commitment, will, declaration, etc., which is not limited in this specification. In an embodiment, the agreement in this specification may include a multi-party agreement or called a contract, such as a house lease contract, a commodity sales contract, a labor contract, etc. The specification does not limit this.
To facilitate understanding, the following takes the signing of an agreement as an example to describe the technical solutions of one or more embodiments of this specification. Fig. 2 is a schematic diagram of implementing real person authentication provided by an exemplary embodiment. As shown in Figure 2, suppose that user A uses a mobile phone 21 (or other types of electronic equipment, this manual does not limit this), the mobile phone 21 can run an APP client of an application X or load the application X corresponds to the website to provide user A with the function of signing a video agreement. In the implementation of the video-conferencing agreement signing process, the application X can authenticate the user A as a real person, so as to effectively manage the real personal identity of the user A, and accurately define the contract participants (ie, user A) of the related video-conferencing agreement.
In one embodiment, the mobile phone 21 can collect images of user A through the camera module, so that the collected pictures or videos include the face image of user A, and the image of user A holding a valid certificate (such as an ID card). The image and the image of user A performing corresponding actions in accordance with instructions are used as the identity data for user A, and the mobile phone 21 uploads the identity data to the server 22, so that the server 22 can be based on face detection, face recognition, A variety of technical methods such as OCR certificate recognition and living body detection implement real person authentication for user A.
After the real person authentication is completed, user A can sign the corresponding video agreement based on the identity information that has been authenticated. Fig. 3 is a schematic diagram of signing a multimedia agreement provided by an exemplary embodiment. As shown in Figure 3, the mobile phone 21 can collect multimedia data for user A, such as video collection through a camera, audio collection through a microphone, or simultaneous audio and video collection, etc., and ensure that the collected multimedia data can represent at least two aspects The content of: On the one hand, the multimedia material needs to characterize the content of the agreement to be signed, on the other hand, the multimedia material needs to characterize the content of the agreement that user A approves.
User A can use multiple methods to form multimedia data that meets the above requirements. For example, user A can speak the voice content that meets the above requirements when facing the camera of the mobile phone 21; for another example, user A can also print text or content that meets the above requirements when facing the camera of the mobile phone 21. An electronic device displaying content that meets the foregoing requirements is displayed in front of the lens; for another example, user A can simultaneously adopt the foregoing multiple forms.
For example, when user A is facing the camera lens of mobile phone 21, when he says voice content such as "I promise to donate 1 million RMB to XX organization", the characterization agreement content can be "User A donates 1 million RMB to XX organization" , And the sentence "I promise..." expresses user A's attitude towards the content of the above agreement, so it can be considered that the above requirements are met. For another example, when facing the camera of the mobile phone 21, user A can present a paper printed with "I promise to donate 1 million yuan to XX organization" in front of the camera, which also meets the above requirements. For another example, when facing the camera of the mobile phone 21, user A can present a paper printed with "Donated 1 million RMB to the XX organization" in front of the camera, and say something like "I approve the content of the current shooting agreement" The voice content also meets the above requirements.
The foregoing embodiment involves the signing of a unilateral multimedia agreement by user A, that is, the agreement participants of the multimedia agreement only include user A, but this scenario does not mean that only user A can appear in the multimedia data. For example, as shown in Figure 4, both user A and user B can appear in the multimedia data collected by the mobile phone 21, and the server 22 can perform real person authentication for user A and user B respectively; after the real person authentication is passed, user B can Assist user A in completing multimedia collection, for example, user B dictates the content of the agreement, and user A confirms the content of the agreement dictated by user B. For example, the dictation content of user B can be "a donation of 1 million yuan from user A to XX organization", And user A can confirm through content such as "I agree".
In an embodiment, the server 22 may analyze the multimedia data uploaded by the mobile phone 21 to determine the multimedia content contained therein, such as the above-mentioned agreement content, the user A's approval of the agreement content, and so on. Then, the server 22 can inspect the multimedia content based on the inspection rules defined in the smart contract by invoking the smart contract; the inspection rules may include at least one of the following: whether the protocol content contains illegal content (for example, it can match Whether the content of the agreement contains preset sensitive words), whether the content of the agreement contains invalid content (such as whether the content of the agreement is clear and accurate through semantic analysis), whether the parties to the agreement recognize the content of the agreement (such as whether the parties to the agreement issue a voice that expresses "approval" Or make an action to express "approval", etc.), whether the state of the agreement participants expressing "approval" is normal (such as whether the tone or expression of the agreement participants is normal, whether there is a situation of being coerced, etc.), etc., this manual is not correct This is limited.
Fig. 5 is a schematic diagram of an anti-spoken treatment provided by an exemplary embodiment. As shown in Figure 5, for the unilateral multimedia agreement signed by user A, after receiving the multimedia data uploaded by the mobile phone 21, the server 22 can extract the content of the agreement contained in the multimedia data; then, the server 22 can call the smart contract, The extracted content of the agreement is provided to the smart contract, so that the smart contract can check whether the content of the agreement contains erroneous content.
In one embodiment, the smart contract pre-defines the identification logic of the slip-on content, such as matching the content of the agreement with predefined slip-on keywords, and for example, the name, address information, numbers, etc. identified in the agreement content Specific types of information are regarded as verbal content, and for example, the content of the agreement content that is unclear due to the accent and tone changes of the parties to the agreement is regarded as verbal content. This manual does not limit this.
Regarding the identified erroneous content, the smart contract may instruct the server 22 to return a corresponding erroneous content confirmation prompt to the mobile phone 21. Correspondingly, the mobile phone 21 can guide the user to repeat the confirmation of the erroneous content so as to collect the corresponding multimedia confirmation data. For example, suppose the content of the agreement is "I promise to rent Room 302, Building 2 of XX Community from User A, the rent is 3000 yuan per month", and the content of the verbal error is "3000 yuan" in Chinese (such as accent, pitch change, etc., It may be misunderstood as "4000 yuan"), it can guide user A to express "Three thousand yuan" in English (or other languages), so that the rent amount can be confirmed in two different languages, which greatly reduces the rent amount. Dispute.
Correspondingly, the mobile phone 21 can upload the collected multimedia confirmation data to the server 22, and the server 22 can call a smart contract to verify the data content contained in the multimedia confirmation data. For example, a smart contract can check the validity of the data content contained in the multimedia confirmation data (such as whether it contains sensitive words, etc.); for another example, the smart contract can compare the data content contained in the multimedia confirmation data with the agreement content contained in the aforementioned multimedia data To determine whether the two are consistent.
After the confirmation is correct, the server 22 can publish the corresponding multimedia protocol to the blockchain. For example, the server 22 can publish a transaction to the blockchain, which includes the multimedia data uploaded by the mobile phone 21 in Figure 3-4, the multimedia confirmation data uploaded by the mobile phone 21 in Figure 6, the multimedia data and the multimedia confirmation The data is signed by the key used to characterize the digital identity of user A to indicate that the multimedia data and the multimedia confirmation data are the multimedia protocol in which user A participates, and the content of the transaction can be recorded in the blockchain ledger, thereby Realize the deposit of the multimedia protocol. Of course, the server 22 can only store the aforementioned multimedia data and multimedia confirmation data locally, and the transaction issued to the blockchain only contains the hash value of the multimedia data and multimedia confirmation data. On the one hand, it can avoid the multimedia protocol The content is disclosed, which helps to improve the privacy of the data. On the other hand, the multimedia data and multimedia confirmation data stored locally by the server 22 can be verified according to the hash value recorded in the blockchain ledger to avoid the multimedia data. And multimedia confirmation data has been tampered with.
In the foregoing embodiment, the multimedia protocol has only a single protocol participant, that is, the multimedia protocol is a single-party multimedia protocol; and in other embodiments, the multimedia protocol may also be a multi-party multimedia protocol, that is, there are multiple protocol participants. The scene of the multimedia protocol is described.
It is assumed that both user A and user B are parties to the agreement, that is, user A and user B jointly sign a multimedia agreement. As shown in Fig. 4, user A and user B can be located at the same place, and use the mobile phone 21 together to complete operations such as real person authentication and multimedia data collection. In the real person authentication process, the mobile phone 21 can simultaneously collect images containing user A and user B through the camera module, and implement real person authentication for user A and user B accordingly. The process is the same as the implementation shown in Figure 2. The example is similar, so I won't repeat it here. Alternatively, user A and user B can time-division and multiplex the mobile phone 21. For example, user A first uses the mobile phone 21 to complete the real person authentication, and then user B uses the mobile phone 21 to complete the real person authentication. For each user’s real person The authentication process is similar to the embodiment shown in FIG. 2, and will not be repeated here.
Then, the user A and user B can be used for multimedia collection through the mobile phone 21 to obtain corresponding multimedia data. In one embodiment, the mobile phone 21 can generate a piece of multimedia data, which contains: multimedia content that represents the content of the agreement to be signed, and multimedia content that represents the content of the agreement that user A and user B approve; for example, user A You can (face the lens of mobile phone 21) say "I promise to rent out Room 302, Building 2, XX Community, to user B, the rent is 3000 yuan per month", and user B can (face the lens of mobile phone 21) say " I promise to rent Room 302 in Building 2 of XX Community from User A at a rent of 3000 yuan per month. Then the content of the agreement is "User A rents Room 302 in Building 2 of XX Community to User B at a rent of 3000 yuan per month." And user A and user B's sentence about "I promise..." expresses their attitude towards the content of the above agreement; for example, user A or user B can print "User A rents XX cell number 2 to user B In Room 302, a paper with a rent of 3,000 yuan per month is presented in front of the camera, and user A and user B can respectively say voice content such as "I approve the content of the agreement for the current shooting". Of course, the expression form of multimedia content is not limited, as long as it can represent the meaning of the above two aspects.
It should be pointed out that when the mobile phone 21 only generates one piece of multimedia data, the user A and the user B can complete the collection of the multimedia data at the same time, or they can complete the collection separately and sequentially. This specification does not limit this.
In another embodiment, the mobile phone 21 can respectively generate a piece of multimedia data for user A and user B. The multimedia data corresponding to user A includes: multimedia content that represents the content of the agreement to be signed, and that user A recognizes the agreement. The multimedia content of the content corresponds to that the multimedia data of user B includes: multimedia content representing the content of the agreement to be signed, and multimedia content representing the content of the agreement that user B approves. For each piece of multimedia data, the generation method is similar to the embodiment shown in FIG. 3 or FIG. 4, and will not be repeated here.
When the multi-party multimedia protocol that user A and user B participate in produces only one piece of multimedia data, the server 22 can return the erroneous content confirmation prompt to the mobile phone 21 through an embodiment similar to that shown in FIG. 5, so that the mobile phone 21 guides the user A Repeatedly confirm the content of the verbal error in the agreement with user B. Then, the server 22 obtains the multimedia confirmation data uploaded by the mobile phone 21, and calls the smart contract to verify the data content contained in the multimedia confirmation data, and publishes the multimedia data and the multimedia confirmation data uploaded by the mobile phone 21 to the blockchain. , Record as the corresponding multimedia protocol. Here, you can refer to the embodiment shown in FIG. 5, but the confirmation operation of the erroneous content needs to be completed by the user A and the user B, and will not be repeated here.
In addition to sharing the mobile phone 21, users A and B can also use different electronic devices. For example, as shown in Fig. 6, user A can use mobile phone 21 and user B can use mobile phone 23, especially when user A and user B respectively When in different geographical locations, multimedia agreements can still be signed remotely, without the need to go to the same place to sign the agreement.
In one embodiment, any participant of the agreement may request the signing function of the multimedia agreement from the server 22 through the mobile phone 21. For example, when the participant of any agreement is user A, the user A may designate user B as the associated agreement. Participants, so that the mobile phone 21 used by user A (logged in with the account of user A) and the mobile phone 23 used by user B (logged in with the account of user B) can achieve collaboration, thereby jointly participating in the signing process of the same multimedia agreement .
The mobile phone 21 can implement real person authentication for user A and collect multimedia data related to user A, which is similar to the case of the embodiment shown in Figure 3-4, and will not be repeated here; mobile phone 23 can implement real person authentication for user B , And collect multimedia data related to user B, which is similar to the implementation process of mobile phone 21, and will not be repeated here.
After the mobile phone 21 or the mobile phone 23 uploads the multimedia data to the server 22, similar to the embodiment shown in FIG. 3, the server 22 can analyze the multimedia data, and then check the analysis results by calling the smart contract, for example, Check at least one of the following aspects: whether the content of the agreement contains illegal content, whether the content of the agreement contains invalid content, whether the parties to the agreement approve the content of the agreement, whether the state of the agreement participants expressing "approval" is normal, etc., no longer here Go into details.
Fig. 7 is a schematic diagram of another oral error prevention processing provided by an exemplary embodiment. As shown in FIG. 7, the server 22 can detect the protocol content contained in the multimedia data 1 uploaded by the mobile phone 21 and the protocol content contained in the multimedia data 2 uploaded by the mobile phone 23 by invoking the smart contract, and determine the content contained in the protocol content. The content of easy-to-spoken mistakes is sent to the mobile phone 21 and 23 respectively, and the confirmation prompt 1 of the easy-to-spoken contents confirmation prompt 2 is sent to the mobile phone 21 and the mobile phone 23, so that the mobile phone 21 and the mobile phone 23 respectively guide the user A and the user B to repeat the mistakes in the agreement confirm. Then, the server 22 obtains the multimedia confirmation data 1 and the multimedia confirmation data 2 uploaded by the mobile phone 21 and the mobile phone 23 respectively, and calls the smart contract to verify the data content contained in the multimedia confirmation data 1 and the multimedia confirmation data 2 respectively. For the anti-spoken processing implemented by user A and user B, reference may be made to the embodiment shown in FIG. 5, which will not be repeated here.
In one embodiment, since user A and user B may be in different geographic locations, the two may not be able to directly learn the multimedia collection status of the other party, so the server 22 is acquiring multimedia data or multimedia confirmation data of one party. Later, it can be passed to the other party for viewing. For example, the electronic equipment used by each agreement participant can display video windows corresponding to each agreement participant, so as to display the video images taken by the electronic equipment used by each agreement participant; for example, mobile phones 21, Two video windows can be displayed on the mobile phone 23 to display the video pictures taken by the mobile phone 21 and the mobile phone 23 respectively, so that the user A and the user B can view their own video shooting situation and the other party's video shooting situation . In particular, through the mutual transfer of multimedia data and multimedia confirmation data, each protocol participant can learn the multimedia data and multimedia confirmation data of each protocol participant, so as to verify the content of the agreement contained in the multimedia data and the multimedia confirmation data. Check the content of the data to facilitate discovery of text traps, ambiguities, and verbal errors that may not be easily detectable by the server 22; and, each agreement participant can have the right to terminate the signing, so that any agreement participant can If there are objections to the multimedia data or multimedia confirmation data, and other parties to the agreement refuse to modify, the signing of the agreement can be terminated to protect the rights of the parties to the agreement.
Then, the server 22 can publish the multimedia data 1 and multimedia confirmation data 1 uploaded by the mobile phone 21, and the multimedia data 2 and multimedia confirmation data 2 uploaded by the mobile phone 23 to the blockchain, so as to be recorded as between user A and user B. Signed multimedia agreement. Alternatively, the four hash values corresponding to multimedia data 1, multimedia confirmation data 1, multimedia data 2, and multimedia confirmation data 2 (or a hash value calculated again from the four hash values) can be published to the block The multimedia data 1, the multimedia confirmation data 1, the multimedia data 2, and the multimedia confirmation data 2 are stored in the server 22 and avoid the chain, which helps to achieve privacy protection.
It should be pointed out that although in the above-mentioned embodiment, when a multi-party agreement is involved, the scenario of signing an agreement between user A and user B is used as an example, but the technical solution of this specification can also be applied to a larger number of agreement participants. In order to realize the signing of an agreement between three or more parties, this manual does not limit this.
Fig. 8 is a schematic structural diagram of a device provided by an exemplary embodiment. Please refer to Figure 8. At the hardware level, the device includes a processor 802, an internal bus 804, a network interface 806, an internal memory 808, and a non-volatile memory 810. Of course, it may also include hardware required for other services. body. The processor 802 reads the corresponding computer program from the non-volatile memory 810 to the internal memory 808 and then runs it to form a multimedia protocol content confirmation device at the logical level. Of course, in addition to software implementation, one or more embodiments of this specification do not exclude other implementations, such as logic devices or a combination of software and hardware, etc., which means that the execution body of the following processing flow is not limited to Each logical unit can also be a hardware or a logical device.
Please refer to FIG. 9, in the software implementation, the multimedia protocol content confirmation device is applied to the blockchain node, which may include:
The first acquiring unit 91 acquires first multimedia data in the form of video or audio provided by the protocol participants, the first multimedia data including first information for characterizing the content of the protocol and for characterizing the protocol Participants recognize the second information of the content of the agreement;
The first calling unit 92 calls a smart contract that is used to identify the feature information contained in the agreement content represented by the first information, and output an additional confirmation request for the feature information to the protocol participant ；
The second acquiring unit 93 acquires second multimedia data in the form of video or audio returned by the protocol participant in response to the additional confirmation request, where the second multimedia data includes additional confirmation of the feature information News;
The publishing unit 94 publishes the first multimedia data and the second multimedia data to the blockchain to record the multimedia agreement signed by the agreement participants.
Optionally, the characteristic information includes: information that complies with a predefined slippage rule.
Optionally, different languages are used in the first multimedia data and the second multimedia data to confirm the characteristic information.
Optional, also includes:
The second calling unit 95 calls a smart contract, and the smart contract is used to verify whether the content of the agreement represented by the first information is legal and valid.
Optional, also includes:
The third calling unit 96 calls a smart contract, which is used to verify the approval of the agreement participants represented by the second information on the content of the agreement and/or that represented by the additional confirmation information Whether the agreement participant's recognition of the feature information is valid.
Optionally, the multimedia protocol is a single-party protocol, and there is one protocol participant; or, the multimedia protocol is a multi-party protocol, and there are multiple protocol participants.
Optional,
When there are multiple protocol participants, the multiple protocol participants correspond to the same first multimedia data and second multimedia data, and the second information contained in the first multimedia data is used to characterize multiple protocols Participant's recognition of the content of the agreement, and the additional confirmation information contained in the second multimedia data is used to characterize the recognition of the feature information by multiple agreement participants;
Or, when there are multiple protocol participants, the multiple protocol participants respectively correspond to different first multimedia data and second multimedia data, and the second information contained in each first multimedia data is used for It characterizes the recognition of the protocol content by the corresponding protocol participant, and the additional confirmation information contained in each second multimedia data is used to characterize the recognition of the characteristic information by the corresponding protocol participant.
Optional, also includes:
The fourth invoking unit 97, invoking a smart contract, which is used to verify the first multimedia data contained in each first multimedia data when multiple parties to the agreement respectively correspond to different first multimedia data. Whether the content of the agreement represented by the information is consistent.
Optional, also includes:
The fifth calling unit 98 calls a smart contract, the smart contract is used to generate a text agreement based on the video data, and to sign through the data identities of the participants in the agreement;
When the publishing unit 94 publishes the first multimedia data and the second multimedia data to the blockchain, it also publishes the text protocol in association.
The systems, devices, modules, or units explained in the above embodiments may be implemented by computer chips or entities, or implemented by products with certain functions. A typical implementation device is a computer. The specific form of the computer can be a personal computer, a laptop, a mobile phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email receiving and sending device, and a game console , Tablets, wearable devices, or a combination of any of these devices.
This specification proposes a computer-readable medium on which computer instructions are stored. When the instructions are executed by a processor, the technical solutions of this specification are implemented, such as the method for confirming the content of the multimedia protocol in any of the above embodiments. A repeat.
In a typical configuration, a computer includes one or more processors (CPU), input/output interfaces, network interfaces, and internal memory.
Internal memory may include non-permanent memory in computer-readable media, random access memory (RAM) and/or non-volatile internal memory, such as read-only memory (ROM) or flash memory Body (flash RAM). Internal memory is an example of computer-readable media.
Computer-readable media includes permanent and non-permanent, removable and non-removable media, and information storage can be realized by any method or technology. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase change internal memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), and other types of random access memory (RAM). ), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other internal memory technology, read-only CD-ROM (CD-ROM), digital Versatile optical disc (DVD) or other optical storage, magnetic cassette tape, magnetic disk storage, quantum memory, graphene-based storage media or other magnetic storage devices or any other non-transmission media that can be used for storage and can be accessed by computing devices Information. According to the definition in this article, computer-readable media does not include transitory media, such as modulated data signals and carrier waves.
It should also be noted that the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or equipment including a series of elements not only includes those elements, but also includes Other elements that are not explicitly listed, or include elements inherent to the process, method, commodity, or equipment. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, commodity or equipment that includes the element.
The foregoing describes specific embodiments of this specification. Other embodiments are within the scope of the patent application. In some cases, the actions or steps described in the scope of the patent application may be performed in a different order from the embodiment and still achieve desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or sequential order shown to achieve the desired result. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
The terms used in one or more embodiments of this specification are only for the purpose of describing specific embodiments, and are not intended to limit one or more embodiments of this specification. The singular forms of "a", "said" and "the" used in one or more embodiments of this specification and the scope of the patent application are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and/or" used herein refers to and includes any or all possible combinations of one or more associated listed items.
It should be understood that although the terms first, second, third, etc. may be used in one or more embodiments of this specification to describe various information, the information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of one or more embodiments of this specification, the first information can also be referred to as second information, and similarly, the second information can also be referred to as first information. Depending on the context, the word "if" as used herein can be interpreted as "when" or "when" or "in response to certainty".
The above descriptions are only preferred embodiments of one or more embodiments of this specification, and are not intended to limit one or more embodiments of this specification. All within the spirit and principle of one or more embodiments of this specification, Any modification, equivalent replacement, improvement, etc. made should be included in the protection scope of one or more embodiments of this specification.
