【BibiGPT】AI 自动总结视频 · 更新支持 YouTube 英文内容一键总结啦

JimmyLv_吕立青
7 Mar 202312:26

Summary

TLDRThe video introduces BibiGPT, an AI-powered tool for summarizing content from platforms like YouTube and Bilibili. It showcases new features, including a bookmarklet for quick summarization and a beta feature with timestamps for direct navigation to specific video moments. The tool also integrates with Notion and GitHub for login and content storage, offering additional benefits like extended free usage for registered users. The creator discusses future plans for broader support and a desktop application, highlighting the project's rapid growth and community engagement.

Takeaways

  • 🚀 Introduction of BibiGPT, an upgraded version of BiliGPT, with the slogan 'no bb, show me the notes!', designed for AI-powered summarization of various audio-visual content.
  • 🔗 New feature update: BibiGPT now supports YouTube video summarization by simply inputting a YouTube link.
  • 📚 Introduction of a bookmarklet feature for quick summarization of YouTube and Bilibili videos with a single click.
  • 💡 Backend caching implemented to speed up the summarization process by loading videos only once.
  • ⏱️ Beta feature for displaying timestamps in the summaries, allowing users to jump directly to specific points in the video.
  • 📝 Option to copy summarized notes directly from the interface to use as comments or annotations in videos.
  • 🔑 Account system introduced to manage API usage limits and provide additional features for registered users.
  • 👤 Integration with Notion and GitHub for account login, reflecting the developer and knowledge management focus of the tool.
  • 📈 Plans to change the billing model from count-based to time-based, offering more flexibility in video length usage.
  • 🎁 Future benefits for users who purchase usage, with significant multipliers on the purchased time.
  • 📝 Additional updates include support for more platforms, a desktop application, and enhanced summarization capabilities.
  • 🌐 Open-source nature of the project with active community contributions and regular updates documented on GitHub.

Q & A

  • What is the name of the upgraded version of BiliGPT introduced in the video?

    -The upgraded version of BiliGPT introduced in the video is called BibiGPT.

  • What is the slogan of BibiGPT?

    -The slogan of BibiGPT is 'no bb, show me the notes!'

  • Which platforms does BibiGPT support for summarizing audio-visual content?

    -BibiGPT supports summarizing content from platforms like YouTube, Bilibili, meetings, podcasts, and local files.

  • How can users utilize BibiGPT with YouTube links?

    -Users can input a YouTube link into BibiGPT, and after a short wait, the content of the video will be summarized.

  • What is the purpose of the bookmark feature introduced in the video?

    -The bookmark feature allows users to quickly summarize videos from YouTube or Bilibili by simply clicking on the bookmark button.

  • What does the beta feature of showing timestamps offer?

    -The beta feature of showing timestamps allows users to click on a specific time in the summary to jump directly to that moment in the video.

  • How does the account system introduced in the video benefit users?

    -The account system provides users with additional daily usage limits for video summarization once they log in, starting with an extra 5 times per day.

  • Which platforms are supported for login in the BibiGPT account system?

    -The account system initially supports login through Notion and GitHub.

  • What is the plan for the pricing model in the future according to the video?

    -The plan is to change the pricing model from a count of uses to a duration-based model, allowing a certain number of hours per day.

  • What additional feature is mentioned for summarizing video content in the future?

    -In the future, the plan includes supporting desktop applications and local file uploads, and using OpenAI's interface to convert audio to text.

  • What does the creator of BibiGPT envision as the ultimate goal for the platform?

    -The ultimate goal is to create a platform where everyone can quickly share their prompts and create their AI applications, enabling everyone to become AI magicians.

Outlines

00:00

😀 Introduction to BibiGPT and New Features

The video introduces BibiGPT, an upgraded version of BiliGPT, which is a tool for summarizing audio-visual content from platforms like YouTube, Bilibili, podcasts, and local files using AI. New features include support for YouTube links, a bookmarklet for quick summarization, and a beta feature to display timestamps in summaries. The tool has been updated to include a caching system for faster loading and is set to integrate with more note-taking apps in the future. The creator also mentions an account system to manage API usage limits and offers additional features like saving summaries directly to Notion.

05:01

🎉 Account System and Future Updates

The script discusses the new account system that offers daily free usage limits and additional benefits for logging in via Notion or GitHub. The creator plans to change the pricing model from a count-based system to a time-based one, offering users more flexibility. Future updates include support for more video platforms, a desktop application, and enhancements to the summarization process. The project is open-source, and the creator shares updates and developer diaries on GitHub. The video also highlights the rapid growth of the project's user base and community appreciation.

10:09

🚀 Community Impact and Future Vision

The final paragraph emphasizes the community's positive response to BibiGPT, with mentions of recommendations from influencers and the project's growth in popularity. The creator expresses gratitude for the support and shares plans for a platform where users can share prompts and create AI applications, aiming to empower everyone to become 'AI magicians.' A public account called 'Magic Department' is introduced as a platform for further engagement and sharing of AI magic.

Mindmap

Keywords

💡BibiGPT

BibiGPT is an upgraded version of BiliGPT, described as a 'BB terminator' in the video. It is an AI tool designed to summarize audio-visual content from platforms like YouTube, Bilibili, podcasts, and local files. The term is central to the video's theme as it represents the main subject being introduced and discussed. For instance, the video script mentions the new features of BibiGPT, such as its ability to summarize YouTube videos and integrate with other platforms.

💡AI Summarization

AI Summarization refers to the process of using artificial intelligence to condense lengthy content into shorter, more digestible summaries. In the context of the video, AI summarization is the core functionality of BibiGPT, allowing users to quickly grasp the main points of videos without having to watch them in full. The script illustrates this with examples such as summarizing a YouTube video about note-taking software.

💡YouTube Integration

YouTube Integration is a feature that allows BibiGPT to interact directly with YouTube videos, either by pasting a link or using a bookmarklet to summarize the content. This feature is highlighted in the script as a significant update, demonstrating the tool's capability to enhance user experience by simplifying the process of accessing and understanding video content on YouTube.

💡Bookmarklet

A Bookmarklet is a small JavaScript code stored as a bookmark in a web browser. It allows for quick access to specific functions or actions without the need to manually navigate to a website. In the video, the creator introduces a bookmarklet for BibiGPT that enables users to easily summarize YouTube and Bilibili videos by clicking on the bookmarklet in their browser.

💡Time Stamps

Time Stamps are used in the video script to refer to the feature that allows users to see and jump to specific moments within a video summary. This is particularly useful for quickly accessing parts of a video that are of interest. The script mentions a beta feature that includes time stamps in the summaries, enhancing the navigability of the content.

💡Account System

The Account System mentioned in the script is a feature that allows users to log in to BibiGPT, which comes with benefits such as additional free video summarization attempts per day. It is part of the video's narrative on improving user experience and managing the usage of the AI summarization service.

💡Notion Integration

Notion Integration refers to the capability of BibiGPT to connect with the Notion app, allowing users to save their video summaries directly into Notion. This is presented in the script as a way to enhance knowledge management and note-taking, making it easier for users to organize and access their summarized content.

💡GitHub

GitHub is a platform for version control and collaboration that is mentioned in the script as a method for users to log in to BibiGPT and as the host for the project's open-source code. It signifies the community aspect of the project and the creator's commitment to transparency and collaboration.

💡OpenAI API

OpenAI API is a service provided by OpenAI that allows developers to integrate AI capabilities into their applications. In the video, the creator discusses the cost associated with using the OpenAI API for video recognition and how it affects the daily limit of free summarization attempts for BibiGPT users.

💡Prompt Engineering

Prompt Engineering is the process of designing effective prompts for AI systems to elicit desired responses or actions. In the context of the video, prompt engineering is discussed as a way to optimize the AI's summarization process, such as adjusting the level of detail or focusing on specific aspects of the content.

💡Midjourney

Midjourney is mentioned in the script as a potential integration for BibiGPT to transform summaries into visual representations like的思维导图 or images. This would enhance the user's ability to recall and understand the summarized content through visual means.

Highlights

Introduction of BibiGPT, an upgraded version of BiliGPT, with the slogan 'no bb, show me the notes!' for AI-powered summarization of various audio-visual content.

New feature update supporting YouTube links for direct video summarization.

Demonstration of copying and pasting YouTube video content for summarization.

Introduction of a bookmarklet feature for quick summarization from YouTube and Bilibili.

Caching mechanism implemented for faster video summarization.

Beta feature for displaying timestamps in video summaries.

Ability to jump to specific timestamps in YouTube videos directly from the summary.

Efficiency in viewing video content through timestamped summaries.

Account system introduced to manage API usage and provide additional benefits.

Support for Notion and GitHub logins for account management.

Future plans to integrate with more note-taking applications like Flomo and Roam Research.

Proposal to change the billing model from counts to video duration.

Special offer for early adopters with significant bonus on purchased usage.

Open-source project with active community contributions and GitHub updates.

BibiGPT v1.0 release announcement with active YouTube support.

Vision for a platform where users can share prompts and create AI applications.

Public launch of a WeChat public account called 'Magic Department' for community engagement.

Rapid user growth and community appreciation for the project's utility.

Plans for desktop application development and support for local files.

Potential future features including summarization output as mind maps or images.

Transcripts

play00:02

Hello,大家好,欢迎来到立青的频道

play00:04

那么今天给大家介绍一下 BiliGPT 的升级版, BibiGPT

play00:09

哔哔终结者,那么它的口号就是:no bb, show me the notes!

play00:14

直接用 AI 一键总结 B 站的音视频,或者是 YouTube、会议、播客、本地文件等多种形式音视频内容

play00:22

那么当然首先介绍一下过去一周 BibiGPT 的新功能更新

play00:26

首先第一个就是它支持了YouTube,也就是你现在可以直接输入一个 YouTube 链接,我们可以来试一下

play00:33

输入它然后回车

play00:35

还有一些小细节我待会再给大家介绍

play00:37

等待一会儿之后,这里就出现了一个 YouTube 的视频

play00:41

然后我复制它,回到视频

play00:43

你就可以看到这是我之前看过的一个笔记软件的视频,我可以直接把这个内容粘贴到这里,作为一个回馈

play00:51

那么除了这样的一种使用方式以外,还增加了一个书签版,也就是把网站上右上角这个书签按钮拖到书签栏

play01:01

比方说我直接把它拖到这里,然后再进入 YouTube 的时候,你就可以直接点一下,你发现它自动打开了 BibiGPT 的网站,然后进行了一个总结

play01:10

这个速度非常快,因为我在后台做了缓存,也就是每个视频它只会加载一次,那么这个插件它对 B 站的视频也是生效的

play01:19

所以我们来试一下 B 站的视频

play01:21

点一下这里的书签,然后你发现它直接跳转了过来,直接进行了一个总结

play01:26

那么在下面点击一键复制,或者是直接点这个空白部分,就可以直接复制了

play01:32

回到视频,那你就可以在这里增加上这样的一个省流课代表,不得不说课代表们都要失业了

play01:40

这里还有一个小的 beta 功能,就是是否显示时间戳

play01:44

我们在这里你只需要勾选它,然后再点击一键总结,在底下显示时间戳,进行一键总结

play01:50

这里你可以看有一个时间戳,点击一下GPT,它就直接跳转到第6秒钟,或者是点到 1 分 38 秒,它也会跳转到对应的时间戳

play02:00

这个内容对于 YouTube 也是生效的,我们就拿影视飓风的这个视频来说好了,点一下书签,它会自动开始总结

play02:10

你看这里就有了对应的时间戳

play02:12

这个视频揭秘了 100 位 up 主如何制作字幕,然后平均 up 主们会使用 1-3 小时完成视频字幕

play02:20

那么可以直接跳转到自己感兴趣的地方

play02:23

比方说跳转到 11 分 28 秒的地方,点击你看,它就会跳转到对应 YouTube 视频所在的位置,把声音调小一点

play02:32

(这款字体的设计初衷是在时速100,能够在 6 秒内)你看这个地方,它就会进行一个内容的显示

play02:39

那么这就是一个非常高效的去查看视频位置的一个好方法,好工具

play02:45

除了这些以外,还有非常小的一些小更新,大家可以去试试看

play02:50

那如果大家对使用过程当中有任何问题,也可以点这个提反馈,那么就会跳转到这样一个反馈收集表

play02:57

非常期待你的超级无敌好建议和不得了的BUG

play03:01

好,那么我们干个杯,继续下一个话题

play03:04

就在紧急迭代当中,我引入了账号系统,然后也会给大家发福利的

play03:09

我们来看一下账号系统是怎么工作的

play03:12

因为 OpenAI API 其实是识别时非常贵的,所以每天就只能免费 7 次

play03:17

如果你在识别视频的时候发现次数用完了,你可以点击登录,登录之后每天都会额外赠送 5 次

play03:25

那么这里我首先支持了 Notion 登录和 GitHub 登录

play03:29

为什么是 Notion 和 GitHub 呢

play03:30

因为左手代码,右手笔记

play03:33

作为一个程序员,作为一个知识管理爱好者,首先支持的就是从学习角度上来说,我们使用最多的两个网站了

play03:41

那么使用 Notion 登录呢

play03:43

还有一个非常棒的地方,就是你可以选择自己所保存的位置,你也可以选择我所提供的一个模板,

play03:50

这个模板在我之后会做一个功能,就是你可以一键把你所总结的内容存到 Notion 笔记当中

play03:58

那么你登录之后右上角就会显示你的头像了,然后你就可以再次去使用识别更多的视频了

play04:05

那么在 Notion 当中就是这样一个数据库表的方式,存储了所有的 BibiGPT 的视频笔记,应该是音视频笔记,

play04:14

然后会把总结的 notes 和对应的 URL 以及它自动打上的 tag 放进来,这个是我之前测试了很多遍,所以它就出现到这里了

play04:25

当然你们登录之后它就只会保存一次,如果大家很感兴趣的话,可以关注加私信我,然后我提前给大家试用

play04:32

最后还会对接更多的笔记软件的,比如 Flomo、写客松、Roam Research 等等

play04:38

那么另外一个想要提到的点就是,现在有一个计费非常不合理的地方,我允许的是次数,而不是视频的时长

play04:46

所以有些同学就过来甩一个可能 1 小时、2 小时的视频,这样的话它也只算一次

play04:52

所以说我后面计划去把这个次数改成时长,比方说每天可能允许 1 小时或者 2 小时

play05:00

然后等如果大家用完了,可以在这里点击购买次数

play05:04

那么这里提前预告一个福利嘛,就是说现在确实因为我还没有开发完,所以算的是次数

play05:10

如果大家在这里买过了一些次数的后,会直接以一个*非常大的倍数*的方式给大家送时长

play05:17

比如说你现在买的是 50 次,最后可能就直接变成了 500 小时

play05:22

当然最后而如果是之后再购买的话,可能就等额的只有 200 小时等等

play05:28

那么这边有 350 字还会额外赠送 ChatGPT 提示的艺术

play05:33

就你如何去写好一个 prompt 制作清晰有效的 prompt 的一个指南

play05:38

这个电子书会额外送给大家

play05:40

怎么样让它更好地去在阅读、写作、编程、笔记等方面,能够达到更好的效果

play05:46

大家可以去看我的前两期视频,最强打工人,7x24 小时,随时待命

play05:52

好,那么说完了账号系统和福利,后面也再给大家补充一下后续更新的计划

play05:57

那么首先是目前暂时只支持 YouTube 和哔哩哔哩的视频

play06:03

最后我想把会议、播客、本地文件等等的音视频内容全部都做完

play06:08

然后也会推出一个桌面端,让使用体验更加的友好,也更方便去上传本地文件

play06:15

到时候会用 OpenAI 的接口直接去识别文件的声音,转成文字,然后我应该会更加的好,大家敬请期待

play06:23

我是从 Input, Prompt, Output 的角度来思考的

play06:26

我们刚刚说支持各种类型的音视频,它其实属于一个input

play06:31

然后在 prompt 的时候,比方说是否显示时间戳,其实就是 Prompt 的一个调参

play06:38

就怎么样让 GPT 的接口更加高效,或者说更符合你总结的一个目的

play06:43

比方说我可以让它一句话总结,或者是把它拆成多个片段,或者是读取作者的金句,所以在 prompt 词这一方面也可以持续迭代

play06:54

至于output,我现在想的是可以直接保存文本到Notion,但其实还有更多的可能性

play07:00

比方说把总结的结果直接变成一张思维导图,或者是变成一个图像

play07:07

我可以接入 Midjourney 来显示一张图像,这样一张图像会更加有效地帮你去总结和回忆当时所学的内容

play07:16

当然这都是很多在输出端可以去完善的

play07:19

如果你有高效产出的需求的,可以让他直接帮你变成小红书的文案,是你正在完成的作业、作业总结等等

play07:28

后续的更新,我在网站上做了一个域名的映射,所以大家直接访问 /release,就会进到 GitHub 查看所有的更新记录

play07:37

当然,你看在网站的最上方也会有一个更新日志

play07:40

其实我的项目完全是开源的,我做了一个开发者日记,记录下我每次的更新

play07:46

像最近做的就是支持了 YouTube 的英文内容以及总结

play07:50

你点一下就会跳转到GitHub,查看所有的日期以及发布了 Features 和修复了哪些 Bugfix

play07:58

当然这个其实是自动化的,每次我提交代码之后,我做了一个脚本,会自动帮我更新版本号以及对应的更新日志

play08:08

作为一个程序员,这种自动化的流程是非常值得去做的,也帮我节省了很多很多的时间

play08:14

BibiGPT v1.0 是今天发布

play08:16

就当我正式支持 YouTube video 之后就正式发布了,大家可以看整个的更新,非常非常的勤快的其实

play08:24

然后也非常开心,这个项目目前已经有了 915 个 stars,可能马上就要破千了

play08:31

非常高兴能够通过这个项目帮大家节省时间

play08:35

一键总结所有的音视频内容,如果大家感兴趣,非常期待大家的PR

play08:42

之前有位小伙伴就帮我完善了时间戳的这个功能,然后也对他进行了一些测试

play08:48

所以在过去一周我真的感觉是自己在疯狂迭代:“感觉自己毕生所学都全部用上了”

play08:55

随之所发生的事情也想跟大家聊一聊

play08:58

就过去一周的一些变化

play09:00

因为首先这个项目非常的火热,就是一周时间就获得了 4 万多的用户,也收获了很多很多人的赞赏

play09:07

在这里非常感谢大家

play09:09

我给大家看一下这个项目的后台数据,这里是一个分析的功能,总共显示是

play09:15

我 3 月 1 号开始发布的,第二天就直接冲到了 1 万多的用户,第二天甚至更高,

play09:22

这几天差不多持平在 5000 多左右,总共用户已经 43645 个用户了,如果没有重复的话,识别了可能 7 万多次的视频

play09:33

所以真的非常感谢大家的分享

play09:36

过去一周我真的加了可能比过去一年都要多的人,有很多人表示感谢,

play09:42

还会有投资人过来说这个项目很不错,以及即刻马上就要举办一个 AI 的黑客马拉松,很多的机构和平台都开始行动了起来

play09:52

有一个特别好玩的就是这还有人自己帮我做了一个快速跳转 BiliGPT 的油猴脚本,非常感谢!

play10:00

然后我之前关注的一些博主,比如微博上的阿文说被种草一个自动总结 B 站视频的工具,还挺实用

play10:08

关注了小众软件,他也说用 BiliGPT 把 3 分钟视频自动缩减成 100 个字, 10 秒看完一键总结视频内容,当时就震惊了

play10:17

B 站上我发现差评君其实也推荐了一下,试了一下他自己的视频的效果

play10:23

我在微信上也进行了一些搜索,也有很多人进行了推荐,所以真的非常感谢大家

play10:30

甚至有朋友跟我说,王煜全老师在他的公众号也提到了我,

play10:34

在即刻上面也有非常多的人关注了我,可能新增了 1000 多人,也会有很多人帮忙推荐这个项目

play10:41

包括我很喜欢的(长文作者)评论尸,我也一直坚信文字的力量,所以在这里真的要跟大家好好说一声感谢

play10:49

对于我来说,在做的杠杆率最高的事情就是「开发超级酷的 AI 应用」,做的杠杆率第二高的事情就是「做贼有意思的视频」

play10:58

我通过视频的方式获取大家的反馈,再通过做软件开发的方式回馈给大家,真正能够帮助大家去学习

play11:06

特别是在 B 站的评论区,也会有朋友把评论总结之后的内容贴回到 B 站,所以看到大家在学习不同的内容,也是让我非常开心的一点

play11:17

好,那视频的内容差不多就到这里了, YouTube 上也有很多学习的资源,所以说优先支持了一下 YouTube 的视频

play11:24

YouTube 的中文英文其实都是可以一键总结的,那么也欢迎大家使用账号,登录之后会给大家送福利

play11:33

以及下一步的更新计划,就是支持桌面端和本地文件,支持更多形态的音频或视频,以及在这个小应用的爆发之下

play11:43

其实我最开始的想法是做一个平台,这样每个人都可以非常快速的分享自己的prompt,创建自己的 AI 应用,让每个人都能够成为AI魔法师

play11:55

目前还只是一个开始,我相信未来有更多的人使用魔法,分享魔法,

play12:01

所以我也开通了一个公众号作为平台,就叫做“魔法司”,也就是

play12:06

「在魔法司,成为魔法师」

play12:10

暂时不剧透太多,如果大家感兴趣赶紧去关注一波

play12:14

好,那么这个视频就到这里啦

play12:16

大家要开心快乐,我们下次再见,拜拜!

Rate This

5.0 / 5 (0 votes)

Related Tags
AI SummarizationVideo ContentYouTubeBilibiliEfficiencyNote GenerationTime StampsBookmarkletCache SystemNotion IntegrationDeveloper Tools