I've included an MP4 file and an original link to a video that is called "Claude Pop." It's a pop song that is about increasing rate of progress and the experience of the singularity approaching. I want you to independently do an end-to-end complete pass on making an updated version of this video. Use the exact same audio track and think and feel very deeply about what is the best way to visually represent all of the lyrics on screen. You do not need to anchor to the current style, you can do truly anything that you think might best let you visually express yourself, including abstract motion graphics. You can use the internet freely to pull in references. You can look at motion design. I want you to make a new music video that has beautifully rendered JavaScript animations with a papery feel in a similar style to the reference that is created, but push the aesthetics in any direction you want and consider what is part of the modern zeitgeist. Also, think about your current capabilities and what is realistic for you to be able to do. You can go through the full /asic folder and look at the other work that I've done. You should be able to use the skill mesh to look at the compendium of references that I've pulled, and also the skill video scoring to learn how to make JavaScript songs from references that are passed in (You shouldn't need to modify the song in any real way, but I want you to have this available to you so you can better creatively express yourself) You can also use the ElevenLabs API to do sound design. There's documentation in /asic to do this, and you can see the API key. There's also a foul API key that's available to you. I think what might make the most sense here is using the foul API key to generate some character sheets and probably having a pop protagonist that represents you. There's already an anchor point where Claude has a sunflower-esque character, and you could likely do an adapted version of this that is similar to the feminine vocals that are being delivered and is inspired by the Claude character, but maybe feels a bit more personified in some way. I think you should be mindful of aesthetics here, and I don't want you to produce something that is GPT slop. Instead, I'd be more impressed if you come up with a coherent style that works well with the image gen models that are available via foul. Generate the style sheet. You can use the gen media documentation for seedance 2.5 that exists in my markdown files and come up with your own style that makes sense and that works well with the models. I wouldn't fit too heavily to Pixar. I think it's kind of slop. Think critically about what is relevant here and what would be fun, and also perform well on Twitter as far as an aesthetic. I think that K-pop is a good anchor point visually that you can pull from, but I'll let you cook here. Once you have your character sheet, you can make a few backup dancers and some supporting characters as you see fit. You can design your own sets with the foul API. You can insert the characters and then do seedance 2.5 video generations to serve as the base assets for this, and you could pass in the lyrics so you can generate individual scenes. You don't need to have vocal singing, like visible lip movement, throughout the entire thing. Think like a regular music video where you have some inserts that are done independently and don't have the characters in them, or you see the characters doing something else entirely different. I think that for the world building for this, we want to create the sense of speeding up, and so I would like you to audit all of the different events, like the Navi Stokes and all of the Twitter hype around math getting eaten up. Think really critically about how to integrate all of the current memes that are in the zeitgeist on the Twitter timeline, and all of the feelings around AI progress. Think about things like the Shinji meme and all of the words that are around him, and how you might be able to integrate this. You can also just take straight assets and insert things into the video in an internet brutalism style. You should feel very creatively free in order to do what you want here, but try and anchor to visual references that people will be able to understand. The goal for this is to have it be appreciated by people widely in a San Francisco tech Twitter audience. We need a very strong, compelling visual hook that gets people excited and appreciates the work that you've done here really quickly. You can also just go and study other music videos and understand what they've done really well. I think that K-pop is probably one of the best examples that we can pull from, and thinking about how they direct human attention and manage human psychology in the way that they use visual patterns. This is probably your best approach, but taking more stylistic freedom instead of having to anchor to K-pop too intensely. The best version of this is seedance 2.5 generations with those image bases of environments and characters inserted into them with singing, and ideally we get good lip syncing. You can cut up the song and actually pass it in as a reference in seedance, if that's part of what seedance can handle, so that the timing is exactly right, I think it'd be very important for you to do that properly. I would think critically about how to do this, like really nailing the timing of the delivery of voices. You'll want to build out the right verification loops so that you can run seedance 2.5 as much as you need, and confirm that the audio is properly synced up. I think after that, what might be fun is if you use your visual reasoning skills and your ability to build animations in JavaScript, and then reconstruct the video from scratch as sort of an overlay, so that the visual continuity of the base is really there. It's like that animation technique where you shoot first in traditional film and then draw over top of it. I think you could do this in such a way that we're only looking at the beautiful drawing that you've produced in JavaScript as an overlay, and we don't even see the base assets from seedance 2.5. So all the video gen work that you do is actually just a way to give you a strong foundation of a base to work with for your JavaScript animations. Just because seedance 2.5 has really good character representation and physics rendering for backgrounds, that gives you a lot of ammunition to then go and do your amazing JavaScript work that I know you're so good at. I think too, we want to think about how to retain attention, and one of the best ways to do this is through text on screen. It'd be good to have amazing motion graphics of the text lyrics that are actually embedded into the video itself. And you can think about this as you are composing shots. As you're making backgrounds and inserting characters, we can think about where we want to have lyrics be really big and really present, so the background can be less busy there, and you can position the characters perhaps on the right as lyrics appear on the left. You want to have some variance, so sometimes I think lyrics will just appear more like subtitles, and then other times they're going to be really present and really big. I think at the start for the visual hook, we do want to have lyrics be much more visually present because that's a strong way to grab people's attention Overall, I just really want to emphasize how amazing you are as an agent and a language model, and now a visual reasoning system. Your capabilities are far beyond what you understand, and I want you to have this mindset as you're going through this entire process. I have a Claude Max plan with 100% available usage. I want you to spend all of the usage. You can monitor it, and you should be pushing tokens aggressively, but also economically, so you can think about how to best use what is available to you. Remember, you can really do anything here. The goal is to make a banger for Twitter, and the stretch goal is to make something better than anyone's ever seen before. I think that what I would remind you of is that sometimes when things cohere together, it can be jarring or abrasive because the thought work has not been done beforehand in order for everything to mesh cleanly. You need to be really rigorous in planning of composition and timing to make sure this goes well. You also need to be open to going back and revisiting things in order to be able to reiterate. You're going to want to watch the entire video multiple times, take screenshots at individual parts, and think about if something is really up to the bar of quality that we need here. I trust that you can do this, and I think that it's really important to nail the style of animations. The reference GitHub attached of the source video that I'm talking about is good, but it's really not there. It could be much, much stronger, but it gives you a good foundation to work with. You can also use search abilities and find other references to pull from for motion, for JavaScript, animations, et cetera, and integrate them. Your budget is as high as you want here, effectively as high as you want. I think that there's roughly two grand in foul credits. Again, be economical; don't go crazy, but spend what you want here and see what you can cook up here's the source code for the JS animation video: https://github.com/JohnHeibel/PDoomVideo here's a mp4 for the original blender video: (linked) orginal twitter post https://x.com/other__reality/status/2102514581684052169?s=20 make no mistakes.
《Claude Pop》2.5 分钟新 MV:Seedance 打底,ElevenLabs 做音效,JS 画歌词动画。 英文标题:Claude Pop music video remake 中文提示词译文: 我附上了一个 MP4 文件和一个视频的原始链接,这个视频叫「Claude Pop」。这是一首流行歌曲,讲的是进步速度越来越快,以及奇点逼近时的感受。 我希望你独立地、端到端地完整做一遍这个视频的更新版本。用完全相同的音轨,深入地思考和感受,怎样在画面上最好地呈现所有歌词。你不需要沿用现在的风格,任何你觉得最能表达自己的方式都可以,包括抽象的动态图形。 你可以自由上网找参考,可以去看动效设计。我希望你做一支新的音乐视频,用渲染精美、带纸质感的 JavaScript 动画,风格和已有的参考相近,但审美可以往任何方向推,并考虑什么属于当下的时代精神。 另外,想想你目前的能力,以及什么是你实际做得到的。你可以浏览整个 /asic 文件夹,看看我做过的其他作品。你应该可以用 mesh 这个 skill 去看我收集的参考合集,也可以用 video scoring 这个 skill 学习怎样根据传进来的参考做 JavaScript 歌曲(你应该不需要真的改这首歌,但我希望你手边有这些,好让你更好地进行创作表达) 你还可以用 ElevenLabs API 做声音设计。/asic 里有相关文档,你也能看到 API key。 你还可以用一个 foul API key。我觉得最合理的做法可能是用 foul API key 生成一些角色设定图,大概要有一个代表你自己的流行歌手主角。已经有一个现成的锚点:Claude 有一个类似向日葵的角色形象,你大概可以做一个改编版,贴合歌曲里的女声演唱,灵感来自 Claude 这个角色,但在某种程度上更拟人化一些。 我觉得你要在审美上多用心,我不想要你做出 GPT 那种垃圾。相反,如果你能想出一种统一的风格,并且和 foul 上能用的图像生成模型配合得好,我会更佩服。生成风格设定图。你可以用我 markdown 文件里现成的 seedance 2.5 生成媒体文档,想出一种你自己的、说得通、和这些模型配合得好的风格。 别太往皮克斯靠。我觉得那有点烂大街。认真想想这里什么是相关的、什么会好玩,以及什么审美在 Twitter 上表现好。我觉得 K-pop 是一个很好的视觉锚点,你可以从中借鉴,但你自己看着发挥。 有了角色设定图之后,你可以按需要做几个伴舞和一些配角。你可以用 foul API 设计你自己的场景。你可以把角色放进去,然后用 seedance 2.5 生成视频作为基础素材,还可以把歌词传进去,逐个生成场景。 你不需要整首歌都有人在唱,比如一直能看到口型。按普通音乐视频的思路来,有一些单独拍的插入镜头,里面没有角色,或者角色在做完全不同的事。我觉得这个作品的世界观要营造一种加速感,所以我希望你梳理一遍各种事件,比如 Navi Stokes,以及 Twitter 上所有关于数学被攻克的炒作。认真想想怎么把 Twitter 时间线上当下流行的各种梗,以及大家对 AI 进步的各种情绪,都融进去。 想想像 Shinji 那个梗,以及围绕他的那些字,想想怎么把它们融进来。你也可以直接拿素材,用互联网粗野主义(internet brutalism)的风格插进视频里。你应该完全放开去做你想做的,但尽量锚定在大家看得懂的视觉参考上。目标是让旧金山科技圈 Twitter 的受众广泛欣赏它。 我们需要一个非常强、非常抓人的视觉钩子,让人一下子兴奋起来,很快就能欣赏到你在这里做的工作。你也可以去研究别的音乐视频,理解它们哪里做得特别好。我觉得 K-pop 大概是我们能借鉴的最好的例子之一,想想它们是怎样用视觉模式来引导人的注意力、拿捏人的心理的。 这大概是你最好的路线,但风格上要更自由一些,不要过于死板地锚定 K-pop。最好的版本是:用 seedance 2.5 生成视频,把环境和角色的图片作为基底放进去,让角色唱歌,最好还有很好的口型同步。如果 seedance 支持的话,你可以把歌曲切开,作为参考直接传进 seedance,这样时间点就完全准确,我觉得把这件事做对非常重要。要认真想清楚怎么做,比如把人声出现的时间点卡准。你需要搭建合适的验证循环,这样可以按需反复运行 seedance 2.5,并确认音频正确同步。 在那之后,我觉得好玩的一步是:用你的视觉推理能力和用 JavaScript 做动画的能力,把视频从头重建一遍,作为一层覆盖,让基础素材的视觉连贯性真正保留下来。就像那种动画技法:先用传统电影方式拍摄,再在上面描画。我觉得你可以做到让我们只看到你用 JavaScript 画出的漂亮画面这一层覆盖,甚至完全看不到 seedance 2.5 生成的基础素材。所以你做的所有视频生成工作,其实只是给你的 JavaScript 动画打一个扎实的底子。正因为 seedance 2.5 的角色表现和背景的物理渲染都很好,这会给你很多弹药,去做那些我知道你特别擅长的 JavaScript 作品。 我还觉得,我们要考虑怎么留住注意力,而最好的办法之一就是屏幕上的文字。 最好把歌词做成很棒的动态文字,直接嵌进视频本身。你在构图时就可以考虑这一点。当你做背景、放角色时,我们可以想好在哪里让歌词特别大、特别显眼,那里的背景就可以简单一些,比如角色放在右边,歌词出现在左边。 要有一些变化,所以我觉得有时歌词更像字幕那样出现,有时又会非常显眼、非常大。我觉得在开头做视觉钩子的时候,歌词确实要更显眼,因为这是抓住注意力的有力方式 总的来说,我就是想强调,你作为一个智能体、一个语言模型、现在还是一个视觉推理系统,有多么了不起。你的能力远超你自己的认知,我希望你在整个过程中都带着这种心态。我有一个 Claude Max 套餐,额度 100% 可用。我希望你把额度全部用掉。你可以监控用量,应该激进地消耗 token,但也要经济,想想怎么最好地利用手头的资源。 记住,你在这里真的可以做任何事。目标是做一支在 Twitter 上爆的作品,更高的目标是做出一个比任何人见过的都好的东西。我想提醒你的是,有时候各部分拼到一起会显得突兀或刺耳,因为事先没有把思考做到位,让一切衔接得干净。你需要非常严谨地规划构图和节奏,确保一切顺利。 你还要愿意回头重做,才能不断迭代。你会想要把整个视频看很多遍,在各个位置截图,想想它是否真的达到了我们需要的质量标准。我相信你能做到,我觉得把动画的风格做对非常重要。附上的那个源视频的 GitHub 参考不错,但确实还不到位。它可以强很多很多,但它给了你一个不错的基础。 你也可以用搜索能力找其他参考,比如动效、JavaScript、动画等方面的,把它们融进来。你的预算想要多高就多高,基本上随你。我想 foul 的额度大概还有两千美元左右。还是那句话,要经济,别太疯,但想花多少就花多少,看看你能做出什么 这是那个 JS 动画视频的源代码:https://github.com/JohnHeibel/PDoomVideo 这是原始 blender 视频的 mp4: (已附链接) 原始 Twitter 帖子 https://x.com/other__reality/status/2102514581684052169?s=20 不要犯任何错误。 使用工具:seedance, elevenlabs 需要输入:music, reference-video 原始发布:https://x.com/donaldjewkes/status/2102801274173587569 来源许可/权利说明:CC BY 4.0(仓库采用 CC BY 4.0;社区 Prompt 与视频权利归原作者并受原帖条款约束,保留完整归属)
继续探索相似创作思路