Digital music icon Don Diablo is thought for pushing the boundaries of music, visible arts and stay efficiency — and the music video for his newest single, “BLACKOUT,” explores utilizing generative AI, combining NVIDIA RTX-powered and cloud-based instruments in a hybrid workflow.
Set inside an industrial warehouse, the video options Diablo performing in entrance of an immersive, AI-generated surroundings — mixing stylized results, a cinematic temper and personalised parts.
The picture creation and experimentation was accomplished regionally on a desktop powered by a NVIDIA GeForce RTX 5090 GPU, whereas the ultimate animation was rendered utilizing Kling AI, a cloud-based generative video software. This hybrid strategy gave the crew inventive management and high-fidelity outcomes.
CTRL + ALT + Create With RTX
All image-based work within the music video — together with stylization and identification modeling — was carried out regionally utilizing ComfyUI, a visible, node-based interface for constructing and customizing generative AI workflows.
With minimal setup, the crew might launch preconfigured workflows and experiment freely with completely different fashions and methods. ComfyUI supplied pace, ease of use and help for a variety of open-source instruments — enabling quick iteration and distinctive visuals that aligned with Diablo’s inventive course.
Diablo wished the visuals to mirror his identification — not simply function decor. To attain this, a customized mannequin was skilled on a facial dataset of Diablo, utilizing low-rank adaptation within the FLUXGYM consumer interface.
The ensuing mannequin was then loaded into ComfyUI and built-in right into a Secure Diffusion pipeline for stylized picture technology. An identity-embedding node ensured constant facial options throughout frames, in addition to stylistic cohesion.
As soon as the imagery was locked, the crew turned to Kling AI within the cloud to animate the visuals into dynamic scenes, harnessing the software’s superior physics and cinematic capabilities.
This workflow, all working regionally on an RTX 5090 GPU, enabled sooner iteration, exact visible management, tighter suggestions loops and full inventive autonomy. It showcases how creators can use native RTX-powered instruments — in addition to cloud-based platforms for pre-defined workloads that require extra compute — to rapidly and simply produce high-impact content material on their phrases.
“Working with these new AI instruments actually looks like getting into my very own thoughts,” mentioned Diablo. “We have been capable of creatively elevate the bar, form the visuals in actual time and keep targeted on the story. AI is a strong software for creativity.”
Inventive Workflows, Powered by RTX AI
Watch the total “BLACKOUT” music video to see how the crew introduced their inventive concepts to life with RTX AI.
Artists and builders are already utilizing generative AI to streamline their work and push inventive boundaries, whether or not exploring ideas, designing digital worlds or constructing clever apps. With RTX AI PCs, customers can entry the most recent and biggest fashions and instruments, in addition to highly effective AI efficiency.
Study extra concerning the NVIDIA Studio platform and RTX AI PCs.
Every week, the RTX AI Storage weblog collection options community-driven AI improvements and content material for these trying to be taught extra about NVIDIA NIM microservices and AI Blueprints, in addition to constructing AI brokers, inventive workflows, digital people, productiveness apps and extra on AI PCs and workstations.
Plug in to NVIDIA AI PC on Fb, Instagram, TikTok and X — and keep knowledgeable by subscribing to the RTX AI PC publication.