{"id":3108,"date":"2023-10-28T12:12:41","date_gmt":"2023-10-28T12:12:41","guid":{"rendered":"https:\/\/promptmuse.com\/?p=3108"},"modified":"2024-01-19T11:56:08","modified_gmt":"2024-01-19T11:56:08","slug":"comfyui-and-animate-diff-evolve-installation-guide","status":"publish","type":"post","link":"https:\/\/promptmuse.com\/comfyui-and-animate-diff-evolve-installation-guide\/","title":{"rendered":"ComfyUI and Animate Diff Evolve Installation Guide"},"content":{"rendered":"<p><iframe title=\"Master ComfyUI &amp; Animate Diff: Ultimate Guide to Seamless AI Animations (Even on Low-End PCs!)\" width=\"788\" height=\"443\" src=\"https:\/\/www.youtube.com\/embed\/1fWZNECdN9Y?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" allowfullscreen><\/iframe><\/p>\n<p>Hello there, Prompt Muse here! In this comprehensive guide, I\u2019ll walk you through the essentials of setting up ComfyUI and Animate Diff Evolve.<\/p>\n<p>1. Introduction<\/p>\n<p>\u2022 ComfyUI offers a node-based layout, allowing for a streamlined workspace tailored to your needs.mm<br \/>\n\u2022 Drag and drop features for images and workflows enhance ease of use.<br \/>\n\u2022 This tutorial aims to make you feel comfortable with ComfyUI, ensuring you make the most of its unique features.<\/p>\n<p>2. System Requirements<\/p>\n<p>\u2022 Nvidia RTX Graphics card is preferable (Works with AMD cards and Macs click here)<br \/>\n\u2022 Preferred: 12 GB of VRAM for processing videos.<br \/>\n\u2022 Allocate 50-80 GB of storage for outputs.<\/p>\n<p>Tip: If your PC doesn\u2019t meet these requirements, consider using Shadow Tech. It\u2019s a remote PC service I personally use, providing an NVIDIA 1080 GPU, ample storage, and 12 GB VRAM for about $40\/month.<\/p>\n<p>3. Software Dependencies<\/p>\n<p>\u2022 Git: Allows you to pull extensions from GitHub. Download here.<br \/>\n\u2022 FFmpeg: Essential for encoding videos. Download here.<\/p>\n<p>4. Installing ComfyUI &amp; comfyUIManager<\/p>\n<p>1. Visit the ComfyUI GitHub page.<br \/>\n2. Under the \u201cInstalling\u201d section, select the \u201cDirect link to download\u201d for the standalone portable version.<br \/>\n3. Once downloaded, extract the files to your chosen directory.<br \/>\n4. For ComfyUI models:<br \/>\n\u2022 Checkpoints: Download from civitai.com and place in the checkpoints folder.<br \/>\n\u2022 VAE: Download from Stability AI\u2019s hugging face website and place in the vae folder.<br \/>\n5. Install ComfyUI Manager from the civitAI page for easy updates and add-on installations.<\/p>\n<p>5. Basic Workflow Overview<\/p>\n<p>\u2022 ComfyUI operates like a circuit board, with nodes representing each process.<br \/>\n\u2022 Start with the Load Checkpoints node, input your positive and negative prompts, and proceed to the K Sampler.<br \/>\n\u2022 The Latent Image Node determines your image dimensions and batch size.<br \/>\n\u2022 The VAE Decode node processes the final image.<\/p>\n<p>Pro Tip: Images created in ComfyUI can be dragged and dropped back into the system to load their respective node layouts.<\/p>\n<p>Here&#8217;s the continuation of the tutorial based on the provided transcript:<\/p>\n<p>&#8212;<\/p>\n<p>## **6. Installing Motion Models**<\/p>\n<p>1. In ComfyUI Manager, go to **Install Models**.<br \/>\n2. Type &#8220;mm&#8221; in the search box, which stands for motion models.<br \/>\n3. Download and install **Motion Model version 14**, **version 15**, and **version 15 uncore 2**. The high and mid variants are also recommended.<br \/>\n4. After downloading, you should see a confirmation message.<\/p>\n<p>## **7. Installing Control Net**<\/p>\n<p>1. Still in the ComfyUI Manager, search for &#8220;control net&#8221;.<br \/>\n2. Locate and install **Stable Diffusion 1.5**. You might need to scroll down the list.<br \/>\n3. Install other control nets like **Line Artarts** and **Open Pose** as needed, ensuring you have enough storage.<\/p>\n<p>**Note:** After installing, close all instances of the manager and ComfyUI. When reopening ComfyUI, it will automatically install the nodes and extensions you&#8217;ve selected.<\/p>\n<p>## **8. Utilizing Pre-Made Templates**<\/p>\n<p>1. Visit **cinka dink&#8217;s GitHub page**. He offers pre-made templates for Animate Evolve.<br \/>\n2. Download a workflow, drag, and drop it into ComfyUI to load the node layout.<br \/>\n3. If you encounter missing nodes (highlighted in red), simply go to the manager and click on **Install Missing Nodes**.<\/p>\n<p>## **9. Running Workflows**<\/p>\n<p>1. Use the **Load Checkpoints** node, followed by **Clip Setting**, **Positive Prompt**, and **Negative Prompt**.<br \/>\n2. The **K Sampler** determines sampling, while **Animate Diff Loader** adds motion.<br \/>\n3. Adjust settings such as image dimensions, batch size, and motion model as needed.<br \/>\n4. For advanced users, experiment with nodes like **Animate Diff Uniform Context Options** to enhance animations.<\/p>\n<p>## **10. Adding Laura for Enhanced Details**<\/p>\n<p>1. Double-click on an empty space in ComfyUI and search for **Laura**.<br \/>\n2. Select the **Laur Loader** and connect it as shown in the workflow.<br \/>\n3. Adjust the **Strength Model** to reduce the risk of artifacts.<br \/>\n4. Run the prompt and observe the enhanced details in the generated animation.<\/p>\n<p>## **11. Video to Video Animations Workflow**<\/p>\n<p>1. Use **Inner Reflections&#8217;** guide as a template for video-to-video animations.<br \/>\n2. For video inputs, use the **Video Load Node**.<br \/>\n3. Adjust settings like frame load cap, skip first frames, and select every M frame to customize the video output.<br \/>\n4. Use **Load Checkpoint** to select your desired model.<br \/>\n5. Implement control nets, like **Line Art**, to guide the animation style.<br \/>\n6. Experiment with different nodes and settings to achieve unique video outputs.<\/p>\n<p>## **12. Exploring Other Templates**<\/p>\n<p>1. Another great template to explore is **Prompt Scheduling**, which allows dynamic prompt changes over time.<br \/>\n2. This feature can be used to create evolving animations, adding depth to your projects.<\/p>\n<p>&#8212;<\/p>\n<p>**Conclusion**<\/p>\n<p>Thank you for following along! With ComfyUI, the possibilities are vast, allowing for creative freedom and intricate animations. A written version of this tutorial is available on the Prompt Muse website. Feel free to reach out on social media @promptMuse for further assistance.<\/p>\n<p>Remember: Art is a journey, and every masterpiece begins with the decision to try. Dive in and explore the world of ComfyUI and Animate Evolve!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Hello there, Prompt Muse here! In this comprehensive guide, I\u2019ll walk you through the essentials of setting up ComfyUI and Animate Diff Evolve. 1. Introduction \u2022 ComfyUI offers a node-based layout, allowing for a streamlined workspace tailored to your needs.mm \u2022 Drag and drop features for images and workflows enhance ease of use. \u2022 This<\/p>\n","protected":false},"author":2,"featured_media":3109,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[30,12],"tags":[699],"featured_image_src":"https:\/\/promptmuse.com\/wp-content\/uploads\/2023\/10\/IMG_3046.jpeg","blog_images":{"medium":"https:\/\/promptmuse.com\/wp-content\/uploads\/2023\/10\/IMG_3046-300x225.jpeg","large":"https:\/\/promptmuse.com\/wp-content\/uploads\/2023\/10\/IMG_3046.jpeg"},"acf":[],"ams_acf":[{"key":"video_url","label":"Video URL","value":""}],"_links":{"self":[{"href":"https:\/\/promptmuse.com\/wp-json\/wp\/v2\/posts\/3108"}],"collection":[{"href":"https:\/\/promptmuse.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/promptmuse.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/promptmuse.com\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/promptmuse.com\/wp-json\/wp\/v2\/comments?post=3108"}],"version-history":[{"count":0,"href":"https:\/\/promptmuse.com\/wp-json\/wp\/v2\/posts\/3108\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/promptmuse.com\/wp-json\/wp\/v2\/media\/3109"}],"wp:attachment":[{"href":"https:\/\/promptmuse.com\/wp-json\/wp\/v2\/media?parent=3108"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/promptmuse.com\/wp-json\/wp\/v2\/categories?post=3108"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/promptmuse.com\/wp-json\/wp\/v2\/tags?post=3108"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}