Latest Tutorials

Learn about the latest technologies from fellow newline community members!

  • React
  • Angular
  • Vue
  • Svelte
  • NextJS
  • Redux
  • Apollo
  • Storybook
  • D3
  • Testing Library
  • JavaScript
  • TypeScript
  • Node.js
  • Deno
  • Rust
  • Python
  • GraphQL
  • React
  • Angular
  • Vue
  • Svelte
  • NextJS
  • Redux
  • Apollo
  • Storybook
  • D3
  • Testing Library
  • JavaScript
  • TypeScript
  • Node.js
  • Deno
  • Rust
  • Python
  • GraphQL

    Pipeline Parallelism vs Data Parallelism: Which Improves Throughput?

    Watch: I explain Fully Sharded Data Parallel (FSDP) and pipeline parallelism in 3D with Vision Pro by william falcon Pipeline parallelism and data parallelism are two strategies for optimizing computational workloads, particularly in deep learning and large-scale model training. The choice between…
    Thumbnail Image of Tutorial Pipeline Parallelism vs Data Parallelism: Which Improves Throughput?
    Image of Author Dr. Dipen
    Dr. Dipen
    I am an AI/ML researcher with 150+ citations and 16 published research papers. I have three tier-1 publications, including Internet of Things (Elsevier), Biomedical Signal Processing and Control (Elsevier), and IEEE Access. In my research journey, I have collaborated with NASA Glenn Research Center, Cleveland Clinic, and the U.S. Department of Energy for various research projects. I am also an official reviewer and have reviewed over 100 research papers for Elsevier, IEEE Transactions, ICRA, MDPI, and other top journals and conferences. I hold a PhD from Cleveland State University with a focus on large language models (LLMs) in cybersecurity, and I also earned a master’s degree in informatics from Northeastern University.
    •Last Updated:
    00
    Read Full Article

      Pipeline Parallelism in Practice: Step‑by‑Step Guide

      Pipeline parallelism splits large deep learning models across multiple devices to optimize memory and compute efficiency. This technique partitions models into stages, enabling parallel execution of layers while managing data flow between devices. Below is a structured overview of key…
      Thumbnail Image of Tutorial Pipeline Parallelism in Practice: Step‑by‑Step Guide
      Image of Author Dr. Dipen
      Dr. Dipen
      I am an AI/ML researcher with 150+ citations and 16 published research papers. I have three tier-1 publications, including Internet of Things (Elsevier), Biomedical Signal Processing and Control (Elsevier), and IEEE Access. In my research journey, I have collaborated with NASA Glenn Research Center, Cleveland Clinic, and the U.S. Department of Energy for various research projects. I am also an official reviewer and have reviewed over 100 research papers for Elsevier, IEEE Transactions, ICRA, MDPI, and other top journals and conferences. I hold a PhD from Cleveland State University with a focus on large language models (LLMs) in cybersecurity, and I also earned a master’s degree in informatics from Northeastern University.
      •Last Updated:
      00
      Read Full Article

      I got a job offer, thanks in a big part to your teaching. They sent a test as part of the interview process, and this was a huge help to implement my own Node server.

      This has been a really good investment!

      Advance your career with newline Pro.

      Only $40 per month for unlimited access to over 60+ books, guides and courses!

      Learn More

        Optimizing Pipeline Parallelism for Large‑Scale Models

        Watch: Efficient Large-Scale Language Model Training on GPU Clusters by Databricks Optimizing pipeline parallelism involves selecting the right technique for your use case and balancing trade-offs between complexity, latency, and throughput. Below is a structured breakdown of key considerations:…
        Thumbnail Image of Tutorial Optimizing Pipeline Parallelism for Large‑Scale Models
        Image of Author Dr. Dipen
        Dr. Dipen
        I am an AI/ML researcher with 150+ citations and 16 published research papers. I have three tier-1 publications, including Internet of Things (Elsevier), Biomedical Signal Processing and Control (Elsevier), and IEEE Access. In my research journey, I have collaborated with NASA Glenn Research Center, Cleveland Clinic, and the U.S. Department of Energy for various research projects. I am also an official reviewer and have reviewed over 100 research papers for Elsevier, IEEE Transactions, ICRA, MDPI, and other top journals and conferences. I hold a PhD from Cleveland State University with a focus on large language models (LLMs) in cybersecurity, and I also earned a master’s degree in informatics from Northeastern University.
        •Last Updated:
        00
        Read Full Article

          Pipeline Parallelism for Faster LLM Inference

          Pipeline parallelism splits a model’s layers into sequential chunks, assigning each to separate devices to optimize large language model (LLM) inference. This approach improves throughput by overlapping computation and communication, reducing idle time across hardware. Below is a structured…
          Thumbnail Image of Tutorial Pipeline Parallelism for Faster LLM Inference
          Image of Author Dr. Dipen
          Dr. Dipen
          I am an AI/ML researcher with 150+ citations and 16 published research papers. I have three tier-1 publications, including Internet of Things (Elsevier), Biomedical Signal Processing and Control (Elsevier), and IEEE Access. In my research journey, I have collaborated with NASA Glenn Research Center, Cleveland Clinic, and the U.S. Department of Energy for various research projects. I am also an official reviewer and have reviewed over 100 research papers for Elsevier, IEEE Transactions, ICRA, MDPI, and other top journals and conferences. I hold a PhD from Cleveland State University with a focus on large language models (LLMs) in cybersecurity, and I also earned a master’s degree in informatics from Northeastern University.
          •Last Updated:
          00
          Read Full Article

            Diffusion Transformer Checklist: Build Stable Models

            Building stable Diffusion Transformer models requires balancing architecture choices, optimization strategies, and practical implementation timelines. This section breaks down the critical factors for developers aiming to deploy efficient and reliable systems. A comparison of three prominent…
            Thumbnail Image of Tutorial Diffusion Transformer Checklist: Build Stable Models
            Image of Author Dr. Dipen
            Dr. Dipen
            I am an AI/ML researcher with 150+ citations and 16 published research papers. I have three tier-1 publications, including Internet of Things (Elsevier), Biomedical Signal Processing and Control (Elsevier), and IEEE Access. In my research journey, I have collaborated with NASA Glenn Research Center, Cleveland Clinic, and the U.S. Department of Energy for various research projects. I am also an official reviewer and have reviewed over 100 research papers for Elsevier, IEEE Transactions, ICRA, MDPI, and other top journals and conferences. I hold a PhD from Cleveland State University with a focus on large language models (LLMs) in cybersecurity, and I also earned a master’s degree in informatics from Northeastern University.
            •Last Updated:
            00
            Read Full Article

            Email Newsletter

            Free tutorials and tips delivered every week.

            Trusted by 100,000+ developers!

            Popular Topics