Latest Tutorials

Learn about the latest technologies from fellow newline community members!

  • React
  • Angular
  • Vue
  • Svelte
  • NextJS
  • Redux
  • Apollo
  • Storybook
  • D3
  • Testing Library
  • JavaScript
  • TypeScript
  • Node.js
  • Deno
  • Rust
  • Python
  • GraphQL
  • React
  • Angular
  • Vue
  • Svelte
  • NextJS
  • Redux
  • Apollo
  • Storybook
  • D3
  • Testing Library
  • JavaScript
  • TypeScript
  • Node.js
  • Deno
  • Rust
  • Python
  • GraphQL

    Pipeline Parallelism in Practice: Step‑by‑Step Guide

    Pipeline parallelism splits large deep learning models across multiple devices to optimize memory and compute efficiency. This technique partitions models into stages, enabling parallel execution of layers while managing data flow between devices. Below is a structured overview of key…
    Thumbnail Image of Tutorial Pipeline Parallelism in Practice: Step‑by‑Step Guide
    Image of Author Dr. Dipen
    Dr. Dipen
    I am an AI/ML researcher with 150+ citations and 16 published research papers. I have three tier-1 publications, including Internet of Things (Elsevier), Biomedical Signal Processing and Control (Elsevier), and IEEE Access. In my research journey, I have collaborated with NASA Glenn Research Center, Cleveland Clinic, and the U.S. Department of Energy for various research projects. I am also an official reviewer and have reviewed over 100 research papers for Elsevier, IEEE Transactions, ICRA, MDPI, and other top journals and conferences. I hold a PhD from Cleveland State University with a focus on large language models (LLMs) in cybersecurity, and I also earned a master’s degree in informatics from Northeastern University.
    •Last Updated:
    00
    Read Full Article

      Optimizing Pipeline Parallelism for Large‑Scale Models

      Watch: Efficient Large-Scale Language Model Training on GPU Clusters by Databricks Optimizing pipeline parallelism involves selecting the right technique for your use case and balancing trade-offs between complexity, latency, and throughput. Below is a structured breakdown of key considerations:…
      Thumbnail Image of Tutorial Optimizing Pipeline Parallelism for Large‑Scale Models
      Image of Author Dr. Dipen
      Dr. Dipen
      I am an AI/ML researcher with 150+ citations and 16 published research papers. I have three tier-1 publications, including Internet of Things (Elsevier), Biomedical Signal Processing and Control (Elsevier), and IEEE Access. In my research journey, I have collaborated with NASA Glenn Research Center, Cleveland Clinic, and the U.S. Department of Energy for various research projects. I am also an official reviewer and have reviewed over 100 research papers for Elsevier, IEEE Transactions, ICRA, MDPI, and other top journals and conferences. I hold a PhD from Cleveland State University with a focus on large language models (LLMs) in cybersecurity, and I also earned a master’s degree in informatics from Northeastern University.
      •Last Updated:
      00
      Read Full Article

      I got a job offer, thanks in a big part to your teaching. They sent a test as part of the interview process, and this was a huge help to implement my own Node server.

      This has been a really good investment!

      Advance your career with newline Pro.

      Only $40 per month for unlimited access to over 60+ books, guides and courses!

      Learn More

        Pipeline Parallelism for Faster LLM Inference

        Pipeline parallelism splits a model’s layers into sequential chunks, assigning each to separate devices to optimize large language model (LLM) inference. This approach improves throughput by overlapping computation and communication, reducing idle time across hardware. Below is a structured…
        Thumbnail Image of Tutorial Pipeline Parallelism for Faster LLM Inference
        Image of Author Dr. Dipen
        Dr. Dipen
        I am an AI/ML researcher with 150+ citations and 16 published research papers. I have three tier-1 publications, including Internet of Things (Elsevier), Biomedical Signal Processing and Control (Elsevier), and IEEE Access. In my research journey, I have collaborated with NASA Glenn Research Center, Cleveland Clinic, and the U.S. Department of Energy for various research projects. I am also an official reviewer and have reviewed over 100 research papers for Elsevier, IEEE Transactions, ICRA, MDPI, and other top journals and conferences. I hold a PhD from Cleveland State University with a focus on large language models (LLMs) in cybersecurity, and I also earned a master’s degree in informatics from Northeastern University.
        •Last Updated:
        00
        Read Full Article

          Diffusion Transformer Checklist: Build Stable Models

          Building stable Diffusion Transformer models requires balancing architecture choices, optimization strategies, and practical implementation timelines. This section breaks down the critical factors for developers aiming to deploy efficient and reliable systems. A comparison of three prominent…
          Thumbnail Image of Tutorial Diffusion Transformer Checklist: Build Stable Models
          Image of Author Dr. Dipen
          Dr. Dipen
          I am an AI/ML researcher with 150+ citations and 16 published research papers. I have three tier-1 publications, including Internet of Things (Elsevier), Biomedical Signal Processing and Control (Elsevier), and IEEE Access. In my research journey, I have collaborated with NASA Glenn Research Center, Cleveland Clinic, and the U.S. Department of Energy for various research projects. I am also an official reviewer and have reviewed over 100 research papers for Elsevier, IEEE Transactions, ICRA, MDPI, and other top journals and conferences. I hold a PhD from Cleveland State University with a focus on large language models (LLMs) in cybersecurity, and I also earned a master’s degree in informatics from Northeastern University.
          •Last Updated:
          00
          Read Full Article

            Tensor Parallelism vs Data Parallelism: Which Scales Better?

            Watch: Model Parallelism vs Data Parallelism vs Tensor Parallelism | #deeplearning #llms by Lazy Analyst When choosing between Tensor Parallelism (TP) and Data Parallelism (DP), the decision hinges on model size, data volume, and infrastructure constraints. Below is a structured comparison to…
            Thumbnail Image of Tutorial Tensor Parallelism vs Data Parallelism: Which Scales Better?
            Image of Author Dr. Dipen
            Dr. Dipen
            I am an AI/ML researcher with 150+ citations and 16 published research papers. I have three tier-1 publications, including Internet of Things (Elsevier), Biomedical Signal Processing and Control (Elsevier), and IEEE Access. In my research journey, I have collaborated with NASA Glenn Research Center, Cleveland Clinic, and the U.S. Department of Energy for various research projects. I am also an official reviewer and have reviewed over 100 research papers for Elsevier, IEEE Transactions, ICRA, MDPI, and other top journals and conferences. I hold a PhD from Cleveland State University with a focus on large language models (LLMs) in cybersecurity, and I also earned a master’s degree in informatics from Northeastern University.
            •Last Updated:
            00
            Read Full Article

            Email Newsletter

            Free tutorials and tips delivered every week.

            Trusted by 100,000+ developers!

            Popular Topics