Latest Tutorials

Learn about the latest technologies from fellow newline community members!

  • React
  • Angular
  • Vue
  • Svelte
  • NextJS
  • Redux
  • Apollo
  • Storybook
  • D3
  • Testing Library
  • JavaScript
  • TypeScript
  • Node.js
  • Deno
  • Rust
  • Python
  • GraphQL
  • React
  • Angular
  • Vue
  • Svelte
  • NextJS
  • Redux
  • Apollo
  • Storybook
  • D3
  • Testing Library
  • JavaScript
  • TypeScript
  • Node.js
  • Deno
  • Rust
  • Python
  • GraphQL

    Tensor Parallelism vs Data Parallelism: Which Scales Better?

    Watch: Model Parallelism vs Data Parallelism vs Tensor Parallelism | #deeplearning #llms by Lazy Analyst When choosing between Tensor Parallelism (TP) and Data Parallelism (DP), the decision hinges on model size, data volume, and infrastructure constraints. Below is a structured comparison to…
    Thumbnail Image of Tutorial Tensor Parallelism vs Data Parallelism: Which Scales Better?
    Image of Author Dr. Dipen
    Dr. Dipen
    I am an AI/ML researcher with 150+ citations and 16 published research papers. I have three tier-1 publications, including Internet of Things (Elsevier), Biomedical Signal Processing and Control (Elsevier), and IEEE Access. In my research journey, I have collaborated with NASA Glenn Research Center, Cleveland Clinic, and the U.S. Department of Energy for various research projects. I am also an official reviewer and have reviewed over 100 research papers for Elsevier, IEEE Transactions, ICRA, MDPI, and other top journals and conferences. I hold a PhD from Cleveland State University with a focus on large language models (LLMs) in cybersecurity, and I also earned a master’s degree in informatics from Northeastern University.
    •Last Updated:
    00
    Read Full Article

      Top 5 Pipeline Parallelism Techniques for LLMs

      Looking at the comparison overview table, each technique is listed with a real-world use case. For example, Tensor Parallelism mentions NVIDIA's Megatron-LM. There's a section titled "Technique 1: Tensor Parallelism with Megatron-LM," so I can reference that. Similarly, ZeRO Pipeline Parallelism is…
      Thumbnail Image of Tutorial Top 5 Pipeline Parallelism Techniques for LLMs
      Image of Author Dr. Dipen
      Dr. Dipen
      I am an AI/ML researcher with 150+ citations and 16 published research papers. I have three tier-1 publications, including Internet of Things (Elsevier), Biomedical Signal Processing and Control (Elsevier), and IEEE Access. In my research journey, I have collaborated with NASA Glenn Research Center, Cleveland Clinic, and the U.S. Department of Energy for various research projects. I am also an official reviewer and have reviewed over 100 research papers for Elsevier, IEEE Transactions, ICRA, MDPI, and other top journals and conferences. I hold a PhD from Cleveland State University with a focus on large language models (LLMs) in cybersecurity, and I also earned a master’s degree in informatics from Northeastern University.
      •Last Updated:
      00
      Read Full Article

      I got a job offer, thanks in a big part to your teaching. They sent a test as part of the interview process, and this was a huge help to implement my own Node server.

      This has been a really good investment!

      Advance your career with newline Pro.

      Only $40 per month for unlimited access to over 60+ books, guides and courses!

      Learn More

        What Is Pipeline Parallelism and How to Use It

        Pipeline parallelism divides neural network layers across multiple GPUs, enabling simultaneous computation and memory reuse. This technique contrasts sharply with sequential processing, where each GPU waits for the previous to finish before starting its task. Below is a structured comparison of…
        Thumbnail Image of Tutorial What Is Pipeline Parallelism and How to Use It
        Image of Author Dr. Dipen
        Dr. Dipen
        I am an AI/ML researcher with 150+ citations and 16 published research papers. I have three tier-1 publications, including Internet of Things (Elsevier), Biomedical Signal Processing and Control (Elsevier), and IEEE Access. In my research journey, I have collaborated with NASA Glenn Research Center, Cleveland Clinic, and the U.S. Department of Energy for various research projects. I am also an official reviewer and have reviewed over 100 research papers for Elsevier, IEEE Transactions, ICRA, MDPI, and other top journals and conferences. I hold a PhD from Cleveland State University with a focus on large language models (LLMs) in cybersecurity, and I also earned a master’s degree in informatics from Northeastern University.
        •Last Updated:
        00
        Read Full Article

          Prompt Tuning vs Fine‑Tuning: Which Yields Faster Results?

          When choosing between prompt tuning and fine-tuning, developers must weigh tradeoffs in speed, complexity, and performance. Below is a structured comparison to guide decisions.. For hands-on practice with both techniques, platforms like newline.co offer structured courses covering prompt…
          Thumbnail Image of Tutorial Prompt Tuning vs Fine‑Tuning: Which Yields Faster Results?
          Image of Author Dr. Dipen
          Dr. Dipen
          I am an AI/ML researcher with 150+ citations and 16 published research papers. I have three tier-1 publications, including Internet of Things (Elsevier), Biomedical Signal Processing and Control (Elsevier), and IEEE Access. In my research journey, I have collaborated with NASA Glenn Research Center, Cleveland Clinic, and the U.S. Department of Energy for various research projects. I am also an official reviewer and have reviewed over 100 research papers for Elsevier, IEEE Transactions, ICRA, MDPI, and other top journals and conferences. I hold a PhD from Cleveland State University with a focus on large language models (LLMs) in cybersecurity, and I also earned a master’s degree in informatics from Northeastern University.
          •Last Updated:
          00
          Read Full Article

            How to Tune Prompts for LLM Accuracy: LLM as judge ?

            Watch: Fine-Tuning vs Prompt Engineering: Best Strategy for Domain-Specific LLM Accuracy | AgixTech by Agix Technologies Prompt tuning is a critical strategy for improving the accuracy of large language models (LLMs), with structured approaches and model-specific techniques yielding measurable…
            Thumbnail Image of Tutorial How to Tune Prompts for LLM Accuracy: LLM as judge ?
            Image of Author Dr. Dipen
            Dr. Dipen
            I am an AI/ML researcher with 150+ citations and 16 published research papers. I have three tier-1 publications, including Internet of Things (Elsevier), Biomedical Signal Processing and Control (Elsevier), and IEEE Access. In my research journey, I have collaborated with NASA Glenn Research Center, Cleveland Clinic, and the U.S. Department of Energy for various research projects. I am also an official reviewer and have reviewed over 100 research papers for Elsevier, IEEE Transactions, ICRA, MDPI, and other top journals and conferences. I hold a PhD from Cleveland State University with a focus on large language models (LLMs) in cybersecurity, and I also earned a master’s degree in informatics from Northeastern University.
            •Last Updated:
            00
            Read Full Article

            Email Newsletter

            Free tutorials and tips delivered every week.

            Trusted by 100,000+ developers!

            Popular Topics