Discussions

• 1 You must be logged in to vote

  ⚡

  Use a pretrained model for training another model

  haertelkar asked Nov 9, 2024 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  0
• 2 You must be logged in to vote

  ⚡

  Log the same metric when using multiple dataloaders in validation_step()

  thangld201 asked Sep 13, 2023 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  1
• 8 You must be logged in to vote

  ⚡

  Gist on how to use Schedule-Free in Lightning

  CompRhys asked Apr 10, 2024 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  

  

  9
• 2 You must be logged in to vote

  ⚡

  self.global_step understanding

  ajinkyaambatwar asked Jun 16, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  

  

  3
• 6 You must be logged in to vote

  ⚡

  Timed out initializing process group in store based....

  EvanZ asked Nov 9, 2022 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  

  

  6
• 1 You must be logged in to vote

  🤖

  ddp_weakref is not set during the backward pass

  lokesh-vr-17773 asked Nov 4, 2024 in DDP / multi-GPU / multi-node · Unanswered

  

  

  0
• 7 You must be logged in to vote

  ⚡

  How to overwrite checkpoints with ModelCheckpoint

  nsabir2011 asked Nov 24, 2022 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  1
• 1 You must be logged in to vote

  ⚡

  What is trainer/global_step in wandb logging?

  edmcman asked Oct 30, 2024 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  1
• 3 You must be logged in to vote

  ⚡

  Gradient checkpointing with DDP in a loop

  shivammehta25 asked Nov 11, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  

  

  8
• 2 You must be logged in to vote

  🤖

  Optuna HPO & Lightning Multi-GPU Training using DDP on SLURM - ValueError: World Size does not Match

  eTuDpy asked May 30, 2024 in DDP / multi-GPU / multi-node · Unanswered

  

  

  

  

  4
• 1 You must be logged in to vote

  ⚡

  Exact behaviour of .prepare_data() and .setup() in LightningDataModule when passing DM or dataloaders to Trainer in respect to internal hooks.

  tiefenthaler asked Oct 29, 2024 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ⚡

  Active Learning Trainer

  BerAnton asked Oct 25, 2024 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🤖

  Collect Threads after Trainer.fit

  42elenz asked Oct 23, 2024 in DDP / multi-GPU / multi-node · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ⚡

  Logging in Multi - GPU and new on_validation_step function

  42elenz asked Oct 23, 2024 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🤖

  Both GPUs are getting same data from IterableDataset with DDP

  akshat-suwalka asked Jul 22, 2024 in DDP / multi-GPU / multi-node · Unanswered

  

  

  1
• 2 You must be logged in to vote

  🤖

  Collective mismatch at end of training epoch

  valtsblukis asked Aug 3, 2022 in DDP / multi-GPU / multi-node · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  ⚡

  Using sklearn data pre-processing pipelines inside LightningDataModule

  tiefenthaler asked Apr 23, 2024 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🤖

  Issue with ToTensor Transform and Multiprocessing in PyTorch Lightning

  DaniMlk asked Oct 15, 2024 in DDP / multi-GPU / multi-node · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Dataloader reinsertion for recursive predictionsrs

  leonardcaquot94 started Oct 11, 2024 in General

  

  

  0
• 8 You must be logged in to vote

  💬

  Conflict between Lightning and Huggingface Transformers (device_map).

  richarddwang started Jun 20, 2023 in General

  

  

  

  

  4
• 1 You must be logged in to vote

  ⚡

  I want to apply custom learning rate scheduler.

  sooftware asked Jun 19, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Answered

  

  

  

  

  11
• 10 You must be logged in to vote

  ⚡

  Multi-GPU Inference

  distributed Generic distributed-related topic callback: prediction writer trainer: predict

  ricardorei asked Sep 1, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  

  

  27
• 1 You must be logged in to vote

  ⚡

  Custom train loop to perform partial batch updates

  leonardcaquot94 asked Oct 4, 2024 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ⚡

  val loss and accuracy not logging

  gkrampah asked Oct 2, 2024 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  0
• 17 You must be logged in to vote

  ⚡

  All time taken by {method 'enable' of '_lsprof.Profiler' objects} in Advanced profiler output

  profiler

  SeguinBe asked Feb 7, 2022 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  

  

  9