Alexander Swerdlow

Results 32 comments of Alexander Swerdlow

For some context, this is the [launcher](https://github.com/facebookincubator/submitit) I'm referencing, but it doesn't do anything very special. At the end of the day it just writes a sbatch script that amounts...

For sure: ``` #!/bin/bash # Parameters #SBATCH --comment=commenthere #SBATCH --constraint=A5000 #SBATCH --cpus-per-task=8 #SBATCH --gpus-per-node=8 #SBATCH --job-name=main #SBATCH --mem=320GB #SBATCH --nodes=1 #SBATCH --ntasks-per-node=8 #SBATCH --open-mode=append #SBATCH --output=/folderpath2024_07_09/13_57_03/%j/%j_0_log.out #SBATCH --partition=all #SBATCH --signal=USR2@900...

Hi! You can comment out that second dataset [BEVs from Metadrive] and just train on nuScenes as long as you don't plan on using Metadrive generated BEV maps at inference...

Hi! Just to be clear, are you asking for code that goes from BEV map -> First-person view [e.g., car cameras] with the segmentation of objects/map [see the image below,...

Hey! Unfortunately, I wasn't able to find my code, but you could use something like this for argoverse 2: https://github.com/argoverse/argoverse-api/blob/master/demo_usage/argoverse_map_tutorial.ipynb

There should be a warning/exception for non-supported types to prevent this issue.

Same here — using a head dim of 256 in fp16 fwd/bwd

I haven't confirmed this, but the lack of speedup may be in part due to the contiguous requirement (#1087) as when I am benchmarking, I am comparing to using FA2...

Hm, I was just compiling with the most recent commit (3f1b4d38) and despite the `maybe_contiguous`, I found that I got an `Input tensors must be contiguous` error (like [this comment](https://github.com/Lightning-AI/lightning-thunder/pull/882#discussion_r1699226399)...

Thanks! Just pulled and was able to run it without the forced `.contiguous()`. I'll note [mainly for other users, if they run into it] that I found `flash_attn_qkvpacked_func` [FA2] to...