Sachin Bharadwaj M

Hey Terry ! As far as my experience with TorchFort is concerned, the developers have created a few combinations of dimensions for state, action, reward and so on. Suppose if...

As per your comments I assume your state array is 2D and action is 1D. I also assume you have 16384 data samples. Since, Fortran follows column majoring, input arrays...

Hi @romerojosh ! Thanks for your reply. As a future step, I wanted to run multiple CFD simulations, each having multiple agents, to train the same RL model. Otherwise, for...

I will wait for a response from @azrael417 regarding the multi-env / multi-agent. 1. By running multiple independent models concurrently, do you mean each MPI process is having it's own...

I am trying to reproduce https://www.nature.com/articles/s41467-022-28957-7 using TorchFort and https://github.com/ExtremeFLOW/neko. From our previous discussions (https://github.com/NVIDIA/TorchFort/issues/48), it was suggested to use MARL via the multi-environment mechanism. The setup is for wall-modelled...

I am using the following functions currently: torchfort_rl_off_policy_create_system, predict, update_replay_buffer, train_step. I am passing s,a,r,s' with their leading dimension equal to number of agents and giving n_envs parameter under replay_buffer...

Just to clarify, if I want to run on the HPC cluster with just CPUs cores, Suppose, number of compute nodes per job = 1 (single node) and CPU cores...

Hi Thorsten, The MPI_Gatherv implementation on rank 0 worked ! By collecting global (s,a,r,s') arrays from all ranks, I've eliminated the uneven agent distribution problem entirely. The replay buffer updates...

I am collecting 100 timesteps of simulation data (s_1, a_1 , r_1, s'_1) ... (s_100, a_100, r_100, s'_100) which is equivalent to one episode (as terminal state is reached) and...

sure, I'm using off-policy Soft-Actor-Critic for my training. I'm having some problems relating to normalization of the state and reward... We had previously discussed about this (https://github.com/NVIDIA/TorchFort/issues/48#issuecomment-2969989589)... Suppose my states...