Memory issue with full gw claculation

Various technical topics such as parallelism and efficiency, netCDF problems, the Yambo code structure itself, are posted here.

Moderators: Davide Sangalli, andrea.ferretti, myrta gruning, andrea marini, Daniele Varsano, Conor Hogan, Nicola Spallanzani

Post Reply
Ponnappa
Posts: 20
Joined: Sat Sep 07, 2024 7:26 pm

Memory issue with full gw claculation

Post by Ponnappa » Tue Oct 08, 2024 12:17 pm

Dear Yambo Developers and Users,

I am facing memory issues when considering full GW band structure. I have access to 4 nodes with 32 cpu each. I have tried various staterigies to parallelize with c and v but keep getting the same issue(I also face same problem in first step of BSE calculaiton). I am attaching the r_setup
r_setup.txt
, input file
gw.in.txt
and the LOG file
l-jdir_HF_and_locXC_gw0_dyson_rim_cut_em1d_ppa_el_el_corr_CPU_1.txt
. I face the memory issue very often. I would request you to help me in getting insights about best stratergies to parallelize and solve the issue. Thank you in advance.

Regards,
Ponnappa K P
You do not have the required permissions to view the files attached to this post.
Ponnappa K. P.
Phd Student
Harish Chadra Research Institute, India

User avatar
Daniele Varsano
Posts: 4198
Joined: Tue Mar 17, 2009 2:23 pm
Contact:

Re: Memory issue with full gw claculation

Post by Daniele Varsano » Tue Oct 08, 2024 12:37 pm

Dear Ponappa,

in order to distribute memory efficiently, you can set something like:

Code: Select all

X_and_IO_CPU= "1 1 1 12 10"                 # [PARALLEL] CPUs for each role
X_and_IO_ROLEs= "q,g,k,c,v"               # [PARALLEL] CPUs roles (q,g,k,c,v)
running with 120 code. If this is not enough you need to run with fewer cpus per node, allowing in this way more memory per mpi-task.

Also note that you cannot set in "b" more CPU than the ones indicate in GbndRnge:

Code: Select all

SE_CPU= "1 1 128"                       # [PARALLEL] CPUs for each role
SE_ROLEs= "q,qp,b"     
Best,
Daniele
Dr. Daniele Varsano
S3-CNR Institute of Nanoscience and MaX Center, Italy
MaX - Materials design at the Exascale
http://www.nano.cnr.it
http://www.max-centre.eu/

Post Reply