Error of out-of-memory
Moderators: Davide Sangalli, andrea.ferretti, myrta gruning, andrea marini, Daniele Varsano, Conor Hogan
-
- Posts: 44
- Joined: Wed May 06, 2020 9:43 am
- Contact:
Error of out-of-memory
Dear Developers,
I'm trying to perform the GW (real-axis) calculations by using Yambo (Version 5.0.0). I am working on a server with the information below.
-------------------------------------
Server Information:
---------------------------------
Pool Memory Cpus
---------------------------------
sardalya 256000Mb 28
barbun 384000Mb 40
-------------------------------------
I started a GW calculation by using the 28 cores. But my calculation stopped with an insufficient memory problem.
How can I set the SE_ROLEs part?
Do you have any suggestions to overcome such a problem? Thanks.
Best regards.
Zafer
I am attaching all the logic, report, slurm-jobid.err and slurm-jobid.out files for my calculation.
I also attached input file for my calculation.
I'm trying to perform the GW (real-axis) calculations by using Yambo (Version 5.0.0). I am working on a server with the information below.
-------------------------------------
Server Information:
---------------------------------
Pool Memory Cpus
---------------------------------
sardalya 256000Mb 28
barbun 384000Mb 40
-------------------------------------
I started a GW calculation by using the 28 cores. But my calculation stopped with an insufficient memory problem.
How can I set the SE_ROLEs part?
Do you have any suggestions to overcome such a problem? Thanks.
Best regards.
Zafer
I am attaching all the logic, report, slurm-jobid.err and slurm-jobid.out files for my calculation.
I also attached input file for my calculation.
You do not have the required permissions to view the files attached to this post.
Last edited by Zafer Kandemir on Sun Apr 25, 2021 6:39 am, edited 1 time in total.
Dr. Zafer Kandemir
Postdoctoral Researcher
Faculty of Engineering and Natural Sciences, Sabanci University
34956 Istanbul, Turkey
Postdoctoral Researcher
Faculty of Engineering and Natural Sciences, Sabanci University
34956 Istanbul, Turkey
- claudio
- Posts: 534
- Joined: Tue Mar 31, 2009 11:33 pm
- Location: Marseille
- Contact:
Re: Error of out-of-memory
Dear Zafer
please add the Yambo input file used for the calculation.
A possible strategy to decrease the amount of memery in the GW is to put all parallelization
on the "G bands" , and do not parallelize on the Quasiparticle.
best
Claudio
please add the Yambo input file used for the calculation.
A possible strategy to decrease the amount of memery in the GW is to put all parallelization
on the "G bands" , and do not parallelize on the Quasiparticle.
best
Claudio
Claudio Attaccalite
[CNRS/ Aix-Marseille Université/ CINaM laborarory / TSN department
Campus de Luminy – Case 913
13288 MARSEILLE Cedex 09
web site: http://www.attaccalite.com
[CNRS/ Aix-Marseille Université/ CINaM laborarory / TSN department
Campus de Luminy – Case 913
13288 MARSEILLE Cedex 09
web site: http://www.attaccalite.com
-
- Posts: 44
- Joined: Wed May 06, 2020 9:43 am
- Contact:
Re: Error of out-of-memory
Dear Claudio,
Thank you for your advice. I added the Yambo input file.
Thank you for your advice. I added the Yambo input file.
Dr. Zafer Kandemir
Postdoctoral Researcher
Faculty of Engineering and Natural Sciences, Sabanci University
34956 Istanbul, Turkey
Postdoctoral Researcher
Faculty of Engineering and Natural Sciences, Sabanci University
34956 Istanbul, Turkey
- Daniele Varsano
- Posts: 4231
- Joined: Tue Mar 17, 2009 2:23 pm
- Contact:
Re: Error of out-of-memory
Dear Zafer,
the input file is not attached.
In order to upload it you need to rename it adding a supported suffix (e.g. .txt)
Best,
Daniele
the input file is not attached.
In order to upload it you need to rename it adding a supported suffix (e.g. .txt)
Best,
Daniele
Dr. Daniele Varsano
S3-CNR Institute of Nanoscience and MaX Center, Italy
MaX - Materials design at the Exascale
http://www.nano.cnr.it
http://www.max-centre.eu/
S3-CNR Institute of Nanoscience and MaX Center, Italy
MaX - Materials design at the Exascale
http://www.nano.cnr.it
http://www.max-centre.eu/
-
- Posts: 44
- Joined: Wed May 06, 2020 9:43 am
- Contact:
Re: Error of out-of-memory
Dear Daniele,
I edited the first post and attached the input file. I added it here again. Thanks.
Zafer
I edited the first post and attached the input file. I added it here again. Thanks.
Zafer
You do not have the required permissions to view the files attached to this post.
Dr. Zafer Kandemir
Postdoctoral Researcher
Faculty of Engineering and Natural Sciences, Sabanci University
34956 Istanbul, Turkey
Postdoctoral Researcher
Faculty of Engineering and Natural Sciences, Sabanci University
34956 Istanbul, Turkey
- Daniele Varsano
- Posts: 4231
- Joined: Tue Mar 17, 2009 2:23 pm
- Contact:
Re: Error of out-of-memory
Dear Zafer,
real-axis calculations are extremely heavy, also because it is not guaranteed that 100 frequencies are enough to get converged results.
Usually plasmon-pole approximation works very well.
Anyway, if you need to go through a real axis calculation, as Claudio said, my suggestion is to parallelise over bands:
SE_CPU="1.1.28"
SE_ROLEs="q.qp.b"
and next split your calculation in several runs e.g:
first run:
second run
etc.
renaming te ndb.QP database of each run, or assigning a different label, at the end you can build a single database using ypp to merge them.
Best,
Daniele
real-axis calculations are extremely heavy, also because it is not guaranteed that 100 frequencies are enough to get converged results.
Usually plasmon-pole approximation works very well.
Anyway, if you need to go through a real axis calculation, as Claudio said, my suggestion is to parallelise over bands:
SE_CPU="1.1.28"
SE_ROLEs="q.qp.b"
and next split your calculation in several runs e.g:
first run:
Code: Select all
%QPkrange # [GW] QP generalized Kpoint/Band indices
1|10|27|30|
%
Code: Select all
%QPkrange # [GW] QP generalized Kpoint/Band indices
11|20|27|30|
%
renaming te ndb.QP database of each run, or assigning a different label, at the end you can build a single database using ypp to merge them.
Best,
Daniele
Dr. Daniele Varsano
S3-CNR Institute of Nanoscience and MaX Center, Italy
MaX - Materials design at the Exascale
http://www.nano.cnr.it
http://www.max-centre.eu/
S3-CNR Institute of Nanoscience and MaX Center, Italy
MaX - Materials design at the Exascale
http://www.nano.cnr.it
http://www.max-centre.eu/
-
- Posts: 44
- Joined: Wed May 06, 2020 9:43 am
- Contact:
Re: Error of out-of-memory
Dear Daniele,
Thank you very much for your advice. I read the topics "Merging databases" and "Splitting a GW run then merge the database" about ypp. I will try it.
Best regards.
Zafer
Thank you very much for your advice. I read the topics "Merging databases" and "Splitting a GW run then merge the database" about ypp. I will try it.
Best regards.
Zafer
Dr. Zafer Kandemir
Postdoctoral Researcher
Faculty of Engineering and Natural Sciences, Sabanci University
34956 Istanbul, Turkey
Postdoctoral Researcher
Faculty of Engineering and Natural Sciences, Sabanci University
34956 Istanbul, Turkey