Too many files in the SAVE directory

Various technical topics such as parallelism and efficiency, netCDF problems, the Yambo code structure itself, are posted here.

Moderators: Davide Sangalli, andrea.ferretti, myrta gruning, andrea marini, Daniele Varsano, Conor Hogan, Nicola Spallanzani

Post Reply
javad
Posts: 42
Joined: Fri Feb 28, 2014 10:23 pm

Too many files in the SAVE directory

Post by javad » Wed Sep 16, 2015 4:18 pm

Dear yambo developers

I'm performing different BSE calculations with Yambo, to check parameters and so on, but I have a problem.

When I try to erase the old files in the SAVE folder, doing

Code: Select all

rm SAVE/ndb.BS*
I get the error message

Code: Select all

bash: /bin/rm: Argument list too long
it there a way to generate less files in the SAVE folder?

Javad
Javad Exirifard
IPM - Institute for Research in Fundamental Sciences
P. O. Box 19395-5746
Niavaran Square
Tehran, Iran

User avatar
Daniele Varsano
Posts: 3816
Joined: Tue Mar 17, 2009 2:23 pm
Contact:

Re: Too many files in the SAVE directory

Post by Daniele Varsano » Wed Sep 16, 2015 4:37 pm

Dear Javad,

This is a known problem, here some workarounds:


Solution 1: Parallelize the BSE over the K-points e.g.:

Code: Select all

BS_CPU= "16 1 1"              # [PARALLEL] CPUs for each role
BS_ROLEs= "k eh t"  
Solution 2: Avoid to write database on file:

Code: Select all

DBsIOoff="BS"
Solution 1, the more cpu you use, lesser files you will have in the SAVE dir.
Solution 2, preferred. Any file will be written on disk, so you have to diagonalize it on the same run. Drawbacks, any restart is possible.

In an internal devel version we have implemented a way to soften this problem by avoiding this huge fragmentation. We will insert it in the release very soon.

Best,

Daniele
Dr. Daniele Varsano
S3-CNR Institute of Nanoscience and MaX Center, Italy
MaX - Materials design at the Exascale
http://www.nano.cnr.it
http://www.max-centre.eu/

User avatar
Davide Sangalli
Posts: 614
Joined: Tue May 29, 2012 4:49 pm
Location: Via Salaria Km 29.3, CP 10, 00016, Monterotondo Stazione, Italy
Contact:

Re: Too many files in the SAVE directory

Post by Davide Sangalli » Wed Sep 16, 2015 4:59 pm

Dear Javad,
another quick suggestion which may help is to run yambo with the -J JOBNAME option.
In this way the run will create a folder named JOBANAME and put there all the ndb.BS* files
Thus to erase them you can simply run: rm -r JOBNAME

This will avoid the problem.

Best,
D.
Davide Sangalli, PhD
CNR-ISM, Division of Ultrafast Processes in Materials (FLASHit) and MaX Centre
https://sites.google.com/view/davidesangalli
http://www.max-centre.eu/

Post Reply