Error writing ndb.QP file during evGWo

You can find here problems arising when using old releases of Yambo (< 5.0). Issues as parallelization strategy, performance issues and other technical aspects.

Moderators: Davide Sangalli, andrea.ferretti, myrta gruning, andrea marini, Daniele Varsano, Conor Hogan

Locked
Bruno
Posts: 72
Joined: Tue Dec 08, 2020 11:16 am

Error writing ndb.QP file during evGWo

Post by Bruno » Sat Jan 23, 2021 12:00 pm

Hello!

I'm having problems running the evGWo calculation. The calculation runs fine until it ends the G3Wo and then it gives me the following error at the end of the log files l- :

<02h-22m> P1: [07.05] QP properties and I/O
P1: [ERROR] STOP signal received while in[07.05] QP properties and I/O
P1: [ERROR] Writing File ./gw_final//ndb.QP; Variable NOT DEFINED; Permission denied


Before that everything was being written fine. In anycase a tried to submit this calculation again and I got the exact same error also at the end of G3Wo. Is it something related to the yambo regarding maybe the file size? Or is it possible that it is something cluster related? I've never received this permission denied error before in yambo calculations, but this is my first evGWo one, so I suppose it is related to it somehow.

Regards,
MSc. Bruno Cucco
PhD Candidate
CNRS Institut des Sciences Chimiques de Rennes, France
Université de Rennes 1
https://iscr.univ-rennes1.fr

User avatar
claudio
Posts: 528
Joined: Tue Mar 31, 2009 11:33 pm
Location: Marseille
Contact:

Re: Error writing ndb.QP file during evGWo

Post by claudio » Sun Jan 24, 2021 9:09 am

Dear Bruno

I will check the code to see if there is a problem.
In the while I advice you to make a script and use the procedure described here

https://www.attaccalite.com/self-consis ... ambo-code/

for the self-consistent GW on G or on G and W.
The advantage of using an external script is that you can perform a restart, not implemented in the fortran loop of yambo.

best
Claudio
Claudio Attaccalite
[CNRS/ Aix-Marseille Université/ CINaM laborarory / TSN department
Campus de Luminy – Case 913
13288 MARSEILLE Cedex 09
web site: http://www.attaccalite.com

Bruno
Posts: 72
Joined: Tue Dec 08, 2020 11:16 am

Re: Error writing ndb.QP file during evGWo

Post by Bruno » Sun Jan 24, 2021 11:22 am

Hello!

Thank you very much for the suggestion Claudio, I'm doing that right now.

Regards,
MSc. Bruno Cucco
PhD Candidate
CNRS Institut des Sciences Chimiques de Rennes, France
Université de Rennes 1
https://iscr.univ-rennes1.fr

Bruno
Posts: 72
Joined: Tue Dec 08, 2020 11:16 am

Re: Error writing ndb.QP file during evGWo

Post by Bruno » Sun Jan 24, 2021 1:05 pm

Hello!

Just to make sure of one thing, during the actual evGW0 cycle the code does not recompute the EXS term right? Just the G0W0, G1W0... is that right?

Doing it by the mentioned manual way is it possible to prevent it to recompute this term? Because it takes quite a while. There is any file that I should be copying to another folder?

Regards,
MSc. Bruno Cucco
PhD Candidate
CNRS Institut des Sciences Chimiques de Rennes, France
Université de Rennes 1
https://iscr.univ-rennes1.fr

User avatar
Daniele Varsano
Posts: 4209
Joined: Tue Mar 17, 2009 2:23 pm
Contact:

Re: Error writing ndb.QP file during evGWo

Post by Daniele Varsano » Sun Jan 24, 2021 2:40 pm

Dear Bruno,
you can copy the ndb.HF* database in the SAVE directory, this will avoid to recompute the HF term.

Best,
Daniele
Dr. Daniele Varsano
S3-CNR Institute of Nanoscience and MaX Center, Italy
MaX - Materials design at the Exascale
http://www.nano.cnr.it
http://www.max-centre.eu/

Bruno
Posts: 72
Joined: Tue Dec 08, 2020 11:16 am

Re: Error writing ndb.QP file during evGWo

Post by Bruno » Sun Jan 24, 2021 3:28 pm

Dear Daniele,

Thank you very much!

Regards,
MSc. Bruno Cucco
PhD Candidate
CNRS Institut des Sciences Chimiques de Rennes, France
Université de Rennes 1
https://iscr.univ-rennes1.fr

Christian Koenig
Posts: 34
Joined: Mon Nov 18, 2019 10:48 am

Re: Error writing ndb.QP file during evGWo

Post by Christian Koenig » Tue Feb 16, 2021 11:29 am

Hi All,

Not sure if this issue is already solved, but I get a very similar issue.

I compiled version 5.0.0 on two different machines. On the first one,
as far as I can tell, the code seems to run without problems for G0W0.
Unfortunately, I don't have access to this machine in the moment
and I can't verify if the calculation finished.
On the second machine, compiling works just as for the older versions.
However, p2y will crash with

***************************** p2y output **************************
<---> DBs path set to : .
<---> detected QE data format : qexsd
<---> == PWscf v.6.x generated data (QEXSD fmt) ==
<---> Header/K-points/Energies... done
<03s> Cell data...
... the usual stuff here ...
<05s> == DB1 (Gvecs and more) ...
[ERROR] Writing File ./SAVE//ns.db1; Variable NOT DEFINED; Permission denied
***************************** p2y output **************************

The same happens in the next step for "yambo" (without options)
if I generate the database with a previous version.

Note that there are two spaces between "Variable" and "NOT DEFINED",
so I assume that some variable's name is an empty string.
Could that be a netcdf problem?

Any help would be appreciated.


Best,

Christian
Christian Koenig
Tyndall National Institute
Cork, Ireland

andrea.ferretti
Posts: 214
Joined: Fri Jan 31, 2014 11:13 am

Re: Error writing ndb.QP file during evGWo

Post by andrea.ferretti » Thu Feb 18, 2021 10:48 am

Dear Christian,

thanks for reporting... this is quite puzzling. This could be surely related to some compilation issue somehow related to or affecting netcdf.
Alternatively, a variable name getting empty ?

In order to help it would be useful if you could send the config.log file (where one should also be able to understand a bit about the underlying machine)

take care
Andrea
Andrea Ferretti, PhD
CNR-NANO-S3 and MaX Centre
via Campi 213/A, 41125, Modena, Italy
Tel: +39 059 2055322; Skype: andrea_ferretti
URL: http://www.nano.cnr.it

Christian Koenig
Posts: 34
Joined: Mon Nov 18, 2019 10:48 am

Re: Error writing ndb.QP file during evGWo

Post by Christian Koenig » Thu Feb 18, 2021 7:52 pm

Dear Andrea,

Thanks for the response. I figured out that the problem is indeed caused by netcdf and I can now run the code on both machines.

When compiling yambo version 5.0.0, netcdf v4 is used by default. My old binaries were linked to v3.
I also observed that during "make all" a warning appeared that a shared library (of netcdf) was linked against a static library.
Not sure if this was specific to me or if this is a problem in the Makefile if those libraries are not pre-installed.
Thus, either v3 and v4 of netcdf were not compatible here - or the linker problem caused the crash at runtime.

The solution for me was to use the option "--enable-netcdf-v3" with configure.
Hopefully this helps if someone encounters the same problem again.


Best regards

Christian
Christian Koenig
Tyndall National Institute
Cork, Ireland

User avatar
Davide Sangalli
Posts: 641
Joined: Tue May 29, 2012 4:49 pm
Location: Via Salaria Km 29.3, CP 10, 00016, Monterotondo Stazione, Italy
Contact:

Re: Error writing ndb.QP file during evGWo

Post by Davide Sangalli » Tue Mar 02, 2021 12:45 pm

Just a comment.
NETCDF v4 library is fully capable to read files created with NETCDF v3.
The other way around does not work.

You can compile yambo with v3, but yambo_rt will not work.
Thus it is suggested to use v4.

Best,
D.
Davide Sangalli, PhD
CNR-ISM, Division of Ultrafast Processes in Materials (FLASHit) and MaX Centre
https://sites.google.com/view/davidesangalli
http://www.max-centre.eu/

Locked