New CTL Warnings - connection error; dropping connection

[Steven Sedory]

We recently ran updates on two of our SANs, putting both of them at Build FreeNAS-9.3-STABLE-201601181840.

These two boxes are at different locations, completely unrelated, and both provide VM storage via iSCSI for Hyper V. We have other similar boxes, that I have not updated yet.

Only on these two, and starting a day or two after the upgrade, I've received the following or similar errors, but there is no other negative symptoms that I can tell. This is the most recent lines of the console message log:

Feb 6 00:00:00 hvstorage01 syslog-ng[2851]: Configuration reload request received, reloading configuration;
Feb 7 00:00:00 hvstorage01 syslog-ng[2851]: Configuration reload request received, reloading configuration;
Feb 8 00:00:00 hvstorage01 syslog-ng[2851]: Configuration reload request received, reloading configuration;
Feb 9 00:00:00 hvstorage01 syslog-ng[2851]: Configuration reload request received, reloading configuration;
Feb 10 00:00:00 hvstorage01 syslog-ng[2851]: Configuration reload request received, reloading configuration;
Feb 10 00:00:27 hvstorage01 WARNING: 10.30.1.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): connection error; dropping connection
Feb 10 00:00:27 hvstorage01 WARNING: 10.30.1.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): connection error; dropping connection
Feb 10 00:00:27 hvstorage01 WARNING: 10.30.0.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): connection error; dropping connection
Feb 10 00:00:27 hvstorage01 WARNING: 10.30.0.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): connection error; dropping connection
Feb 10 00:00:27 hvstorage01 WARNING: 10.30.1.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): connection error; dropping connection
Feb 10 00:00:28 hvstorage01 WARNING: 10.30.1.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): waiting for CTL to terminate 1 tasks
Feb 10 00:00:28 hvstorage01 WARNING: 10.30.0.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): connection error; dropping connection
Feb 10 00:00:28 hvstorage01 WARNING: 10.30.1.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): tasks terminated
Feb 10 00:00:28 hvstorage01 WARNING: 10.30.0.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): waiting for CTL to terminate 1 tasks
Feb 10 00:00:28 hvstorage01 WARNING: 10.30.0.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): tasks terminated
Feb 10 00:15:36 hvstorage01 WARNING: 10.30.0.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): connection error; dropping connection
Feb 10 00:15:36 hvstorage01 WARNING: 10.30.0.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): connection error; dropping connection
Feb 10 00:15:36 hvstorage01 WARNING: 10.30.0.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): connection error; dropping connection
Feb 10 00:15:46 hvstorage01 WARNING: 10.30.1.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): connection error; dropping connection
Feb 10 00:15:46 hvstorage01 WARNING: 10.30.1.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): connection error; dropping connection
Feb 10 00:15:46 hvstorage01 WARNING: 10.30.1.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): connection error; dropping connection
Feb 10 04:02:10 hvstorage01 WARNING: 10.30.0.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): connection error; dropping connection
Feb 10 04:02:10 hvstorage01 WARNING: 10.30.0.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): connection error; dropping connection
Feb 10 04:02:10 hvstorage01 WARNING: 10.30.0.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): connection error; dropping connection
Feb 11 00:00:01 hvstorage01 syslog-ng[2851]: Configuration reload request received, reloading configuration;
Feb 11 15:38:44 hvstorage01 WARNING: 10.30.1.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): connection error; dropping connection
Feb 11 15:38:44 hvstorage01 WARNING: 10.30.1.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): connection error; dropping connection
Feb 11 15:38:44 hvstorage01 WARNING: 10.30.1.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): waiting for CTL to terminate 7 tasks
Feb 11 15:38:44 hvstorage01 WARNING: 10.30.1.2 (iqn.1991-05.com.microsoft:hvhost01.cno01.calvarycch.org): tasks terminated
Feb 12 00:00:00 hvstorage01 syslog-ng[2851]: Configuration reload request received, reloading configuration;

Is this something I should be worried about? Is there something I can do to get more information?

 

[Montel Bahn]

OK since i can't edit in order to delete my trolly comments, IDK check you time issues</placeholder>

 

[Steven Sedory]

Can you give me a little more info? Server time seems to be fine..

 

[Montel Bahn]

I don't want to waste your time; I apparently can't even work the forum options properly, and sorry this is WAY out of my league.
I've never even Updated yet, if that adds some color. What I just read about it in the Guide sounds impressive. I assume you double checked that you ARE on the correct Train, i.e. NOT the 'Nightlies'?

You can roll back the Updates right? if you wanted/needed to (I'm NOT suggesting you do that!), but this trivial reassurance is all I have.

 

[dlavigne]

You can ignore the first 5 syslog reload config lines as they are normal.

I'm not sure about the IQN messages, but if all is working normally you should be able to ignore those as well (it may just be a chatty initiator).

 

[Steven Sedory]

Thanks for the info.

So far, everything seems okay, so perhaps (and hopefully) it is just chatty. Seems to be new since the recent update I mentioned.

 

[m0nkey_]

You've not posted any details about the hardware you're using. You're more likely to get a proper response by doing so.

 

[bestboy]

Not sure if it is related, but I get a different, yet kind of similar message for my iSCSI target mounted in Windows 7

Code:

WARNING: 172.23.23.11 (iqn.1991-05.com.microsoft:mirakuru): no ping reply (NOP-Out) after 5 seconds; dropping connection

I get this message in the log whenever I shut down the Windows 7 box. It seems the Windows iSCSI initiator doesn't close the connection actively.