TheShellshock67
Dabbler
- Joined
- Feb 22, 2013
- Messages
- 25
Dear Freenas magics,
I do not know if this is the right place to start this thread, if not please correct me :p
Since approx. a week i've been getting a lot of errors on my freenas box.
This goes hand in hand with a complete hang and VM's that Bluescreen.
errors that are scrolling past when it hangs:
Things i've tried so far:
-Disable Jumbo Frames on all machines that use iSCSI to this Freenas machine
-Checked if all network ports use 1Gbits network
Does anyone know or have suggestions on how to resolve this?
Thanks,
Bryan Wilms
I do not know if this is the right place to start this thread, if not please correct me :p
Since approx. a week i've been getting a lot of errors on my freenas box.
This goes hand in hand with a complete hang and VM's that Bluescreen.
errors that are scrolling past when it hangs:
tail -f /var/log/messages
Dec 12 16:53:51 vault WARNING: 10.88.1.3 (iqn.1991-05.com.microsoft:Hyper-VServer03.domain): connection error; dropping connection
Dec 12 16:53:51 vault WARNING: 10.88.1.3 (iqn.1991-05.com.microsoft:Hyper-VServer03.domain): waiting for CTL to terminate 20 tasks
Dec 12 16:53:52 vault WARNING: 10.88.1.3 (iqn.1991-05.com.microsoft:Hyper-VServer03.domain): connection error; dropping connection
Dec 12 16:53:52 vault WARNING: 10.88.1.3 (iqn.1991-05.com.microsoft:Hyper-VServer03.domain): waiting for CTL to terminate 2 tasks
Dec 12 16:53:53 vault WARNING: 10.88.1.2 (iqn.1991-05.com.microsoft:Hyper-VServer02.domain): connection error; dropping connection
Dec 12 16:53:53 vault WARNING: 10.88.1.2 (iqn.1991-05.com.microsoft:Hyper-VServer02.domain): waiting for CTL to terminate 8 tasks
Dec 12 16:53:53 vault WARNING: 10.88.1.3 (iqn.1991-05.com.microsoft:Hyper-VServer03.domain): connection error; dropping connection
Dec 12 16:53:53 vault WARNING: 10.88.1.3 (iqn.1991-05.com.microsoft:Hyper-VServer03.domain): waiting for CTL to terminate 2 tasks
Dec 12 16:53:56 vault WARNING: 10.88.1.3 (iqn.1991-05.com.microsoft:Hyper-VServer03.domain): no ping reply (NOP-Out) after 5 seconds; dropping connection
Dec 12 16:53:56 vault WARNING: 10.88.1.3 (iqn.1991-05.com.microsoft:Hyper-VServer03.domain): waiting for CTL to terminate 1 tasks
Dec 12 16:53:57 vault WARNING: 10.88.1.3 (iqn.1991-05.com.microsoft:Hyper-VServer03.domain): no ping reply (NOP-Out) after 5 seconds; dropping connection
Dec 12 16:53:57 vault WARNING: 10.88.1.3 (iqn.1991-05.com.microsoft:Hyper-VServer03.domain): waiting for CTL to terminate 1 tasks
Dec 12 16:53:58 vault WARNING: 10.88.1.2 (iqn.1991-05.com.microsoft:Hyper-VServer02.domain): no ping reply (NOP-Out) after 5 seconds; dropping connection
Dec 12 16:53:58 vault WARNING: 10.88.1.2 (iqn.1991-05.com.microsoft:Hyper-VServer02.domain): waiting for CTL to terminate 1 tasks
Dec 12 16:53:58 vault WARNING: 10.88.1.3 (iqn.1991-05.com.microsoft:Hyper-VServer03.domain): no ping reply (NOP-Out) after 5 seconds; dropping connection
Dec 12 16:53:58 vault WARNING: 10.88.1.3 (iqn.1991-05.com.microsoft:Hyper-VServer03.domain): waiting for CTL to terminate 1 tasks
Dec 12 16:54:19 vault WARNING: 10.88.1.3 (iqn.1991-05.com.microsoft:Hyper-VServer03.domain): connection error; dropping connection
Dec 12 16:54:19 vault WARNING: 10.88.1.3 (iqn.1991-05.com.microsoft:Hyper-VServer03.domain): waiting for CTL to terminate 2 tasks
Dec 12 16:54:21 vault WARNING: 10.88.1.2 (iqn.1991-05.com.microsoft:Hyper-VServer02.domain): connection error; dropping connection
Dec 12 16:54:21 vault WARNING: 10.88.1.2 (iqn.1991-05.com.microsoft:Hyper-VServer02.domain): waiting for CTL to terminate 2 tasks
Dec 12 16:54:24 vault WARNING: 10.88.1.3 (iqn.1991-05.com.microsoft:Hyper-VServer03.domain): no ping reply (NOP-Out) after 5 seconds; dropping connection
Dec 12 16:54:24 vault WARNING: 10.88.1.3 (iqn.1991-05.com.microsoft:Hyper-VServer03.domain): waiting for CTL to terminate 1 tasks
Dec 12 16:54:25 vault (1:14:0/2): WRITE(10). CDB: 2a 00 1f b9 0e c0 00 00 40 00
Dec 12 16:54:25 vault (1:14:0/2): Tag: 0x90f69700, type 1
Dec 12 16:54:25 vault (1:14:0/2): ctl_process_done: 111 seconds
Dec 12 16:54:25 vault (1:15:0/3): PERSISTENT RESERVE IN. CDB: 5e 00 00 00 00 00 00 08 08 00
Dec 12 16:54:25 vault (1:15:0/3): Tag: 0xe4ba1600, type 1
Dec 12 16:54:25 vault (1:15:0/3): ctl_process_done: 111 seconds
Dec 12 16:54:25 vault (1:9:0/12): PERSISTENT RESERVE IN. CDB: 5e 00 00 00 00 00 00 08 08 00
Dec 12 16:54:25 vault (1:9:0/12): Tag: 0x87f11500, type 1
Dec 12 16:54:25 vault (1:9:0/12): ctl_process_done: 111 seconds
Dec 12 16:54:25 vault (0:14:0/2): WRITE(10). CDB: 2a 08 18 cc 9f d8 00 00 08 00
Dec 12 16:54:25 vault (0:14:0/2): Tag: 0xa20ea900, type 1
Dec 12 16:54:25 vault (0:14:0/2): ctl_process_done: 110 seconds
Dec 12 16:54:25 vault (0:14:0/2): PERSISTENT RESERVE IN. CDB: 5e 00 00 00 00 00 00 08 08 00
Dec 12 16:54:25 vault (0:14:0/2): Tag: 0xa30ea900, type 1
Dec 12 16:54:25 vault (0:14:0/2): ctl_process_done: 110 seconds
Dec 12 16:54:25 vault (1:14:0/2): MODE SENSE(6). CDB: 1a 00 3f 00 c0 00
Dec 12 16:54:25 vault (1:14:0/2): Tag: 0x91f69700, type 1
Dec 12 16:54:25 vault (1:14:0/2): ctl_process_done: 109 seconds
Dec 12 16:54:25 vault (1:14:0/2): MODE SENSE(6). CDB: 1a 00 3f 00 c0 00
Dec 12 16:54:25 vault (1:14:0/2): Tag: 0x92f69700, type 1
Dec 12 16:54:25 vault (1:14:0/2): ctl_process_done: 109 seconds
Dec 12 16:54:25 vault (1:14:0/2): MODE SENSE(6). CDB: 1a 00 3f 00 c0 00
Dec 12 16:54:25 vault (1:14:0/2): Tag: 0x93f69700, type 1
Dec 12 16:54:25 vault (1:14:0/2): ctl_process_done: 109 seconds
Dec 12 16:54:25 vault (1:14:0/2): MODE SENSE(6). CDB: 1a 00 3f 00 c0 00
Dec 12 16:54:25 vault (1:14:0/2): Tag: 0x94f69700, type 1
Dec 12 16:54:25 vault (1:14:0/2): ctl_process_done: 109 seconds
Dec 12 16:54:25 vault (0:14:0/2): WRITE(10). CDB: 2a 00 05 97 3c 90 00 00 10 00
Dec 12 16:54:25 vault (0:14:0/2): Tag: 0xa40ea900, type 1
Dec 12 16:54:25 vault (0:14:0/2): ctl_process_done: 109 seconds
Dec 12 16:54:25 vault (1:14:0/2): WRITE(10). CDB: 2a 08 55 8c 1a 73 00 00 68 00
Dec 12 16:54:25 vault (1:14:0/2): Tag: 0x95f69700, type 1
Dec 12 16:54:25 vault (1:14:0/2): ctl_process_done: 104 seconds
Dec 12 16:54:25 vault (1:14:0/2): MODE SENSE(6). CDB: 1a 00 3f 00 c0 00
Dec 12 16:54:25 vault (1:14:0/2): Tag: 0x96f69700, type 1
Dec 12 16:54:25 vault (1:14:0/2): ctl_process_done: 104 seconds
Dec 12 16:54:25 vault (1:14:0/2): MODE SENSE(6). CDB: 1a 00 3f 00 c0 00
Dec 12 16:54:25 vault (1:14:0/2): Tag: 0x97f69700, type 1
Dec 12 16:54:25 vault (1:14:0/2): ctl_process_done: 104 seconds
Dec 12 16:54:25 vault (1:14:0/2): MODE SENSE(6). CDB: 1a 00 3f 00 c0 00
Dec 12 16:54:25 vault (1:14:0/2): Tag: 0x98f69700, type 1
Dec 12 16:54:25 vault (1:14:0/2): ctl_process_done: 103 seconds
Dec 12 16:54:25 vault (1:14:0/2): MODE SENSE(6). CDB: 1a 00 3f 00 c0 00
Dec 12 16:54:25 vault (1:14:0/2): Tag: 0x99f69700, type 1
Dec 12 16:54:25 vault (1:14:0/2): ctl_process_done: 103 seconds
Dec 12 16:54:25 vault (1:14:0/2): MODE SENSE(6). CDB: 1a 00 3f 00 c0 00
Dec 12 16:54:25 vault (1:14:0/2): Tag: 0x9af69700, type 1
Dec 12 16:54:25 vault (1:14:0/2): ctl_process_done: 98 seconds
Dec 12 16:54:25 vault (1:14:0/2): MODE SENSE(6). CDB: 1a 00 3f 00 c0 00
Dec 12 16:54:25 vault (1:14:0/2): Tag: 0x9bf69700, type 1
Dec 12 16:54:25 vault (1:14:0/2): ctl_process_done: 98 seconds
Dec 12 16:54:25 vault (1:14:0/2): MODE SENSE(6). CDB: 1a 00 3f 00 c0 00
Dec 12 16:54:25 vault (1:14:0/2): Tag: 0x9cf69700, type 1
Dec 12 16:54:25 vault (1:14:0/2): ctl_process_done: 97 seconds
Dec 12 16:54:25 vault (1:14:0/2): MODE SENSE(6). CDB: 1a 00 3f 00 c0 00
Dec 12 16:54:25 vault (1:14:0/2): Tag: 0x9df69700, type 1
Dec 12 16:54:25 vault (1:14:0/2): ctl_process_done: 97 seconds
Dec 12 16:54:25 vault (1:14:0/2): WRITE(10). CDB: 2a 00 55 32 c7 e6 00 00 01 00
Dec 12 16:54:25 vault (1:14:0/2): Tag: 0x9ef69700, type 1
Dec 12 16:54:25 vault (1:14:0/2): ctl_process_done: 96 seconds
Dec 12 16:54:25 vault (1:14:0/2): MODE SENSE(6). CDB: 1a 00 3f 00 c0 00
Dec 12 16:54:25 vault (1:14:0/2): Tag: 0x9ff69700, type 1
Dec 12 16:54:25 vault (1:14:0/2): ctl_process_done: 93 seconds
Dec 12 16:54:25 vault (1:14:0/2): MODE SENSE(6). CDB: 1a 00 3f 00 c0 00
Dec 12 16:54:25 vault (1:14:0/2): Tag: 0xa0f69700, type 1
Dec 12 16:54:25 vault (1:14:0/2): ctl_process_done: 92 seconds
Dec 12 16:54:25 vault (0:14:0/2): WRITE(10). CDB: 2a 08 18 c8 76 18 00 00 08 00
Dec 12 16:54:25 vault (0:14:0/2): Tag: 0xa50ea900, type 1
Dec 12 16:54:25 vault (0:14:0/2): ctl_process_done: 92 seconds
Dec 12 16:54:25 vault (1:14:0/2): MODE SENSE(6). CDB: 1a 00 3f 00 c0 00
Dec 12 16:54:25 vault (1:14:0/2): Tag: 0xa1f69700, type 1
Dec 12 16:54:25 vault (1:14:0/2): ctl_process_done: 91 seconds
Dec 12 16:54:25 vault (1:14:0/2): MODE SENSE(6). CDB: 1a 00 3f 00 c0 00
Dec 12 16:54:25 vault (1:14:0/2): Tag: 0xa2f69700, type 1
Dec 12 16:54:25 vault (1:14:0/2): ctl_process_done: 91 seconds
Dec 12 16:54:25 vault WARNING: 10.88.1.2 (iqn.1991-05.com.microsoft:Hyper-VServer02.domain): tasks terminated
Dec 12 16:54:25 vault WARNING: 10.88.1.3 (iqn.1991-05.com.microsoft:Hyper-VServer03.domain): tasks terminated
Dec 12 16:54:25 vault (0:14:0/2): EXTENDED COPY. CDB: 83 11 00 00 00 00 00 00 28 c2 00 00 02 28 00 00
Dec 12 16:54:25 vault (0:14:0/2): Tag: 0xa10ea900, type 1
Dec 12 16:54:25 vault (0:14:0/2): ctl_process_done: 111 seconds
Dec 12 16:54:25 vault WARNING: 10.88.1.3 (iqn.1991-05.com.microsoft:Hyper-VServer03.domain): tasks terminated
Dec 12 16:54:25 vault WARNING: 10.88.1.2 (iqn.1991-05.com.microsoft:Hyper-VServer02.domain): tasks terminated
Things i've tried so far:
-Disable Jumbo Frames on all machines that use iSCSI to this Freenas machine
-Checked if all network ports use 1Gbits network
Does anyone know or have suggestions on how to resolve this?
Thanks,
Bryan Wilms